Re: TESTING (was: RE: More vacuum.c refactoring ) - Mailing list pgsql-hackers

From Tom Lane
Subject Re: TESTING (was: RE: More vacuum.c refactoring )
Date
Msg-id 18780.1086989722@sss.pgh.pa.us
Whole thread Raw
In response to TESTING (was: RE: More vacuum.c refactoring )  ("Dann Corbit" <DCorbit@connx.com>)
List pgsql-hackers
"Dann Corbit" <DCorbit@connx.com> writes:
>> --- and no I have zero confidence that passing the regression 
>> tests proves anything, because all those prior bugs passed 
>> the regression tests.

> Then why didn't those bugs get added to the regression?

Because there wasn't any reasonable way to make them reproducible.

The set of things we can test in the regression tests is only a small
fraction of the interesting properties of Postgres.  This is
unfortunate but ranting about "standard practice" doesn't change it.

> I seem to recall that someone was porting the NIST suite to PostgreSQL.
> What ever happened to that effort?

It was done and we fixed a couple of bugs based on it (the one I can
think of offhand had to do with semantics of aggregate functions in
sub-selects).  I don't think there's anything more to be learned there.
        regards, tom lane


pgsql-hackers by date:

Previous
From: "Dann Corbit"
Date:
Subject: Re: [pgsql-hackers-win32] Tablespaces
Next
From: Bruce Momjian
Date:
Subject: Re: [pgsql-hackers-win32] Tablespaces