Re: [HACKERS] 123.45 - 123 = 0.45 - Mailing list pgsql-hackers

From Bruce Momjian
Subject Re: [HACKERS] 123.45 - 123 = 0.45
Date
Msg-id 199812151653.LAA16720@candle.pha.pa.us
Whole thread Raw
In response to RE: [HACKERS] 123.45 - 123 = 0.45  ("Jackson, DeJuan" <djackson@cpsgroup.com>)
List pgsql-hackers
> > Yes, someone pointed this out to me in private e-mail, and I wrote a C
> > program to confirm it.  I just had never seen such rounding on such
> > small non-irrational numbers.
> But, the problem is that it is irrational in base 2 (or at least so many
> digits that it won't fit).

Ah, I figured that out after I sent the message.

--  Bruce Momjian                        |  http://www.op.net/~candle maillist@candle.pha.pa.us            |  (610)
853-3000+  If your life is a hard drive,     |  830 Blythe Avenue +  Christ can be your backup.        |  Drexel Hill,
Pennsylvania19026
 


pgsql-hackers by date:

Previous
From: Tom Lane
Date:
Subject: Re: [HACKERS] 123.45 - 123 = 0.45
Next
From: "Thomas G. Lockhart"
Date:
Subject: Re: [COMMITTERS] 'pgsql/src/backend/utils/adt nabstime.c'