[Date Prev][Date Next][Thread Prev][Thread Next]
- Subject: Re: Hidden integers...
- From: Reuben Thomas <rrt@...>
- Date: Wed, 18 Apr 2001 12:34:08 +0100 (BST)
> Sounds like you were running up against the same sort of issues we were.
> It's a pain to have to use epsilon values to fix float/int conversions all
> the time, and try to find out where and why 8.99999999982 didn't convert
> correctly to integer 9 in your code.
I didn't have any problems with rounding: I was using only integral values
in the range exactly representable by double, so all calculations were exact
(I was using only +, - and logical operations).
> Theres a small error that crops up and gets worse in floating point when
> doing multiplys and divides.
...which I wasn't doing.
http://sc3d.org/rrt/ | Si hoc legere scis nimium eruditionis habes.