Re: Comment about IEEE floating-point rounding... (was: Setting Float Precision in Lua.c)

lua-l archive

[Date Prev][Date Next][Thread Prev][Thread Next] [Date Index] [Thread Index]

Subject: Re: Comment about IEEE floating-point rounding... (was: Setting Float Precision in Lua.c)
From: Luiz Henrique de Figueiredo <lhf@...>
Date: Tue, 26 Jun 2018 15:08:30 -0300

>> print(1e97 % 97)
> 3.0
>
> I don't think any of these are right.

The correct result is 10 because of Fermat's little theorem[1] since
97 is prime.

[1] https://en.wikipedia.org/wiki/Fermat%27s_little_theorem

References:
- Comment about IEEE floating-point rounding... (was: Setting Float Precision in Lua.c), sur-behoffski
- Re: Comment about IEEE floating-point rounding... (was: Setting Float Precision in Lua.c), Hugo Musso Gualandi
- Re: Comment about IEEE floating-point rounding... (was: Setting Float Precision in Lua.c), Albert Chan
- Re: Comment about IEEE floating-point rounding... (was: Setting Float Precision in Lua.c), Albert Chan
- Re: Comment about IEEE floating-point rounding... (was: Setting Float Precision in Lua.c), Dirk Laurie
- Re: Comment about IEEE floating-point rounding... (was: Setting Float Precision in Lua.c), Sean Conner

Prev by Date: Re: Comment about IEEE floating-point rounding... (was: Setting Float Precision in Lua.c)
Next by Date: Re: Comment about IEEE floating-point rounding... (was: Setting Float Precision in Lua.c)
Previous by thread: Re: Comment about IEEE floating-point rounding... (was: Setting Float Precision in Lua.c)
Next by thread: Re: Comment about IEEE floating-point rounding... (was: Setting Float Precision in Lua.c)
Index(es):
- Date
- Thread