[Gretl-devel] Re: numerical overflow problem? (with $huge and int())
Am 01.12.2022 um 17:51 schrieb Sven Schreiber:
totally different small issue:
? eval int($huge)
-2.1474836e+009
... as opposed to floor($huge) and round($huge), which work as
expected. BTW, int(-$huge) is also negative, the same number.
Off-list discussion revealed that the overflow issue with int() is not a
surprise, although it remains debatable whether the average user is
expected to know when to stop using int(). The alternative being to
return NA.
An additional sentence in the documentation which states that there are
some subtle differences between the behaviors of int(), round(), and
floor(), was also seen as useful.
cheers
sven
Attachments:
- attachment.htm (text/html — 1.1 KB)