[Gretl-devel] Re: numerical overflow problem? (with $huge and int())
Am 02.12.22 um 14:38 schrieb Sven Schreiber:
Am 01.12.2022 um 19:25 schrieb Marcin Błażejowski:
> On 1.12.2022 17:51, Sven Schreiber wrote:
>>
>> ? eval int($huge)
>> -2.1474836e+009
>
> Hmm,
>
> if ($huge==1e+100) I would't say it is an issue, since it's far beyond
> 32 bits integer.
Yes, may be a valid point (let's hear Allin's final word). But what
about Sven's 2nd case?
I would expect this to work:
<hansl>
assert(int($huge) == 2147483647)
assert(int(-$huge) == -2147483647)
</hansl>
but currently either int($huge) or int(-$huge) returns the wrong sign,
right?
Artur