octave-bug-tracker
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Octave-bug-tracker] [bug #53293] uint64 are truncated


From: anonymous
Subject: [Octave-bug-tracker] [bug #53293] uint64 are truncated
Date: Tue, 6 Mar 2018 06:02:54 -0500 (EST)
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Firefox/52.0

Follow-up Comment #1, bug #53293 (project octave):

I got the same results in Debian GNU/Linux amd64.

But I think this is NOT a bug.

Because in Octave a numeric constant literal, such as 7189901176607676539,
18446744073709551615, 0xffffffffffffffff, is type of double.
(See also the help text of function "isinteger")
But IEEE754 double only has about 52-bit significant digit. As a result, the
lower bits of a large number is actually "truncated by double", not truncated
by uint64.
(See also the help text of function "flintmax")


    _______________________________________________________

Reply to this item at:

  <http://savannah.gnu.org/bugs/?53293>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.gnu.org/




reply via email to

[Prev in Thread] Current Thread [Next in Thread]