octave-bug-tracker
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Octave-bug-tracker] [bug #58908] same non-zero output becomes zero sudd


From: Torsten Lilge
Subject: [Octave-bug-tracker] [bug #58908] same non-zero output becomes zero suddenly
Date: Fri, 7 Aug 2020 01:32:20 -0400 (EDT)
User-agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36

Follow-up Comment #1, bug #58908 (project octave):

I think this is just the limitation given by the accuracy that is provided by
the double format. AFAIK, this 64 bit long number representation has 55 digits
mantissa. Taking into account that 10 binary digits represent numbers up to
approximately 3 decimal digits, then the numbers in your second example are
near to the available precision.

    _______________________________________________________

Reply to this item at:

  <https://savannah.gnu.org/bugs/?58908>

_______________________________________________
  Message sent via Savannah
  https://savannah.gnu.org/




reply via email to

[Prev in Thread] Current Thread [Next in Thread]