[Octave-bug-tracker] [bug #61143] Functions sum and mean returns wrong answer for single precision input

[John W. Eaton]

Follow-up Comment #7, bug #61143 (project octave):

Can reordering ever help this case?


sum ([flintmax, 1])


Performing the summation using double can also help, but only until it
doesn't.  I don't think there is a simple "fix" for this problem except to
understand that numerical computations using a floating point representation
are not exact.  You kind of have to know what you are doing.  I don't see a
way around that.

    _______________________________________________________

Reply to this item at:

  <https://savannah.gnu.org/bugs/?61143>

_______________________________________________
  Message sent via Savannah
  https://savannah.gnu.org/