octave-bug-tracker
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Octave-bug-tracker] [bug #63848] Mean: single class inputs can overflow


From: Markus Mützel
Subject: [Octave-bug-tracker] [bug #63848] Mean: single class inputs can overflow with sum producing wrong mean
Date: Wed, 1 Mar 2023 02:44:50 -0500 (EST)

Follow-up Comment #7, bug #63848 (project octave):

Is this really an overflow issue with `sum`? The expected approximate result
of the summation (80e6*0.5) is still far from `realmax('single')` (approx.
3.4e38).
I'd guess it is an issue caused by the limited precision of floating point
numbers...


    _______________________________________________________

Reply to this item at:

  <https://savannah.gnu.org/bugs/?63848>

_______________________________________________
Message sent via Savannah
https://savannah.gnu.org/




reply via email to

[Prev in Thread] Current Thread [Next in Thread]