[Octave-bug-tracker] [bug #63848] Mean: wrong result for large single vectors

[Nicholas Jankowski]

Follow-up Comment #3, bug #63848 (project octave):

just went through fixing something similar for large ints in the statistics
pkg version of mean, which we're planning on porting to octave core now that
statistics v1.5.4 has been released. trying to maintain output type
compatibility with matlab and the 'outtype' option wasn't exactly trivial, but
once that's ported over I can look at whether things with single can be
handled similarly to how they avoided overflow with ints.  there we also had
to be careful of large ints causing precision issues with double, and that
shouldn't be an issue here.  


    _______________________________________________________

Reply to this item at:

  <https://savannah.gnu.org/bugs/?63848>

_______________________________________________
Message sent via Savannah
https://savannah.gnu.org/