octave-bug-tracker
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Octave-bug-tracker] [bug #32991] format long shows more decimal digits


From: Pedro Quaresma
Subject: [Octave-bug-tracker] [bug #32991] format long shows more decimal digits than can possibly be accurate
Date: Thu, 07 Apr 2011 14:09:16 +0000
User-agent: Mozilla/5.0 (compatible; Konqueror/4.4; Linux) KHTML/4.4.5 (like Gecko)

Follow-up Comment #4, bug #32991 (project octave):

I agree with this last comment in one point, but I disagree in another point:

"Users of floating point arithmetic should know the limitations or they
shouldn't be using floating point arithmetic at all"

I agree.

But I do not agree with the solution adopted by Octave. It is not a calculus
bug (I see now that it is not, thank you for all the comments), but, in my
opinion, it is a "display bug", Octave shouldn't display 

octave:3> 322426889*404781269 
 ans = 130512365289142144 

the format long should not display, as integers, numbers that are out of range
for a correct representation, it is misleading.

    _______________________________________________________

Reply to this item at:

  <http://savannah.gnu.org/bugs/?32991>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.gnu.org/




reply via email to

[Prev in Thread] Current Thread [Next in Thread]