[Octave-bug-tracker] [bug #53683] numerical output format for float values with magnitude greater than precision is wrong

[Dan Sebald]

Follow-up Comment #6, bug #53683 (project octave):

Well, I'd say that current behavior is wrong, no matter the interpretation. 
I'm not a real stickler for exact compatibility, but the issue here is that
Matlab appears to be saying nothing about "precision" or (what Octave states
in the documentation) "with 5 significant figures".  To me, "significant
figures" can only be interpreted as precision, and Octave is sort of doing
that in the first half of the progression below.  Anyway, Matlab just says "4
digits after the decimal point".  Perhaps once that no longer makes reasonable
sense, then it switches to exponent notation.

    _______________________________________________________

Reply to this item at:

  <http://savannah.gnu.org/bugs/?53683>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.gnu.org/