[Octave-bug-tracker] [bug #57175] Incorrect output using rref() function on integer matrix

[Mike Miller]

Follow-up Comment #2, bug #57175 (project octave):

I agree that some kind of integer rounding must be in effect with your claim
of what the correct answer ought to be.

For one more example, I used the symbolic package to compute the answer as


R = (sym 4×5 matrix)

  ⎡1  0  0  0  -13/4⎤
  ⎢                 ⎥
  ⎢            -99  ⎥
  ⎢0  1  0  0  ──── ⎥
  ⎢             20  ⎥
  ⎢                 ⎥
  ⎢0  0  1  0    2  ⎥
  ⎢                 ⎥
  ⎣0  0  0  1    4  ⎦



    _______________________________________________________

Reply to this item at:

  <https://savannah.gnu.org/bugs/?57175>

_______________________________________________
  Message sent via Savannah
  https://savannah.gnu.org/