[Octave-bug-tracker] [bug #43369] rats has some internal overflow

[Rik]

Update of bug #43369 (project octave):

                  Status:                    None => Confirmed              

    _______________________________________________________

Follow-up Comment #1:

The trouble is this line in libinterp/corefcn/pr-output.cc:rational_approx at
about line 404.  The loop stopping criteria above this statement should be
checking that the numerator (n) and the denominator (d) have not exceeded
std::numeric_limits<int>::max ()).


          buf << std::setprecision (0) << static_cast<int>(n)
              << "/" << static_cast<int>(d);




    _______________________________________________________

Reply to this item at:

  <http://savannah.gnu.org/bugs/?43369>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.gnu.org/