[Octave-bug-tracker] [bug #50575] Integer overflow in whos when calculating total elements in matrix

[anonymous]

URL:
  <http://savannah.gnu.org/bugs/?50575>

                 Summary: Integer overflow in whos when calculating total
elements in matrix
                 Project: GNU Octave
            Submitted by: None
            Submitted on: Sat 18 Mar 2017 12:22:04 PM UTC
                Category: None
                Severity: 3 - Normal
                Priority: 5 - Normal
              Item Group: None
                  Status: None
             Assigned to: None
         Originator Name: Mark Yagnatinsky
        Originator Email: address@hidden
             Open/Closed: Open
         Discussion Lock: Any
                 Release: 3.8.1
        Operating System: GNU/Linux

    _______________________________________________________

Details:

On Ubuntu 14.04, the following occurs; worth noting that
46340^2 < 2^31 < 46341^2.  Might also be worth checking if the bytes
calculation is correct; I can't seem to allocate a matrix big enough to test
this: magic(3e4) fails for me.

octave:1> eye(46340);whos;eye(46341);whos
Variables in the current scope:

   Attr Name        Size                     Bytes  Class
   ==== ====        ====                     =====  =====
        ans     46340x46340                 370720  double

Total is 2147395600 elements using 370720 bytes

Variables in the current scope:

   Attr Name        Size                     Bytes  Class
   ==== ====        ====                     =====  =====
        ans     46341x46341                 370728  double

Total is 18446744071562072601 elements using 370728 bytes




    _______________________________________________________

Reply to this item at:

  <http://savannah.gnu.org/bugs/?50575>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.gnu.org/