octave-bug-tracker
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Octave-bug-tracker] [bug #60784] Inconsistent behavior for boolean matr


From: Dmitri A. Sergatskov
Subject: [Octave-bug-tracker] [bug #60784] Inconsistent behavior for boolean matrix types with matrix functions
Date: Tue, 15 Jun 2021 23:12:48 -0400 (EDT)
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Firefox/78.0

Follow-up Comment #3, bug #60784 (project octave):

And perhaps a somewhat surprising thing is:


octave:11> D=int16(B);
octave:12> whos
Variables visible from the current scope:

variables in scope: top scope

   Attr Name        Size                     Bytes  Class
   ==== ====        ====                     =====  ===== 
        A       20000x20000             3200000000  double
        B       20000x20000              400000000  logical
        C       20000x20000             1600000000  single
        D       20000x20000              800000000  int16
        ans         1x1                          8  double

Total is 1600000001 elements using 6000000008 bytes

octave:13> tic; det (D), toc
ans = 0
Elapsed time is 14.9294 seconds.
octave:14> 



It appears that int16 gets promoted to double, while single apparently not. 


Dmitri.
-- 
 




    _______________________________________________________

Reply to this item at:

  <https://savannah.gnu.org/bugs/?60784>

_______________________________________________
  Message sent via Savannah
  https://savannah.gnu.org/




reply via email to

[Prev in Thread] Current Thread [Next in Thread]