[Octave-bug-tracker] [bug #63791] movmean - out of memory or dimension too large for index type

[Liang Tang]

Follow-up Comment #11, bug #63791 (project octave):

I don't understand what is the method used in Octave movmean. So I can only
report back as I am told.  My original observation was that there is a
x(1000000) and there is a slc of 1000000*513.  Given the size of slc, I don't
know what is it for and what to do with it.  Pls let me know what below is OK
to use.  Up to this point, the memory consumed by Octave mainly is for slc
allocation.  This Octave session is a clean start, nothing else other than
that single command.  


stopped in movfun>movfun_oncol at line 299
[C:\Octave\Octave-7.1.0\mingw64\share\octave\7.1.0\m\signal\movfun.m]
299:   y(C,:) = fcn (x(slcidx));
debug> whos
Variables visible from the current scope:

variables in scope: movfun_oncol:
C:\Octave\Octave-7.1.0\mingw64\share\octave\7.1.0\m\signal\movfun.m

  Attr   Name         Size                     Bytes  Class
  ====   ====         ====                     =====  =====
    f    C            1x999488                    24  double
    f    Cpos         1x256                       24  double
    f    Cpre         1x256                       24  double
         N            1x1                          8  double
         ans          1x1                          1  logical
    f    bcfunc       1x1                          0  function_handle
    f    fcn          1x1                          0  function_handle
    f    odim         1x1                          8  double
    f    slcidx     513x999488            4101898752  double
    f    win        513x1                       4104  double
    f    wlen         1x2                         16  double
    f    x      1000000x1                    8000000  double
    f    y      1000000x1                    8000000  double

Total is 515737864 elements using 4117902961 bytes

debug> memory
Octave is running on x86_64-w64-mingw32
System    RAM:  16680272 kiB,  swap:  18712852 kiB
Octave    RAM:   4182944 kiB,  virt:   8903440 kiB
Available RAM:   6157876 kiB, total:  10563836 kiB

debug> __octave_config_info__.ENABLE_64
ans = 1
debug> fcn
fcn = @mean
debug> x(slcidx)
error: out of memory or dimension too large for Octave's index type
error: called from
    movfun>movfun_oncol at line 299 column 10
    movfun at line 282 column 14
    movmean at line 138 column 5

debug> memory
Octave is running on x86_64-w64-mingw32
System    RAM:  16680272 kiB,  swap:  18712852 kiB
Octave    RAM:   8185216 kiB,  virt:  16915664 kiB
Available RAM:   2271416 kiB, total:   2792836 kiB



    _______________________________________________________

Reply to this item at:

  <https://savannah.gnu.org/bugs/?63791>

_______________________________________________
Message sent via Savannah
https://savannah.gnu.org/