octave-maintainers
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

MS windows comparisons


From: Eric S. Carlson
Subject: MS windows comparisons
Date: Fri, 15 Dec 2006 07:05:32 -0800 (PST)

Hello,

I have run comparisons of a local build, MG's exe, and *B R14SP1 using the
benchmarks programs at:
http://www.sciviews.org/benchmark/

First, a note: This test uses a lot of looping, which tips the scales in
favor of "the real thing" - looping speed is one of the weaker points of
octave (But is rarely a problem in anything I actually do) . Any programs
sensibly written to avoid looping have comparable performance.

Second: neither Octave version uses ATLAS or MKL

Third: clearly the FFTW library is a worthy addition

My build was of the CVS image available on 12/1. Has something changed since
then that has caused a substantial slowdown in looping? Is there any reason
why a local build would have better optimization, even though the
compilers/runtime libs/build options are the same? (I think I followed the
the MSVC build instructions for msys, but who knows) 

EC

Comparisons:
EC-Local MG-exe   *BR14SP1
0.73     1.23     0.24    
0.38     0.37     0.32    
0.71     1.08     0.49    
1.39     1.22     0.12    
0.23     0.29     0.1     
----------- 
0.58     0.78     0.21    
                          
                          
                          
0.52     0.19     0.25    
0.59     0.68     0.42    
0.3      0.38     0.08    
0.35     0.35     0.1     
0.25     0.25     0.07    
-----------  
0.38     0.32     0.13    
                          
                          
                          
0.36     0.48     0.89    
0.47     0.48     0.35    
0.34     0.64     0.25    
3.67     5.55     0.01    
2.37     3.66     0.55    
-----------  
0.74     1.04     0.36    
                          
                          
12.66   16.83     4.24    
0.54     0.64     0.21   


Specifics:
Carlson Local Build Octave octave_benchmark.m:
    Octave Benchmark 2
   ==================
Number of times each test is run__________________________: 3
 
   I. Matrix calculation
   ---------------------
Creation, transp., deformation of a 1500x1500 matrix (sec): 0.7284
800x800 normal distributed random matrix ^1000______ (sec): 0.3762
Sorting of 2,000,000 random values__________________ (sec): 0.7142
700x700 cross-product matrix (b = a' * a)___________ (sec): 1.385
Linear regression over a 600x600 matrix (c = a \\ b') (sec): 0.2299
                  ------------------------------------------------------
                Trimmed geom. mean (2 extremes eliminated): 0.5806
 
   II. Matrix functions
   --------------------
FFT over 800,000 random values______________________ (sec): 0.5221
Eigenvalues of a 320x320 random matrix______________ (sec): 0.5913
Determinant of a 650x650 random matrix______________ (sec): 0.2963
Cholesky decomposition of a 900x900 matrix__________ (sec): 0.348
Inverse of a 400x400 random matrix__________________ (sec): 0.248
                  ------------------------------------------------------
                Trimmed geom. mean (2 extremes eliminated): 0.3776
 
   III. Programmation
   ------------------
750,000 Fibonacci numbers calculation (vector calc)_ (sec): 0.357
Creation of a 2250x2250 Hilbert matrix (matrix calc) (sec): 0.4743
Grand common divisors of 70,000 pairs (recursion)___ (sec): 0.3448
Creation of a 220x220 Toeplitz matrix (loops)_______ (sec): 3.674
Escoufier's method on a 37x37 matrix (mixed)________ (sec): 2.371
                  ------------------------------------------------------
                Trimmed geom. mean (2 extremes eliminated): 0.7377
 
 
Total time for all 15 tests_________________________ (sec): 12.66
Overall mean (sum of I, II and III trimmed means/3)_ (sec): 0.5448
                      --- End of test ---

_______________________________________________________________________
_______________________________________________________________________

MG exec   Octave Benchmark 2
   ==================
Number of times each test is run__________________________: 3

   I. Matrix calculation
   ---------------------
Creation, transp., deformation of a 1500x1500 matrix (sec): 1.225
800x800 normal distributed random matrix ^1000______ (sec): 0.3653
Sorting of 2,000,000 random values__________________ (sec): 1.08
700x700 cross-product matrix (b = a' * a)___________ (sec): 1.224
Linear regression over a 600x600 matrix (c = a \ b') (sec): 0.2898
                  ------------------------------------------------------
                Trimmed geom. mean (2 extremes eliminated): 0.7845

   II. Matrix functions
   --------------------
FFT over 800,000 random values______________________ (sec): 0.1886
Eigenvalues of a 320x320 random matrix______________ (sec): 0.6839
Determinant of a 650x650 random matrix______________ (sec): 0.3753
Cholesky decomposition of a 900x900 matrix__________ (sec): 0.3454
Inverse of a 400x400 random matrix__________________ (sec): 0.2482
                  ------------------------------------------------------
                Trimmed geom. mean (2 extremes eliminated): 0.3181

   III. Programmation
   ------------------
750,000 Fibonacci numbers calculation (vector calc)_ (sec): 0.4786
Creation of a 2250x2250 Hilbert matrix (matrix calc) (sec): 0.4781
Grand common divisors of 70,000 pairs (recursion)___ (sec): 0.6357
Creation of a 220x220 Toeplitz matrix (loops)_______ (sec): 5.548
Escoufier's method on a 37x37 matrix (mixed)________ (sec): 3.661
                  ------------------------------------------------------
                Trimmed geom. mean (2 extremes eliminated): 1.037


Total time for all 15 tests_________________________ (sec): 16.83
Overall mean (sum of I, II and III trimmed means/3)_ (sec): 0.6372
                      --- End of test ---
_______________________________________________________________________
_______________________________________________________________________
*BR14SP1  Benchmark 2
   ==================
Number of times each test is run__________________________: 3

   I. Matrix calculation
   ---------------------
Creation, transp., deformation of a 1500x1500 matrix (sec): 0.24467
800x800 normal distributed random matrix ^1000______ (sec): 0.31767
Sorting of 2,000,000 random values__________________ (sec): 0.49467
700x700 cross-product matrix (b = a' * a)___________ (sec): 0.12033
Linear regression over a 600x600 matrix (c = a \ b') (sec): 0.10433
                  ------------------------------------------------------
                Trimmed geom. mean (2 extremes eliminated): 0.21069

   II. Matrix functions
   --------------------
FFT over 800,000 random values______________________ (sec): 0.24967
Eigenvalues of a 320x320 random matrix______________ (sec): 0.422
Determinant of a 650x650 random matrix______________ (sec): 0.083333
Cholesky decomposition of a 900x900 matrix__________ (sec): 0.099
Inverse of a 400x400 random matrix__________________ (sec): 0.067667
                  ------------------------------------------------------
                Trimmed geom. mean (2 extremes eliminated): 0.12723

   III. Programmation
   ------------------
750,000 Fibonacci numbers calculation (vector calc)_ (sec): 0.88533
Creation of a 2250x2250 Hilbert matrix (matrix calc) (sec): 0.354
Grand common divisors of 70,000 pairs (recursion)___ (sec): 0.245
Creation of a 220x220 Toeplitz matrix (loops)_______ (sec): 0.0053333
Escoufier's method on a 37x37 matrix (mixed)________ (sec): 0.546
                  ------------------------------------------------------
                Trimmed geom. mean (2 extremes eliminated): 0.36179


Total time for all 15 tests_________________________ (sec): 4.239
Overall mean (sum of I, II and III trimmed means/3)_ (sec): 0.21326
                      --- End of test ---



-- 
View this message in context: 
http://www.nabble.com/MS-windows-comparisons-tf2827526.html#a7893017
Sent from the Octave - Maintainers mailing list archive at Nabble.com.



reply via email to

[Prev in Thread] Current Thread [Next in Thread]