[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[gnugo-devel] Node counts, etc
|
From: |
Evan Berggren Daniel |
|
Subject: |
[gnugo-devel] Node counts, etc |
|
Date: |
Thu, 10 Apr 2003 16:36:38 -0400 (EDT) |
In case others are interested, I have collected some information on
performance and regression deltas for various options, for
gnugo-3.3.18-pre3.
Data is for stock cvs, cvs with owl node limit = 1200, cvs with owl node
limit 10000 and cache size 128MB, and cvs at level 12 with owl node limit
10000 and cache 128MB.
Summary: increasing the owl node limit right now wouldn't change much, but
would cost < 5% in performance; might be worth it, but only to simplify
debugging. Level 12 runs at about half the speed as measured by node
counts, with a large delta. Increasing the hashtable cache size somewhat
is probably a good idea, and definitely so with level > 10.
Evan Daniel
Stock cvs:
reading 19.30 82845 0 0
owl 487.24 20042754 18634 86497
owl_rot 8.11 297451 95 1504
ld_owl 82.69 2783698 11446 529
optics 9.05 273138 0 1009
filllib 44.53 1053199 888 6804
atari_atari 58.33 2256335 1737 7353
connection 104.54 5432473 0 45876
blunder 68.77 2496418 1993 9604
trevora 321.32 14132104 56167 46111
nngs1 938.32 46568770 64005 169860
strategy 840.27 39552410 69361 170625
endgame 54.25 1219479 601 12384
heikki 19.68 1124133 1511 3848
neurogo 576.06 23035399 53868 53053
arb 99.73 3684432 5225 9057
rosebud 23.90 1504813 1607 5928
golife 76.34 3179965 11758 3820
arion 127.41 5543881 5423 17973
viking 183.07 8470345 12393 25099
ego 113.29 5177433 5466 25264
dniwog 162.92 6850374 16787 18391
lazarus 497.65 19392095 41076 53925
trevorb 490.12 23131005 30153 95611
strategy2 928.31 38613321 78270 125775
nicklas1 517.63 21600632 36977 91700
nicklas2 68.62 2757101 5994 3304
nicklas3 13.27 579789 1811 174
nicklas4 143.61 6300730 12712 21910
nicklas5 230.45 10415297 18570 41633
manyfaces 186.67 9360540 15968 40278
niki 289.76 13667838 17018 55530
trevor 342.88 14288053 36379 38838
tactics 122.67 5710477 4283 28615
buzco 160.60 7582177 11462 18838
nngs 2583.12 123043447 163600 427078
trevorc 1028.38 46415436 78689 202972
strategy3 583.20 25121305 39981 95356
capture 2.80 24837 0 0
connect 24.89 852169 0 6664
global 766.52 30808422 62458 104516
vie 163.19 6612103 4888 31165
arend 701.61 36468189 32116 194648
13x13 1047.91 44185139 135000 163009
semeai 87.42 3886522 3012 18743
trevord 1329.55 63106361 47730 331903
strategy4 1305.67 68819601 87978 295190
owl1 74.66 3527178 3664 18912
handtalk 444.29 21711678 28896 108262
nngs2 1242.41 51590654 94048 162721
nngs3 2954.05 135634826 233553 528744
nngs4 1113.41 46542044 107632 141013
strategy5 418.13 20963994 33886 87957
century2002 517.91 21641538 56695 67825
auto01 41.44 2182272 1550 14898
auto02 59.57 3156052 3326 24611
auto03 38.91 2331261 1137 17366
auto04 28.06 1773479 492 14486
auto_handtalk 54.18 2906800 2234 22576
safety 44.21 2162500 5010 13128
ninestones 1384.56 69362010 108099 285278
tactics1 47.14 2196801 3441 10188
manyfaces1 327.08 15716434 31732 64464
gunnar 406.89 19559273 23639 66279
arend2 228.97 11478851 19290 33402
nando 216.88 9798718 13155 53881
thrash 17.16 488077 251 2884
13x13b 419.51 19619292 40459 69944
Total nodes: 1281848167 2117279 5016783
Total time: 28115.06
owl-node-limit=1200
delta: 4 PASS, 7 FAIL
reading 16.11 82845 0 0
owl 455.52 20103723 19234 86533
owl_rot 7.14 297451 95 1504
ld_owl 81.34 2783698 11446 529
optics 8.91 273138 0 1009
filllib 44.05 1053199 888 6804
atari_atari 57.11 2256335 1737 7353
connection 101.48 5432473 0 45876
blunder 67.24 2496418 1993 9604
trevora 324.25 14443380 58507 46010
nngs1 931.16 46716889 65512 170127
strategy 845.18 40117535 71856 172674
endgame 53.52 1219479 601 12384
heikki 20.11 1143955 1679 3848
neurogo 570.25 23349951 55964 53326
arb 98.80 3697867 5425 9060
rosebud 23.58 1504813 1607 5928
golife 77.12 3276843 12358 3856
arion 120.44 5557148 5623 17973
viking:2 FAIL C4 [E2]
viking 183.21 8657226 13123 25125
ego 109.69 5177433 5466 25264
dniwog 157.32 6902457 17245 18593
lazarus 491.53 19568612 42187 54093
trevorb 483.94 23278398 30553 96830
strategy2:77 FAIL H15 [H3]
strategy2:90 FAIL G13 [B14|D17]
strategy2 903.44 39022867 81232 128198
nicklas1 512.19 21677292 37775 91896
nicklas2 70.19 2774792 6194 3304
nicklas3 14.32 579789 1811 174
nicklas4 148.34 6379985 13018 22043
nicklas5 235.15 10556709 19439 41956
manyfaces 191.99 9527329 16768 40739
niki 293.84 13765960 17618 55256
trevor 359.63 14652294 39983 41333
tactics 121.85 5710477 4283 28615
buzco 160.94 7647362 11862 18846
nngs:1700 FAIL J18 [!J18]
nngs 2602.08 123870549 168038 428862
trevorc:1440 PASS E12 [E12|F11]
trevorc 997.04 46870834 82025 203399
strategy3 603.68 25464260 42287 95967
capture 2.65 24837 0 0
connect 25.50 852169 0 6664
global 784.51 31525443 65863 106140
vie 154.18 6633034 5088 31165
arend 721.99 37111831 34073 197988
13x13 1060.42 45442767 143940 164688
semeai 82.04 3886522 3012 18743
trevord 1263.50 63427877 47923 334332
strategy4 1358.14 69673316 93201 299024
owl1:293 PASS 0 [0]
owl1 77.30 3546351 3881 18923
handtalk 476.03 22216444 32412 109518
nngs2 1241.61 52078461 96896 165511
nngs3:140 FAIL G9 [D9]
nngs3:220 PASS E11 [E11]
nngs3:240 FAIL F13 [G13|G12]
nngs3 3007.60 137666250 243553 537104
nngs4 1158.75 46737639 109035 144849
strategy5 436.18 21052811 34497 88398
century2002 550.28 21985809 59859 69064
auto01 42.77 2182272 1550 14898
auto02 63.99 3230649 3734 24820
auto03 41.09 2349090 1337 17366
auto04 29.00 1773479 492 14486
auto_handtalk 56.69 2918417 2434 22576
safety 44.20 2096715 4769 13119
ninestones 1465.09 70012818 114338 287352
tactics1 48.86 2196801 3441 10188
manyfaces1:60 PASS G18 [N18|G18]
manyfaces1 342.16 15819006 32442 65409
gunnar:19 FAIL L3 [L4]
gunnar 433.70 20014410 25215 66535
arend2 245.04 11710237 20941 33189
nando 225.28 9790695 13401 53881
thrash 17.75 488077 251 2884
13x13b 435.66 19736961 40859 70001
Total nodes: 1296072953 2203869 5063706
Total time: 28435.60
owl-node-limit=10000, cache-size=128MB
reading 103.61 82845 0 0
owl:80 PASS 1 J2 [1 J2]
owl:150 FAIL 1 G13 [0]
owl 599.12 20240108 20607 86549
owl_rot 11.22 297451 95 1504
ld_owl 111.36 2783698 11446 529
optics 18.54 273138 0 1009
filllib 96.11 1053199 888 6804
atari_atari 95.80 2256335 1737 7353
connection 165.90 5432473 0 45876
blunder 114.48 2478109 1993 9604
trevora:220 FAIL B6 [C3|E7]
trevora 419.23 14432292 63033 46095
nngs1 1121.11 46682022 70340 171026
strategy:34 FAIL N15 [E17]
strategy:36 FAIL D18 [!D18]
strategy 949.19 40107878 83683 168510
endgame 124.93 1219479 601 12384
heikki 22.60 1106282 1679 3848
neurogo 644.23 24112527 64842 55951
arb:210 FAIL C8 [D8]
arb 122.24 3666202 5474 9060
rosebud 25.97 1461356 1607 5928
golife 89.62 3074280 12094 3787
arion 131.05 5592911 5816 17936
viking:2 FAIL C4 [E2]
viking 202.39 8532180 13103 25119
ego 128.43 5144062 5466 25264
dniwog 170.82 6791101 17207 18470
lazarus 556.12 19745278 48763 54352
trevorb 603.74 23068004 31055 97433
strategy2:73 FAIL P15 [F7|R17]
strategy2:74 FAIL P15 [F7|R17]
strategy2:77 FAIL H15 [H3]
strategy2:90 FAIL G13 [B14|D17]
strategy2 1026.57 39408719 94108 130592
nicklas1 616.01 21367539 39136 90877
nicklas2 96.68 2739528 7012 3317
nicklas3 17.37 483016 1811 174
nicklas4 185.46 7260029 16229 23853
nicklas5 269.23 11017469 23245 43396
manyfaces:7 FAIL G2 [R2|S7]
manyfaces 216.77 9527946 19256 40467
niki 337.88 14091810 22172 55508
trevor 498.96 15383307 50212 43054
tactics 130.44 5601603 4283 28615
buzco 175.67 7646029 12743 18906
nngs:1700 FAIL J18 [!J18]
nngs 2959.82 123855708 186239 430144
trevorc:1440 PASS E12 [E12|F11]
trevorc:1660 PASS L10 [L10]
trevorc 1270.81 48051395 97768 204103
strategy3 707.03 25819450 49643 98994
capture 16.19 24837 0 0
connect 80.77 852169 0 6664
global 861.13 31060604 72583 109508
vie 201.22 6863341 6924 31200
arend 837.09 38924573 44808 210004
13x13 1250.63 46720934 171186 166134
semeai 95.95 3886522 3012 18743
trevord 1400.29 63197031 51981 334852
strategy4 1459.19 69526392 101541 305214
owl1:283 PASS 0 [0]
owl1:293 PASS 0 [0]
owl1 103.15 3589848 4292 19110
handtalk 493.81 21684454 32530 109827
nngs2:140 PASS P5 [P5]
nngs2 1296.70 50604509 103922 161916
nngs3:220 PASS E11 [E11]
nngs3:240 FAIL F13 [G13|G12]
nngs3:390 PASS O11 [O11]
nngs3:740 FAIL F2 [!F2]
nngs3 3465.52 142412621 279552 589682
nngs4:230 PASS Q18 [Q18]
nngs4:400 PASS 0 [0]
nngs4 1445.41 46308302 120064 144516
strategy5:236 PASS R12 [R12]
strategy5 544.40 21270532 40529 86377
century2002 786.26 25198822 89473 80839
auto01 94.85 2182272 1550 14898
auto02 163.23 3687488 7318 25499
auto03 103.52 2943885 6719 17999
auto04 36.86 1773479 492 14486
auto_handtalk 67.18 2998889 2998 22576
safety 55.33 2096715 4769 13119
ninestones 1526.05 68449969 120988 286059
tactics1 60.29 2179598 3441 10188
manyfaces1:30 PASS C14 [C14]
manyfaces1:60 PASS G18 [N18|G18]
manyfaces1:70 PASS M10 [M10|L9|L8|K7]
manyfaces1 441.76 16148346 38114 67999
gunnar:19 FAIL L3 [L4]
gunnar 500.43 19753160 26135 67961
arend2:80 PASS L2 [L2]
arend2 305.73 12390482 27375 35704
nando 288.55 9759177 15085 53581
thrash 30.89 488077 251 2884
13x13b 557.10 19700478 44800 70694
Total nodes: 1308564264 2507818 5164624
Total time: 33705.96
level=12, owl-node-limit=10000, cache-size=128MB
delta: 56 PASS, 51 FAIL (49 FAIL after my test revisions patch)
reading:65 PASS 0 [0]
reading:138 PASS 2 F9 [2 F9]
reading:154 PASS 2 G4 [2 G4]
reading:165 PASS 1 L3 [1 K3|L3]
reading:178 FAIL 1 G9 [0]
reading 100.61 171745 0 0
owl:29 FAIL 1 E9 [1 C7]
owl:31 FAIL 1 E9 [1 C7]
owl:80 PASS 1 J2 [1 J2]
owl:132 FAIL 0 [(1|2) R4]
owl:150 FAIL 1 G13 [0]
owl:212 FAIL 0 [3 E16]
owl:262 PASS 0 [0]
owl 1034.17 38832282 28875 89279
owl_rot 16.03 513288 107 1517
ld_owl 203.97 6677408 13747 433
optics 34.37 521069 0 973
filllib 182.55 1808660 984 6836
atari_atari 131.26 3940184 2184 3609
connection:52 PASS 1 Q15 [1 Q15]
connection:62 FAIL 1 S15 [1 T15|T17]
connection 198.73 7656989 0 44284
blunder 162.95 4935749 2238 9586
trevora:220 FAIL B6 [C3|E7]
trevora:390 PASS A2 [A2]
trevora:530 PASS H4 [H4]
trevora:531 PASS 1 [1]
trevora:610 PASS F2 [D2|F2]
trevora 799.73 30429800 95053 43137
nngs1:16 FAIL D5 [M4]
nngs1 1881.11 84759132 83942 166036
strategy:34 FAIL N15 [E17]
strategy 1567.67 68796232 99159 176645
endgame 135.93 1561230 611 11448
heikki 36.63 1611616 1748 2158
neurogo:2 FAIL D6 [R3]
neurogo 1247.31 46238208 84231 47679
arb:210 FAIL C8 [D8]
arb 239.55 8284267 7399 8791
rosebud 48.40 2734959 1814 6068
golife 166.79 6108752 16381 3712
arion 244.50 11045239 6250 15949
viking:2 FAIL C4 [E2]
viking 391.04 16063389 16776 22938
ego 205.18 8464578 5444 22943
dniwog:4 FAIL B9 [D7]
dniwog:5 PASS H4 [H4|G4]
dniwog 330.18 14359903 24987 20281
lazarus 1118.90 39452461 70234 51330
trevorb:440 PASS E6 [E6]
trevorb:740 PASS F12 [!H10]
trevorb:960 PASS C3 [!D5]
trevorb 1122.74 45322071 39932 92325
strategy2:73 FAIL P15 [F7|R17]
strategy2:74 FAIL P15 [F7|R17]
strategy2:90 FAIL G13 [B14|D17]
strategy2 2005.11 73241759 111773 124248
nicklas1:501 FAIL F6 [G7]
nicklas1:1216 PASS H3 [H3]
nicklas1 953.25 37051173 47962 84413
nicklas2 193.73 7049516 8634 3667
nicklas3:1403 PASS H9 [J6|H9]
nicklas3 36.54 1442668 3052 209
nicklas4 268.49 11556314 19054 23889
nicklas5 399.38 17733475 26115 40292
manyfaces:7 FAIL G2 [R2|S7]
manyfaces 330.88 16287561 23399 45437
niki 583.68 26027627 32799 60101
trevor:9 PASS E5 [E5]
trevor:410 FAIL C4 [D5|E5]
trevor:1060 PASS 1 [1]
trevor 806.09 29904469 59473 44997
tactics 192.94 8806242 3497 27902
buzco 331.90 15904688 15301 21752
nngs:190 PASS O11 [O11|P12]
nngs:330 PASS B15 [B15|B16]
nngs:720 PASS F16 [F16]
nngs:1280 PASS D13 [D13]
nngs 5051.97 240782127 232815 404701
trevorc:130 PASS H9 [H9]
trevorc:450 FAIL F13 [K5]
trevorc:910 FAIL E1 [H13]
trevorc:1250 FAIL C2 [!C2]
trevorc:1440 PASS E12 [E12|F11]
trevorc:1540 FAIL L10 [M10]
trevorc:1580 FAIL B8 [C8]
trevorc 2157.17 91997271 133554 208512
strategy3:122 FAIL S17 [(R19|T18)]
strategy3:137 FAIL R18 [F5]
strategy3 1103.43 44510337 59102 99023
capture:5 PASS 1 S3 [1 S3]
capture:18 FAIL 0 [1 F6]
capture 16.69 41513 0 0
connect:70 PASS 0 [0]
connect 84.35 1029670 0 5854
global:34 FAIL S7 [N6]
global:40 PASS G4 [G4]
global 1398.74 56713852 89036 98034
vie 291.19 11062162 7784 31519
arend:3 FAIL L5 [P6|Q5]
arend:9 FAIL R15 [S17]
arend 1564.53 70221813 79348 211678
13x13:20 FAIL L7 [M8]
13x13:25 FAIL A7 [J5]
13x13:29 FAIL J13 [C8]
13x13:31 PASS M4 [M4|N4]
13x13:39 FAIL J5 [H4|J4]
13x13:52 FAIL L5 [H10]
13x13:65 FAIL L2 [H4]
13x13 2100.15 86966608 220045 159466
semeai 118.33 4891162 3318 17047
trevord:780 FAIL D19 [B18]
trevord 1991.84 95327091 58276 299693
strategy4:179 PASS E2 [P3|O2|P2|O4|E2]
strategy4 2449.02 118607053 120101 268940
owl1:266 FAIL 1 C18 [1 B17]
owl1:282 FAIL 0 [1 .*]
owl1:283 PASS 0 [0]
owl1:293 PASS 0 [0]
owl1 148.91 5942288 5175 20275
handtalk:10 FAIL C11 [E9|F8]
handtalk 767.76 35884735 41367 110209
nngs2:150 FAIL J18 [M3|L3]
nngs2:460 PASS J4 [J4|K2|K3|K4|K5|L2]
nngs2:510 PASS E8 [E8]
nngs2 2462.35 104441213 133330 168622
nngs3:140 FAIL G9 [D9]
nngs3:220 PASS E11 [E11]
nngs3:390 PASS O11 [O11]
nngs3:400 PASS N13 [N13]
nngs3:470 PASS G15 [!J17]
nngs3:490 FAIL T13 [P15]
nngs3:760 FAIL O11 [Q14]
nngs3:790 FAIL F5 [D5]
nngs3:1190 FAIL C17 [D17]
nngs3 5991.54 253412785 369300 580505
nngs4:160 PASS K8 [K8|L8]
nngs4:190 FAIL E2 [T8]
nngs4:230 PASS Q18 [Q18]
nngs4:400 PASS 0 [0]
nngs4 2460.29 93893203 156240 149860
strategy5:223 FAIL S4 [P16]
strategy5:236 PASS R12 [R12]
strategy5 887.58 38992142 54517 93846
century2002:200 PASS F6 [F6]
century2002 1233.09 46424816 132854 84442
auto01 75.97 3310595 2579 15372
auto02 126.71 5512650 8083 28000
auto03 94.22 4146792 5372 17777
auto04 49.53 2490981 703 15243
auto_handtalk:7 PASS ALIVE DEAD N18 [ALIVE DEAD (O18|N18|O17|P17)]
auto_handtalk 76.11 3520192 3150 19187
safety 87.76 3812340 7300 13326
ninestones:230 PASS PASS [!P11]
ninestones:240 FAIL M19 [!M19]
ninestones:260 PASS B16 [B16]
ninestones:370 PASS R5 [R5]
ninestones:540 FAIL A17 [B15]
ninestones 2705.51 121966497 147003 290994
tactics1 85.55 3546007 4067 9619
manyfaces1:30 PASS C14 [C14]
manyfaces1:36 PASS P16 [P16]
manyfaces1:60 PASS G18 [N18|G18]
manyfaces1:70 PASS M10 [M10|L9|L8|K7]
manyfaces1 706.34 29616844 62724 70771
gunnar:3 PASS K17 [K17]
gunnar 845.11 38082703 32328 65266
arend2:80 PASS L2 [L2]
arend2 491.92 21323142 36415 31355
nando:2 PASS 0 [0]
nando:6 PASS 0 [0]
nando:26 PASS 0 [0]
nando 420.10 14965683 21845 47783
thrash 34.63 834056 250 2879
13x13b 914.07 39861546 57102 67651
Total nodes: 2389426572 3238238 5032313
Total time: 56694.71
| [Prev in Thread] |
Current Thread |
[Next in Thread] |
- [gnugo-devel] Node counts, etc,
Evan Berggren Daniel <=