[gnugo-devel] Tests

[bump]

Here are some tests based on recent games. The game records
are in the CVS. I'll wait for comments before adding the
tests.

I left a gap in the test numbers at the beginning of the
game because I think we also want to do some tuning
around move 24 but I haven't added any tests.

My general belief is that despite the progress we've
made during the past year, current play is unacceptable.
I think when we can identify and fix some problems, the
rating will move up on NNGS and we'll know it's time
to release 3.4 (though we'll have to bring the
documentation up to date first).

In the uhu game, some of the problems are semeai related.

Dan




Index: regression/ninestones.tst
===================================================================
RCS file: /cvsroot/gnugo/gnugo/regression/ninestones.tst,v
retrieving revision 1.13
diff -u -r1.13 ninestones.tst
--- regression/ninestones.tst   13 Jan 2003 04:12:44 -0000      1.13
+++ regression/ninestones.tst   12 Feb 2003 14:32:40 -0000
@@ -95,3 +95,78 @@
 loadsgf games/nngs/norate-ggl-200212301513.sgf 234
 290 gg_genmove black
 #? [B1]
+
+# game move is playable but invites trouble.
+loadsgf games/nngs/leftd-gnugo-3.3.16-200302072009.sgf 4
+300 gg_genmove black
+#? [P16]
+
+loadsgf games/nngs/leftd-gnugo-3.3.16-200302072009.sgf 8
+310 gg_genmove black
+#? [P16]
+
+loadsgf games/nngs/leftd-gnugo-3.3.16-200302072009.sgf 24
+320 gg_genmove black
+#? [D5]
+
+loadsgf games/nngs/leftd-gnugo-3.3.16-200302072009.sgf 36
+330 gg_genmove black
+#? [M17|M16]
+
+loadsgf games/nngs/leftd-gnugo-3.3.16-200302072009.sgf 48
+340 gg_genmove black
+#? [H4]
+
+loadsgf games/nngs/leftd-gnugo-3.3.16-200302072009.sgf 56
+350 gg_genmove black
+#? [!N19]
+
+loadsgf games/nngs/leftd-gnugo-3.3.16-200302072009.sgf 76
+360 gg_genmove black
+#? [!S3]
+
+loadsgf games/nngs/leftd-gnugo-3.3.16-200302072009.sgf 78
+370 gg_genmove black
+#? [R5]
+
+loadsgf games/nngs/juka-gnugo-3.3.16-200302072106.sgf 4
+380 gg_genmove black
+#? [D3|D4|E7|F6]
+
+loadsgf games/nngs/juka-gnugo-3.3.16-200302072106.sgf 8
+390 gg_genmove black
+#? [D3]
+
+loadsgf games/nngs/uhu-gnugo-3.3.16-200302112129.sgf 200
+500 gg_genmove black
+#? [A8|A6]
+
+loadsgf games/nngs/uhu-gnugo-3.3.16-200302112129.sgf 208
+510 gg_genmove black
+#? [E19]
+
+loadsgf games/nngs/uhu-gnugo-3.3.16-200302112129.sgf 210
+520 gg_genmove black
+#? [!G19]
+
+loadsgf games/nngs/uhu-gnugo-3.3.16-200302112129.sgf 214
+530 gg_genmove black
+#? [F13]
+
+loadsgf games/nngs/uhu-gnugo-3.3.16-200302112129.sgf 228
+540 gg_genmove black
+#? [B15]
+
+loadsgf games/nngs/uhu-gnugo-3.3.16-200302112129.sgf 254
+550 gg_genmove black
+#? [G5|J4]
+
+# B can win the semeai. It takes 11 moves to remove the W
+# stones from the board, including going back to capture
+# D18. It takes 11 moves to remove the B stones from the
+# board. The game move at L9 fills one of B's own liberties.
+loadsgf games/nngs/uhu-gnugo-3.3.16-200302112129.sgf 272
+560 gg_genmove black
+#? [!L9]
+
+
Index: regression/games/nngs/juka-gnugo-3.3.16-200302072106.sgf
===================================================================
RCS file: regression/games/nngs/juka-gnugo-3.3.16-200302072106.sgf
diff -N regression/games/nngs/juka-gnugo-3.3.16-200302072106.sgf
--- /dev/null   1 Jan 1970 00:00:00 -0000
+++ regression/games/nngs/juka-gnugo-3.3.16-200302072106.sgf    12 Feb 2003 
14:32:56 -0000
@@ -0,0 +1,49 @@
+(;GM[1]FF[4]
+SZ[19]HA[9]KM[0.5]
+PW[juka]WR[1k*]
+PB[GnuGo (GNU Go 3.3.16)]BR[10k*]
+PC[NNGS]DT[2003-02-07]AP[gnugoclient:2.0]
+RE[W+84.5]
+AB[dd][jd][pd][dj][jj][pj][dp][jp][pp]
+;W[fq];B[dn];W[dl];B[nq];W[gn];B[dg];W[cq];B[cp];W[dq];B[ep];W[fp]
+;B[eq];W[er];B[jn];W[fl];B[ck];W[cl];B[bo];W[bq];B[hk];W[fj];B[hi]
+;W[fh];B[gg];W[jm];B[im];W[in];B[kn];W[il];B[ll];W[kk];B[li];W[lk]
+;B[nl];W[mk];B[jk];W[kl];B[hm];W[ml];B[qf];W[hn];B[jl];W[km];B[gm]
+;W[fm];B[gk];W[ej];B[fc];W[dh];B[ch];W[eg];B[df];W[di];B[ci];W[pl]
+;B[nh];W[lg];B[mh];W[jh];B[kg];W[kh];B[mm];W[nm];B[om];W[nn];B[mn]
+;W[mo];B[ln];W[nk];B[ol];W[ok];B[pk];W[ql];B[on];W[no];B[lp];W[oo]
+;B[pn];W[po];B[qn];W[qo];B[rn];W[ro];B[rm];W[rl];B[lh];W[ig];B[kf]
+;W[hh];B[gh];W[gi];B[ii];W[gf];B[oc];W[hf];B[pr];W[qc];B[qd];W[qh]
+;B[rc];W[oi];B[pg];W[pi];B[hd];W[mc];B[jg];W[ih];B[kj];W[ob];B[nb]
+;W[nc];B[pb];W[mb];B[oa];W[ic];B[id];W[jc];B[hc];W[ib];B[hb];W[kb]
+;B[ja];W[ia];B[lc];W[ld];B[kd];W[kc];B[lf];W[cc];B[cd];W[bd];B[be]
+;W[bb];B[ad];W[ac];B[db];W[cb];B[ae];W[dc];B[eb];W[qq];B[bk];W[bl]
+;B[pq];W[qr];B[io];W[jr];B[lr];W[iq];B[rg];W[kq];B[ri];W[rh];B[sh]
+;W[qj];B[lq];W[ip];B[ho];W[go];B[qs];W[kp];B[lo];W[ks];B[rr];W[rq]
+;B[al];W[am];B[ak];W[bm];B[ko];W[ns];B[ls];W[nr];B[kr];W[jq];B[js]
+;W[hr];B[jo];W[le];B[me];W[md];B[hp];W[gr];B[ne];W[ed];B[ec];W[ef]
+;B[ee];W[fe];B[fd];W[dk];B[cj];W[ma];B[is];W[np];B[oq];W[mp];B[qp]
+;W[rp];B[mq];W[sq];B[rs];W[sr];B[so];W[sm];B[sn];W[sl];B[ge];W[ff]
+;B[gj];W[fi];B[rj];W[qi];B[gl];W[si];B[sg];W[qk];B[he];W[jf];B[ke]
+;W[na];B[ob];W[qg];B[re];W[oh];B[og];W[ha];B[ga];W[fk];B[nd];W[ni]
+;B[lj];W[mj];B[je];W[if];B[mi];W[rk];B[sj];W[sk];B[si];W[];B[ji]
+;W[ki];B[ph];W[ie];B[]C[final_score: W+84.5
+K19 removed
+B18 removed
+A17 removed
+M17 removed
+R17 removed
+B16 removed
+G13 removed
+M13 removed
+Q10 removed
+J8 removed
+M8 removed
+O8 removed
+N7 removed
+D6 removed
+B5 removed
+C4 removed
+S2 removed
+J1 removed]
+)
Index: regression/games/nngs/leftd-gnugo-3.3.16-200302072009.sgf
===================================================================
RCS file: regression/games/nngs/leftd-gnugo-3.3.16-200302072009.sgf
diff -N regression/games/nngs/leftd-gnugo-3.3.16-200302072009.sgf
--- /dev/null   1 Jan 1970 00:00:00 -0000
+++ regression/games/nngs/leftd-gnugo-3.3.16-200302072009.sgf   12 Feb 2003 
14:32:56 -0000
@@ -0,0 +1,47 @@
+(;GM[1]FF[4]
+SZ[19]HA[9]KM[0.5]
+PW[leftd]WR[2k*]
+PB[GnuGo (GNU Go 3.3.16)]BR[10k*]
+PC[NNGS]DT[2003-02-07]AP[gnugoclient:2.0]
+RE[B+24.5]
+AB[dd][jd][pd][dj][jj][pj][dp][jp][pp]
+;W[qf];B[qe];W[oe];B[pf];W[pe];B[re];W[rf];B[md];W[qd];B[of];W[nf]
+;B[od];W[ne];B[rd];W[qc];B[ph];W[rc];B[pm];W[fq];B[fp];W[ep];B[eo]
+;W[eq];B[gp];W[dq];B[cp];W[cq];B[oc];W[nd];B[nc];W[oh];B[ng];W[og]
+;B[pg];W[le];B[mg];W[lf];B[oi];W[mc];B[lc];W[mb];B[gd];W[en];B[dn]
+;W[fo];B[do];W[go];B[ho];W[hp];B[fn];W[gn];B[fm];W[gm];B[nb];W[ld]
+;B[ma];W[lb];B[em];W[ch];B[jm];W[or];B[qr];W[lq];B[lo];W[mo];B[mn]
+;W[no];B[nn];W[po];B[oo];W[op];B[on];W[pq];B[qp];W[qq];B[rq];W[rp]
+;B[np];W[qo];B[eh];W[be];B[jg];W[lg];B[gl];W[gq];B[lh];W[hl];B[gk]
+;W[cc];B[dc];W[cb];B[bi];W[ci];B[cj];W[bh];B[bj];W[mp];B[df];W[cf]
+;B[hk];W[il];B[db];W[dg];B[eg];W[de];B[ef];W[ee];B[cd];W[bd];B[ce]
+;W[fe];B[ec];W[ge];B[hd];W[jf];B[he];W[hf];B[if];W[ig];B[gf];W[ie]
+;B[gg];W[ic];B[id];W[rm];B[kc];W[kb];B[jc];W[jb];B[jh];W[lm];B[jl]
+;W[ln];B[lp];W[mq];B[kq];W[jn];B[kf];W[ke];B[je];W[kg];B[im];W[in]
+;B[kh];W[pl];B[ol];W[ok];B[pk];W[ql];B[nk];W[hm];B[if];W[nl];B[om]
+;W[ie];B[ih];W[bq];B[bp];W[ik];B[jk];W[ij];B[ml];W[ll];B[ca];W[bb]
+;B[lk];W[mm];B[nm];W[ba];B[lr];W[mr];B[aq];W[ar];B[ap];W[br];B[hg]
+;W[da];B[ea];W[fb];B[eb];W[hc];B[fd];W[di];B[ei];W[rj];B[gb];W[hb]
+;B[gc];W[ga];B[ah];W[ag];B[ai];W[qh];B[bg];W[af];B[dh];W[bf];B[cg]
+;W[qg];B[pi];W[hj];B[fa];W[ha];B[kn];W[ko];B[km];W[kp];B[ii];W[gj]
+;B[fj];W[mf];B[gi];W[hi];B[hh];W[qm];B[kl];W[lo];B[pn];W[qn];B[nl]
+;W[qi];B[qk];W[rk];B[if];W[kf];B[kd];W[sd];B[me];W[se];B[la];W[pb]
+;B[ka];W[pe];B[oe];W[qe];B[ob];W[oa];B[pc];W[qb];B[ca];W[nj];B[oj]
+;W[da];B[na];W[pa];B[ca];W[mk];B[mj];W[da];B[pp];W[oq];B[ca];W[fl]
+;B[fk];W[da];B[qj];W[ca];B[]C[final_score: B+24.5
+G19 removed
+F18 removed
+K18 removed
+D15 removed
+P13 removed
+O10 removed
+F8 removed
+H5 removed
+K4 removed
+O4 removed
+Q4 removed
+L3 removed
+S3 removed
+M2 removed
+R2 removed]
+)