Giter Club home page Giter Club logo

fishtest's People

Contributors

cuddlestmonkey avatar ddugovic avatar glinscott avatar hxim avatar ianfab avatar joergoster avatar jromang avatar kamyarkaviani avatar lucasart avatar mcostalba avatar ppigazzini avatar stefano80 avatar theo77186 avatar vondele avatar wfenchel avatar zamar avatar zardav avatar

Stargazers

avatar avatar avatar avatar avatar

Watchers

avatar avatar avatar avatar

fishtest's Issues

Post-NNUE testing

This is to discuss testing SF versions after the merge of NNUE evaluation code. One critical change is that the compiler needs to support c++17 instead of c++11 now, which raises the requirement to GCC >=7. In order to avoid crashing workers, please check the compiler versions you are using and upgrade if required @notruck @ddugovic @Nordlandia @ppigazzini. As soon as we are clear that all workers are ready, we can run a first test with MV-SF.

cutechess-cli problems

@ianfab cutechess-cli Windows and Linux are linked dynamically.
Windows version is missing some dll (e.g. api-ms-win-crt-runtime-l1-1-0.dll).
Linux version requires a very recent libgcc (only Ubuntu 16.10 works)

Here is the Windows static cutechess-cli.exe 32 bit (for max compatibility); in this way no ddl is required (Qt5Core.dll and *140.dll):
cutechess-cli.zip

Instructions to built the static cutechess-cli.exe 32 bit:

  1. install MSYS2:
    http://www.msys2.org/
    a. start the installer
    b. update with the command:
    pacman -Syuu
  2. start a MSYS2 MinGW 32 bit console (not 64 bit)
  3. start these commands (it takes several minutes)
    pacman -S git make mingw-w64-i686-gcc mingw-w64-i686-jasper mingw-w64-i686-qt5-static
    git clone https://github.com/cutechess/cutechess.git
    cd cutechess
    C:/msys32/mingw32/qt5-static/bin/qmake.exe -config release
    make
    strip projects/cli/cutechess-cli.exe

Variant cmd exit tasks

Okey so i decided to contribute again to variant framework but this text implies something is wrong in the settings.

Exception running games:
Traceback (most recent call last):
File "C:\fishtest-master\worker\worker.py", line 88, in worker
run_games(worker_info, password, remote, run, task_id)
File "C:\fishtest-master\worker\games.py", line 370, in run_games
setup_engine(new_engine, worker_dir, sha_new, repo_url, worker_info['concurrency'])
File "C:\fishtest-master\worker\games.py", line 128, in setup_engine
subprocess.check_call(MAKE_CMD + ' -j %s' % (concurrency) + ' profile-build', shell=True)
File "C:\Python27\lib\subprocess.py", line 190, in check_call
raise CalledProcessError(retcode, cmd)
CalledProcessError: Command 'make COMP=mingw ARCH=x86-64-modern -j 3 profile-build' returned non-zero exit status 1
Task exited

Any quick-fix?

cutechess/fishtest issued Illegal PV warnings for Shogi

The vast majority of Shogi (and shogi-family) games complete without any warning, but this one game (round 87) issued quite a bunch.

In particular, it really seems to dislike this i8h8 move. The log below is unedited and copied verbatim:

Started game 85 of 200 (stockfish vs base)
Finished game 85 (stockfish vs base): 0-1 {Gote mates}
Score of stockfish vs base: 42 - 43 - 0  [0.494] 85
Started game 86 of 200 (base vs stockfish)
Finished game 86 (base vs stockfish): 1-0 {White wins by adjudication}
Score of stockfish vs base: 42 - 44 - 0  [0.488] 86
Started game 87 of 200 (stockfish vs base)
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Rh8 Kf9 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Rh8 Kf9 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Rh8 Kf9 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Rh8 Kf9 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Rh8 Kf9 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Rh8 Kf9 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Rh8 Kf9 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Rh8 Kf9 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Rh8 Kf9 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Rh8 Kf9 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Rh8 Kf9 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Rh8 Kf9 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Rh8 Kf9 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Rh8 Kf9 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Rh8 Kf9 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Rh8 Kf9 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from base (1)
Warning: PV: Kf8 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from base (1)
Warning: PV: Kf8 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from base (1)
Warning: PV: Kf8 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from base (1)
Warning: PV: Kf8 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from base (1)
Warning: PV: Kf8 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from base (1)
Warning: PV: Kf8 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from base (1)
Warning: PV: Kf8 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from base (1)
Warning: PV: Kf8 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from base (1)
Warning: PV: Kf8 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from base (1)
Warning: PV: Kf8 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from base (1)
Warning: PV: Kf8 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from base (1)
Warning: PV: Kf8 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from base (1)
Warning: PV: Kf8 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from base (1)
Warning: PV: Kf8 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from base (1)
Warning: PV: Kf8 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from base (1)
Warning: PV: Kf8 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from base (1)
Warning: PV: Kf8 +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Ri8 Kg9 i8h8
Warning: Illegal PV move i8h8 from stockfish (0)
Warning: PV: +Ri8 Kg9 i8h8
Finished game 87 (stockfish vs base): 1/2-1/2 {Draw by fourfold repetition}
Score of stockfish vs base: 42 - 44 - 1  [0.489] 87
Started game 88 of 200 (base vs stockfish)
Finished game 88 (base vs stockfish): 1-0 {Sente mates}
Score of stockfish vs base: 42 - 45 - 1  [0.483] 88

The game itself is relatively short, eventually ending in a 4-fold repetition.

[Event "?"]
[Site "?"]
[Date "2020.08.24"]
[Round "87"]
[White "stockfish"]
[Black "base"]
[Result "1/2-1/2"]
[FEN "lnsgkgsnl/1r5b1/ppp1ppppp/3p5/9/4P3P/PPPP1PPP1/1B5R1/LNSGKGSNL[-] b - 2"]
[GameDuration "00:01:17"]
[GameEndTime "2020-08-24T14:08:11.619 UTC"]
[GameStartTime "2020-08-24T14:06:53.907 UTC"]
[PlyCount "74"]
[SetUp "1"]
[TimeControl "32.439+0.32"]
[Variant "shogi"]

1... Gfe8 {-0.32/16 2.6s} 2. Gfe2 {+1.34/18 2.7s} Pb6 {-0.82/19 3.1s}
3. Pc4 {+1.37/15 0.86s} Pb5 {-0.66/15 0.65s} 4. Bc3 {+1.19/15 0.46s}
Pd5 {-0.54/16 2.6s} 5. Sf2 {+1.30/15 0.83s} Kf9 {-0.52/16 0.77s}
6. Kf1 {+1.41/15 0.76s} Rb6 {-0.51/14 0.45s} 7. Ph4 {+1.63/14 0.24s}
Pi6 {-1.16/18 4.3s} 8. Pf4 {+1.79/16 1.1s} Sg8 {-1.03/16 1.5s}
9. Sd2 {+1.73/15 0.51s} Kg9 {-1.21/15 0.93s} 10. Ph5 {+1.74/16 2.7s}
Rc6 {-0.94/16 1.9s} 11. Kg1 {+2.07/18 2.6s} Rxc4 {-0.74/16 1.0s}
12. Ph6 {+2.25/13 0.25s} Pxh6 {-0.68/16 0.51s} 13. Rxh6 {+1.18/16 1.7s}
Rxe4 {-0.38/14 0.35s} 14. Pi5 {+1.42/17 4.3s} Pxi5 {-0.25/13 0.42s}
15. P@h7 {+2.41/16 1.1s} Bi7 {-1.27/15 1.3s} 16. Rd6 {+2.55/14 0.30s}
Sc8 {-0.95/18 2.5s} 17. Sde3 {+3.16/16 0.94s} Re6 {+0.13/15 0.27s}
18. Rxe6 {+3.47/14 0.32s} Pxe6 {+0.47/14 0.31s} 19. Lxi5 {+1.81/16 1.5s}
R@h3 {+0.93/13 0.37s} 20. Lxi7+ {+4.31/16 1.0s} Lxi7 {-0.43/17 1.1s}
21. B@f5 {+4.56/16 1.3s} Rh6+ {+0.23/15 0.38s} 22. R@i8 {+3.59/18 1.3s}
Sxh7 {+0.46/14 0.37s} 23. Ri9+ {+4.20/16 0.53s} Sg8 {+0.22/15 1.2s}
24. P@h7 {+1.86/15 1.1s} P@h2 {+1.43/13 0.50s} 25. Kf1 {0.00/20 5.6s}
Pxh1+ {+3.03/15 1.1s} 26. +Rh8 {0.00/17 0.22s} Kf9 {+0.72/15 0.64s}
27. +Ri8 {0.00/19 0.66s} Kg9 {0.00/22 2.3s} 28. +Rh8 {0.00/19 0.29s}
Kf8 {0.00/19 0.72s} 29. +Ri8 {0.00/20 0.32s} Kg9 {0.00/18 0.27s}
30. +Rh8 {0.00/21 0.49s} Kf8 {0.00/20 0.38s} 31. +Ri8 {0.00/22 0.38s}
N@e7 {0.00/19 0.47s} 32. Bg4 {+1.50/16 0.94s} Kg9 {0.00/18 0.95s}
33. +Rh8 {0.00/20 0.61s} Kf8 {0.00/20 0.19s} 34. +Ri8 {0.00/21 0.25s}
Kg9 {0.00/20 0.37s} 35. +Rh8 {0.00/21 0.28s} Kf8 {0.00/23 0.31s}
36. +Ri8 {0.00/23 0.62s} Kg9 {0.00/23 0.34s} 37. +Rh8 {0.00/22 0.35s}
Kf8 {0.00/25 0.41s} 38. +Ri8 {0.00/26 0.29s, Draw by fourfold repetition}
1/2-1/2

Seeing some "invalid value" warnings in tune_pv tests for horde

Reporting mainly because I haven't noticed these warnings before. The tuned values seem to be changing slightly from run to run, but I have no idea what happens if those values aren't being accepted?

Thanks!

Verifying signature of stockfish_a71d5e72013c69d08037c634b2fedc7332731dd7 ...
Verifying signature of stockfish_a71d5e72013c69d08037c634b2fedc7332731dd7 ...
CPU factor : 1.40994802932 - tc adjusted to 42.298+0.423
Running tune_pv vs tune_pv
['/home/mvfishtest/fishtest-master/worker/testing/cutechess-cli', '-repeat', '-rounds', '2', '-tournament', 'gauntlet', '-srand', '3885277006', '-resign', 'movecount=8', 'score=800', '-draw', 'movenumber=34', 'movecount=8', 'score=20', '-concurrency', '1', '-openings', 'file=horde.epd', 'format=epd', 'order=random', 'plies=16', '-variant', u'horde', '-engine', 'name=stockfish', 'cmd=stockfish_a71d5e72013c69d08037c634b2fedc7332731dd7', 'option.Hash=32', 'option.Move Overhead=100', 'option.PieceValue[MG][PAWN]=109.0', 'option.PieceValue[EG][PAWN]=180.0', 'option.PieceValue[MG][KNIGHT]=574.0', 'option.PieceValue[EG][KNIGHT]=693.0', 'option.PieceValue[MG][BISHOP]=933.0', 'option.PieceValue[EG][BISHOP]=794.0', 'option.PieceValue[MG][ROOK]=1566.0', 'option.PieceValue[EG][ROOK]=1545.0', 'option.PieceValue[MG][QUEEN]=2529.0', 'option.PieceValue[EG][QUEEN]=3373.0', '-engine', 'name=base', 'cmd=stockfish_a71d5e72013c69d08037c634b2fedc7332731dd7', 'option.Hash=32', 'option.Move Overhead=100', 'option.PieceValue[MG][PAWN]=163.0', 'option.PieceValue[EG][PAWN]=270.0', 'option.PieceValue[MG][KNIGHT]=910.0', 'option.PieceValue[EG][KNIGHT]=1060.0', 'option.PieceValue[MG][BISHOP]=578.0', 'option.PieceValue[EG][BISHOP]=1188.0', 'option.PieceValue[MG][ROOK]=1017.0', 'option.PieceValue[EG][ROOK]=952.0', 'option.PieceValue[MG][QUEEN]=3621.0', 'option.PieceValue[EG][QUEEN]=2220.0', '-each', 'proto=uci', 'tc=42.298+0.423', 'option.Threads=1']
TC limit 592.178172313 End time: 2021-03-23 21:22:18.134427
Warning: 2 opening repetitions vs 1 games per encounter
Warning: Invalid value for option PieceValue[EG][BISHOP]: 794.0
Warning: Invalid value for option PieceValue[EG][KNIGHT]: 693.0
Warning: Invalid value for option PieceValue[EG][PAWN]: 180.0
Warning: Invalid value for option PieceValue[EG][QUEEN]: 3373.0
Warning: Invalid value for option PieceValue[EG][ROOK]: 1545.0
Warning: Invalid value for option PieceValue[MG][BISHOP]: 933.0
Warning: Invalid value for option PieceValue[MG][KNIGHT]: 574.0
Warning: Invalid value for option PieceValue[MG][PAWN]: 109.0
Warning: Invalid value for option PieceValue[MG][QUEEN]: 2529.0
Warning: Invalid value for option PieceValue[MG][ROOK]: 1566.0
Warning: Invalid value for option PieceValue[EG][BISHOP]: 1188.0
Warning: Invalid value for option PieceValue[EG][KNIGHT]: 1060.0
Warning: Invalid value for option PieceValue[EG][PAWN]: 270.0
Warning: Invalid value for option PieceValue[EG][QUEEN]: 2220.0
Warning: Invalid value for option PieceValue[EG][ROOK]: 952.0
Warning: Invalid value for option PieceValue[MG][BISHOP]: 578.0
Warning: Invalid value for option PieceValue[MG][KNIGHT]: 910.0
Warning: Invalid value for option PieceValue[MG][PAWN]: 163.0
Warning: Invalid value for option PieceValue[MG][QUEEN]: 3621.0
Warning: Invalid value for option PieceValue[MG][ROOK]: 1017.0
Indexing opening suite...
Started game 1 of 2 (stockfish vs base)
Finished game 1 (stockfish vs base): 0-1 {Black wins by adjudication}
Score of stockfish vs base: 0 - 1 - 0  [0.000] 1
Started game 2 of 2 (base vs stockfish)
Finished game 2 (base vs stockfish): 0-1 {Black wins by adjudication}
Score of stockfish vs base: 1 - 1 - 0  [0.500] 2
...      stockfish playing White: 0 - 1 - 0  [0.000] 1
...      stockfish playing Black: 1 - 0 - 0  [1.000] 1
...      White vs Black: 0 - 2 - 0  [0.000] 2
Elo difference: 0.0 +/- nan, LOS: 50.0 %, DrawRatio: 0.0 %
Finished match
Finished match cleanly
Note: <type 'exceptions.OSError'> killing the process pid: 856, possibly already terminated
['/home/mvfishtest/fishtest-master/worker/testing/cutechess-cli', '-repeat', '-rounds', '2', '-tournament', 'gauntlet', '-srand', '2795225889', '-resign', 'movecount=8', 'score=800', '-draw', 'movenumber=34', 'movecount=8', 'score=20', '-concurrency', '1', '-openings', 'file=horde.epd', 'format=epd', 'order=random', 'plies=16', '-variant', u'horde', '-engine', 'name=stockfish', 'cmd=stockfish_a71d5e72013c69d08037c634b2fedc7332731dd7', 'option.Hash=32', 'option.Move Overhead=100', 'option.PieceValue[MG][PAWN]=164.0', 'option.PieceValue[EG][PAWN]=269.0', 'option.PieceValue[MG][KNIGHT]=911.0', 'option.PieceValue[EG][KNIGHT]=1061.0', 'option.PieceValue[MG][BISHOP]=932.0', 'option.PieceValue[EG][BISHOP]=795.0', 'option.PieceValue[MG][ROOK]=1016.0', 'option.PieceValue[EG][ROOK]=1550.0', 'option.PieceValue[MG][QUEEN]=2538.0', 'option.PieceValue[EG][QUEEN]=3364.0', '-engine', 'name=base', 'cmd=stockfish_a71d5e72013c69d08037c634b2fedc7332731dd7', 'option.Hash=32', 'option.Move Overhead=100', 'option.PieceValue[MG][PAWN]=109.0', 'option.PieceValue[EG][PAWN]=179.0', 'option.PieceValue[MG][KNIGHT]=575.0', 'option.PieceValue[EG][KNIGHT]=694.0', 'option.PieceValue[MG][BISHOP]=577.0', 'option.PieceValue[EG][BISHOP]=1189.0', 'option.PieceValue[MG][ROOK]=1564.0', 'option.PieceValue[EG][ROOK]=957.0', 'option.PieceValue[MG][QUEEN]=3629.0', 'option.PieceValue[EG][QUEEN]=2211.0', '-each', 'proto=uci', 'tc=42.298+0.423', 'option.Threads=1']
TC limit 592.178172313 End time: 2021-03-23 21:26:09.829729
Warning: 2 opening repetitions vs 1 games per encounter
Warning: Invalid value for option PieceValue[EG][BISHOP]: 795.0
Warning: Invalid value for option PieceValue[EG][KNIGHT]: 1061.0
Warning: Invalid value for option PieceValue[EG][PAWN]: 269.0
Warning: Invalid value for option PieceValue[EG][QUEEN]: 3364.0
Warning: Invalid value for option PieceValue[EG][ROOK]: 1550.0
Warning: Invalid value for option PieceValue[MG][BISHOP]: 932.0
Warning: Invalid value for option PieceValue[MG][KNIGHT]: 911.0
Warning: Invalid value for option PieceValue[MG][PAWN]: 164.0
Warning: Invalid value for option PieceValue[MG][QUEEN]: 2538.0
Warning: Invalid value for option PieceValue[MG][ROOK]: 1016.0
Warning: Invalid value for option PieceValue[EG][BISHOP]: 1189.0
Warning: Invalid value for option PieceValue[EG][KNIGHT]: 694.0
Warning: Invalid value for option PieceValue[EG][PAWN]: 179.0
Warning: Invalid value for option PieceValue[EG][QUEEN]: 2211.0
Warning: Invalid value for option PieceValue[EG][ROOK]: 957.0
Warning: Invalid value for option PieceValue[MG][BISHOP]: 577.0
Warning: Invalid value for option PieceValue[MG][KNIGHT]: 575.0
Warning: Invalid value for option PieceValue[MG][PAWN]: 109.0
Warning: Invalid value for option PieceValue[MG][QUEEN]: 3629.0
Warning: Invalid value for option PieceValue[MG][ROOK]: 1564.0
Indexing opening suite...
Started game 1 of 2 (stockfish vs base)
Finished game 1 (stockfish vs base): 0-1 {Black wins by adjudication}
Score of stockfish vs base: 0 - 1 - 0  [0.000] 1
Started game 2 of 2 (base vs stockfish)
Finished game 2 (base vs stockfish): 1-0 {White wins by adjudication}
Score of stockfish vs base: 0 - 2 - 0  [0.000] 2
...      stockfish playing White: 0 - 1 - 0  [0.000] 1
...      stockfish playing Black: 0 - 1 - 0  [0.000] 1
...      White vs Black: 1 - 1 - 0  [0.500] 2
Elo difference: -inf +/- nan, LOS: 7.9 %, DrawRatio: 0.0 %
Finished match
Finished match cleanly
Note: <type 'exceptions.OSError'> killing the process pid: 921, possibly already terminated
['/home/mvfishtest/fishtest-master/worker/testing/cutechess-cli', '-repeat', '-rounds', '2', '-tournament', 'gauntlet', '-srand', '3519591321', '-resign', 'movecount=8', 'score=800', '-draw', 'movenumber=34', 'movecount=8', 'score=20', '-concurrency', '1', '-openings', 'file=horde.epd', 'format=epd', 'order=random', 'plies=16', '-variant', u'horde', '-engine', 'name=stockfish', 'cmd=stockfish_a71d5e72013c69d08037c634b2fedc7332731dd7', 'option.Hash=32', 'option.Move Overhead=100', 'option.PieceValue[MG][PAWN]=109.0', 'option.PieceValue[EG][PAWN]=180.0', 'option.PieceValue[MG][KNIGHT]=571.0', 'option.PieceValue[EG][KNIGHT]=1057.0', 'option.PieceValue[MG][BISHOP]=928.0', 'option.PieceValue[EG][BISHOP]=799.0', 'option.PieceValue[MG][ROOK]=1022.0', 'option.PieceValue[EG][ROOK]=1543.0', 'option.PieceValue[MG][QUEEN]=3640.0', 'option.PieceValue[EG][QUEEN]=2217.0', '-engine', 'name=base', 'cmd=stockfish_a71d5e72013c69d08037c634b2fedc7332731dd7', 'option.Hash=32', 'option.Move Overhead=100', 'option.PieceValue[MG][PAWN]=163.0', 'option.PieceValue[EG][PAWN]=269.0', 'option.PieceValue[MG][KNIGHT]=907.0', 'option.PieceValue[EG][KNIGHT]=690.0', 'option.PieceValue[MG][BISHOP]=574.0', 'option.PieceValue[EG][BISHOP]=1193.0', 'option.PieceValue[MG][ROOK]=1570.0', 'option.PieceValue[EG][ROOK]=950.0', 'option.PieceValue[MG][QUEEN]=2550.0', 'option.PieceValue[EG][QUEEN]=3370.0', '-each', 'proto=uci', 'tc=42.298+0.423', 'option.Threads=1']
TC limit 592.178172313 End time: 2021-03-23 21:29:55.452091
Warning: 2 opening repetitions vs 1 games per encounter
Warning: Invalid value for option PieceValue[EG][BISHOP]: 799.0
Warning: Invalid value for option PieceValue[EG][KNIGHT]: 1057.0
Warning: Invalid value for option PieceValue[EG][PAWN]: 180.0
Warning: Invalid value for option PieceValue[EG][QUEEN]: 2217.0
Warning: Invalid value for option PieceValue[EG][ROOK]: 1543.0
Warning: Invalid value for option PieceValue[MG][BISHOP]: 928.0
Warning: Invalid value for option PieceValue[MG][KNIGHT]: 571.0
Warning: Invalid value for option PieceValue[MG][PAWN]: 109.0
Warning: Invalid value for option PieceValue[MG][QUEEN]: 3640.0
Warning: Invalid value for option PieceValue[MG][ROOK]: 1022.0
Warning: Invalid value for option PieceValue[EG][BISHOP]: 1193.0
Warning: Invalid value for option PieceValue[EG][KNIGHT]: 690.0
Warning: Invalid value for option PieceValue[EG][PAWN]: 269.0
Warning: Invalid value for option PieceValue[EG][QUEEN]: 3370.0
Warning: Invalid value for option PieceValue[EG][ROOK]: 950.0
Warning: Invalid value for option PieceValue[MG][BISHOP]: 574.0
Warning: Invalid value for option PieceValue[MG][KNIGHT]: 907.0
Warning: Invalid value for option PieceValue[MG][PAWN]: 163.0
Warning: Invalid value for option PieceValue[MG][QUEEN]: 2550.0
Warning: Invalid value for option PieceValue[MG][ROOK]: 1570.0
Indexing opening suite...
Started game 1 of 2 (stockfish vs base)
Finished game 1 (stockfish vs base): 1-0 {White wins by adjudication}
Score of stockfish vs base: 1 - 0 - 0  [1.000] 1
Started game 2 of 2 (base vs stockfish)
Finished game 2 (base vs stockfish): 1-0 {White wins by adjudication}
Score of stockfish vs base: 1 - 1 - 0  [0.500] 2
...      stockfish playing White: 1 - 0 - 0  [1.000] 1
...      stockfish playing Black: 0 - 1 - 0  [0.000] 1
...      White vs Black: 2 - 0 - 0  [1.000] 2
Elo difference: 0.0 +/- nan, LOS: 50.0 %, DrawRatio: 0.0 %
Finished match
Finished match cleanly

Testing White vs Black score

It may be possible to test white score vs black score directly without having to modify the source code.
Recent versions of cutechess-cli support the -noswap option. This prevents the players to swap positions/sides.
If a test uses a white-to-move opening suite or position set, e.g. 2moves_v1.epd, or crazyhouse-p4-f12.epd, the first engine will allways play the white pieces. If using a "black suite" like crazyhoude.epd, it will be the other way round.

Fishtest may relay control of the -noswap option to enable this kind of testing.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.