CCRAT Results

10.03.2025

Conditions

Hardware:

Ryzen7 5700G 8*3.8 Ghz (16HT), 32 GB DDR4 Ram

System:

WIN 11 Pro

Software:

CuteChessGUI EXPER 3.5.1 (advanced CuteChess fork/branch by 'alwey'), SCID vs PC 4.25, Ordo 1.26.

Startpositions:

Fixed openings from my 3M_rand.pgn (1185 opening lines with 6 plies) for programs rated below 3500.
Fixed openings from UHO_2024_6mvs_+100_+109 (4740 opening lines with 12 plies) for programs rated above 3500 (mixed 50:50 with 3M_rand).
All games played twice with reversed colours for each line.

Settings:

Time control (adapted to CCRL Blitz spec according to used hardware) 1:20 + 1s (+20ms GUI margin), Hash 256MB(main) if supported.
Ponder off, Resign set to 900 for 5 moves both sides. Concurreny currently set to 4.
Draw adjudication at 100/10/20 (moves/length/score) and at max. move 240 (those results will be manually checked later and eventually adjusted).

Tablebases up to 5 men, if supported, e.g. Syzygy, Nalimov, Scorpio or Gaviota bases.
Szygzy adjudication only if all participants of a match/tourney support Syzygy themselves.

Since CCRAT-8 changed to a minimal Syzygy adjudication for tournaments of all rating ranges no matter if TBS are supported by the participants!
(KR-KR, KN-KN, KB-KB, KN-KB, KN-K, KB-K)

CCRAT-8

CuteChessGUI result output:
Rank Name                                  TC     Elo     +/-   Games    Wins  Losses   Draws   Points   Score    Draw    Time Illegal  Discon   Stall WrClaim 
   0 Frolic_25-64                        80+1     108      28     500     267     116     117    325.5   65.1%   23.4%       0       0       0       0       0 
   1 Counter_30-64                       80+1     -42      63     100      35      47      18     44.0   44.0%   18.0%       0       0       0       0       0 
   2 Fruit_21                            80+1     -67      62     100      30      49      21     40.5   40.5%   21.0%       0       0       0       0       0 
   3 Asymptote_05-64                     80+1    -131      66     100      23      59      18     32.0   32.0%   18.0%       0       0       0       0       0 
   4 Leorik_22-64                        80+1    -135      59     100      16      53      31     31.5   31.5%   31.0%       0       0       0       0       0 
   5 Philou_371-64                       80+1    -177      62     100      12      59      29     26.5   26.5%   29.0%       0       0       0       0       0 
Ordo Output (200 simuls):
   # PLAYER             :  RATING  ERROR  POINTS  PLAYED    (%)    W    D    L   D(%)
   1 Frolic_25-64       :   93.69  23.50   325.5     500  65.10  267  117  116  23.40
   2 Counter_30-64      :   50.99  55.11    44.0     100  44.00   35   18   47  18.00
   3 Fruit_21           :   25.59  56.13    40.5     100  40.50   30   21   49  21.00
   4 Asymptote_05-64    :  -39.70  58.51    32.0     100  32.00   23   18   59  18.00
   5 Leorik_22-64       :  -43.78  56.05    31.5     100  31.50   16   31   53  31.00
   6 Philou_371-64      :  -86.78  56.30    26.5     100  26.50   12   29   59  29.00

White advantage = 35.48 +/- 14.64
Draw rate (equal opponents) = 25.47 % +/- 1.90
=> GAMES(download)
Errors/bugs
-
Comments:
- Frolic 2.5 played with 32MB hash, because it has a fixed value and
changing it is not yet implemented (despite available uci option)

CCRAT-7

   # PLAYER                      :  RATING  ERROR  POINTS  PLAYED    (%)    W    D    L   D(%)
   1 Fruit_21                    :   61.90  37.15   136.5     200  68.25  115   43   42  21.50
   2 Euwe_200-64                 :    6.13  38.48   122.0     200  61.00   98   48   54  24.00
   3 GreKo_2017-64               :    4.29  36.68   121.5     200  60.75  103   37   60  18.50
   4 Potential_srw-bb19e54-64    :  -72.32  18.20   220.0     600  36.67  156  128  316  21.33

White advantage = 10.12 +/- 12.53
Draw rate (equal opponents) = 22.47 % +/- 1.72
=> GAMES(download)
Errors/bugs
Player: Potential_srw-bb19e54-64
   "Loss: Black makes an illegal move: a5b5": 1
   "Loss: Black makes an illegal move: d1b6b": 1
   "Loss: Black makes an illegal move: f8h6": 1
   "Loss: Black's connection stalls": 3
   "Loss: White makes an illegal move: a8a8": 1
   "Loss: White's connection stalls": 5
Player: GreKo_2017-64
   "Loss: Black makes an illegal move: a8a8": 1
   "Loss: White makes an illegal move: a8a8": 3
Comments:
- GreKo 2017 sends 'material draw' and plays an illegal move 'a8a8'
also in positions not covered by FIDE rules.

position fen 1b6/8/2K2N2/8/8/8/4k3/8 w - - 0 164
go wtime 20000 btime 20000 winc 1000 binc 1000
1/2-1/2 {Insufficient material}
bestmove a8a8

In later versions it sends a legal bestmove and plays on.
Note that this bug was present in an earlier version 10.3 too and
had been fixed already, but obviously crept in again.
https://talkchess.com/viewtopic.php?p=554431#p554431

- Potential test version with some bugs - stalling in dead lost positions
and other bugs.

CCRAT-6

   # PLAYER                       :  RATING  ERROR  POINTS  PLAYED    (%)    W    D    L   D(%)
   1 Lux 4.1 x64                  :   60.97  50.83    68.5     120  57.08   42   53   25  44.17
   2 Peacekeeper 1.30 x64         :   37.31  46.12    64.5     120  53.75   53   23   44  19.17
   3 Potential srw bb19e54 x64    :   10.97  23.73   249.0     480  51.88  190  118  172  24.58
   4 Monolith 0.4 x64             :  -21.26  44.33    54.5     120  45.42   46   17   57  14.17
   5 Coiled 0.5 x64               :  -87.99  50.18    43.5     120  36.25   31   25   64  20.83

White advantage = 6.01 +/- 13.37
Draw rate (equal opponents) = 25.05 % +/- 2.00
=> GAMES(download)
Errors/bugs
Player: Potential_srw-bb19e54-64
   "Loss: Black makes an illegal move: c7e5r": 1
   "Loss: Black's connection stalls": 3
   "Loss: White makes an illegal move: a8a8": 1
   "Loss: White's connection stalls": 3
Player: Lux_41-64
   "Loss: Black loses on time": 1
   "Loss: White loses on time": 1
Comments:
- Lux 4.1 time losses in two games over 160 moves with a long move sequence
into the 50 moves draw counter (35-40 moves already).
It seems it always used very slightly more time than the inc gave even
after 140 moves.

- Potential test version with some bugs - stalling in dead lost positions
and other bugs.

CCRAT-5

   # PLAYER                       :  RATING  ERROR  POINTS  PLAYED    (%)    W    D    L   D(%)
   1 Quazar 0.3 x64               :   45.03  26.07   175.0     300  58.33  140   70   90  23.33
   2 Potential srw d00d895 x64    :   13.43  26.56   157.5     300  52.50  112   91   97  30.33
   3 Tcheran 3.0 x64              :  -23.36  27.15   137.0     300  45.67   93   88  119  29.33
   4 FoxSee v8.2 x64              :  -35.10  25.03   130.5     300  43.50   97   67  136  22.33

White advantage = 43.17 +/- 12.36
Draw rate (equal opponents) = 26.99 % +/- 1.85
=> GAMES(download)
Errors/bugs
Player: Potential_srw-d00d895-64
   "Loss: Black makes an illegal move: e3d3": 1
Comments:
- Potential test version with some bugs.

CCRAT-4

   # PLAYER                       :  RATING  ERROR  POINTS  PLAYED    (%)    W    D    L   D(%)
   1 Glass 2.0 x64                :   90.25  62.43    57.5      80  71.88   51   13   16  16.25
   2 Leorik 2.1 x64               :   58.69  66.71    54.5      80  68.13   42   25   13  31.25
   3 Hamsters 0.7.1               :   24.26  64.12    51.0      80  63.75   43   16   21  20.00
   4 RedQueen 0.9.5 x64           :  -26.59  65.01    45.5      80  56.88   38   15   27  18.75
   5 Critter 0.40                 :  -71.09  58.93    40.5      80  50.63   32   17   31  21.25
   6 Potential srw d00d895 x64    :  -75.51  27.70   151.0     400  37.75  108   86  206  21.50

White advantage = 32.62 +/- 16.33
Draw rate (equal opponents) = 22.91 % +/- 2.13
=> GAMES(download)
Errors/bugs
Player: Potential_srw-d00d895-64
   "Loss: White makes an illegal move: a8a8": 2
Player: RedQueen_095-64
   "Loss: Black loses on time": 1
   "Loss: White loses on time": 1
Comments:
- Various RedQueen versions sometimes (rarely) lose on time

- Potential test version with some bugs

CCRAT-3

   # PLAYER                       :   RATING  ERROR  POINTS  PLAYED    (%)    W    D    L   D(%)
   1 Admete 1.5.0 x64             :   117.01  40.81   136.0     200  68.00  112   48   40  24.00
   2 Hamsters 0.6                 :    88.43  36.00   127.5     200  63.75  104   47   49  23.50
   3 Counter 2.0.1 x64            :    57.51  39.43   118.0     200  59.00   99   38   63  19.00
   4 Potential dev 3a9f418 x64    :   -21.61  36.51    93.0     200  46.50   74   38   88  19.00
   5 Diablo 0.5.1 x64             :  -118.08  42.50    63.5     200  31.75   38   51  111  25.50
   6 Diablo 0.5.1                 :  -123.28  41.19    62.0     200  31.00   34   56  110  28.00

White advantage = 23.95 +/- 12.39
Draw rate (equal opponents) = 25.93 % +/- 1.98
=> GAMES(download)
Errors/bugs
Player: Potential_dev3a9f418-64
   "Loss: White disconnects": 1
Player: Counter_201-64
   "Loss: Black makes an illegal move: a5a4": 1
   "Loss: Black makes an illegal move: g4g3": 1
   "Loss: Black makes an illegal move: g8h7": 1
   "Loss: Black makes an illegal move: h5g6": 1
   "Loss: White makes an illegal move: f7d5": 1
   "Loss: White makes an illegal move: h3f1": 1
Comments:
- Counter 2.0.1 ignores N underpromotions and treats 'em as Q promotions
(games of that version removed from the CCRAT rating list, as base games
from CCRL + CEGT were inconsistently adjudicated despite the resulting
illegal moves - bug fixed in 2.0.2)

- Potential test version with some bugs

CCRAT-2

   # PLAYER                       :  RATING  ERROR  POINTS  PLAYED    (%)    W    D    L   D(%)
   1 Potential dev 3a9f418 x64    :   45.53  16.31   250.5     400  62.63  213   75  112  18.75
   2 Diablo 0.5.1 x64             :  -45.53  16.31   149.5     400  37.38  112   75  213  18.75

White advantage = 29.09 +/- 16.00
Draw rate (equal opponents) = 19.62 % +/- 1.98
=> GAMES(download)
Errors/bugs
Player: Potential_dev3a9f418-64
   "Loss: Black disconnects": 7
   "Loss: White disconnects": 1
Comments:
- Potential test version with some bugs

CCRAT-1

   # PLAYER                  :  RATING  ERROR  POINTS  PLAYED    (%)    W    D    L   D(%)
   1 Stash 10.0 x64          :  101.33  25.18   246.0     360  68.33  211   70   79  19.44
   2 Rudim 1.4 x64           :  -22.42  24.60   165.5     360  45.97  120   91  149  25.28
   3 Chers 0.3.2 x64         :  -31.48  25.16   159.5     360  44.31  108  103  149  28.61
   4 MinimalChess 0.3 x64    :  -47.43  25.04   149.0     360  41.39   92  114  154  31.67

White advantage = 14.12 +/- 10.72
Draw rate (equal opponents) = 27.63 % +/- 1.74
=> GAMES(download)
Errors/bugs
Player: Chers_032-64
   "Loss: White's connection stalls": 1
Comments:
- Chers 0.32 bug verified and reproduced
3rr1k1/1p3pp1/pqnbbn1p/4p3/2ppP1P1/PP1P1N1P/1BPQNPB1/3RR1K1 w - - 0 19
(hangs always in this position)