CCRL 40/15
Downloads and Statistics
April 10, 2021
Testing summary:
Total: 1'235'065 games
played by 2'819 programs

White wins: 423'539 (34.3%)
Black wins: 311'222 (25.2%)
Draws: 500'304 (40.5%)
White score: 54.5%

Custom engine selection

Comparing 13 engines!
13 selected engines played 0 games with each other

CCRL 40/15 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k.
Computed on April 10, 2021 with Bayeselo based on 1'235'065 games
Please refer to the "about" page for comments on engine inclusion

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Lc0 0.27.0 w703810 64-bit 4CPU3332+19−2043.6%+37.960.4%748 
100.0%
 Lc0 0.24.0 w591226 64-bit3142+31−3149.5%−1.053.8%292
65.7%
 Lc0 0.27.0 w703810 64-bit3129+56−5646.1%+26.254.4%90
65.3%
 Lc0 0.26.2 w703810 64-bit3116+30−3046.6%+17.953.5%312
83.2%
 Lc0 0.21.3 wLD2 64-bit3094+33−3351.2%−15.147.5%284
63.3%
 Lc0 0.22.0 wLD2 64-bit3086+35−3550.2%−5.248.3%238
78.4%
 Lc0 0.23.2 wLD2 64-bit3066+36−3653.2%−23.845.0%238
72.4%
 Lc0 0.20.1 w36089 64-bit3053+21−2057.5%−57.436.7%829
100.0%
 Lc0 0.21.1 w11258 64-bit2968+37−3752.7%−18.039.8%226
70.6%
 Lc0 0.20.1 w11258 64-bit2954+34−3450.2%−4.840.5%274
97.5%
 Lc0 0.20.2 w32930 64-bit2907+33−3252.5%−19.341.3%298
90.4%
 Lc0 0.19.1 w11248 64-bit2876+32−3252.1%−14.839.1%304
100.0%
 Leela Chess 0.10 w323 64-bit2652+18−1852.2%−18.325.1%1102
 

Results matrix

Custom engine selection
#NameElo12345678910111213
1Lc0 0.27.0 w703810 64-bit 4CPU3332             
2Lc0 0.24.0 w591226 64-bit3142             
3Lc0 0.27.0 w703810 64-bit3129             
4Lc0 0.26.2 w703810 64-bit3116             
5Lc0 0.21.3 wLD2 64-bit3094             
6Lc0 0.22.0 wLD2 64-bit3086             
7Lc0 0.23.2 wLD2 64-bit3066             
8Lc0 0.20.1 w36089 64-bit3053             
9Lc0 0.21.1 w11258 64-bit2968             
10Lc0 0.20.1 w11258 64-bit2954             
11Lc0 0.20.2 w32930 64-bit2907             
12Lc0 0.19.1 w11248 64-bit2876             
13Leela Chess 0.10 w323 64-bit2652             
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo12345678910111213
1Lc0 0.27.0 w703810 64-bit 4CPU3332 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Lc0 0.24.0 w591226 64-bit31420.0 65.787.698.099.099.9100.0100.0100.0100.0100.0100.0
3Lc0 0.27.0 w703810 64-bit31290.034.3 65.385.390.096.999.4100.0100.0100.0100.0100.0
4Lc0 0.26.2 w703810 64-bit31160.012.434.7 83.290.098.3100.0100.0100.0100.0100.0100.0
5Lc0 0.21.3 wLD2 64-bit30940.02.014.716.8 63.387.598.1100.0100.0100.0100.0100.0
6Lc0 0.22.0 wLD2 64-bit30860.01.010.010.036.7 78.494.1100.0100.0100.0100.0100.0
7Lc0 0.23.2 wLD2 64-bit30660.00.13.11.712.521.6 72.4100.0100.0100.0100.0100.0
8Lc0 0.20.1 w36089 64-bit30530.00.00.60.01.95.927.6 100.0100.0100.0100.0100.0
9Lc0 0.21.1 w11258 64-bit29680.00.00.00.00.00.00.00.0 70.699.2100.0100.0
10Lc0 0.20.1 w11258 64-bit29540.00.00.00.00.00.00.00.029.4 97.599.9100.0
11Lc0 0.20.2 w32930 64-bit29070.00.00.00.00.00.00.00.00.82.5 90.4100.0
12Lc0 0.19.1 w11248 64-bit28760.00.00.00.00.00.00.00.00.00.19.6 100.0
13Leela Chess 0.10 w323 64-bit26520.00.00.00.00.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo12345678910111213
1Lc0 0.27.0 w703810 64-bit 4CPU3332 000000000000
2Lc0 0.24.0 w591226 64-bit31420 1201587092884800000
3Lc0 0.27.0 w703810 64-bit31290120 17216081200000
4Lc0 0.26.2 w703810 64-bit31160158172 4863324800000
5Lc0 0.21.3 wLD2 64-bit30940701648 24562452844320
6Lc0 0.22.0 wLD2 64-bit308609206324 322420724480
7Lc0 0.23.2 wLD2 64-bit30660888325632 1200000
8Lc0 0.20.1 w36089 64-bit30530481248242412 607248480
9Lc0 0.21.1 w11258 64-bit296800005220060 1244480
10Lc0 0.20.1 w11258 64-bit2954000087207212 28680
11Lc0 0.20.2 w32930 64-bit2907000044440484428 160
12Lc0 0.19.1 w11248 64-bit28760000328048486816 0
13Leela Chess 0.10 w323 64-bit2652000000000000 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo12345678910111213
1Lc0 0.27.0 w703810 64-bit 4CPU3332 0.00.00.00.00.00.00.00.00.00.00.00.0
2Lc0 0.24.0 w591226 64-bit31420.0 31.426.212.217.416.64.30.00.00.00.00.0
3Lc0 0.27.0 w703810 64-bit31290.031.4 42.84.30.02.41.30.00.00.00.00.0
4Lc0 0.26.2 w703810 64-bit31160.026.242.8 8.111.55.84.20.00.00.00.00.0
5Lc0 0.21.3 wLD2 64-bit30940.012.24.38.1 4.610.72.210.21.47.65.40.0
6Lc0 0.22.0 wLD2 64-bit30860.017.40.011.54.6 6.72.24.314.18.21.50.0
7Lc0 0.23.2 wLD2 64-bit30660.016.62.45.810.76.7 1.10.00.00.00.00.0
8Lc0 0.20.1 w36089 64-bit30530.04.31.34.22.22.21.1 5.76.54.34.20.0
9Lc0 0.21.1 w11258 64-bit29680.00.00.00.010.24.30.05.7 2.48.49.10.0
10Lc0 0.20.1 w11258 64-bit29540.00.00.00.01.414.10.06.52.4 4.911.80.0
11Lc0 0.20.2 w32930 64-bit29070.00.00.00.07.68.20.04.38.44.9 2.70.0
12Lc0 0.19.1 w11248 64-bit28760.00.00.00.05.41.50.04.29.111.82.7 0.0
13Leela Chess 0.10 w323 64-bit26520.00.00.00.00.00.00.00.00.00.00.00.0 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 67 common opponents

Custom engine selection
NameEloLc0
0.27.0
w703810
64-bit
4CPU
Lc0
0.24.0
w591226
64-bit
Lc0
0.27.0
w703810
64-bit
Lc0
0.26.2
w703810
64-bit
Lc0
0.21.3
wLD2
64-bit
Lc0
0.22.0
wLD2
64-bit
Lc0
0.23.2
wLD2
64-bit
Lc0
0.20.1
w36089
64-bit
Lc0
0.21.1
w11258
64-bit
Lc0
0.20.1
w11258
64-bit
Lc0
0.20.2
w32930
64-bit
Lc0
0.19.1
w11248
64-bit
Leela
Chess
0.10
w323
64-bit
Pedone 3.0 64-bit3244 50%
8/16
38%
3/8
          
RofChade 2.3 64-bit3240 38%
1.5/4
25%
1/4
12%
1/8
         
Laser 1.7 64-bit3206 50%
2/4
 50%
2/4
   33%
10.5/32
     
RofChade 2.202 64-bit3204 0%
0/1
  12%
0.5/4
        
Defenchess 2.2 64-bit3202 25%
1/4
38%
1.5/4
29%
3.5/12
25%
1/4
        
Schooner 2.2 64-bit3202 31%
2.5/8
44%
3.5/8
46%
5.5/12
         
Booot 6.3.1 64-bit3199 38%
1.5/4
     30%
9.5/32
     
Fizbo 2 64-bit3196 50%
2/4
     30%
9.5/32
     
Fritz 17 64-bit3191 12%
0.5/4
 62%
2.5/4
42%
13.5/32
        
Andscacs 0.95 64-bit3180 25%
1/4
38%
1.5/4
46%
5.5/12
38%
1.5/4
 38%
1.5/4
33%
10.5/32
     
RubiChess 1.7.1 64-bit3172 38%
1.5/4
   38%
7.5/20
       
Arasan 22.2 64-bit3158  38%
3/8
48%
9.5/20
         
Halogen 10 64-bit3156 46%
11/24
50%
4/8
          
Wasp 4.50 64-bit3155  56%
4.5/8
17%
2/12
         
Roc 1.6 64-bit3154 50%
4/8
   40%
8/20
       
Arasan 22.1 64-bit3146 25%
1/4
 56%
9/16
         
Arasan 22.0 64-bit3140 50%
4/8
    45%
9/20
      
NirvanaChess 2.5 64-bit3132  44%
3.5/8
48%
11.5/24
         
Pedone 2.1 64-bit3128   56%
9/16
 42%
8.5/20
       
Winter 0.9 64-bit3127 52%
11.5/22
50%
4/8
38%
6/16
         
NameEloLc0
0.27.0
w703810
64-bit
4CPU
Lc0
0.24.0
w591226
64-bit
Lc0
0.27.0
w703810
64-bit
Lc0
0.26.2
w703810
64-bit
Lc0
0.21.3
wLD2
64-bit
Lc0
0.22.0
wLD2
64-bit
Lc0
0.23.2
wLD2
64-bit
Lc0
0.20.1
w36089
64-bit
Lc0
0.21.1
w11258
64-bit
Lc0
0.20.1
w11258
64-bit
Lc0
0.20.2
w32930
64-bit
Lc0
0.19.1
w11248
64-bit
Leela
Chess
0.10
w323
64-bit
Roc 1.7 64-bit3123 25%
1/4
38%
1.5/4
52%
10.5/20
         
Marvin 5.0.0 64-bit3113  62%
2.5/4
58%
7/12
         
Pedone 2.0 64-bit3107 56%
4.5/8
   66%
10.5/16
38%
1.5/4
      
SlowChess Blitz Classic 1.9 64-bit3104 0%
0/1
  38%
6/16
        
NirvanaChess 2.4 64-bit3099    38%
1.5/4
33%
4/12
       
Vajolet2 2.8 64-bit3098 56%
4.5/8
 44%
3.5/8
 55%
11/20
50%
2/4
      
Nemorino 5.00 64-bit3085 25%
1/4
    50%
2/4
      
Winter 0.8 64-bit3081   0%
0/1
 50%
8/16
       
Pedone 1.9 64-bit3079     62%
2.5/4
 58%
11.5/20
     
ChessBrainVB 3.743066 62%
2.5/4
  47%
8.5/18
 50%
2/4
      
Wasp 3.75 64-bit3062 12%
0.5/4
  52%
10.5/20
38%
1.5/4
75%
3/4
      
chess22k 1.13 64-bit3062    45%
4.5/10
 75%
3/4
      
iCE 4.0 64-bit3060 62%
2.5/4
 75%
3/4
75%
15/20
 25%
1/4
      
RubiChess 1.4 64-bit3036       44%
7/16
 75%
3/4
   
Senpai 2.0 64-bit3031     75%
3/4
    25%
1/4
  
Pirarucu 3.0.7 64-bit3013     50%
4/8
    34%
5.5/16
  
Winter 0.7 64-bit3002     50%
2/4
   56%
9/16
   
Hakkapeliitta TCEC v2 64-bit2999     62%
5/8
    50%
2/4
  
Rodent III 0.281 64-bit2992     50%
2/4
   42%
7.5/18
   
Deuterium 2019.2.37.73 64-bit2981     75%
3/4
  52%
10.5/20
    
NameEloLc0
0.27.0
w703810
64-bit
4CPU
Lc0
0.24.0
w591226
64-bit
Lc0
0.27.0
w703810
64-bit
Lc0
0.26.2
w703810
64-bit
Lc0
0.21.3
wLD2
64-bit
Lc0
0.22.0
wLD2
64-bit
Lc0
0.23.2
wLD2
64-bit
Lc0
0.20.1
w36089
64-bit
Lc0
0.21.1
w11258
64-bit
Lc0
0.20.1
w11258
64-bit
Lc0
0.20.2
w32930
64-bit
Lc0
0.19.1
w11248
64-bit
Leela
Chess
0.10
w323
64-bit
RubiChess 1.3 64-bit2981       61%
8.5/14
  38%
1.5/4
12%
0.5/4
 
Pirarucu 2.9.5 64-bit2966       68%
9.5/14
 100%
4/4
50%
2/4
  
Amoeba 3.0 64-bit2962     62%
5/8
   54%
13/24
   
Deuterium 2019.1.36.50 64-bit2953         38%
1.5/4
38%
1.5/4
25%
1/4
 
Pirarucu 2.7.4 64-bit2950         33%
4/12
 31%
2.5/8
 
Marvin 3.4.0 64-bit2937    88%
3.5/4
   50%
6/12
    
Amoeba 2.8 64-bit2926       64%
20.5/32
 58%
7/12
25%
1/4
  
Winter 0.6 64-bit2926    62%
2.5/4
    75%
3/4
   
Godel 6.0 64-bit2923    75%
3/4
     43%
6/14
  
Cheng 4.39 64-bit2919       55%
17.5/32
62%
7.5/12
62%
2.5/4
 25%
1/4
 
Dirty CUCUMBER 64-bit2918     62%
2.5/4
   31%
5/16
 62%
2.5/4
 
Deuterium 2018.1.35.514 64-bit2913       64%
20.5/32
   38%
1.5/4
 
Crafty 25.3 64-bit2912     50%
2/4
   42%
5/12
   
RubiChess 1.2.1 64-bit2908         50%
6/12
 31%
2.5/8
 
Toga II 4.0 64-bit2904    75%
3/4
  67%
21.5/32
62%
2.5/4
 25%
1/4
  
Atlas 3.91 64-bit2899     88%
3.5/4
 73%
23.5/32
38%
1.5/4
    
Scorpio 2.9 MCTS 64-bit2868    88%
3.5/4
   38%
1.5/4
 50%
9/18
  
The Baron 3.44 64-bit2866    50%
2/4
   12%
0.5/4
  53%
8.5/16
 
Marvin 3.3.2 64-bit2858        75%
3/4
 54%
6.5/12
  
Counter 3.3 64-bit2848    75%
3/4
     58%
7/12
  
NameEloLc0
0.27.0
w703810
64-bit
4CPU
Lc0
0.24.0
w591226
64-bit
Lc0
0.27.0
w703810
64-bit
Lc0
0.26.2
w703810
64-bit
Lc0
0.21.3
wLD2
64-bit
Lc0
0.22.0
wLD2
64-bit
Lc0
0.23.2
wLD2
64-bit
Lc0
0.20.1
w36089
64-bit
Lc0
0.21.1
w11258
64-bit
Lc0
0.20.1
w11258
64-bit
Lc0
0.20.2
w32930
64-bit
Lc0
0.19.1
w11248
64-bit
Leela
Chess
0.10
w323
64-bit
Tornado 8.0 64-bit2842       73%
23.5/32
   25%
1/4
 
Tucano 7.07 64-bit2842    62%
2.5/4
   88%
3.5/4
    
Fruit Reloaded 3.2.1 64-bit2837    25%
1/4
   75%
3/4
  25%
1/4
 
Asymptote 0.6.3 64-bit2836    88%
3.5/4
      58%
7/12
 
Counter 3.2 64-bit2834        12%
0.5/4
 66%
10.5/16
  
Zurichess Neuchatel 64-bit2830        50%
2/4
  88%
3.5/4
 
Monolith 1.0 64-bit2795        62%
2.5/4
  38%
1.5/4
 
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on April 10, 2021