CCRL 40/15
Downloads and Statistics
October 24, 2020
Testing summary:
Total: 1'185'135 games
played by 2'728 programs

White wins: 408'196 (34.4%)
Black wins: 301'376 (25.4%)
Draws: 475'563 (40.1%)
White score: 54.5%

Custom engine selection

Comparing 11 engines!
11 selected engines played 0 games with each other

CCRL 40/15 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k.
Computed on October 24, 2020 with Bayeselo based on 1'185'135 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
 Lc0 0.26.2 w703810 64-bit3146+58−5945.7%+20.156.8%81 
59.4%
1Lc0 0.24.0 w591226 64-bit3137+35−3649.6%−1.852.2%230
95.5%
 Lc0 0.21.3 wLD2 64-bit3095+33−3351.2%−15.447.5%284
63.4%
 Lc0 0.22.0 wLD2 64-bit3087+35−3550.2%−5.648.3%238
78.0%
 Lc0 0.23.2 wLD2 64-bit3067+36−3653.2%−23.945.0%238
73.1%
 Lc0 0.20.1 w36089 64-bit3054+21−2157.5%−57.836.7%829
100.0%
 Lc0 0.21.1 w11258 64-bit2968+37−3752.7%−17.439.8%226
71.5%
 Lc0 0.20.1 w11258 64-bit2954+34−3450.2%−4.840.5%274
97.9%
 Lc0 0.20.2 w32930 64-bit2905+33−3352.2%−17.642.1%292
90.3%
 Lc0 0.19.1 w11248 64-bit2874+33−3351.9%−13.238.9%296
100.0%
 Leela Chess 0.10 w323 64-bit2652+18−1852.2%−18.325.1%1102
 

Results matrix

Custom engine selection
#NameElo1234567891011
1Lc0 0.26.2 w703810 64-bit3146           
2Lc0 0.24.0 w591226 64-bit3137           
3Lc0 0.21.3 wLD2 64-bit3095           
4Lc0 0.22.0 wLD2 64-bit3087           
5Lc0 0.23.2 wLD2 64-bit3067           
6Lc0 0.20.1 w36089 64-bit3054           
7Lc0 0.21.1 w11258 64-bit2968           
8Lc0 0.20.1 w11258 64-bit2954           
9Lc0 0.20.2 w32930 64-bit2905           
10Lc0 0.19.1 w11248 64-bit2874           
11Leela Chess 0.10 w323 64-bit2652           
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo1234567891011
1Lc0 0.26.2 w703810 64-bit3146 59.492.995.498.899.8100.0100.0100.0100.0100.0
2Lc0 0.24.0 w591226 64-bit313740.6 95.597.699.7100.0100.0100.0100.0100.0100.0
3Lc0 0.21.3 wLD2 64-bit30957.14.5 63.487.398.1100.0100.0100.0100.0100.0
4Lc0 0.22.0 wLD2 64-bit30874.62.436.6 78.094.2100.0100.0100.0100.0100.0
5Lc0 0.23.2 wLD2 64-bit30671.20.312.722.0 73.1100.0100.0100.0100.0100.0
6Lc0 0.20.1 w36089 64-bit30540.20.01.95.826.9 100.0100.0100.0100.0100.0
7Lc0 0.21.1 w11258 64-bit29680.00.00.00.00.00.0 71.599.4100.0100.0
8Lc0 0.20.1 w11258 64-bit29540.00.00.00.00.00.028.5 97.9100.0100.0
9Lc0 0.20.2 w32930 64-bit29050.00.00.00.00.00.00.62.1 90.3100.0
10Lc0 0.19.1 w11248 64-bit28740.00.00.00.00.00.00.00.09.7 100.0
11Leela Chess 0.10 w323 64-bit26520.00.00.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo1234567891011
1Lc0 0.26.2 w703810 64-bit3146 843227161200000
2Lc0 0.24.0 w591226 64-bit313784 7092884800000
3Lc0 0.21.3 wLD2 64-bit30953270 24562452844320
4Lc0 0.22.0 wLD2 64-bit3087279224 322420724480
5Lc0 0.23.2 wLD2 64-bit306716885632 1200000
6Lc0 0.20.1 w36089 64-bit30541248242412 607248480
7Lc0 0.21.1 w11258 64-bit2968005220060 1244480
8Lc0 0.20.1 w11258 64-bit29540087207212 28680
9Lc0 0.20.2 w32930 64-bit29050044440484428 160
10Lc0 0.19.1 w11248 64-bit287400328048486816 0
11Leela Chess 0.10 w323 64-bit26520000000000 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo1234567891011
1Lc0 0.26.2 w703810 64-bit3146 27.08.88.55.01.30.00.00.00.00.0
2Lc0 0.24.0 w591226 64-bit313727.0 13.619.718.84.50.00.00.00.00.0
3Lc0 0.21.3 wLD2 64-bit30958.813.6 4.610.72.210.21.47.65.50.0
4Lc0 0.22.0 wLD2 64-bit30878.519.74.6 6.72.24.314.18.31.50.0
5Lc0 0.23.2 wLD2 64-bit30675.018.810.76.7 1.10.00.00.00.00.0
6Lc0 0.20.1 w36089 64-bit30541.34.52.22.21.1 5.76.54.34.30.0
7Lc0 0.21.1 w11258 64-bit29680.00.010.24.30.05.7 2.48.59.20.0
8Lc0 0.20.1 w11258 64-bit29540.00.01.414.10.06.52.4 4.911.90.0
9Lc0 0.20.2 w32930 64-bit29050.00.07.68.30.04.38.54.9 2.70.0
10Lc0 0.19.1 w11248 64-bit28740.00.05.51.50.04.39.211.92.7 0.0
11Leela Chess 0.10 w323 64-bit26520.00.00.00.00.00.00.00.00.00.0 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 60 common opponents

Custom engine selection
NameEloLc0
0.26.2
w703810
64-bit
Lc0
0.24.0
w591226
64-bit
Lc0
0.21.3
wLD2
64-bit
Lc0
0.22.0
wLD2
64-bit
Lc0
0.23.2
wLD2
64-bit
Lc0
0.20.1
w36089
64-bit
Lc0
0.21.1
w11258
64-bit
Lc0
0.20.1
w11258
64-bit
Lc0
0.20.2
w32930
64-bit
Lc0
0.19.1
w11248
64-bit
Leela
Chess
0.10
w323
64-bit
RofChade 2.3 64-bit324012%
0.5/4
38%
1.5/4
         
Laser 1.7 64-bit3208 50%
2/4
   33%
10.5/32
     
RofChade 2.202 64-bit3207 0%
0/1
12%
0.5/4
        
Schooner 2.2 64-bit320650%
2/4
31%
2.5/8
         
Booot 6.3.1 64-bit3201 38%
1.5/4
   30%
9.5/32
     
Defenchess 2.2 64-bit320131%
2.5/8
25%
1/4
25%
1/4
        
Fizbo 2 64-bit3197 50%
2/4
   30%
9.5/32
     
Fritz 17 64-bit319362%
2.5/4
12%
0.5/4
42%
13.5/32
        
Andscacs 0.95 64-bit318162%
2.5/4
25%
1/4
38%
1.5/4
 38%
1.5/4
33%
10.5/32
     
RubiChess 1.7.1 64-bit3173 38%
1.5/4
 38%
7.5/20
       
Roc 1.6 64-bit3157 50%
4/8
 40%
8/20
       
Arasan 22.1 64-bit314656%
4.5/8
25%
1/4
         
Roc 1.7 64-bit314644%
3.5/8
25%
1/4
         
Arasan 22.0 64-bit3141 50%
4/8
  45%
9/20
      
Pedone 2.1 64-bit312550%
2/4
  42%
8.5/20
       
Pedone 2.0 64-bit3108 56%
4.5/8
 66%
10.5/16
38%
1.5/4
      
SlowChess Blitz Classic 1.9 64-bit3105 0%
0/1
38%
6/16
        
NirvanaChess 2.4 64-bit3100  38%
1.5/4
33%
4/12
       
Vajolet2 2.8 64-bit310038%
1.5/4
56%
4.5/8
 55%
11/20
50%
2/4
      
Nemorino 5.00 64-bit3086 25%
1/4
  50%
2/4
      
NameEloLc0
0.26.2
w703810
64-bit
Lc0
0.24.0
w591226
64-bit
Lc0
0.21.3
wLD2
64-bit
Lc0
0.22.0
wLD2
64-bit
Lc0
0.23.2
wLD2
64-bit
Lc0
0.20.1
w36089
64-bit
Lc0
0.21.1
w11258
64-bit
Lc0
0.20.1
w11258
64-bit
Lc0
0.20.2
w32930
64-bit
Lc0
0.19.1
w11248
64-bit
Leela
Chess
0.10
w323
64-bit
Winter 0.8 64-bit30810%
0/1
  50%
8/16
       
Pedone 1.9 64-bit3080   62%
2.5/4
 58%
11.5/20
     
ChessBrainVB 3.743068 62%
2.5/4
47%
8.5/18
 50%
2/4
      
Wasp 3.75 64-bit3063 12%
0.5/4
52%
10.5/20
38%
1.5/4
75%
3/4
      
chess22k 1.13 64-bit3063  45%
4.5/10
 75%
3/4
      
iCE 4.0 64-bit3061 62%
2.5/4
75%
15/20
 25%
1/4
      
RubiChess 1.4 64-bit3037     44%
7/16
 75%
3/4
   
Senpai 2.0 64-bit3032   75%
3/4
    25%
1/4
  
Pirarucu 3.0.7 64-bit3013   50%
4/8
    34%
5.5/16
  
Winter 0.7 64-bit3005   50%
2/4
   56%
9/16
   
Hakkapeliitta TCEC v2 64-bit3000   62%
5/8
    50%
2/4
  
Rodent III 0.281 64-bit2992   50%
2/4
   42%
7.5/18
   
RubiChess 1.3 64-bit2981     61%
8.5/14
  38%
1.5/4
12%
0.5/4
 
Deuterium 2019.2.37.73 64-bit2980   75%
3/4
  52%
10.5/20
    
Pirarucu 2.9.5 64-bit2966     68%
9.5/14
 100%
4/4
50%
2/4
  
Amoeba 3.0 64-bit2957   62%
5/8
   54%
13/24
   
Deuterium 2019.1.36.50 64-bit2953       38%
1.5/4
38%
1.5/4
25%
1/4
 
Pirarucu 2.7.4 64-bit2950       33%
4/12
 31%
2.5/8
 
Marvin 3.4.0 64-bit2938  88%
3.5/4
   50%
6/12
    
Amoeba 2.8 64-bit2926     64%
20.5/32
 58%
7/12
25%
1/4
  
NameEloLc0
0.26.2
w703810
64-bit
Lc0
0.24.0
w591226
64-bit
Lc0
0.21.3
wLD2
64-bit
Lc0
0.22.0
wLD2
64-bit
Lc0
0.23.2
wLD2
64-bit
Lc0
0.20.1
w36089
64-bit
Lc0
0.21.1
w11258
64-bit
Lc0
0.20.1
w11258
64-bit
Lc0
0.20.2
w32930
64-bit
Lc0
0.19.1
w11248
64-bit
Leela
Chess
0.10
w323
64-bit
Winter 0.6 64-bit2926  62%
2.5/4
    75%
3/4
   
Godel 6.0 64-bit2923  75%
3/4
     43%
6/14
  
Cheng 4.39 64-bit2921     55%
17.5/32
62%
7.5/12
62%
2.5/4
 25%
1/4
 
Dirty CUCUMBER 64-bit2917   62%
2.5/4
   31%
5/16
 62%
2.5/4
 
Deuterium 2018.1.35.514 64-bit2913     64%
20.5/32
   38%
1.5/4
 
Crafty 25.3 64-bit2912   50%
2/4
   42%
5/12
   
RubiChess 1.2.1 64-bit2908       50%
6/12
 31%
2.5/8
 
Toga II 4.0 64-bit2904  75%
3/4
  67%
21.5/32
62%
2.5/4
 25%
1/4
  
Atlas 3.91 64-bit2898   88%
3.5/4
 73%
23.5/32
38%
1.5/4
    
Scorpio 2.9 MCTS 64-bit2868  88%
3.5/4
   38%
1.5/4
 50%
9/18
  
The Baron 3.44 64-bit2864  50%
2/4
   12%
0.5/4
  53%
8.5/16
 
Marvin 3.3.2 64-bit2858      75%
3/4
 54%
6.5/12
  
Counter 3.3 64-bit2848  75%
3/4
     58%
7/12
  
Tornado 8.0 64-bit2842     73%
23.5/32
   25%
1/4
 
Tucano 7.07 64-bit2842  62%
2.5/4
   88%
3.5/4
    
Fruit Reloaded 3.2.1 64-bit2837  25%
1/4
   75%
3/4
  25%
1/4
 
Asymptote 0.6.3 64-bit2836  88%
3.5/4
      58%
7/12
 
Counter 3.2 64-bit2834      12%
0.5/4
 66%
10.5/16
  
Zurichess Neuchatel 64-bit2828      50%
2/4
  88%
3.5/4
 
Monolith 1.0 64-bit2796      62%
2.5/4
  38%
1.5/4
 
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on October 24, 2020