CCRL 40/15
Downloads and Statistics
October 24, 2020
Testing summary:
Total: 1'185'135 games
played by 2'728 programs

White wins: 408'196 (34.4%)
Black wins: 301'376 (25.4%)
Draws: 475'563 (40.1%)
White score: 54.5%

Custom engine selection

Comparing 7 engines!
7 selected engines played 61 games with each other

CCRL 40/15 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k.
Computed on October 24, 2020 with Bayeselo based on 1'185'135 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Onno 1.2.70 64-bit 4CPU2933+19−1947.3%+16.748.3%810 
100.0%
 Onno 1.2.70 64-bit2835+16−1648.4%+10.442.8%1254
92.8%
 Onno 1.0 64-bit2817+17−1746.2%+27.941.3%1149
72.8%
 Onno 1.1.1 64-bit2809+20−2146.6%+22.842.5%756
81.3%
 Onno 1.1.1 32-bit2797+18−1845.6%+27.743.4%1011
62.7%
 Onno 1.0 32-bit2793+18−1845.5%+28.348.6%911
70.6%
 Onno 1.2.70 32-bit2786+18−1846.2%+24.847.0%979
 

Results matrix

Custom engine selection
#NameElo1234567
1Onno 1.2.70 64-bit 4CPU2933       
2Onno 1.2.70 64-bit2835       
3Onno 1.0 64-bit2817     36.5 − 24.5
+15−3=43
+28
 
4Onno 1.1.1 64-bit2809       
5Onno 1.1.1 32-bit2797       
6Onno 1.0 32-bit2793  24.5 − 36.5
+3−15=43
−28
    
7Onno 1.2.70 32-bit2786       
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo1234567
1Onno 1.2.70 64-bit 4CPU2933 100.0100.0100.0100.0100.0100.0
2Onno 1.2.70 64-bit28350.0 92.897.299.9100.0100.0
3Onno 1.0 64-bit28170.07.2 72.895.197.999.4
4Onno 1.1.1 64-bit28090.02.827.2 81.388.095.4
5Onno 1.1.1 32-bit27970.00.14.918.7 62.781.0
6Onno 1.0 32-bit27930.00.02.112.037.2 70.6
7Onno 1.2.70 32-bit27860.00.00.64.619.029.4 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo1234567
1Onno 1.2.70 64-bit 4CPU2933 582070006
2Onno 1.2.70 64-bit283558 298306133135294
3Onno 1.0 64-bit2817207298 55921552472
4Onno 1.1.1 64-bit28090306559 283330146
5Onno 1.1.1 32-bit27970133215283 1218506
6Onno 1.0 32-bit279301355243301218 420
7Onno 1.2.70 32-bit2786629472146506420 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo1234567
1Onno 1.2.70 64-bit 4CPU2933 2.810.60.00.00.00.3
2Onno 1.2.70 64-bit28352.8 12.415.25.96.213.2
3Onno 1.0 64-bit281710.612.4 29.310.025.43.4
4Onno 1.1.1 64-bit28090.015.229.3 16.019.88.4
5Onno 1.1.1 32-bit27970.05.910.016.0 63.425.4
6Onno 1.0 32-bit27930.06.225.419.863.4 22.2
7Onno 1.2.70 32-bit27860.313.23.48.425.422.2 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 80 common opponents

Custom engine selection
NameEloOnno
1.2.70
64-bit
4CPU
Onno
1.2.70
64-bit
Onno
1.0
64-bit
Onno
1.1.1
64-bit
Onno
1.1.1
32-bit
Onno
1.0
32-bit
Onno
1.2.70
32-bit
Rybka 3 64-bit3047  12%
7/57
8%
1.5/18
   
Rybka 3 32-bit2995    18%
7/38
22%
6.5/30
 
Naum 4.2 64-bit2976 29%
7/24
 24%
7/29
   
Zappa Mexico II 64-bit 4CPU296842%
5/12
 38%
12/32
    
Naum 4 64-bit2954  23%
7.5/32
29%
5.5/19
   
Deep Shredder 12 64-bit2939 38%
1.5/4
 20%
1/5
   
Stockfish 1.6.3 32-bit2933    28%
9.5/34
15%
4.5/30
 
Naum 4 32-bit2929    33%
12.5/38
37%
11/30
 
Shredder 12 32-bit2929 40%
9.5/24
  30%
24.5/82
24%
15/62
38%
11.5/30
Deep Sjeng WC2008 64-bit 4CPU292544%
4/9
 22%
7/32
    
Thinker 5.4c Inert 64-bit 4CPU292353%
17/32
 33%
10.5/32
    
Gull 1.2 64-bit291950%
1/2
50%
1/2
     
Hannibal 1.2 64-bit291550%
3/6
0%
0/2
     
Spike 1.4 Leiden2914 50%
1/2
    0%
0/2
Quazar 0.4 64-bit290575%
6/8
30%
3/10
     
Toga II 1.4.1SE 4CPU290362%
2.5/4
 35%
10.5/30
    
Glaurung 2.2 64-bit 4CPU289525%
0.5/2
 29%
10/34
    
iCE 2.0 64-bit2892 50%
1/2
75%
1.5/2
    
Fritz 122886   75%
1.5/2
43%
14.5/34
28%
8.5/30
23%
7/30
Hiarcs 13.12874 48%
11.5/24
    49%
16.5/34
NameEloOnno
1.2.70
64-bit
4CPU
Onno
1.2.70
64-bit
Onno
1.0
64-bit
Onno
1.1.1
64-bit
Onno
1.1.1
32-bit
Onno
1.0
32-bit
Onno
1.2.70
32-bit
Thinker 5.4d Inert 64-bit2865 55%
11/20
 50%
1/2
   
Stockfish 1.5.1 32-bit2863    35%
12/34
27%
8/30
 
Thinker 5.4c Inert 64-bit2859 40%
9.5/24
52%
16.5/32
47%
8.5/18
   
Thinker 5.4d Inert 32-bit2856    25%
1/4
 38%
15.5/41
Zappa Mexico II 64-bit2853 43%
15.5/36
48%
15.5/32
53%
10/19
   
Fritz 112851  41%
13/32
50%
1/2
 38%
11.5/30
 
Thinker 5.4c Inert 32-bit2849    34%
11.5/34
43%
13/30
 
Loop M1-T 64-bit 4CPU284865%
20/31
 40%
12.5/31
    
Stockfish 1.4 64-bit2848  56%
18/32
44%
28/64
 42%
13.5/32
 
Nemo 1.0.1 64-bit284767%
4/6
46%
22/48
     
Booot 5.1.02843100%
2/2
58%
14/24
    35%
4.5/13
Deep Shredder 11 64-bit2842  45%
14.5/32
34%
5.5/16
   
Deep Sjeng WC2008 64-bit2835 44%
10.5/24
45%
14.5/32
42%
8/19
   
Spark 0.3 64-bit2835 48%
11.5/24
 43%
14.5/34
   
Shredder 112832    48%
14.5/30
48%
14.5/30
 
Deep Junior 11.1a 32-bit2831    75%
1.5/2
 12%
0.5/4
Stockfish 1.4 32-bit2829    45%
38/84
50%
15/30
 
Grapefruit 1.0 32-bit2826 44%
10.5/24
44%
14/32
50%
8/16
42%
15.5/37
40%
12/30
43%
14.5/34
Toga II 1.4.1SE2826   54%
28/52
51%
26.5/52
 62%
2.5/4
Deep Sjeng WC2008 32-bit2825    37%
14/38
53%
16/30
44%
15/34
NameEloOnno
1.2.70
64-bit
4CPU
Onno
1.2.70
64-bit
Onno
1.0
64-bit
Onno
1.1.1
64-bit
Onno
1.1.1
32-bit
Onno
1.0
32-bit
Onno
1.2.70
32-bit
Booot 5.02824 56%
13.5/24
    40%
2/5
Cyclone xTreme2823    48%
14.5/30
 75%
1.5/2
Murka 3 64-bit2823 46%
5.5/12
65%
6.5/10
    
Cyclone xTreme Rage2820    25%
1.5/6
 44%
4/9
Hiarcs 12.12817  48%
15.5/32
44%
8/18
50%
20/40
53%
16/30
 
Toga II 3.1.2SE2815 62%
5/8
    33%
2/6
Hiarcs 12 Sharpen PV On2813  53%
17/32
 37%
11/30
45%
13.5/30
 
Hiarcs 122808  44%
14/32
75%
1.5/2
   
Zappa Mexico II 32-bit2808    51%
19.5/38
47%
14/30
85%
8.5/10
Scorpio 2.7.7 64-bit2804 62%
2.5/4
70%
7/10
    
Cheng4 0.36c 64-bit2798 50%
0.5/1
   60%
6/10
 
Spark 0.3 32-bit2797    62%
20.5/33
60%
18/30
 
Doch 09.980 32-bit2795    45%
13.5/30
55%
16.5/30
 
Hiarcs Paderborn 20072794  62%
20/32
 50%
1/2
 50%
1/2
Atlas 3.70em 64-bit2787 50%
1/2
50%
2/4
    
Texel 1.01 64-bit2786100%
2/2
35%
3.5/10
     
Scorpio 2.7.6 64-bit2781 25%
1/4
65%
6.5/10
    
Jonny 4.002778 71%
17/24
    31%
7.5/24
Bright 0.4a2775  61%
38/62
53%
8.5/16
100%
2/2
62%
18.5/30
 
Naraku 1.42774 75%
1.5/2
   45%
4.5/10
75%
3/4
NameEloOnno
1.2.70
64-bit
4CPU
Onno
1.2.70
64-bit
Onno
1.0
64-bit
Onno
1.1.1
64-bit
Onno
1.1.1
32-bit
Onno
1.0
32-bit
Onno
1.2.70
32-bit
Loop 13.6 (Loop 2007) 32-bit2773    56%
19/34
55%
16.5/30
67%
6/9
Octochess r5190 64-bit2772 75%
1.5/2
60%
6/10
    
Ktulu 92752   78%
12.5/16
50%
1/2
58%
17.5/30
68%
17/25
SmarThink 1.20 32-bit2746   55%
17/31
39%
8.5/22
 43%
3/7
Spike 1.2 Turin2745   50%
8/16
75%
1.5/2
 50%
3/6
Twisted Logic 20100131x 32-bit2736    50%
1/2
 75%
1.5/2
SmarThink 1.10 32-bit2718   59%
9.5/16
 65%
13/20
 
Chess Tiger 2007.12704    75%
1.5/2
 50%
1/2
Crafty 23.2 32-bit2695    100%
2/2
 75%
3/4
Frenzee Feb08 32-bit2695    100%
1/1
 0%
0/1
Chessmaster 11 Conqueror2694     40%
4/10
38%
1.5/4
Chessmaster 11 Toxic2683    75%
1.5/2
 42%
2.5/6
Tornado 4.82 32-bit2681     80%
8/10
75%
1.5/2
Chessmaster 11 Leonidas2680    38%
1.5/4
 55%
5.5/10
MinkoChess 0.8 32-bit2674    50%
1/2
 75%
9/12
Daydreamer 1.75 32-bit2667    75%
1.5/2
 60%
12/20
Movei 00.8.438 (10 10 10)2667    75%
1.5/2
 50%
0.5/1
BugChess2 1.6.4 32-bit2657    75%
1.5/2
 100%
1/1
E.T. Chess 13.01.082649    100%
2/2
 83%
5/6
Colossus 2008b2643    100%
2/2
 75%
3/4
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on October 24, 2020