CCRL 40/15
Downloads and Statistics
August 1, 2020
Testing summary:
Total: 1'166'106 games
played by 2'690 programs

White wins: 402'287 (34.5%)
Black wins: 297'247 (25.5%)
Draws: 466'572 (40.0%)
White score: 54.5%

Custom engine selection

Comparing 9 engines!
9 selected engines played 0 games with each other

CCRL 40/15 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k.
Computed on August 1, 2020 with Bayeselo based on 1'166'106 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Spark 1.0 64-bit 4CPU2969+13−1345.0%+31.946.6%1787 
99.8%
 Spark 0.4 64-bit 4CPU2932+21−2143.0%+48.545.2%703
62.6%
 Spark 0.3 64-bit 4CPU2927+23−2346.5%+20.049.7%572
99.4%
 Spark 1.0 64-bit2892+12−1246.4%+27.642.7%2318
100.0%
 Spark 1.0 32-bit2864+11−1145.6%+29.244.6%2708
99.7%
 Spark 0.3 64-bit2835+18−1846.3%+25.338.3%1048
86.7%
 Spark 0.4 32-bit2821+16−1645.8%+27.347.8%1159
96.6%
 Spark 0.3a 32-bit2799+17−1745.7%+25.946.6%1070
56.3%
 Spark 0.3 32-bit2797+16−1647.7%+16.348.7%1264
 

Results matrix

Custom engine selection
#NameElo123456789
1Spark 1.0 64-bit 4CPU2969         
2Spark 0.4 64-bit 4CPU2932         
3Spark 0.3 64-bit 4CPU2927         
4Spark 1.0 64-bit2892         
5Spark 1.0 32-bit2864         
6Spark 0.3 64-bit2835         
7Spark 0.4 32-bit2821         
8Spark 0.3a 32-bit2799         
9Spark 0.3 32-bit2797         
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo123456789
1Spark 1.0 64-bit 4CPU2969 99.899.9100.0100.0100.0100.0100.0100.0
2Spark 0.4 64-bit 4CPU29320.2 62.699.9100.0100.0100.0100.0100.0
3Spark 0.3 64-bit 4CPU29270.137.4 99.4100.0100.0100.0100.0100.0
4Spark 1.0 64-bit28920.00.10.6 100.0100.0100.0100.0100.0
5Spark 1.0 32-bit28640.00.00.00.0 99.7100.0100.0100.0
6Spark 0.3 64-bit28350.00.00.00.00.3 86.799.899.9
7Spark 0.4 32-bit28210.00.00.00.00.013.3 96.698.0
8Spark 0.3a 32-bit27990.00.00.00.00.00.23.4 56.3
9Spark 0.3 32-bit27970.00.00.00.00.00.12.043.7 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo123456789
1Spark 1.0 64-bit 4CPU2969 50330633460000
2Spark 0.4 64-bit 4CPU2932503 2350060000
3Spark 0.3 64-bit 4CPU2927306235 0071000
4Spark 1.0 64-bit289233400 631555736187
5Spark 1.0 32-bit2864600631 951390537485
6Spark 0.3 64-bit28350607155595 182262372
7Spark 0.4 32-bit2821000731390182 818603
8Spark 0.3a 32-bit279900061537262818 1496
9Spark 0.3 32-bit2797000874853726031496 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo123456789
1Spark 1.0 64-bit 4CPU2969 20.213.08.10.10.00.00.00.0
2Spark 0.4 64-bit 4CPU293220.2 18.40.00.03.40.00.00.0
3Spark 0.3 64-bit 4CPU292713.018.4 0.00.04.40.00.00.0
4Spark 1.0 64-bit28928.10.00.0 12.616.52.11.82.4
5Spark 1.0 32-bit28640.10.00.012.6 2.535.914.212.2
6Spark 0.3 64-bit28350.03.44.416.52.5 8.212.416.1
7Spark 0.4 32-bit28210.00.00.02.135.98.2 36.724.9
8Spark 0.3a 32-bit27990.00.00.01.814.212.436.7 64.1
9Spark 0.3 32-bit27970.00.00.02.412.216.124.964.1 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 118 common opponents

Custom engine selection
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
Komodo 4 64-bit309826%
9/34
  13%
7/52
     
Naum 4.6 64-bit 4CPU30950%
0/2
  15%
3/20
     
Naum 4.2 64-bit 4CPU306128%
13/46
21%
8/38
19%
3/16
      
Deep Shredder 12 64-bit 4CPU301848%
22.5/47
43%
14.5/34
43%
21.5/50
      
Rybka 4 32-bit3017    38%
13/34
 27%
8/30
  
Stockfish 1.9.1 32-bit3001    29%
9.5/33
 21%
7/34
  
Rybka 3 32-bit2995       16%
5.5/34
20%
6.5/33
Critter 0.90 32-bit2990    35%
14.5/42
 21%
7/34
  
Stockfish 1.7.1 32-bit2977      24%
8/34
32%
11/34
22%
6.5/30
Naum 4.2 64-bit2976   33%
14/43
 28%
14.5/52
   
Komodo 1.3 64-bit297260%
21/35
  41%
6.5/16
     
Zappa Mexico II 64-bit 4CPU296854%
30.5/57
0%
0/2
47%
15/32
      
Fritz 13296044%
14/32
  42%
21.5/51
     
Naum 4.2 32-bit2958    40%
13.5/34
  35%
7/20
 
Naum 4.1 32-bit2953       22%
6.5/30
20%
6/30
Komodo 1.2 64-bit2945 46%
16.5/36
   38%
9/24
   
Deep Sjeng c't 20102941   45%
15/33
40%
13.5/34
    
Deep Shredder 12 64-bit2939   45%
28/62
 23%
16/69
   
Arasan 17.5 64-bit 4CPU293475%
7.5/10
55%
11/20
       
Onno 1.2.70 64-bit 4CPU293357%
32.5/57
49%
18.5/38
       
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
Stockfish 1.6.3 32-bit2933       33%
12.5/38
35%
12/34
EXchess 7.71b 64-bit 4CPU293255%
11/20
75%
7.5/10
       
Fizbo 1.4 64-bit 4CPU293275%
1.5/2
56%
4.5/8
       
Bobcat 7.1 64-bit 4CPU293144%
3.5/8
45%
4.5/10
       
Naum 4 32-bit2930       25%
1/4
26%
9/34
Shredder 12 32-bit2929   42%
10/24
36%
23/64
  18%
6/34
38%
24/63
Arasan 18.0 64-bit 4CPU292643%
9/21
61%
5.5/9
       
Thinker 5.4d Inert 64-bit 4CPU292675%
9/12
60%
21/35
48%
24/50
      
Deep Sjeng WC2008 64-bit 4CPU292571%
8.5/12
25%
1/4
52%
16.5/32
      
Komodo 1.0 64-bit2921  41%
13/32
  36%
14/39
   
Gull 1.2 64-bit291975%
1.5/2
  47%
22/47
     
Hannibal 1.2 64-bit291540%
4/10
  41%
19.5/47
     
Spike 1.4 Leiden2914   44%
48.5/110
39%
26.5/68
    
Rybka 2.3.2a 32-bit2912    43%
13/30
 27%
8/30
37%
11.5/31
33%
10.5/32
Crafty 23.8 64-bit 4CPU290869%
5.5/8
44%
3.5/8
       
Quazar 0.4 64-bit290542%
5/12
  52%
30/58
     
Toga II 1.4.1SE 4CPU290388%
3.5/4
56%
18.5/33
       
DiscoCheck 5.2 64-bit289960%
6/10
  50%
1/2
     
Cheng4 0.36c 64-bit 4CPU289650%
1/2
25%
2/8
       
Komodo 1.2 32-bit2896    44%
14/32
 38%
17.5/46
  
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
Hiarcs 13.22895   50%
11.5/23
42%
16/38
    
Tornado 7.0 64-bit 4CPU289358%
3.5/6
50%
5/10
       
Cheng4 0.38 64-bit2889   25%
0.5/2
30%
3/10
    
Fritz 122886    38%
13/34
50%
1/2
40%
12/30
41%
14/34
51%
17.5/34
Gull 1.0a 32-bit2885    47%
14/30
 35%
12/34
  
Quazar 0.4 32-bit2879   38%
1.5/4
49%
17.5/36
    
Gull 1.1 32-bit2877    51%
21.5/42
 38%
13/34
  
Hiarcs 13.12874   58%
14/24
47%
14/30
 41%
14/34
  
Scorpio 2.7.6 64-bit 4CPU287475%
1.5/2
60%
6/10
       
Komodo 1.0 32-bit2867       38%
23/60
48%
14.5/30
EXchess 7.18b 64-bit 4CPU286467%
4/6
50%
5/10
       
Thinker 5.4d Inert 64-bit2864   65%
19.5/30
 47%
15/32
   
Stockfish 1.5.1 32-bit2863   38%
1.5/4
    36%
13/36
Thinker 5.4c Inert 64-bit2859   73%
17.5/24
 37%
13/35
   
Deep Junior 12 32-bit2856    51%
19.5/38
 60%
6/10
  
Doch 1.3.4 32-bit2856       42%
2.5/6
35%
11.5/33
Thinker 5.4d Inert 32-bit2856    50%
38/76
 47%
21.5/46
39%
18/46
38%
13/34
Zappa Mexico II 64-bit2854   64%
25.5/40
 54%
18.5/34
   
Rodent 1.7 64-bit2850   65%
6.5/10
50%
5/10
    
Atlas 3.80 64-bit2847   54%
6.5/12
75%
7.5/10
    
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
Nemo 1.0.1 64-bit284767%
4/6
  59%
54.5/92
     
Booot 5.1.0284475%
1.5/2
  62%
2.5/4
58%
52/89
    
Arasan 17.4 64-bit2842   38%
1.5/4
65%
6.5/10
    
Deep Sjeng WC2008 64-bit2834   56%
13.5/24
 68%
23/34
   
Onno 1.2.70 64-bit2833   55%
22/40
 52%
12.5/24
   
Protector 1.3.5 32-bit2830    41%
15/37
 50%
28.5/57
  
Cyclone xTreme Fury2827       44%
15/34
33%
1/3
Grapefruit 1.0 32-bit2826    72%
21.5/30
54%
19/35
54%
20.5/38
44%
18.5/42
50%
19.5/39
Deep Sjeng WC2008 32-bit2825      38%
1.5/4
49%
16.5/34
41%
13.5/33
Booot 5.02824    58%
18.5/32
 43%
18/42
  
Protector 1.3.4 32-bit2824      55%
16.5/30
54%
14/26
 
Cyclone xTreme2823    55%
17.5/32
 52%
15.5/30
  
Deep Junior 11.1a 64-bit2823     58%
14/24
  40%
9.5/24
Octochess r5190 64-bit 4CPU282250%
1/2
75%
7.5/10
       
NirvanaChess 1.5 64-bit2821   75%
4.5/6
40%
4/10
    
Cyclone xTreme Rage2820    25%
1/4
 50%
2/4
75%
1.5/2
 
Tornado 6.0 64-bit2819   38%
1.5/4
35%
3.5/10
    
Hiarcs 12.12817     48%
27/56
 44%
16/36
50%
16.5/33
Toga II 3.1.2SE2815   62%
5/8
58%
3.5/6
    
Deuterium 14.1.32.119 64-bit2808   50%
3/6
55%
5.5/10
    
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
Zappa Mexico II 32-bit2808    58%
3.5/6
 62%
5/8
50%
17/34
48%
16/33
Crafty 24.1 64-bit2803   50%
1/2
65%
6.5/10
    
Hannibal 1.0a 32-bit2800    58%
29/50
 46%
21/46
  
Onno 1.1.1 32-bit2797       25%
1.5/6
38%
12.5/33
Protector 1.3.2 32-bit2795       52%
34/66
53%
16/30
Nemo 1.0.1 32-bit2794   12%
0.5/4
75%
13.5/18
    
Onno 1.2.70 32-bit2786    67%
8/12
 44%
3.5/8
  
Texel 1.01 64-bit278625%
0.5/2
  58%
10.5/18
     
Bright 0.5c2778   50%
0.5/1
69%
5.5/8
88%
3.5/4
65%
19.5/30
51%
24.5/48
52%
15.5/30
Jonny 4.002778   88%
3.5/4
61%
39.5/65
 56%
18.5/33
  
Bright 0.4a2775     56%
18/32
  62%
18.5/30
Naraku 1.42774   69%
5.5/8
69%
12.5/18
    
Critter 0.52b 32-bit2773       56%
29/52
53%
16/30
Loop 13.6 (Loop 2007) 32-bit2773      53%
16/30
50%
15/30
 
Twisted Logic 20100131x 64-bit2770   50%
0.5/1
 70%
3.5/5
   
SmarThink 1.20 64-bit2763   50%
1/2
 67%
16/24
   
Ktulu 92752    50%
0.5/1
69%
21.5/31
38%
1.5/4
  
SmarThink 1.20 32-bit2746    50%
0.5/1
 38%
1.5/4
58%
10.5/18
 
Spike 1.2 Turin2745     67%
24/36
62%
18.5/30
48%
14.5/30
70%
21/30
Chronos 1.9.9 32-bit2740    77%
8.5/11
 69%
11/16
  
NameEloSpark
1.0
64-bit
4CPU
Spark
0.4
64-bit
4CPU
Spark
0.3
64-bit
4CPU
Spark
1.0
64-bit
Spark
1.0
32-bit
Spark
0.3
64-bit
Spark
0.4
32-bit
Spark
0.3a
32-bit
Spark
0.3
32-bit
MinkoChess 1.1 32-bit2740    85%
11/13
 50%
2/4
  
Twisted Logic 20100131x 32-bit2736      63%
21.5/34
64%
25.5/40
52%
15.5/30
Crafty 23.4 64-bit2735100%
1/1
  62%
2.5/4
     
Crafty 23.4 32-bit2732    58%
3.5/6
 50%
2/4
  
Twisted Logic 20090922 32-bit2730       62%
2.5/4
60%
21/35
Bison 9.11 32-bit2728    25%
1/4
60%
3/5
69%
5.5/8
25%
1/4
62%
18.5/30
Critter 0.42 32-bit2705       50%
1.5/3
50%
0.5/1
Booot 4.15.12697      50%
4/8
75%
3/4
 
Crafty 23.2 32-bit2695      75%
3/4
80%
8/10
 
Frenzee Feb08 32-bit2695      62%
2.5/4
88%
3.5/4
63%
22/35
Booot 4.15.02693       69%
5.5/8
64%
22.5/35
Delfi 5.42689    50%
0.5/1
  75%
9/12
70%
24.5/35
Crafty 23.1 32-bit2687       70%
3.5/5
65%
20/31
MinkoChess 0.8 32-bit2674      71%
8.5/12
25%
0.5/2
 
Daydreamer 1.75 32-bit2667      88%
3.5/4
75%
1.5/2
 
Scorpio 2.5 32-bit2663      75%
3/4
75%
1.5/2
 
BugChess2 1.6.4 32-bit2657      100%
1/1
83%
5/6
 
Colossus 2008b2643      75%
3/4
100%
2/2
 
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on August 1, 2020