CCRL 40/15
Downloads and Statistics
March 8, 2024
Testing summary:
Total: 1'821'530 games
played by 3'719 programs

White wins: 582'500 (32.0%)
Black wins: 410'534 (22.5%)
Draws: 828'496 (45.5%)
White score: 54.7%

Custom engine selection

Comparing 12 engines!
12 selected engines played 220 games with each other

CCRL 40/15 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k.
Computed on March 8, 2024 with Bayeselo based on 1'821'530 games
Please refer to the "about" page for comments on engine inclusion

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent		DrawsGamesLOS
Elo+−
1Bright 0.4a 4CPU2914+13−1347.8%+16.440.9%1631 
72.2%
 Bright 0.5c 4CPU2907+20−2047.2%+20.242.9%616
97.4%
 Bright 0.3d 4CPU2881+17−1745.4%+32.844.1%885
100.0%
 Bright 0.3a 4CPU2840+16−1642.3%+56.941.8%987
97.8%
 Bright 0.2c 4CPU2815+19−1943.9%+44.243.2%724
99.5%
 Bright 0.5c2786+11−1146.7%+22.840.9%2225
69.0%
 Bright 0.4a2783+8−846.7%+24.338.6%3828
75.2%
 Bright 0.3d2777+17−1742.9%+55.835.7%939
99.7%
 Bright 0.3b2740+21−2146.0%+28.236.1%582
70.7%
 Bright 0.3a2733+16−1646.8%+23.836.8%991
99.8%
 Bright 0.2b2694+22−2250.2%−4.634.6%535
97.5%
 Bright 0.2c2663+22−2247.2%+20.432.9%523
 

Results matrix

Custom engine selection
#NameElo1
Brigh
2
Brigh
3
Brigh
4
Brigh
5
Brigh
6
Brigh
7
Brigh
8
Brigh
9
Brigh
10
Brigh
11
Brigh
12
Brigh
1Bright 0.4a 4CPU2914  49.5 − 34.5
+33−18=33
+32		         
2Bright 0.5c 4CPU2907            
3Bright 0.3d 4CPU288134.5 − 49.5
+18−33=33
−32		           
4Bright 0.3a 4CPU2840            
5Bright 0.2c 4CPU2815            
6Bright 0.5c2786            
7Bright 0.4a2783       65.5 − 60.5
+38−33=55
+10		    
8Bright 0.3d2777      60.5 − 65.5
+33−38=55
−10		   5.5 − 4.5
+3−2=5
−44		 
9Bright 0.3b2740            
10Bright 0.3a2733            
11Bright 0.2b2694       4.5 − 5.5
+2−3=5
+44		    
12Bright 0.2c2663            
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo1
Bri
2
Bri
3
Bri
4
Bri
5
Bri
6
Bri
7
Bri
8
Bri
9
Bri
10
Bri
11
Bri
12
Bri
1Bright 0.4a 4CPU2914 72.299.9100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Bright 0.5c 4CPU290727.8 97.4100.0100.0100.0100.0100.0100.0100.0100.0100.0
3Bright 0.3d 4CPU28810.12.6 100.0100.0100.0100.0100.0100.0100.0100.0100.0
4Bright 0.3a 4CPU28400.00.00.0 97.8100.0100.0100.0100.0100.0100.0100.0
5Bright 0.2c 4CPU28150.00.00.02.2 99.599.999.9100.0100.0100.0100.0
6Bright 0.5c27860.00.00.00.00.5 69.083.0100.0100.0100.0100.0
7Bright 0.4a27830.00.00.00.00.131.0 75.2100.0100.0100.0100.0
8Bright 0.3d27770.00.00.00.00.117.024.8 99.7100.0100.0100.0
9Bright 0.3b27400.00.00.00.00.00.00.00.3 70.799.9100.0
10Bright 0.3a27330.00.00.00.00.00.00.00.029.3 99.8100.0
11Bright 0.2b26940.00.00.00.00.00.00.00.00.10.2 97.5
12Bright 0.2c26630.00.00.00.00.00.00.00.00.00.02.5 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Score with 158 common opponents

Custom engine selection
NameEloBright
0.4a
4CPU		Bright
0.5c
4CPU		Bright
0.3d
4CPU		Bright
0.3a
4CPU		Bright
0.2c
4CPU		Bright
0.5c		Bright
0.4a		Bright
0.3d		Bright
0.3b		Bright
0.3a		Bright
0.2b		Bright
0.2c
Rybka 3 64-bit 4CPU315216%
7.5/46		 23%
11.5/50		11%
3.5/31		        
Rybka 3 64-bit3075      15%
16/104		14%
4.5/32		    
Rybka 2.3.2a 64-bit 4CPU3047  24%
16.5/68		15%
5/34		19%
6.5/35		       
Deep Shredder 12 64-bit 4CPU304534%
17.5/52		20%
1/5		          
Rybka 3 32-bit3027      13%
4/31		15%
8/52		    
Naum 3.1 64-bit 4CPU299438%
15/39		 32%
28.5/88		34%
11/32		        
Zappa Mexico II 64-bit 4CPU299334%
25.5/76		36%
2.5/7		36%
18/50		38%
16.5/44		28%
4.5/16		       
Rybka 2.3.2a 64-bit2985   32%
10.5/33		23%
8.5/37		25%
1/4		 24%
16.5/70		10%
0.5/5		  6%
0.5/8
Zappa Mexico 64-bit 4CPU2984   25%
0.5/2		29%
8.5/29		       
Naum 3 64-bit 4CPU2979   35%
17/49		28%
12.5/45		       
Gaviota 1.0 64-bit 4CPU296228%
4.5/16		50%
2/4		          
Arasan 17.5 64-bit 4CPU296030%
6/20		100%
1/1		          
Arasan 18.0 64-bit 4CPU294648%
9.5/20		75%
1.5/2		          
Deep Sjeng WC2008 64-bit 4CPU294547%
16/34		50%
3.5/7		          
Komodo 1.0 64-bit2942     8%
0.5/6		36%
11.5/32		     
Deep Shredder 11 64-bit 4CPU293547%
27/57		 47%
17/36		33%
12/36		37%
10/27		       
Rybka 2.3.2a 32-bit2933     27%
8/30		27%
8/30		21%
7/34		 24%
7/29		  
Deep Sjeng 3.0 64-bit 4CPU292346%
44.5/97		 49%
24.5/50		40%
17/42		        
Toga II 1.4.1SE 4CPU292245%
35.5/79		40%
2/5		45%
23.5/52		35%
17/48		        
Naum 2.2 64-bit 4CPU2921   0%
0/2		29%
10/34		       
NameEloBright
0.4a
4CPU		Bright
0.5c
4CPU		Bright
0.3d
4CPU		Bright
0.3a
4CPU		Bright
0.2c
4CPU		Bright
0.5c		Bright
0.4a		Bright
0.3d		Bright
0.3b		Bright
0.3a		Bright
0.2b		Bright
0.2c
Tornado 6.0 64-bit 4CPU291546%
6.5/14		50%
2/4		          
Hiarcs 12 4CPU291454%
21/39		 31%
16/52		42%
21/50		        
Glaurung 2.2 64-bit 4CPU291353%
17/32		25%
0.5/2		          
Hiarcs Paderborn 2007 4CPU290650%
30/60		  48%
14.5/30		        
Toga II 1.4 beta5c 4CPU2902   39%
22/56		32%
14.5/45		       
Deep Fritz 10.1 4CPU290145%
18/40		 65%
20/31		49%
24.5/50		42%
15/36		       
Rybka 2.1 32-bit2885   50%
0.5/1		    26%
7/27		   
Glaurung 2.1 64-bit 4CPU288457%
29/51		 49%
43.5/89		42%
22/52		        
Naum 3.1 32-bit2877      12%
0.5/4		36%
13/36		22%
7/32		30%
30.5/102		0%
0/4		 
Naum 3.1 64-bit2875      28%
14/50		 38%
1.5/4		   
Fritz 112868      35%
28.5/82		35%
19/55		31%
5/16		   
Zappa Mexico II 64-bit2867      35%
34.5/98		 12%
0.5/4		   
Loop M1-T 64-bit 4CPU286161%
79.5/130		 52%
25.5/49		55%
21/38		        
Booot 5.1.02859 58%
3.5/6		   0%
0/6		      
Thinker 5.3b Inert 32-bit2858      38%
11.5/30		  25%
1/4		  
Deep Shredder 11 64-bit2857   50%
0.5/1		28%
6.5/23		 43%
26/61		42%
17/40		29%
4/14		  31%
2.5/8
Loop 13.6 (Loop 2007) 64-bit 4CPU2850 71%
10/14		 25%
0.5/2		        
Spark 0.3 64-bit2849     12%
0.5/4		44%
14/32		     
Thinker 5.4a Inert 32-bit2849      48%
14.5/30		  30%
1.5/5		  
Shredder 112848      36%
11.5/32		12%
0.5/4		33%
8/24		38%
11.5/30		  
NameEloBright
0.4a
4CPU		Bright
0.5c
4CPU		Bright
0.3d
4CPU		Bright
0.3a
4CPU		Bright
0.2c
4CPU		Bright
0.5c		Bright
0.4a		Bright
0.3d		Bright
0.3b		Bright
0.3a		Bright
0.2b		Bright
0.2c
Zappa Mexico 64-bit2845    41%
22/54		     100%
1/1		38%
3/8
Cyclone xTreme Fury2840     40%
12/30		45%
15/33		     
Glaurung 2.0.1 64-bit 4CPU2839   45%
30/67		51%
22/43		       
Toga II 1.4.1SE2839      43%
40/92		 38%
14/37		37%
5.5/15		  
Grapefruit 1.0 32-bit2838     44%
15/34		45%
33/74		  20%
1/5		  
Cyclone xTreme2837     45%
13.5/30		35%
14.5/41		     
Cyclone 3.42836      35%
11/31		  17%
1/6		  
Toga II 1.4.1SE62834      50%
1/2		39%
14/36		  50%
2/4		 
Cyclone xTreme Rage2832     50%
0.5/1		48%
27/56		     
Onno 1.0 64-bit283157%
25/44		     39%
24/62		     
Toga II 3.1.2SE2827     25%
1.5/6		   35%
10.5/30		  
Critter 0.52b 64-bit2825     25%
1/4		44%
8/18		     
Hiarcs 12 Sharpen PV On2823      41%
13/32		38%
1.5/4		40%
9.5/24		40%
12/30		  
Hiarcs 122820      35%
23/66		 42%
15.5/37		39%
12.5/32		12%
0.5/4		 
Zappa Mexico II 32-bit2820     43%
3/7		35%
11.5/33		25%
1/4		40%
10.5/26		35%
10.5/30		  
Deep Junior 10 4CPU2814  54%
28/52		58%
22/38		58%
22/38		       
Toga II 1.4 beta5c2814         38%
1.5/4		 21%
7/33
Hiarcs Paderborn 20072809     25%
0.5/2		50%
1/2		38%
13/34		    
Spark 0.3 32-bit2808     48%
14.5/30		38%
11.5/30		     
Naum 2.2 64-bit2807   50%
0.5/1		60%
33.5/56		     50%
0.5/1		19%
1.5/8
NameEloBright
0.4a
4CPU		Bright
0.5c
4CPU		Bright
0.3d
4CPU		Bright
0.3a
4CPU		Bright
0.2c
4CPU		Bright
0.5c		Bright
0.4a		Bright
0.3d		Bright
0.3b		Bright
0.3a		Bright
0.2b		Bright
0.2c
Rybka 1.0 32-bit2803    100%
1/1		     25%
1/4		 
Toga II 1.3.12800          28%
10/36		34%
25/74
Cyclone 1.02796       50%
4/8		 25%
1/4		38%
1.5/4		 
Fruit 2.3.12794     42%
11/26		61%
5.5/9		 46%
11/24		46%
21/46		 0%
0/2
Grapefruit 1.0a32794      88%
3.5/4		  17%
1/6		  
Atlas 3.70em 64-bit2793     50%
1/2		50%
2/4		     
Loop M1-T 64-bit2792    50%
0.5/1		 47%
15/32		    38%
3/8
Texel 1.01 64-bit2790 100%
2/2		   62%
5/8		      
Deep Sjeng 2.7 4CPU2788  59%
19/32		48%
24.5/51		46%
17/37		       
Fruit 05/11/032782     33%
2/6		  25%
1/4		75%
3/4		38%
5/13		 
Rhetoric 1.4.1 64-bit2781     25%
0.5/2		75%
7.5/10		     
Loop 13.6 (Loop 2007)2780     50%
23/46		42%
12.5/30		50%
2/4		 35%
10.5/30		  
Stockfish 1.2 Default2780      58%
17.5/30		  58%
3.5/6		  
Bright 0.3d2777      52%
65.5/126		   45%
4.5/10		 
Loop 13.5 32-bit2777    100%
1/1		   50%
12/24		   
Thinker 5.2e Passive2777       38%
1.5/4		 12%
0.5/4		27%
6.5/24		 
Glaurung 2.1 64-bit2773      49%
26.5/54		38%
3/8		64%
7/11		   
Glaurung 2.1 32-bit2772      62%
2.5/4		65%
23.5/36		38%
11.5/30		50%
4/8		  
Loop 12.322770       40%
4/10		75%
1.5/2		   
Glaurung 2.2 32-bit2760     61%
11/18		59%
22.5/38		  50%
3.5/7		  
NameEloBright
0.4a
4CPU		Bright
0.5c
4CPU		Bright
0.3d
4CPU		Bright
0.3a
4CPU		Bright
0.2c
4CPU		Bright
0.5c		Bright
0.4a		Bright
0.3d		Bright
0.3b		Bright
0.3a		Bright
0.2b		Bright
0.2c
Hiarcs X54 Hypermodern 32-bit2759    100%
1/1		  60%
6/10		    
Ktulu 92758     52%
12/23		39%
12.5/32		     
Deep Sjeng 2.72756         42%
12.5/30		36%
11.5/32		 
Scorpio 2.7 32-bit2752     100%
2/2		65%
6.5/10		     
Glaurung 2.0.1 64-bit2751    0%
0/1		   25%
0.5/2		  25%
2/8
SmarThink 1.20 32-bit2750     61%
19.5/32		58%
33.5/58		     
Junior 102749     50%
2/4		    52%
16.5/32		 
Spike 1.2 Turin274986%
33.5/39		 74%
38.5/52		62%
23.5/38		55%
17/31		57%
27/47		61%
43/71		  49%
23.5/48		40%
12/30		25%
0.5/2
Stockfish 1.012748      46%
11/24		  75%
4.5/6		  
Chronos 1.9.9 64-bit2742     71%
18.5/26		38%
1.5/4		     
Glaurung 2.0.1 32-bit2742        54%
13/24		68%
21/31		 33%
10.5/32
Toga II 1.1a 32-bit2735    50%
0.5/1		 75%
3/4		     
Scorpio 2.0 32-bit 4CPU273478%
25/32		  83%
2.5/3		62%
23.5/38		     50%
0.5/1		40%
6/15
BugChess2 1.9 32-bit2733     100%
3/3		55%
5.5/10		     
Twisted Logic 20090922 32-bit2733     50%
1/2		59%
19/32		     
Thinker 5.1d Passive2731        40%
12/30		58%
7/12		  
Godel 3.4.9 64-bit2728     75%
3/4		70%
7/10		     
Twisted Logic 200806202725      65%
20/31		38%
1.5/4		 60%
6/10		75%
3/4		 
Ktulu 82709  75%
37.5/50		69%
22/32		74%
25/34		 25%
0.5/2		62%
2.5/4		 88%
3.5/4		 58%
3.5/6
SmarThink 1.00 64-bit2707   50%
0.5/1		0%
0/1		      75%
1.5/2
NameEloBright
0.4a
4CPU		Bright
0.5c
4CPU		Bright
0.3d
4CPU		Bright
0.3a
4CPU		Bright
0.2c
4CPU		Bright
0.5c		Bright
0.4a		Bright
0.3d		Bright
0.3b		Bright
0.3a		Bright
0.2b		Bright
0.2c
Chessmaster 11 Archangel2705      50%
1/2		75%
3/4		55%
15.5/28		40%
4/10		  
Scorpio 2.7 64-bit2704     77%
18.5/24		   60%
6/10		  
Chess Tiger 2007.12703   62%
18.5/30		 64%
4.5/7		50%
1.5/3		  50%
2/4		58%
18.5/32		25%
1/4
Chessmaster 11 Aiglos II2701     75%
4.5/6		38%
1.5/4		35%
3.5/10		    
Naum 2.0 32-bit2698    50%
0.5/1		 68%
20.5/30		45%
4.5/10		    
Fruit 2.12696       64%
9/14		  38%
1.5/4		 
Booot 4.15.02692      63%
24/38		  69%
5.5/8		  
Chessmaster 11 Conqueror2692     100%
4/4		65%
6.5/10		     
Frenzee Feb08 32-bit2692     25%
1/4		61%
24.5/40		75%
3/4		54%
13/24		71%
8.5/12		 46%
6.5/14
Tornado 4.87a 32-bit2690     75%
1.5/2		60%
6/10		     
Spike 1.12689   100%
1/1		       25%
0.5/2
Delfi 5.42688     50%
0.5/1		64%
24.5/38		100%
4/4		 39%
7/18		  
Chessmaster 11 Toxic2682     44%
3.5/8		75%
3/4		64%
9/14		 50%
1/2		  
Tornado 4.82 32-bit2681     100%
2/2		35%
3.5/10		     
Chessmaster 11 Leonidas2673     62%
2.5/4		100%
2/2		46%
6.5/14		73%
20.5/28		 50%
2/4		 
LoopList 6.002664    50%
0.5/1		     0%
0/1		 
CM10th Lazarus2663   100%
1/1		50%
0.5/1		       
Chessmaster 112663        50%
2/4		75%
1.5/2		 33%
2/6
Movei 00.8.438 (10 10 10)2663   100%
1/1		50%
0.5/1		 61%
19.5/32		  81%
6.5/8		 65%
6.5/10
Booot 4.14.02662       62%
2.5/4		66%
16.5/25		50%
7/14		 50%
4/8
NameEloBright
0.4a
4CPU		Bright
0.5c
4CPU		Bright
0.3d
4CPU		Bright
0.3a
4CPU		Bright
0.2c
4CPU		Bright
0.5c		Bright
0.4a		Bright
0.3d		Bright
0.3b		Bright
0.3a		Bright
0.2b		Bright
0.2c
Dirty 25Aug2011 32-bit2661     0%
0/2		   59%
9.5/16		  
Frenzee Dec07 32-bit2655       62%
2.5/4		75%
3/4		  50%
1/2
Alaric 7072654   50%
0.5/1		 75%
1.5/2		61%
8.5/14		  33%
2/6		62%
20/32		100%
2/2
Bobcat 2.75 32-bit2654     70%
7/10		     5%
0.5/10
Scorpio 2.02b2654       65%
13/20		 67%
4/6		  
Scorpio 2.0 32-bit2652        75%
3/4		58%
3.5/6		 57%
20.5/36
Scorpio 1.812647       88%
3.5/4		  62%
2.5/4		 
E.T. Chess 13.01.082644     67%
4/6		71%
8.5/12		  52%
11/21		 83%
5/6
Movei 00.8.4382642         75%
3/4		50%
19/38		 
CM9000 Assassin2639       71%
10/14		 75%
1.5/2		  
Cyrano 0.6b17 32-bit2639      63%
16.5/26		  50%
2/4		  
CM10th Guardian2638      100%
2/2		   50%
1/2		 
Colossus 2008b2638      65%
6.5/10		  75%
1.5/2		  
ProDeo 1.742632     0%
0/2		100%
2/2		     
Slow Chess Blitz WV2.12631         100%
2/2		 50%
1/2
Delfi 5.22630         25%
0.5/2		75%
1.5/2		50%
1/2
RedQueen 1.0.0 32-bit2630     62%
2.5/4		     25%
2.5/10
Gandalf 62628        62%
2.5/4		  25%
0.5/2
Scorpio 2.05b2625      0%
0/2		71%
10/14		    
ProDeo 1.72624         50%
5/10		 75%
7.5/10
NameEloBright
0.4a
4CPU		Bright
0.5c
4CPU		Bright
0.3d
4CPU		Bright
0.3a
4CPU		Bright
0.2c
4CPU		Bright
0.5c		Bright
0.4a		Bright
0.3d		Bright
0.3b		Bright
0.3a		Bright
0.2b		Bright
0.2c
WildCat 72620    100%
1/1		      50%
2/4
WildCat 82620        100%
4/4		75%
3/4		 75%
3/4
Arasan 13.4 32-bit2613     100%
2/2		     40%
4/10
Ruffian 2.1.02613     100%
1/1		75%
1.5/2		  75%
3/4		  
BugChess2 1.6.3 32-bit2612      68%
15/22		  62%
2.5/4		  
ProDeo 1.62610    100%
1/1		   88%
3.5/4		75%
1.5/2		 92%
5.5/6
Hamsters 0.7.12606      50%
2/4		  50%
1/2		  
Pharaon 3.5.12604         100%
2/2		88%
3.5/4		25%
0.5/2
Colossus 2007d2603         75%
1.5/2		56%
5/9		50%
1/2
Alfil 8.1.12591      50%
1/2		 0%
0/4		25%
0.5/2		  
Sloppy 0.2.2 32-bit2587         75%
1.5/2		 66%
10.5/16
CuckooChess 1.12 32-bit2578     100%
2/2		   90%
9/10		  
The Baron 1.8.12578        88%
3.5/4		  50%
1/2
Petir 4.9999992567        38%
1.5/4		 75%
3/4		25%
0.5/2
Scorpio 2.2 32-bit2556      75%
3/4		75%
7.5/10		    
BugChess2 1.5.22552    50%
0.5/1		      75%
3/4
Francesca MAD 0.192544     100%
2/2		     50%
5/10
Hamsters 0.52533    100%
1/1		     100%
7/7		 
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
 Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines

Created in 2005-2013 by CCRL team
Last games added on March 8, 2024