Solver Statistics - Kenya Maruyama

From Sokoban Wiki

(Difference between revisions)
Jump to: navigation, search
(add JSoko stat)
m (→Summary of the Kenyam Set A level set)
 
(4 intermediate revisions not shown)
Line 1: Line 1:
-
This is a summary of running the Kenyam Set A (44 levels + 8 alternative version) using these solvers: <br>
+
= Summary of the Kenyam Set A level set =
-
:* BoxSearch v5.1 beta2 <br>
+
Each solver is tested separately to ensure that they don't compete for system resources. <br><br>
-
:* JSoko 1.35 <br>
+
Though some people might be interested in how long it takes to solve a given level and/or how good the solution is (optimal or not), <br>
-
:* Takaken v7.1<br>
+
this summary disregards all timing associated with solving the levels and solution statistics. <br><br>
-
:* YASS v2.97<br>
+
These tests are mainly for gauging solvability, not timing nor how good the solution is. <br><br>
-
<br>
+
-
Each solver is tested separately to ensure that they don't compete for system resources.
+
-
<br><br>
+
-
For copyrights, credits and redistribution of these statistics, please read the [[Solvers#Disclaimer | disclaimer]].<br>
+
-
<br>
+
-
Though some people might be interested in how long it takes to solve a given level and/or how good the solution is (optimal or not), this summary disregards all timing associated with solving the levels and solution statistics.
+
-
These tests are mainly for gauging solvability, not timing nor how good the solution is.
+
-
<div class="note-2 margin">
+
All solvers combined solved 52 of 52 levels.
-
 
+
-
;Not all Sokoban solvers are created equal:
+
-
:*BoxSearch allows setting for max time limit and max memory.  (level size limit: none)
+
-
:*JSoko:  (level size limit: width=40, height=40)
+
-
:*Takaken allows setting for time and max memory option.  (level size limit: width=32, height=20, Boxes=50)
+
-
:*YASS allows setting for max time and max memory option.  (level size limit:  width=50, height=50)
+
-
 
+
-
 
+
-
;Test machine info:
+
-
:*Machine: ThinkPad T42P
+
-
:*CPU:  x86 Family 6 Model 13 Stepping 6 Genuine Intel
+
-
:*Physical RAM: 2 GB
+
-
:*OS Name & Version:  Microsoft Windows XP Professional v5.12600 Service Pack 2 Build 2600.
+
-
:*<b>NOTE 1:</b> The JSoko results are tested on a Samsung Aura Dillen Core 2 Duo T9300 (2,5 GHz) with 3 GiB RAM, OS: Vista Home (Service Pack 1), JRE: 1.6.02_12
+
-
:*<b>NOTE 2:</b> The YASS v2.97 results are tested on a ThinkPad T61P with the following spec:
+
-
::*CPU:  x86 Family 6 Model 15 Stepping 11 Genuine Intel ~2394 Mhz
+
-
::*Physical RAM: 2 GB
+
-
::*OS Name & Version:  Microsoft Windows XP Professional v5.12600 Service Pack 2 Build 2600.
+
-
 
+
-
 
+
-
;Initial tests:
+
-
:*BoxSearch is set with max memory limit of 1500 MB and 600 seconds.  (using quick mode)
+
-
:*JSoko is set with 1500 MB memory and 600 second limit. (any solution method)
+
-
:*Takaken is set with 1000 MB memory and 600 second limit.
+
-
:*YASS is set with 1500 MB memory and 600 second limit.
+
-
 
+
-
 
+
-
;Further tests:
+
-
:*(none so far)
+
-
 
+
-
</div>
+
-
 
+
-
 
+
-
 
+
-
The following table shows the levels where each of the solvers failed:
+
-
======================================================================
+
-
+
-
          BoxSearch        JSoko          Takaken          YASS   
+
-
============== ============== ============== ==============
+
-
        7            7     
+
-
        8            8            8            8     
+
-
      10     
+
-
      15     
+
-
      20          20          20          20     
+
-
      22     
+
-
      25     
+
-
      51     
+
-
============== ============== ============== ==============
+
-
Total:       4       7       2       2
+
-
+
-
Total (unique level count): 8
+
-
+
-
+
-
+
-
All solvers failed on these levels:
+
-
===================================================================================
+
-
      8      20
+
-
===================================================================================
+
-
Total count: 2
+
-
+
-
+
-
"BoxSearch" failed on these levels where at least one solver solved:
+
-
===================================================================================
+
-
      7      22
+
-
===================================================================================
+
-
Total count: 2
+
-
+
-
+
-
"JSoko" failed on these levels where at least one solver solved:
+
-
===================================================================================
+
-
      7      10      15      25      51
+
-
===================================================================================
+
-
Total count: 5
+
-
+
-
+
-
"Takaken" failed on these levels where at least one solver solved:
+
-
===================================================================================
+
-
+
-
===================================================================================
+
-
Total count: 0
+
-
+
-
+
-
"YASS" failed on these levels where at least one solver solved:
+
-
===================================================================================
+
-
+
-
===================================================================================
+
-
Total count: 0
+
-
+
-
+
-
"BoxSearch" solved these levels where all other solvers failed:
+
-
===================================================================================
+
-
+
-
===================================================================================
+
-
Total count: 0
+
-
+
-
+
-
"JSoko" solved these levels where all other solvers failed:
+
-
===================================================================================
+
-
+
-
===================================================================================
+
-
Total count: 0
+
-
+
-
+
-
"Takaken" solved these levels where all other solvers failed:
+
-
===================================================================================
+
-
+
-
===================================================================================
+
-
Total count: 0
+
-
+
-
+
-
"YASS" solved these levels where all other solvers failed:
+
-
===================================================================================
+
-
+
-
===================================================================================
+
-
Total count: 0
+
-
+
-
+
-
"BoxSearch" failed on these levels where all other solvers solved:
+
-
===================================================================================
+
-
      22
+
-
===================================================================================
+
-
Total count: 1
+
-
+
-
+
-
"JSoko" failed on these levels where all other solvers solved:
+
-
===================================================================================
+
-
      10      15      25      51
+
-
===================================================================================
+
-
Total count: 4
+
-
+
-
+
-
"Takaken" failed on these levels where all other solvers solved:
+
-
===================================================================================
+
-
+
-
===================================================================================
+
-
Total count: 0
+
-
+
-
+
-
"YASS" failed on these levels where all other solvers solved:
+
-
===================================================================================
+
-
+
-
===================================================================================
+
-
Total count: 0
+
-
+
-
+
-
<!-- STAT --><div class="box margin-2"><div style="width:500px;">
+
-
BoxSearch solved 48 of 52 levels.
+
<div class="box-progress">
<div class="box-progress">
-
<div class="small" style="width: 92.3%;">BoxSearch 92.3%</div>
+
  <div class="small" style="width: 100%;">All solvers 100%</div>
</div>
</div>
-
JSoko solved 45 of 52 levels.
 
-
<div class="box-progress">
 
-
<div class="small" style="width: 86.5%;">JSoko 86.5%</div>
 
-
</div>
 
-
Takaken solved 50 of 52 levels.
+
{| class="soko-table"
-
<div class="box-progress">
+
|-
-
<div class="small" style="width: 96.2%;">Takaken 96.2%</div>
+
-
</div>
+
-
 
+
-
YASS solved 50 of 52 levels.
+
-
<div class="box-progress">
+
-
<div class="small" style="width: 96.2%;">YASS 96.2%</div>
+
-
</div>
+
-
 
+
-
All solvers combined solved 50 of 52 levels.
+
-
<div class="box-progress">
+
-
<div class="small" style="width: 96.2%;background:rgb(125,190,255);">All solvers 96.2%</div>
+
-
</div>
+
-
</div></div><!--/STAT -->
+
<!-- -------------------------------------------------------------------------------------------- -->
 +
! colspan="9" | Solver Statistics  &nbsp;&nbsp;&nbsp;&nbsp;    Set: Kenyam Set A
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
|- bgcolor="#f1efe5" align="center"
 +
| width=" 65"              | Level No.
 +
| width=" 65"              | BoxSearch
 +
| width=" 65"              | Takaken
 +
| width=" 65"              | YASS
 +
| width=" 80"              | JSoko
 +
| width=" 80"              | Sokolution
 +
| width=" 80"              | Solved by only one
 +
| width=" 80"              | Solved by all
 +
| width=" 80"              | Solved by none
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
|- align="center"
 +
| align="right" | 1 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 2 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 3 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 4 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 5 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 6 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 7 &nbsp;&nbsp; || {{n}} || {{y}} || {{y}} ||  {{n}} || {{y}} ||  ||  ||
 +
|- align="center"
 +
| align="right" | 8 &nbsp;&nbsp; || {{n}} || {{n}} || {{y}} ||  {{n}} || {{y}} ||  ||  ||
 +
|- align="center"
 +
| align="right" | 9 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 10 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{n}} || {{y}} ||  ||  ||
 +
|- align="center"
 +
| align="right" | 11 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 12 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 13 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 14 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 15 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{n}} || {{y}} ||  ||  ||
 +
|- align="center"
 +
| align="right" | 16 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 17 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 18 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 19 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 20 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{y}} || yes ||  ||
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
|- bgcolor="#f1efe5" align="center"
 +
| width=" 65"              | Level No.
 +
| width=" 65"              | BoxSearch
 +
| width=" 65"              | Takaken
 +
| width=" 65"              | YASS
 +
| width=" 80"              | JSoko
 +
| width=" 80"              | Sokolution
 +
| width=" 80"              | Solved by only one
 +
| width=" 80"              | Solved by all
 +
| width=" 80"              | Solved by none
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
|- align="center"
 +
| align="right" | 21 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 22 &nbsp;&nbsp; || {{n}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  ||  ||
 +
|- align="center"
 +
| align="right" | 23 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 24 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 25 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{n}} || {{y}} ||  ||  ||
 +
|- align="center"
 +
| align="right" | 26 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 27 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 28 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 29 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 30 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 31 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 32 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 33 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 34 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 35 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 36 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 37 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 38 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 39 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 40 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
|- bgcolor="#f1efe5" align="center"
 +
| width=" 65"              | Level No.
 +
| width=" 65"              | BoxSearch
 +
| width=" 65"              | Takaken
 +
| width=" 65"              | YASS
 +
| width=" 80"              | JSoko
 +
| width=" 80"              | Sokolution
 +
| width=" 80"              | Solved by only one
 +
| width=" 80"              | Solved by all
 +
| width=" 80"              | Solved by none
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
|- align="center"
 +
| align="right" | 41 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 42 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 43 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 44 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 45 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 46 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 47 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 48 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 49 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 50 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- align="center"
 +
| align="right" | 51 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{n}} || {{y}} ||  ||  ||
 +
|- align="center"
 +
| align="right" | 52 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} ||  || yes ||
 +
|- bgcolor="#f1efe5" align="center"
 +
| align="right" | Total &nbsp;&nbsp; || 48 || 50 || 51 || 45 || 52 || 1 || 44 || 0
 +
|}

Current revision as of 03:40, 13 April 2019

Summary of the Kenyam Set A level set

Each solver is tested separately to ensure that they don't compete for system resources.

Though some people might be interested in how long it takes to solve a given level and/or how good the solution is (optimal or not),
this summary disregards all timing associated with solving the levels and solution statistics.

These tests are mainly for gauging solvability, not timing nor how good the solution is.

All solvers combined solved 52 of 52 levels.

All solvers 100%


Solver Statistics      Set: Kenyam Set A
Level No. BoxSearch Takaken YASS JSoko Sokolution Solved by only one Solved by all Solved by none
1    yes yes yes yes yes yes
2    yes yes yes yes yes yes
3    yes yes yes yes yes yes
4    yes yes yes yes yes yes
5    yes yes yes yes yes yes
6    yes yes yes yes yes yes
7    no yes yes no yes
8    no no yes no yes
9    yes yes yes yes yes yes
10    yes yes yes no yes
11    yes yes yes yes yes yes
12    yes yes yes yes yes yes
13    yes yes yes yes yes yes
14    yes yes yes yes yes yes
15    yes yes yes no yes
16    yes yes yes yes yes yes
17    yes yes yes yes yes yes
18    yes yes yes yes yes yes
19    yes yes yes yes yes yes
20    no no no no yes yes
Level No. BoxSearch Takaken YASS JSoko Sokolution Solved by only one Solved by all Solved by none
21    yes yes yes yes yes yes
22    no yes yes yes yes
23    yes yes yes yes yes yes
24    yes yes yes yes yes yes
25    yes yes yes no yes
26    yes yes yes yes yes yes
27    yes yes yes yes yes yes
28    yes yes yes yes yes yes
29    yes yes yes yes yes yes
30    yes yes yes yes yes yes
31    yes yes yes yes yes yes
32    yes yes yes yes yes yes
33    yes yes yes yes yes yes
34    yes yes yes yes yes yes
35    yes yes yes yes yes yes
36    yes yes yes yes yes yes
37    yes yes yes yes yes yes
38    yes yes yes yes yes yes
39    yes yes yes yes yes yes
40    yes yes yes yes yes yes
Level No. BoxSearch Takaken YASS JSoko Sokolution Solved by only one Solved by all Solved by none
41    yes yes yes yes yes yes
42    yes yes yes yes yes yes
43    yes yes yes yes yes yes
44    yes yes yes yes yes yes
45    yes yes yes yes yes yes
46    yes yes yes yes yes yes
47    yes yes yes yes yes yes
48    yes yes yes yes yes yes
49    yes yes yes yes yes yes
50    yes yes yes yes yes yes
51    yes yes yes no yes
52    yes yes yes yes yes yes
Total    48 50 51 45 52 1 44 0
Retrieved from "http://www.sokobano.de/wiki/index.php?title=Solver_Statistics_-_Kenya_Maruyama"
Personal tools