Solver Statistics - Sasquatch III - David W. Skinner

From Sokoban Wiki

(Difference between revisions)
Jump to: navigation, search
(total statistic for Sasquatch III)
Line 1: Line 1:
-
This is a summary of running the Sasquatch III collection (50 levels total) using these solvers:<br>
+
= Summary of the Sasquatch III level set =
-
&#8226; BoxSearch v5.1 beta2 <br>
+
Each solver is tested separately to ensure that they don't compete for system resources. <br><br>
-
&#8226; JSoko 1.35 <br>
+
Though some people might be interested in how long it takes to solve a given level and/or how good the solution is (optimal or not), <br>
-
&#8226; Takaken v7.2<br>
+
this summary disregards all timing associated with solving the levels and solution statistics. <br><br>
-
&#8226; YASS v2.65<br>
+
These tests are mainly for gauging solvability, not timing nor how good the solution is. <br><br>
-
<br>
+
-
Each solver is tested separately to ensure that they don't compete for system resources.
+
-
<br><br>
+
-
For copyrights, credits and redistribution of these statistics, please read the [[Solvers#Disclaimer | disclaimer]].<br>
+
-
<br>
+
-
Though some people might be interested in how long it takes to solve a given level and/or how good the solution is (optimal or not), this summary disregards all timing associated with solving the levels and solution statistics.
+
-
These tests are mainly for gauging solvability, not timing nor how good the solution is.
+
-
<div class="note-2">
+
All solvers combined solved 23 of 50 levels.
-
<u>Not all Sokoban solvers are created equal:</u><br>
+
-
*BoxSearch: (level size limit: none)
+
-
*JSoko: (level size limit: width=40, height=40)
+
-
*Takaken: (level size limit: width=32, height=20, Boxes=50)
+
-
*YASS: (level size limit:  width=50, height=50)
+
-
 
+
-
 
+
-
<u>Test machine info:</u><br>
+
-
*Machine: ThinkPad T42P
+
-
*CPU:  x86 Family 6 Model 13 Stepping 6 Genuine Intel
+
-
*Physical RAM: 2 GB
+
-
*OS Name & Version:  Microsoft Windows XP Professional v5.12600 Service Pack 2 Build 2600.
+
-
*<b>NOTE:</b> The JSoko results are tested on a Samsung Aura Dillen Core 2 Duo T9300 (2,5 GHz) with 3 GiB RAM, OS: Vista Home (Service Pack 1), JRE: 1.6.02_12
+
-
 
+
-
 
+
-
<u>Initial tests:</u><br>
+
-
*BoxSearch is set with max memory limit of 1500 MB and 600 seconds.  (using quick mode)
+
-
*JSoko is set with 1500 MB memory and 600 second limit. (any solution method)
+
-
*Takaken is set with 1000 MB memory and 600 second limit.
+
-
*YASS is set with 1500 MB memory and 600 second limit.
+
-
 
+
-
 
+
-
<u>Further tests:</u><br>
+
-
*[[SolverStatistics-yass-Sasquatch-III | YASS: 13 ]]
+
-
</div>
+
-
 
+
-
 
+
-
 
+
-
The following table shows the levels where each of the solvers failed:
+
-
======================================================================
+
-
+
-
          BoxSearch        JSoko          Takaken          YASS   
+
-
============== ============== ============== ==============
+
-
        2            2     
+
-
        4            4            4     
+
-
        6            6            6     
+
-
        9            9     
+
-
      10     
+
-
      11          11          11     
+
-
      12     
+
-
      13          13          13          13     
+
-
      14          14     
+
-
      17          17          17          17     
+
-
      18          18          18          18     
+
-
      19          19          19          19     
+
-
      20     
+
-
      21          21     
+
-
      22          22          22          22     
+
-
      23          23          23          23     
+
-
      24          24          24          24     
+
-
      25          25          25     
+
-
      26          26          26          26     
+
-
      27          27          27          27     
+
-
      28          28          28     
+
-
      29          29          29          29     
+
-
      30          30          30          30     
+
-
      31          31          31          31     
+
-
      32          32          32          32     
+
-
      33          33          33          33     
+
-
      34          34          34          34     
+
-
      35          35          35          35     
+
-
      36          36          36          36     
+
-
      37          37          37     
+
-
      38          38     
+
-
      39          39     
+
-
      40          40          40          40     
+
-
      41          41          41          41     
+
-
      42          42          42          42     
+
-
      43          43          43          43     
+
-
      44          44          44          44     
+
-
      45          45          45          45     
+
-
      46          46          46          46     
+
-
      47          47          47          47     
+
-
      48          48          48          48     
+
-
      49          49          49          49     
+
-
      50          50          50          50     
+
-
============== ============== ============== ==============
+
-
Total:     36     38     30     41
+
-
+
-
Total (unique level count): 43
+
-
+
-
+
-
+
-
All solvers failed on these levels:
+
-
===================================================================================
+
-
      13      17      18      19      22      23     24      26      27      29
+
-
      30      31      32      33      34      35      36      40      41      42
+
-
      43      44      45      46      47      48      49      50
+
-
===================================================================================
+
-
Total count: 28
+
-
+
-
+
-
"BoxSearch" failed on these levels where at least one solver solved:
+
-
===================================================================================
+
-
      4      6      9      11      21      25      37      39
+
-
===================================================================================
+
-
Total count: 8
+
-
+
-
+
-
"JSoko" failed on these levels where at least one solver solved:
+
-
===================================================================================
+
-
      4      6      10      11      12      14      25      28      37      38
+
-
===================================================================================
+
-
Total count: 10
+
-
+
-
+
-
"Takaken" failed on these levels where at least one solver solved:
+
-
===================================================================================
+
-
      2      28
+
-
===================================================================================
+
-
Total count: 2
+
-
+
-
+
-
"YASS" failed on these levels where at least one solver solved:
+
-
===================================================================================
+
-
      2      4      6      9      11      14      20      21      25      28
+
-
      37      38      39
+
-
===================================================================================
+
-
Total count: 13
+
-
+
-
+
-
"BoxSearch" solved these levels where all other solvers failed:
+
-
===================================================================================
+
-
      28
+
-
===================================================================================
+
-
Total count: 1
+
-
+
-
+
-
"JSoko" solved these levels where all other solvers failed:
+
-
===================================================================================
+
-
+
-
===================================================================================
+
-
Total count: 0
+
-
+
-
+
-
"Takaken" solved these levels where all other solvers failed:
+
-
===================================================================================
+
-
      4      6      11      25      37
+
-
===================================================================================
+
-
Total count: 5
+
-
+
-
+
-
"YASS" solved these levels where all other solvers failed:
+
-
===================================================================================
+
-
+
-
===================================================================================
+
-
Total count: 0
+
-
+
-
+
-
"BoxSearch" failed on these levels where all other solvers solved:
+
-
===================================================================================
+
-
+
-
===================================================================================
+
-
Total count: 0
+
-
+
-
+
-
"JSoko" failed on these levels where all other solvers solved:
+
-
===================================================================================
+
-
      10      12
+
-
===================================================================================
+
-
Total count: 2
+
-
+
-
+
-
"Takaken" failed on these levels where all other solvers solved:
+
-
===================================================================================
+
-
+
-
===================================================================================
+
-
Total count: 0
+
-
+
-
+
-
"YASS" failed on these levels where all other solvers solved:
+
-
===================================================================================
+
-
      20
+
-
===================================================================================
+
-
Total count: 1
+
-
+
-
+
-
<!-- STAT --><div class="box margin-2"><div style="width:500px;">
+
-
BoxSearch solved 14 of 50 levels.
+
<div class="box-progress">
<div class="box-progress">
-
<div class="small" style="width: 28%;">BoxSearch 28%</div>
+
  <div class="small" style="width: 46%;">All solvers 46%</div>
</div>
</div>
-
JSoko solved 12 of 50 levels.
 
-
<div class="box-progress">
 
-
<div class="small" style="width: 24%;">JSoko 24%</div>
 
-
</div>
 
-
Takaken solved 20 of 50 levels.
+
{| class="soko-table"
-
<div class="box-progress">
+
|-
-
<div class="small" style="width: 40%;">Takaken 40%</div>
+
-
</div>
+
-
 
+
-
YASS solved 9 of 50 levels.
+
-
<div class="box-progress">
+
-
<div class="small" style="width: 18%;">YASS 18%</div>
+
-
</div>
+
-
 
+
-
All solvers combined solved 22 of 50 levels.
+
-
<div class="box-progress">
+
-
<div class="small" style="width: 44%;background:rgb(125,190,255);">All solvers 44%</div>
+
-
</div>
+
-
</div></div><!--/STAT -->
+
<!-- -------------------------------------------------------------------------------------------- -->
 +
! colspan="9" | Solver Statistics  &nbsp;&nbsp;&nbsp;&nbsp;    Set: Sasquatch III
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
|- bgcolor="#f1efe5" align="center"
 +
| width=" 65"              | LevelNo
 +
| width=" 65"              | BoxSearch
 +
| width=" 65"              | Takaken
 +
| width=" 65"              | YASS
 +
| width=" 80"              | JSoko
 +
| width=" 80"              | Sokolution
 +
| width=" 80"              | Solved by only one
 +
| width=" 80"              | Solved by all
 +
| width=" 80"              | Solved by none
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
|- align="center"
 +
| align="right" | 1 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 2 &nbsp;&nbsp; || {{y}} || {{n}} || {{y}} ||  {{y}} || {{y}} || no || no || no
 +
|- align="center"
 +
| align="right" | 3 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 4 &nbsp;&nbsp; || {{n}} || {{y}} || {{n}} ||  {{n}} || {{y}} || no || no || no
 +
|- align="center"
 +
| align="right" | 5 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 6 &nbsp;&nbsp; || {{n}} || {{y}} || {{n}} ||  {{n}} || {{y}} || no || no || no
 +
|- align="center"
 +
| align="right" | 7 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 8 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 9 &nbsp;&nbsp; || {{n}} || {{y}} || {{n}} ||  {{y}} || {{y}} || no || no || no
 +
|- align="center"
 +
| align="right" | 10 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{n}} || {{y}} || no || no || no
 +
|- align="center"
 +
| align="right" | 11 &nbsp;&nbsp; || {{n}} || {{y}} || {{n}} ||  {{n}} || {{n}} || yes || no || no
 +
|- align="center"
 +
| align="right" | 12 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{n}} || {{y}} || no || no || no
 +
|- align="center"
 +
| align="right" | 13 &nbsp;&nbsp; || {{n}} || {{n}} || {{y}} ||  {{n}} || {{n}} || yes || no || no
 +
|- align="center"
 +
| align="right" | 14 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{n}} || {{y}} || no || no || no
 +
|- align="center"
 +
| align="right" | 15 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 16 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 17 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{y}} || yes || no || no
 +
|- align="center"
 +
| align="right" | 18 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 19 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 20 &nbsp;&nbsp; || {{y}} || {{y}} || {{n}} ||  {{y}} || {{y}} || no || no || no
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
|- bgcolor="#f1efe5" align="center"
 +
| width=" 65"              | LevelNo
 +
| width=" 65"              | BoxSearch
 +
| width=" 65"              | Takaken
 +
| width=" 65"              | YASS
 +
| width=" 80"              | JSoko
 +
| width=" 80"              | Sokolution
 +
| width=" 80"              | Solved by only one
 +
| width=" 80"              | Solved by all
 +
| width=" 80"              | Solved by none
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
|- align="center"
 +
| align="right" | 21 &nbsp;&nbsp; || {{n}} || {{y}} || {{n}} ||  {{y}} || {{y}} || no || no || no
 +
|- align="center"
 +
| align="right" | 22 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 23 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{y}} || yes || no || no
 +
|- align="center"
 +
| align="right" | 24 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{y}} || yes || no || no
 +
|- align="center"
 +
| align="right" | 25 &nbsp;&nbsp; || {{n}} || {{y}} || {{n}} ||  {{n}} || {{n}} || yes || no || no
 +
|- align="center"
 +
| align="right" | 26 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 27 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 28 &nbsp;&nbsp; || {{y}} || {{n}} || {{n}} ||  {{n}} || {{y}} || no || no || no
 +
|- align="center"
 +
| align="right" | 29 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 30 &nbsp;&nbsp; || {{n}} || {{y}} || {{n}} ||  {{n}} || {{n}} || yes || no || no
 +
|- align="center"
 +
| align="right" | 31 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 32 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 33 &nbsp;&nbsp; || {{n}} || {{y}} || {{y}} ||  {{n}} || {{n}} || no || no || no
 +
|- align="center"
 +
| align="right" | 34 &nbsp;&nbsp; || {{n}} || {{y}} || {{n}} ||  {{n}} || {{n}} || yes || no || no
 +
|- align="center"
 +
| align="right" | 35 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 36 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 37 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{y}} || yes || no || no
 +
|- align="center"
 +
| align="right" | 38 &nbsp;&nbsp; || {{y}} || {{y}} || {{n}} ||  {{n}} || {{y}} || no || no || no
 +
|- align="center"
 +
| align="right" | 39 &nbsp;&nbsp; || {{n}} || {{y}} || {{n}} ||  {{y}} || {{n}} || no || no || no
 +
|- align="center"
 +
| align="right" | 40 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
|- bgcolor="#f1efe5" align="center"
 +
| width=" 65"              | LevelNo
 +
| width=" 65"              | BoxSearch
 +
| width=" 65"              | Takaken
 +
| width=" 65"              | YASS
 +
| width=" 80"              | JSoko
 +
| width=" 80"              | Sokolution
 +
| width=" 80"              | Solved by only one
 +
| width=" 80"              | Solved by all
 +
| width=" 80"              | Solved by none
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
|- align="center"
 +
| align="right" | 41 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 42 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 43 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 44 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 45 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 46 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 47 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 48 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{y}} || yes || no || no
 +
|- align="center"
 +
| align="right" | 49 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 50 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- bgcolor="#f1efe5" align="center"
 +
| align="right" | Total &nbsp;&nbsp; || 14 || 22 || 13 || 12 || 23 || 10 || 7 || 20
 +
|}

Revision as of 20:56, 7 March 2019

Summary of the Sasquatch III level set

Each solver is tested separately to ensure that they don't compete for system resources.

Though some people might be interested in how long it takes to solve a given level and/or how good the solution is (optimal or not),
this summary disregards all timing associated with solving the levels and solution statistics.

These tests are mainly for gauging solvability, not timing nor how good the solution is.

All solvers combined solved 23 of 50 levels.

All solvers 46%


Solver Statistics      Set: Sasquatch III
LevelNo BoxSearch Takaken YASS JSoko Sokolution Solved by only one Solved by all Solved by none
1    yes yes yes yes yes no yes no
2    yes no yes yes yes no no no
3    yes yes yes yes yes no yes no
4    no yes no no yes no no no
5    yes yes yes yes yes no yes no
6    no yes no no yes no no no
7    yes yes yes yes yes no yes no
8    yes yes yes yes yes no yes no
9    no yes no yes yes no no no
10    yes yes yes no yes no no no
11    no yes no no no yes no no
12    yes yes yes no yes no no no
13    no no yes no no yes no no
14    yes yes yes no yes no no no
15    yes yes yes yes yes no yes no
16    yes yes yes yes yes no yes no
17    no no no no yes yes no no
18    no no no no no no no yes
19    no no no no no no no yes
20    yes yes no yes yes no no no
LevelNo BoxSearch Takaken YASS JSoko Sokolution Solved by only one Solved by all Solved by none
21    no yes no yes yes no no no
22    no no no no no no no yes
23    no no no no yes yes no no
24    no no no no yes yes no no
25    no yes no no no yes no no
26    no no no no no no no yes
27    no no no no no no no yes
28    yes no no no yes no no no
29    no no no no no no no yes
30    no yes no no no yes no no
31    no no no no no no no yes
32    no no no no no no no yes
33    no yes yes no no no no no
34    no yes no no no yes no no
35    no no no no no no no yes
36    no no no no no no no yes
37    no no no no yes yes no no
38    yes yes no no yes no no no
39    no yes no yes no no no no
40    no no no no no no no yes
LevelNo BoxSearch Takaken YASS JSoko Sokolution Solved by only one Solved by all Solved by none
41    no no no no no no no yes
42    no no no no no no no yes
43    no no no no no no no yes
44    no no no no no no no yes
45    no no no no no no no yes
46    no no no no no no no yes
47    no no no no no no no yes
48    no no no no yes yes no no
49    no no no no no no no yes
50    no no no no no no no yes
Total    14 22 13 12 23 10 7 20
Retrieved from "http://www.sokobano.de/wiki/index.php?title=Solver_Statistics_-_Sasquatch_III_-_David_W._Skinner"
Personal tools