The results below are organized as follows:

  • each table displays the solver’s performance for individual problem instances for the given task under different time limits
  • table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria

MAR

overall

Problem 20sec 1200sec 3600sec
1aie 0.0 100.0 100.0
1bxv 0.0 100.0 100.0
1g6x 0.0 100.0 100.0
1jer 0.0 100.0 100.0
1npl 0.0 100.0 100.0
1qt9 100.0 100.0 100.0
1rfs 100.0 100.0 100.0
2rta 0.0 100.0 100.0
BN_12 97.5 97.5 97.5
BN_13 98.7 98.7 98.7
BN_15 97.7 97.7 97.7
BN_31 0.0 87.6 87.6
blockmap_10_01-0009 0.0 0.0 0.0
blockmap_10_02-0009 0.0 0.0 0.0
blockmap_10_03-0009 0.0 0.0 0.0
blockmap_10_03-0010 0.0 0.0 0.0
blockmap_15_01-0008 0.0 0.0 0.0
blockmap_15_02-0008 0.0 0.0 0.0
blockmap_15_03-0010 0.0 0.0 0.0
blockmap_20_01-0009 0.0 0.0 0.0
bwt3ac.wcsp 0.0 47.2 47.2
fs-07 0.0 0.0 0.0
mastermind_03_08_04-0000 0.0 57.6 57.6
mastermind_03_08_04-0001 0.0 87.6 87.6
mastermind_03_08_04-0002 0.0 80.0 80.0
mastermind_03_08_04-0003 0.0 75.8 75.8
mastermind_03_08_04-0007 0.0 94.4 94.4
mastermind_03_08_04-0008 0.0 87.8 87.8
mastermind_03_08_04-0010 0.0 81.5 81.5
mastermind_03_08_04-0012 0.0 0.0 0.0
mastermind_03_08_04-0013 0.0 1.9 1.9
mastermind_03_08_04-0014 0.0 9.1 9.1
mastermind_03_08_04-0015 0.0 6.2 6.2
mastermind_03_08_05-0001 0.0 86.6 86.6
mastermind_03_08_05-0003 0.0 92.2 92.2
mastermind_03_08_05-0009 0.0 74.5 74.5
mastermind_04_08_03-0000 0.0 71.9 71.9
mastermind_04_08_03-0011 0.0 37.9 37.9
mastermind_04_08_03-0012 0.0 46.8 46.8
mastermind_04_08_03-0013 0.0 47.6 47.6
mastermind_04_08_03-0014 0.0 18.8 18.8
mastermind_04_08_03-0015 0.0 7.8 7.8
mastermind_04_08_04-0001 0.0 85.0 85.0
mastermind_04_08_04-0002 0.0 62.7 62.7
mastermind_04_08_04-0003 0.0 69.5 69.5
mastermind_04_08_04-0004 0.0 63.3 63.3
mastermind_04_08_04-0005 0.0 89.7 89.7
mastermind_05_08_03-0001 0.0 79.2 79.2
mastermind_05_08_03-0002 0.0 72.4 72.4
mastermind_05_08_03-0003 0.0 67.2 67.2
mastermind_05_08_03-0004 0.0 82.5 82.5
mastermind_05_08_03-0009 0.0 57.4 57.4
mastermind_05_08_03-0011 0.0 42.8 42.8
mastermind_05_08_03-0012 0.0 64.9 64.9
mastermind_05_08_03-0013 0.0 53.8 53.8
mastermind_05_08_03-0015 0.0 28.0 28.0
mastermind_06_08_03-0002 0.0 69.2 69.2
mastermind_06_08_03-0003 0.0 79.8 79.8
mastermind_06_08_03-0005 0.0 79.3 79.3
mastermind_06_08_03-0009 0.0 58.8 58.8
mastermind_10_08_03-0008 0.0 30.5 30.5
mastermind_10_08_03-0009 0.0 77.7 77.7
myciel5g_3.wcsp 100.0 0.0 100.0
or_chain_102.fg 0.0 0.0 10.3
or_chain_106.fg 0.0 0.0 91.2
or_chain_107.fg 0.0 0.0 68.2
or_chain_12.fg 0.0 0.0 7.0
or_chain_128.fg 0.0 0.0 71.4
or_chain_132.fg 0.0 0.0 37.0
or_chain_138.fg 0.0 0.0 95.7
or_chain_140.fg 0.0 0.0 0.0
or_chain_149.fg 0.0 0.0 97.6
or_chain_15.fg 0.0 0.0 91.6
or_chain_150.fg 0.0 0.0 37.1
or_chain_153.fg 0.0 0.0 0.0
or_chain_155.fg 93.1 0.0 93.1
or_chain_161.fg 0.0 0.0 46.8
or_chain_186.fg 0.0 0.0 84.1
or_chain_188.fg 0.0 0.0 45.3
or_chain_198.fg 0.0 0.0 99.2
or_chain_209.fg 0.0 0.0 74.5
or_chain_242.fg 0.0 0.0 56.9
or_chain_4.fg 0.0 0.0 0.1
or_chain_53.fg 0.0 0.0 99.7
or_chain_61.fg 0.0 0.0 82.2
or_chain_64.fg 0.0 0.0 0.0
or_chain_90.fg 0.0 0.0 45.6
queen5_5_3.wcsp 100.0 0.0 100.0

Updated: