The results below are organized as follows:

  • each table displays the solver’s performance for individual problem instances for the given task under different time limits
  • table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria

MAR

overall

Problem 20sec 1200sec 3600sec
1aie 100.0 100.0 100.0
1bxv 100.0 100.0 100.0
1g6x 99.9 100.0 100.0
1jer 100.0 100.0 100.0
1npl 100.0 100.0 100.0
1qt9 89.9 100.0 100.0
1rfs 91.7 100.0 100.0
2rta 100.0 100.0 100.0
BN_12 99.0 100.0 100.0
BN_13 99.5 99.7 99.7
BN_15 99.7 100.0 100.0
BN_31 100.0 100.0 100.0
blockmap_10_01-0009 0.0 100.0 100.0
blockmap_10_02-0009 0.0 100.0 100.0
blockmap_10_03-0009 0.0 100.0 100.0
blockmap_10_03-0010 0.0 100.0 100.0
blockmap_15_01-0008 0.0 100.0 100.0
blockmap_15_02-0008 0.0 100.0 100.0
blockmap_15_03-0010 0.0 100.0 100.0
blockmap_20_01-0009 0.0 0.0 0.0
bwt3ac.wcsp 97.0 99.9 99.9
fs-07 98.5 98.3 98.3
mastermind_03_08_04-0000 96.2 97.9 97.9
mastermind_03_08_04-0001 67.9 67.9 67.9
mastermind_03_08_04-0002 87.3 87.3 87.3
mastermind_03_08_04-0003 63.1 63.1 63.1
mastermind_03_08_04-0007 100.0 100.0 100.0
mastermind_03_08_04-0008 100.0 100.0 100.0
mastermind_03_08_04-0010 100.0 100.0 100.0
mastermind_03_08_04-0012 0.0 90.2 90.2
mastermind_03_08_04-0013 0.0 91.3 91.3
mastermind_03_08_04-0014 0.0 87.2 87.2
mastermind_03_08_04-0015 0.0 92.8 92.8
mastermind_03_08_05-0001 0.0 77.9 77.9
mastermind_03_08_05-0003 0.0 81.7 81.7
mastermind_03_08_05-0009 0.0 100.0 100.0
mastermind_04_08_03-0000 0.0 86.9 86.9
mastermind_04_08_03-0011 100.0 100.0 100.0
mastermind_04_08_03-0012 100.0 100.0 100.0
mastermind_04_08_03-0013 100.0 100.0 100.0
mastermind_04_08_03-0014 100.0 100.0 100.0
mastermind_04_08_03-0015 100.0 100.0 100.0
mastermind_04_08_04-0001 73.5 73.5 73.5
mastermind_04_08_04-0002 100.0 100.0 100.0
mastermind_04_08_04-0003 100.0 100.0 100.0
mastermind_04_08_04-0004 100.0 100.0 100.0
mastermind_04_08_04-0005 83.4 83.4 83.4
mastermind_05_08_03-0001 84.3 84.3 84.3
mastermind_05_08_03-0002 82.0 82.0 82.0
mastermind_05_08_03-0003 82.1 82.1 82.1
mastermind_05_08_03-0004 88.5 88.5 88.5
mastermind_05_08_03-0009 100.0 100.0 100.0
mastermind_05_08_03-0011 0.0 100.0 100.0
mastermind_05_08_03-0012 0.0 100.0 100.0
mastermind_05_08_03-0013 0.0 100.0 100.0
mastermind_05_08_03-0015 0.0 100.0 100.0
mastermind_06_08_03-0002 86.6 86.6 86.6
mastermind_06_08_03-0003 89.1 89.1 89.1
mastermind_06_08_03-0005 100.0 100.0 100.0
mastermind_06_08_03-0009 100.0 100.0 100.0
mastermind_10_08_03-0008 67.8 67.8 67.8
mastermind_10_08_03-0009 84.5 84.5 84.5
myciel5g_3.wcsp 88.9 88.9 88.9
or_chain_102.fg 0.0 76.4 76.4
or_chain_106.fg 0.0 44.4 77.1
or_chain_107.fg 0.0 35.5 35.5
or_chain_12.fg 0.0 0.0 0.0
or_chain_128.fg 0.0 0.0 0.0
or_chain_132.fg 0.0 42.1 42.1
or_chain_138.fg 0.0 51.0 47.1
or_chain_140.fg 0.0 0.0 0.0
or_chain_149.fg 0.0 86.2 86.2
or_chain_15.fg 0.0 30.3 65.4
or_chain_150.fg 0.0 55.6 55.6
or_chain_153.fg 0.0 67.4 67.4
or_chain_155.fg 0.0 85.5 85.5
or_chain_161.fg 0.0 0.0 24.9
or_chain_186.fg 0.0 65.2 65.2
or_chain_188.fg 0.0 0.0 0.0
or_chain_198.fg 0.0 38.6 40.0
or_chain_209.fg 0.0 46.8 46.8
or_chain_242.fg 0.0 31.6 22.3
or_chain_4.fg 0.0 72.7 72.7
or_chain_53.fg 0.0 48.2 39.3
or_chain_61.fg 0.0 0.0 0.0
or_chain_64.fg 0.0 0.0 0.0
or_chain_90.fg 0.0 47.6 47.6
queen5_5_3.wcsp 88.9 88.9 88.9

Updated: