The results below are organized as follows:

  • each table below displays various solvers’ performance for individual problem instances for the given task and time limit
  • table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria

overall

20sec

Problem AbstractionSampling baseline ibia-pr lbp-pr uai14-pr
1a7w 99.6 (-1.0) 0.0 (0.9) 100.0 (-1.0) 100.0 (-1.0) 100.0 (-1.0)
1aie 98.8 (2.8) 0.0 (2.9) 100.0 (2.8) 100.0 (2.8) 100.0 (2.8)
1b2v 100.0 (-53.4) 0.0 (-46.7) 100.0 (-53.4) 100.0 (-53.4) 100.0 (-53.4)
1bxv 100.0 (-9.7) 0.0 (-6.4) 100.0 (-9.7) 100.0 (-9.7) 100.0 (-9.7)
1cpq 99.7 (-21.7) 0.0 (-15.9) 100.0 (-21.7) 99.9 (-21.7) 100.0 (-21.7)
1ctj 99.9 (-13.3) 0.0 (-9.8) 100.0 (-13.3) 100.0 (-13.3) 100.0 (-13.3)
1cxy 100.0 (-38.0) 0.0 (-30.7) 100.0 (-38.0) 100.0 (-38.0) 100.0 (-38.0)
1f94 99.9 (-61.4) 0.0 (-59.5) 100.0 (-61.4) 99.7 (-61.4) 100.0 (-61.4)
1fas 0.0 (nan) 0.0 (-32.2) 100.0 (-33.3) 100.0 (-33.3) 100.0 (-33.3)
1g6x 99.5 (-27.2) 0.0 (-24.3) 100.0 (-27.2) 100.0 (-27.2) 100.0 (-27.2)
1jer 100.0 (-31.5) 0.0 (-21.1) 100.0 (-31.5) 100.0 (-31.5) 100.0 (-31.5)
1kp6 100.0 (-45.1) 0.0 (-39.2) 100.0 (-45.1) 100.0 (-45.1) 100.0 (-45.1)
1nkd 99.9 (-8.8) 0.0 (-4.9) 100.0 (-8.8) 100.0 (-8.8) 100.0 (-8.8)
1npl 0.0 (nan) 0.0 (-30.8) 100.0 (-42.9) 100.0 (-42.9) 100.0 (-42.9)
1qt9 98.9 (-59.9) 0.0 (-39.2) 100.0 (-59.7) 100.0 (-59.7) 100.0 (-59.7)
1rfs 100.0 (-50.6) 0.0 (-23.7) 100.0 (-50.6) 100.0 (-50.6) 100.0 (-50.6)
1svy 100.0 (-38.6) 0.0 (-29.3) 100.0 (-38.6) 100.0 (-38.6) 100.0 (-38.6)
1vfy 99.2 (-20.1) 0.0 (-18.1) 100.0 (-20.1) 100.0 (-20.1) 100.0 (-20.1)
2rta 100.0 (-55.2) 0.0 (-38.3) 100.0 (-55.2) 100.0 (-55.2) 100.0 (-55.2)
BN_12 99.9 (-3.6) 0.0 (-0.3) 100.0 (-3.6) 99.9 (-3.6) 100.0 (-3.6)
BN_13 100.0 (-2.3) 0.0 (2.5) 100.0 (-2.3) 100.0 (-2.3) 100.0 (-2.3)
BN_15 100.0 (-5.7) 0.0 (-1.0) 100.0 (-5.7) 100.0 (-5.7) 100.0 (-5.7)
BN_31 99.9 (-10.9) 0.0 (116.3) 100.0 (-11.0) 99.8 (-11.2) 100.0 (-11.0)
BN_74 99.0 (-1.5) 0.0 (153.5) 100.0 (0.0) 99.6 (0.7) 100.0 (0.0)
blockmap_10_01-0006 99.4 (-0.5) 0.0 (94.8) 0.0 (nan) 74.4 (23.5) 74.3 (23.5)
blockmap_10_01-0009 100.0 (-1.0) 0.0 (3.6) 0.0 (nan) 0.0 (5.2) 0.0 (5.6)
blockmap_10_02-0009 100.0 (-2.2) 0.0 (11.9) 0.0 (nan) 40.1 (6.2) 40.1 (6.2)
blockmap_10_03-0009 100.0 (-3.2) 0.0 (-1.1) 0.0 (nan) 0.0 (0.0) 0.0 (0.5)
blockmap_10_03-0010 100.0 (-2.9) 0.0 (8.6) 0.0 (nan) 18.4 (6.5) 11.2 (7.3)
blockmap_15_01-0008 100.0 (-1.2) 0.0 (-1.2) 0.0 (nan) 0.0 (23.5) 0.0 (111.1)
blockmap_15_02-0008 100.0 (-2.4) 0.0 (-1.9) 0.0 (nan) 0.0 (11.4) 0.0 (55.0)
blockmap_15_03-0008 0.0 (-inf) 0.0 (30.0) 0.0 (nan) 92.3 (-0.6) 0.0 (300.0)
blockmap_15_03-0010 100.0 (-3.1) 0.0 (-2.9) 0.0 (nan) 0.0 (39.4) 0.0 (160.5)
blockmap_20_01-0009 100.0 (-1.3) 0.0 (-1.3) 0.0 (nan) 0.0 (14.3) 0.0 (39.5)
blockmap_20_02-0009 0.0 (nan) 0.0 (-2.3) 0.0 (nan) 0.0 (2.7) 0.0 (690.4)
blockmap_20_03-0010 0.0 (nan) 0.0 (-3.3) 0.0 (nan) 0.0 (-18.1) 0.0 (610.9)
blockmap_22_01-0006 0.0 (nan) 0.0 (-1.3) 0.0 (nan) 0.0 (26.6) 0.0 (807.5)
blockmap_22_03-0009 100.0 (-4.1) 0.0 (-3.6) 0.0 (nan) 0.0 (-56.3) 0.0 (-76.6)
bwt3ac.wcsp 99.8 (0.1) 0.0 (11.7) 100.0 (0.0) 76.8 (-2.7) 99.6 (-0.0)
fs-07 100.0 (-14.7) 0.0 (-6.4) 92.8 (-14.1) 10.5 (-22.2) 100.0 (-14.8)
mastermind_03_08_04-0000 0.0 (-inf) 0.0 (249.0) 100.0 (0.0) 100.0 (-0.0) 100.0 (0.0)
mastermind_03_08_04-0001 99.6 (-13.1) 0.0 (86.6) 100.0 (-12.7) 100.0 (-12.7) 100.0 (-12.7)
mastermind_03_08_04-0002 99.8 (-14.6) 0.0 (63.9) 100.0 (-14.5) 99.4 (-14.0) 100.0 (-14.5)
mastermind_03_08_04-0003 99.7 (-11.9) 0.0 (119.0) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5)
mastermind_03_08_04-0007 100.0 (-16.6) 0.0 (86.6) 100.0 (-16.6) 98.4 (-14.9) 100.0 (-16.6)
mastermind_03_08_04-0008 100.0 (-16.3) 0.0 (33.9) 100.0 (-16.3) 99.6 (-16.1) 100.0 (-16.3)
mastermind_03_08_04-0010 99.9 (-14.4) 0.0 (149.5) 100.0 (-14.5) 99.0 (-16.1) 99.6 (-15.2)
mastermind_03_08_04-0011 0.0 (-inf) 0.0 (233.0) 99.9 (-10.1) 96.7 (-17.7) 99.4 (-11.3)
mastermind_03_08_04-0012 0.0 (-inf) 0.0 (234.5) 99.9 (-8.3) 97.0 (-15.4) 99.7 (-8.9)
mastermind_03_08_04-0013 0.0 (-inf) 0.0 (233.5) 99.9 (-8.8) 96.6 (-16.8) 99.4 (-10.1)
mastermind_03_08_04-0014 0.0 (-inf) 0.0 (233.3) 99.9 (-9.2) 96.3 (-17.9) 99.7 (-9.6)
mastermind_03_08_04-0015 0.0 (-inf) 0.0 (234.0) 100.0 (-8.0) 96.8 (-15.7) 99.7 (-8.8)
mastermind_03_08_05-0000 0.0 (-inf) 0.0 (409.8) 100.0 (0.0) 100.0 (-0.0) 100.0 (-0.0)
mastermind_03_08_05-0001 0.0 (-inf) 0.0 (203.4) 0.0 (nan) 99.9 (-15.2) 100.0 (-15.4)
mastermind_03_08_05-0003 0.0 (-inf) 0.0 (171.6) 0.0 (nan) 100.0 (-15.1) 100.0 (-15.1)
mastermind_03_08_05-0004 0.0 (-inf) 0.0 (227.8) 0.0 (nan) 99.9 (-13.9) 100.0 (-14.2)
mastermind_03_08_05-0008 0.0 (-inf) 0.0 (310.5) 0.0 (nan) 98.3 (-20.1) 99.9 (-14.3)
mastermind_03_08_05-0009 100.0 (-21.5) 0.0 (27.9) 0.0 (nan) 89.3 (-16.2) 86.4 (-14.8)
mastermind_03_08_05-0011 0.0 (-inf) 0.0 (390.4) 0.0 (nan) 98.7 (-15.4) 98.6 (-15.9)
mastermind_03_08_05-0012 0.0 (-inf) 0.0 (392.2) 0.0 (nan) 97.6 (-18.8) 98.7 (-14.6)
mastermind_03_08_05-0013 0.0 (-inf) 0.0 (390.4) 0.0 (nan) 96.8 (-21.6) 98.9 (-13.5)
mastermind_03_08_05-0014 0.0 (-inf) 0.0 (392.9) 0.0 (nan) 97.7 (-18.3) 99.2 (-12.5)
mastermind_03_08_05-0015 0.0 (-inf) 0.0 (390.2) 0.0 (nan) 97.0 (-22.0) 98.9 (-14.3)
mastermind_04_08_03-0000 100.0 (-0.0) 0.0 (139.3) 100.0 (0.0) 100.0 (-0.0) 100.0 (-0.0)
mastermind_04_08_03-0011 99.9 (-4.8) 0.0 (128.2) 100.0 (-4.7) 97.7 (-7.7) 99.8 (-5.0)
mastermind_04_08_03-0012 99.9 (-6.2) 0.0 (128.5) 100.0 (-6.0) 96.1 (-11.3) 99.9 (-6.1)
mastermind_04_08_03-0013 100.0 (-7.2) 0.0 (127.0) 100.0 (-7.2) 97.3 (-10.9) 99.9 (-7.3)
mastermind_04_08_03-0014 100.0 (-6.5) 0.0 (127.4) 100.0 (-6.5) 97.7 (-9.6) 99.6 (-7.0)
mastermind_04_08_03-0015 99.8 (-6.9) 0.0 (128.4) 100.0 (-7.1) 95.7 (-12.8) 99.9 (-7.2)
mastermind_04_08_04-0000 0.0 (-inf) 0.0 (274.2) 100.0 (0.0) 100.0 (-0.0) 100.0 (0.1)
mastermind_04_08_04-0001 99.2 (-12.5) 0.0 (97.0) 100.0 (-11.7) 99.7 (-11.3) 100.0 (-11.7)
mastermind_04_08_04-0002 98.7 (-14.0) 0.0 (127.4) 100.0 (-12.1) 100.0 (-12.1) 100.0 (-12.1)
mastermind_04_08_04-0003 95.8 (-18.7) 0.0 (107.7) 100.0 (-13.6) 100.0 (-13.6) 100.0 (-13.6)
mastermind_04_08_04-0004 0.0 (-inf) 0.0 (143.1) 100.0 (-11.2) 99.8 (-10.9) 100.0 (-11.2)
mastermind_04_08_04-0005 0.0 (-inf) 0.0 (79.4) 100.0 (-15.9) 99.7 (-15.6) 100.0 (-15.9)
mastermind_04_08_04-0011 0.0 (-inf) 0.0 (258.0) 0.0 (nan) 97.4 (-15.3) 99.3 (-10.3)
mastermind_04_08_04-0012 0.0 (-inf) 0.0 (259.5) 0.0 (nan) 97.4 (-15.1) 99.7 (-8.7)
mastermind_04_08_04-0013 0.0 (-inf) 0.0 (259.1) 0.0 (nan) 97.9 (-12.7) 98.8 (-10.3)
mastermind_04_08_04-0014 0.0 (-inf) 0.0 (259.1) 0.0 (nan) 97.9 (-14.3) 99.3 (-10.6)
mastermind_04_08_04-0015 0.0 (-inf) 0.0 (260.0) 0.0 (nan) 96.8 (-16.3) 99.0 (-10.3)
mastermind_05_08_03-0000 99.7 (0.5) 0.0 (150.1) 100.0 (0.0) 100.0 (-0.0) 100.0 (0.0)
mastermind_05_08_03-0001 100.0 (-9.8) 0.0 (58.1) 100.0 (-9.8) 100.0 (-9.8) 100.0 (-9.8)
mastermind_05_08_03-0002 100.0 (-12.2) 0.0 (43.8) 100.0 (-12.2) 100.0 (-12.2) 100.0 (-12.2)
mastermind_05_08_03-0003 100.0 (-8.6) 0.0 (70.9) 100.0 (-8.6) 100.0 (-8.6) 100.0 (-8.6)
mastermind_05_08_03-0004 100.0 (-11.6) 0.0 (43.9) 100.0 (-11.6) 100.0 (-11.6) 100.0 (-11.6)
mastermind_05_08_03-0009 99.9 (-8.0) 0.0 (98.9) 100.0 (-8.0) 96.6 (-11.6) 99.7 (-8.3)
mastermind_05_08_03-0011 99.7 (-6.7) 0.0 (139.6) 99.9 (-6.3) 95.2 (-13.2) 99.9 (-6.3)
mastermind_05_08_03-0012 99.5 (-8.3) 0.0 (138.7) 99.6 (-8.2) 95.7 (-13.9) 99.9 (-7.8)
mastermind_05_08_03-0013 99.7 (-6.2) 0.0 (138.8) 100.0 (-6.6) 97.3 (-10.6) 99.8 (-6.3)
mastermind_05_08_03-0014 99.9 (-5.1) 0.0 (139.5) 100.0 (-4.9) 96.6 (-9.8) 99.9 (-4.8)
mastermind_05_08_03-0015 99.3 (-7.4) 0.0 (140.2) 99.9 (-6.1) 95.6 (-12.7) 99.9 (-6.1)
mastermind_06_08_03-0000 0.0 (-inf) 0.0 (160.4) 100.0 (0.0) 100.0 (-0.0) 100.0 (-0.0)
mastermind_06_08_03-0001 100.0 (-12.6) 0.0 (18.6) 100.0 (-12.6) 92.8 (-10.4) 100.0 (-12.6)
mastermind_06_08_03-0002 100.0 (-10.5) 0.0 (51.4) 100.0 (-10.5) 99.9 (-10.6) 100.0 (-10.5)
mastermind_06_08_03-0003 100.0 (-11.2) 0.0 (33.5) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2)
mastermind_06_08_03-0005 100.0 (-11.9) 0.0 (10.4) 100.0 (-11.9) 87.0 (-9.0) 100.0 (-11.9)
mastermind_06_08_03-0009 99.9 (-8.3) 0.0 (98.2) 100.0 (-8.4) 97.3 (-11.3) 99.9 (-8.5)
mastermind_06_08_03-0011 99.6 (-4.1) 0.0 (148.5) 99.9 (-4.9) 98.5 (-7.0) 99.1 (-6.1)
mastermind_06_08_03-0012 0.0 (-inf) 0.0 (149.4) 100.0 (-5.9) 96.7 (-11.0) 100.0 (-5.8)
mastermind_06_08_03-0014 0.0 (-inf) 0.0 (149.4) 100.0 (-6.3) 96.0 (-12.5) 99.9 (-6.2)
mastermind_06_08_03-0015 0.0 (-inf) 0.0 (148.8) 99.8 (-7.4) 96.6 (-13.1) 99.9 (-7.6)
mastermind_10_08_03-0001 0.0 (-inf) 0.0 (52.8) 100.0 (-13.6) 100.0 (-13.6) 100.0 (-13.6)
mastermind_10_08_03-0003 0.0 (-inf) 0.0 (52.3) 100.0 (-15.5) 99.6 (-15.2) 100.0 (-15.5)
mastermind_10_08_03-0004 0.0 (-inf) 0.0 (26.0) 100.0 (-16.5) 95.7 (-14.7) 100.0 (-16.5)
mastermind_10_08_03-0008 100.0 (-23.2) 0.0 (-13.4) 100.0 (-23.2) 78.4 (-25.4) 79.0 (-25.3)
mastermind_10_08_03-0009 100.0 (-17.8) 0.0 (17.5) 100.0 (-17.8) 88.2 (-22.0) 89.7 (-21.5)
mastermind_10_08_03-0010 0.0 (-inf) 0.0 (112.8) 100.0 (-10.1) 98.9 (-11.5) 99.9 (-10.1)
myciel5g_3.wcsp 92.7 (-66.7) 0.0 (14.3) 92.3 (-55.4) 44.3 (-19.1) 75.7 (-42.9)
myciel5g_4.wcsp 97.9 (-8.7) 0.0 (22.5) 64.8 (2.7) 73.3 (0.1) 59.4 (4.4)
or_chain_1.fg 87.0 (-11.6) 0.0 (-4.5) 97.4 (-10.6) 91.1 (-11.3) 92.2 (-11.2)
or_chain_102.fg 96.4 (-9.9) 0.0 (-4.9) 92.6 (-10.4) 88.5 (-10.6) 90.6 (-10.5)
or_chain_106.fg 80.0 (-11.4) 0.0 (-3.4) 94.9 (-9.7) 91.9 (-10.6) 93.0 (-10.5)
or_chain_107.fg 89.5 (-12.3) 0.0 (-4.2) 99.5 (-11.6) 95.7 (-11.9) 97.0 (-11.8)
or_chain_12.fg 72.7 (-14.2) 0.0 (-5.1) 96.3 (-12.5) 85.0 (-13.3) 93.8 (-12.7)
or_chain_128.fg 88.7 (-11.8) 0.0 (-2.9) 97.3 (-11.1) 89.3 (-11.8) 93.8 (-11.4)
or_chain_132.fg 99.8 (-8.4) 0.0 (-2.2) 93.7 (-8.0) 100.0 (-8.4) 100.0 (-8.4)
or_chain_138.fg 99.0 (-10.1) 0.0 (-1.8) 98.1 (-10.2) 99.9 (-10.1) 100.0 (-10.1)
or_chain_140.fg 20.0 (-10.3) 0.0 (0.4) 98.6 (-5.5) 89.7 (-6.2) 88.7 (-6.2)
or_chain_149.fg 99.4 (-8.6) 0.0 (-1.4) 99.8 (-8.6) 99.9 (-8.6) 100.0 (-8.6)
or_chain_15.fg 81.9 (-13.1) 0.0 (-4.7) 92.6 (-12.4) 99.3 (-11.9) 99.7 (-11.9)
or_chain_150.fg 91.9 (-7.5) 0.0 (-3.5) 80.9 (-8.0) 96.9 (-7.4) 97.2 (-7.4)
or_chain_153.fg 86.2 (-9.6) 0.0 (-1.8) 92.4 (-9.2) 95.5 (-9.0) 95.9 (-9.0)
or_chain_155.fg 95.0 (-10.3) 0.0 (-3.4) 99.8 (-9.9) 99.0 (-10.0) 100.0 (-10.0)
or_chain_161.fg 97.6 (-9.1) 0.0 (-3.2) 73.0 (-7.6) 93.4 (-9.6) 97.3 (-9.4)
or_chain_186.fg 94.5 (-9.7) 0.0 (-5.6) 87.2 (-10.0) 95.9 (-9.6) 97.3 (-9.6)
or_chain_188.fg 97.8 (-12.5) 0.0 (-5.4) 99.0 (-12.4) 95.1 (-12.7) 99.2 (-12.4)
or_chain_198.fg 93.9 (-4.6) 0.0 (1.3) 81.3 (-3.3) 99.9 (-4.3) 99.9 (-4.3)
or_chain_209.fg 92.8 (-12.0) 0.0 (-4.6) 91.9 (-12.0) 98.2 (-11.6) 98.9 (-11.5)
or_chain_242.fg 98.7 (-5.5) 0.0 (2.4) 93.9 (-5.8) 98.4 (-5.5) 98.9 (-5.4)
or_chain_4.fg 88.4 (-12.5) 0.0 (-4.9) 93.4 (-12.2) 95.8 (-12.0) 97.1 (-11.9)
or_chain_53.fg 99.8 (-9.2) 0.0 (-1.0) 99.6 (-9.2) 100.0 (-9.2) 100.0 (-9.2)
or_chain_61.fg 92.3 (-8.4) 0.0 (-2.3) 90.0 (-7.4) 96.8 (-8.2) 97.1 (-8.2)
or_chain_64.fg 92.2 (-9.4) 0.0 (-1.7) 99.5 (-8.9) 92.8 (-9.4) 93.5 (-9.3)
or_chain_90.fg 94.8 (-8.9) 0.0 (-2.1) 91.3 (-9.1) 85.0 (-9.5) 88.8 (-9.3)
pedigree51 95.7 (-74.4) 0.0 (-9.0) 95.4 (-74.1) 99.1 (-76.7) 96.0 (-74.5)
queen5_5_3.wcsp 98.2 (-115.3) 0.0 (7.7) 96.3 (-108.6) 19.8 (-16.2) 79.8 (-88.7)
queen5_5_4.wcsp 98.9 (-46.3) 0.0 (12.1) 83.6 (-36.2) 29.4 (-4.9) 64.7 (-25.3)
rus2_20_40_0_1 99.9 (106.9) 0.0 (161.5) 0.0 (nan) 100.0 (106.9) 0.0 (309.0)
rus2_20_40_0_2 99.9 (120.6) 0.0 (171.9) 0.0 (nan) 100.0 (120.6) 0.0 (318.0)
rus2_20_40_0_3 100.0 (88.2) 0.0 (143.3) 0.0 (nan) 100.0 (88.2) 0.0 (276.2)
rus2_20_40_1_1 100.0 (107.4) 0.0 (171.6) 0.0 (nan) 100.0 (107.4) 0.0 (289.2)
rus2_20_40_1_2 100.0 (104.5) 0.0 (166.3) 0.0 (nan) 100.0 (104.5) 0.0 (248.4)
rus2_20_40_1_3 99.8 (101.5) 0.0 (175.5) 0.0 (nan) 99.9 (101.7) 0.0 (260.4)
rus2_20_40_2_1 98.6 (118.5) 0.0 (175.7) 0.0 (nan) 99.9 (119.2) 0.0 (288.6)
rus2_20_40_2_2 98.2 (117.5) 0.0 (174.5) 0.0 (nan) 100.0 (118.6) 0.0 (318.0)
rus2_20_40_2_3 99.9 (112.4) 0.0 (176.5) 0.0 (nan) 97.6 (110.9) 0.0 (323.5)
rus2_20_40_3_1 99.3 (110.6) 0.0 (172.9) 0.0 (nan) 99.2 (109.6) 0.0 (283.7)
rus2_20_40_3_2 99.9 (141.1) 0.0 (206.1) 0.0 (nan) 97.6 (139.6) 0.0 (320.2)
rus2_20_40_3_3 99.8 (123.4) 0.0 (191.3) 0.0 (nan) 99.3 (123.1) 0.0 (311.1)
rus2_20_40_4_1 99.9 (99.1) 0.0 (162.8) 0.0 (nan) 100.0 (99.2) 0.0 (250.0)
rus2_20_40_4_2 100.0 (107.0) 0.0 (163.6) 0.0 (nan) 100.0 (107.1) 0.0 (346.9)
rus2_20_40_4_3 99.9 (95.2) 0.0 (162.9) 0.0 (nan) 100.0 (95.2) 0.0 (287.4)
rus2_20_40_5_1 100.0 (95.5) 0.0 (154.3) 0.0 (nan) 91.2 (90.3) 0.0 (238.3)
rus2_20_40_5_2 99.7 (88.1) 0.0 (160.9) 0.0 (nan) 99.9 (88.2) 0.0 (223.8)
rus2_20_40_5_3 100.0 (169.9) 0.0 (227.4) 0.0 (nan) 100.0 (169.9) 0.0 (298.2)
rus2_20_40_6_1 99.7 (118.9) 0.0 (182.2) 0.0 (nan) 95.2 (116.1) 0.0 (307.9)
rus2_20_40_6_2 99.9 (68.3) 0.0 (132.5) 0.0 (nan) 100.0 (68.3) 0.0 (283.7)
rus2_20_40_6_3 100.0 (134.1) 0.0 (199.1) 0.0 (nan) 100.0 (134.1) 0.0 (345.4)
rus2_20_40_7_1 100.0 (88.5) 0.0 (151.9) 0.0 (nan) 100.0 (88.5) 0.0 (285.3)
rus2_20_40_7_2 99.9 (111.5) 0.0 (168.5) 0.0 (nan) 100.0 (111.5) 0.0 (245.2)
rus2_20_40_7_3 99.9 (81.4) 0.0 (141.3) 0.0 (nan) 100.0 (81.4) 0.0 (261.1)
rus2_20_40_8_1 100.0 (106.9) 0.0 (178.4) 0.0 (nan) 95.1 (103.4) 0.0 (330.5)
rus2_20_40_8_2 99.9 (99.8) 0.0 (164.7) 0.0 (nan) 99.9 (99.8) 0.0 (326.2)
rus2_20_40_8_3 99.9 (100.5) 0.0 (168.4) 0.0 (nan) 100.0 (100.6) 0.0 (399.2)
rus2_20_40_9_1 99.9 (94.6) 0.0 (167.2) 0.0 (nan) 100.0 (94.5) 0.0 (274.0)
rus2_20_40_9_2 99.4 (94.1) 0.0 (171.3) 0.0 (nan) 100.0 (94.6) 0.0 (306.3)
rus2_20_40_9_3 99.9 (63.7) 0.0 (139.1) 0.0 (nan) 99.9 (63.5) 0.0 (302.3)
rus_20_40_0_1 100.0 (617.3) 0.0 (828.0) 0.0 (nan) 99.3 (615.7) 0.0 (2460.3)
rus_20_40_0_2 100.0 (791.6) 0.0 (988.1) 0.0 (nan) 100.0 (791.6) 0.0 (2444.7)
rus_20_40_0_3 100.0 (903.0) 0.0 (1097.8) 0.0 (nan) 78.3 (860.7) 0.0 (2451.4)
rus_20_40_1_1 100.0 (1004.6) 0.0 (1185.5) 0.0 (nan) 99.5 (1003.8) 0.0 (2431.7)
rus_20_40_1_2 100.0 (910.1) 0.0 (1097.2) 0.0 (nan) 100.0 (910.1) 0.0 (2423.0)
rus_20_40_1_3 95.3 (891.4) 0.0 (1097.9) 0.0 (nan) 100.0 (900.6) 0.0 (2449.3)
rus_20_40_2_1 100.0 (797.8) 0.0 (992.4) 0.0 (nan) 99.6 (797.0) 0.0 (2440.0)
rus_20_40_2_2 97.2 (683.7) 0.0 (886.0) 0.0 (nan) 100.0 (689.3) 0.0 (2462.3)
rus_20_40_2_3 95.4 (739.8) 0.0 (958.8) 0.0 (nan) 100.0 (749.3) 0.0 (2483.3)
rus_20_40_3_1 99.8 (825.5) 0.0 (1017.6) 0.0 (nan) 100.0 (825.8) 0.0 (2463.3)
rus_20_40_3_2 100.0 (839.0) 0.0 (1027.8) 0.0 (nan) 99.9 (838.8) 0.0 (2467.5)
rus_20_40_3_3 100.0 (841.9) 0.0 (1028.2) 0.0 (nan) 99.9 (841.7) 0.0 (2475.0)
rus_20_40_4_1 95.2 (922.7) 0.0 (1113.8) 0.0 (nan) 95.2 (922.7) 0.0 (2474.3)
rus_20_40_4_2 99.3 (934.4) 0.0 (1119.3) 0.0 (nan) 99.3 (934.4) 0.0 (2426.5)
rus_20_40_4_3 100.0 (853.3) 0.0 (1054.6) 0.0 (nan) 100.0 (853.3) 0.0 (2427.9)
rus_20_40_5_1 100.0 (875.9) 0.0 (1059.6) 0.0 (nan) 99.9 (875.7) 0.0 (2484.6)
rus_20_40_5_2 100.0 (839.6) 0.0 (1031.4) 0.0 (nan) 100.0 (839.7) 0.0 (2422.6)
rus_20_40_5_3 98.5 (878.8) 0.0 (1088.9) 0.0 (nan) 98.5 (878.8) 0.0 (2424.4)
rus_20_40_6_1 95.1 (713.5) 0.0 (935.5) 0.0 (nan) 91.3 (705.4) 0.0 (2465.4)
rus_20_40_6_2 100.0 (982.4) 0.0 (1166.7) 0.0 (nan) 99.5 (981.6) 0.0 (2425.2)
rus_20_40_6_3 96.3 (959.9) 0.0 (1152.7) 0.0 (nan) 100.0 (966.7) 0.0 (2436.3)
rus_20_40_7_1 100.0 (752.1) 0.0 (943.8) 0.0 (nan) 100.0 (752.1) 0.0 (2408.4)
rus_20_40_7_2 100.0 (756.2) 0.0 (951.7) 0.0 (nan) 99.4 (755.0) 0.0 (2435.3)
rus_20_40_7_3 100.0 (869.7) 0.0 (1064.6) 0.0 (nan) 100.0 (869.7) 0.0 (2468.7)
rus_20_40_8_1 99.5 (725.8) 0.0 (931.5) 0.0 (nan) 73.6 (780.9) 0.0 (2474.1)
rus_20_40_8_2 100.0 (898.6) 0.0 (1083.3) 0.0 (nan) 99.6 (897.8) 0.0 (2439.9)
rus_20_40_8_3 98.9 (701.8) 0.0 (895.8) 0.0 (nan) 100.0 (703.8) 0.0 (2468.2)
rus_20_40_9_1 90.5 (849.4) 0.0 (1047.2) 0.0 (nan) 99.4 (867.7) 0.0 (2458.6)
rus_20_40_9_2 93.9 (821.6) 0.0 (1045.8) 0.0 (nan) 100.0 (834.5) 0.0 (2479.3)
rus_20_40_9_3 100.0 (863.9) 0.0 (1052.3) 0.0 (nan) 99.6 (863.2) 0.0 (2404.9)

1200sec

Problem AbstractionSampling baseline ibia-pr lbp-pr uai14-pr
1a7w 0.0 (nan) 0.0 (0.9) 100.0 (-1.0) 100.0 (-1.0) 100.0 (-1.0)
1aie 0.0 (nan) 0.0 (2.9) 100.0 (2.8) 100.0 (2.8) 100.0 (2.8)
1b2v 100.0 (-53.4) 0.0 (-46.7) 100.0 (-53.4) 100.0 (-53.4) 100.0 (-53.4)
1bxv 100.0 (-9.7) 0.0 (-6.4) 100.0 (-9.7) 100.0 (-9.7) 100.0 (-9.7)
1cpq 0.0 (nan) 0.0 (-15.9) 100.0 (-21.7) 99.9 (-21.7) 100.0 (-21.7)
1ctj 100.0 (-13.3) 0.0 (-9.8) 100.0 (-13.3) 100.0 (-13.3) 100.0 (-13.3)
1cxy 100.0 (-38.0) 0.0 (-30.7) 100.0 (-38.0) 100.0 (-38.0) 100.0 (-38.0)
1f94 0.0 (nan) 0.0 (-59.5) 100.0 (-61.4) 99.7 (-61.4) 100.0 (-61.4)
1fas 100.0 (-33.3) 0.0 (-32.2) 100.0 (-33.3) 100.0 (-33.3) 100.0 (-33.3)
1g6x 0.0 (nan) 0.0 (-24.3) 100.0 (-27.2) 100.0 (-27.2) 100.0 (-27.2)
1jer 100.0 (-31.5) 0.0 (-21.1) 100.0 (-31.5) 100.0 (-31.5) 100.0 (-31.5)
1kp6 0.0 (nan) 0.0 (-39.2) 100.0 (-45.1) 100.0 (-45.1) 100.0 (-45.1)
1nkd 0.0 (nan) 0.0 (-4.9) 100.0 (-8.8) 100.0 (-8.8) 100.0 (-8.8)
1npl 100.0 (-42.9) 0.0 (-30.8) 100.0 (-42.9) 100.0 (-42.9) 100.0 (-42.9)
1qt9 100.0 (-59.7) 0.0 (-39.2) 100.0 (-59.7) 100.0 (-59.7) 100.0 (-59.7)
1rfs 100.0 (-50.6) 0.0 (-23.7) 100.0 (-50.6) 100.0 (-50.6) 100.0 (-50.6)
1svy 100.0 (-38.6) 0.0 (-29.3) 100.0 (-38.6) 100.0 (-38.6) 100.0 (-38.6)
1vfy 100.0 (-20.1) 0.0 (-18.1) 100.0 (-20.1) 100.0 (-20.1) 100.0 (-20.1)
2rta 100.0 (-55.2) 0.0 (-38.3) 100.0 (-55.2) 100.0 (-55.2) 100.0 (-55.2)
BN_12 100.0 (-3.6) 0.0 (-0.3) 100.0 (-3.6) 99.9 (-3.6) 100.0 (-3.6)
BN_13 100.0 (-2.3) 0.0 (2.5) 100.0 (-2.3) 100.0 (-2.3) 100.0 (-2.3)
BN_15 100.0 (-5.7) 0.0 (-1.0) 100.0 (-5.7) 100.0 (-5.7) 100.0 (-5.7)
BN_31 100.0 (-11.0) 0.0 (116.3) 100.0 (-11.0) 99.8 (-11.2) 100.0 (-11.0)
BN_74 100.0 (-0.0) 0.0 (153.5) 100.0 (0.0) 99.6 (0.7) 100.0 (0.0)
blockmap_10_01-0006 100.0 (-1.0) 0.0 (94.8) 100.0 (-1.0) 74.4 (23.5) 100.0 (-1.0)
blockmap_10_01-0009 100.0 (-1.0) 0.0 (3.6) 100.0 (-1.0) 0.0 (5.2) 100.0 (-1.0)
blockmap_10_02-0009 100.0 (-2.2) 0.0 (11.9) 100.0 (-2.2) 40.1 (6.2) 100.0 (-2.2)
blockmap_10_03-0009 100.0 (-3.2) 0.0 (-1.1) 100.0 (-3.2) 0.0 (0.0) 100.0 (-3.2)
blockmap_10_03-0010 100.0 (-2.9) 0.0 (8.6) 100.0 (-2.9) 18.4 (6.5) 100.0 (-2.9)
blockmap_15_01-0008 100.0 (-1.2) 0.0 (-1.2) 100.0 (-1.2) 0.0 (23.5) 100.0 (-1.2)
blockmap_15_02-0008 100.0 (-2.4) 0.0 (-1.9) 100.0 (-2.4) 0.0 (11.4) 100.0 (-2.4)
blockmap_15_03-0008 100.0 (-3.2) 0.0 (30.0) 100.0 (-3.2) 92.3 (-0.6) 91.7 (-0.5)
blockmap_15_03-0010 100.0 (-3.1) 0.0 (-2.9) 100.0 (-3.1) 0.0 (39.4) 100.0 (-3.1)
blockmap_20_01-0009 100.0 (-1.3) 0.0 (-1.3) 0.0 (nan) 0.0 (14.3) 100.0 (-1.3)
blockmap_20_02-0009 100.0 (-2.6) 0.0 (-2.3) 0.0 (nan) 0.0 (2.7) 0.0 (482.0)
blockmap_20_03-0010 100.0 (-4.0) 0.0 (-3.3) 0.0 (nan) 0.0 (-18.1) 0.0 (323.4)
blockmap_22_01-0006 100.0 (-1.3) 0.0 (-1.3) 0.0 (nan) 0.0 (26.6) 0.0 (539.7)
blockmap_22_03-0009 100.0 (-4.1) 0.0 (-3.6) 0.0 (nan) 0.0 (-56.3) 0.0 (-208.2)
bwt3ac.wcsp 100.0 (0.0) 0.0 (11.7) 100.0 (0.0) 76.8 (-2.7) 100.0 (0.0)
fs-07 100.0 (-14.8) 0.0 (-6.4) 92.8 (-14.1) 10.5 (-22.2) 100.0 (-14.8)
mastermind_03_08_04-0000 100.0 (-0.0) 0.0 (249.0) 100.0 (0.0) 100.0 (-0.0) 100.0 (0.0)
mastermind_03_08_04-0001 100.0 (-12.7) 0.0 (86.6) 100.0 (-12.7) 100.0 (-12.7) 100.0 (-12.7)
mastermind_03_08_04-0002 100.0 (-14.5) 0.0 (63.9) 100.0 (-14.5) 99.4 (-14.0) 100.0 (-14.5)
mastermind_03_08_04-0003 100.0 (-11.5) 0.0 (119.0) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5)
mastermind_03_08_04-0007 100.0 (-16.6) 0.0 (86.6) 100.0 (-16.6) 98.4 (-14.9) 100.0 (-16.6)
mastermind_03_08_04-0008 100.0 (-16.3) 0.0 (33.9) 100.0 (-16.3) 99.6 (-16.1) 100.0 (-16.3)
mastermind_03_08_04-0010 100.0 (-14.5) 0.0 (149.5) 100.0 (-14.5) 99.0 (-16.1) 100.0 (-14.5)
mastermind_03_08_04-0011 0.0 (-inf) 0.0 (233.0) 99.7 (-10.5) 96.3 (-18.6) 96.3 (-0.8)
mastermind_03_08_04-0012 99.9 (-8.0) 0.0 (234.5) 99.9 (-7.8) 97.0 (-15.4) 90.5 (15.0)
mastermind_03_08_04-0013 99.9 (-8.9) 0.0 (233.5) 100.0 (-8.7) 96.5 (-17.0) 99.0 (-6.3)
mastermind_03_08_04-0014 0.0 (-inf) 0.0 (233.3) 99.9 (-9.1) 96.3 (-17.8) 99.8 (-8.5)
mastermind_03_08_04-0015 99.1 (-10.3) 0.0 (234.0) 100.0 (-8.1) 96.0 (-17.8) 99.6 (-7.2)
mastermind_03_08_05-0000 0.0 (-inf) 0.0 (409.8) 100.0 (0.0) 100.0 (-0.0) 100.0 (-0.0)
mastermind_03_08_05-0001 100.0 (-15.5) 0.0 (203.4) 100.0 (-15.4) 99.9 (-15.2) 100.0 (-15.4)
mastermind_03_08_05-0003 100.0 (-15.2) 0.0 (171.6) 100.0 (-15.1) 100.0 (-15.1) 100.0 (-15.1)
mastermind_03_08_05-0004 100.0 (-14.3) 0.0 (227.8) 100.0 (-14.2) 99.9 (-13.9) 100.0 (-14.2)
mastermind_03_08_05-0008 99.8 (-15.2) 0.0 (310.5) 100.0 (-14.6) 98.3 (-20.3) 100.0 (-14.6)
mastermind_03_08_05-0009 100.0 (-21.5) 0.0 (27.9) 100.0 (-21.5) 89.3 (-16.2) 100.0 (-21.5)
mastermind_03_08_05-0011 0.0 (-inf) 0.0 (390.4) 99.4 (-12.6) 98.3 (-16.9) 98.7 (-5.0)
mastermind_03_08_05-0012 0.0 (-inf) 0.0 (392.2) 99.9 (-9.5) 96.8 (-22.0) 99.9 (-9.6)
mastermind_03_08_05-0013 0.0 (-inf) 0.0 (390.4) 99.9 (-9.4) 96.1 (-24.5) 99.8 (-8.0)
mastermind_03_08_05-0014 0.0 (-inf) 0.0 (392.9) 100.0 (-9.2) 97.1 (-20.6) 98.4 (-2.5)
mastermind_03_08_05-0015 0.0 (-inf) 0.0 (390.2) 99.9 (-9.5) 95.9 (-26.6) 99.4 (-7.8)
mastermind_04_08_03-0000 100.0 (0.0) 0.0 (139.3) 100.0 (0.0) 100.0 (-0.0) 100.0 (-0.0)
mastermind_04_08_03-0011 100.0 (-4.7) 0.0 (128.2) 100.0 (-4.7) 97.7 (-7.7) 100.0 (-4.7)
mastermind_04_08_03-0012 100.0 (-6.0) 0.0 (128.5) 100.0 (-6.0) 95.8 (-11.7) 100.0 (-6.0)
mastermind_04_08_03-0013 100.0 (-7.2) 0.0 (127.0) 100.0 (-7.2) 97.2 (-10.9) 100.0 (-7.2)
mastermind_04_08_03-0014 100.0 (-6.5) 0.0 (127.4) 100.0 (-6.5) 97.7 (-9.6) 100.0 (-6.5)
mastermind_04_08_03-0015 100.0 (-7.1) 0.0 (128.4) 100.0 (-7.1) 95.7 (-12.8) 100.0 (-7.1)
mastermind_04_08_04-0000 99.9 (-0.3) 0.0 (274.2) 100.0 (0.0) 100.0 (-0.0) 100.0 (0.0)
mastermind_04_08_04-0001 100.0 (-11.7) 0.0 (97.0) 100.0 (-11.7) 99.7 (-11.3) 100.0 (-11.7)
mastermind_04_08_04-0002 100.0 (-12.1) 0.0 (127.4) 100.0 (-12.1) 100.0 (-12.1) 100.0 (-12.1)
mastermind_04_08_04-0003 100.0 (-13.6) 0.0 (107.7) 100.0 (-13.6) 100.0 (-13.6) 100.0 (-13.6)
mastermind_04_08_04-0004 100.0 (-11.2) 0.0 (143.1) 100.0 (-11.2) 99.8 (-10.9) 100.0 (-11.2)
mastermind_04_08_04-0005 100.0 (-16.0) 0.0 (79.4) 100.0 (-15.9) 99.7 (-15.6) 100.0 (-15.9)
mastermind_04_08_04-0011 99.3 (-10.3) 0.0 (258.0) 100.0 (-8.3) 97.0 (-16.3) 99.7 (-7.6)
mastermind_04_08_04-0012 99.9 (-8.2) 0.0 (259.5) 100.0 (-8.0) 96.9 (-16.2) 93.6 (9.0)
mastermind_04_08_04-0013 99.6 (-8.2) 0.0 (259.1) 99.7 (-7.9) 97.7 (-13.3) 99.5 (-5.9)
mastermind_04_08_04-0014 99.6 (-7.8) 0.0 (259.1) 99.9 (-9.0) 97.8 (-14.7) 99.9 (-8.5)
mastermind_04_08_04-0015 98.8 (-10.8) 0.0 (260.0) 100.0 (-7.7) 96.5 (-17.0) 99.9 (-8.0)
mastermind_05_08_03-0000 100.0 (-0.0) 0.0 (150.1) 100.0 (0.0) 100.0 (-0.0) 100.0 (0.0)
mastermind_05_08_03-0001 100.0 (-9.8) 0.0 (58.1) 100.0 (-9.8) 100.0 (-9.8) 100.0 (-9.8)
mastermind_05_08_03-0002 100.0 (-12.2) 0.0 (43.8) 100.0 (-12.2) 100.0 (-12.2) 100.0 (-12.2)
mastermind_05_08_03-0003 100.0 (-8.6) 0.0 (70.9) 100.0 (-8.6) 100.0 (-8.6) 100.0 (-8.6)
mastermind_05_08_03-0004 100.0 (-11.6) 0.0 (43.9) 100.0 (-11.6) 100.0 (-11.6) 100.0 (-11.6)
mastermind_05_08_03-0009 100.0 (-8.0) 0.0 (98.9) 100.0 (-8.0) 96.6 (-11.6) 100.0 (-8.0)
mastermind_05_08_03-0011 100.0 (-6.2) 0.0 (139.6) 100.0 (-6.2) 94.9 (-13.5) 99.9 (-6.2)
mastermind_05_08_03-0012 100.0 (-7.6) 0.0 (138.7) 100.0 (-7.6) 95.1 (-14.8) 100.0 (-7.6)
mastermind_05_08_03-0013 100.0 (-6.6) 0.0 (138.8) 100.0 (-6.6) 97.1 (-10.8) 99.8 (-6.2)
mastermind_05_08_03-0014 100.0 (-4.9) 0.0 (139.5) 100.0 (-4.9) 96.6 (-9.8) 100.0 (-4.9)
mastermind_05_08_03-0015 100.0 (-6.3) 0.0 (140.2) 100.0 (-6.3) 95.4 (-13.0) 100.0 (-6.2)
mastermind_06_08_03-0000 100.0 (-0.0) 0.0 (160.4) 100.0 (0.0) 100.0 (-0.0) 100.0 (0.0)
mastermind_06_08_03-0001 100.0 (-12.6) 0.0 (18.6) 100.0 (-12.6) 92.8 (-10.4) 100.0 (-12.6)
mastermind_06_08_03-0002 100.0 (-10.5) 0.0 (51.4) 100.0 (-10.5) 99.9 (-10.6) 100.0 (-10.5)
mastermind_06_08_03-0003 100.0 (-11.2) 0.0 (33.5) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2)
mastermind_06_08_03-0005 100.0 (-11.9) 0.0 (10.4) 100.0 (-11.9) 87.0 (-9.0) 100.0 (-11.9)
mastermind_06_08_03-0009 100.0 (-8.4) 0.0 (98.2) 100.0 (-8.4) 97.2 (-11.3) 100.0 (-8.3)
mastermind_06_08_03-0011 100.0 (-4.7) 0.0 (148.5) 99.8 (-5.0) 98.5 (-7.0) 99.4 (-5.6)
mastermind_06_08_03-0012 100.0 (-5.9) 0.0 (149.4) 100.0 (-5.9) 96.6 (-11.1) 99.9 (-5.8)
mastermind_06_08_03-0014 100.0 (-6.3) 0.0 (149.4) 100.0 (-6.3) 95.7 (-12.9) 99.9 (-6.2)
mastermind_06_08_03-0015 100.0 (-7.7) 0.0 (148.8) 99.8 (-7.4) 96.3 (-13.6) 99.9 (-7.7)
mastermind_10_08_03-0001 100.0 (-13.6) 0.0 (52.8) 100.0 (-13.6) 100.0 (-13.6) 100.0 (-13.6)
mastermind_10_08_03-0003 100.0 (-15.5) 0.0 (52.3) 100.0 (-15.5) 99.6 (-15.2) 100.0 (-15.6)
mastermind_10_08_03-0004 100.0 (-16.5) 0.0 (26.0) 100.0 (-16.5) 95.7 (-14.7) 100.0 (-16.5)
mastermind_10_08_03-0008 100.0 (-23.2) 0.0 (-13.4) 100.0 (-23.2) 78.3 (-25.4) 100.0 (-23.2)
mastermind_10_08_03-0009 100.0 (-17.8) 0.0 (17.5) 100.0 (-17.8) 88.1 (-22.0) 89.0 (-21.7)
mastermind_10_08_03-0010 100.0 (-10.1) 0.0 (112.8) 100.0 (-10.1) 98.9 (-11.5) 99.8 (-9.9)
myciel5g_3.wcsp 99.4 (-61.7) 0.0 (14.3) 96.3 (-58.4) 44.3 (-19.1) 94.6 (-57.2)
myciel5g_4.wcsp 98.8 (-8.4) 0.0 (22.5) 79.5 (-1.8) 73.3 (0.1) 50.7 (7.0)
or_chain_1.fg 94.3 (-11.1) 0.0 (-4.5) 91.4 (-11.3) 91.1 (-11.3) 93.1 (-11.2)
or_chain_102.fg 94.1 (-10.3) 0.0 (-4.9) 94.0 (-10.4) 88.5 (-10.6) 92.6 (-10.4)
or_chain_106.fg 95.3 (-10.4) 0.0 (-3.4) 95.5 (-10.4) 91.9 (-10.6) 93.7 (-10.5)
or_chain_107.fg 99.0 (-11.5) 0.0 (-4.2) 99.2 (-11.6) 95.7 (-11.9) 97.7 (-11.7)
or_chain_12.fg 95.8 (-12.5) 0.0 (-5.1) 97.1 (-12.4) 85.0 (-13.3) 95.5 (-12.6)
or_chain_128.fg 96.7 (-11.2) 0.0 (-2.9) 92.0 (-11.6) 89.3 (-11.8) 96.4 (-11.2)
or_chain_132.fg 99.9 (-8.4) 0.0 (-2.2) 97.5 (-8.6) 100.0 (-8.4) 100.0 (-8.4)
or_chain_138.fg 99.6 (-10.0) 0.0 (-1.8) 99.7 (-10.1) 99.9 (-10.1) 100.0 (-10.1)
or_chain_140.fg 77.0 (-6.9) 0.0 (0.4) 97.3 (-5.4) 89.7 (-6.2) 93.9 (-5.9)
or_chain_149.fg 100.0 (-8.6) 0.0 (-1.4) 99.9 (-8.6) 99.9 (-8.6) 100.0 (-8.6)
or_chain_15.fg 99.0 (-11.8) 0.0 (-4.7) 99.6 (-11.8) 99.3 (-11.9) 99.8 (-11.9)
or_chain_150.fg 99.7 (-7.3) 0.0 (-3.5) 93.1 (-7.5) 96.9 (-7.4) 99.5 (-7.3)
or_chain_153.fg 100.0 (-8.7) 0.0 (-1.8) 95.6 (-9.0) 95.5 (-9.0) 99.4 (-8.7)
or_chain_155.fg 100.0 (-9.9) 0.0 (-3.4) 100.0 (-9.9) 99.0 (-10.0) 99.9 (-9.9)
or_chain_161.fg 99.5 (-9.2) 0.0 (-3.2) 97.2 (-9.4) 93.4 (-9.6) 99.7 (-9.3)
or_chain_186.fg 99.9 (-9.5) 0.0 (-5.6) 99.4 (-9.5) 95.9 (-9.6) 99.1 (-9.5)
or_chain_188.fg 100.0 (-12.3) 0.0 (-5.4) 99.2 (-12.3) 95.1 (-12.7) 100.0 (-12.3)
or_chain_198.fg 99.9 (-4.3) 0.0 (1.3) 81.3 (-3.3) 99.9 (-4.3) 100.0 (-4.3)
or_chain_209.fg 99.9 (-11.5) 0.0 (-4.6) 98.9 (-11.5) 98.2 (-11.6) 100.0 (-11.5)
or_chain_242.fg 99.9 (-5.3) 0.0 (2.4) 99.9 (-5.4) 98.4 (-5.5) 98.9 (-5.4)
or_chain_4.fg 100.0 (-11.7) 0.0 (-4.9) 97.7 (-11.9) 95.8 (-12.0) 99.5 (-11.8)
or_chain_53.fg 100.0 (-9.2) 0.0 (-1.0) 86.8 (-8.1) 100.0 (-9.2) 100.0 (-9.2)
or_chain_61.fg 100.0 (-8.0) 0.0 (-2.3) 88.0 (-7.3) 96.8 (-8.2) 97.2 (-8.2)
or_chain_64.fg 100.0 (-8.8) 0.0 (-1.7) 90.3 (-8.2) 92.8 (-9.4) 100.0 (-8.8)
or_chain_90.fg 95.3 (-8.8) 0.0 (-2.1) 94.2 (-8.9) 85.0 (-9.5) 95.3 (-8.8)
pedigree51 95.0 (-73.9) 0.0 (-9.0) 95.1 (-73.9) 99.2 (-76.7) 94.6 (-73.6)
queen5_5_3.wcsp 99.2 (-113.9) 0.0 (7.7) 96.3 (-108.6) 19.8 (-16.2) 99.9 (-113.1)
queen5_5_4.wcsp 95.3 (-48.5) 0.0 (12.1) 97.8 (-44.4) 29.4 (-4.9) 83.4 (-36.1)
rus2_20_40_0_1 99.9 (106.9) 0.0 (161.5) 99.9 (107.0) 100.0 (106.9) 100.0 (106.9)
rus2_20_40_0_2 99.9 (120.6) 0.0 (171.9) 99.7 (120.8) 100.0 (120.6) 100.0 (120.6)
rus2_20_40_0_3 99.9 (88.2) 0.0 (143.3) 99.9 (88.2) 100.0 (88.2) 100.0 (88.2)
rus2_20_40_1_1 100.0 (107.4) 0.0 (171.6) 100.0 (107.4) 100.0 (107.4) 100.0 (107.4)
rus2_20_40_1_2 100.0 (104.5) 0.0 (166.3) 99.9 (104.5) 100.0 (104.5) 100.0 (104.5)
rus2_20_40_1_3 99.9 (101.6) 0.0 (175.5) 98.4 (102.8) 99.9 (101.7) 99.9 (101.7)
rus2_20_40_2_1 99.4 (119.0) 0.0 (175.7) 99.7 (119.4) 99.9 (119.2) 99.3 (119.7)
rus2_20_40_2_2 98.9 (118.0) 0.0 (174.5) 98.5 (119.4) 100.0 (118.6) 98.8 (119.2)
rus2_20_40_2_3 99.9 (112.3) 0.0 (176.5) 100.0 (112.4) 97.6 (110.9) 99.8 (112.6)
rus2_20_40_3_1 99.7 (110.0) 0.0 (172.9) 99.4 (110.6) 99.2 (109.6) 100.0 (110.2)
rus2_20_40_3_2 99.6 (140.9) 0.0 (206.1) 99.8 (141.1) 97.6 (139.6) 97.6 (139.7)
rus2_20_40_3_3 99.9 (123.5) 0.0 (191.3) 99.9 (123.5) 99.3 (123.1) 99.1 (124.1)
rus2_20_40_4_1 100.0 (99.2) 0.0 (162.8) 99.9 (99.1) 100.0 (99.2) 100.0 (99.2)
rus2_20_40_4_2 100.0 (107.0) 0.0 (163.6) 99.9 (107.1) 100.0 (107.1) 100.0 (107.1)
rus2_20_40_4_3 100.0 (95.2) 0.0 (162.9) 100.0 (95.2) 100.0 (95.2) 100.0 (95.2)
rus2_20_40_5_1 99.9 (95.4) 0.0 (154.3) 99.8 (95.6) 91.2 (90.3) 94.7 (92.3)
rus2_20_40_5_2 99.3 (87.8) 0.0 (160.9) 100.0 (88.4) 99.9 (88.2) 98.8 (89.2)
rus2_20_40_5_3 99.9 (169.9) 0.0 (227.4) 99.3 (170.3) 100.0 (169.9) 100.0 (169.9)
rus2_20_40_6_1 99.8 (119.3) 0.0 (182.2) 99.6 (119.4) 95.2 (116.1) 95.3 (116.1)
rus2_20_40_6_2 100.0 (68.4) 0.0 (132.5) 99.8 (68.2) 100.0 (68.3) 100.0 (68.4)
rus2_20_40_6_3 99.9 (134.2) 0.0 (199.1) 99.9 (134.2) 100.0 (134.1) 100.0 (134.1)
rus2_20_40_7_1 100.0 (88.5) 0.0 (151.9) 99.0 (89.1) 100.0 (88.5) 100.0 (88.5)
rus2_20_40_7_2 100.0 (111.6) 0.0 (168.5) 99.7 (111.4) 100.0 (111.5) 100.0 (111.5)
rus2_20_40_7_3 100.0 (81.4) 0.0 (141.3) 100.0 (81.5) 100.0 (81.4) 100.0 (81.4)
rus2_20_40_8_1 99.9 (107.0) 0.0 (178.4) 99.9 (107.0) 95.1 (103.4) 100.0 (106.9)
rus2_20_40_8_2 99.9 (99.9) 0.0 (164.7) 99.8 (99.7) 99.9 (99.8) 99.9 (99.9)
rus2_20_40_8_3 99.9 (100.5) 0.0 (168.4) 100.0 (100.6) 100.0 (100.6) 99.5 (100.9)
rus2_20_40_9_1 100.0 (94.5) 0.0 (167.2) 100.0 (94.6) 100.0 (94.5) 100.0 (94.5)
rus2_20_40_9_2 100.0 (94.6) 0.0 (171.3) 99.8 (94.5) 100.0 (94.6) 100.0 (94.6)
rus2_20_40_9_3 99.9 (63.7) 0.0 (139.1) 99.9 (63.6) 99.9 (63.5) 99.9 (63.5)
rus_20_40_0_1 99.9 (617.5) 0.0 (828.0) 100.0 (617.3) 100.0 (617.3) 100.0 (617.3)
rus_20_40_0_2 100.0 (791.6) 0.0 (988.1) 97.9 (795.7) 100.0 (791.6) 100.0 (791.6)
rus_20_40_0_3 100.0 (903.0) 0.0 (1097.8) 99.5 (904.0) 98.8 (905.3) 100.0 (903.0)
rus_20_40_1_1 97.2 (999.7) 0.0 (1185.5) 100.0 (1004.7) 99.5 (1003.8) 100.0 (1004.6)
rus_20_40_1_2 99.4 (911.4) 0.0 (1097.2) 100.0 (910.2) 100.0 (910.1) 94.7 (920.2)
rus_20_40_1_3 95.5 (891.8) 0.0 (1097.9) 99.5 (901.6) 100.0 (900.6) 95.9 (892.7)
rus_20_40_2_1 97.4 (792.8) 0.0 (992.4) 100.0 (797.8) 99.6 (797.0) 94.9 (807.8)
rus_20_40_2_2 91.1 (671.7) 0.0 (886.0) 97.6 (684.5) 100.0 (689.3) 99.5 (688.3)
rus_20_40_2_3 93.8 (736.3) 0.0 (958.8) 100.0 (749.3) 100.0 (749.3) 100.0 (749.3)
rus_20_40_3_1 99.8 (825.5) 0.0 (1017.6) 99.1 (827.6) 100.0 (825.8) 99.6 (825.1)
rus_20_40_3_2 99.9 (838.9) 0.0 (1027.8) 99.7 (839.6) 99.9 (838.8) 99.8 (838.6)
rus_20_40_3_3 95.2 (832.9) 0.0 (1028.2) 99.7 (842.6) 99.9 (841.7) 99.8 (841.5)
rus_20_40_4_1 99.5 (930.6) 0.0 (1113.8) 100.0 (931.5) 95.2 (922.7) 100.0 (931.5)
rus_20_40_4_2 99.7 (935.2) 0.0 (1119.3) 99.8 (936.2) 99.3 (934.4) 99.3 (934.4)
rus_20_40_4_3 95.2 (843.6) 0.0 (1054.6) 100.0 (853.3) 100.0 (853.3) 91.1 (871.1)
rus_20_40_5_1 100.0 (875.9) 0.0 (1059.6) 99.6 (876.6) 99.9 (875.7) 99.8 (875.5)
rus_20_40_5_2 97.9 (835.6) 0.0 (1031.4) 99.8 (840.0) 100.0 (839.7) 100.0 (839.7)
rus_20_40_5_3 98.6 (879.0) 0.0 (1088.9) 98.7 (884.7) 98.5 (878.8) 98.5 (878.8)
rus_20_40_6_1 99.9 (724.0) 0.0 (935.5) 100.0 (723.9) 19.5 (894.2) 99.2 (725.6)
rus_20_40_6_2 97.3 (977.4) 0.0 (1166.7) 100.0 (982.4) 99.5 (981.6) 100.0 (982.4)
rus_20_40_6_3 94.7 (956.9) 0.0 (1152.7) 100.0 (966.7) 100.0 (966.7) 96.7 (960.6)
rus_20_40_7_1 100.0 (752.1) 0.0 (943.8) 99.9 (752.3) 100.0 (752.1) 98.6 (754.8)
rus_20_40_7_2 98.7 (753.6) 0.0 (951.7) 99.5 (757.2) 99.4 (755.0) 99.4 (755.0)
rus_20_40_7_3 97.5 (864.9) 0.0 (1064.6) 100.0 (869.7) 100.0 (869.7) 100.0 (869.7)
rus_20_40_8_1 97.5 (721.8) 0.0 (931.5) 99.6 (727.6) 70.8 (786.7) 99.4 (725.6)
rus_20_40_8_2 97.3 (893.7) 0.0 (1083.3) 100.0 (898.7) 99.6 (897.8) 100.0 (898.6)
rus_20_40_8_3 96.3 (696.8) 0.0 (895.8) 100.0 (703.8) 100.0 (703.8) 98.9 (701.8)
rus_20_40_9_1 100.0 (866.6) 0.0 (1047.2) 100.0 (866.6) 90.5 (849.4) 99.2 (868.1)
rus_20_40_9_2 100.0 (834.5) 0.0 (1045.8) 100.0 (834.5) 100.0 (834.5) 94.9 (823.8)
rus_20_40_9_3 99.3 (865.3) 0.0 (1052.3) 100.0 (864.0) 99.6 (863.2) 94.7 (874.0)

3600sec

Problem AbstractionSampling baseline ibia-pr lbp-pr uai14-pr
1a7w 100.0 (-1.0) 0.0 (0.9) 100.0 (-1.0) 100.0 (-1.0) 100.0 (-1.0)
1aie 100.0 (2.8) 0.0 (2.9) 100.0 (2.8) 100.0 (2.8) 100.0 (2.8)
1b2v 100.0 (-53.4) 0.0 (-46.7) 100.0 (-53.4) 100.0 (-53.4) 100.0 (-53.4)
1bxv 0.0 (nan) 0.0 (-6.4) 100.0 (-9.7) 100.0 (-9.7) 100.0 (-9.7)
1cpq 100.0 (-21.7) 0.0 (-15.9) 100.0 (-21.7) 99.9 (-21.7) 100.0 (-21.7)
1ctj 100.0 (-13.3) 0.0 (-9.8) 100.0 (-13.3) 100.0 (-13.3) 100.0 (-13.3)
1cxy 100.0 (-38.0) 0.0 (-30.7) 100.0 (-38.0) 100.0 (-38.0) 100.0 (-38.0)
1f94 100.0 (-61.4) 0.0 (-59.5) 100.0 (-61.4) 99.7 (-61.4) 100.0 (-61.4)
1fas 100.0 (-33.3) 0.0 (-32.2) 100.0 (-33.3) 100.0 (-33.3) 100.0 (-33.3)
1g6x 100.0 (-27.2) 0.0 (-24.3) 100.0 (-27.2) 100.0 (-27.2) 100.0 (-27.2)
1jer 100.0 (-31.5) 0.0 (-21.1) 100.0 (-31.5) 100.0 (-31.5) 100.0 (-31.5)
1kp6 0.0 (nan) 0.0 (-39.2) 100.0 (-45.1) 100.0 (-45.1) 100.0 (-45.1)
1nkd 0.0 (nan) 0.0 (-4.9) 100.0 (-8.8) 100.0 (-8.8) 100.0 (-8.8)
1npl 100.0 (-42.9) 0.0 (-30.8) 100.0 (-42.9) 100.0 (-42.9) 100.0 (-42.9)
1qt9 99.9 (-59.7) 0.0 (-39.2) 100.0 (-59.7) 100.0 (-59.7) 100.0 (-59.7)
1rfs 100.0 (-50.6) 0.0 (-23.7) 100.0 (-50.6) 100.0 (-50.6) 100.0 (-50.6)
1svy 100.0 (-38.6) 0.0 (-29.3) 100.0 (-38.6) 100.0 (-38.6) 100.0 (-38.6)
1vfy 100.0 (-20.1) 0.0 (-18.1) 100.0 (-20.1) 100.0 (-20.1) 100.0 (-20.1)
2rta 100.0 (-55.2) 0.0 (-38.3) 100.0 (-55.2) 100.0 (-55.2) 100.0 (-55.2)
BN_12 100.0 (-3.6) 0.0 (-0.3) 100.0 (-3.6) 99.9 (-3.6) 100.0 (-3.6)
BN_13 100.0 (-2.3) 0.0 (2.5) 100.0 (-2.3) 100.0 (-2.3) 100.0 (-2.3)
BN_15 100.0 (-5.7) 0.0 (-1.0) 100.0 (-5.7) 100.0 (-5.7) 100.0 (-5.7)
BN_31 100.0 (-11.0) 0.0 (116.3) 100.0 (-11.0) 99.8 (-11.2) 100.0 (-11.0)
BN_74 100.0 (-0.0) 0.0 (153.5) 100.0 (0.0) 99.6 (0.7) 100.0 (0.0)
blockmap_10_01-0006 100.0 (-1.1) 0.0 (94.8) 100.0 (-1.0) 74.4 (23.5) 100.0 (-1.0)
blockmap_10_01-0009 100.0 (-1.0) 0.0 (3.6) 100.0 (-1.0) 0.0 (5.2) 100.0 (-1.0)
blockmap_10_02-0009 100.0 (-2.2) 0.0 (11.9) 100.0 (-2.2) 40.1 (6.2) 100.0 (-2.2)
blockmap_10_03-0009 100.0 (-3.2) 0.0 (-1.1) 100.0 (-3.2) 0.0 (0.0) 100.0 (-3.2)
blockmap_10_03-0010 100.0 (-2.9) 0.0 (8.6) 100.0 (-2.9) 18.4 (6.5) 100.0 (-2.9)
blockmap_15_01-0008 100.0 (-1.2) 0.0 (-1.2) 100.0 (-1.2) 0.0 (23.5) 100.0 (-1.2)
blockmap_15_02-0008 100.0 (-2.4) 0.0 (-1.9) 100.0 (-2.4) 0.0 (11.4) 100.0 (-2.4)
blockmap_15_03-0008 100.0 (-3.2) 0.0 (30.0) 100.0 (-3.2) 92.3 (-0.6) 91.7 (-0.5)
blockmap_15_03-0010 100.0 (-3.1) 0.0 (-2.9) 100.0 (-3.1) 0.0 (39.4) 100.0 (-3.1)
blockmap_20_01-0009 100.0 (-1.3) 0.0 (-1.3) 100.0 (-1.3) 0.0 (14.3) 100.0 (-1.3)
blockmap_20_02-0009 100.0 (-2.6) 0.0 (-2.3) 0.0 (nan) 0.0 (2.7) 0.0 (168.0)
blockmap_20_03-0010 100.0 (-4.0) 0.0 (-3.3) 0.0 (nan) 0.0 (-18.1) 0.0 (131.2)
blockmap_22_01-0006 100.0 (-1.3) 0.0 (-1.3) 0.0 (nan) 0.0 (26.6) 0.0 (449.1)
blockmap_22_03-0009 100.0 (-4.1) 0.0 (-3.6) 0.0 (nan) 0.0 (-56.3) 0.0 (-242.5)
bwt3ac.wcsp 99.9 (0.0) 0.0 (11.7) 100.0 (0.0) 76.8 (-2.7) 100.0 (0.0)
fs-07 100.0 (-14.8) 0.0 (-6.4) 92.8 (-14.1) 10.5 (-22.2) 100.0 (-14.8)
mastermind_03_08_04-0000 100.0 (0.0) 0.0 (249.0) 100.0 (0.0) 100.0 (-0.0) 100.0 (0.0)
mastermind_03_08_04-0001 100.0 (-12.7) 0.0 (86.6) 100.0 (-12.7) 100.0 (-12.7) 100.0 (-12.7)
mastermind_03_08_04-0002 100.0 (-14.5) 0.0 (63.9) 100.0 (-14.5) 99.4 (-14.0) 100.0 (-14.5)
mastermind_03_08_04-0003 100.0 (-11.5) 0.0 (119.0) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5)
mastermind_03_08_04-0007 100.0 (-16.6) 0.0 (86.6) 100.0 (-16.6) 98.4 (-14.9) 100.0 (-16.6)
mastermind_03_08_04-0008 100.0 (-16.3) 0.0 (33.9) 100.0 (-16.3) 99.6 (-16.1) 100.0 (-16.3)
mastermind_03_08_04-0010 100.0 (-14.5) 0.0 (149.5) 100.0 (-14.5) 99.0 (-16.1) 100.0 (-14.5)
mastermind_03_08_04-0011 100.0 (-9.7) 0.0 (233.0) 99.7 (-10.5) 96.3 (-18.6) 90.9 (12.5)
mastermind_03_08_04-0012 99.9 (-8.0) 0.0 (234.5) 99.9 (-7.8) 97.0 (-15.4) 96.3 (0.9)
mastermind_03_08_04-0013 99.9 (-8.4) 0.0 (233.5) 100.0 (-8.7) 96.5 (-17.0) 99.2 (-6.6)
mastermind_03_08_04-0014 99.5 (-10.1) 0.0 (233.3) 99.9 (-9.1) 96.3 (-17.8) 92.1 (10.3)
mastermind_03_08_04-0015 99.9 (-7.9) 0.0 (234.0) 100.0 (-8.1) 96.0 (-17.8) 99.6 (-7.0)
mastermind_03_08_05-0000 99.5 (-2.2) 0.0 (409.8) 100.0 (0.0) 100.0 (-0.0) 100.0 (0.0)
mastermind_03_08_05-0001 100.0 (-15.5) 0.0 (203.4) 100.0 (-15.4) 99.9 (-15.2) 100.0 (-15.4)
mastermind_03_08_05-0003 100.0 (-15.1) 0.0 (171.6) 100.0 (-15.1) 100.0 (-15.1) 100.0 (-15.1)
mastermind_03_08_05-0004 100.0 (-14.2) 0.0 (227.8) 100.0 (-14.2) 99.9 (-13.9) 100.0 (-14.3)
mastermind_03_08_05-0008 99.8 (-15.3) 0.0 (310.5) 100.0 (-14.6) 98.3 (-20.3) 100.0 (-14.6)
mastermind_03_08_05-0009 100.0 (-21.5) 0.0 (27.9) 100.0 (-21.5) 89.3 (-16.2) 100.0 (-21.5)
mastermind_03_08_05-0011 0.0 (-inf) 0.0 (390.4) 99.4 (-12.6) 98.3 (-16.9) 93.3 (16.8)
mastermind_03_08_05-0012 0.0 (-inf) 0.0 (392.2) 99.9 (-9.5) 96.8 (-22.0) 99.9 (-9.5)
mastermind_03_08_05-0013 0.0 (-inf) 0.0 (390.4) 99.9 (-9.4) 96.1 (-24.5) 99.8 (-8.1)
mastermind_03_08_05-0014 0.0 (-inf) 0.0 (392.9) 100.0 (-9.2) 97.1 (-20.6) 98.0 (-1.2)
mastermind_03_08_05-0015 0.0 (-inf) 0.0 (390.2) 99.9 (-9.5) 95.9 (-26.6) 98.7 (-4.9)
mastermind_04_08_03-0000 100.0 (0.0) 0.0 (139.3) 100.0 (0.0) 100.0 (-0.0) 100.0 (-0.0)
mastermind_04_08_03-0011 100.0 (-4.7) 0.0 (128.2) 100.0 (-4.7) 97.7 (-7.7) 100.0 (-4.7)
mastermind_04_08_03-0012 100.0 (-6.0) 0.0 (128.5) 100.0 (-6.0) 95.8 (-11.7) 100.0 (-6.0)
mastermind_04_08_03-0013 100.0 (-7.2) 0.0 (127.0) 100.0 (-7.2) 97.2 (-10.9) 100.0 (-7.2)
mastermind_04_08_03-0014 100.0 (-6.5) 0.0 (127.4) 100.0 (-6.5) 97.7 (-9.6) 100.0 (-6.5)
mastermind_04_08_03-0015 100.0 (-7.1) 0.0 (128.4) 100.0 (-7.1) 95.7 (-12.8) 100.0 (-7.1)
mastermind_04_08_04-0000 99.9 (-0.2) 0.0 (274.2) 100.0 (0.0) 100.0 (-0.0) 100.0 (0.0)
mastermind_04_08_04-0001 100.0 (-11.7) 0.0 (97.0) 100.0 (-11.7) 99.7 (-11.3) 100.0 (-11.7)
mastermind_04_08_04-0002 100.0 (-12.1) 0.0 (127.4) 100.0 (-12.1) 100.0 (-12.1) 100.0 (-12.1)
mastermind_04_08_04-0003 100.0 (-13.6) 0.0 (107.7) 100.0 (-13.6) 100.0 (-13.6) 100.0 (-13.6)
mastermind_04_08_04-0004 100.0 (-11.2) 0.0 (143.1) 100.0 (-11.2) 99.8 (-10.9) 100.0 (-11.2)
mastermind_04_08_04-0005 100.0 (-15.9) 0.0 (79.4) 100.0 (-15.9) 99.7 (-15.6) 100.0 (-15.9)
mastermind_04_08_04-0011 99.8 (-7.9) 0.0 (258.0) 100.0 (-8.3) 97.0 (-16.3) 98.8 (-5.2)
mastermind_04_08_04-0012 99.6 (-9.1) 0.0 (259.5) 100.0 (-8.0) 96.9 (-16.2) 94.3 (7.3)
mastermind_04_08_04-0013 0.0 (-inf) 0.0 (259.1) 99.7 (-7.9) 97.7 (-13.3) 98.8 (-4.0)
mastermind_04_08_04-0014 0.0 (-inf) 0.0 (259.1) 99.9 (-9.0) 97.8 (-14.7) 96.9 (-0.6)
mastermind_04_08_04-0015 0.0 (-inf) 0.0 (260.0) 100.0 (-7.7) 96.5 (-17.0) 99.9 (-8.1)
mastermind_05_08_03-0000 100.0 (0.0) 0.0 (150.1) 100.0 (0.0) 100.0 (-0.0) 100.0 (0.0)
mastermind_05_08_03-0001 100.0 (-9.8) 0.0 (58.1) 100.0 (-9.8) 100.0 (-9.8) 100.0 (-9.8)
mastermind_05_08_03-0002 100.0 (-12.2) 0.0 (43.8) 100.0 (-12.2) 100.0 (-12.2) 100.0 (-12.2)
mastermind_05_08_03-0003 100.0 (-8.6) 0.0 (70.9) 100.0 (-8.6) 100.0 (-8.6) 100.0 (-8.6)
mastermind_05_08_03-0004 100.0 (-11.6) 0.0 (43.9) 100.0 (-11.6) 100.0 (-11.6) 100.0 (-11.6)
mastermind_05_08_03-0009 100.0 (-8.0) 0.0 (98.9) 100.0 (-8.0) 96.6 (-11.6) 100.0 (-8.0)
mastermind_05_08_03-0011 100.0 (-6.2) 0.0 (139.6) 100.0 (-6.2) 94.9 (-13.5) 100.0 (-6.2)
mastermind_05_08_03-0012 100.0 (-7.6) 0.0 (138.7) 100.0 (-7.6) 95.1 (-14.8) 100.0 (-7.6)
mastermind_05_08_03-0013 100.0 (-6.6) 0.0 (138.8) 100.0 (-6.6) 97.1 (-10.8) 100.0 (-6.6)
mastermind_05_08_03-0014 100.0 (-4.9) 0.0 (139.5) 100.0 (-4.9) 96.6 (-9.8) 100.0 (-4.9)
mastermind_05_08_03-0015 100.0 (-6.3) 0.0 (140.2) 100.0 (-6.3) 95.4 (-13.0) 100.0 (-6.3)
mastermind_06_08_03-0000 100.0 (0.0) 0.0 (160.4) 100.0 (0.0) 100.0 (-0.0) 100.0 (-0.0)
mastermind_06_08_03-0001 100.0 (-12.6) 0.0 (18.6) 100.0 (-12.6) 92.8 (-10.4) 100.0 (-12.6)
mastermind_06_08_03-0002 100.0 (-10.5) 0.0 (51.4) 100.0 (-10.5) 99.9 (-10.6) 100.0 (-10.5)
mastermind_06_08_03-0003 100.0 (-11.2) 0.0 (33.5) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2)
mastermind_06_08_03-0005 100.0 (-11.9) 0.0 (10.4) 100.0 (-11.9) 87.0 (-9.0) 100.0 (-11.9)
mastermind_06_08_03-0009 100.0 (-8.4) 0.0 (98.2) 100.0 (-8.4) 97.2 (-11.3) 100.0 (-8.4)
mastermind_06_08_03-0011 100.0 (-4.7) 0.0 (148.5) 99.8 (-5.0) 98.5 (-7.0) 99.7 (-5.2)
mastermind_06_08_03-0012 100.0 (-5.9) 0.0 (149.4) 100.0 (-5.9) 96.6 (-11.1) 99.9 (-5.8)
mastermind_06_08_03-0014 100.0 (-6.3) 0.0 (149.4) 100.0 (-6.3) 95.7 (-12.9) 99.9 (-6.2)
mastermind_06_08_03-0015 100.0 (-7.7) 0.0 (148.8) 99.8 (-7.4) 96.3 (-13.6) 99.9 (-7.6)
mastermind_10_08_03-0001 100.0 (-13.7) 0.0 (52.8) 100.0 (-13.6) 100.0 (-13.6) 100.0 (-13.6)
mastermind_10_08_03-0003 100.0 (-15.6) 0.0 (52.3) 100.0 (-15.5) 99.6 (-15.2) 100.0 (-15.5)
mastermind_10_08_03-0004 100.0 (-16.5) 0.0 (26.0) 100.0 (-16.5) 95.7 (-14.7) 100.0 (-16.5)
mastermind_10_08_03-0008 100.0 (-23.2) 0.0 (-13.4) 100.0 (-23.2) 78.3 (-25.4) 100.0 (-23.2)
mastermind_10_08_03-0009 100.0 (-17.8) 0.0 (17.5) 100.0 (-17.8) 88.1 (-22.0) 89.0 (-21.7)
mastermind_10_08_03-0010 100.0 (-10.1) 0.0 (112.8) 100.0 (-10.1) 98.9 (-11.5) 99.8 (-9.9)
myciel5g_3.wcsp 97.4 (-63.1) 0.0 (14.3) 96.3 (-58.4) 44.3 (-19.1) 94.6 (-57.2)
myciel5g_4.wcsp 98.5 (-8.5) 0.0 (22.5) 79.5 (-1.8) 73.3 (0.1) 50.8 (7.0)
or_chain_1.fg 95.0 (-11.1) 0.0 (-4.5) 91.4 (-11.3) 91.1 (-11.3) 93.0 (-11.2)
or_chain_102.fg 94.1 (-10.3) 0.0 (-4.9) 94.0 (-10.4) 88.5 (-10.6) 91.6 (-10.5)
or_chain_106.fg 95.2 (-10.4) 0.0 (-3.4) 95.5 (-10.4) 91.9 (-10.6) 94.8 (-10.4)
or_chain_107.fg 99.9 (-11.6) 0.0 (-4.2) 99.2 (-11.6) 95.7 (-11.9) 99.4 (-11.6)
or_chain_12.fg 95.8 (-12.5) 0.0 (-5.1) 97.1 (-12.4) 85.0 (-13.3) 95.8 (-12.5)
or_chain_128.fg 96.3 (-11.2) 0.0 (-2.9) 92.0 (-11.6) 89.3 (-11.8) 96.2 (-11.2)
or_chain_132.fg 100.0 (-8.4) 0.0 (-2.2) 97.5 (-8.6) 100.0 (-8.4) 100.0 (-8.4)
or_chain_138.fg 100.0 (-10.1) 0.0 (-1.8) 99.7 (-10.1) 99.9 (-10.1) 100.0 (-10.1)
or_chain_140.fg 95.6 (-5.8) 0.0 (0.4) 97.3 (-5.4) 89.7 (-6.2) 91.7 (-6.0)
or_chain_149.fg 100.0 (-8.6) 0.0 (-1.4) 99.9 (-8.6) 99.9 (-8.6) 100.0 (-8.6)
or_chain_15.fg 99.9 (-11.9) 0.0 (-4.7) 99.6 (-11.8) 99.3 (-11.9) 99.9 (-11.9)
or_chain_150.fg 99.6 (-7.2) 0.0 (-3.5) 93.1 (-7.5) 96.9 (-7.4) 99.6 (-7.3)
or_chain_153.fg 100.0 (-8.7) 0.0 (-1.8) 95.6 (-9.0) 95.5 (-9.0) 100.0 (-8.7)
or_chain_155.fg 100.0 (-9.9) 0.0 (-3.4) 100.0 (-9.9) 99.0 (-10.0) 100.0 (-10.0)
or_chain_161.fg 99.6 (-9.3) 0.0 (-3.2) 97.2 (-9.4) 93.4 (-9.6) 100.0 (-9.2)
or_chain_186.fg 100.0 (-9.5) 0.0 (-5.6) 99.4 (-9.5) 95.9 (-9.6) 100.0 (-9.5)
or_chain_188.fg 100.0 (-12.3) 0.0 (-5.4) 99.2 (-12.3) 95.1 (-12.7) 100.0 (-12.3)
or_chain_198.fg 100.0 (-4.3) 0.0 (1.3) 81.3 (-3.3) 99.9 (-4.3) 100.0 (-4.3)
or_chain_209.fg 99.9 (-11.5) 0.0 (-4.6) 98.9 (-11.5) 98.2 (-11.6) 100.0 (-11.5)
or_chain_242.fg 99.9 (-5.3) 0.0 (2.4) 99.9 (-5.4) 98.4 (-5.5) 100.0 (-5.4)
or_chain_4.fg 100.0 (-11.7) 0.0 (-4.9) 97.7 (-11.9) 95.8 (-12.0) 98.6 (-11.6)
or_chain_53.fg 100.0 (-9.2) 0.0 (-1.0) 86.8 (-8.1) 100.0 (-9.2) 100.0 (-9.2)
or_chain_61.fg 99.2 (-8.0) 0.0 (-2.3) 88.0 (-7.3) 96.8 (-8.2) 97.1 (-8.2)
or_chain_64.fg 100.0 (-8.8) 0.0 (-1.7) 90.3 (-8.2) 92.8 (-9.4) 100.0 (-8.8)
or_chain_90.fg 95.3 (-8.8) 0.0 (-2.1) 94.2 (-8.9) 85.0 (-9.5) 95.3 (-8.8)
pedigree51 95.0 (-73.9) 0.0 (-9.0) 95.1 (-73.9) 99.2 (-76.7) 95.1 (-73.9)
queen5_5_3.wcsp 99.7 (-113.4) 0.0 (7.7) 96.3 (-108.6) 19.8 (-16.2) 100.0 (-113.0)
queen5_5_4.wcsp 98.8 (-46.4) 0.0 (12.1) 97.8 (-44.4) 29.4 (-4.9) 83.4 (-36.1)
rus2_20_40_0_1 100.0 (106.9) 0.0 (161.5) 99.9 (107.0) 100.0 (106.9) 99.9 (106.9)
rus2_20_40_0_2 100.0 (120.6) 0.0 (171.9) 99.7 (120.8) 100.0 (120.6) 99.9 (120.7)
rus2_20_40_0_3 100.0 (88.2) 0.0 (143.3) 99.9 (88.2) 100.0 (88.2) 100.0 (88.2)
rus2_20_40_1_1 100.0 (107.4) 0.0 (171.6) 100.0 (107.4) 100.0 (107.4) 100.0 (107.4)
rus2_20_40_1_2 100.0 (104.5) 0.0 (166.3) 99.9 (104.5) 100.0 (104.5) 100.0 (104.5)
rus2_20_40_1_3 100.0 (101.6) 0.0 (175.5) 98.4 (102.8) 99.9 (101.7) 99.9 (101.7)
rus2_20_40_2_1 99.2 (118.8) 0.0 (175.7) 99.7 (119.4) 99.9 (119.2) 99.7 (119.4)
rus2_20_40_2_2 97.4 (117.1) 0.0 (174.5) 98.5 (119.4) 100.0 (118.6) 100.0 (118.6)
rus2_20_40_2_3 99.9 (112.4) 0.0 (176.5) 100.0 (112.4) 97.6 (110.9) 97.6 (110.9)
rus2_20_40_3_1 99.8 (110.0) 0.0 (172.9) 99.4 (110.6) 99.2 (109.6) 99.3 (109.7)
rus2_20_40_3_2 100.0 (141.2) 0.0 (206.1) 99.8 (141.1) 97.6 (139.6) 97.6 (139.6)
rus2_20_40_3_3 99.7 (123.3) 0.0 (191.3) 99.9 (123.5) 99.3 (123.1) 99.3 (123.1)
rus2_20_40_4_1 100.0 (99.2) 0.0 (162.8) 99.9 (99.1) 100.0 (99.2) 100.0 (99.2)
rus2_20_40_4_2 100.0 (107.1) 0.0 (163.6) 99.9 (107.1) 100.0 (107.1) 100.0 (107.1)
rus2_20_40_4_3 100.0 (95.2) 0.0 (162.9) 100.0 (95.2) 100.0 (95.2) 100.0 (95.2)
rus2_20_40_5_1 100.0 (95.4) 0.0 (154.3) 99.8 (95.6) 91.2 (90.3) 91.2 (90.3)
rus2_20_40_5_2 100.0 (88.3) 0.0 (160.9) 100.0 (88.4) 99.9 (88.2) 99.8 (88.5)
rus2_20_40_5_3 100.0 (169.9) 0.0 (227.4) 99.3 (170.3) 100.0 (169.9) 100.0 (169.9)
rus2_20_40_6_1 99.9 (119.1) 0.0 (182.2) 99.6 (119.4) 95.2 (116.1) 95.2 (116.1)
rus2_20_40_6_2 100.0 (68.4) 0.0 (132.5) 99.8 (68.2) 100.0 (68.3) 100.0 (68.4)
rus2_20_40_6_3 100.0 (134.1) 0.0 (199.1) 99.9 (134.2) 100.0 (134.1) 100.0 (134.1)
rus2_20_40_7_1 100.0 (88.5) 0.0 (151.9) 99.0 (89.1) 100.0 (88.5) 99.9 (88.5)
rus2_20_40_7_2 100.0 (111.5) 0.0 (168.5) 99.7 (111.4) 100.0 (111.5) 100.0 (111.5)
rus2_20_40_7_3 100.0 (81.4) 0.0 (141.3) 100.0 (81.5) 100.0 (81.4) 100.0 (81.4)
rus2_20_40_8_1 100.0 (106.9) 0.0 (178.4) 99.9 (107.0) 95.1 (103.4) 95.1 (103.4)
rus2_20_40_8_2 100.0 (99.9) 0.0 (164.7) 99.8 (99.7) 99.9 (99.8) 99.9 (99.8)
rus2_20_40_8_3 99.9 (100.5) 0.0 (168.4) 100.0 (100.6) 100.0 (100.6) 100.0 (100.6)
rus2_20_40_9_1 100.0 (94.5) 0.0 (167.2) 100.0 (94.6) 100.0 (94.5) 100.0 (94.5)
rus2_20_40_9_2 100.0 (94.6) 0.0 (171.3) 99.8 (94.5) 100.0 (94.6) 100.0 (94.6)
rus2_20_40_9_3 99.9 (63.6) 0.0 (139.1) 99.9 (63.6) 99.9 (63.5) 99.9 (63.6)
rus_20_40_0_1 100.0 (617.4) 0.0 (828.0) 100.0 (617.3) 100.0 (617.3) 100.0 (617.3)
rus_20_40_0_2 100.0 (791.6) 0.0 (988.1) 97.9 (795.7) 100.0 (791.6) 100.0 (791.6)
rus_20_40_0_3 100.0 (903.0) 0.0 (1097.8) 99.5 (904.0) 57.0 (986.8) 96.5 (896.2)
rus_20_40_1_1 97.4 (999.9) 0.0 (1185.5) 100.0 (1004.7) 99.5 (1003.8) 99.5 (1003.8)
rus_20_40_1_2 97.4 (905.4) 0.0 (1097.2) 100.0 (910.2) 100.0 (910.1) 100.0 (910.1)
rus_20_40_1_3 95.4 (891.5) 0.0 (1097.9) 99.5 (901.6) 100.0 (900.6) 98.1 (896.8)
rus_20_40_2_1 97.4 (792.8) 0.0 (992.4) 100.0 (797.8) 99.6 (797.0) 99.6 (797.0)
rus_20_40_2_2 97.2 (683.8) 0.0 (886.0) 97.6 (684.5) 100.0 (689.3) 100.0 (689.3)
rus_20_40_2_3 93.8 (736.4) 0.0 (958.8) 100.0 (749.3) 100.0 (749.3) 100.0 (749.3)
rus_20_40_3_1 99.7 (825.4) 0.0 (1017.6) 99.1 (827.6) 100.0 (825.8) 100.0 (825.8)
rus_20_40_3_2 99.7 (838.4) 0.0 (1027.8) 99.7 (839.6) 99.9 (838.8) 99.9 (838.8)
rus_20_40_3_3 99.8 (841.6) 0.0 (1028.2) 99.7 (842.6) 99.9 (841.7) 99.9 (841.7)
rus_20_40_4_1 99.6 (930.7) 0.0 (1113.8) 100.0 (931.5) 95.2 (922.7) 95.2 (922.7)
rus_20_40_4_2 99.5 (934.9) 0.0 (1119.3) 99.8 (936.2) 99.3 (934.4) 99.3 (934.4)
rus_20_40_4_3 96.7 (846.6) 0.0 (1054.6) 100.0 (853.3) 100.0 (853.3) 96.2 (845.6)
rus_20_40_5_1 99.8 (875.5) 0.0 (1059.6) 99.6 (876.6) 99.9 (875.7) 99.9 (875.7)
rus_20_40_5_2 97.9 (835.5) 0.0 (1031.4) 99.8 (840.0) 100.0 (839.7) 100.0 (839.7)
rus_20_40_5_3 98.4 (878.6) 0.0 (1088.9) 98.7 (884.7) 98.5 (878.8) 98.5 (878.8)
rus_20_40_6_1 100.0 (723.9) 0.0 (935.5) 100.0 (723.9) 89.6 (745.8) 99.9 (723.6)
rus_20_40_6_2 97.3 (977.4) 0.0 (1166.7) 100.0 (982.4) 99.5 (981.6) 99.5 (981.6)
rus_20_40_6_3 96.7 (960.7) 0.0 (1152.7) 100.0 (966.7) 100.0 (966.7) 100.0 (966.7)
rus_20_40_7_1 100.0 (752.1) 0.0 (943.8) 99.9 (752.3) 100.0 (752.1) 100.0 (752.1)
rus_20_40_7_2 98.5 (753.3) 0.0 (951.7) 99.5 (757.2) 99.4 (755.0) 99.4 (755.0)
rus_20_40_7_3 97.5 (864.9) 0.0 (1064.6) 100.0 (869.7) 100.0 (869.7) 100.0 (869.7)
rus_20_40_8_1 99.8 (726.6) 0.0 (931.5) 99.6 (727.6) 92.3 (742.6) 98.6 (729.8)
rus_20_40_8_2 97.3 (893.7) 0.0 (1083.3) 100.0 (898.7) 99.6 (897.8) 99.6 (897.8)
rus_20_40_8_3 96.3 (696.8) 0.0 (895.8) 100.0 (703.8) 100.0 (703.8) 100.0 (703.8)
rus_20_40_9_1 100.0 (866.6) 0.0 (1047.2) 100.0 (866.6) 90.5 (849.4) 90.5 (849.4)
rus_20_40_9_2 100.0 (834.5) 0.0 (1045.8) 100.0 (834.5) 100.0 (834.5) 100.0 (834.5)
rus_20_40_9_3 99.7 (864.6) 0.0 (1052.3) 100.0 (864.0) 99.6 (863.2) 99.6 (863.2)

Updated: