The results below are organized as follows:

  • each table displays the solver’s performance for individual problem instances for the given task under different time limits
  • table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria

PR

overall

Problem 20sec 1200sec 3600sec
1a7w 0.0 (0.9) 0.0 (0.9) 0.0 (0.9)
1aie 0.0 (2.9) 0.0 (2.9) 0.0 (2.9)
1b2v 0.0 (-46.7) 0.0 (-46.7) 0.0 (-46.7)
1bxv 0.0 (-6.4) 0.0 (-6.4) 0.0 (-6.4)
1cpq 0.0 (-15.9) 0.0 (-15.9) 0.0 (-15.9)
1ctj 0.0 (-9.8) 0.0 (-9.8) 0.0 (-9.8)
1cxy 0.0 (-30.7) 0.0 (-30.7) 0.0 (-30.7)
1f94 0.0 (-59.5) 0.0 (-59.5) 0.0 (-59.5)
1fas 0.0 (-32.2) 0.0 (-32.2) 0.0 (-32.2)
1g6x 0.0 (-24.3) 0.0 (-24.3) 0.0 (-24.3)
1jer 0.0 (-21.1) 0.0 (-21.1) 0.0 (-21.1)
1kp6 0.0 (-39.2) 0.0 (-39.2) 0.0 (-39.2)
1nkd 0.0 (-4.9) 0.0 (-4.9) 0.0 (-4.9)
1npl 0.0 (-30.8) 0.0 (-30.8) 0.0 (-30.8)
1qt9 0.0 (-39.2) 0.0 (-39.2) 0.0 (-39.2)
1rfs 0.0 (-23.7) 0.0 (-23.7) 0.0 (-23.7)
1svy 0.0 (-29.3) 0.0 (-29.3) 0.0 (-29.3)
1vfy 0.0 (-18.1) 0.0 (-18.1) 0.0 (-18.1)
2rta 0.0 (-38.3) 0.0 (-38.3) 0.0 (-38.3)
BN_12 0.0 (-0.3) 0.0 (-0.3) 0.0 (-0.3)
BN_13 0.0 (2.5) 0.0 (2.5) 0.0 (2.5)
BN_15 0.0 (-1.0) 0.0 (-1.0) 0.0 (-1.0)
BN_31 0.0 (116.3) 0.0 (116.3) 0.0 (116.3)
BN_74 0.0 (153.5) 0.0 (153.5) 0.0 (153.5)
blockmap_10_01-0006 0.0 (94.8) 0.0 (94.8) 0.0 (94.8)
blockmap_10_01-0009 0.0 (3.6) 0.0 (3.6) 0.0 (3.6)
blockmap_10_02-0009 0.0 (11.9) 0.0 (11.9) 0.0 (11.9)
blockmap_10_03-0009 0.0 (-1.1) 0.0 (-1.1) 0.0 (-1.1)
blockmap_10_03-0010 0.0 (8.6) 0.0 (8.6) 0.0 (8.6)
blockmap_15_01-0008 0.0 (-1.2) 0.0 (-1.2) 0.0 (-1.2)
blockmap_15_02-0008 0.0 (-1.9) 0.0 (-1.9) 0.0 (-1.9)
blockmap_15_03-0008 0.0 (30.0) 0.0 (30.0) 0.0 (30.0)
blockmap_15_03-0010 0.0 (-2.9) 0.0 (-2.9) 0.0 (-2.9)
blockmap_20_01-0009 0.0 (-1.3) 0.0 (-1.3) 0.0 (-1.3)
blockmap_20_02-0009 0.0 (-2.3) 0.0 (-2.3) 0.0 (-2.3)
blockmap_20_03-0010 0.0 (-3.3) 0.0 (-3.3) 0.0 (-3.3)
blockmap_22_01-0006 0.0 (-1.3) 0.0 (-1.3) 0.0 (-1.3)
blockmap_22_03-0009 0.0 (-3.6) 0.0 (-3.6) 0.0 (-3.6)
bwt3ac.wcsp 0.0 (11.7) 0.0 (11.7) 0.0 (11.7)
fs-07 0.0 (-6.4) 0.0 (-6.4) 0.0 (-6.4)
mastermind_03_08_04-0000 0.0 (249.0) 0.0 (249.0) 0.0 (249.0)
mastermind_03_08_04-0001 0.0 (86.6) 0.0 (86.6) 0.0 (86.6)
mastermind_03_08_04-0002 0.0 (63.9) 0.0 (63.9) 0.0 (63.9)
mastermind_03_08_04-0003 0.0 (119.0) 0.0 (119.0) 0.0 (119.0)
mastermind_03_08_04-0007 0.0 (86.6) 0.0 (86.6) 0.0 (86.6)
mastermind_03_08_04-0008 0.0 (33.9) 0.0 (33.9) 0.0 (33.9)
mastermind_03_08_04-0010 0.0 (149.5) 0.0 (149.5) 0.0 (149.5)
mastermind_03_08_04-0011 0.0 (233.0) 0.0 (233.0) 0.0 (233.0)
mastermind_03_08_04-0012 0.0 (234.5) 0.0 (234.5) 0.0 (234.5)
mastermind_03_08_04-0013 0.0 (233.5) 0.0 (233.5) 0.0 (233.5)
mastermind_03_08_04-0014 0.0 (233.3) 0.0 (233.3) 0.0 (233.3)
mastermind_03_08_04-0015 0.0 (234.0) 0.0 (234.0) 0.0 (234.0)
mastermind_03_08_05-0000 0.0 (409.8) 0.0 (409.8) 0.0 (409.8)
mastermind_03_08_05-0001 0.0 (203.4) 0.0 (203.4) 0.0 (203.4)
mastermind_03_08_05-0003 0.0 (171.6) 0.0 (171.6) 0.0 (171.6)
mastermind_03_08_05-0004 0.0 (227.8) 0.0 (227.8) 0.0 (227.8)
mastermind_03_08_05-0008 0.0 (310.5) 0.0 (310.5) 0.0 (310.5)
mastermind_03_08_05-0009 0.0 (27.9) 0.0 (27.9) 0.0 (27.9)
mastermind_03_08_05-0011 0.0 (390.4) 0.0 (390.4) 0.0 (390.4)
mastermind_03_08_05-0012 0.0 (392.2) 0.0 (392.2) 0.0 (392.2)
mastermind_03_08_05-0013 0.0 (390.4) 0.0 (390.4) 0.0 (390.4)
mastermind_03_08_05-0014 0.0 (392.9) 0.0 (392.9) 0.0 (392.9)
mastermind_03_08_05-0015 0.0 (390.2) 0.0 (390.2) 0.0 (390.2)
mastermind_04_08_03-0000 0.0 (139.3) 0.0 (139.3) 0.0 (139.3)
mastermind_04_08_03-0011 0.0 (128.2) 0.0 (128.2) 0.0 (128.2)
mastermind_04_08_03-0012 0.0 (128.5) 0.0 (128.5) 0.0 (128.5)
mastermind_04_08_03-0013 0.0 (127.0) 0.0 (127.0) 0.0 (127.0)
mastermind_04_08_03-0014 0.0 (127.4) 0.0 (127.4) 0.0 (127.4)
mastermind_04_08_03-0015 0.0 (128.4) 0.0 (128.4) 0.0 (128.4)
mastermind_04_08_04-0000 0.0 (274.2) 0.0 (274.2) 0.0 (274.2)
mastermind_04_08_04-0001 0.0 (97.0) 0.0 (97.0) 0.0 (97.0)
mastermind_04_08_04-0002 0.0 (127.4) 0.0 (127.4) 0.0 (127.4)
mastermind_04_08_04-0003 0.0 (107.7) 0.0 (107.7) 0.0 (107.7)
mastermind_04_08_04-0004 0.0 (143.1) 0.0 (143.1) 0.0 (143.1)
mastermind_04_08_04-0005 0.0 (79.4) 0.0 (79.4) 0.0 (79.4)
mastermind_04_08_04-0011 0.0 (258.0) 0.0 (258.0) 0.0 (258.0)
mastermind_04_08_04-0012 0.0 (259.5) 0.0 (259.5) 0.0 (259.5)
mastermind_04_08_04-0013 0.0 (259.1) 0.0 (259.1) 0.0 (259.1)
mastermind_04_08_04-0014 0.0 (259.1) 0.0 (259.1) 0.0 (259.1)
mastermind_04_08_04-0015 0.0 (260.0) 0.0 (260.0) 0.0 (260.0)
mastermind_05_08_03-0000 0.0 (150.1) 0.0 (150.1) 0.0 (150.1)
mastermind_05_08_03-0001 0.0 (58.1) 0.0 (58.1) 0.0 (58.1)
mastermind_05_08_03-0002 0.0 (43.8) 0.0 (43.8) 0.0 (43.8)
mastermind_05_08_03-0003 0.0 (70.9) 0.0 (70.9) 0.0 (70.9)
mastermind_05_08_03-0004 0.0 (43.9) 0.0 (43.9) 0.0 (43.9)
mastermind_05_08_03-0009 0.0 (98.9) 0.0 (98.9) 0.0 (98.9)
mastermind_05_08_03-0011 0.0 (139.6) 0.0 (139.6) 0.0 (139.6)
mastermind_05_08_03-0012 0.0 (138.7) 0.0 (138.7) 0.0 (138.7)
mastermind_05_08_03-0013 0.0 (138.8) 0.0 (138.8) 0.0 (138.8)
mastermind_05_08_03-0014 0.0 (139.5) 0.0 (139.5) 0.0 (139.5)
mastermind_05_08_03-0015 0.0 (140.2) 0.0 (140.2) 0.0 (140.2)
mastermind_06_08_03-0000 0.0 (160.4) 0.0 (160.4) 0.0 (160.4)
mastermind_06_08_03-0001 0.0 (18.6) 0.0 (18.6) 0.0 (18.6)
mastermind_06_08_03-0002 0.0 (51.4) 0.0 (51.4) 0.0 (51.4)
mastermind_06_08_03-0003 0.0 (33.5) 0.0 (33.5) 0.0 (33.5)
mastermind_06_08_03-0005 0.0 (10.4) 0.0 (10.4) 0.0 (10.4)
mastermind_06_08_03-0009 0.0 (98.2) 0.0 (98.2) 0.0 (98.2)
mastermind_06_08_03-0011 0.0 (148.5) 0.0 (148.5) 0.0 (148.5)
mastermind_06_08_03-0012 0.0 (149.4) 0.0 (149.4) 0.0 (149.4)
mastermind_06_08_03-0014 0.0 (149.4) 0.0 (149.4) 0.0 (149.4)
mastermind_06_08_03-0015 0.0 (148.8) 0.0 (148.8) 0.0 (148.8)
mastermind_10_08_03-0001 0.0 (52.8) 0.0 (52.8) 0.0 (52.8)
mastermind_10_08_03-0003 0.0 (52.3) 0.0 (52.3) 0.0 (52.3)
mastermind_10_08_03-0004 0.0 (26.0) 0.0 (26.0) 0.0 (26.0)
mastermind_10_08_03-0008 0.0 (-13.4) 0.0 (-13.4) 0.0 (-13.4)
mastermind_10_08_03-0009 0.0 (17.5) 0.0 (17.5) 0.0 (17.5)
mastermind_10_08_03-0010 0.0 (112.8) 0.0 (112.8) 0.0 (112.8)
myciel5g_3.wcsp 0.0 (14.3) 0.0 (14.3) 0.0 (14.3)
myciel5g_4.wcsp 0.0 (22.5) 0.0 (22.5) 0.0 (22.5)
or_chain_1.fg 0.0 (-4.5) 0.0 (-4.5) 0.0 (-4.5)
or_chain_102.fg 0.0 (-4.9) 0.0 (-4.9) 0.0 (-4.9)
or_chain_106.fg 0.0 (-3.4) 0.0 (-3.4) 0.0 (-3.4)
or_chain_107.fg 0.0 (-4.2) 0.0 (-4.2) 0.0 (-4.2)
or_chain_12.fg 0.0 (-5.1) 0.0 (-5.1) 0.0 (-5.1)
or_chain_128.fg 0.0 (-2.9) 0.0 (-2.9) 0.0 (-2.9)
or_chain_132.fg 0.0 (-2.2) 0.0 (-2.2) 0.0 (-2.2)
or_chain_138.fg 0.0 (-1.8) 0.0 (-1.8) 0.0 (-1.8)
or_chain_140.fg 0.0 (0.4) 0.0 (0.4) 0.0 (0.4)
or_chain_149.fg 0.0 (-1.4) 0.0 (-1.4) 0.0 (-1.4)
or_chain_15.fg 0.0 (-4.7) 0.0 (-4.7) 0.0 (-4.7)
or_chain_150.fg 0.0 (-3.5) 0.0 (-3.5) 0.0 (-3.5)
or_chain_153.fg 0.0 (-1.8) 0.0 (-1.8) 0.0 (-1.8)
or_chain_155.fg 0.0 (-3.4) 0.0 (-3.4) 0.0 (-3.4)
or_chain_161.fg 0.0 (-3.2) 0.0 (-3.2) 0.0 (-3.2)
or_chain_186.fg 0.0 (-5.6) 0.0 (-5.6) 0.0 (-5.6)
or_chain_188.fg 0.0 (-5.4) 0.0 (-5.4) 0.0 (-5.4)
or_chain_198.fg 0.0 (1.3) 0.0 (1.3) 0.0 (1.3)
or_chain_209.fg 0.0 (-4.6) 0.0 (-4.6) 0.0 (-4.6)
or_chain_242.fg 0.0 (2.4) 0.0 (2.4) 0.0 (2.4)
or_chain_4.fg 0.0 (-4.9) 0.0 (-4.9) 0.0 (-4.9)
or_chain_53.fg 0.0 (-1.0) 0.0 (-1.0) 0.0 (-1.0)
or_chain_61.fg 0.0 (-2.3) 0.0 (-2.3) 0.0 (-2.3)
or_chain_64.fg 0.0 (-1.7) 0.0 (-1.7) 0.0 (-1.7)
or_chain_90.fg 0.0 (-2.1) 0.0 (-2.1) 0.0 (-2.1)
pedigree51 0.0 (-9.0) 0.0 (-9.0) 0.0 (-9.0)
queen5_5_3.wcsp 0.0 (7.7) 0.0 (7.7) 0.0 (7.7)
queen5_5_4.wcsp 0.0 (12.1) 0.0 (12.1) 0.0 (12.1)
rus2_20_40_0_1 0.0 (161.5) 0.0 (161.5) 0.0 (161.5)
rus2_20_40_0_2 0.0 (171.9) 0.0 (171.9) 0.0 (171.9)
rus2_20_40_0_3 0.0 (143.3) 0.0 (143.3) 0.0 (143.3)
rus2_20_40_1_1 0.0 (171.6) 0.0 (171.6) 0.0 (171.6)
rus2_20_40_1_2 0.0 (166.3) 0.0 (166.3) 0.0 (166.3)
rus2_20_40_1_3 0.0 (175.5) 0.0 (175.5) 0.0 (175.5)
rus2_20_40_2_1 0.0 (175.7) 0.0 (175.7) 0.0 (175.7)
rus2_20_40_2_2 0.0 (174.5) 0.0 (174.5) 0.0 (174.5)
rus2_20_40_2_3 0.0 (176.5) 0.0 (176.5) 0.0 (176.5)
rus2_20_40_3_1 0.0 (172.9) 0.0 (172.9) 0.0 (172.9)
rus2_20_40_3_2 0.0 (206.1) 0.0 (206.1) 0.0 (206.1)
rus2_20_40_3_3 0.0 (191.3) 0.0 (191.3) 0.0 (191.3)
rus2_20_40_4_1 0.0 (162.8) 0.0 (162.8) 0.0 (162.8)
rus2_20_40_4_2 0.0 (163.6) 0.0 (163.6) 0.0 (163.6)
rus2_20_40_4_3 0.0 (162.9) 0.0 (162.9) 0.0 (162.9)
rus2_20_40_5_1 0.0 (154.3) 0.0 (154.3) 0.0 (154.3)
rus2_20_40_5_2 0.0 (160.9) 0.0 (160.9) 0.0 (160.9)
rus2_20_40_5_3 0.0 (227.4) 0.0 (227.4) 0.0 (227.4)
rus2_20_40_6_1 0.0 (182.2) 0.0 (182.2) 0.0 (182.2)
rus2_20_40_6_2 0.0 (132.5) 0.0 (132.5) 0.0 (132.5)
rus2_20_40_6_3 0.0 (199.1) 0.0 (199.1) 0.0 (199.1)
rus2_20_40_7_1 0.0 (151.9) 0.0 (151.9) 0.0 (151.9)
rus2_20_40_7_2 0.0 (168.5) 0.0 (168.5) 0.0 (168.5)
rus2_20_40_7_3 0.0 (141.3) 0.0 (141.3) 0.0 (141.3)
rus2_20_40_8_1 0.0 (178.4) 0.0 (178.4) 0.0 (178.4)
rus2_20_40_8_2 0.0 (164.7) 0.0 (164.7) 0.0 (164.7)
rus2_20_40_8_3 0.0 (168.4) 0.0 (168.4) 0.0 (168.4)
rus2_20_40_9_1 0.0 (167.2) 0.0 (167.2) 0.0 (167.2)
rus2_20_40_9_2 0.0 (171.3) 0.0 (171.3) 0.0 (171.3)
rus2_20_40_9_3 0.0 (139.1) 0.0 (139.1) 0.0 (139.1)
rus_20_40_0_1 0.0 (828.0) 0.0 (828.0) 0.0 (828.0)
rus_20_40_0_2 0.0 (988.1) 0.0 (988.1) 0.0 (988.1)
rus_20_40_0_3 0.0 (1097.8) 0.0 (1097.8) 0.0 (1097.8)
rus_20_40_1_1 0.0 (1185.5) 0.0 (1185.5) 0.0 (1185.5)
rus_20_40_1_2 0.0 (1097.2) 0.0 (1097.2) 0.0 (1097.2)
rus_20_40_1_3 0.0 (1097.9) 0.0 (1097.9) 0.0 (1097.9)
rus_20_40_2_1 0.0 (992.4) 0.0 (992.4) 0.0 (992.4)
rus_20_40_2_2 0.0 (886.0) 0.0 (886.0) 0.0 (886.0)
rus_20_40_2_3 0.0 (958.8) 0.0 (958.8) 0.0 (958.8)
rus_20_40_3_1 0.0 (1017.6) 0.0 (1017.6) 0.0 (1017.6)
rus_20_40_3_2 0.0 (1027.8) 0.0 (1027.8) 0.0 (1027.8)
rus_20_40_3_3 0.0 (1028.2) 0.0 (1028.2) 0.0 (1028.2)
rus_20_40_4_1 0.0 (1113.8) 0.0 (1113.8) 0.0 (1113.8)
rus_20_40_4_2 0.0 (1119.3) 0.0 (1119.3) 0.0 (1119.3)
rus_20_40_4_3 0.0 (1054.6) 0.0 (1054.6) 0.0 (1054.6)
rus_20_40_5_1 0.0 (1059.6) 0.0 (1059.6) 0.0 (1059.6)
rus_20_40_5_2 0.0 (1031.4) 0.0 (1031.4) 0.0 (1031.4)
rus_20_40_5_3 0.0 (1088.9) 0.0 (1088.9) 0.0 (1088.9)
rus_20_40_6_1 0.0 (935.5) 0.0 (935.5) 0.0 (935.5)
rus_20_40_6_2 0.0 (1166.7) 0.0 (1166.7) 0.0 (1166.7)
rus_20_40_6_3 0.0 (1152.7) 0.0 (1152.7) 0.0 (1152.7)
rus_20_40_7_1 0.0 (943.8) 0.0 (943.8) 0.0 (943.8)
rus_20_40_7_2 0.0 (951.7) 0.0 (951.7) 0.0 (951.7)
rus_20_40_7_3 0.0 (1064.6) 0.0 (1064.6) 0.0 (1064.6)
rus_20_40_8_1 0.0 (931.5) 0.0 (931.5) 0.0 (931.5)
rus_20_40_8_2 0.0 (1083.3) 0.0 (1083.3) 0.0 (1083.3)
rus_20_40_8_3 0.0 (895.8) 0.0 (895.8) 0.0 (895.8)
rus_20_40_9_1 0.0 (1047.2) 0.0 (1047.2) 0.0 (1047.2)
rus_20_40_9_2 0.0 (1045.8) 0.0 (1045.8) 0.0 (1045.8)
rus_20_40_9_3 0.0 (1052.3) 0.0 (1052.3) 0.0 (1052.3)

MAR

overall

Problem 20sec 1200sec 3600sec
1aie 0 0 0
1bxv 0 0 0
1g6x 0 0 0
1jer 0 0 0
1npl 0 0 0
1qt9 0 0 0
1rfs 0 0 0
2rta 0 0 0
BN_12 0 0 0
BN_13 0 0 0
BN_15 0 0 0
BN_31 0 0 0
blockmap_10_01-0009 0 0 0
blockmap_10_02-0009 0 0 0
blockmap_10_03-0009 0 0 0
blockmap_10_03-0010 0 0 0
blockmap_15_01-0008 0 0 0
blockmap_15_02-0008 0 0 0
blockmap_15_03-0010 0 0 0
blockmap_20_01-0009 0 0 0
bwt3ac.wcsp 0 0 0
fs-07 0 0 0
mastermind_03_08_04-0000 0 0 0
mastermind_03_08_04-0001 0 0 0
mastermind_03_08_04-0002 0 0 0
mastermind_03_08_04-0003 0 0 0
mastermind_03_08_04-0007 0 0 0
mastermind_03_08_04-0008 0 0 0
mastermind_03_08_04-0010 0 0 0
mastermind_03_08_04-0012 0 0 0
mastermind_03_08_04-0013 0 0 0
mastermind_03_08_04-0014 0 0 0
mastermind_03_08_04-0015 0 0 0
mastermind_03_08_05-0001 0 0 0
mastermind_03_08_05-0003 0 0 0
mastermind_03_08_05-0009 0 0 0
mastermind_04_08_03-0000 0 0 0
mastermind_04_08_03-0011 0 0 0
mastermind_04_08_03-0012 0 0 0
mastermind_04_08_03-0013 0 0 0
mastermind_04_08_03-0014 0 0 0
mastermind_04_08_03-0015 0 0 0
mastermind_04_08_04-0001 0 0 0
mastermind_04_08_04-0002 0 0 0
mastermind_04_08_04-0003 0 0 0
mastermind_04_08_04-0004 0 0 0
mastermind_04_08_04-0005 0 0 0
mastermind_05_08_03-0001 0 0 0
mastermind_05_08_03-0002 0 0 0
mastermind_05_08_03-0003 0 0 0
mastermind_05_08_03-0004 0 0 0
mastermind_05_08_03-0009 0 0 0
mastermind_05_08_03-0011 0 0 0
mastermind_05_08_03-0012 0 0 0
mastermind_05_08_03-0013 0 0 0
mastermind_05_08_03-0015 0 0 0
mastermind_06_08_03-0002 0 0 0
mastermind_06_08_03-0003 0 0 0
mastermind_06_08_03-0005 0 0 0
mastermind_06_08_03-0009 0 0 0
mastermind_10_08_03-0008 0 0 0
mastermind_10_08_03-0009 0 0 0
myciel5g_3.wcsp 0 0 0
or_chain_102.fg 0 0 0
or_chain_106.fg 0 0 0
or_chain_107.fg 0 0 0
or_chain_12.fg 0 0 0
or_chain_128.fg 0 0 0
or_chain_132.fg 0 0 0
or_chain_138.fg 0 0 0
or_chain_140.fg 0 0 0
or_chain_149.fg 0 0 0
or_chain_15.fg 0 0 0
or_chain_150.fg 0 0 0
or_chain_153.fg 0 0 0
or_chain_155.fg 0 0 0
or_chain_161.fg 0 0 0
or_chain_186.fg 0 0 0
or_chain_188.fg 0 0 0
or_chain_198.fg 0 0 0
or_chain_209.fg 0 0 0
or_chain_242.fg 0 0 0
or_chain_4.fg 0 0 0
or_chain_53.fg 0 0 0
or_chain_61.fg 0 0 0
or_chain_64.fg 0 0 0
or_chain_90.fg 0 0 0
queen5_5_3.wcsp 0 0 0

MPE

overall

Problem 20sec 1200sec 3600sec
1CKK 0.0 (4667.7) 0.0 (4667.7) 0.0 (4667.7)
1CM1 0.0 (4505.6) 0.0 (4505.6) 0.0 (4505.6)
1SY9 0.0 (3450.5) 0.0 (3450.5) 0.0 (3450.5)
2BBN 0.0 (4729.9) 0.0 (4729.9) 0.0 (4729.9)
2BCX 0.0 (4946.7) 0.0 (4946.7) 0.0 (4946.7)
BN-d-10000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan)
BN-d-200-5-10 0.0 (-53.5) 0.0 (-53.5) 0.0 (-53.5)
BN-d-20000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan)
BN-d-250-5-10 0.0 (-63.6) 0.0 (-63.6) 0.0 (-63.6)
BN-d-500-5-10 0.0 (-129.4) 0.0 (-129.4) 0.0 (-129.4)
BN-nd-10000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan)
BN-nd-200-5-10 0.0 (-60.7) 0.0 (-60.7) 0.0 (-60.7)
BN-nd-20000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan)
BN-nd-250-5-10 0.0 (-72.2) 0.0 (-72.2) 0.0 (-72.2)
BN-nd-500-5-10 0.0 (-146.4) 0.0 (-146.4) 0.0 (-146.4)
Hardsat_aes_64_1_keyfind_1 0.0 (nan) 0.0 (nan) 0.0 (nan)
Hardsat_gss-25-s100 0.0 (nan) 0.0 (nan) 0.0 (nan)
Hardsat_mod2c-rand3bip-sat-240-3.shuffled-as.sat05-2520 0.0 (nan) 0.0 (nan) 0.0 (nan)
Hardsat_mod2c-rand3bip-sat-250-3.shuffled-as.sat05-2535 0.0 (nan) 0.0 (nan) 0.0 (nan)
Hardsat_mod4block_2vars_10gates_u2_autoenc 0.0 (nan) 0.0 (nan) 0.0 (nan)
Maxsat_aes_64_1_keyfind_1 0.0 (1806.1) 0.0 (1806.1) 0.0 (1806.1)
Maxsat_gss-25-s100 0.0 (nan) 0.0 (nan) 0.0 (nan)
Maxsat_mod2c-rand3bip-sat-240-3.shuffled-as.sat05-2520 0.0 (1580.0) 0.0 (1580.0) 0.0 (1580.0)
Maxsat_mod2c-rand3bip-sat-250-3.shuffled-as.sat05-2535 0.0 (1634.5) 0.0 (1634.5) 0.0 (1634.5)
Maxsat_mod4block_2vars_10gates_u2_autoenc 0.0 (80875.5) 0.0 (80875.5) 0.0 (80875.5)
Promedas_60 0.0 (-30.3) 0.0 (-30.3) 0.0 (-30.3)
Promedas_61 0.0 (-21.7) 0.0 (-21.7) 0.0 (-21.7)
Promedas_62 0.0 (-26.2) 0.0 (-26.2) 0.0 (-26.2)
Promedas_63 0.0 (-20.2) 0.0 (-20.2) 0.0 (-20.2)
Promedas_64 0.0 (-26.5) 0.0 (-26.5) 0.0 (-26.5)
Promedas_65 0.0 (-23.4) 0.0 (-23.4) 0.0 (-23.4)
Promedas_66 0.0 (-26.7) 0.0 (-26.7) 0.0 (-26.7)
Promedas_67 0.0 (-38.9) 0.0 (-38.9) 0.0 (-38.9)
Promedas_68 0.0 (-55.9) 0.0 (-55.9) 0.0 (-55.9)
Promedas_69 0.0 (-23.9) 0.0 (-23.9) 0.0 (-23.9)
driverlog04ac.wcsp 0.0 (-104.1) 0.0 (-104.1) 0.0 (-104.1)
driverlog05ac.wcsp 0.0 (-100.1) 0.0 (-100.1) 0.0 (-100.1)
driverlog08ac.wcsp 0.0 (-108.1) 0.0 (-108.1) 0.0 (-108.1)
grid20x20.f10 0.0 (830.6) 0.0 (830.6) 0.0 (830.6)
grid20x20.f10.wrap 0.0 (817.2) 0.0 (817.2) 0.0 (817.2)
grid20x20.f15 0.0 (1230.9) 0.0 (1230.9) 0.0 (1230.9)
grid20x20.f15.wrap 0.0 (1204.0) 0.0 (1204.0) 0.0 (1204.0)
grid20x20.f5.wrap 0.0 (430.5) 0.0 (430.5) 0.0 (430.5)
grid40x40.f10 0.0 (3580.9) 0.0 (3580.9) 0.0 (3580.9)
grid40x40.f10.wrap 0.0 (3371.4) 0.0 (3371.4) 0.0 (3371.4)
grid40x40.f15 0.0 (5300.0) 0.0 (5300.0) 0.0 (5300.0)
grid40x40.f15.wrap 0.0 (4967.7) 0.0 (4967.7) 0.0 (4967.7)
grid40x40.f2 0.0 (846.4) 0.0 (846.4) 0.0 (846.4)
grid40x40.f2.wrap 0.0 (837.0) 0.0 (837.0) 0.0 (837.0)
grid40x40.f5 0.0 (1853.7) 0.0 (1853.7) 0.0 (1853.7)
grid40x40.f5.wrap 0.0 (1803.2) 0.0 (1803.2) 0.0 (1803.2)
grid80x80.f10 0.0 (13670.1) 0.0 (13670.1) 0.0 (13670.1)
grid80x80.f10.wrap 0.0 (13794.2) 0.0 (13794.2) 0.0 (13794.2)
grid80x80.f15 0.0 (20172.3) 0.0 (20172.3) 0.0 (20172.3)
grid80x80.f15.wrap 0.0 (20033.2) 0.0 (20033.2) 0.0 (20033.2)
grid80x80.f2 0.0 (3413.5) 0.0 (3413.5) 0.0 (3413.5)
grid80x80.f2.wrap 0.0 (3346.5) 0.0 (3346.5) 0.0 (3346.5)
grid80x80.f5 0.0 (7444.4) 0.0 (7444.4) 0.0 (7444.4)
grid80x80.f5.wrap 0.0 (7246.2) 0.0 (7246.2) 0.0 (7246.2)
pdb1jmx 0.0 (-633.6) 0.0 (-633.6) 0.0 (-633.6)
pdb1kgn 0.0 (-957.1) 0.0 (-957.1) 0.0 (-957.1)
pdb1kwh 0.0 (-413.1) 0.0 (-413.1) 0.0 (-413.1)
pdb1m3y 0.0 (-1359.0) 0.0 (-1359.0) 0.0 (-1359.0)
pdb1qks 0.0 (-827.9) 0.0 (-827.9) 0.0 (-827.9)
pedigree1 0.0 (-54.5) 0.0 (-54.5) 0.0 (-54.5)
pedigree13 0.0 (-121.8) 0.0 (-121.8) 0.0 (-121.8)
pedigree18 0.0 (-199.7) 0.0 (-199.7) 0.0 (-199.7)
pedigree19 0.0 (-182.4) 0.0 (-182.4) 0.0 (-182.4)
pedigree20 0.0 (-115.1) 0.0 (-115.1) 0.0 (-115.1)
pedigree23 0.0 (-70.8) 0.0 (-70.8) 0.0 (-70.8)
pedigree25 0.0 (-222.0) 0.0 (-222.0) 0.0 (-222.0)
pedigree30 0.0 (-226.0) 0.0 (-226.0) 0.0 (-226.0)
pedigree31 0.0 (-248.3) 0.0 (-248.3) 0.0 (-248.3)
pedigree33 0.0 (-148.2) 0.0 (-148.2) 0.0 (-148.2)
pedigree34 0.0 (-172.2) 0.0 (-172.2) 0.0 (-172.2)
pedigree37 0.0 (-228.6) 0.0 (-228.6) 0.0 (-228.6)
pedigree38 0.0 (-142.9) 0.0 (-142.9) 0.0 (-142.9)
pedigree39 0.0 (-243.0) 0.0 (-243.0) 0.0 (-243.0)
pedigree40 0.0 (-227.2) 0.0 (-227.2) 0.0 (-227.2)
pedigree41 0.0 (-205.3) 0.0 (-205.3) 0.0 (-205.3)
pedigree42 0.0 (-93.2) 0.0 (-93.2) 0.0 (-93.2)
pedigree44 0.0 (-153.8) 0.0 (-153.8) 0.0 (-153.8)
pedigree50 0.0 (-98.4) 0.0 (-98.4) 0.0 (-98.4)
pedigree51 0.0 (-208.3) 0.0 (-208.3) 0.0 (-208.3)
pedigree7 0.0 (-171.9) 0.0 (-171.9) 0.0 (-171.9)
pedigree9 0.0 (-212.1) 0.0 (-212.1) 0.0 (-212.1)
rovers02ac.wcsp 0.0 (-92.2) 0.0 (-92.2) 0.0 (-92.2)
rus_100_200_1_1 0.0 (1757.8) 0.0 (1757.8) 0.0 (1757.8)
rus_100_200_2_1 0.0 (1757.8) 0.0 (1757.8) 0.0 (1757.8)
rus_100_200_3_1 0.0 (1757.8) 0.0 (1757.8) 0.0 (1757.8)
rus_100_200_3_3 0.0 (1757.8) 0.0 (1757.8) 0.0 (1757.8)
rus_100_200_4_3 0.0 (1757.8) 0.0 (1757.8) 0.0 (1757.8)
rus_100_200_5_3 0.0 (1757.8) 0.0 (1757.8) 0.0 (1757.8)
rus_100_200_6_1 0.0 (1757.8) 0.0 (1757.8) 0.0 (1757.8)
rus_50_100_4_1 0.0 (1341.6) 0.0 (1341.6) 0.0 (1341.6)
rus_50_100_4_3 0.0 (1341.6) 0.0 (1341.6) 0.0 (1341.6)
rus_50_100_6_1 0.0 (1341.6) 0.0 (1341.6) 0.0 (1341.6)
rus_50_100_6_2 0.0 (1341.6) 0.0 (1341.6) 0.0 (1341.6)
rus_50_100_7_1 0.0 (1341.6) 0.0 (1341.6) 0.0 (1341.6)
rus_50_100_7_2 0.0 (1341.6) 0.0 (1341.6) 0.0 (1341.6)
rus_50_100_8_1 0.0 (1341.6) 0.0 (1341.6) 0.0 (1341.6)
rus_50_100_9_3 0.0 (1341.6) 0.0 (1341.6) 0.0 (1341.6)
satellite01ac.wcsp 0.0 (-12.0) 0.0 (-12.0) 0.0 (-12.0)
satellite02ac.wcsp 0.0 (-32.0) 0.0 (-32.0) 0.0 (-32.0)
scen06.wcsp 0.0 (-83.6) 0.0 (-83.6) 0.0 (-83.6)
scen07.wcsp 0.0 (-76.2) 0.0 (-76.2) 0.0 (-76.2)
zenotravel02ac.wcsp 0.0 (-48.0) 0.0 (-48.0) 0.0 (-48.0)
zenotravel04ac.wcsp 0.0 (-68.1) 0.0 (-68.1) 0.0 (-68.1)

MMAP

overall

Problem 20sec 1200sec 3600sec
75-17-5.Q0.5.I4 0.0 (-18.6) 0.0 (-18.6) 0.0 (-18.6)
75-19-5.Q0.5.I2 0.0 (-23.6) 0.0 (-23.6) 0.0 (-23.6)
75-22-5.Q0.5.I2 0.0 (-32.9) 0.0 (-32.9) 0.0 (-32.9)
75-23-5.Q0.5.I3 0.0 (-33.9) 0.0 (-33.9) 0.0 (-33.9)
75-26-5.Q0.5.I4 0.0 (-47.0) 0.0 (-47.0) 0.0 (-47.0)
90-22-5.Q0.5.I4 0.0 (-19.0) 0.0 (-19.0) 0.0 (-19.0)
90-24-5.Q0.5.I2 0.0 (-17.9) 0.0 (-17.9) 0.0 (-17.9)
90-25-5.Q0.5.I2 0.0 (-27.8) 0.0 (-27.8) 0.0 (-27.8)
90-26-5.Q0.5.I1 0.0 (-23.8) 0.0 (-23.8) 0.0 (-23.8)
90-30-5.Q0.5.I1 0.0 (-27.3) 0.0 (-27.3) 0.0 (-27.3)
90-34-5.Q0.5.I2 0.0 (-38.5) 0.0 (-38.5) 0.0 (-38.5)
90-38-5.Q0.5.I4 0.0 (-38.6) 0.0 (-38.6) 0.0 (-38.6)
90-42-5.Q0.5.I4 0.0 (-49.1) 0.0 (-49.1) 0.0 (-49.1)
90-46-5.Q0.5.I4 0.0 (-61.1) 0.0 (-61.1) 0.0 (-61.1)
90-50-5.Q0.5.I3 0.0 (-74.0) 0.0 (-74.0) 0.0 (-74.0)
Grids_20 0.0 (nan) 0.0 (nan) 0.0 (nan)
Grids_21 0.0 (nan) 0.0 (nan) 0.0 (nan)
Grids_22 0.0 (nan) 0.0 (nan) 0.0 (nan)
Grids_23 0.0 (nan) 0.0 (nan) 0.0 (nan)
Grids_24 0.0 (nan) 0.0 (nan) 0.0 (nan)
Grids_25 0.0 (nan) 0.0 (nan) 0.0 (nan)
Grids_26 0.0 (nan) 0.0 (nan) 0.0 (nan)
Grids_27 0.0 (nan) 0.0 (nan) 0.0 (nan)
Grids_28 0.0 (nan) 0.0 (nan) 0.0 (nan)
Grids_29 0.0 (nan) 0.0 (nan) 0.0 (nan)
ImageAlignment_11 0.0 (nan) 0.0 (nan) 0.0 (nan)
ImageAlignment_12 0.0 (nan) 0.0 (nan) 0.0 (nan)
ImageAlignment_13 0.0 (nan) 0.0 (nan) 0.0 (nan)
ImageAlignment_14 0.0 (nan) 0.0 (nan) 0.0 (nan)
ImageAlignment_15 0.0 (nan) 0.0 (nan) 0.0 (nan)
ObjectDetection_13 0.0 (nan) 0.0 (nan) 0.0 (nan)
ObjectDetection_14 0.0 (nan) 0.0 (nan) 0.0 (nan)
ObjectDetection_15 0.0 (nan) 0.0 (nan) 0.0 (nan)
ObjectDetection_16 0.0 (nan) 0.0 (nan) 0.0 (nan)
ObjectDetection_17 0.0 (nan) 0.0 (nan) 0.0 (nan)
ProteinFolding_11 0.0 (nan) 0.0 (nan) 0.0 (nan)
ProteinFolding_12 0.0 (nan) 0.0 (nan) 0.0 (nan)
ProteinFolding_13 0.0 (nan) 0.0 (nan) 0.0 (nan)
ProteinFolding_14 0.0 (nan) 0.0 (nan) 0.0 (nan)
ProteinFolding_15 0.0 (nan) 0.0 (nan) 0.0 (nan)
Segmentation_11 0.0 (nan) 0.0 (nan) 0.0 (nan)
Segmentation_12 0.0 (nan) 0.0 (nan) 0.0 (nan)
Segmentation_13 0.0 (nan) 0.0 (nan) 0.0 (nan)
Segmentation_14 0.0 (nan) 0.0 (nan) 0.0 (nan)
Segmentation_15 0.0 (nan) 0.0 (nan) 0.0 (nan)
Segmentation_16 0.0 (nan) 0.0 (nan) 0.0 (nan)
Segmentation_17 0.0 (nan) 0.0 (nan) 0.0 (nan)
Segmentation_18 0.0 (nan) 0.0 (nan) 0.0 (nan)
Segmentation_19 0.0 (nan) 0.0 (nan) 0.0 (nan)
Segmentation_20 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p24_16 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p24_20 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p34_15 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p34_20 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p44_15 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p44_19 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p54_10 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p54_16 0.0 (nan) 0.0 (nan) 0.0 (nan)
comm_p01_16 0.0 (nan) 0.0 (nan) 0.0 (nan)
comm_p01_20 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_11.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_16.fg.Q0.5.I3 0.0 (-73.1) 0.0 (-73.1) 0.0 (-73.1)
or_chain_22.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_24.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_25.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_32.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_36.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_39.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_40.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_41.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_43.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_6.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_60.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_63.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_8.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan)
pedigree1.Q0.5.I3 0.0 (-42.1) 0.0 (-42.1) 0.0 (-42.1)
pedigree13.Q0.5.I1 0.0 (-94.6) 0.0 (-94.6) 0.0 (-94.6)
pedigree18.Q0.5.I1 0.0 (-167.0) 0.0 (-167.0) 0.0 (-167.0)
pedigree19.Q0.5.I4 0.0 (-156.8) 0.0 (-156.8) 0.0 (-156.8)
pedigree20.Q0.5.I2 0.0 (-89.8) 0.0 (-89.8) 0.0 (-89.8)
pedigree25.Q0.5.I2 0.0 (-193.7) 0.0 (-193.7) 0.0 (-193.7)
pedigree30.Q0.5.I2 0.0 (-186.6) 0.0 (-186.6) 0.0 (-186.6)
pedigree31.Q0.5.I2 0.0 (-195.5) 0.0 (-195.5) 0.0 (-195.5)
pedigree33.Q0.5.I2 0.0 (-127.2) 0.0 (-127.2) 0.0 (-127.2)
pedigree38.Q0.5.I2 0.0 (-124.7) 0.0 (-124.7) 0.0 (-124.7)
pedigree41.Q0.5.I2 0.0 (-175.4) 0.0 (-175.4) 0.0 (-175.4)
pedigree44.Q0.5.I4 0.0 (-135.0) 0.0 (-135.0) 0.0 (-135.0)
pedigree50.Q0.5.I1 0.0 (-83.2) 0.0 (-83.2) 0.0 (-83.2)
pedigree7.Q0.5.I2 0.0 (-136.9) 0.0 (-136.9) 0.0 (-136.9)
pedigree9.Q0.5.I3 0.0 (-178.2) 0.0 (-178.2) 0.0 (-178.2)
pomdp10-12_7_3_8_4.mmap 0.0 (1.2) 0.0 (1.2) 0.0 (1.2)
pomdp6-12_6_2_6_3.mmap 0.0 (0.9) 0.0 (0.9) 0.0 (0.9)
pomdp7-20_10_2_10_3.mmap 0.0 (nan) 0.0 (nan) 0.0 (nan)
pomdp8-14_9_3_12_4.mmap 0.0 (1.4) 0.0 (1.4) 0.0 (1.4)
pomdp9-14_8_3_10_4.mmap 0.0 (nan) 0.0 (nan) 0.0 (nan)
wcsp_14 0.0 (nan) 0.0 (nan) 0.0 (nan)
wcsp_15 0.0 (nan) 0.0 (nan) 0.0 (nan)
wcsp_16 0.0 (nan) 0.0 (nan) 0.0 (nan)
wcsp_17 0.0 (nan) 0.0 (nan) 0.0 (nan)
wcsp_18 0.0 (nan) 0.0 (nan) 0.0 (nan)

Updated: