The results below are organized as follows:

  • each table below displays various solvers’ performance for individual problem instances for the given task and time limit
  • table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria

overall

20sec

Problem baseline daoopt-lh-mpe daoopt-mpe toulbar2-ipr-mpe toulbar2-vacint-mpe toulbar2-vns-mpe
1CKK 0.0 (4667.7) 76.0 (5316.3) 78.3 (5335.5) 0.0 (nan) 0.0 (nan) 94.9 (5477.7)
1CM1 0.0 (4505.6) 77.1 (5206.7) 95.4 (5372.4) 0.0 (nan) 0.0 (nan) 100.0 (5414.6)
1SY9 0.0 (3450.5) 78.9 (3872.4) 97.3 (3970.7) 0.0 (nan) 0.0 (nan) 100.0 (3985.1)
2BBN 0.0 (4729.9) 58.2 (5078.1) 75.8 (5183.5) 0.0 (nan) 0.0 (nan) 0.0 (nan)
2BCX 0.0 (4946.7) 83.5 (5828.5) 88.3 (5878.2) 0.0 (nan) 0.0 (nan) 0.0 (nan)
BN-d-10000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
BN-d-200-5-10 0.0 (-53.5) 92.2 (-47.1) 86.3 (-47.5) 95.3 (-46.9) 99.3 (-46.6) 100.0 (-46.5)
BN-d-20000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
BN-d-250-5-10 0.0 (-63.6) 73.9 (-58.4) 88.8 (-57.4) 0.0 (nan) 86.5 (-57.6) 92.8 (-57.1)
BN-d-500-5-10 0.0 (-129.4) 74.2 (-120.2) 68.1 (-121.0) 0.0 (nan) 61.3 (-121.8) 75.1 (-120.1)
BN-nd-10000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
BN-nd-200-5-10 0.0 (-60.7) 85.2 (-55.4) 79.9 (-55.7) 0.0 (nan) 98.2 (-54.6) 99.1 (-54.5)
BN-nd-20000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
BN-nd-250-5-10 0.0 (-72.2) 74.2 (-67.1) 74.1 (-67.1) 0.0 (nan) 88.9 (-66.0) 100.0 (-65.3)
BN-nd-500-5-10 0.0 (-146.4) 83.6 (-136.8) 76.8 (-137.5) 0.0 (nan) 77.3 (-137.5) 89.6 (-136.1)
Hardsat_aes_64_1_keyfind_1 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (-inf) 0.0 (-inf)
Hardsat_gss-25-s100 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
Hardsat_mod2c-rand3bip-sat-240-3.shuffled-as.sat05-2520 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
Hardsat_mod2c-rand3bip-sat-250-3.shuffled-as.sat05-2535 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
Hardsat_mod4block_2vars_10gates_u2_autoenc 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
Maxsat_aes_64_1_keyfind_1 0.0 (1806.1) 87.2 (1861.5) 95.2 (1866.5) 0.0 (1799.2) 4.1 (1808.8) 27.1 (1823.4)
Maxsat_gss-25-s100 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
Maxsat_mod2c-rand3bip-sat-240-3.shuffled-as.sat05-2520 0.0 (1580.0) 75.9 (1625.1) 83.9 (1629.8) 79.0 (1626.9) 79.0 (1626.9) 88.8 (1632.8)
Maxsat_mod2c-rand3bip-sat-250-3.shuffled-as.sat05-2535 0.0 (1634.5) 81.5 (1682.2) 95.3 (1690.2) 85.0 (1684.2) 79.3 (1680.9) 91.5 (1688.0)
Maxsat_mod4block_2vars_10gates_u2_autoenc 0.0 (80875.5) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
Promedas_60 0.0 (-30.3) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0)
Promedas_61 0.0 (-21.7) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9)
Promedas_62 0.0 (-26.2) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7)
Promedas_63 0.0 (-20.2) 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1)
Promedas_64 0.0 (-26.5) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5)
Promedas_65 0.0 (-23.4) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2)
Promedas_66 0.0 (-26.7) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4)
Promedas_67 0.0 (-38.9) 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4)
Promedas_68 0.0 (-55.9) 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9)
Promedas_69 0.0 (-23.9) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2)
driverlog04ac.wcsp 0.0 (-104.1) 65.5 (-36.0) 80.9 (-20.0) 88.5 (-12.1) 88.5 (-12.1) 88.5 (-12.1)
driverlog05ac.wcsp 0.0 (-100.1) 68.1 (-32.0) 72.1 (-28.0) 80.0 (-20.0) 80.0 (-20.0) 80.0 (-20.0)
driverlog08ac.wcsp 0.0 (-108.1) 59.4 (-44.0) 74.2 (-28.0) 74.1 (-28.0) 77.8 (-24.1) 77.8 (-24.0)
grid20x20.f10 0.0 (830.6) 100.0 (1309.7) 100.0 (1309.7) 100.0 (1309.7) 97.4 (1297.0) 96.9 (1294.7)
grid20x20.f10.wrap 0.0 (817.2) 100.0 (1325.0) 100.0 (1325.0) 100.0 (1325.0) 97.1 (1310.1) 97.0 (1309.6)
grid20x20.f15 0.0 (1230.9) 99.9 (1961.1) 100.0 (1961.8) 100.0 (1961.8) 98.7 (1952.0) 97.6 (1944.4)
grid20x20.f15.wrap 0.0 (1204.0) 100.0 (1981.8) 100.0 (1981.8) 100.0 (1981.8) 91.8 (1917.7) 98.2 (1967.6)
grid20x20.f5.wrap 0.0 (430.5) 100.0 (670.0) 100.0 (670.0) 100.0 (670.0) 91.4 (649.3) 96.6 (661.9)
grid40x40.f10 0.0 (3580.9) 94.3 (5395.3) 100.0 (5504.4) 97.5 (5455.7) 91.8 (5346.3) 98.0 (5466.6)
grid40x40.f10.wrap 0.0 (3371.4) 91.7 (5482.9) 100.0 (5674.0) 81.4 (5246.8) 95.2 (5563.7) 97.4 (5614.1)
grid40x40.f15 0.0 (5300.0) 95.2 (8093.3) 99.8 (8227.6) 95.8 (8111.6) 94.3 (8066.4) 96.9 (8143.6)
grid40x40.f15.wrap 0.0 (4967.7) 92.3 (8225.5) 100.0 (8495.2) 82.6 (7883.7) 92.7 (8237.7) 97.6 (8410.5)
grid40x40.f2 0.0 (846.4) 94.9 (1151.4) 100.0 (1167.8) 100.0 (1167.8) 87.4 (1127.2) 99.5 (1166.1)
grid40x40.f2.wrap 0.0 (837.0) 91.7 (1150.8) 100.0 (1179.1) 93.4 (1156.6) 96.7 (1167.9) 99.5 (1177.6)
grid40x40.f5 0.0 (1853.7) 93.9 (2725.1) 100.0 (2781.6) 84.9 (2642.0) 94.8 (2733.8) 98.7 (2769.4)
grid40x40.f5.wrap 0.0 (1803.2) 92.1 (2744.5) 99.3 (2817.8) 79.8 (2618.7) 93.3 (2757.0) 96.6 (2790.4)
grid80x80.f10 0.0 (13670.1) 93.3 (21375.3) 93.3 (21368.9) 0.0 (nan) 77.6 (20079.9) 92.9 (21337.6)
grid80x80.f10.wrap 0.0 (13794.2) 91.4 (21310.0) 91.1 (21291.4) 0.0 (nan) 76.2 (20062.1) 92.8 (21426.6)
grid80x80.f15 0.0 (20172.3) 93.6 (32004.1) 93.6 (31999.4) 0.0 (nan) 77.5 (29969.1) 93.7 (32013.4)
grid80x80.f15.wrap 0.0 (20033.2) 93.2 (32330.4) 92.8 (32269.9) 0.0 (nan) 80.3 (30619.9) 93.4 (32351.3)
grid80x80.f2 0.0 (3413.5) 91.7 (4573.3) 92.9 (4588.4) 0.0 (nan) 74.5 (4355.8) 91.8 (4574.2)
grid80x80.f2.wrap 0.0 (3346.5) 90.7 (4606.9) 94.2 (4654.8) 0.0 (nan) 76.5 (4409.3) 93.7 (4648.3)
grid80x80.f5 0.0 (7444.4) 91.0 (10820.2) 92.4 (10872.1) 0.0 (nan) 75.3 (10237.6) 92.1 (10863.0)
grid80x80.f5.wrap 0.0 (7246.2) 92.2 (10811.7) 91.7 (10794.3) 0.0 (nan) 75.4 (10160.6) 91.2 (10773.7)
pdb1jmx 0.0 (-633.6) 93.1 (-510.6) 100.0 (-501.4) 100.0 (-501.4) 100.0 (-501.4) 100.0 (-501.4)
pdb1kgn 0.0 (-957.1) 90.7 (-768.1) 99.8 (-749.2) 100.0 (-748.7) 100.0 (-748.7) 99.8 (-749.2)
pdb1kwh 0.0 (-413.1) 98.2 (-307.5) 100.0 (-305.5) 100.0 (-305.5) 100.0 (-305.5) 100.0 (-305.5)
pdb1m3y 0.0 (-1359.0) 93.6 (-1073.7) 99.9 (-1054.6) 100.0 (-1054.2) 100.0 (-1054.2) 100.0 (-1054.2)
pdb1qks 0.0 (-827.9) 97.3 (-661.7) 100.0 (-657.0) 100.0 (-657.0) 100.0 (-657.0) 100.0 (-657.0)
pedigree1 0.0 (-54.5) 100.0 (-45.6) 100.0 (-45.6) 100.0 (-45.6) 100.0 (-45.6) 100.0 (-45.6)
pedigree13 0.0 (-121.8) 99.9 (-73.4) 100.0 (-73.4) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree18 0.0 (-199.7) 100.0 (-125.3) 100.0 (-125.3) 0.0 (-inf) 100.0 (-125.3) 100.0 (-125.3)
pedigree19 0.0 (-182.4) 99.2 (-97.8) 99.9 (-97.2) 99.4 (-97.6) 97.8 (-99.0) 94.7 (-101.7)
pedigree20 0.0 (-115.1) 100.0 (-53.8) 100.0 (-53.8) 100.0 (-53.8) 100.0 (-53.8) 100.0 (-53.8)
pedigree23 0.0 (-70.8) 100.0 (-62.4) 100.0 (-62.4) 100.0 (-62.4) 100.0 (-62.4) 100.0 (-62.4)
pedigree25 0.0 (-222.0) 100.0 (-160.8) 100.0 (-160.8) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree30 0.0 (-226.0) 100.0 (-137.0) 100.0 (-137.0) 0.0 (-inf) 99.5 (-137.4) 98.8 (-138.0)
pedigree31 0.0 (-248.3) 99.8 (-130.7) 100.0 (-130.5) 97.3 (-133.7) 0.0 (-inf) 0.0 (-inf)
pedigree33 0.0 (-148.2) 100.0 (-74.9) 100.0 (-74.9) 100.0 (-74.9) 100.0 (-74.9) 100.0 (-74.9)
pedigree34 0.0 (-172.2) 99.5 (-111.4) 100.0 (-111.1) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree37 0.0 (-228.6) 100.0 (-144.9) 100.0 (-144.9) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree38 0.0 (-142.9) 99.8 (-87.4) 100.0 (-87.3) 100.0 (-87.3) 100.0 (-87.3) 100.0 (-87.3)
pedigree39 0.0 (-243.0) 99.2 (-156.4) 100.0 (-155.6) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree40 0.0 (-227.2) 99.5 (-130.8) 99.3 (-130.9) 100.0 (-130.3) 99.0 (-131.2) 95.7 (-134.5)
pedigree41 0.0 (-205.3) 99.9 (-120.9) 100.0 (-120.7) 100.0 (-120.7) 98.6 (-121.9) 99.6 (-121.1)
pedigree42 0.0 (-93.2) 99.9 (-81.8) 100.0 (-81.8) 100.0 (-81.8) 100.0 (-81.8) 100.0 (-81.8)
pedigree44 0.0 (-153.8) 99.8 (-97.1) 100.0 (-97.0) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree50 0.0 (-98.4) 99.7 (-61.8) 100.0 (-61.7) 100.0 (-61.7) 100.0 (-61.7) 100.0 (-61.7)
pedigree51 0.0 (-208.3) 99.7 (-109.9) 99.8 (-109.9) 98.0 (-111.7) 97.1 (-112.5) 97.2 (-112.4)
pedigree7 0.0 (-171.9) 99.6 (-114.1) 100.0 (-113.9) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree9 0.0 (-212.1) 100.0 (-122.9) 100.0 (-122.9) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
rovers02ac.wcsp 0.0 (-92.2) 100.0 (-0.2) 100.0 (-0.2) 87.1 (-12.0) 91.5 (-8.0) 87.1 (-12.0)
rus_100_200_1_1 0.0 (1757.8) 0.0 (nan) 0.0 (nan) 0.0 (nan) 100.0 (2683.9) 95.2 (2639.6)
rus_100_200_2_1 0.0 (1757.8) 0.0 (nan) 0.0 (nan) 0.0 (nan) 99.2 (2639.4) 96.3 (2613.7)
rus_100_200_3_1 0.0 (1757.8) 0.0 (nan) 0.0 (nan) 0.0 (nan) 88.0 (2539.4) 77.9 (2450.3)
rus_100_200_3_3 0.0 (1757.8) 0.0 (nan) 0.0 (nan) 0.0 (nan) 77.8 (2449.6) 70.0 (2379.6)
rus_100_200_4_3 0.0 (1757.8) 0.0 (nan) 0.0 (nan) 0.0 (nan) 81.2 (2479.5) 76.1 (2434.2)
rus_100_200_5_3 0.0 (1757.8) 0.0 (nan) 0.0 (nan) 0.0 (nan) 91.8 (2573.3) 86.1 (2522.8)
rus_100_200_6_1 0.0 (1757.8) 0.0 (nan) 0.0 (nan) 0.0 (nan) 58.4 (2276.7) 52.8 (2226.8)
rus_50_100_4_1 0.0 (1341.6) 0.0 (nan) 0.0 (nan) 39.6 (1535.9) 39.6 (1535.9) 39.6 (1535.9)
rus_50_100_4_3 0.0 (1341.6) 0.0 (nan) 0.0 (nan) 55.8 (1615.8) 55.8 (1615.8) 55.8 (1615.8)
rus_50_100_6_1 0.0 (1341.6) 0.0 (nan) 0.0 (nan) 0.0 (1338.1) 0.0 (1338.1) 0.0 (1337.8)
rus_50_100_6_2 0.0 (1341.6) 0.0 (nan) 0.0 (nan) 64.1 (1656.5) 64.1 (1656.5) 64.1 (1656.5)
rus_50_100_7_1 0.0 (1341.6) 0.0 (nan) 0.0 (nan) 33.1 (1504.1) 33.1 (1504.1) 33.1 (1504.1)
rus_50_100_7_2 0.0 (1341.6) 0.0 (nan) 0.0 (nan) 34.2 (1509.9) 34.2 (1509.9) 34.2 (1509.9)
rus_50_100_8_1 0.0 (1341.6) 0.0 (nan) 0.0 (nan) 21.3 (1446.2) 21.3 (1446.2) 21.3 (1446.2)
rus_50_100_9_3 0.0 (1341.6) 0.0 (nan) 0.0 (nan) 55.5 (1614.3) 55.5 (1614.3) 55.5 (1614.3)
satellite01ac.wcsp 0.0 (-12.0) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1)
satellite02ac.wcsp 0.0 (-32.0) 37.6 (-20.0) 37.6 (-20.0) 100.0 (-0.0) 100.0 (-0.0) 100.0 (-0.0)
scen06.wcsp 0.0 (-83.6) 98.3 (-14.8) 98.9 (-14.3) 99.9 (-13.6) 99.3 (-14.1) 100.0 (-13.6)
scen07.wcsp 0.0 (-76.2) 98.7 (-2.4) 99.5 (-1.8) 94.3 (-5.6) 99.7 (-1.6) 100.0 (-1.4)
zenotravel02ac.wcsp 0.0 (-48.0) 100.0 (-0.1) 100.0 (-0.1) 66.8 (-16.0) 66.8 (-16.0) 66.8 (-16.0)
zenotravel04ac.wcsp 0.0 (-68.1) 58.9 (-28.0) 70.7 (-20.0) 64.8 (-24.0) 58.9 (-28.0) 58.9 (-28.0)

1200sec

Problem baseline daoopt-lh-mpe daoopt-mpe toulbar2-ipr-mpe toulbar2-vacint-mpe toulbar2-vns-mpe
1CKK 0.0 (4667.7) 76.0 (5316.3) 90.6 (5441.0) 100.0 (5520.9) 100.0 (5520.9) 100.0 (5520.9)
1CM1 0.0 (4505.6) 77.1 (5206.7) 99.9 (5413.8) 100.0 (5414.6) 100.0 (5414.6) 100.0 (5414.6)
1SY9 0.0 (3450.5) 78.9 (3872.4) 100.0 (3985.1) 100.0 (3985.1) 100.0 (3985.1) 100.0 (3985.1)
2BBN 0.0 (4729.9) 81.6 (5218.7) 99.8 (5327.5) 100.0 (5328.6) 100.0 (5328.6) 100.0 (5328.6)
2BCX 0.0 (4946.7) 83.5 (5828.5) 99.3 (5995.0) 100.0 (6002.2) 100.0 (6002.2) 100.0 (6002.2)
BN-d-10000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (-1154.2) 0.0 (nan)
BN-d-200-5-10 0.0 (-53.5) 92.2 (-47.1) 99.3 (-46.6) 100.0 (-46.5) 99.3 (-46.6) 100.0 (-46.5)
BN-d-20000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (-2338.6) 0.0 (nan)
BN-d-250-5-10 0.0 (-63.6) 73.9 (-58.4) 85.7 (-57.6) 100.0 (-56.6) 86.5 (-57.6) 100.0 (-56.6)
BN-d-500-5-10 0.0 (-129.4) 74.2 (-120.2) 71.5 (-120.6) 99.7 (-117.1) 75.5 (-120.1) 100.0 (-117.0)
BN-nd-10000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (-1308.1) 0.0 (nan)
BN-nd-200-5-10 0.0 (-60.7) 85.2 (-55.4) 94.9 (-54.8) 100.0 (-54.5) 98.2 (-54.6) 99.1 (-54.5)
BN-nd-20000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (-2574.3) 0.0 (nan)
BN-nd-250-5-10 0.0 (-72.2) 74.2 (-67.1) 97.8 (-65.4) 91.7 (-65.8) 88.9 (-66.0) 100.0 (-65.3)
BN-nd-500-5-10 0.0 (-146.4) 83.6 (-136.8) 66.6 (-138.7) 100.0 (-134.9) 77.3 (-137.5) 90.8 (-135.9)
Hardsat_aes_64_1_keyfind_1 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
Hardsat_gss-25-s100 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
Hardsat_mod2c-rand3bip-sat-240-3.shuffled-as.sat05-2520 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
Hardsat_mod2c-rand3bip-sat-250-3.shuffled-as.sat05-2535 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
Hardsat_mod4block_2vars_10gates_u2_autoenc 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
Maxsat_aes_64_1_keyfind_1 0.0 (1806.1) 95.8 (1866.9) 100.0 (1869.6) 30.2 (1825.3) 20.3 (1819.0) 33.6 (1827.4)
Maxsat_gss-25-s100 0.0 (nan) 0.0 (63283.8) 0.0 (63382.3) 0.0 (63026.1) 0.0 (63302.4) 0.0 (63435.8)
Maxsat_mod2c-rand3bip-sat-240-3.shuffled-as.sat05-2520 0.0 (1580.0) 88.9 (1632.8) 89.9 (1633.4) 96.6 (1637.4) 79.0 (1626.9) 88.9 (1632.8)
Maxsat_mod2c-rand3bip-sat-250-3.shuffled-as.sat05-2535 0.0 (1634.5) 91.4 (1687.9) 81.6 (1682.2) 98.6 (1692.1) 79.3 (1680.9) 91.5 (1688.0)
Maxsat_mod4block_2vars_10gates_u2_autoenc 0.0 (80875.5) 1.4 (80881.7) 0.0 (80856.5) 98.6 (81310.2) 98.5 (81310.0) 75.5 (81208.7)
Promedas_60 0.0 (-30.3) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0)
Promedas_61 0.0 (-21.7) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9)
Promedas_62 0.0 (-26.2) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7)
Promedas_63 0.0 (-20.2) 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1)
Promedas_64 0.0 (-26.5) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5)
Promedas_65 0.0 (-23.4) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2)
Promedas_66 0.0 (-26.7) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4)
Promedas_67 0.0 (-38.9) 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4)
Promedas_68 0.0 (-55.9) 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9)
Promedas_69 0.0 (-23.9) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2)
driverlog04ac.wcsp 0.0 (-104.1) 65.5 (-36.0) 100.0 (-0.2) 88.5 (-12.1) 88.5 (-12.1) 88.5 (-12.1)
driverlog05ac.wcsp 0.0 (-100.1) 68.1 (-32.0) 100.0 (-0.1) 80.0 (-20.0) 80.0 (-20.0) 80.0 (-20.0)
driverlog08ac.wcsp 0.0 (-108.1) 59.4 (-44.0) 100.0 (-0.1) 77.8 (-24.0) 77.8 (-24.0) 77.8 (-24.0)
grid20x20.f10 0.0 (830.6) 99.9 (1309.4) 100.0 (1309.7) 100.0 (1309.7) 98.5 (1302.6) 98.5 (1302.7)
grid20x20.f10.wrap 0.0 (817.2) 100.0 (1325.0) 100.0 (1325.0) 100.0 (1325.0) 98.9 (1319.4) 97.0 (1309.6)
grid20x20.f15 0.0 (1230.9) 100.0 (1961.8) 100.0 (1961.8) 100.0 (1961.8) 99.6 (1959.0) 97.6 (1944.4)
grid20x20.f15.wrap 0.0 (1204.0) 100.0 (1981.8) 100.0 (1981.8) 100.0 (1981.8) 98.9 (1973.3) 98.2 (1967.6)
grid20x20.f5.wrap 0.0 (430.5) 100.0 (670.0) 100.0 (670.0) 100.0 (670.0) 98.9 (667.4) 96.6 (661.9)
grid40x40.f10 0.0 (3580.9) 99.0 (5484.3) 100.0 (5504.4) 98.9 (5482.4) 93.0 (5369.6) 98.8 (5480.4)
grid40x40.f10.wrap 0.0 (3371.4) 98.3 (5636.0) 100.0 (5674.4) 100.0 (5674.4) 95.4 (5569.6) 97.8 (5622.9)
grid40x40.f15 0.0 (5300.0) 99.2 (8210.4) 100.0 (8234.3) 97.8 (8169.5) 95.0 (8087.8) 97.8 (8169.7)
grid40x40.f15.wrap 0.0 (4967.7) 98.7 (8451.7) 100.0 (8496.7) 98.6 (8447.4) 94.0 (8285.4) 98.2 (8434.3)
grid40x40.f2 0.0 (846.4) 99.9 (1167.4) 100.0 (1167.8) 100.0 (1167.8) 87.4 (1127.2) 99.5 (1166.1)
grid40x40.f2.wrap 0.0 (837.0) 99.7 (1178.4) 100.0 (1179.2) 100.0 (1179.2) 98.3 (1173.5) 99.5 (1177.6)
grid40x40.f5 0.0 (1853.7) 99.7 (2778.7) 100.0 (2781.6) 100.0 (2781.6) 95.8 (2743.1) 98.7 (2769.4)
grid40x40.f5.wrap 0.0 (1803.2) 98.7 (2812.4) 100.0 (2825.5) 100.0 (2825.5) 94.4 (2768.3) 98.7 (2812.1)
grid80x80.f10 0.0 (13670.1) 98.9 (21833.6) 100.0 (21925.9) 98.2 (21777.8) 94.1 (21437.4) 98.5 (21800.2)
grid80x80.f10.wrap 0.0 (13794.2) 97.4 (21803.5) 100.0 (22017.5) 98.1 (21859.6) 95.6 (21654.6) 98.7 (21915.8)
grid80x80.f15 0.0 (20172.3) 98.2 (32579.3) 100.0 (32808.8) 97.7 (32514.6) 93.8 (32021.0) 98.3 (32596.7)
grid80x80.f15.wrap 0.0 (20033.2) 97.5 (32894.0) 100.0 (33223.8) 97.6 (32903.5) 94.5 (32496.1) 98.6 (33039.3)
grid80x80.f2 0.0 (3413.5) 99.3 (4668.5) 100.0 (4677.6) 100.0 (4677.7) 95.3 (4618.0) 99.8 (4674.6)
grid80x80.f2.wrap 0.0 (3346.5) 99.0 (4722.3) 100.0 (4735.7) 100.0 (4735.7) 95.0 (4666.9) 99.7 (4731.6)
grid80x80.f5 0.0 (7444.4) 98.6 (11103.3) 100.0 (11155.6) 98.1 (11086.9) 93.8 (10927.3) 98.6 (11104.0)
grid80x80.f5.wrap 0.0 (7246.2) 98.6 (11060.2) 100.0 (11113.9) 98.7 (11063.5) 94.7 (10907.2) 97.4 (11014.6)
pdb1jmx 0.0 (-633.6) 93.1 (-510.6) 100.0 (-501.4) 100.0 (-501.4) 100.0 (-501.4) 100.0 (-501.4)
pdb1kgn 0.0 (-957.1) 90.7 (-768.1) 100.0 (-748.8) 100.0 (-748.7) 100.0 (-748.7) 100.0 (-748.7)
pdb1kwh 0.0 (-413.1) 98.2 (-307.5) 100.0 (-305.5) 100.0 (-305.5) 100.0 (-305.5) 100.0 (-305.5)
pdb1m3y 0.0 (-1359.0) 94.1 (-1072.2) 100.0 (-1054.2) 100.0 (-1054.2) 100.0 (-1054.2) 100.0 (-1054.2)
pdb1qks 0.0 (-827.9) 97.3 (-661.7) 100.0 (-657.0) 100.0 (-657.0) 100.0 (-657.0) 100.0 (-657.0)
pedigree1 0.0 (-54.5) 100.0 (-45.6) 100.0 (-45.6) 100.0 (-45.6) 100.0 (-45.6) 100.0 (-45.6)
pedigree13 0.0 (-121.8) 99.9 (-73.4) 100.0 (-73.4) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree18 0.0 (-199.7) 99.9 (-125.3) 100.0 (-125.3) 100.0 (-125.3) 100.0 (-125.3) 100.0 (-125.3)
pedigree19 0.0 (-182.4) 99.4 (-97.6) 100.0 (-97.1) 100.0 (-97.1) 99.4 (-97.6) 99.4 (-97.6)
pedigree20 0.0 (-115.1) 100.0 (-53.8) 100.0 (-53.8) 100.0 (-53.8) 100.0 (-53.8) 100.0 (-53.8)
pedigree23 0.0 (-70.8) 100.0 (-62.4) 100.0 (-62.4) 100.0 (-62.4) 100.0 (-62.4) 100.0 (-62.4)
pedigree25 0.0 (-222.0) 100.0 (-160.8) 100.0 (-160.8) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree30 0.0 (-226.0) 100.0 (-137.0) 100.0 (-137.0) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree31 0.0 (-248.3) 99.8 (-130.7) 100.0 (-130.5) 97.3 (-133.7) 0.0 (-inf) 97.3 (-133.7)
pedigree33 0.0 (-148.2) 100.0 (-74.9) 100.0 (-74.9) 100.0 (-74.9) 100.0 (-74.9) 100.0 (-74.9)
pedigree34 0.0 (-172.2) 99.5 (-111.4) 100.0 (-111.1) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree37 0.0 (-228.6) 100.0 (-144.9) 100.0 (-144.9) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree38 0.0 (-142.9) 99.8 (-87.4) 100.0 (-87.3) 100.0 (-87.3) 100.0 (-87.3) 100.0 (-87.3)
pedigree39 0.0 (-243.0) 100.0 (-155.6) 100.0 (-155.6) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree40 0.0 (-227.2) 99.6 (-130.6) 100.0 (-130.2) 100.0 (-130.2) 99.6 (-130.6) 99.3 (-130.9)
pedigree41 0.0 (-205.3) 99.9 (-120.9) 100.0 (-120.7) 100.0 (-120.7) 100.0 (-120.7) 100.0 (-120.7)
pedigree42 0.0 (-93.2) 100.0 (-81.8) 100.0 (-81.8) 100.0 (-81.8) 100.0 (-81.8) 100.0 (-81.8)
pedigree44 0.0 (-153.8) 99.3 (-97.4) 100.0 (-97.0) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree50 0.0 (-98.4) 100.0 (-61.7) 100.0 (-61.7) 100.0 (-61.7) 100.0 (-61.7) 100.0 (-61.7)
pedigree51 0.0 (-208.3) 99.9 (-109.7) 100.0 (-109.6) 98.1 (-111.5) 98.1 (-111.5) 98.1 (-111.5)
pedigree7 0.0 (-171.9) 100.0 (-113.9) 100.0 (-113.9) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree9 0.0 (-212.1) 100.0 (-122.9) 100.0 (-122.9) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
rovers02ac.wcsp 0.0 (-92.2) 100.0 (-0.2) 100.0 (-0.2) 87.1 (-12.0) 91.5 (-8.0) 87.1 (-12.0)
rus_100_200_1_1 0.0 (1757.8) 96.0 (2646.5) 58.0 (2295.3) 100.0 (2683.9) 100.0 (2683.9) 100.0 (2683.9)
rus_100_200_2_1 0.0 (1757.8) 100.0 (2646.5) 60.5 (2295.3) 99.2 (2639.4) 99.2 (2639.4) 99.2 (2639.4)
rus_100_200_3_1 0.0 (1757.8) 100.0 (2646.5) 60.5 (2295.3) 88.0 (2539.4) 88.0 (2539.4) 88.0 (2539.4)
rus_100_200_3_3 0.0 (1757.8) 100.0 (2646.5) 60.5 (2295.3) 77.8 (2449.6) 77.8 (2449.6) 77.8 (2449.6)
rus_100_200_4_3 0.0 (1757.8) 100.0 (2646.5) 60.5 (2295.3) 81.2 (2479.5) 81.2 (2479.5) 81.2 (2479.5)
rus_100_200_5_3 0.0 (1757.8) 100.0 (2646.5) 60.5 (2295.3) 91.8 (2573.3) 91.8 (2573.3) 91.8 (2573.3)
rus_100_200_6_1 0.0 (1757.8) 100.0 (2646.5) 60.5 (2295.3) 58.4 (2276.7) 58.4 (2276.7) 55.8 (2254.0)
rus_50_100_4_1 0.0 (1341.6) 42.9 (1552.4) 80.7 (1738.2) 39.6 (1535.9) 39.6 (1535.9) 39.6 (1535.9)
rus_50_100_4_3 0.0 (1341.6) 42.9 (1552.4) 80.7 (1738.2) 55.8 (1615.8) 55.8 (1615.8) 55.8 (1615.8)
rus_50_100_6_1 0.0 (1341.6) 42.9 (1552.4) 80.7 (1738.2) 0.0 (1338.1) 0.0 (1338.1) 0.0 (1337.8)
rus_50_100_6_2 0.0 (1341.6) 42.9 (1552.4) 80.7 (1738.2) 64.1 (1656.5) 64.1 (1656.5) 64.1 (1656.5)
rus_50_100_7_1 0.0 (1341.6) 42.9 (1552.4) 80.7 (1738.2) 33.1 (1504.1) 33.1 (1504.1) 33.1 (1504.1)
rus_50_100_7_2 0.0 (1341.6) 42.9 (1552.4) 80.7 (1738.2) 34.2 (1509.9) 34.2 (1509.9) 34.2 (1509.9)
rus_50_100_8_1 0.0 (1341.6) 42.9 (1552.4) 80.7 (1738.2) 21.3 (1446.2) 21.3 (1446.2) 21.3 (1446.2)
rus_50_100_9_3 0.0 (1341.6) 42.9 (1552.4) 80.7 (1738.2) 55.5 (1614.3) 55.5 (1614.3) 55.5 (1614.3)
satellite01ac.wcsp 0.0 (-12.0) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1)
satellite02ac.wcsp 0.0 (-32.0) 37.6 (-20.0) 100.0 (-0.0) 100.0 (-0.0) 100.0 (-0.0) 100.0 (-0.0)
scen06.wcsp 0.0 (-83.6) 98.3 (-14.8) 98.9 (-14.3) 100.0 (-13.6) 100.0 (-13.6) 100.0 (-13.6)
scen07.wcsp 0.0 (-76.2) 98.7 (-2.4) 99.8 (-1.5) 100.0 (-1.4) 100.0 (-1.4) 100.0 (-1.4)
zenotravel02ac.wcsp 0.0 (-48.0) 100.0 (-0.1) 100.0 (-0.1) 66.8 (-16.0) 66.8 (-16.0) 66.8 (-16.0)
zenotravel04ac.wcsp 0.0 (-68.1) 58.9 (-28.0) 100.0 (-0.1) 58.9 (-28.0) 58.9 (-28.0) 58.9 (-28.0)

3600sec

Problem baseline daoopt-lh-mpe daoopt-mpe toulbar2-ipr-mpe toulbar2-vacint-mpe toulbar2-vns-mpe
1CKK 0.0 (4667.7) 76.0 (5316.3) 90.6 (5441.0) 100.0 (5520.9) 100.0 (5520.9) 100.0 (5520.9)
1CM1 0.0 (4505.6) 77.1 (5206.7) 99.9 (5413.8) 100.0 (5414.6) 100.0 (5414.6) 100.0 (5414.6)
1SY9 0.0 (3450.5) 78.9 (3872.4) 100.0 (3985.1) 100.0 (3985.1) 100.0 (3985.1) 100.0 (3985.1)
2BBN 0.0 (4729.9) 81.6 (5218.7) 99.8 (5327.5) 100.0 (5328.6) 100.0 (5328.6) 100.0 (5328.6)
2BCX 0.0 (4946.7) 83.5 (5828.5) 99.3 (5995.0) 100.0 (6002.2) 100.0 (6002.2) 100.0 (6002.2)
BN-d-10000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (-1152.5) 0.0 (nan)
BN-d-200-5-10 0.0 (-53.5) 92.2 (-47.1) 98.4 (-46.6) 100.0 (-46.5) 99.3 (-46.6) 100.0 (-46.5)
BN-d-20000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (-2338.6) 0.0 (nan)
BN-d-250-5-10 0.0 (-63.6) 73.9 (-58.4) 85.0 (-57.7) 100.0 (-56.6) 86.5 (-57.6) 100.0 (-56.6)
BN-d-500-5-10 0.0 (-129.4) 74.2 (-120.2) 71.5 (-120.6) 99.7 (-117.1) 75.5 (-120.1) 100.0 (-117.0)
BN-nd-10000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (-1305.9) 0.0 (nan)
BN-nd-200-5-10 0.0 (-60.7) 85.2 (-55.4) 94.9 (-54.8) 100.0 (-54.5) 98.2 (-54.6) 99.1 (-54.5)
BN-nd-20000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (-2573.6) 0.0 (nan)
BN-nd-250-5-10 0.0 (-72.2) 74.2 (-67.1) 91.9 (-65.8) 91.7 (-65.8) 88.9 (-66.0) 100.0 (-65.3)
BN-nd-500-5-10 0.0 (-146.4) 83.6 (-136.8) 62.6 (-139.2) 100.0 (-134.9) 77.3 (-137.5) 90.8 (-135.9)
Hardsat_aes_64_1_keyfind_1 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
Hardsat_gss-25-s100 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
Hardsat_mod2c-rand3bip-sat-240-3.shuffled-as.sat05-2520 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
Hardsat_mod2c-rand3bip-sat-250-3.shuffled-as.sat05-2535 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
Hardsat_mod4block_2vars_10gates_u2_autoenc 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
Maxsat_aes_64_1_keyfind_1 0.0 (1806.1) 96.8 (1867.6) 100.0 (1869.6) 25.9 (1822.6) 21.1 (1819.5) 30.7 (1825.6)
Maxsat_gss-25-s100 0.0 (nan) 0.0 (63581.0) 0.0 (63382.3) 0.0 (63026.1) 0.0 (63302.4) 0.0 (63491.6)
Maxsat_mod2c-rand3bip-sat-240-3.shuffled-as.sat05-2520 0.0 (1580.0) 83.2 (1629.4) 89.9 (1633.4) 100.0 (1639.4) 79.0 (1626.9) 88.9 (1632.8)
Maxsat_mod2c-rand3bip-sat-250-3.shuffled-as.sat05-2535 0.0 (1634.5) 93.7 (1689.3) 81.6 (1682.2) 100.0 (1692.9) 79.3 (1680.9) 91.5 (1688.0)
Maxsat_mod4block_2vars_10gates_u2_autoenc 0.0 (80875.5) 25.3 (80987.3) 0.0 (80856.5) 100.0 (81316.6) 98.5 (81310.0) 78.4 (81221.2)
Promedas_60 0.0 (-30.3) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0)
Promedas_61 0.0 (-21.7) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9)
Promedas_62 0.0 (-26.2) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7)
Promedas_63 0.0 (-20.2) 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1)
Promedas_64 0.0 (-26.5) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5)
Promedas_65 0.0 (-23.4) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2)
Promedas_66 0.0 (-26.7) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4)
Promedas_67 0.0 (-38.9) 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4)
Promedas_68 0.0 (-55.9) 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9)
Promedas_69 0.0 (-23.9) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2)
driverlog04ac.wcsp 0.0 (-104.1) 88.6 (-12.0) 100.0 (-0.2) 88.5 (-12.1) 88.5 (-12.1) 88.5 (-12.1)
driverlog05ac.wcsp 0.0 (-100.1) 84.0 (-16.0) 100.0 (-0.1) 80.0 (-20.0) 80.0 (-20.0) 80.0 (-20.0)
driverlog08ac.wcsp 0.0 (-108.1) 59.4 (-44.0) 100.0 (-0.1) 77.8 (-24.0) 77.8 (-24.0) 77.8 (-24.0)
grid20x20.f10 0.0 (830.6) 100.0 (1309.7) 100.0 (1309.7) 100.0 (1309.7) 98.9 (1304.2) 98.5 (1302.7)
grid20x20.f10.wrap 0.0 (817.2) 100.0 (1325.0) 100.0 (1325.0) 100.0 (1325.0) 98.9 (1319.4) 99.1 (1320.5)
grid20x20.f15 0.0 (1230.9) 100.0 (1961.8) 100.0 (1961.8) 100.0 (1961.8) 99.6 (1959.0) 97.6 (1944.4)
grid20x20.f15.wrap 0.0 (1204.0) 99.1 (1975.0) 100.0 (1981.8) 100.0 (1981.8) 99.4 (1977.3) 98.2 (1967.6)
grid20x20.f5.wrap 0.0 (430.5) 100.0 (670.0) 100.0 (670.0) 100.0 (670.0) 98.9 (667.4) 96.6 (661.9)
grid40x40.f10 0.0 (3580.9) 99.8 (5499.8) 100.0 (5504.4) 100.0 (5504.4) 93.4 (5376.9) 98.8 (5480.4)
grid40x40.f10.wrap 0.0 (3371.4) 99.9 (5672.4) 100.0 (5674.4) 100.0 (5674.4) 95.5 (5569.8) 97.8 (5622.9)
grid40x40.f15 0.0 (5300.0) 99.2 (8210.6) 100.0 (8234.3) 99.8 (8228.8) 95.0 (8087.8) 97.8 (8169.7)
grid40x40.f15.wrap 0.0 (4967.7) 99.3 (8472.0) 100.0 (8496.7) 100.0 (8496.7) 94.1 (8287.3) 98.2 (8434.3)
grid40x40.f2 0.0 (846.4) 99.9 (1167.6) 100.0 (1167.8) 100.0 (1167.8) 87.4 (1127.2) 99.5 (1166.1)
grid40x40.f2.wrap 0.0 (837.0) 99.4 (1177.3) 100.0 (1179.2) 100.0 (1179.2) 98.3 (1173.5) 99.5 (1177.6)
grid40x40.f5 0.0 (1853.7) 99.8 (2779.7) 100.0 (2781.6) 100.0 (2781.6) 95.8 (2743.1) 98.7 (2769.4)
grid40x40.f5.wrap 0.0 (1803.2) 99.2 (2817.0) 100.0 (2825.5) 100.0 (2825.5) 94.7 (2771.1) 98.7 (2812.1)
grid80x80.f10 0.0 (13670.1) 98.8 (21823.6) 100.0 (21925.9) 98.4 (21794.5) 94.3 (21454.1) 98.5 (21801.2)
grid80x80.f10.wrap 0.0 (13794.2) 97.6 (21821.3) 100.0 (22019.3) 98.6 (21905.2) 95.7 (21665.5) 99.1 (21945.7)
grid80x80.f15 0.0 (20172.3) 98.3 (32587.8) 100.0 (32808.8) 98.2 (32582.2) 94.1 (32066.8) 99.2 (32713.9)
grid80x80.f15.wrap 0.0 (20033.2) 97.7 (32914.3) 100.0 (33223.8) 98.1 (32971.6) 94.7 (32521.0) 99.2 (33123.5)
grid80x80.f2 0.0 (3413.5) 98.7 (4661.1) 100.0 (4677.6) 100.0 (4677.7) 95.8 (4624.8) 99.8 (4674.6)
grid80x80.f2.wrap 0.0 (3346.5) 99.3 (4725.5) 100.0 (4735.7) 100.0 (4735.7) 95.2 (4668.6) 99.7 (4731.6)
grid80x80.f5 0.0 (7444.4) 98.1 (11085.6) 100.0 (11155.6) 98.4 (11097.7) 94.3 (10945.3) 99.0 (11119.9)
grid80x80.f5.wrap 0.0 (7246.2) 97.2 (11006.6) 100.0 (11113.9) 99.0 (11073.6) 95.1 (10924.6) 98.2 (11045.4)
pdb1jmx 0.0 (-633.6) 96.5 (-506.1) 100.0 (-501.4) 100.0 (-501.4) 100.0 (-501.4) 100.0 (-501.4)
pdb1kgn 0.0 (-957.1) 92.4 (-764.6) 100.0 (-748.7) 100.0 (-748.7) 100.0 (-748.7) 100.0 (-748.7)
pdb1kwh 0.0 (-413.1) 98.2 (-307.5) 100.0 (-305.5) 100.0 (-305.5) 100.0 (-305.5) 100.0 (-305.5)
pdb1m3y 0.0 (-1359.0) 93.6 (-1073.7) 100.0 (-1054.2) 100.0 (-1054.2) 100.0 (-1054.2) 100.0 (-1054.2)
pdb1qks 0.0 (-827.9) 99.0 (-658.8) 100.0 (-657.0) 100.0 (-657.0) 100.0 (-657.0) 100.0 (-657.0)
pedigree1 0.0 (-54.5) 100.0 (-45.6) 100.0 (-45.6) 100.0 (-45.6) 100.0 (-45.6) 100.0 (-45.6)
pedigree13 0.0 (-121.8) 100.0 (-73.4) 100.0 (-73.4) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree18 0.0 (-199.7) 100.0 (-125.3) 100.0 (-125.3) 100.0 (-125.3) 100.0 (-125.3) 100.0 (-125.3)
pedigree19 0.0 (-182.4) 99.4 (-97.6) 100.0 (-97.1) 100.0 (-97.1) 99.5 (-97.5) 99.4 (-97.6)
pedigree20 0.0 (-115.1) 100.0 (-53.8) 100.0 (-53.8) 100.0 (-53.8) 100.0 (-53.8) 100.0 (-53.8)
pedigree23 0.0 (-70.8) 100.0 (-62.4) 100.0 (-62.4) 100.0 (-62.4) 100.0 (-62.4) 100.0 (-62.4)
pedigree25 0.0 (-222.0) 100.0 (-160.8) 100.0 (-160.8) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree30 0.0 (-226.0) 100.0 (-137.0) 100.0 (-137.0) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree31 0.0 (-248.3) 100.0 (-130.5) 100.0 (-130.5) 97.3 (-133.7) 0.0 (-inf) 97.3 (-133.7)
pedigree33 0.0 (-148.2) 100.0 (-74.9) 100.0 (-74.9) 100.0 (-74.9) 100.0 (-74.9) 100.0 (-74.9)
pedigree34 0.0 (-172.2) 100.0 (-111.1) 100.0 (-111.1) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree37 0.0 (-228.6) 100.0 (-144.9) 100.0 (-144.9) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree38 0.0 (-142.9) 100.0 (-87.3) 100.0 (-87.3) 100.0 (-87.3) 100.0 (-87.3) 100.0 (-87.3)
pedigree39 0.0 (-243.0) 100.0 (-155.6) 100.0 (-155.6) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree40 0.0 (-227.2) 99.9 (-130.4) 100.0 (-130.2) 100.0 (-130.2) 99.6 (-130.6) 99.3 (-130.9)
pedigree41 0.0 (-205.3) 100.0 (-120.7) 100.0 (-120.7) 100.0 (-120.7) 100.0 (-120.7) 100.0 (-120.7)
pedigree42 0.0 (-93.2) 100.0 (-81.8) 100.0 (-81.8) 100.0 (-81.8) 100.0 (-81.8) 100.0 (-81.8)
pedigree44 0.0 (-153.8) 100.0 (-97.0) 100.0 (-97.0) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree50 0.0 (-98.4) 100.0 (-61.7) 100.0 (-61.7) 100.0 (-61.7) 100.0 (-61.7) 100.0 (-61.7)
pedigree51 0.0 (-208.3) 99.7 (-109.9) 100.0 (-109.6) 98.1 (-111.5) 98.1 (-111.5) 98.1 (-111.5)
pedigree7 0.0 (-171.9) 100.0 (-113.9) 100.0 (-113.9) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
pedigree9 0.0 (-212.1) 100.0 (-122.9) 100.0 (-122.9) 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
rovers02ac.wcsp 0.0 (-92.2) 100.0 (-0.2) 100.0 (-0.2) 87.1 (-12.0) 91.5 (-8.0) 87.1 (-12.0)
rus_100_200_1_1 0.0 (1757.8) 96.0 (2646.5) 58.0 (2295.3) 100.0 (2683.9) 100.0 (2683.9) 100.0 (2683.9)
rus_100_200_2_1 0.0 (1757.8) 100.0 (2646.5) 60.5 (2295.3) 99.2 (2639.4) 99.2 (2639.4) 99.2 (2639.4)
rus_100_200_3_1 0.0 (1757.8) 100.0 (2646.5) 60.5 (2295.3) 88.0 (2539.4) 88.0 (2539.4) 88.0 (2539.4)
rus_100_200_3_3 0.0 (1757.8) 100.0 (2646.5) 60.5 (2295.3) 77.8 (2449.6) 77.8 (2449.6) 77.8 (2449.6)
rus_100_200_4_3 0.0 (1757.8) 100.0 (2646.5) 60.5 (2295.3) 81.2 (2479.5) 81.2 (2479.5) 81.2 (2479.5)
rus_100_200_5_3 0.0 (1757.8) 100.0 (2646.5) 60.5 (2295.3) 91.8 (2573.3) 91.8 (2573.3) 91.8 (2573.3)
rus_100_200_6_1 0.0 (1757.8) 100.0 (2646.5) 60.5 (2295.3) 58.4 (2276.7) 58.4 (2276.7) 55.8 (2254.0)
rus_50_100_4_1 0.0 (1341.6) 100.0 (1832.8) 80.7 (1738.2) 39.6 (1535.9) 39.6 (1535.9) 39.6 (1535.9)
rus_50_100_4_3 0.0 (1341.6) 100.0 (1832.8) 80.7 (1738.2) 55.8 (1615.8) 55.8 (1615.8) 55.8 (1615.8)
rus_50_100_6_1 0.0 (1341.6) 100.0 (1832.8) 80.7 (1738.2) 0.0 (1338.1) 0.0 (1338.1) 0.0 (1338.1)
rus_50_100_6_2 0.0 (1341.6) 100.0 (1832.8) 80.7 (1738.2) 64.1 (1656.5) 64.1 (1656.5) 64.1 (1656.5)
rus_50_100_7_1 0.0 (1341.6) 100.0 (1832.8) 80.7 (1738.2) 33.1 (1504.1) 33.1 (1504.1) 33.1 (1504.1)
rus_50_100_7_2 0.0 (1341.6) 100.0 (1832.8) 80.7 (1738.2) 34.2 (1509.9) 34.2 (1509.9) 34.2 (1509.9)
rus_50_100_8_1 0.0 (1341.6) 100.0 (1832.8) 80.7 (1738.2) 21.3 (1446.2) 21.3 (1446.2) 21.3 (1446.2)
rus_50_100_9_3 0.0 (1341.6) 100.0 (1832.8) 80.7 (1738.2) 55.5 (1614.3) 55.5 (1614.3) 55.5 (1614.3)
satellite01ac.wcsp 0.0 (-12.0) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1)
satellite02ac.wcsp 0.0 (-32.0) 37.6 (-20.0) 100.0 (-0.0) 100.0 (-0.0) 100.0 (-0.0) 100.0 (-0.0)
scen06.wcsp 0.0 (-83.6) 98.3 (-14.8) 98.9 (-14.3) 100.0 (-13.6) 100.0 (-13.6) 100.0 (-13.6)
scen07.wcsp 0.0 (-76.2) 98.7 (-2.4) 99.6 (-1.7) 100.0 (-1.4) 100.0 (-1.4) 100.0 (-1.4)
zenotravel02ac.wcsp 0.0 (-48.0) 100.0 (-0.1) 100.0 (-0.1) 66.8 (-16.0) 66.8 (-16.0) 66.8 (-16.0)
zenotravel04ac.wcsp 0.0 (-68.1) 58.9 (-28.0) 100.0 (-0.1) 58.9 (-28.0) 58.9 (-28.0) 58.9 (-28.0)

Updated: