The results below are organized as follows:

  • each table below displays various solvers’ performance for individual problem instances for the given task and time limit
  • table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria

overall

20sec

Problem baseline daoopt-lh-mpe daoopt-mpe toulbar2-ipr-mpe toulbar2-vacint-mpe toulbar2-vns-mpe
1CKK 0.0 (4667.7) 76.0 (5316.3) 78.3 (5335.5) 0.0 (nan) 0.0 (nan) 96.9 (5494.2)
1CM1 0.0 (4505.6) 77.1 (5206.7) 95.4 (5372.4) 0.0 (nan) 0.0 (nan) 100.0 (5414.6)
1SY9 0.0 (3450.5) 78.9 (3872.4) 97.3 (3970.7) 0.0 (nan) 0.0 (nan) 100.0 (3985.1)
2BBN 0.0 (4729.9) 58.2 (5078.1) 75.8 (5183.5) 0.0 (nan) 0.0 (nan) 0.0 (nan)
2BCX 0.0 (4946.7) 83.5 (5828.5) 88.3 (5878.2) 0.0 (nan) 0.0 (nan) 0.0 (nan)
BN-d-10000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
BN-d-200-5-10 0.0 (-53.5) 92.2 (-47.1) 86.3 (-47.5) 95.3 (-46.9) 99.3 (-46.6) 100.0 (-46.5)
BN-d-20000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
BN-d-250-5-10 0.0 (-63.6) 73.9 (-58.4) 88.8 (-57.4) 0.0 (nan) 86.5 (-57.6) 92.8 (-57.1)
BN-d-500-5-10 0.0 (-129.4) 74.2 (-120.2) 72.5 (-120.4) 0.0 (nan) 61.3 (-121.8) 75.1 (-120.1)
BN-nd-10000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
BN-nd-200-5-10 0.0 (-60.7) 85.2 (-55.4) 79.6 (-55.7) 0.0 (nan) 98.2 (-54.6) 99.1 (-54.5)
BN-nd-20000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
BN-nd-250-5-10 0.0 (-72.2) 74.2 (-67.1) 74.1 (-67.1) 0.0 (nan) 88.9 (-66.0) 100.0 (-65.3)
BN-nd-500-5-10 0.0 (-146.4) 83.6 (-136.8) 76.8 (-137.5) 0.0 (nan) 67.5 (-138.6) 89.6 (-136.1)
Maxsat_aes_64_1_keyfind_1 0.0 (1806.1) 87.2 (1861.5) 95.2 (1866.5) 61.5 (1845.2) 80.9 (1857.4) 92.7 (1864.9)
Maxsat_gss-25-s100 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
Maxsat_mod2c-rand3bip-sat-240-3.shuffled-as.sat05-2520 0.0 (1580.0) 75.9 (1625.1) 83.9 (1629.8) 79.0 (1626.9) 79.0 (1626.9) 88.8 (1632.8)
Maxsat_mod2c-rand3bip-sat-250-3.shuffled-as.sat05-2535 0.0 (1634.5) 81.5 (1682.2) 95.3 (1690.2) 85.0 (1684.2) 79.3 (1680.9) 91.5 (1688.0)
Maxsat_mod4block_2vars_10gates_u2_autoenc 0.0 (80875.5) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
Promedas_60 0.0 (-30.3) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0)
Promedas_61 0.0 (-21.7) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9)
Promedas_62 0.0 (-26.2) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7)
Promedas_63 0.0 (-20.2) 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1)
Promedas_64 0.0 (-26.5) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5)
Promedas_65 0.0 (-23.4) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2)
Promedas_66 0.0 (-26.7) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4)
Promedas_67 0.0 (-38.9) 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4)
Promedas_68 0.0 (-55.9) 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9)
Promedas_69 0.0 (-23.9) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2)
driverlog04ac.wcsp 0.0 (-104.1) 65.5 (-36.0) 80.9 (-20.0) 100.0 (-0.2) 100.0 (-0.2) 100.0 (-0.2)
driverlog05ac.wcsp 0.0 (-100.1) 68.1 (-32.0) 72.1 (-28.0) 88.0 (-12.0) 100.0 (-0.1) 100.0 (-0.1)
driverlog08ac.wcsp 0.0 (-108.1) 59.4 (-44.0) 74.2 (-28.0) 88.9 (-12.1) 100.0 (-0.1) 92.6 (-8.1)
grid20x20.f10 0.0 (830.6) 100.0 (1309.7) 100.0 (1309.7) 100.0 (1309.7) 97.4 (1297.0) 96.9 (1294.7)
grid20x20.f10.wrap 0.0 (817.2) 100.0 (1325.0) 100.0 (1325.0) 100.0 (1325.0) 97.1 (1310.1) 97.0 (1309.6)
grid20x20.f15 0.0 (1230.9) 99.9 (1961.1) 100.0 (1961.8) 100.0 (1961.8) 98.7 (1952.0) 97.6 (1944.4)
grid20x20.f15.wrap 0.0 (1204.0) 100.0 (1981.8) 100.0 (1981.8) 100.0 (1981.8) 91.8 (1917.7) 98.2 (1967.6)
grid20x20.f5.wrap 0.0 (430.5) 100.0 (670.0) 100.0 (670.0) 100.0 (670.0) 91.4 (649.3) 96.6 (661.9)
grid40x40.f10 0.0 (3580.9) 94.3 (5395.3) 100.0 (5504.4) 97.7 (5460.0) 91.8 (5346.3) 98.0 (5466.6)
grid40x40.f10.wrap 0.0 (3371.4) 91.7 (5482.9) 100.0 (5674.0) 81.4 (5246.8) 95.2 (5563.7) 97.4 (5614.1)
grid40x40.f15 0.0 (5300.0) 95.2 (8093.3) 99.8 (8227.6) 96.5 (8130.5) 94.3 (8066.4) 96.9 (8143.6)
grid40x40.f15.wrap 0.0 (4967.7) 92.3 (8225.5) 100.0 (8495.2) 82.6 (7883.7) 92.7 (8237.7) 97.6 (8410.5)
grid40x40.f2 0.0 (846.4) 94.9 (1151.4) 100.0 (1167.8) 100.0 (1167.8) 87.4 (1127.2) 99.5 (1166.1)
grid40x40.f2.wrap 0.0 (837.0) 91.7 (1150.8) 100.0 (1179.2) 93.4 (1156.6) 96.7 (1167.9) 99.5 (1177.6)
grid40x40.f5 0.0 (1853.7) 93.9 (2725.1) 100.0 (2781.6) 99.2 (2773.8) 94.8 (2733.8) 98.7 (2769.4)
grid40x40.f5.wrap 0.0 (1803.2) 92.1 (2744.5) 99.3 (2817.8) 79.8 (2618.7) 93.3 (2757.0) 96.6 (2790.4)
grid80x80.f10 0.0 (13670.1) 93.3 (21375.3) 93.3 (21368.9) 0.0 (nan) 77.6 (20079.9) 92.9 (21340.7)
grid80x80.f10.wrap 0.0 (13794.2) 91.4 (21310.0) 91.1 (21291.4) 0.0 (nan) 76.2 (20062.1) 93.0 (21442.6)
grid80x80.f15 0.0 (20172.3) 93.6 (32004.1) 93.6 (31999.4) 0.0 (nan) 77.5 (29969.1) 93.8 (32023.6)
grid80x80.f15.wrap 0.0 (20033.2) 93.2 (32330.4) 92.8 (32269.9) 0.0 (nan) 80.3 (30619.9) 93.4 (32354.8)
grid80x80.f2 0.0 (3413.5) 91.7 (4573.3) 92.9 (4588.4) 0.0 (nan) 74.5 (4355.8) 92.0 (4577.2)
grid80x80.f2.wrap 0.0 (3346.5) 90.7 (4606.9) 94.2 (4655.1) 0.0 (nan) 76.5 (4409.3) 94.0 (4652.6)
grid80x80.f5 0.0 (7444.4) 90.9 (10820.2) 92.3 (10872.1) 0.0 (nan) 75.2 (10237.6) 92.5 (10879.4)
grid80x80.f5.wrap 0.0 (7246.2) 92.1 (10811.7) 91.7 (10794.3) 0.0 (nan) 75.3 (10160.6) 91.2 (10776.6)
pdb1jmx 0.0 (-633.6) 93.1 (-510.6) 100.0 (-501.4) 100.0 (-501.4) 100.0 (-501.4) 100.0 (-501.4)
pdb1kgn 0.0 (-957.1) 90.7 (-768.1) 99.8 (-749.2) 100.0 (-748.7) 100.0 (-748.7) 99.8 (-749.2)
pdb1kwh 0.0 (-413.1) 98.2 (-307.5) 100.0 (-305.5) 100.0 (-305.5) 100.0 (-305.5) 100.0 (-305.5)
pdb1m3y 0.0 (-1359.0) 93.6 (-1073.7) 99.9 (-1054.6) 100.0 (-1054.2) 100.0 (-1054.2) 100.0 (-1054.2)
pdb1qks 0.0 (-827.9) 97.3 (-661.7) 100.0 (-657.0) 100.0 (-657.0) 100.0 (-657.0) 100.0 (-657.0)
pedigree1 0.0 (-54.5) 100.0 (-45.6) 100.0 (-45.6) 100.0 (-45.6) 100.0 (-45.6) 100.0 (-45.6)
pedigree13 0.0 (-121.8) 99.9 (-73.4) 100.0 (-73.4) 100.0 (-73.4) 100.0 (-73.4) 100.0 (-73.4)
pedigree18 0.0 (-199.7) 100.0 (-125.3) 100.0 (-125.3) 100.0 (-125.3) 98.0 (-126.8) 100.0 (-125.3)
pedigree19 0.0 (-182.4) 99.2 (-97.8) 99.3 (-97.7) 99.4 (-97.6) 97.8 (-99.0) 94.5 (-101.8)
pedigree20 0.0 (-115.1) 100.0 (-53.8) 100.0 (-53.8) 100.0 (-53.8) 100.0 (-53.8) 100.0 (-53.8)
pedigree23 0.0 (-70.8) 100.0 (-62.4) 100.0 (-62.4) 100.0 (-62.4) 100.0 (-62.4) 100.0 (-62.4)
pedigree25 0.0 (-222.0) 100.0 (-160.8) 100.0 (-160.8) 100.0 (-160.8) 100.0 (-160.8) 99.9 (-160.9)
pedigree30 0.0 (-226.0) 100.0 (-137.0) 100.0 (-137.0) 100.0 (-137.0) 98.9 (-138.0) 99.3 (-137.6)
pedigree31 0.0 (-248.3) 99.8 (-130.7) 99.9 (-130.6) 100.0 (-130.5) 100.0 (-130.5) 99.4 (-131.2)
pedigree33 0.0 (-148.2) 100.0 (-74.9) 100.0 (-74.9) 100.0 (-74.9) 100.0 (-74.9) 100.0 (-74.9)
pedigree34 0.0 (-172.2) 99.5 (-111.4) 100.0 (-111.1) 100.0 (-111.1) 100.0 (-111.1) 100.0 (-111.1)
pedigree37 0.0 (-228.6) 100.0 (-144.9) 100.0 (-144.9) 100.0 (-144.9) 100.0 (-144.9) 100.0 (-144.9)
pedigree38 0.0 (-142.9) 99.8 (-87.4) 100.0 (-87.3) 100.0 (-87.3) 100.0 (-87.3) 100.0 (-87.3)
pedigree39 0.0 (-243.0) 99.2 (-156.4) 100.0 (-155.6) 100.0 (-155.6) 100.0 (-155.6) 100.0 (-155.6)
pedigree40 0.0 (-227.2) 99.5 (-130.8) 99.4 (-130.8) 100.0 (-130.3) 97.3 (-132.8) 97.9 (-132.3)
pedigree41 0.0 (-205.3) 99.9 (-120.9) 100.0 (-120.7) 100.0 (-120.7) 98.6 (-121.9) 98.8 (-121.8)
pedigree42 0.0 (-93.2) 99.9 (-81.8) 100.0 (-81.8) 100.0 (-81.8) 100.0 (-81.8) 100.0 (-81.8)
pedigree44 0.0 (-153.8) 99.8 (-97.1) 100.0 (-97.0) 100.0 (-97.0) 98.5 (-97.8) 98.3 (-98.0)
pedigree50 0.0 (-98.4) 99.7 (-61.8) 100.0 (-61.7) 100.0 (-61.7) 100.0 (-61.7) 100.0 (-61.7)
pedigree51 0.0 (-208.3) 99.7 (-109.9) 99.9 (-109.7) 100.0 (-109.6) 97.9 (-111.7) 99.9 (-109.7)
pedigree7 0.0 (-171.9) 99.6 (-114.1) 100.0 (-113.9) 100.0 (-113.9) 100.0 (-113.9) 100.0 (-113.9)
pedigree9 0.0 (-212.1) 100.0 (-122.9) 99.9 (-123.0) 100.0 (-122.9) 97.9 (-124.8) 96.4 (-126.1)
rovers02ac.wcsp 0.0 (-92.2) 100.0 (-0.2) 100.0 (-0.2) 100.0 (-0.2) 100.0 (-0.2) 100.0 (-0.2)
rus_100_200_1_1 0.0 (2604.1) 0.0 (nan) 0.0 (nan) 0.0 (nan) 100.0 (2683.9) 44.6 (2639.6)
rus_100_200_2_1 0.0 (2576.7) 0.0 (nan) 0.0 (nan) 0.0 (nan) 100.0 (2639.4) 72.6 (2622.2)
rus_100_200_3_1 0.0 (2454.8) 0.0 (nan) 0.0 (nan) 0.0 (nan) 100.0 (2539.4) 3.6 (2457.8)
rus_100_200_3_3 0.0 (2390.9) 0.0 (nan) 0.0 (nan) 0.0 (nan) 100.0 (2449.6) 0.0 (2383.2)
rus_100_200_4_3 0.0 (2395.8) 0.0 (nan) 0.0 (nan) 0.0 (nan) 100.0 (2479.5) 46.7 (2434.9)
rus_100_200_5_3 0.0 (2497.0) 0.0 (nan) 0.0 (nan) 0.0 (nan) 100.0 (2573.3) 33.8 (2522.8)
rus_100_200_6_1 0.0 (2197.4) 0.0 (nan) 0.0 (nan) 0.0 (nan) 100.0 (2276.7) 37.8 (2227.3)
rus_50_100_4_1 0.0 (1500.0) 0.0 (1496.1) 33.6 (1512.1) 100.0 (1535.9) 100.0 (1535.9) 100.0 (1535.9)
rus_50_100_4_3 0.0 (1579.0) 94.9 (1613.9) 94.9 (1613.9) 100.0 (1615.8) 100.0 (1615.8) 100.0 (1615.8)
rus_50_100_6_1 0.0 (1302.2) 64.7 (1325.5) 63.6 (1325.1) 100.0 (1338.1) 100.0 (1338.1) 99.0 (1337.8)
rus_50_100_6_2 0.0 (1616.2) 66.2 (1642.9) 80.7 (1648.7) 100.0 (1656.5) 100.0 (1656.5) 100.0 (1656.5)
rus_50_100_7_1 0.0 (1457.7) 33.9 (1473.5) 30.2 (1471.7) 100.0 (1504.1) 100.0 (1504.1) 100.0 (1504.1)
rus_50_100_7_2 0.0 (1465.1) 86.6 (1503.8) 86.6 (1503.8) 100.0 (1509.9) 100.0 (1509.9) 100.0 (1509.9)
rus_50_100_8_1 0.0 (1402.5) 68.6 (1432.5) 96.3 (1444.5) 100.0 (1446.2) 100.0 (1446.2) 100.0 (1446.2)
rus_50_100_9_3 0.0 (1568.8) 54.8 (1593.7) 61.2 (1596.7) 100.0 (1614.3) 100.0 (1614.3) 100.0 (1614.3)
satellite01ac.wcsp 0.0 (-12.0) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1)
satellite02ac.wcsp 0.0 (-32.0) 37.6 (-20.0) 37.6 (-20.0) 100.0 (-0.0) 100.0 (-0.0) 100.0 (-0.0)
scen06.wcsp 0.0 (-83.6) 98.3 (-14.8) 98.9 (-14.3) 99.9 (-13.6) 99.3 (-14.1) 100.0 (-13.6)
scen07.wcsp 0.0 (-76.2) 98.7 (-2.4) 99.5 (-1.8) 94.3 (-5.6) 99.7 (-1.6) 100.0 (-1.4)
zenotravel02ac.wcsp 0.0 (-48.0) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1)
zenotravel04ac.wcsp 0.0 (-68.1) 58.9 (-28.0) 76.5 (-16.0) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1)

1200sec

Problem baseline daoopt-lh-mpe daoopt-mpe toulbar2-ipr-mpe toulbar2-vacint-mpe toulbar2-vns-mpe
1CKK 0.0 (4667.7) 76.0 (5316.3) 90.5 (5439.5) 100.0 (5520.9) 100.0 (5520.9) 100.0 (5520.9)
1CM1 0.0 (4505.6) 77.1 (5206.7) 99.9 (5413.8) 100.0 (5414.6) 100.0 (5414.6) 100.0 (5414.6)
1SY9 0.0 (3450.5) 78.9 (3872.4) 89.1 (3926.8) 100.0 (3985.1) 100.0 (3985.1) 100.0 (3985.1)
2BBN 0.0 (4729.9) 81.6 (5218.7) 98.2 (5317.9) 100.0 (5328.6) 100.0 (5328.6) 100.0 (5328.6)
2BCX 0.0 (4946.7) 83.5 (5828.5) 95.1 (5951.0) 100.0 (6002.2) 100.0 (6002.2) 100.0 (6002.2)
BN-d-10000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 36.5 (-1154.2) 0.0 (nan)
BN-d-200-5-10 0.0 (-53.5) 92.2 (-47.1) 94.6 (-46.9) 100.0 (-46.5) 99.3 (-46.6) 100.0 (-46.5)
BN-d-20000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 100.0 (-2338.6) 0.0 (nan)
BN-d-250-5-10 0.0 (-63.6) 73.9 (-58.4) 85.7 (-57.6) 100.0 (-56.6) 86.5 (-57.6) 100.0 (-56.6)
BN-d-500-5-10 0.0 (-129.4) 74.2 (-120.2) 77.9 (-119.8) 99.7 (-117.1) 75.5 (-120.1) 100.0 (-117.0)
BN-nd-10000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 24.9 (-1308.1) 0.0 (nan)
BN-nd-200-5-10 0.0 (-60.7) 85.2 (-55.4) 84.4 (-55.4) 100.0 (-54.5) 98.2 (-54.6) 99.1 (-54.5)
BN-nd-20000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 60.1 (-2574.3) 0.0 (nan)
BN-nd-250-5-10 0.0 (-72.2) 74.2 (-67.1) 83.1 (-66.4) 91.7 (-65.8) 88.9 (-66.0) 100.0 (-65.3)
BN-nd-500-5-10 0.0 (-146.4) 83.6 (-136.8) 62.1 (-139.2) 100.0 (-134.9) 77.3 (-137.5) 90.8 (-135.9)
Maxsat_aes_64_1_keyfind_1 0.0 (1806.1) 95.8 (1866.9) 99.6 (1869.4) 99.5 (1869.3) 84.1 (1859.5) 95.9 (1867.0)
Maxsat_gss-25-s100 0.0 (nan) 46.5 (63283.8) 66.2 (63393.0) 0.2 (63026.1) 49.9 (63302.4) 73.8 (63435.1)
Maxsat_mod2c-rand3bip-sat-240-3.shuffled-as.sat05-2520 0.0 (1580.0) 88.9 (1632.8) 86.2 (1631.2) 96.6 (1637.4) 79.0 (1626.9) 88.9 (1632.8)
Maxsat_mod2c-rand3bip-sat-250-3.shuffled-as.sat05-2535 0.0 (1634.5) 91.4 (1687.9) 81.6 (1682.2) 98.6 (1692.1) 79.3 (1680.9) 91.5 (1688.0)
Maxsat_mod4block_2vars_10gates_u2_autoenc 0.0 (80875.5) 1.4 (80881.7) 0.0 (80856.5) 99.0 (81310.6) 98.9 (81310.1) 80.8 (81230.7)
Promedas_60 0.0 (-30.3) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0)
Promedas_61 0.0 (-21.7) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9)
Promedas_62 0.0 (-26.2) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7)
Promedas_63 0.0 (-20.2) 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1)
Promedas_64 0.0 (-26.5) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5)
Promedas_65 0.0 (-23.4) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2)
Promedas_66 0.0 (-26.7) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4)
Promedas_67 0.0 (-38.9) 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4)
Promedas_68 0.0 (-55.9) 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9)
Promedas_69 0.0 (-23.9) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2)
driverlog04ac.wcsp 0.0 (-104.1) 65.5 (-36.0) 100.0 (-0.2) 100.0 (-0.2) 100.0 (-0.2) 100.0 (-0.2)
driverlog05ac.wcsp 0.0 (-100.1) 68.1 (-32.0) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1)
driverlog08ac.wcsp 0.0 (-108.1) 59.4 (-44.0) 77.8 (-24.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1)
grid20x20.f10 0.0 (830.6) 99.9 (1309.4) 100.0 (1309.7) 100.0 (1309.7) 98.5 (1302.6) 98.5 (1302.7)
grid20x20.f10.wrap 0.0 (817.2) 100.0 (1325.0) 100.0 (1325.0) 100.0 (1325.0) 98.9 (1319.4) 97.0 (1309.6)
grid20x20.f15 0.0 (1230.9) 100.0 (1961.8) 100.0 (1961.8) 100.0 (1961.8) 99.6 (1959.0) 97.6 (1944.4)
grid20x20.f15.wrap 0.0 (1204.0) 100.0 (1981.8) 100.0 (1981.8) 100.0 (1981.8) 98.9 (1973.3) 98.2 (1967.6)
grid20x20.f5.wrap 0.0 (430.5) 100.0 (670.0) 100.0 (670.0) 100.0 (670.0) 98.9 (667.4) 96.6 (661.9)
grid40x40.f10 0.0 (3580.9) 99.0 (5484.3) 100.0 (5504.4) 99.1 (5487.6) 93.0 (5369.6) 98.8 (5480.4)
grid40x40.f10.wrap 0.0 (3371.4) 98.3 (5636.0) 100.0 (5674.4) 100.0 (5674.4) 95.5 (5569.8) 97.8 (5622.9)
grid40x40.f15 0.0 (5300.0) 99.2 (8210.4) 100.0 (8234.3) 98.3 (8183.4) 95.0 (8087.8) 97.8 (8169.7)
grid40x40.f15.wrap 0.0 (4967.7) 98.7 (8451.7) 100.0 (8496.7) 98.6 (8448.1) 94.0 (8285.4) 98.2 (8434.3)
grid40x40.f2 0.0 (846.4) 99.9 (1167.4) 100.0 (1167.8) 100.0 (1167.8) 87.4 (1127.2) 99.5 (1166.1)
grid40x40.f2.wrap 0.0 (837.0) 99.7 (1178.4) 100.0 (1179.2) 100.0 (1179.2) 98.3 (1173.5) 99.5 (1177.6)
grid40x40.f5 0.0 (1853.7) 99.7 (2778.7) 100.0 (2781.6) 100.0 (2781.6) 95.8 (2743.1) 98.7 (2769.4)
grid40x40.f5.wrap 0.0 (1803.2) 98.7 (2812.4) 100.0 (2825.5) 100.0 (2825.5) 94.4 (2768.3) 98.7 (2812.1)
grid80x80.f10 0.0 (13670.1) 98.9 (21833.6) 100.0 (21925.9) 98.2 (21778.5) 94.1 (21437.4) 98.5 (21801.2)
grid80x80.f10.wrap 0.0 (13794.2) 97.4 (21803.5) 99.5 (21976.5) 98.4 (21887.2) 95.6 (21654.6) 98.8 (21919.6)
grid80x80.f15 0.0 (20172.3) 98.2 (32579.3) 100.0 (32803.4) 98.0 (32555.5) 93.8 (32021.0) 98.6 (32634.7)
grid80x80.f15.wrap 0.0 (20033.2) 97.5 (32894.0) 99.9 (33209.6) 97.6 (32904.5) 94.5 (32496.1) 98.6 (33039.3)
grid80x80.f2 0.0 (3413.5) 99.3 (4668.5) 100.0 (4677.7) 100.0 (4677.7) 95.3 (4618.0) 99.8 (4674.6)
grid80x80.f2.wrap 0.0 (3346.5) 99.0 (4722.3) 100.0 (4735.3) 100.0 (4735.7) 95.0 (4666.9) 99.7 (4731.6)
grid80x80.f5 0.0 (7444.4) 98.6 (11103.3) 100.0 (11156.3) 97.9 (11077.5) 93.8 (10927.3) 98.6 (11104.0)
grid80x80.f5.wrap 0.0 (7246.2) 98.5 (11060.2) 100.0 (11116.8) 98.2 (11048.9) 94.5 (10902.6) 97.5 (11019.8)
pdb1jmx 0.0 (-633.6) 93.1 (-510.6) 100.0 (-501.4) 100.0 (-501.4) 100.0 (-501.4) 100.0 (-501.4)
pdb1kgn 0.0 (-957.1) 90.7 (-768.1) 100.0 (-748.7) 100.0 (-748.7) 100.0 (-748.7) 100.0 (-748.7)
pdb1kwh 0.0 (-413.1) 98.2 (-307.5) 100.0 (-305.5) 100.0 (-305.5) 100.0 (-305.5) 100.0 (-305.5)
pdb1m3y 0.0 (-1359.0) 94.1 (-1072.2) 100.0 (-1054.2) 100.0 (-1054.2) 100.0 (-1054.2) 100.0 (-1054.2)
pdb1qks 0.0 (-827.9) 97.3 (-661.7) 100.0 (-657.0) 100.0 (-657.0) 100.0 (-657.0) 100.0 (-657.0)
pedigree1 0.0 (-54.5) 100.0 (-45.6) 100.0 (-45.6) 100.0 (-45.6) 100.0 (-45.6) 100.0 (-45.6)
pedigree13 0.0 (-121.8) 99.9 (-73.4) 100.0 (-73.4) 100.0 (-73.4) 100.0 (-73.4) 100.0 (-73.4)
pedigree18 0.0 (-199.7) 99.9 (-125.3) 100.0 (-125.3) 100.0 (-125.3) 99.4 (-125.7) 100.0 (-125.3)
pedigree19 0.0 (-182.4) 99.4 (-97.6) 100.0 (-97.1) 100.0 (-97.1) 99.4 (-97.6) 96.7 (-99.9)
pedigree20 0.0 (-115.1) 100.0 (-53.8) 100.0 (-53.8) 100.0 (-53.8) 100.0 (-53.8) 100.0 (-53.8)
pedigree23 0.0 (-70.8) 100.0 (-62.4) 100.0 (-62.4) 100.0 (-62.4) 100.0 (-62.4) 100.0 (-62.4)
pedigree25 0.0 (-222.0) 100.0 (-160.8) 100.0 (-160.8) 100.0 (-160.8) 100.0 (-160.8) 100.0 (-160.8)
pedigree30 0.0 (-226.0) 100.0 (-137.0) 100.0 (-137.0) 100.0 (-137.0) 100.0 (-137.0) 100.0 (-137.0)
pedigree31 0.0 (-248.3) 99.8 (-130.7) 100.0 (-130.5) 100.0 (-130.5) 100.0 (-130.5) 100.0 (-130.5)
pedigree33 0.0 (-148.2) 100.0 (-74.9) 100.0 (-74.9) 100.0 (-74.9) 100.0 (-74.9) 100.0 (-74.9)
pedigree34 0.0 (-172.2) 99.5 (-111.4) 100.0 (-111.1) 100.0 (-111.1) 100.0 (-111.1) 100.0 (-111.1)
pedigree37 0.0 (-228.6) 100.0 (-144.9) 100.0 (-144.9) 100.0 (-144.9) 100.0 (-144.9) 100.0 (-144.9)
pedigree38 0.0 (-142.9) 99.8 (-87.4) 100.0 (-87.3) 100.0 (-87.3) 100.0 (-87.3) 100.0 (-87.3)
pedigree39 0.0 (-243.0) 100.0 (-155.6) 100.0 (-155.6) 100.0 (-155.6) 100.0 (-155.6) 100.0 (-155.6)
pedigree40 0.0 (-227.2) 99.6 (-130.6) 100.0 (-130.2) 100.0 (-130.2) 99.3 (-130.9) 99.0 (-131.2)
pedigree41 0.0 (-205.3) 99.9 (-120.9) 100.0 (-120.7) 100.0 (-120.7) 100.0 (-120.7) 100.0 (-120.7)
pedigree42 0.0 (-93.2) 100.0 (-81.8) 100.0 (-81.8) 100.0 (-81.8) 100.0 (-81.8) 100.0 (-81.8)
pedigree44 0.0 (-153.8) 99.3 (-97.4) 100.0 (-97.0) 100.0 (-97.0) 100.0 (-97.0) 98.3 (-97.9)
pedigree50 0.0 (-98.4) 100.0 (-61.7) 100.0 (-61.7) 100.0 (-61.7) 100.0 (-61.7) 100.0 (-61.7)
pedigree51 0.0 (-208.3) 99.9 (-109.7) 100.0 (-109.6) 100.0 (-109.6) 100.0 (-109.6) 99.9 (-109.7)
pedigree7 0.0 (-171.9) 100.0 (-113.9) 100.0 (-113.9) 100.0 (-113.9) 100.0 (-113.9) 100.0 (-113.9)
pedigree9 0.0 (-212.1) 100.0 (-122.9) 100.0 (-122.9) 100.0 (-122.9) 100.0 (-122.9) 100.0 (-122.9)
rovers02ac.wcsp 0.0 (-92.2) 100.0 (-0.2) 100.0 (-0.2) 100.0 (-0.2) 100.0 (-0.2) 100.0 (-0.2)
rus_100_200_1_1 0.0 (2604.1) 96.7 (2681.2) 59.4 (2651.4) 100.0 (2683.9) 100.0 (2683.9) 100.0 (2683.9)
rus_100_200_2_1 0.0 (2576.7) 78.6 (2626.0) 91.3 (2633.9) 100.0 (2639.4) 100.0 (2639.4) 100.0 (2639.4)
rus_100_200_3_1 0.0 (2454.8) 98.8 (2538.3) 98.8 (2538.3) 100.0 (2539.4) 100.0 (2539.4) 100.0 (2539.4)
rus_100_200_3_3 0.0 (2390.9) 99.9 (2449.5) 75.0 (2434.9) 100.0 (2449.6) 100.0 (2449.6) 100.0 (2449.6)
rus_100_200_4_3 0.0 (2395.8) 93.9 (2474.4) 93.4 (2474.0) 100.0 (2479.5) 100.0 (2479.5) 100.0 (2479.5)
rus_100_200_5_3 0.0 (2497.0) 97.0 (2571.1) 54.1 (2538.3) 100.0 (2573.3) 100.0 (2573.3) 100.0 (2573.3)
rus_100_200_6_1 0.0 (2197.4) 69.4 (2252.4) 54.1 (2240.3) 100.0 (2276.7) 100.0 (2276.7) 71.4 (2254.0)
rus_50_100_4_1 0.0 (1500.0) 78.0 (1528.0) 62.3 (1522.4) 100.0 (1535.9) 100.0 (1535.9) 100.0 (1535.9)
rus_50_100_4_3 0.0 (1579.0) 100.0 (1615.8) 94.9 (1613.9) 100.0 (1615.8) 100.0 (1615.8) 100.0 (1615.8)
rus_50_100_6_1 0.0 (1302.2) 92.3 (1335.4) 100.0 (1338.1) 100.0 (1338.1) 100.0 (1338.1) 99.0 (1337.8)
rus_50_100_6_2 0.0 (1616.2) 100.0 (1656.5) 80.7 (1648.7) 100.0 (1656.5) 100.0 (1656.5) 100.0 (1656.5)
rus_50_100_7_1 0.0 (1457.7) 97.3 (1502.9) 81.7 (1495.6) 100.0 (1504.1) 100.0 (1504.1) 100.0 (1504.1)
rus_50_100_7_2 0.0 (1465.1) 96.5 (1508.3) 86.6 (1503.8) 100.0 (1509.9) 100.0 (1509.9) 100.0 (1509.9)
rus_50_100_8_1 0.0 (1402.5) 100.0 (1446.2) 96.3 (1444.5) 100.0 (1446.2) 100.0 (1446.2) 100.0 (1446.2)
rus_50_100_9_3 0.0 (1568.8) 71.1 (1601.1) 64.0 (1597.9) 100.0 (1614.3) 100.0 (1614.3) 100.0 (1614.3)
satellite01ac.wcsp 0.0 (-12.0) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1)
satellite02ac.wcsp 0.0 (-32.0) 37.6 (-20.0) 100.0 (-0.0) 100.0 (-0.0) 100.0 (-0.0) 100.0 (-0.0)
scen06.wcsp 0.0 (-83.6) 98.3 (-14.8) 98.9 (-14.3) 100.0 (-13.6) 100.0 (-13.6) 100.0 (-13.6)
scen07.wcsp 0.0 (-76.2) 98.7 (-2.4) 99.8 (-1.5) 100.0 (-1.4) 100.0 (-1.4) 100.0 (-1.4)
zenotravel02ac.wcsp 0.0 (-48.0) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1)
zenotravel04ac.wcsp 0.0 (-68.1) 58.9 (-28.0) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1)

3600sec

Problem baseline daoopt-lh-mpe daoopt-mpe toulbar2-ipr-mpe toulbar2-vacint-mpe toulbar2-vns-mpe
1CKK 0.0 (4667.7) 76.0 (5316.3) 90.6 (5441.0) 100.0 (5520.9) 100.0 (5520.9) 100.0 (5520.9)
1CM1 0.0 (4505.6) 77.1 (5206.7) 99.9 (5413.8) 100.0 (5414.6) 100.0 (5414.6) 100.0 (5414.6)
1SY9 0.0 (3450.5) 78.9 (3872.4) 100.0 (3985.1) 100.0 (3985.1) 100.0 (3985.1) 100.0 (3985.1)
2BBN 0.0 (4729.9) 81.6 (5218.7) 99.8 (5327.5) 100.0 (5328.6) 100.0 (5328.6) 100.0 (5328.6)
2BCX 0.0 (4946.7) 83.5 (5828.5) 99.3 (5995.0) 100.0 (6002.2) 100.0 (6002.2) 100.0 (6002.2)
BN-d-10000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 100.0 (-1152.5) 0.0 (nan)
BN-d-200-5-10 0.0 (-53.5) 92.2 (-47.1) 99.3 (-46.6) 100.0 (-46.5) 99.3 (-46.6) 100.0 (-46.5)
BN-d-20000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 100.0 (-2338.6) 0.0 (nan)
BN-d-250-5-10 0.0 (-63.6) 73.9 (-58.4) 93.1 (-57.1) 100.0 (-56.6) 86.5 (-57.6) 100.0 (-56.6)
BN-d-500-5-10 0.0 (-129.4) 74.2 (-120.2) 71.5 (-120.6) 99.7 (-117.1) 75.5 (-120.1) 100.0 (-117.0)
BN-nd-10000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 100.0 (-1305.1) 0.0 (nan)
BN-nd-200-5-10 0.0 (-60.7) 85.2 (-55.4) 99.1 (-54.5) 100.0 (-54.5) 98.2 (-54.6) 99.1 (-54.5)
BN-nd-20000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 100.0 (-2573.6) 0.0 (nan)
BN-nd-250-5-10 0.0 (-72.2) 74.2 (-67.1) 91.9 (-65.8) 91.7 (-65.8) 88.9 (-66.0) 100.0 (-65.3)
BN-nd-500-5-10 0.0 (-146.4) 83.6 (-136.8) 66.6 (-138.7) 100.0 (-134.9) 77.3 (-137.5) 90.8 (-135.9)
Maxsat_aes_64_1_keyfind_1 0.0 (1806.1) 96.8 (1867.6) 100.0 (1869.6) 99.5 (1869.3) 86.3 (1860.9) 95.9 (1867.0)
Maxsat_gss-25-s100 0.0 (nan) 100.0 (63581.0) 64.3 (63382.3) 0.2 (63026.1) 49.9 (63302.4) 84.0 (63492.0)
Maxsat_mod2c-rand3bip-sat-240-3.shuffled-as.sat05-2520 0.0 (1580.0) 83.2 (1629.4) 89.9 (1633.4) 100.0 (1639.4) 79.0 (1626.9) 88.9 (1632.8)
Maxsat_mod2c-rand3bip-sat-250-3.shuffled-as.sat05-2535 0.0 (1634.5) 93.7 (1689.3) 81.6 (1682.2) 100.0 (1692.9) 79.3 (1680.9) 91.5 (1688.0)
Maxsat_mod4block_2vars_10gates_u2_autoenc 0.0 (80875.5) 25.4 (80987.3) 0.0 (80856.5) 100.0 (81315.1) 98.9 (81310.1) 80.8 (81230.7)
Promedas_60 0.0 (-30.3) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0)
Promedas_61 0.0 (-21.7) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9)
Promedas_62 0.0 (-26.2) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7)
Promedas_63 0.0 (-20.2) 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1)
Promedas_64 0.0 (-26.5) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5)
Promedas_65 0.0 (-23.4) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2)
Promedas_66 0.0 (-26.7) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4)
Promedas_67 0.0 (-38.9) 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4)
Promedas_68 0.0 (-55.9) 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9)
Promedas_69 0.0 (-23.9) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2)
driverlog04ac.wcsp 0.0 (-104.1) 88.6 (-12.0) 100.0 (-0.2) 100.0 (-0.2) 100.0 (-0.2) 100.0 (-0.2)
driverlog05ac.wcsp 0.0 (-100.1) 84.0 (-16.0) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1)
driverlog08ac.wcsp 0.0 (-108.1) 59.4 (-44.0) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1)
grid20x20.f10 0.0 (830.6) 100.0 (1309.7) 100.0 (1309.7) 100.0 (1309.7) 98.9 (1304.2) 98.5 (1302.7)
grid20x20.f10.wrap 0.0 (817.2) 100.0 (1325.0) 100.0 (1325.0) 100.0 (1325.0) 98.9 (1319.4) 99.1 (1320.5)
grid20x20.f15 0.0 (1230.9) 100.0 (1961.8) 100.0 (1961.8) 100.0 (1961.8) 99.6 (1959.0) 97.6 (1944.4)
grid20x20.f15.wrap 0.0 (1204.0) 99.1 (1975.0) 100.0 (1981.8) 100.0 (1981.8) 99.4 (1977.3) 98.2 (1967.6)
grid20x20.f5.wrap 0.0 (430.5) 100.0 (670.0) 100.0 (670.0) 100.0 (670.0) 98.9 (667.4) 96.6 (661.9)
grid40x40.f10 0.0 (3580.9) 99.8 (5499.8) 100.0 (5504.4) 100.0 (5504.4) 93.4 (5376.9) 98.8 (5480.4)
grid40x40.f10.wrap 0.0 (3371.4) 99.9 (5672.4) 100.0 (5674.4) 100.0 (5674.4) 95.5 (5569.8) 97.8 (5622.9)
grid40x40.f15 0.0 (5300.0) 99.2 (8210.6) 100.0 (8234.3) 100.0 (8234.3) 95.0 (8087.8) 97.8 (8169.7)
grid40x40.f15.wrap 0.0 (4967.7) 99.3 (8472.0) 100.0 (8496.7) 100.0 (8496.7) 94.1 (8287.3) 98.2 (8434.3)
grid40x40.f2 0.0 (846.4) 99.9 (1167.6) 100.0 (1167.8) 100.0 (1167.8) 87.4 (1127.2) 99.5 (1166.1)
grid40x40.f2.wrap 0.0 (837.0) 99.4 (1177.3) 100.0 (1179.2) 100.0 (1179.2) 98.3 (1173.5) 99.5 (1177.6)
grid40x40.f5 0.0 (1853.7) 99.8 (2779.7) 100.0 (2781.6) 100.0 (2781.6) 95.8 (2743.1) 98.7 (2769.4)
grid40x40.f5.wrap 0.0 (1803.2) 99.2 (2817.0) 100.0 (2825.5) 100.0 (2825.5) 94.7 (2771.1) 98.7 (2812.1)
grid80x80.f10 0.0 (13670.1) 98.8 (21823.6) 100.0 (21925.9) 98.6 (21809.1) 94.3 (21454.1) 98.5 (21801.2)
grid80x80.f10.wrap 0.0 (13794.2) 97.6 (21821.3) 100.0 (22019.3) 98.7 (21912.2) 95.7 (21665.5) 99.1 (21945.7)
grid80x80.f15 0.0 (20172.3) 98.3 (32587.8) 100.0 (32808.8) 98.5 (32618.0) 94.2 (32069.9) 99.2 (32713.9)
grid80x80.f15.wrap 0.0 (20033.2) 97.7 (32914.3) 100.0 (33223.8) 98.3 (33000.5) 94.6 (32512.0) 99.3 (33133.2)
grid80x80.f2 0.0 (3413.5) 98.7 (4661.1) 100.0 (4677.6) 100.0 (4677.7) 95.9 (4625.5) 99.8 (4674.6)
grid80x80.f2.wrap 0.0 (3346.5) 99.3 (4725.5) 100.0 (4735.7) 100.0 (4735.7) 95.2 (4668.6) 99.7 (4731.6)
grid80x80.f5 0.0 (7444.4) 98.1 (11085.6) 100.0 (11155.6) 98.2 (11091.0) 94.2 (10942.4) 99.0 (11119.9)
grid80x80.f5.wrap 0.0 (7246.2) 97.2 (11006.6) 99.9 (11113.9) 99.0 (11078.4) 95.0 (10924.6) 98.2 (11045.4)
pdb1jmx 0.0 (-633.6) 96.5 (-506.1) 100.0 (-501.4) 100.0 (-501.4) 100.0 (-501.4) 100.0 (-501.4)
pdb1kgn 0.0 (-957.1) 92.4 (-764.6) 100.0 (-748.7) 100.0 (-748.7) 100.0 (-748.7) 100.0 (-748.7)
pdb1kwh 0.0 (-413.1) 98.2 (-307.5) 100.0 (-305.5) 100.0 (-305.5) 100.0 (-305.5) 100.0 (-305.5)
pdb1m3y 0.0 (-1359.0) 93.6 (-1073.7) 100.0 (-1054.2) 100.0 (-1054.2) 100.0 (-1054.2) 100.0 (-1054.2)
pdb1qks 0.0 (-827.9) 99.0 (-658.8) 100.0 (-657.0) 100.0 (-657.0) 100.0 (-657.0) 100.0 (-657.0)
pedigree1 0.0 (-54.5) 100.0 (-45.6) 100.0 (-45.6) 100.0 (-45.6) 100.0 (-45.6) 100.0 (-45.6)
pedigree13 0.0 (-121.8) 100.0 (-73.4) 100.0 (-73.4) 100.0 (-73.4) 100.0 (-73.4) 100.0 (-73.4)
pedigree18 0.0 (-199.7) 100.0 (-125.3) 100.0 (-125.3) 100.0 (-125.3) 100.0 (-125.3) 100.0 (-125.3)
pedigree19 0.0 (-182.4) 99.4 (-97.6) 100.0 (-97.1) 100.0 (-97.1) 99.5 (-97.6) 99.1 (-97.9)
pedigree20 0.0 (-115.1) 100.0 (-53.8) 100.0 (-53.8) 100.0 (-53.8) 100.0 (-53.8) 100.0 (-53.8)
pedigree23 0.0 (-70.8) 100.0 (-62.4) 100.0 (-62.4) 100.0 (-62.4) 100.0 (-62.4) 100.0 (-62.4)
pedigree25 0.0 (-222.0) 100.0 (-160.8) 100.0 (-160.8) 100.0 (-160.8) 100.0 (-160.8) 100.0 (-160.8)
pedigree30 0.0 (-226.0) 100.0 (-137.0) 100.0 (-137.0) 100.0 (-137.0) 100.0 (-137.0) 100.0 (-137.0)
pedigree31 0.0 (-248.3) 100.0 (-130.5) 100.0 (-130.5) 100.0 (-130.5) 100.0 (-130.5) 100.0 (-130.5)
pedigree33 0.0 (-148.2) 100.0 (-74.9) 100.0 (-74.9) 100.0 (-74.9) 100.0 (-74.9) 100.0 (-74.9)
pedigree34 0.0 (-172.2) 100.0 (-111.1) 100.0 (-111.1) 100.0 (-111.1) 100.0 (-111.1) 100.0 (-111.1)
pedigree37 0.0 (-228.6) 100.0 (-144.9) 100.0 (-144.9) 100.0 (-144.9) 100.0 (-144.9) 100.0 (-144.9)
pedigree38 0.0 (-142.9) 100.0 (-87.3) 100.0 (-87.3) 100.0 (-87.3) 100.0 (-87.3) 100.0 (-87.3)
pedigree39 0.0 (-243.0) 100.0 (-155.6) 100.0 (-155.6) 100.0 (-155.6) 100.0 (-155.6) 100.0 (-155.6)
pedigree40 0.0 (-227.2) 99.9 (-130.4) 100.0 (-130.2) 100.0 (-130.2) 99.5 (-130.8) 99.0 (-131.2)
pedigree41 0.0 (-205.3) 100.0 (-120.7) 100.0 (-120.7) 100.0 (-120.7) 100.0 (-120.7) 100.0 (-120.7)
pedigree42 0.0 (-93.2) 100.0 (-81.8) 100.0 (-81.8) 100.0 (-81.8) 100.0 (-81.8) 100.0 (-81.8)
pedigree44 0.0 (-153.8) 100.0 (-97.0) 100.0 (-97.0) 100.0 (-97.0) 100.0 (-97.0) 99.8 (-97.1)
pedigree50 0.0 (-98.4) 100.0 (-61.7) 100.0 (-61.7) 100.0 (-61.7) 100.0 (-61.7) 100.0 (-61.7)
pedigree51 0.0 (-208.3) 99.7 (-109.9) 100.0 (-109.6) 100.0 (-109.6) 100.0 (-109.6) 100.0 (-109.6)
pedigree7 0.0 (-171.9) 100.0 (-113.9) 100.0 (-113.9) 100.0 (-113.9) 100.0 (-113.9) 100.0 (-113.9)
pedigree9 0.0 (-212.1) 100.0 (-122.9) 100.0 (-122.9) 100.0 (-122.9) 100.0 (-122.9) 100.0 (-122.9)
rovers02ac.wcsp 0.0 (-92.2) 100.0 (-0.2) 100.0 (-0.2) 100.0 (-0.2) 100.0 (-0.2) 100.0 (-0.2)
rus_100_200_1_1 0.0 (2604.1) 96.7 (2681.2) 59.4 (2651.4) 100.0 (2683.9) 100.0 (2683.9) 100.0 (2683.9)
rus_100_200_2_1 0.0 (2576.7) 78.6 (2626.0) 84.3 (2629.5) 100.0 (2639.4) 100.0 (2639.4) 100.0 (2639.4)
rus_100_200_3_1 0.0 (2454.8) 98.8 (2538.3) 98.8 (2538.3) 100.0 (2539.4) 100.0 (2539.4) 100.0 (2539.4)
rus_100_200_3_3 0.0 (2390.9) 99.9 (2449.5) 75.0 (2434.9) 100.0 (2449.6) 100.0 (2449.6) 100.0 (2449.6)
rus_100_200_4_3 0.0 (2395.8) 93.9 (2474.4) 93.4 (2474.0) 100.0 (2479.5) 100.0 (2479.5) 100.0 (2479.5)
rus_100_200_5_3 0.0 (2497.0) 97.0 (2571.1) 54.1 (2538.3) 100.0 (2573.3) 100.0 (2573.3) 100.0 (2573.3)
rus_100_200_6_1 0.0 (2197.4) 69.6 (2252.6) 54.1 (2240.3) 100.0 (2276.7) 100.0 (2276.7) 71.4 (2254.0)
rus_50_100_4_1 0.0 (1500.0) 78.0 (1528.0) 62.3 (1522.4) 100.0 (1535.9) 100.0 (1535.9) 100.0 (1535.9)
rus_50_100_4_3 0.0 (1579.0) 100.0 (1615.8) 94.9 (1613.9) 100.0 (1615.8) 100.0 (1615.8) 100.0 (1615.8)
rus_50_100_6_1 0.0 (1302.2) 92.3 (1335.4) 100.0 (1338.1) 100.0 (1338.1) 100.0 (1338.1) 100.0 (1338.1)
rus_50_100_6_2 0.0 (1616.2) 100.0 (1656.5) 80.7 (1648.7) 100.0 (1656.5) 100.0 (1656.5) 100.0 (1656.5)
rus_50_100_7_1 0.0 (1457.7) 100.0 (1504.1) 81.7 (1495.6) 100.0 (1504.1) 100.0 (1504.1) 100.0 (1504.1)
rus_50_100_7_2 0.0 (1465.1) 96.5 (1508.3) 86.6 (1503.8) 100.0 (1509.9) 100.0 (1509.9) 100.0 (1509.9)
rus_50_100_8_1 0.0 (1402.5) 100.0 (1446.2) 96.3 (1444.5) 100.0 (1446.2) 100.0 (1446.2) 100.0 (1446.2)
rus_50_100_9_3 0.0 (1568.8) 100.0 (1614.3) 64.0 (1597.9) 100.0 (1614.3) 100.0 (1614.3) 100.0 (1614.3)
satellite01ac.wcsp 0.0 (-12.0) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1)
satellite02ac.wcsp 0.0 (-32.0) 37.6 (-20.0) 100.0 (-0.0) 100.0 (-0.0) 100.0 (-0.0) 100.0 (-0.0)
scen06.wcsp 0.0 (-83.6) 98.3 (-14.8) 98.9 (-14.3) 100.0 (-13.6) 100.0 (-13.6) 100.0 (-13.6)
scen07.wcsp 0.0 (-76.2) 98.7 (-2.4) 99.7 (-1.6) 100.0 (-1.4) 100.0 (-1.4) 100.0 (-1.4)
zenotravel02ac.wcsp 0.0 (-48.0) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1)
zenotravel04ac.wcsp 0.0 (-68.1) 58.9 (-28.0) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1)

Updated: