daoopt-mpe Scores
The results below are organized as follows:
- each table displays the solver’s performance for individual problem instances for the given task under different time limits
- table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria
MPE
overall
| Problem | 20sec | 1200sec | 3600sec |
|---|---|---|---|
| 1CKK | 78.3 (5335.5) | 90.6 (5441.0) | 90.6 (5441.0) |
| 1CM1 | 95.4 (5372.4) | 99.9 (5413.8) | 99.9 (5413.8) |
| 1SY9 | 97.3 (3970.7) | 100.0 (3985.1) | 100.0 (3985.1) |
| 2BBN | 75.8 (5183.5) | 99.8 (5327.5) | 99.8 (5327.5) |
| 2BCX | 88.3 (5878.2) | 99.3 (5995.0) | 99.3 (5995.0) |
| BN-d-10000-4-2 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| BN-d-200-5-10 | 86.3 (-47.5) | 99.3 (-46.6) | 98.4 (-46.6) |
| BN-d-20000-4-2 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| BN-d-250-5-10 | 88.8 (-57.4) | 85.7 (-57.6) | 85.0 (-57.7) |
| BN-d-500-5-10 | 68.1 (-121.0) | 71.5 (-120.6) | 71.5 (-120.6) |
| BN-nd-10000-4-2 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| BN-nd-200-5-10 | 79.9 (-55.7) | 94.9 (-54.8) | 94.9 (-54.8) |
| BN-nd-20000-4-2 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| BN-nd-250-5-10 | 74.1 (-67.1) | 97.8 (-65.4) | 91.9 (-65.8) |
| BN-nd-500-5-10 | 76.8 (-137.5) | 66.6 (-138.7) | 62.6 (-139.2) |
| Hardsat_aes_64_1_keyfind_1 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Hardsat_gss-25-s100 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Hardsat_mod2c-rand3bip-sat-240-3.shuffled-as.sat05-2520 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Hardsat_mod2c-rand3bip-sat-250-3.shuffled-as.sat05-2535 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Hardsat_mod4block_2vars_10gates_u2_autoenc | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Maxsat_aes_64_1_keyfind_1 | 95.2 (1866.5) | 100.0 (1869.6) | 100.0 (1869.6) |
| Maxsat_gss-25-s100 | 0.0 (nan) | 0.0 (63382.3) | 0.0 (63382.3) |
| Maxsat_mod2c-rand3bip-sat-240-3.shuffled-as.sat05-2520 | 83.9 (1629.8) | 89.9 (1633.4) | 89.9 (1633.4) |
| Maxsat_mod2c-rand3bip-sat-250-3.shuffled-as.sat05-2535 | 95.3 (1690.2) | 81.6 (1682.2) | 81.6 (1682.2) |
| Maxsat_mod4block_2vars_10gates_u2_autoenc | 0.0 (nan) | 0.0 (80856.5) | 0.0 (80856.5) |
| Promedas_60 | 100.0 (-10.0) | 100.0 (-10.0) | 100.0 (-10.0) |
| Promedas_61 | 100.0 (-6.9) | 100.0 (-6.9) | 100.0 (-6.9) |
| Promedas_62 | 100.0 (-4.7) | 100.0 (-4.7) | 100.0 (-4.7) |
| Promedas_63 | 100.0 (-6.1) | 100.0 (-6.1) | 100.0 (-6.1) |
| Promedas_64 | 100.0 (-11.5) | 100.0 (-11.5) | 100.0 (-11.5) |
| Promedas_65 | 100.0 (-5.2) | 100.0 (-5.2) | 100.0 (-5.2) |
| Promedas_66 | 100.0 (-10.4) | 100.0 (-10.4) | 100.0 (-10.4) |
| Promedas_67 | 100.0 (-13.4) | 100.0 (-13.4) | 100.0 (-13.4) |
| Promedas_68 | 100.0 (-18.9) | 100.0 (-18.9) | 100.0 (-18.9) |
| Promedas_69 | 100.0 (-11.2) | 100.0 (-11.2) | 100.0 (-11.2) |
| driverlog04ac.wcsp | 80.9 (-20.0) | 100.0 (-0.2) | 100.0 (-0.2) |
| driverlog05ac.wcsp | 72.1 (-28.0) | 100.0 (-0.1) | 100.0 (-0.1) |
| driverlog08ac.wcsp | 74.2 (-28.0) | 100.0 (-0.1) | 100.0 (-0.1) |
| grid20x20.f10 | 100.0 (1309.7) | 100.0 (1309.7) | 100.0 (1309.7) |
| grid20x20.f10.wrap | 100.0 (1325.0) | 100.0 (1325.0) | 100.0 (1325.0) |
| grid20x20.f15 | 100.0 (1961.8) | 100.0 (1961.8) | 100.0 (1961.8) |
| grid20x20.f15.wrap | 100.0 (1981.8) | 100.0 (1981.8) | 100.0 (1981.8) |
| grid20x20.f5.wrap | 100.0 (670.0) | 100.0 (670.0) | 100.0 (670.0) |
| grid40x40.f10 | 100.0 (5504.4) | 100.0 (5504.4) | 100.0 (5504.4) |
| grid40x40.f10.wrap | 100.0 (5674.0) | 100.0 (5674.4) | 100.0 (5674.4) |
| grid40x40.f15 | 99.8 (8227.6) | 100.0 (8234.3) | 100.0 (8234.3) |
| grid40x40.f15.wrap | 100.0 (8495.2) | 100.0 (8496.7) | 100.0 (8496.7) |
| grid40x40.f2 | 100.0 (1167.8) | 100.0 (1167.8) | 100.0 (1167.8) |
| grid40x40.f2.wrap | 100.0 (1179.1) | 100.0 (1179.2) | 100.0 (1179.2) |
| grid40x40.f5 | 100.0 (2781.6) | 100.0 (2781.6) | 100.0 (2781.6) |
| grid40x40.f5.wrap | 99.3 (2817.8) | 100.0 (2825.5) | 100.0 (2825.5) |
| grid80x80.f10 | 93.3 (21368.9) | 100.0 (21925.9) | 100.0 (21925.9) |
| grid80x80.f10.wrap | 91.1 (21291.4) | 100.0 (22017.5) | 100.0 (22019.3) |
| grid80x80.f15 | 93.6 (31999.4) | 100.0 (32808.8) | 100.0 (32808.8) |
| grid80x80.f15.wrap | 92.8 (32269.9) | 100.0 (33223.8) | 100.0 (33223.8) |
| grid80x80.f2 | 92.9 (4588.4) | 100.0 (4677.6) | 100.0 (4677.6) |
| grid80x80.f2.wrap | 94.2 (4654.8) | 100.0 (4735.7) | 100.0 (4735.7) |
| grid80x80.f5 | 92.4 (10872.1) | 100.0 (11155.6) | 100.0 (11155.6) |
| grid80x80.f5.wrap | 91.7 (10794.3) | 100.0 (11113.9) | 100.0 (11113.9) |
| pdb1jmx | 100.0 (-501.4) | 100.0 (-501.4) | 100.0 (-501.4) |
| pdb1kgn | 99.8 (-749.2) | 100.0 (-748.8) | 100.0 (-748.7) |
| pdb1kwh | 100.0 (-305.5) | 100.0 (-305.5) | 100.0 (-305.5) |
| pdb1m3y | 99.9 (-1054.6) | 100.0 (-1054.2) | 100.0 (-1054.2) |
| pdb1qks | 100.0 (-657.0) | 100.0 (-657.0) | 100.0 (-657.0) |
| pedigree1 | 100.0 (-45.6) | 100.0 (-45.6) | 100.0 (-45.6) |
| pedigree13 | 100.0 (-73.4) | 100.0 (-73.4) | 100.0 (-73.4) |
| pedigree18 | 100.0 (-125.3) | 100.0 (-125.3) | 100.0 (-125.3) |
| pedigree19 | 99.9 (-97.2) | 100.0 (-97.1) | 100.0 (-97.1) |
| pedigree20 | 100.0 (-53.8) | 100.0 (-53.8) | 100.0 (-53.8) |
| pedigree23 | 100.0 (-62.4) | 100.0 (-62.4) | 100.0 (-62.4) |
| pedigree25 | 100.0 (-160.8) | 100.0 (-160.8) | 100.0 (-160.8) |
| pedigree30 | 100.0 (-137.0) | 100.0 (-137.0) | 100.0 (-137.0) |
| pedigree31 | 100.0 (-130.5) | 100.0 (-130.5) | 100.0 (-130.5) |
| pedigree33 | 100.0 (-74.9) | 100.0 (-74.9) | 100.0 (-74.9) |
| pedigree34 | 100.0 (-111.1) | 100.0 (-111.1) | 100.0 (-111.1) |
| pedigree37 | 100.0 (-144.9) | 100.0 (-144.9) | 100.0 (-144.9) |
| pedigree38 | 100.0 (-87.3) | 100.0 (-87.3) | 100.0 (-87.3) |
| pedigree39 | 100.0 (-155.6) | 100.0 (-155.6) | 100.0 (-155.6) |
| pedigree40 | 99.3 (-130.9) | 100.0 (-130.2) | 100.0 (-130.2) |
| pedigree41 | 100.0 (-120.7) | 100.0 (-120.7) | 100.0 (-120.7) |
| pedigree42 | 100.0 (-81.8) | 100.0 (-81.8) | 100.0 (-81.8) |
| pedigree44 | 100.0 (-97.0) | 100.0 (-97.0) | 100.0 (-97.0) |
| pedigree50 | 100.0 (-61.7) | 100.0 (-61.7) | 100.0 (-61.7) |
| pedigree51 | 99.8 (-109.9) | 100.0 (-109.6) | 100.0 (-109.6) |
| pedigree7 | 100.0 (-113.9) | 100.0 (-113.9) | 100.0 (-113.9) |
| pedigree9 | 100.0 (-122.9) | 100.0 (-122.9) | 100.0 (-122.9) |
| rovers02ac.wcsp | 100.0 (-0.2) | 100.0 (-0.2) | 100.0 (-0.2) |
| rus_100_200_1_1 | 0.0 (nan) | 58.0 (2295.3) | 58.0 (2295.3) |
| rus_100_200_2_1 | 0.0 (nan) | 60.5 (2295.3) | 60.5 (2295.3) |
| rus_100_200_3_1 | 0.0 (nan) | 60.5 (2295.3) | 60.5 (2295.3) |
| rus_100_200_3_3 | 0.0 (nan) | 60.5 (2295.3) | 60.5 (2295.3) |
| rus_100_200_4_3 | 0.0 (nan) | 60.5 (2295.3) | 60.5 (2295.3) |
| rus_100_200_5_3 | 0.0 (nan) | 60.5 (2295.3) | 60.5 (2295.3) |
| rus_100_200_6_1 | 0.0 (nan) | 60.5 (2295.3) | 60.5 (2295.3) |
| rus_50_100_4_1 | 0.0 (nan) | 80.7 (1738.2) | 80.7 (1738.2) |
| rus_50_100_4_3 | 0.0 (nan) | 80.7 (1738.2) | 80.7 (1738.2) |
| rus_50_100_6_1 | 0.0 (nan) | 80.7 (1738.2) | 80.7 (1738.2) |
| rus_50_100_6_2 | 0.0 (nan) | 80.7 (1738.2) | 80.7 (1738.2) |
| rus_50_100_7_1 | 0.0 (nan) | 80.7 (1738.2) | 80.7 (1738.2) |
| rus_50_100_7_2 | 0.0 (nan) | 80.7 (1738.2) | 80.7 (1738.2) |
| rus_50_100_8_1 | 0.0 (nan) | 80.7 (1738.2) | 80.7 (1738.2) |
| rus_50_100_9_3 | 0.0 (nan) | 80.7 (1738.2) | 80.7 (1738.2) |
| satellite01ac.wcsp | 100.0 (-0.1) | 100.0 (-0.1) | 100.0 (-0.1) |
| satellite02ac.wcsp | 37.6 (-20.0) | 100.0 (-0.0) | 100.0 (-0.0) |
| scen06.wcsp | 98.9 (-14.3) | 98.9 (-14.3) | 98.9 (-14.3) |
| scen07.wcsp | 99.5 (-1.8) | 99.8 (-1.5) | 99.6 (-1.7) |
| zenotravel02ac.wcsp | 100.0 (-0.1) | 100.0 (-0.1) | 100.0 (-0.1) |
| zenotravel04ac.wcsp | 70.7 (-20.0) | 100.0 (-0.1) | 100.0 (-0.1) |