daoopt-lh-mpe Scores
The results below are organized as follows:
- each table displays the solver’s performance for individual problem instances for the given task under different time limits
- table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria
MPE
overall
| Problem | 20sec | 1200sec | 3600sec |
|---|---|---|---|
| 1CKK | 76.0 (5316.3) | 76.0 (5316.3) | 76.0 (5316.3) |
| 1CM1 | 77.1 (5206.7) | 77.1 (5206.7) | 77.1 (5206.7) |
| 1SY9 | 78.9 (3872.4) | 78.9 (3872.4) | 78.9 (3872.4) |
| 2BBN | 58.2 (5078.1) | 81.6 (5218.7) | 81.6 (5218.7) |
| 2BCX | 83.5 (5828.5) | 83.5 (5828.5) | 83.5 (5828.5) |
| BN-d-10000-4-2 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| BN-d-200-5-10 | 92.2 (-47.1) | 92.2 (-47.1) | 92.2 (-47.1) |
| BN-d-20000-4-2 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| BN-d-250-5-10 | 73.9 (-58.4) | 73.9 (-58.4) | 73.9 (-58.4) |
| BN-d-500-5-10 | 74.2 (-120.2) | 74.2 (-120.2) | 74.2 (-120.2) |
| BN-nd-10000-4-2 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| BN-nd-200-5-10 | 85.2 (-55.4) | 85.2 (-55.4) | 85.2 (-55.4) |
| BN-nd-20000-4-2 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| BN-nd-250-5-10 | 74.2 (-67.1) | 74.2 (-67.1) | 74.2 (-67.1) |
| BN-nd-500-5-10 | 83.6 (-136.8) | 83.6 (-136.8) | 83.6 (-136.8) |
| Maxsat_aes_64_1_keyfind_1 | 87.2 (1861.5) | 95.8 (1866.9) | 96.8 (1867.6) |
| Maxsat_gss-25-s100 | 0.0 (nan) | 46.5 (63283.8) | 100.0 (63581.0) |
| Maxsat_mod2c-rand3bip-sat-240-3.shuffled-as.sat05-2520 | 75.9 (1625.1) | 88.9 (1632.8) | 83.2 (1629.4) |
| Maxsat_mod2c-rand3bip-sat-250-3.shuffled-as.sat05-2535 | 81.5 (1682.2) | 91.4 (1687.9) | 93.7 (1689.3) |
| Maxsat_mod4block_2vars_10gates_u2_autoenc | 0.0 (nan) | 1.4 (80881.7) | 25.4 (80987.3) |
| Promedas_60 | 100.0 (-10.0) | 100.0 (-10.0) | 100.0 (-10.0) |
| Promedas_61 | 100.0 (-6.9) | 100.0 (-6.9) | 100.0 (-6.9) |
| Promedas_62 | 100.0 (-4.7) | 100.0 (-4.7) | 100.0 (-4.7) |
| Promedas_63 | 100.0 (-6.1) | 100.0 (-6.1) | 100.0 (-6.1) |
| Promedas_64 | 100.0 (-11.5) | 100.0 (-11.5) | 100.0 (-11.5) |
| Promedas_65 | 100.0 (-5.2) | 100.0 (-5.2) | 100.0 (-5.2) |
| Promedas_66 | 100.0 (-10.4) | 100.0 (-10.4) | 100.0 (-10.4) |
| Promedas_67 | 100.0 (-13.4) | 100.0 (-13.4) | 100.0 (-13.4) |
| Promedas_68 | 100.0 (-18.9) | 100.0 (-18.9) | 100.0 (-18.9) |
| Promedas_69 | 100.0 (-11.2) | 100.0 (-11.2) | 100.0 (-11.2) |
| driverlog04ac.wcsp | 65.5 (-36.0) | 65.5 (-36.0) | 88.6 (-12.0) |
| driverlog05ac.wcsp | 68.1 (-32.0) | 68.1 (-32.0) | 84.0 (-16.0) |
| driverlog08ac.wcsp | 59.4 (-44.0) | 59.4 (-44.0) | 59.4 (-44.0) |
| grid20x20.f10 | 100.0 (1309.7) | 99.9 (1309.4) | 100.0 (1309.7) |
| grid20x20.f10.wrap | 100.0 (1325.0) | 100.0 (1325.0) | 100.0 (1325.0) |
| grid20x20.f15 | 99.9 (1961.1) | 100.0 (1961.8) | 100.0 (1961.8) |
| grid20x20.f15.wrap | 100.0 (1981.8) | 100.0 (1981.8) | 99.1 (1975.0) |
| grid20x20.f5.wrap | 100.0 (670.0) | 100.0 (670.0) | 100.0 (670.0) |
| grid40x40.f10 | 94.3 (5395.3) | 99.0 (5484.3) | 99.8 (5499.8) |
| grid40x40.f10.wrap | 91.7 (5482.9) | 98.3 (5636.0) | 99.9 (5672.4) |
| grid40x40.f15 | 95.2 (8093.3) | 99.2 (8210.4) | 99.2 (8210.6) |
| grid40x40.f15.wrap | 92.3 (8225.5) | 98.7 (8451.7) | 99.3 (8472.0) |
| grid40x40.f2 | 94.9 (1151.4) | 99.9 (1167.4) | 99.9 (1167.6) |
| grid40x40.f2.wrap | 91.7 (1150.8) | 99.7 (1178.4) | 99.4 (1177.3) |
| grid40x40.f5 | 93.9 (2725.1) | 99.7 (2778.7) | 99.8 (2779.7) |
| grid40x40.f5.wrap | 92.1 (2744.5) | 98.7 (2812.4) | 99.2 (2817.0) |
| grid80x80.f10 | 93.3 (21375.3) | 98.9 (21833.6) | 98.8 (21823.6) |
| grid80x80.f10.wrap | 91.4 (21310.0) | 97.4 (21803.5) | 97.6 (21821.3) |
| grid80x80.f15 | 93.6 (32004.1) | 98.2 (32579.3) | 98.3 (32587.8) |
| grid80x80.f15.wrap | 93.2 (32330.4) | 97.5 (32894.0) | 97.7 (32914.3) |
| grid80x80.f2 | 91.7 (4573.3) | 99.3 (4668.5) | 98.7 (4661.1) |
| grid80x80.f2.wrap | 90.7 (4606.9) | 99.0 (4722.3) | 99.3 (4725.5) |
| grid80x80.f5 | 90.9 (10820.2) | 98.6 (11103.3) | 98.1 (11085.6) |
| grid80x80.f5.wrap | 92.1 (10811.7) | 98.5 (11060.2) | 97.2 (11006.6) |
| pdb1jmx | 93.1 (-510.6) | 93.1 (-510.6) | 96.5 (-506.1) |
| pdb1kgn | 90.7 (-768.1) | 90.7 (-768.1) | 92.4 (-764.6) |
| pdb1kwh | 98.2 (-307.5) | 98.2 (-307.5) | 98.2 (-307.5) |
| pdb1m3y | 93.6 (-1073.7) | 94.1 (-1072.2) | 93.6 (-1073.7) |
| pdb1qks | 97.3 (-661.7) | 97.3 (-661.7) | 99.0 (-658.8) |
| pedigree1 | 100.0 (-45.6) | 100.0 (-45.6) | 100.0 (-45.6) |
| pedigree13 | 99.9 (-73.4) | 99.9 (-73.4) | 100.0 (-73.4) |
| pedigree18 | 100.0 (-125.3) | 99.9 (-125.3) | 100.0 (-125.3) |
| pedigree19 | 99.2 (-97.8) | 99.4 (-97.6) | 99.4 (-97.6) |
| pedigree20 | 100.0 (-53.8) | 100.0 (-53.8) | 100.0 (-53.8) |
| pedigree23 | 100.0 (-62.4) | 100.0 (-62.4) | 100.0 (-62.4) |
| pedigree25 | 100.0 (-160.8) | 100.0 (-160.8) | 100.0 (-160.8) |
| pedigree30 | 100.0 (-137.0) | 100.0 (-137.0) | 100.0 (-137.0) |
| pedigree31 | 99.8 (-130.7) | 99.8 (-130.7) | 100.0 (-130.5) |
| pedigree33 | 100.0 (-74.9) | 100.0 (-74.9) | 100.0 (-74.9) |
| pedigree34 | 99.5 (-111.4) | 99.5 (-111.4) | 100.0 (-111.1) |
| pedigree37 | 100.0 (-144.9) | 100.0 (-144.9) | 100.0 (-144.9) |
| pedigree38 | 99.8 (-87.4) | 99.8 (-87.4) | 100.0 (-87.3) |
| pedigree39 | 99.2 (-156.4) | 100.0 (-155.6) | 100.0 (-155.6) |
| pedigree40 | 99.5 (-130.8) | 99.6 (-130.6) | 99.9 (-130.4) |
| pedigree41 | 99.9 (-120.9) | 99.9 (-120.9) | 100.0 (-120.7) |
| pedigree42 | 99.9 (-81.8) | 100.0 (-81.8) | 100.0 (-81.8) |
| pedigree44 | 99.8 (-97.1) | 99.3 (-97.4) | 100.0 (-97.0) |
| pedigree50 | 99.7 (-61.8) | 100.0 (-61.7) | 100.0 (-61.7) |
| pedigree51 | 99.7 (-109.9) | 99.9 (-109.7) | 99.7 (-109.9) |
| pedigree7 | 99.6 (-114.1) | 100.0 (-113.9) | 100.0 (-113.9) |
| pedigree9 | 100.0 (-122.9) | 100.0 (-122.9) | 100.0 (-122.9) |
| rovers02ac.wcsp | 100.0 (-0.2) | 100.0 (-0.2) | 100.0 (-0.2) |
| rus_100_200_1_1 | 0.0 (nan) | 96.0 (2646.5) | 96.0 (2646.5) |
| rus_100_200_2_1 | 0.0 (nan) | 97.5 (2646.5) | 97.5 (2646.5) |
| rus_100_200_3_1 | 0.0 (nan) | 97.5 (2646.5) | 97.5 (2646.5) |
| rus_100_200_3_3 | 0.0 (nan) | 97.5 (2646.5) | 97.5 (2646.5) |
| rus_100_200_4_3 | 0.0 (nan) | 97.5 (2646.5) | 97.5 (2646.5) |
| rus_100_200_5_3 | 0.0 (nan) | 97.5 (2646.5) | 97.5 (2646.5) |
| rus_100_200_6_1 | 0.0 (nan) | 97.5 (2646.5) | 97.5 (2646.5) |
| rus_50_100_4_1 | 0.0 (nan) | 42.9 (1552.4) | 100.0 (1832.8) |
| rus_50_100_4_3 | 0.0 (nan) | 42.9 (1552.4) | 100.0 (1832.8) |
| rus_50_100_6_1 | 0.0 (nan) | 42.9 (1552.4) | 100.0 (1832.8) |
| rus_50_100_6_2 | 0.0 (nan) | 42.9 (1552.4) | 100.0 (1832.8) |
| rus_50_100_7_1 | 0.0 (nan) | 42.9 (1552.4) | 100.0 (1832.8) |
| rus_50_100_7_2 | 0.0 (nan) | 42.9 (1552.4) | 100.0 (1832.8) |
| rus_50_100_8_1 | 0.0 (nan) | 42.9 (1552.4) | 100.0 (1832.8) |
| rus_50_100_9_3 | 0.0 (nan) | 42.9 (1552.4) | 100.0 (1832.8) |
| satellite01ac.wcsp | 100.0 (-0.1) | 100.0 (-0.1) | 100.0 (-0.1) |
| satellite02ac.wcsp | 37.6 (-20.0) | 37.6 (-20.0) | 37.6 (-20.0) |
| scen06.wcsp | 98.3 (-14.8) | 98.3 (-14.8) | 98.3 (-14.8) |
| scen07.wcsp | 98.7 (-2.4) | 98.7 (-2.4) | 98.7 (-2.4) |
| zenotravel02ac.wcsp | 100.0 (-0.1) | 100.0 (-0.1) | 100.0 (-0.1) |
| zenotravel04ac.wcsp | 58.9 (-28.0) | 58.9 (-28.0) | 58.9 (-28.0) |