toulbar2-vacint-mpe Scores
The results below are organized as follows:
- each table displays the solver’s performance for individual problem instances for the given task under different time limits
- table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria
MPE
overall
| Problem | 20sec | 1200sec | 3600sec |
|---|---|---|---|
| 1CKK | 0.0 (nan) | 100.0 (5520.9) | 100.0 (5520.9) |
| 1CM1 | 0.0 (nan) | 100.0 (5414.6) | 100.0 (5414.6) |
| 1SY9 | 0.0 (nan) | 100.0 (3985.1) | 100.0 (3985.1) |
| 2BBN | 0.0 (nan) | 100.0 (5328.6) | 100.0 (5328.6) |
| 2BCX | 0.0 (nan) | 100.0 (6002.2) | 100.0 (6002.2) |
| BN-d-10000-4-2 | 0.0 (nan) | 0.0 (-1154.2) | 0.0 (-1152.5) |
| BN-d-200-5-10 | 99.3 (-46.6) | 99.3 (-46.6) | 99.3 (-46.6) |
| BN-d-20000-4-2 | 0.0 (nan) | 0.0 (-2338.6) | 0.0 (-2338.6) |
| BN-d-250-5-10 | 86.5 (-57.6) | 86.5 (-57.6) | 86.5 (-57.6) |
| BN-d-500-5-10 | 61.3 (-121.8) | 75.5 (-120.1) | 75.5 (-120.1) |
| BN-nd-10000-4-2 | 0.0 (nan) | 0.0 (-1308.1) | 0.0 (-1305.9) |
| BN-nd-200-5-10 | 98.2 (-54.6) | 98.2 (-54.6) | 98.2 (-54.6) |
| BN-nd-20000-4-2 | 0.0 (nan) | 0.0 (-2574.3) | 0.0 (-2573.6) |
| BN-nd-250-5-10 | 88.9 (-66.0) | 88.9 (-66.0) | 88.9 (-66.0) |
| BN-nd-500-5-10 | 77.3 (-137.5) | 77.3 (-137.5) | 77.3 (-137.5) |
| Hardsat_aes_64_1_keyfind_1 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| Hardsat_gss-25-s100 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Hardsat_mod2c-rand3bip-sat-240-3.shuffled-as.sat05-2520 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Hardsat_mod2c-rand3bip-sat-250-3.shuffled-as.sat05-2535 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Hardsat_mod4block_2vars_10gates_u2_autoenc | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Maxsat_aes_64_1_keyfind_1 | 4.1 (1808.8) | 20.3 (1819.0) | 21.1 (1819.5) |
| Maxsat_gss-25-s100 | 0.0 (nan) | 0.0 (63302.4) | 0.0 (63302.4) |
| Maxsat_mod2c-rand3bip-sat-240-3.shuffled-as.sat05-2520 | 79.0 (1626.9) | 79.0 (1626.9) | 79.0 (1626.9) |
| Maxsat_mod2c-rand3bip-sat-250-3.shuffled-as.sat05-2535 | 79.3 (1680.9) | 79.3 (1680.9) | 79.3 (1680.9) |
| Maxsat_mod4block_2vars_10gates_u2_autoenc | 0.0 (nan) | 98.5 (81310.0) | 98.5 (81310.0) |
| Promedas_60 | 100.0 (-10.0) | 100.0 (-10.0) | 100.0 (-10.0) |
| Promedas_61 | 100.0 (-6.9) | 100.0 (-6.9) | 100.0 (-6.9) |
| Promedas_62 | 100.0 (-4.7) | 100.0 (-4.7) | 100.0 (-4.7) |
| Promedas_63 | 100.0 (-6.1) | 100.0 (-6.1) | 100.0 (-6.1) |
| Promedas_64 | 100.0 (-11.5) | 100.0 (-11.5) | 100.0 (-11.5) |
| Promedas_65 | 100.0 (-5.2) | 100.0 (-5.2) | 100.0 (-5.2) |
| Promedas_66 | 100.0 (-10.4) | 100.0 (-10.4) | 100.0 (-10.4) |
| Promedas_67 | 100.0 (-13.4) | 100.0 (-13.4) | 100.0 (-13.4) |
| Promedas_68 | 100.0 (-18.9) | 100.0 (-18.9) | 100.0 (-18.9) |
| Promedas_69 | 100.0 (-11.2) | 100.0 (-11.2) | 100.0 (-11.2) |
| driverlog04ac.wcsp | 88.5 (-12.1) | 88.5 (-12.1) | 88.5 (-12.1) |
| driverlog05ac.wcsp | 80.0 (-20.0) | 80.0 (-20.0) | 80.0 (-20.0) |
| driverlog08ac.wcsp | 77.8 (-24.1) | 77.8 (-24.0) | 77.8 (-24.0) |
| grid20x20.f10 | 97.4 (1297.0) | 98.5 (1302.6) | 98.9 (1304.2) |
| grid20x20.f10.wrap | 97.1 (1310.1) | 98.9 (1319.4) | 98.9 (1319.4) |
| grid20x20.f15 | 98.7 (1952.0) | 99.6 (1959.0) | 99.6 (1959.0) |
| grid20x20.f15.wrap | 91.8 (1917.7) | 98.9 (1973.3) | 99.4 (1977.3) |
| grid20x20.f5.wrap | 91.4 (649.3) | 98.9 (667.4) | 98.9 (667.4) |
| grid40x40.f10 | 91.8 (5346.3) | 93.0 (5369.6) | 93.4 (5376.9) |
| grid40x40.f10.wrap | 95.2 (5563.7) | 95.4 (5569.6) | 95.5 (5569.8) |
| grid40x40.f15 | 94.3 (8066.4) | 95.0 (8087.8) | 95.0 (8087.8) |
| grid40x40.f15.wrap | 92.7 (8237.7) | 94.0 (8285.4) | 94.1 (8287.3) |
| grid40x40.f2 | 87.4 (1127.2) | 87.4 (1127.2) | 87.4 (1127.2) |
| grid40x40.f2.wrap | 96.7 (1167.9) | 98.3 (1173.5) | 98.3 (1173.5) |
| grid40x40.f5 | 94.8 (2733.8) | 95.8 (2743.1) | 95.8 (2743.1) |
| grid40x40.f5.wrap | 93.3 (2757.0) | 94.4 (2768.3) | 94.7 (2771.1) |
| grid80x80.f10 | 77.6 (20079.9) | 94.1 (21437.4) | 94.3 (21454.1) |
| grid80x80.f10.wrap | 76.2 (20062.1) | 95.6 (21654.6) | 95.7 (21665.5) |
| grid80x80.f15 | 77.5 (29969.1) | 93.8 (32021.0) | 94.1 (32066.8) |
| grid80x80.f15.wrap | 80.3 (30619.9) | 94.5 (32496.1) | 94.7 (32521.0) |
| grid80x80.f2 | 74.5 (4355.8) | 95.3 (4618.0) | 95.8 (4624.8) |
| grid80x80.f2.wrap | 76.5 (4409.3) | 95.0 (4666.9) | 95.2 (4668.6) |
| grid80x80.f5 | 75.3 (10237.6) | 93.8 (10927.3) | 94.3 (10945.3) |
| grid80x80.f5.wrap | 75.4 (10160.6) | 94.7 (10907.2) | 95.1 (10924.6) |
| pdb1jmx | 100.0 (-501.4) | 100.0 (-501.4) | 100.0 (-501.4) |
| pdb1kgn | 100.0 (-748.7) | 100.0 (-748.7) | 100.0 (-748.7) |
| pdb1kwh | 100.0 (-305.5) | 100.0 (-305.5) | 100.0 (-305.5) |
| pdb1m3y | 100.0 (-1054.2) | 100.0 (-1054.2) | 100.0 (-1054.2) |
| pdb1qks | 100.0 (-657.0) | 100.0 (-657.0) | 100.0 (-657.0) |
| pedigree1 | 100.0 (-45.6) | 100.0 (-45.6) | 100.0 (-45.6) |
| pedigree13 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree18 | 100.0 (-125.3) | 100.0 (-125.3) | 100.0 (-125.3) |
| pedigree19 | 97.8 (-99.0) | 99.4 (-97.6) | 99.5 (-97.5) |
| pedigree20 | 100.0 (-53.8) | 100.0 (-53.8) | 100.0 (-53.8) |
| pedigree23 | 100.0 (-62.4) | 100.0 (-62.4) | 100.0 (-62.4) |
| pedigree25 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree30 | 99.5 (-137.4) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree31 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree33 | 100.0 (-74.9) | 100.0 (-74.9) | 100.0 (-74.9) |
| pedigree34 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree37 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree38 | 100.0 (-87.3) | 100.0 (-87.3) | 100.0 (-87.3) |
| pedigree39 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree40 | 99.0 (-131.2) | 99.6 (-130.6) | 99.6 (-130.6) |
| pedigree41 | 98.6 (-121.9) | 100.0 (-120.7) | 100.0 (-120.7) |
| pedigree42 | 100.0 (-81.8) | 100.0 (-81.8) | 100.0 (-81.8) |
| pedigree44 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree50 | 100.0 (-61.7) | 100.0 (-61.7) | 100.0 (-61.7) |
| pedigree51 | 97.1 (-112.5) | 98.1 (-111.5) | 98.1 (-111.5) |
| pedigree7 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree9 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| rovers02ac.wcsp | 91.5 (-8.0) | 91.5 (-8.0) | 91.5 (-8.0) |
| rus_100_200_1_1 | 100.0 (2683.9) | 100.0 (2683.9) | 100.0 (2683.9) |
| rus_100_200_2_1 | 99.2 (2639.4) | 99.2 (2639.4) | 99.2 (2639.4) |
| rus_100_200_3_1 | 88.0 (2539.4) | 88.0 (2539.4) | 88.0 (2539.4) |
| rus_100_200_3_3 | 77.8 (2449.6) | 77.8 (2449.6) | 77.8 (2449.6) |
| rus_100_200_4_3 | 81.2 (2479.5) | 81.2 (2479.5) | 81.2 (2479.5) |
| rus_100_200_5_3 | 91.8 (2573.3) | 91.8 (2573.3) | 91.8 (2573.3) |
| rus_100_200_6_1 | 58.4 (2276.7) | 58.4 (2276.7) | 58.4 (2276.7) |
| rus_50_100_4_1 | 39.6 (1535.9) | 39.6 (1535.9) | 39.6 (1535.9) |
| rus_50_100_4_3 | 55.8 (1615.8) | 55.8 (1615.8) | 55.8 (1615.8) |
| rus_50_100_6_1 | 0.0 (1338.1) | 0.0 (1338.1) | 0.0 (1338.1) |
| rus_50_100_6_2 | 64.1 (1656.5) | 64.1 (1656.5) | 64.1 (1656.5) |
| rus_50_100_7_1 | 33.1 (1504.1) | 33.1 (1504.1) | 33.1 (1504.1) |
| rus_50_100_7_2 | 34.2 (1509.9) | 34.2 (1509.9) | 34.2 (1509.9) |
| rus_50_100_8_1 | 21.3 (1446.2) | 21.3 (1446.2) | 21.3 (1446.2) |
| rus_50_100_9_3 | 55.5 (1614.3) | 55.5 (1614.3) | 55.5 (1614.3) |
| satellite01ac.wcsp | 100.0 (-0.1) | 100.0 (-0.1) | 100.0 (-0.1) |
| satellite02ac.wcsp | 100.0 (-0.0) | 100.0 (-0.0) | 100.0 (-0.0) |
| scen06.wcsp | 99.3 (-14.1) | 100.0 (-13.6) | 100.0 (-13.6) |
| scen07.wcsp | 99.7 (-1.6) | 100.0 (-1.4) | 100.0 (-1.4) |
| zenotravel02ac.wcsp | 66.8 (-16.0) | 66.8 (-16.0) | 66.8 (-16.0) |
| zenotravel04ac.wcsp | 58.9 (-28.0) | 58.9 (-28.0) | 58.9 (-28.0) |