toulbar2-vacint-mpe Scores
The results below are organized as follows:
- each table displays the solver’s performance for individual problem instances for the given task under different time limits
- table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria
MPE
overall
| Problem | 20sec | 1200sec | 3600sec |
|---|---|---|---|
| Grids_18 | 95.2 (5563.7) | 95.5 (5569.8) | 95.5 (5569.8) |
| Grids_19 | 96.7 (1167.9) | 98.3 (1173.5) | 98.3 (1173.5) |
| Grids_20 | 74.5 (4355.8) | 95.3 (4618.0) | 95.8 (4624.8) |
| Grids_21 | 92.7 (8237.7) | 94.0 (8285.4) | 94.1 (8287.3) |
| Grids_22 | 93.3 (2757.0) | 94.4 (2768.3) | 94.7 (2771.1) |
| Grids_23 | 94.8 (2733.8) | 95.8 (2743.1) | 95.8 (2743.1) |
| Grids_24 | 94.3 (8066.4) | 95.0 (8087.8) | 95.0 (8087.8) |
| Grids_25 | 87.4 (1127.2) | 87.4 (1127.2) | 87.4 (1127.2) |
| Grids_26 | 97.1 (1310.1) | 98.9 (1319.4) | 98.9 (1319.4) |
| Grids_27 | 91.8 (5346.3) | 93.0 (5369.6) | 93.4 (5376.9) |
| Grids_28 | 91.8 (1917.7) | 98.9 (1973.3) | 99.4 (1977.3) |
| Grids_29 | 91.4 (649.3) | 98.9 (667.4) | 98.9 (667.4) |
| Grids_30 | 97.4 (1297.0) | 98.5 (1302.6) | 98.9 (1304.2) |
| ImageAlignment_11 | 100.0 (-824.2) | 100.0 (-824.2) | 100.0 (-824.2) |
| ImageAlignment_12 | 100.0 (-436.7) | 100.0 (-436.7) | 100.0 (-436.7) |
| ImageAlignment_13 | 100.0 (-2999.9) | 100.0 (-2999.9) | 100.0 (-2999.9) |
| ImageAlignment_14 | 100.0 (-1557.5) | 100.0 (-1557.5) | 100.0 (-1557.5) |
| ImageAlignment_15 | 100.0 (-1177.5) | 100.0 (-1177.5) | 100.0 (-1177.5) |
| ObjectDetection_11 | 100.0 (4412.7) | 100.0 (4412.7) | 100.0 (4412.7) |
| ObjectDetection_12 | 100.0 (6762.5) | 100.0 (6762.5) | 100.0 (6762.5) |
| ObjectDetection_13 | 100.0 (9970.6) | 100.0 (9970.6) | 100.0 (9970.6) |
| ObjectDetection_14 | 100.0 (9093.7) | 100.0 (9093.7) | 100.0 (9093.7) |
| ObjectDetection_15 | 100.0 (12633.3) | 100.0 (12633.3) | 100.0 (12633.3) |
| ObjectDetection_16 | 100.0 (14347.1) | 100.0 (14347.1) | 100.0 (14347.1) |
| ObjectDetection_17 | 100.0 (4887.4) | 100.0 (4887.4) | 100.0 (4887.4) |
| ObjectDetection_18 | 100.0 (9017.1) | 100.0 (9017.1) | 100.0 (9017.1) |
| Promedas_11 | 100.0 (-21.0) | 100.0 (-21.0) | 100.0 (-21.0) |
| Promedas_12 | 100.0 (-15.3) | 100.0 (-15.3) | 100.0 (-15.3) |
| Promedas_13 | 100.0 (-27.1) | 100.0 (-27.1) | 100.0 (-27.1) |
| Promedas_14 | 100.0 (-18.6) | 100.0 (-18.6) | 100.0 (-18.6) |
| Promedas_15 | 100.0 (-24.5) | 100.0 (-24.5) | 100.0 (-24.5) |
| Promedas_16 | 100.0 (-19.7) | 100.0 (-19.7) | 100.0 (-19.7) |
| Promedas_17 | 100.0 (-19.8) | 100.0 (-19.8) | 100.0 (-19.8) |
| Promedas_18 | 100.0 (-24.4) | 100.0 (-24.4) | 100.0 (-24.4) |
| Promedas_19 | 100.0 (-26.1) | 100.0 (-26.1) | 100.0 (-26.1) |
| Promedas_20 | 100.0 (-12.2) | 100.0 (-12.2) | 100.0 (-12.2) |
| Promedas_21 | 100.0 (-17.4) | 100.0 (-17.4) | 100.0 (-17.4) |
| Promedas_22 | 100.0 (-16.1) | 100.0 (-16.1) | 100.0 (-16.1) |
| Promedas_23 | 100.0 (-23.5) | 100.0 (-23.5) | 100.0 (-23.5) |
| Promedas_24 | 100.0 (-12.5) | 100.0 (-12.5) | 100.0 (-12.5) |
| Promedas_25 | 100.0 (-14.7) | 100.0 (-14.7) | 100.0 (-14.7) |
| Promedas_26 | 100.0 (-19.2) | 100.0 (-19.2) | 100.0 (-19.2) |
| Promedas_27 | 100.0 (-10.0) | 100.0 (-10.0) | 100.0 (-10.0) |
| Promedas_28 | 100.0 (-6.0) | 100.0 (-6.0) | 100.0 (-6.0) |
| Promedas_29 | 100.0 (-19.8) | 100.0 (-19.8) | 100.0 (-19.8) |
| Promedas_30 | 100.0 (-10.4) | 100.0 (-10.4) | 100.0 (-10.4) |
| Promedas_31 | 100.0 (-12.2) | 100.0 (-12.2) | 100.0 (-12.2) |
| Promedas_32 | 100.0 (-13.9) | 100.0 (-13.9) | 100.0 (-13.9) |
| Promedas_33 | 100.0 (-14.0) | 100.0 (-14.0) | 100.0 (-14.0) |
| Promedas_34 | 100.0 (-17.0) | 100.0 (-17.0) | 100.0 (-17.0) |
| Promedas_35 | 100.0 (-11.3) | 100.0 (-11.3) | 100.0 (-11.3) |
| Promedas_36 | 100.0 (-8.2) | 100.0 (-8.2) | 100.0 (-8.2) |
| Promedas_37 | 100.0 (-15.4) | 100.0 (-15.4) | 100.0 (-15.4) |
| Promedas_38 | 100.0 (-12.1) | 100.0 (-12.1) | 100.0 (-12.1) |
| Promedas_39 | 100.0 (-20.7) | 100.0 (-20.7) | 100.0 (-20.7) |
| Promedas_40 | 100.0 (-7.3) | 100.0 (-7.3) | 100.0 (-7.3) |
| Promedas_41 | 100.0 (-9.7) | 100.0 (-9.7) | 100.0 (-9.7) |
| Promedas_42 | 100.0 (-12.8) | 100.0 (-12.8) | 100.0 (-12.8) |
| Promedas_43 | 100.0 (-7.5) | 100.0 (-7.5) | 100.0 (-7.5) |
| Promedas_44 | 100.0 (-9.3) | 100.0 (-9.3) | 100.0 (-9.3) |
| Promedas_45 | 100.0 (-7.5) | 100.0 (-7.5) | 100.0 (-7.5) |
| Promedas_46 | 100.0 (-12.8) | 100.0 (-12.8) | 100.0 (-12.8) |
| Promedas_47 | 100.0 (-14.0) | 100.0 (-14.0) | 100.0 (-14.0) |
| Promedas_48 | 100.0 (-10.8) | 100.0 (-10.8) | 100.0 (-10.8) |
| Promedas_49 | 100.0 (-8.4) | 100.0 (-8.4) | 100.0 (-8.4) |
| Promedas_50 | 100.0 (-9.0) | 100.0 (-9.0) | 100.0 (-9.0) |
| Promedas_51 | 100.0 (-12.3) | 100.0 (-12.3) | 100.0 (-12.3) |
| Promedas_52 | 100.0 (-10.8) | 100.0 (-10.8) | 100.0 (-10.8) |
| Promedas_53 | 100.0 (-9.1) | 100.0 (-9.1) | 100.0 (-9.1) |
| Promedas_54 | 100.0 (-10.3) | 100.0 (-10.3) | 100.0 (-10.3) |
| Promedas_55 | 100.0 (-12.7) | 100.0 (-12.7) | 100.0 (-12.7) |
| Promedas_56 | 100.0 (-10.8) | 100.0 (-10.8) | 100.0 (-10.8) |
| Promedas_57 | 100.0 (-10.4) | 100.0 (-10.4) | 100.0 (-10.4) |
| Promedas_58 | 100.0 (-19.9) | 100.0 (-19.9) | 100.0 (-19.9) |
| Promedas_59 | 100.0 (-10.6) | 100.0 (-10.6) | 100.0 (-10.6) |
| Promedas_60 | 100.0 (-10.0) | 100.0 (-10.0) | 100.0 (-10.0) |
| Promedas_61 | 100.0 (-6.9) | 100.0 (-6.9) | 100.0 (-6.9) |
| Promedas_62 | 100.0 (-4.7) | 100.0 (-4.7) | 100.0 (-4.7) |
| Promedas_63 | 100.0 (-6.1) | 100.0 (-6.1) | 100.0 (-6.1) |
| Promedas_64 | 100.0 (-11.5) | 100.0 (-11.5) | 100.0 (-11.5) |
| Promedas_65 | 100.0 (-5.2) | 100.0 (-5.2) | 100.0 (-5.2) |
| Promedas_66 | 100.0 (-10.4) | 100.0 (-10.4) | 100.0 (-10.4) |
| Promedas_67 | 100.0 (-13.4) | 100.0 (-13.4) | 100.0 (-13.4) |
| Promedas_68 | 100.0 (-18.9) | 100.0 (-18.9) | 100.0 (-18.9) |
| Promedas_69 | 100.0 (-11.2) | 100.0 (-11.2) | 100.0 (-11.2) |
| Promedas_70 | 100.0 (-4.1) | 100.0 (-4.1) | 100.0 (-4.1) |
| Promedas_71 | 100.0 (-6.0) | 100.0 (-6.0) | 100.0 (-6.0) |
| ProteinFolding_11 | 98.7 (1952.0) | 99.6 (1959.0) | 99.6 (1959.0) |
| ProteinFolding_12 | 100.0 (-1547.1) | 100.0 (-1547.1) | 100.0 (-1547.1) |
| ProteinFolding_13 | 100.0 (-143.3) | 100.0 (-143.3) | 100.0 (-143.3) |
| ProteinFolding_14 | 100.0 (-331.7) | 100.0 (-331.7) | 100.0 (-331.7) |
| ProteinFolding_15 | 100.0 (-51.6) | 100.0 (-51.6) | 100.0 (-51.6) |
| ProteinFolding_16 | 100.0 (-855.5) | 100.0 (-855.5) | 100.0 (-855.5) |
| ProteinFolding_17 | 100.0 (16544.2) | 100.0 (16544.2) | 100.0 (16544.2) |
| ProteinFolding_18 | 100.0 (18606.3) | 100.0 (18606.3) | 100.0 (18606.3) |
| ProteinFolding_19 | 100.0 (2678.5) | 100.0 (2678.5) | 100.0 (2678.5) |
| ProteinFolding_20 | 100.0 (5578.7) | 100.0 (5578.7) | 100.0 (5578.7) |
| ProteinFolding_21 | 100.0 (7958.7) | 100.0 (7958.7) | 100.0 (7958.7) |
| ProteinFolding_22 | 100.0 (10547.2) | 100.0 (10547.2) | 100.0 (10547.2) |
| ProteinFolding_23 | 100.0 (4279.1) | 100.0 (4279.1) | 100.0 (4279.1) |
| ProteinFolding_24 | 100.0 (5900.4) | 100.0 (5900.4) | 100.0 (5900.4) |
| ProteinFolding_25 | 100.0 (8656.3) | 100.0 (8656.3) | 100.0 (8656.3) |
| Segmentation_11 | 100.0 (-135.8) | 100.0 (-135.8) | 100.0 (-135.8) |
| Segmentation_12 | 100.0 (-22.2) | 100.0 (-22.2) | 100.0 (-22.2) |
| Segmentation_13 | 100.0 (-21.7) | 100.0 (-21.7) | 100.0 (-21.7) |
| Segmentation_14 | 100.0 (-40.1) | 100.0 (-40.1) | 100.0 (-40.1) |
| Segmentation_15 | 100.0 (-165.2) | 100.0 (-165.2) | 100.0 (-165.2) |
| Segmentation_16 | 100.0 (-41.3) | 100.0 (-41.3) | 100.0 (-41.3) |
| Segmentation_17 | 100.0 (-176.8) | 100.0 (-176.8) | 100.0 (-176.8) |
| Segmentation_18 | 100.0 (-35.9) | 100.0 (-35.9) | 100.0 (-35.9) |
| Segmentation_19 | 100.0 (-25.5) | 100.0 (-25.5) | 100.0 (-25.5) |
| Segmentation_20 | 100.0 (-113.9) | 100.0 (-113.9) | 100.0 (-113.9) |
| wcsp_11 | 66.6 (-3.3) | 77.8 (-3.3) | 88.9 (-3.3) |
| wcsp_12 | 99.8 (-2.6) | 99.9 (-2.6) | 99.9 (-2.6) |
| wcsp_13 | 94.0 (-8.1) | 94.0 (-8.1) | 94.0 (-8.1) |
| wcsp_14 | 87.5 (-16.1) | 87.6 (-16.1) | 87.6 (-16.1) |
| wcsp_15 | 96.6 (-80.0) | 96.6 (-80.0) | 96.6 (-80.0) |
| wcsp_16 | 100.0 (-16.5) | 100.0 (-16.5) | 100.0 (-16.5) |
| wcsp_17 | 99.5 (-13.3) | 100.0 (-12.3) | 100.0 (-12.3) |
| wcsp_18 | 58.9 (-28.0) | 58.9 (-28.0) | 58.9 (-28.0) |