uai14-mpe Scores
The results below are organized as follows:
- each table displays the solver’s performance for individual problem instances for the given task under different time limits
- table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria
MPE
overall
| Problem | 20sec | 1200sec | 3600sec |
|---|---|---|---|
| Grids_18 | 60.8 (4770.6) | 60.8 (4770.6) | 60.8 (4770.6) |
| Grids_19 | 57.4 (1033.4) | 57.4 (1033.4) | 57.4 (1033.4) |
| Grids_20 | 52.5 (4077.8) | 56.7 (4130.7) | 56.7 (4130.7) |
| Grids_21 | 64.0 (7226.5) | 64.0 (7226.5) | 64.0 (7226.5) |
| Grids_22 | 55.9 (2375.1) | 56.1 (2376.4) | 56.1 (2376.4) |
| Grids_23 | 58.3 (2394.7) | 60.3 (2412.8) | 60.3 (2412.8) |
| Grids_24 | 56.3 (6950.6) | 59.6 (7049.3) | 59.6 (7049.3) |
| Grids_25 | 69.1 (1068.5) | 69.1 (1068.5) | 69.1 (1068.5) |
| Grids_26 | 60.6 (1125.1) | 60.6 (1125.1) | 60.6 (1125.1) |
| Grids_27 | 55.4 (4647.1) | 59.6 (4727.8) | 59.6 (4727.8) |
| Grids_28 | 67.0 (1724.8) | 67.0 (1724.8) | 67.0 (1724.8) |
| Grids_29 | 65.2 (586.6) | 65.2 (586.6) | 65.2 (586.6) |
| Grids_30 | 64.3 (1138.7) | 64.3 (1138.7) | 64.3 (1138.7) |
| ImageAlignment_11 | 100.0 (-824.2) | 100.0 (-824.2) | 100.0 (-824.2) |
| ImageAlignment_12 | 100.0 (-436.7) | 100.0 (-436.7) | 100.0 (-436.7) |
| ImageAlignment_13 | 100.0 (-2999.9) | 100.0 (-2999.9) | 100.0 (-2999.9) |
| ImageAlignment_14 | 100.0 (-1557.5) | 100.0 (-1557.5) | 100.0 (-1557.5) |
| ImageAlignment_15 | 100.0 (-1177.5) | 100.0 (-1177.5) | 100.0 (-1177.5) |
| ObjectDetection_11 | 0.0 (2153.8) | 0.0 (3083.8) | 30.8 (3571.3) |
| ObjectDetection_12 | 0.0 (1300.0) | 0.0 (2984.0) | 0.0 (2984.0) |
| ObjectDetection_13 | 0.0 (5128.2) | 0.0 (5777.3) | 0.0 (5280.9) |
| ObjectDetection_14 | 0.0 (5273.4) | 0.0 (3204.4) | 0.0 (3204.4) |
| ObjectDetection_15 | 0.0 (8379.0) | 0.0 (3970.8) | 0.0 (4258.8) |
| ObjectDetection_16 | 0.0 (8554.9) | 0.0 (7589.9) | 0.0 (8533.0) |
| ObjectDetection_17 | 2.0 (2223.0) | 39.7 (3248.4) | 39.7 (3248.4) |
| ObjectDetection_18 | 0.0 (4200.9) | 0.0 (2413.4) | 0.0 (2413.4) |
| Promedas_11 | 49.2 (-45.9) | 49.2 (-45.9) | 50.6 (-45.2) |
| Promedas_12 | 36.1 (-44.4) | 43.8 (-40.9) | 42.1 (-41.7) |
| Promedas_13 | 36.3 (-67.9) | 44.8 (-62.5) | 36.9 (-67.5) |
| Promedas_14 | 57.7 (-37.2) | 57.7 (-37.2) | 57.7 (-37.2) |
| Promedas_15 | 63.6 (-43.3) | 64.2 (-43.0) | 65.5 (-42.3) |
| Promedas_16 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Promedas_17 | 51.0 (-40.6) | 84.7 (-26.3) | 86.3 (-25.6) |
| Promedas_18 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Promedas_19 | 32.3 (-74.7) | 33.8 (-73.6) | 32.3 (-74.7) |
| Promedas_20 | 45.9 (-34.8) | 57.5 (-30.0) | 16.4 (-47.1) |
| Promedas_21 | 14.7 (-62.9) | 14.7 (-62.9) | 15.6 (-62.4) |
| Promedas_22 | 52.3 (-40.4) | 53.3 (-39.9) | 47.3 (-43.0) |
| Promedas_23 | 31.3 (-58.2) | 37.4 (-55.1) | 34.4 (-56.6) |
| Promedas_24 | 39.0 (-28.8) | 39.0 (-28.8) | 51.9 (-25.4) |
| Promedas_25 | 39.6 (-33.9) | 39.0 (-34.1) | 39.0 (-34.1) |
| Promedas_26 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Promedas_27 | 22.4 (-32.1) | 27.4 (-30.7) | 47.9 (-24.8) |
| Promedas_28 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Promedas_29 | 44.1 (-39.9) | 44.1 (-39.9) | 44.0 (-39.9) |
| Promedas_30 | 39.9 (-35.7) | 39.5 (-35.8) | 39.5 (-35.8) |
| Promedas_31 | 38.4 (-35.3) | 77.2 (-20.8) | 77.2 (-20.8) |
| Promedas_32 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Promedas_33 | 28.6 (-43.0) | 40.4 (-38.2) | 61.3 (-29.7) |
| Promedas_34 | 48.2 (-35.5) | 45.9 (-36.3) | 46.6 (-36.0) |
| Promedas_35 | 61.8 (-18.6) | 3.2 (-29.8) | 14.3 (-27.7) |
| Promedas_36 | 18.7 (-25.4) | 19.6 (-25.2) | 0.0 (-29.7) |
| Promedas_37 | 25.3 (-39.5) | 23.7 (-40.0) | 14.0 (-43.2) |
| Promedas_38 | 45.9 (-27.3) | 45.9 (-27.3) | 47.5 (-26.8) |
| Promedas_39 | 60.7 (-33.6) | 59.2 (-34.1) | 68.3 (-31.1) |
| Promedas_40 | 35.8 (-19.9) | 33.7 (-20.3) | 38.6 (-19.3) |
| Promedas_41 | 24.3 (-29.9) | 63.8 (-19.4) | 63.8 (-19.4) |
| Promedas_42 | 23.2 (-38.0) | 22.2 (-38.3) | 24.6 (-37.5) |
| Promedas_43 | 25.5 (-20.9) | 25.5 (-20.9) | 23.1 (-21.4) |
| Promedas_44 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Promedas_45 | 59.4 (-15.4) | 86.7 (-10.1) | 86.7 (-10.1) |
| Promedas_46 | 60.0 (-25.0) | 53.8 (-26.9) | 53.8 (-26.9) |
| Promedas_47 | 32.0 (-36.8) | 92.7 (-16.5) | 92.7 (-16.5) |
| Promedas_48 | 10.6 (-29.9) | 17.1 (-28.5) | 17.9 (-28.3) |
| Promedas_49 | 59.4 (-18.1) | 69.4 (-15.7) | 69.4 (-15.7) |
| Promedas_50 | 14.6 (-23.8) | 16.0 (-23.5) | 15.7 (-23.6) |
| Promedas_51 | 60.3 (-21.4) | 60.3 (-21.4) | 76.9 (-17.6) |
| Promedas_52 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Promedas_53 | 18.8 (-28.4) | 24.2 (-27.1) | 20.5 (-28.0) |
| Promedas_54 | 75.9 (-14.8) | 75.9 (-14.8) | 75.9 (-14.8) |
| Promedas_55 | 20.0 (-27.6) | 5.6 (-30.3) | 25.9 (-26.5) |
| Promedas_56 | 32.5 (-26.4) | 44.6 (-23.6) | 91.8 (-12.7) |
| Promedas_57 | 76.6 (-19.0) | 86.3 (-15.5) | 86.3 (-15.5) |
| Promedas_58 | 14.7 (-59.0) | 25.1 (-54.3) | 12.8 (-60.0) |
| Promedas_59 | 0.0 (-30.7) | 21.9 (-26.1) | 34.8 (-23.5) |
| Promedas_60 | 24.7 (-25.3) | 51.4 (-19.9) | 55.4 (-19.1) |
| Promedas_61 | 0.0 (-33.0) | 73.3 (-10.8) | 73.3 (-10.8) |
| Promedas_62 | 71.3 (-10.9) | 83.5 (-8.2) | 92.2 (-6.3) |
| Promedas_63 | 34.1 (-15.4) | 34.1 (-15.4) | 67.7 (-10.7) |
| Promedas_64 | 0.0 (-28.0) | 84.4 (-13.8) | 86.7 (-13.5) |
| Promedas_65 | 26.0 (-18.7) | 46.1 (-15.0) | 46.1 (-15.0) |
| Promedas_66 | 0.0 (-28.9) | 74.6 (-14.5) | 74.6 (-14.5) |
| Promedas_67 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Promedas_68 | 31.7 (-44.2) | 30.1 (-44.8) | 30.3 (-44.7) |
| Promedas_69 | 0.0 (-26.6) | 5.0 (-23.3) | 5.0 (-23.3) |
| Promedas_70 | 0.0 (-12.2) | 51.6 (-7.9) | 51.6 (-7.9) |
| Promedas_71 | 29.6 (-18.7) | 29.6 (-18.7) | 87.5 (-8.3) |
| ProteinFolding_11 | 65.5 (1709.4) | 65.5 (1709.4) | 65.5 (1709.4) |
| ProteinFolding_12 | 100.0 (-1547.1) | 100.0 (-1547.1) | 100.0 (-1547.1) |
| ProteinFolding_13 | 100.0 (-143.3) | 100.0 (-143.3) | 100.0 (-143.3) |
| ProteinFolding_14 | 100.0 (-331.7) | 100.0 (-331.7) | 100.0 (-331.7) |
| ProteinFolding_15 | 100.0 (-51.6) | 100.0 (-51.6) | 100.0 (-51.6) |
| ProteinFolding_16 | 100.0 (-855.5) | 100.0 (-855.5) | 100.0 (-855.5) |
| ProteinFolding_17 | 0.0 (8114.9) | 0.0 (7107.9) | 0.0 (7141.5) |
| ProteinFolding_18 | 33.8 (12444.4) | 7.8 (10028.2) | 8.6 (10102.6) |
| ProteinFolding_19 | 0.0 (1580.7) | 62.0 (2365.7) | 62.0 (2365.7) |
| ProteinFolding_20 | 0.0 (1399.8) | 0.0 (3729.9) | 0.0 (3729.9) |
| ProteinFolding_21 | 0.0 (5232.2) | 0.0 (3674.0) | 0.0 (3190.3) |
| ProteinFolding_22 | 0.0 (5525.9) | 0.0 (6737.1) | 0.0 (5678.5) |
| ProteinFolding_23 | 10.2 (3454.3) | 82.4 (4117.9) | 82.4 (4117.9) |
| ProteinFolding_24 | 0.0 (2652.5) | 0.0 (4241.3) | 0.0 (4241.3) |
| ProteinFolding_25 | 0.0 (4459.6) | 0.0 (3769.2) | 0.0 (3879.1) |
| Segmentation_11 | 100.0 (-135.8) | 100.0 (-135.8) | 100.0 (-135.8) |
| Segmentation_12 | 100.0 (-22.2) | 100.0 (-22.2) | 100.0 (-22.2) |
| Segmentation_13 | 100.0 (-21.7) | 100.0 (-21.7) | 100.0 (-21.7) |
| Segmentation_14 | 100.0 (-40.1) | 100.0 (-40.1) | 100.0 (-40.1) |
| Segmentation_15 | 100.0 (-165.2) | 100.0 (-165.2) | 100.0 (-165.2) |
| Segmentation_16 | 100.0 (-41.3) | 100.0 (-41.3) | 100.0 (-41.3) |
| Segmentation_17 | 97.2 (-177.3) | 100.0 (-176.8) | 100.0 (-176.8) |
| Segmentation_18 | 100.0 (-35.9) | 100.0 (-35.9) | 100.0 (-35.9) |
| Segmentation_19 | 100.0 (-25.5) | 100.0 (-25.5) | 100.0 (-25.5) |
| Segmentation_20 | 100.0 (-113.9) | 100.0 (-113.9) | 100.0 (-113.9) |
| wcsp_11 | 0.0 (-3.5) | 0.0 (-3.5) | 0.0 (-3.5) |
| wcsp_12 | 69.6 (-2.9) | 89.5 (-2.7) | 89.5 (-2.7) |
| wcsp_13 | 91.1 (-12.0) | 91.1 (-12.0) | 91.1 (-12.0) |
| wcsp_14 | 78.2 (-28.0) | 78.2 (-28.0) | 78.2 (-28.0) |
| wcsp_15 | 13.8 (-176.0) | 13.8 (-176.0) | 20.7 (-168.0) |
| wcsp_16 | 100.0 (-16.5) | 88.3 (-27.9) | 91.9 (-24.4) |
| wcsp_17 | 99.6 (-13.2) | 75.9 (-60.0) | 84.3 (-43.4) |
| wcsp_18 | 53.0 (-32.0) | 53.0 (-32.0) | 53.0 (-32.0) |