daoopt-lh-mmap Scores
The results below are organized as follows:
- each table displays the solver’s performance for individual problem instances for the given task under different time limits
- table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria
MMAP
overall
| Problem | 20sec | 1200sec | 3600sec |
|---|---|---|---|
| Grids_18 | 96.6 (5601.2) | 98.4 (5640.8) | 99.3 (5662.4) |
| Grids_19 | 98.5 (1216.7) | 99.6 (1220.8) | 100.0 (1222.4) |
| Grids_20 | 98.0 (4810.0) | 99.6 (4832.9) | 99.6 (4833.1) |
| Grids_21 | 95.1 (8325.4) | 98.2 (8437.1) | 99.1 (8466.5) |
| Grids_22 | 96.6 (2800.2) | 99.6 (2831.1) | 99.1 (2826.1) |
| Grids_23 | 95.5 (2751.1) | 100.0 (2792.7) | 99.9 (2791.7) |
| Grids_24 | 97.1 (8153.5) | 99.3 (8215.7) | 99.8 (8232.8) |
| Grids_25 | 98.0 (1202.3) | 100.0 (1209.6) | 99.7 (1208.5) |
| Grids_26 | 98.3 (1317.6) | 100.0 (1326.3) | 100.0 (1326.3) |
| Grids_27 | 96.7 (5445.6) | 99.7 (5503.1) | 99.6 (5501.9) |
| Grids_28 | 98.1 (1967.9) | 100.0 (1982.5) | 100.0 (1982.5) |
| Grids_29 | 99.2 (671.0) | 100.0 (673.0) | 100.0 (673.0) |
| Grids_30 | 100.0 (1311.5) | 100.0 (1311.5) | 100.0 (1311.5) |
| ImageAlignment_11 | 100.0 (-824.2) | 100.0 (-824.2) | 100.0 (-824.2) |
| ImageAlignment_12 | 100.0 (-436.7) | 100.0 (-436.7) | 100.0 (-436.7) |
| ImageAlignment_13 | 99.8 (-2999.8) | 99.8 (-2999.8) | 99.8 (-2999.8) |
| ImageAlignment_14 | 100.0 (-1557.5) | 100.0 (-1557.5) | 100.0 (-1557.5) |
| ImageAlignment_15 | 97.3 (-1188.0) | 97.3 (-1188.0) | 100.0 (-1177.5) |
| ObjectDetection_11 | 81.0 (4181.6) | 81.0 (4181.6) | 81.0 (4181.6) |
| ObjectDetection_12 | 94.6 (6725.5) | 94.6 (6725.5) | 94.6 (6725.5) |
| ObjectDetection_13 | 99.6 (9967.7) | 99.6 (9967.7) | 99.6 (9967.7) |
| ObjectDetection_14 | 94.3 (9020.8) | 94.3 (9020.8) | 94.3 (9020.8) |
| ObjectDetection_15 | 59.7 (11703.8) | 59.7 (11703.8) | 59.7 (11703.8) |
| ObjectDetection_16 | 92.9 (14154.2) | 92.9 (14154.2) | 92.9 (14154.2) |
| ObjectDetection_17 | 93.7 (4716.4) | 93.7 (4716.4) | 93.7 (4716.4) |
| ObjectDetection_18 | 92.0 (8849.5) | 92.0 (8849.5) | 92.0 (8849.5) |
| Promedas_11 | 0.0 (nan) | 72.5 (-28.9) | 64.1 (-33.7) |
| Promedas_12 | 93.0 (-11.4) | 93.0 (-11.4) | 93.0 (-11.4) |
| Promedas_13 | 98.1 (-22.3) | 98.1 (-22.3) | 98.1 (-22.3) |
| Promedas_14 | 100.0 (-13.0) | 100.0 (-13.0) | 100.0 (-13.0) |
| Promedas_15 | 98.0 (-22.2) | 95.6 (-23.5) | 100.0 (-21.1) |
| Promedas_16 | 99.8 (-14.9) | 99.8 (-14.9) | 99.8 (-14.9) |
| Promedas_17 | 100.0 (-16.5) | 100.0 (-16.5) | 100.0 (-16.5) |
| Promedas_18 | 99.1 (-21.8) | 99.1 (-21.8) | 99.1 (-21.8) |
| Promedas_19 | 100.0 (-20.2) | 100.0 (-20.2) | 100.0 (-20.2) |
| Promedas_20 | 97.4 (-11.8) | 97.4 (-11.8) | 97.4 (-11.8) |
| Promedas_21 | 100.0 (-12.9) | 100.0 (-12.9) | 100.0 (-12.9) |
| Promedas_22 | 99.8 (-14.6) | 99.8 (-14.6) | 99.8 (-14.6) |
| Promedas_23 | 100.0 (-16.7) | 93.3 (-20.5) | 100.0 (-16.7) |
| Promedas_24 | 100.0 (-9.5) | 100.0 (-9.5) | 100.0 (-9.5) |
| Promedas_25 | 100.0 (-11.6) | 100.0 (-11.6) | 100.0 (-11.6) |
| Promedas_26 | 100.0 (-11.9) | 100.0 (-11.9) | 100.0 (-11.9) |
| Promedas_27 | 100.0 (-9.0) | 100.0 (-9.0) | 96.1 (-10.2) |
| Promedas_28 | 100.0 (-4.4) | 100.0 (-4.4) | 100.0 (-4.4) |
| Promedas_29 | 99.2 (-14.0) | 99.2 (-14.0) | 99.2 (-14.0) |
| Promedas_30 | 100.0 (-10.4) | 100.0 (-10.4) | 100.0 (-10.4) |
| Promedas_31 | 99.1 (-11.0) | 99.1 (-11.0) | 100.0 (-10.7) |
| Promedas_32 | 92.1 (-13.9) | 92.1 (-13.9) | 92.1 (-13.9) |
| Promedas_33 | 100.0 (-12.5) | 100.0 (-12.5) | 100.0 (-12.5) |
| Promedas_34 | 100.0 (-14.0) | 100.0 (-14.0) | 100.0 (-14.0) |
| Promedas_35 | 100.0 (-9.7) | 100.0 (-9.7) | 100.0 (-9.7) |
| Promedas_36 | 100.0 (-8.2) | 100.0 (-8.2) | 100.0 (-8.2) |
| Promedas_37 | 100.0 (-10.8) | 100.0 (-10.8) | 100.0 (-10.8) |
| Promedas_38 | 100.0 (-12.1) | 100.0 (-12.1) | 100.0 (-12.1) |
| Promedas_39 | 100.0 (-15.3) | 95.0 (-17.2) | 100.0 (-15.3) |
| Promedas_40 | 100.0 (-7.0) | 98.5 (-7.3) | 100.0 (-7.0) |
| Promedas_41 | 100.0 (-8.1) | 99.4 (-8.3) | 100.0 (-8.1) |
| Promedas_42 | 100.0 (-8.4) | 92.4 (-11.2) | 92.4 (-11.2) |
| Promedas_43 | 100.0 (-7.5) | 100.0 (-7.5) | 100.0 (-7.5) |
| Promedas_44 | 95.1 (-7.8) | 100.0 (-6.2) | 95.1 (-7.8) |
| Promedas_45 | 100.0 (-6.0) | 100.0 (-6.0) | 100.0 (-6.0) |
| Promedas_46 | 100.0 (-8.2) | 100.0 (-8.2) | 100.0 (-8.2) |
| Promedas_47 | 100.0 (-6.4) | 100.0 (-6.4) | 100.0 (-6.4) |
| Promedas_48 | 100.0 (-7.9) | 100.0 (-7.9) | 100.0 (-7.9) |
| Promedas_49 | 99.8 (-6.9) | 99.8 (-6.9) | 99.8 (-6.9) |
| Promedas_50 | 100.0 (-7.4) | 100.0 (-7.4) | 100.0 (-7.4) |
| Promedas_51 | 100.0 (-7.7) | 100.0 (-7.7) | 100.0 (-7.7) |
| Promedas_52 | 100.0 (-10.7) | 100.0 (-10.7) | 100.0 (-10.7) |
| Promedas_53 | 100.0 (-9.1) | 100.0 (-9.1) | 100.0 (-9.1) |
| Promedas_54 | 100.0 (-8.8) | 100.0 (-8.8) | 100.0 (-8.8) |
| Promedas_55 | 100.0 (-11.2) | 100.0 (-11.2) | 100.0 (-11.2) |
| Promedas_56 | 98.1 (-8.3) | 100.0 (-7.8) | 98.1 (-8.3) |
| Promedas_57 | 100.0 (-10.3) | 100.0 (-10.3) | 100.0 (-10.3) |
| Promedas_58 | 100.0 (-15.3) | 100.0 (-15.3) | 100.0 (-15.3) |
| Promedas_59 | 100.0 (-10.5) | 100.0 (-10.5) | 100.0 (-10.5) |
| Promedas_60 | 100.0 (-10.0) | 100.0 (-10.0) | 100.0 (-10.0) |
| Promedas_61 | 100.0 (-5.4) | 100.0 (-5.4) | 100.0 (-5.4) |
| Promedas_62 | 100.0 (-4.7) | 100.0 (-4.7) | 100.0 (-4.7) |
| Promedas_63 | 100.0 (-4.6) | 100.0 (-4.6) | 100.0 (-4.6) |
| Promedas_64 | 100.0 (-9.9) | 100.0 (-9.9) | 100.0 (-9.9) |
| Promedas_65 | 100.0 (-5.1) | 100.0 (-5.1) | 100.0 (-5.1) |
| Promedas_66 | 100.0 (-10.4) | 100.0 (-10.4) | 100.0 (-10.4) |
| Promedas_67 | 95.9 (-11.8) | 95.9 (-11.8) | 95.9 (-11.8) |
| Promedas_68 | 100.0 (-18.8) | 100.0 (-18.8) | 100.0 (-18.8) |
| Promedas_69 | 100.0 (-9.7) | 100.0 (-9.7) | 100.0 (-9.7) |
| Promedas_70 | 100.0 (-4.1) | 100.0 (-4.1) | 100.0 (-4.1) |
| Promedas_71 | 100.0 (-6.0) | 100.0 (-6.0) | 100.0 (-6.0) |
| ProteinFolding_11 | 100.0 (1962.3) | 100.0 (1962.3) | 100.0 (1962.3) |
| ProteinFolding_12 | 100.0 (-1547.0) | 100.0 (-1547.0) | 100.0 (-1547.0) |
| ProteinFolding_13 | 100.0 (-143.3) | 100.0 (-143.3) | 100.0 (-143.3) |
| ProteinFolding_14 | 100.0 (-331.7) | 100.0 (-331.7) | 100.0 (-331.7) |
| ProteinFolding_15 | 100.0 (-51.6) | 100.0 (-51.6) | 100.0 (-51.6) |
| ProteinFolding_16 | 100.0 (-855.5) | 100.0 (-855.5) | 100.0 (-855.5) |
| ProteinFolding_17 | 100.0 (16544.2) | 100.0 (16544.2) | 100.0 (16544.2) |
| ProteinFolding_18 | 88.5 (17533.8) | 88.5 (17533.8) | 88.5 (17533.8) |
| ProteinFolding_19 | 83.8 (2545.1) | 83.8 (2545.1) | 83.8 (2545.1) |
| ProteinFolding_20 | 100.0 (5578.7) | 100.0 (5578.7) | 100.0 (5578.7) |
| ProteinFolding_21 | 85.8 (7880.7) | 85.8 (7880.7) | 85.8 (7880.7) |
| ProteinFolding_22 | 100.0 (10547.2) | 100.0 (10547.2) | 100.0 (10547.2) |
| ProteinFolding_23 | 70.1 (4004.3) | 70.1 (4004.3) | 70.1 (4004.3) |
| ProteinFolding_24 | 99.5 (5892.9) | 99.5 (5892.9) | 99.5 (5892.9) |
| ProteinFolding_25 | 100.0 (8656.3) | 100.0 (8656.3) | 100.0 (8656.3) |
| Segmentation_11 | 76.5 (-135.2) | 76.5 (-135.2) | 98.6 (-132.3) |
| Segmentation_12 | 100.0 (-21.9) | 100.0 (-21.9) | 100.0 (-21.9) |
| Segmentation_13 | 100.0 (-21.4) | 100.0 (-21.4) | 100.0 (-21.4) |
| Segmentation_14 | 100.0 (-39.3) | 100.0 (-39.3) | 100.0 (-39.3) |
| Segmentation_15 | 74.7 (-169.8) | 74.7 (-169.8) | 99.4 (-163.8) |
| Segmentation_16 | 100.0 (-40.4) | 100.0 (-40.4) | 100.0 (-40.4) |
| Segmentation_17 | 94.8 (-175.4) | 100.0 (-174.3) | 100.0 (-174.3) |
| Segmentation_18 | 100.0 (-34.0) | 100.0 (-34.0) | 100.0 (-34.0) |
| Segmentation_19 | 100.0 (-24.1) | 100.0 (-24.1) | 100.0 (-24.1) |
| Segmentation_20 | 96.6 (-112.7) | 96.6 (-112.7) | 100.0 (-112.0) |
| wcsp_11 | 51.4 (4.5) | 60.8 (6.0) | 60.7 (6.0) |
| wcsp_12 | 79.2 (12.1) | 86.8 (13.6) | 93.2 (14.9) |
| wcsp_13 | 100.0 (0.7) | 100.0 (0.7) | 100.0 (0.7) |
| wcsp_14 | 82.6 (-21.0) | 82.6 (-21.0) | 91.1 (-10.0) |
| wcsp_15 | 95.4 (-80.0) | 95.4 (-80.0) | 95.4 (-80.0) |
| wcsp_16 | 86.4 (4.8) | 86.4 (4.8) | 86.4 (4.8) |
| wcsp_17 | 89.3 (8.7) | 89.3 (8.7) | 89.3 (8.7) |
| wcsp_18 | 64.4 (-24.1) | 64.4 (-24.1) | 81.7 (-12.2) |