merlin-mmap Scores
The results below are organized as follows:
- each table displays the solver’s performance for individual problem instances for the given task under different time limits
- table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria
MMAP
overall
| Problem | 20sec | 1200sec | 3600sec |
|---|---|---|---|
| Grids_18 | 88.0 (5401.6) | 88.5 (5413.0) | 87.8 (5398.2) |
| Grids_19 | 0.0 (nan) | 84.6 (1163.1) | 83.1 (1157.3) |
| Grids_20 | 0.0 (nan) | 79.9 (4552.1) | 77.6 (4519.0) |
| Grids_21 | 0.0 (nan) | 86.7 (8031.6) | 84.5 (7952.7) |
| Grids_22 | 86.1 (2692.0) | 85.4 (2684.0) | 84.8 (2677.8) |
| Grids_23 | 84.7 (2649.1) | 84.2 (2644.3) | 83.7 (2639.9) |
| Grids_24 | 83.8 (7761.6) | 84.4 (7779.8) | 84.1 (7769.2) |
| Grids_25 | 80.3 (1138.0) | 79.8 (1136.0) | 88.3 (1167.2) |
| Grids_26 | 90.8 (1279.2) | 89.9 (1275.0) | 89.9 (1275.0) |
| Grids_27 | 80.4 (5131.1) | 82.8 (5177.7) | 81.5 (5152.3) |
| Grids_28 | 90.2 (1906.2) | 89.5 (1900.8) | 89.4 (1899.7) |
| Grids_29 | 91.0 (651.2) | 91.0 (651.2) | 91.0 (651.2) |
| Grids_30 | 95.2 (1288.6) | 95.2 (1288.6) | 95.5 (1290.0) |
| ImageAlignment_11 | 0.0 (-8256.1) | 0.0 (-5852.0) | 0.0 (nan) |
| ImageAlignment_12 | 100.0 (-436.7) | 0.0 (nan) | 0.0 (nan) |
| ImageAlignment_13 | 0.0 (-14566.4) | 0.0 (-9121.9) | 0.0 (-9180.4) |
| ImageAlignment_14 | 0.0 (-2454.4) | 0.0 (nan) | 0.0 (nan) |
| ImageAlignment_15 | 0.0 (-1675.5) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_11 | 0.0 (1118.4) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_12 | 0.0 (2543.7) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_13 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_14 | 0.0 (4931.7) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_15 | 0.0 (6985.6) | 0.0 (7045.5) | 0.0 (nan) |
| ObjectDetection_16 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_17 | 0.0 (-822.5) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_18 | 0.0 (758.0) | 0.0 (758.0) | 0.0 (nan) |
| Promedas_11 | 0.0 (nan) | 78.1 (-25.8) | 0.0 (-inf) |
| Promedas_12 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| Promedas_13 | 0.0 (nan) | 77.3 (-36.9) | 77.3 (-36.9) |
| Promedas_14 | 0.0 (nan) | 73.4 (-26.2) | 82.1 (-21.9) |
| Promedas_15 | 0.0 (nan) | 0.0 (-inf) | 0.0 (-inf) |
| Promedas_16 | 67.2 (-30.6) | 0.0 (-inf) | 70.0 (-29.3) |
| Promedas_17 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| Promedas_18 | 80.7 (-31.0) | 0.0 (-inf) | 88.1 (-27.3) |
| Promedas_19 | 0.0 (nan) | 71.9 (-42.0) | 83.9 (-32.8) |
| Promedas_20 | 0.0 (nan) | 0.0 (-inf) | 86.9 (-16.3) |
| Promedas_21 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| Promedas_22 | 0.0 (-inf) | 66.7 (-32.0) | 66.7 (-32.0) |
| Promedas_23 | 0.0 (nan) | 91.2 (-21.7) | 91.2 (-21.7) |
| Promedas_24 | 91.9 (-11.9) | 100.0 (-9.5) | 100.0 (-9.5) |
| Promedas_25 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| Promedas_26 | 68.5 (-27.6) | 82.4 (-20.7) | 76.1 (-23.8) |
| Promedas_27 | 81.7 (-14.4) | 0.0 (-inf) | 96.1 (-10.2) |
| Promedas_28 | 67.9 (-14.8) | 0.0 (-inf) | 100.0 (-4.4) |
| Promedas_29 | 0.0 (-inf) | 78.1 (-22.9) | 73.7 (-24.7) |
| Promedas_30 | 64.0 (-25.5) | 0.0 (-inf) | 0.0 (-inf) |
| Promedas_31 | 87.3 (-15.6) | 88.5 (-15.2) | 0.0 (-inf) |
| Promedas_32 | 75.0 (-20.5) | 0.0 (-inf) | 80.1 (-18.5) |
| Promedas_33 | 88.5 (-17.3) | 0.0 (-inf) | 0.0 (-inf) |
| Promedas_34 | 68.7 (-26.1) | 90.0 (-17.8) | 90.0 (-17.8) |
| Promedas_35 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| Promedas_36 | 58.2 (-17.0) | 100.0 (-8.2) | 0.0 (-inf) |
| Promedas_37 | 91.1 (-14.1) | 0.0 (-inf) | 86.1 (-15.9) |
| Promedas_38 | 66.7 (-21.4) | 100.0 (-12.1) | 0.0 (-inf) |
| Promedas_39 | 0.0 (-inf) | 0.0 (-inf) | 91.8 (-18.5) |
| Promedas_40 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| Promedas_41 | 0.0 (-inf) | 100.0 (-8.1) | 100.0 (-8.1) |
| Promedas_42 | 0.0 (-inf) | 92.4 (-11.2) | 92.4 (-11.2) |
| Promedas_43 | 0.0 (-inf) | 100.0 (-7.5) | 100.0 (-7.5) |
| Promedas_44 | 95.1 (-7.8) | 0.0 (-inf) | 100.0 (-6.2) |
| Promedas_45 | 85.2 (-9.1) | 100.0 (-6.0) | 0.0 (-inf) |
| Promedas_46 | 0.0 (-inf) | 100.0 (-8.2) | 0.0 (-inf) |
| Promedas_47 | 0.0 (-inf) | 96.3 (-7.9) | 96.3 (-7.9) |
| Promedas_48 | 89.6 (-10.4) | 0.0 (-inf) | 0.0 (-inf) |
| Promedas_49 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| Promedas_50 | 0.0 (-inf) | 0.0 (-inf) | 100.0 (-7.4) |
| Promedas_51 | 0.0 (-inf) | 100.0 (-7.7) | 100.0 (-7.7) |
| Promedas_52 | 0.0 (-inf) | 100.0 (-10.7) | 100.0 (-10.7) |
| Promedas_53 | 79.9 (-13.9) | 0.0 (-inf) | 0.0 (-inf) |
| Promedas_54 | 69.8 (-14.8) | 100.0 (-8.8) | 0.0 (-inf) |
| Promedas_55 | 75.8 (-16.1) | 100.0 (-11.2) | 100.0 (-11.2) |
| Promedas_56 | 0.0 (-inf) | 100.0 (-7.8) | 0.0 (-inf) |
| Promedas_57 | 91.3 (-13.5) | 0.0 (-inf) | 100.0 (-10.3) |
| Promedas_58 | 0.0 (-inf) | 0.0 (-inf) | 100.0 (-15.3) |
| Promedas_59 | 81.4 (-14.2) | 0.0 (-inf) | 100.0 (-10.5) |
| Promedas_60 | 88.7 (-12.3) | 100.0 (-10.0) | 100.0 (-10.0) |
| Promedas_61 | 60.8 (-11.7) | 100.0 (-5.4) | 100.0 (-5.4) |
| Promedas_62 | 0.0 (-inf) | 100.0 (-4.7) | 100.0 (-4.7) |
| Promedas_63 | 0.0 (-inf) | 100.0 (-4.6) | 0.0 (-inf) |
| Promedas_64 | 0.0 (-inf) | 0.0 (-inf) | 100.0 (-9.9) |
| Promedas_65 | 0.0 (-inf) | 100.0 (-5.1) | 100.0 (-5.1) |
| Promedas_66 | 0.0 (-inf) | 100.0 (-10.4) | 100.0 (-10.4) |
| Promedas_67 | 72.0 (-18.6) | 0.0 (-inf) | 0.0 (-inf) |
| Promedas_68 | 100.0 (-18.8) | 100.0 (-18.8) | 100.0 (-18.8) |
| Promedas_69 | 77.5 (-12.9) | 100.0 (-9.7) | 100.0 (-9.7) |
| Promedas_70 | 0.0 (-inf) | 100.0 (-4.1) | 100.0 (-4.1) |
| Promedas_71 | 100.0 (-6.0) | 100.0 (-6.0) | 0.0 (-inf) |
| ProteinFolding_11 | 67.9 (1727.6) | 68.0 (1728.4) | 68.0 (1728.4) |
| ProteinFolding_12 | 0.0 (-2426.5) | 0.0 (nan) | 0.0 (nan) |
| ProteinFolding_13 | 100.0 (-143.3) | 100.0 (-143.3) | 100.0 (-143.3) |
| ProteinFolding_14 | 100.0 (-331.7) | 100.0 (-331.7) | 0.0 (nan) |
| ProteinFolding_15 | 100.0 (-600.5) | 100.0 (-600.5) | 100.0 (-51.6) |
| ProteinFolding_16 | 0.0 (-1134.3) | 0.0 (-1467.9) | 0.0 (-1467.9) |
| ProteinFolding_17 | 0.0 (-1083.3) | 0.0 (2004.0) | 0.0 (nan) |
| ProteinFolding_18 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ProteinFolding_19 | 0.0 (-288.4) | 0.0 (nan) | 0.0 (nan) |
| ProteinFolding_20 | 0.0 (2743.3) | 0.0 (2743.3) | 0.0 (nan) |
| ProteinFolding_21 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ProteinFolding_22 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ProteinFolding_23 | 0.0 (1008.9) | 0.0 (972.3) | 0.0 (nan) |
| ProteinFolding_24 | 0.0 (682.4) | 0.0 (2494.5) | 0.0 (nan) |
| ProteinFolding_25 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Segmentation_11 | 0.0 (-207.6) | 0.0 (-207.6) | 100.0 (-132.1) |
| Segmentation_12 | 100.0 (-21.9) | 100.0 (-21.9) | 100.0 (-21.9) |
| Segmentation_13 | 100.0 (-21.4) | 100.0 (-21.4) | 100.0 (-21.4) |
| Segmentation_14 | 100.0 (-39.3) | 100.0 (-39.3) | 100.0 (-39.3) |
| Segmentation_15 | 0.0 (-318.1) | 0.0 (-318.1) | 100.0 (-163.7) |
| Segmentation_16 | 100.0 (-40.4) | 100.0 (-40.4) | 100.0 (-40.4) |
| Segmentation_17 | 0.0 (-386.4) | 0.0 (-386.4) | 98.7 (-174.6) |
| Segmentation_18 | 100.0 (-34.0) | 100.0 (-34.0) | 100.0 (-34.0) |
| Segmentation_19 | 100.0 (-24.1) | 100.0 (-24.1) | 100.0 (-24.1) |
| Segmentation_20 | 0.0 (-151.4) | 0.0 (-151.4) | 100.0 (-112.0) |
| wcsp_11 | 100.0 (12.0) | 82.6 (9.4) | 82.6 (9.4) |
| wcsp_12 | 0.0 (-764.0) | 0.0 (-764.0) | 0.0 (-728.0) |
| wcsp_13 | 0.0 (-2296.2) | 0.0 (-2300.3) | 59.4 (-53.1) |
| wcsp_14 | 0.0 (nan) | 0.0 (-857.9) | 82.2 (-21.5) |
| wcsp_15 | 0.0 (-467.6) | 46.4 (-137.6) | 46.4 (-137.6) |
| wcsp_16 | 0.0 (-398.5) | 0.0 (-402.6) | 0.0 (-372.1) |
| wcsp_17 | 0.0 (-704.2) | 0.0 (-766.5) | 48.0 (-92.6) |
| wcsp_18 | 0.0 (-698.7) | 0.0 (-451.9) | 0.0 (-631.8) |