The results below are organized as follows:

  • each table displays the solver’s performance for individual problem instances for the given task under different time limits
  • table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria

MMAP

overall

Problem 20sec 1200sec 3600sec
Grids_18 0.0 (nan) 96.1 (5588.0) 96.1 (5588.0)
Grids_19 0.0 (nan) 97.5 (1212.8) 97.5 (1212.8)
Grids_20 0.0 (nan) 97.6 (4804.9) 97.6 (4804.9)
Grids_21 0.0 (nan) 95.0 (8322.9) 95.0 (8322.9)
Grids_22 0.0 (nan) 93.0 (2763.4) 93.0 (2763.4)
Grids_23 0.0 (nan) 94.3 (2739.2) 94.3 (2739.2)
Grids_24 0.0 (nan) 95.5 (8106.5) 95.5 (8106.5)
Grids_25 0.0 (nan) 98.6 (1204.6) 98.6 (1204.6)
Grids_26 0.0 (nan) 94.9 (1300.4) 94.9 (1300.4)
Grids_27 0.0 (nan) 93.5 (5383.1) 93.5 (5383.1)
Grids_28 0.0 (nan) 92.6 (1924.7) 92.6 (1924.7)
Grids_29 0.0 (nan) 95.7 (662.6) 95.7 (662.6)
Grids_30 0.0 (nan) 99.5 (1309.1) 99.5 (1309.1)
ImageAlignment_11 0.0 (nan) 0.0 (nan) 0.0 (nan)
ImageAlignment_12 0.0 (nan) 100.0 (-436.7) 100.0 (-436.7)
ImageAlignment_13 0.0 (nan) 0.0 (nan) 0.0 (nan)
ImageAlignment_14 0.0 (nan) 0.0 (nan) 100.0 (-1557.5)
ImageAlignment_15 0.0 (nan) 0.0 (nan) 0.0 (nan)
ObjectDetection_11 0.0 (nan) 28.0 (3537.2) 28.0 (3537.2)
ObjectDetection_12 0.0 (nan) 90.2 (6694.7) 90.2 (6694.7)
ObjectDetection_13 0.0 (nan) 0.0 (8826.5) 0.0 (8826.5)
ObjectDetection_14 0.0 (nan) 41.5 (8341.9) 41.5 (8341.9)
ObjectDetection_15 0.0 (nan) 52.8 (11543.7) 52.8 (11543.7)
ObjectDetection_16 0.0 (nan) 70.7 (13547.6) 70.7 (13547.6)
ObjectDetection_17 0.0 (nan) 59.8 (3794.9) 59.8 (3794.9)
ObjectDetection_18 0.0 (nan) 100.0 (9017.1) 100.0 (9017.1)
Promedas_11 0.0 (nan) 53.1 (-39.9) 53.1 (-39.9)
Promedas_12 0.0 (nan) 53.5 (-32.4) 53.5 (-32.4)
Promedas_13 0.0 (nan) 42.7 (-61.2) 42.7 (-61.2)
Promedas_14 0.0 (nan) 0.0 (-inf) 0.0 (-inf)
Promedas_15 0.0 (nan) 43.6 (-52.0) 43.6 (-52.0)
Promedas_16 0.0 (nan) 44.3 (-41.7) 44.3 (-41.7)
Promedas_17 0.0 (nan) 65.1 (-32.5) 65.1 (-32.5)
Promedas_18 0.0 (nan) 53.4 (-44.7) 53.4 (-44.7)
Promedas_19 0.0 (nan) 50.3 (-58.8) 50.3 (-58.8)
Promedas_20 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
Promedas_21 0.0 (nan) 0.0 (-inf) 0.0 (-inf)
Promedas_22 0.0 (nan) 51.7 (-39.9) 51.7 (-39.9)
Promedas_23 0.0 (nan) 53.4 (-43.4) 53.4 (-43.4)
Promedas_24 0.0 (nan) 68.1 (-19.0) 68.1 (-19.0)
Promedas_25 0.0 (nan) 50.0 (-29.1) 50.0 (-29.1)
Promedas_26 0.0 (nan) 44.7 (-39.4) 44.7 (-39.4)
Promedas_27 0.0 (nan) 41.8 (-26.2) 41.8 (-26.2)
Promedas_28 0.0 (nan) 76.1 (-12.2) 76.1 (-12.2)
Promedas_29 0.0 (nan) 64.8 (-28.5) 64.8 (-28.5)
Promedas_30 0.0 (nan) 48.5 (-32.0) 48.5 (-32.0)
Promedas_31 0.0 (nan) 52.7 (-29.1) 52.7 (-29.1)
Promedas_32 0.0 (nan) 29.1 (-38.2) 29.1 (-38.2)
Promedas_33 0.0 (nan) 66.3 (-26.7) 66.3 (-26.7)
Promedas_34 0.0 (nan) 57.4 (-30.4) 57.4 (-30.4)
Promedas_35 0.0 (nan) 27.3 (-24.7) 27.3 (-24.7)
Promedas_36 0.0 (nan) 21.5 (-24.8) 21.5 (-24.8)
Promedas_37 0.0 (nan) 0.0 (-inf) 0.0 (-inf)
Promedas_38 0.0 (nan) 68.3 (-21.0) 68.3 (-21.0)
Promedas_39 0.0 (nan) 53.0 (-33.3) 53.0 (-33.3)
Promedas_40 0.0 (nan) 43.0 (-18.3) 43.0 (-18.3)
Promedas_41 0.0 (nan) 45.4 (-23.6) 45.4 (-23.6)
Promedas_42 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
Promedas_43 0.0 (nan) 44.3 (-17.6) 44.3 (-17.6)
Promedas_44 0.0 (nan) 69.9 (-16.3) 69.9 (-16.3)
Promedas_45 0.0 (nan) 43.5 (-17.9) 43.5 (-17.9)
Promedas_46 0.0 (nan) 54.8 (-24.1) 54.8 (-24.1)
Promedas_47 0.0 (nan) 63.6 (-21.3) 63.6 (-21.3)
Promedas_48 0.0 (nan) 36.4 (-23.3) 36.4 (-23.3)
Promedas_49 0.0 (nan) 64.4 (-15.9) 64.4 (-15.9)
Promedas_50 0.0 (nan) 31.7 (-20.3) 31.7 (-20.3)
Promedas_51 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
Promedas_52 0.0 (nan) 61.5 (-18.7) 61.5 (-18.7)
Promedas_53 0.0 (nan) 82.5 (-13.2) 82.5 (-13.2)
Promedas_54 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
Promedas_55 0.0 (nan) 47.5 (-21.8) 47.5 (-21.8)
Promedas_56 0.0 (nan) 54.7 (-19.6) 54.7 (-19.6)
Promedas_57 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
Promedas_58 0.0 (nan) 68.4 (-31.3) 68.4 (-31.3)
Promedas_59 0.0 (nan) 67.4 (-17.0) 67.4 (-17.0)
Promedas_60 0.0 (nan) 66.6 (-16.8) 66.6 (-16.8)
Promedas_61 0.0 (nan) 17.0 (-18.9) 17.0 (-18.9)
Promedas_62 0.0 (nan) 19.2 (-22.1) 19.2 (-22.1)
Promedas_63 0.0 (nan) 17.4 (-17.5) 17.4 (-17.5)
Promedas_64 0.0 (nan) 13.2 (-24.3) 13.2 (-24.3)
Promedas_65 0.0 (nan) 73.0 (-10.1) 73.0 (-10.1)
Promedas_66 0.0 (nan) 0.4 (-26.7) 0.4 (-26.7)
Promedas_67 0.0 (nan) 64.1 (-20.8) 64.1 (-20.8)
Promedas_68 0.0 (nan) 71.2 (-29.5) 71.2 (-29.5)
Promedas_69 25.3 (-20.3) 25.3 (-20.3) 25.3 (-20.3)
Promedas_70 46.8 (-8.3) 46.8 (-8.3) 46.8 (-8.3)
Promedas_71 0.0 (-inf) 0.0 (-inf) 0.0 (-inf)
ProteinFolding_11 0.0 (nan) 83.2 (1839.4) 83.2 (1839.4)
ProteinFolding_12 0.0 (nan) 0.0 (nan) 97.3 (-1555.5)
ProteinFolding_13 0.0 (nan) 0.0 (nan) 100.0 (-143.3)
ProteinFolding_14 0.0 (nan) 100.0 (-331.7) 100.0 (-331.7)
ProteinFolding_15 0.0 (nan) 100.0 (-51.6) 100.0 (-51.6)
ProteinFolding_16 0.0 (nan) 0.0 (nan) 100.0 (-855.5)
ProteinFolding_17 0.0 (nan) 3.6 (9043.9) 3.6 (9043.9)
ProteinFolding_18 0.0 (nan) 0.0 (8158.4) 0.0 (8158.4)
ProteinFolding_19 0.0 (nan) 1.2 (1865.6) 1.2 (1865.6)
ProteinFolding_20 0.0 (nan) 38.3 (4680.3) 38.3 (4680.3)
ProteinFolding_21 0.0 (nan) 0.0 (7402.6) 0.0 (7402.6)
ProteinFolding_22 0.0 (nan) 97.1 (10531.3) 97.1 (10531.3)
ProteinFolding_23 0.0 (nan) 94.7 (4230.2) 94.7 (4230.2)
ProteinFolding_24 0.0 (nan) 100.0 (5900.4) 100.0 (5900.4)
ProteinFolding_25 0.0 (nan) 100.0 (8656.3) 100.0 (8656.3)
Segmentation_11 0.0 (nan) 90.9 (-133.3) 90.9 (-133.3)
Segmentation_12 0.0 (nan) 58.8 (-30.1) 58.8 (-30.1)
Segmentation_13 0.0 (nan) 100.0 (-21.4) 100.0 (-21.4)
Segmentation_14 0.0 (nan) 87.8 (-40.2) 87.8 (-40.2)
Segmentation_15 0.0 (nan) 80.0 (-168.5) 80.0 (-168.5)
Segmentation_16 0.0 (nan) 100.0 (-40.4) 100.0 (-40.4)
Segmentation_17 0.0 (nan) 95.4 (-175.3) 95.4 (-175.3)
Segmentation_18 0.0 (nan) 89.6 (-35.9) 89.6 (-35.9)
Segmentation_19 0.0 (nan) 92.1 (-25.4) 92.1 (-25.4)
Segmentation_20 0.0 (nan) 98.3 (-112.4) 98.3 (-112.4)
wcsp_11 0.0 (nan) 0.0 (-1206.6) 0.0 (-1206.6)
wcsp_12 0.0 (nan) 0.0 (-227.1) 0.0 (-227.1)
wcsp_13 0.0 (nan) 97.6 (-2.5) 97.6 (-2.5)
wcsp_14 0.0 (nan) 0.0 (nan) 0.0 (-402.4)
wcsp_15 0.0 (nan) 0.0 (-1503.1) 0.0 (-1503.1)
wcsp_16 0.0 (nan) 0.0 (nan) 0.0 (-251.5)
wcsp_17 0.0 (nan) 0.0 (nan) 0.0 (nan)
wcsp_18 0.0 (nan) 0.0 (nan) 76.3 (-16.0)

Updated: