The results below are organized as follows:

  • each table displays the solver’s performance for individual problem instances for the given task under different time limits
  • table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria

MMAP

overall

Problem 20sec 1200sec 3600sec
Grids_18 93.7 (5532.9) 100.0 (5678.7) 100.0 (5678.7)
Grids_19 99.1 (1218.9) 99.8 (1221.6) 99.8 (1221.6)
Grids_20 0.0 (nan) 99.8 (4836.3) 99.9 (4837.5)
Grids_21 93.8 (8281.5) 99.0 (8462.9) 100.0 (8499.7)
Grids_22 92.7 (2759.6) 100.0 (2835.2) 100.0 (2835.2)
Grids_23 99.9 (2791.7) 100.0 (2793.0) 100.0 (2793.0)
Grids_24 97.3 (8157.8) 98.9 (8204.8) 100.0 (8237.3)
Grids_25 99.9 (1209.3) 99.9 (1209.3) 99.9 (1209.3)
Grids_26 100.0 (1326.3) 100.0 (1326.3) 100.0 (1326.3)
Grids_27 94.1 (5395.9) 99.4 (5496.6) 100.0 (5508.9)
Grids_28 100.0 (1982.5) 100.0 (1982.5) 100.0 (1982.5)
Grids_29 100.0 (673.0) 100.0 (673.0) 100.0 (673.0)
Grids_30 100.0 (1311.5) 100.0 (1311.5) 100.0 (1311.5)
ImageAlignment_11 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2)
ImageAlignment_12 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7)
ImageAlignment_13 99.8 (-2999.8) 99.8 (-2999.8) 99.8 (-2999.8)
ImageAlignment_14 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5)
ImageAlignment_15 100.0 (-1177.5) 100.0 (-1177.5) 100.0 (-1177.5)
ObjectDetection_11 100.0 (4412.7) 100.0 (4412.7) 100.0 (4412.7)
ObjectDetection_12 100.0 (6762.5) 100.0 (6762.5) 100.0 (6762.5)
ObjectDetection_13 100.0 (9970.6) 100.0 (9970.6) 100.0 (9970.6)
ObjectDetection_14 100.0 (9093.7) 100.0 (9093.7) 100.0 (9093.7)
ObjectDetection_15 100.0 (12633.3) 100.0 (12633.3) 100.0 (12633.3)
ObjectDetection_16 100.0 (14347.1) 100.0 (14347.1) 100.0 (14347.1)
ObjectDetection_17 100.0 (4887.4) 100.0 (4887.4) 100.0 (4887.4)
ObjectDetection_18 100.0 (9017.1) 100.0 (9017.1) 100.0 (9017.1)
Promedas_11 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4)
Promedas_12 100.0 (-7.6) 100.0 (-7.6) 100.0 (-7.6)
Promedas_13 100.0 (-21.0) 100.0 (-21.0) 100.0 (-21.0)
Promedas_14 98.0 (-14.0) 98.0 (-14.0) 98.0 (-14.0)
Promedas_15 99.9 (-21.2) 99.9 (-21.2) 99.9 (-21.2)
Promedas_16 99.3 (-15.1) 99.3 (-15.1) 99.3 (-15.1)
Promedas_17 100.0 (-16.5) 100.0 (-16.5) 100.0 (-16.5)
Promedas_18 100.0 (-21.3) 100.0 (-21.3) 100.0 (-21.3)
Promedas_19 96.3 (-23.1) 96.3 (-23.1) 96.3 (-23.1)
Promedas_20 100.0 (-10.7) 100.0 (-10.7) 100.0 (-10.7)
Promedas_21 97.5 (-14.4) 97.5 (-14.4) 97.5 (-14.4)
Promedas_22 100.0 (-14.5) 100.0 (-14.5) 100.0 (-14.5)
Promedas_23 96.9 (-18.5) 96.9 (-18.5) 96.9 (-18.5)
Promedas_24 100.0 (-9.5) 100.0 (-9.5) 100.0 (-9.5)
Promedas_25 100.0 (-11.6) 100.0 (-11.6) 100.0 (-11.6)
Promedas_26 91.6 (-16.1) 91.6 (-16.1) 91.6 (-16.1)
Promedas_27 96.7 (-10.0) 96.7 (-10.0) 96.7 (-10.0)
Promedas_28 100.0 (-4.4) 100.0 (-4.4) 100.0 (-4.4)
Promedas_29 100.0 (-13.6) 100.0 (-13.6) 100.0 (-13.6)
Promedas_30 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4)
Promedas_31 100.0 (-10.7) 100.0 (-10.7) 100.0 (-10.7)
Promedas_32 100.0 (-10.8) 100.0 (-10.8) 100.0 (-10.8)
Promedas_33 100.0 (-12.5) 100.0 (-12.5) 100.0 (-12.5)
Promedas_34 100.0 (-14.0) 100.0 (-14.0) 100.0 (-14.0)
Promedas_35 100.0 (-9.7) 100.0 (-9.7) 100.0 (-9.7)
Promedas_36 100.0 (-8.2) 100.0 (-8.2) 100.0 (-8.2)
Promedas_37 100.0 (-10.8) 100.0 (-10.8) 100.0 (-10.8)
Promedas_38 100.0 (-12.1) 100.0 (-12.1) 100.0 (-12.1)
Promedas_39 94.1 (-17.6) 94.1 (-17.6) 94.1 (-17.6)
Promedas_40 98.5 (-7.3) 98.5 (-7.3) 98.5 (-7.3)
Promedas_41 100.0 (-8.1) 100.0 (-8.1) 100.0 (-8.1)
Promedas_42 92.4 (-11.2) 92.4 (-11.2) 92.4 (-11.2)
Promedas_43 100.0 (-7.5) 100.0 (-7.5) 100.0 (-7.5)
Promedas_44 100.0 (-6.2) 100.0 (-6.2) 100.0 (-6.2)
Promedas_45 100.0 (-6.0) 100.0 (-6.0) 100.0 (-6.0)
Promedas_46 100.0 (-8.2) 100.0 (-8.2) 100.0 (-8.2)
Promedas_47 100.0 (-6.4) 100.0 (-6.4) 100.0 (-6.4)
Promedas_48 88.4 (-10.7) 88.4 (-10.7) 88.4 (-10.7)
Promedas_49 100.0 (-6.8) 100.0 (-6.8) 100.0 (-6.8)
Promedas_50 100.0 (-7.4) 100.0 (-7.4) 100.0 (-7.4)
Promedas_51 100.0 (-7.7) 100.0 (-7.7) 100.0 (-7.7)
Promedas_52 100.0 (-10.7) 100.0 (-10.7) 100.0 (-10.7)
Promedas_53 100.0 (-9.1) 100.0 (-9.1) 100.0 (-9.1)
Promedas_54 100.0 (-8.8) 100.0 (-8.8) 100.0 (-8.8)
Promedas_55 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2)
Promedas_56 100.0 (-7.8) 100.0 (-7.8) 100.0 (-7.8)
Promedas_57 100.0 (-10.3) 100.0 (-10.3) 100.0 (-10.3)
Promedas_58 100.0 (-15.3) 100.0 (-15.3) 100.0 (-15.3)
Promedas_59 100.0 (-10.5) 100.0 (-10.5) 100.0 (-10.5)
Promedas_60 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0)
Promedas_61 100.0 (-5.4) 100.0 (-5.4) 100.0 (-5.4)
Promedas_62 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7)
Promedas_63 100.0 (-4.6) 100.0 (-4.6) 100.0 (-4.6)
Promedas_64 100.0 (-9.9) 100.0 (-9.9) 100.0 (-9.9)
Promedas_65 100.0 (-5.1) 100.0 (-5.1) 100.0 (-5.1)
Promedas_66 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4)
Promedas_67 95.9 (-11.8) 95.9 (-11.8) 95.9 (-11.8)
Promedas_68 100.0 (-18.8) 100.0 (-18.8) 100.0 (-18.8)
Promedas_69 100.0 (-9.7) 100.0 (-9.7) 100.0 (-9.7)
Promedas_70 100.0 (-4.1) 100.0 (-4.1) 100.0 (-4.1)
Promedas_71 100.0 (-6.0) 100.0 (-6.0) 100.0 (-6.0)
ProteinFolding_11 100.0 (1962.3) 100.0 (1962.3) 100.0 (1962.3)
ProteinFolding_12 100.0 (-1547.0) 100.0 (-1547.0) 100.0 (-1547.0)
ProteinFolding_13 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3)
ProteinFolding_14 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7)
ProteinFolding_15 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6)
ProteinFolding_16 100.0 (-855.5) 100.0 (-855.5) 100.0 (-855.5)
ProteinFolding_17 100.0 (16544.2) 100.0 (16544.2) 100.0 (16544.2)
ProteinFolding_18 100.0 (18606.3) 100.0 (18606.3) 100.0 (18606.3)
ProteinFolding_19 100.0 (2678.5) 100.0 (2678.5) 100.0 (2678.5)
ProteinFolding_20 100.0 (5578.7) 100.0 (5578.7) 100.0 (5578.7)
ProteinFolding_21 100.0 (7958.7) 100.0 (7958.7) 100.0 (7958.7)
ProteinFolding_22 100.0 (10547.2) 100.0 (10547.2) 100.0 (10547.2)
ProteinFolding_23 100.0 (4279.1) 100.0 (4279.1) 100.0 (4279.1)
ProteinFolding_24 100.0 (5900.4) 100.0 (5900.4) 100.0 (5900.4)
ProteinFolding_25 100.0 (8656.3) 100.0 (8656.3) 100.0 (8656.3)
Segmentation_11 98.6 (-132.3) 98.6 (-132.3) 98.6 (-132.3)
Segmentation_12 100.0 (-21.9) 100.0 (-21.9) 100.0 (-21.9)
Segmentation_13 100.0 (-21.4) 100.0 (-21.4) 100.0 (-21.4)
Segmentation_14 100.0 (-39.3) 100.0 (-39.3) 100.0 (-39.3)
Segmentation_15 99.4 (-163.8) 99.4 (-163.8) 99.4 (-163.8)
Segmentation_16 100.0 (-40.4) 100.0 (-40.4) 100.0 (-40.4)
Segmentation_17 100.0 (-174.3) 100.0 (-174.3) 100.0 (-174.3)
Segmentation_18 100.0 (-34.0) 100.0 (-34.0) 100.0 (-34.0)
Segmentation_19 100.0 (-24.1) 100.0 (-24.1) 100.0 (-24.1)
Segmentation_20 100.0 (-112.0) 100.0 (-112.0) 100.0 (-112.0)
wcsp_11 64.4 (6.5) 65.9 (6.8) 65.9 (6.8)
wcsp_12 90.4 (14.3) 93.2 (14.9) 93.2 (14.9)
wcsp_13 95.2 (-5.7) 92.2 (-9.7) 92.2 (-9.7)
wcsp_14 91.1 (-10.0) 88.1 (-13.9) 88.1 (-13.9)
wcsp_15 99.3 (-75.4) 99.3 (-75.4) 99.3 (-75.4)
wcsp_16 99.6 (22.8) 99.6 (22.9) 99.6 (22.9)
wcsp_17 76.7 (-22.1) 100.0 (34.9) 100.0 (34.9)
wcsp_18 71.8 (-19.0) 63.5 (-24.7) 63.5 (-24.7)

Updated: