The results below are organized as follows:

  • each table below displays various solvers’ performance for individual problem instances for the given task and time limit
  • table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria

overall

20sec

Problem daoopt daoopt-lh-mpe daoopt-test toulbar2-ipr-mpe toulbar2-vacint-mpe toulbar2-vns-mpe uai14-mpe
Grids_18 100.0 (5674.0) 91.7 (5482.9) 93.7 (5528.7) 81.4 (5246.8) 95.2 (5563.7) 97.4 (5614.1) 60.8 (4770.6)
Grids_19 100.0 (1179.1) 91.7 (1150.8) 96.6 (1167.6) 93.4 (1156.6) 96.7 (1167.9) 99.5 (1177.6) 57.4 (1033.4)
Grids_20 92.9 (4588.4) 91.7 (4573.3) 90.9 (4563.2) 0.0 (nan) 74.5 (4355.8) 91.6 (4571.7) 52.5 (4077.8)
Grids_21 100.0 (8495.2) 92.3 (8225.5) 94.6 (8305.2) 82.6 (7883.7) 92.7 (8237.7) 97.6 (8410.5) 64.0 (7226.5)
Grids_22 99.3 (2817.8) 92.1 (2744.5) 93.9 (2763.2) 79.8 (2618.7) 93.3 (2757.0) 96.6 (2790.4) 55.9 (2375.1)
Grids_23 100.0 (2781.6) 93.9 (2725.1) 94.5 (2730.3) 84.9 (2642.0) 94.8 (2733.8) 98.7 (2769.4) 58.3 (2394.7)
Grids_24 99.8 (8227.6) 95.2 (8093.3) 93.2 (8033.3) 81.7 (7697.5) 94.3 (8066.4) 96.9 (8143.6) 56.3 (6950.6)
Grids_25 100.0 (1167.8) 94.9 (1151.4) 97.2 (1158.8) 100.0 (1167.8) 87.4 (1127.2) 99.5 (1166.1) 69.1 (1068.5)
Grids_26 100.0 (1325.0) 99.7 (1323.5) 94.2 (1295.6) 100.0 (1325.0) 97.1 (1310.1) 97.0 (1309.6) 60.6 (1125.1)
Grids_27 100.0 (5504.4) 94.3 (5395.3) 93.4 (5376.9) 79.7 (5113.8) 91.8 (5346.3) 98.0 (5466.6) 55.4 (4647.1)
Grids_28 100.0 (1981.8) 97.5 (1962.4) 94.8 (1941.6) 100.0 (1981.8) 91.8 (1917.7) 98.2 (1967.6) 67.0 (1724.8)
Grids_29 100.0 (670.0) 99.3 (668.3) 96.5 (661.6) 100.0 (670.0) 91.4 (649.3) 96.6 (661.9) 65.2 (586.6)
Grids_30 100.0 (1309.7) 100.0 (1309.7) 99.1 (1305.6) 100.0 (1309.7) 97.4 (1297.0) 96.9 (1294.7) 64.3 (1138.7)
ImageAlignment_11 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2)
ImageAlignment_12 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7)
ImageAlignment_13 100.0 (-2999.9) 100.0 (-2999.9) 100.0 (-2999.9) 100.0 (-2999.9) 100.0 (-2999.9) 100.0 (-2999.9) 100.0 (-2999.9)
ImageAlignment_14 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5)
ImageAlignment_15 100.0 (-1177.5) 97.2 (-1188.2) 100.0 (-1177.5) 100.0 (-1177.5) 100.0 (-1177.5) 100.0 (-1177.5) 100.0 (-1177.5)
ObjectDetection_11 85.6 (4237.9) 81.0 (4181.6) 0.0 (3001.3) 100.0 (4412.7) 100.0 (4412.7) 99.8 (4409.8) 0.0 (2153.8)
ObjectDetection_12 88.8 (6685.0) 94.6 (6725.5) 0.0 (5412.8) 100.0 (6762.5) 100.0 (6762.5) 100.0 (6762.5) 0.0 (1300.0)
ObjectDetection_13 82.9 (9854.2) 99.6 (9967.7) 22.3 (9440.7) 100.0 (9970.6) 100.0 (9970.6) 100.0 (9970.6) 0.0 (5128.2)
ObjectDetection_14 94.3 (9020.8) 94.3 (9020.8) 0.0 (6048.2) 100.0 (9093.7) 100.0 (9093.7) 100.0 (9093.7) 0.0 (5273.4)
ObjectDetection_15 93.3 (12478.6) 59.7 (11703.8) 15.8 (10691.6) 100.0 (12633.3) 100.0 (12633.3) 100.0 (12633.3) 0.0 (8379.0)
ObjectDetection_16 62.6 (13326.1) 92.9 (14153.8) 72.1 (13584.4) 100.0 (14347.1) 100.0 (14347.1) 100.0 (14347.1) 0.0 (8554.9)
ObjectDetection_17 97.4 (4816.0) 93.7 (4716.4) 54.4 (3648.0) 100.0 (4887.4) 100.0 (4887.4) 100.0 (4887.4) 2.0 (2223.0)
ObjectDetection_18 92.0 (8849.5) 92.0 (8849.5) 74.8 (8491.2) 100.0 (9017.1) 100.0 (9017.1) 92.0 (8849.5) 0.0 (4200.9)
Promedas_11 86.3 (-27.7) 0.0 (nan) 64.5 (-38.4) 100.0 (-21.0) 100.0 (-21.0) 93.1 (-24.4) 49.2 (-45.9)
Promedas_12 98.6 (-15.9) 98.4 (-16.0) 0.0 (nan) 100.0 (-15.3) 100.0 (-15.3) 100.0 (-15.3) 36.1 (-44.4)
Promedas_13 91.0 (-32.9) 97.9 (-28.4) 0.0 (nan) 100.0 (-27.1) 100.0 (-27.1) 94.4 (-30.7) 36.3 (-67.9)
Promedas_14 90.2 (-22.9) 98.8 (-19.1) 0.0 (nan) 100.0 (-18.6) 100.0 (-18.6) 92.0 (-22.1) 57.7 (-37.2)
Promedas_15 95.6 (-26.8) 95.4 (-26.9) 0.0 (nan) 100.0 (-24.5) 100.0 (-24.5) 100.0 (-24.5) 63.6 (-43.3)
Promedas_16 97.3 (-20.9) 97.1 (-21.0) 0.0 (nan) 100.0 (-19.7) 100.0 (-19.7) 100.0 (-19.7) 0.0 (nan)
Promedas_17 99.5 (-20.0) 100.0 (-19.8) 64.9 (-34.7) 100.0 (-19.8) 100.0 (-19.8) 100.0 (-19.8) 51.0 (-40.6)
Promedas_18 98.5 (-25.1) 99.0 (-24.9) 58.6 (-43.9) 100.0 (-24.4) 100.0 (-24.4) 100.0 (-24.4) 0.0 (nan)
Promedas_19 100.0 (-26.1) 97.6 (-27.9) 67.2 (-49.7) 100.0 (-26.1) 100.0 (-26.1) 100.0 (-26.1) 32.3 (-74.7)
Promedas_20 87.6 (-17.4) 97.3 (-13.3) 62.0 (-28.1) 100.0 (-12.2) 100.0 (-12.2) 100.0 (-12.2) 45.9 (-34.8)
Promedas_21 100.0 (-17.4) 99.9 (-17.5) 47.0 (-45.7) 100.0 (-17.4) 100.0 (-17.4) 100.0 (-17.4) 14.7 (-62.9)
Promedas_22 99.0 (-16.6) 99.8 (-16.2) 0.0 (nan) 100.0 (-16.1) 100.0 (-16.1) 100.0 (-16.1) 52.3 (-40.4)
Promedas_23 100.0 (-23.5) 96.6 (-25.2) 0.0 (nan) 100.0 (-23.5) 100.0 (-23.5) 100.0 (-23.5) 31.3 (-58.2)
Promedas_24 100.0 (-12.5) 100.0 (-12.5) 75.5 (-19.1) 100.0 (-12.5) 100.0 (-12.5) 100.0 (-12.5) 39.0 (-28.8)
Promedas_25 100.0 (-14.7) 100.0 (-14.7) 75.1 (-22.6) 100.0 (-14.7) 100.0 (-14.7) 100.0 (-14.7) 39.6 (-33.9)
Promedas_26 99.1 (-19.6) 99.1 (-19.6) 0.0 (nan) 100.0 (-19.2) 100.0 (-19.2) 100.0 (-19.2) 0.0 (nan)
Promedas_27 99.5 (-10.2) 98.0 (-10.6) 0.0 (nan) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 22.4 (-32.1)
Promedas_28 100.0 (-6.0) 100.0 (-6.0) 73.5 (-14.2) 100.0 (-6.0) 100.0 (-6.0) 100.0 (-6.0) 0.0 (nan)
Promedas_29 98.5 (-20.3) 99.1 (-20.1) 0.0 (nan) 100.0 (-19.8) 100.0 (-19.8) 100.0 (-19.8) 44.1 (-39.9)
Promedas_30 100.0 (-10.4) 100.0 (-10.4) 0.0 (nan) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 39.9 (-35.7)
Promedas_31 100.0 (-12.2) 99.1 (-12.5) 60.8 (-26.9) 100.0 (-12.2) 100.0 (-12.2) 100.0 (-12.2) 38.4 (-35.3)
Promedas_32 100.0 (-13.9) 100.0 (-13.9) 0.0 (nan) 100.0 (-13.9) 100.0 (-13.9) 100.0 (-13.9) 0.0 (nan)
Promedas_33 100.0 (-14.0) 100.0 (-14.0) 0.0 (nan) 100.0 (-14.0) 100.0 (-14.0) 100.0 (-14.0) 28.6 (-43.0)
Promedas_34 100.0 (-17.0) 100.0 (-17.0) 0.0 (nan) 100.0 (-17.0) 100.0 (-17.0) 100.0 (-17.0) 48.2 (-35.5)
Promedas_35 100.0 (-11.3) 100.0 (-11.3) 70.2 (-17.0) 100.0 (-11.3) 100.0 (-11.3) 100.0 (-11.3) 61.8 (-18.6)
Promedas_36 100.0 (-8.2) 100.0 (-8.2) 81.0 (-12.2) 100.0 (-8.2) 100.0 (-8.2) 100.0 (-8.2) 18.7 (-25.4)
Promedas_37 100.0 (-15.4) 100.0 (-15.4) 65.4 (-26.6) 100.0 (-15.4) 100.0 (-15.4) 100.0 (-15.4) 25.3 (-39.5)
Promedas_38 100.0 (-12.1) 100.0 (-12.1) 86.2 (-15.9) 100.0 (-12.1) 100.0 (-12.1) 100.0 (-12.1) 45.9 (-27.3)
Promedas_39 99.1 (-21.0) 97.7 (-21.5) 91.7 (-23.4) 100.0 (-20.7) 100.0 (-20.7) 100.0 (-20.7) 60.7 (-33.6)
Promedas_40 100.0 (-7.3) 93.8 (-8.5) 0.0 (nan) 100.0 (-7.3) 100.0 (-7.3) 100.0 (-7.3) 35.8 (-19.9)
Promedas_41 100.0 (-9.7) 99.3 (-9.9) 0.0 (nan) 100.0 (-9.7) 100.0 (-9.7) 100.0 (-9.7) 24.3 (-29.9)
Promedas_42 100.0 (-12.8) 99.3 (-13.0) 0.0 (nan) 100.0 (-12.8) 100.0 (-12.8) 100.0 (-12.8) 23.2 (-38.0)
Promedas_43 100.0 (-7.5) 100.0 (-7.5) 64.5 (-13.9) 100.0 (-7.5) 100.0 (-7.5) 100.0 (-7.5) 25.5 (-20.9)
Promedas_44 100.0 (-9.3) 99.6 (-9.4) 67.6 (-19.1) 100.0 (-9.3) 100.0 (-9.3) 100.0 (-9.3) 0.0 (nan)
Promedas_45 100.0 (-7.5) 100.0 (-7.5) 0.0 (nan) 100.0 (-7.5) 100.0 (-7.5) 100.0 (-7.5) 59.4 (-15.4)
Promedas_46 100.0 (-12.8) 100.0 (-12.8) 89.3 (-16.1) 100.0 (-12.8) 100.0 (-12.8) 100.0 (-12.8) 60.0 (-25.0)
Promedas_47 100.0 (-14.0) 100.0 (-14.0) 0.0 (nan) 100.0 (-14.0) 100.0 (-14.0) 100.0 (-14.0) 32.0 (-36.8)
Promedas_48 100.0 (-10.8) 99.0 (-11.0) 0.0 (nan) 100.0 (-10.8) 100.0 (-10.8) 100.0 (-10.8) 10.6 (-29.9)
Promedas_49 100.0 (-8.4) 99.8 (-8.4) 69.8 (-15.6) 100.0 (-8.4) 100.0 (-8.4) 100.0 (-8.4) 59.4 (-18.1)
Promedas_50 100.0 (-9.0) 100.0 (-9.0) 0.0 (nan) 100.0 (-9.0) 100.0 (-9.0) 100.0 (-9.0) 14.6 (-23.8)
Promedas_51 100.0 (-12.3) 100.0 (-12.3) 0.0 (nan) 100.0 (-12.3) 100.0 (-12.3) 100.0 (-12.3) 60.3 (-21.4)
Promedas_52 100.0 (-10.8) 100.0 (-10.8) 0.0 (nan) 100.0 (-10.8) 100.0 (-10.8) 100.0 (-10.8) 0.0 (nan)
Promedas_53 100.0 (-9.1) 100.0 (-9.1) 0.0 (nan) 100.0 (-9.1) 100.0 (-9.1) 100.0 (-9.1) 18.8 (-28.4)
Promedas_54 100.0 (-10.3) 100.0 (-10.3) 0.0 (nan) 100.0 (-10.3) 100.0 (-10.3) 100.0 (-10.3) 75.9 (-14.8)
Promedas_55 100.0 (-12.7) 100.0 (-12.7) 96.4 (-13.4) 100.0 (-12.7) 100.0 (-12.7) 100.0 (-12.7) 20.0 (-27.6)
Promedas_56 100.0 (-10.8) 97.8 (-11.3) 50.7 (-22.2) 100.0 (-10.8) 100.0 (-10.8) 100.0 (-10.8) 32.5 (-26.4)
Promedas_57 100.0 (-10.4) 100.0 (-10.4) 0.0 (nan) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 76.6 (-19.0)
Promedas_58 100.0 (-19.9) 100.0 (-19.9) 71.3 (-33.1) 100.0 (-19.9) 100.0 (-19.9) 100.0 (-19.9) 14.7 (-59.0)
Promedas_59 100.0 (-10.6) 100.0 (-10.6) 95.1 (-11.5) 100.0 (-10.6) 100.0 (-10.6) 100.0 (-10.6) 0.0 (-30.7)
Promedas_60 100.0 (-10.0) 100.0 (-10.0) 93.0 (-11.5) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 24.7 (-25.3)
Promedas_61 100.0 (-6.9) 100.0 (-6.9) 29.2 (-17.4) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9) 0.0 (-33.0)
Promedas_62 100.0 (-4.7) 100.0 (-4.7) 0.0 (nan) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7) 71.3 (-10.9)
Promedas_63 100.0 (-6.1) 100.0 (-6.1) 0.0 (nan) 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1) 34.1 (-15.4)
Promedas_64 100.0 (-11.5) 100.0 (-11.5) 0.0 (nan) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5) 0.0 (-28.0)
Promedas_65 100.0 (-5.2) 100.0 (-5.2) 92.8 (-6.5) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2) 26.0 (-18.7)
Promedas_66 100.0 (-10.4) 100.0 (-10.4) 73.9 (-14.7) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 0.0 (-28.9)
Promedas_67 100.0 (-13.4) 100.0 (-13.4) 0.0 (nan) 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4) 0.0 (nan)
Promedas_68 100.0 (-18.9) 100.0 (-18.9) 95.9 (-20.4) 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9) 31.7 (-44.2)
Promedas_69 100.0 (-11.2) 100.0 (-11.2) 72.1 (-14.8) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2) 0.0 (-26.6)
Promedas_70 100.0 (-4.1) 100.0 (-4.1) 65.6 (-6.8) 100.0 (-4.1) 100.0 (-4.1) 100.0 (-4.1) 0.0 (-12.2)
Promedas_71 100.0 (-6.0) 100.0 (-6.0) 0.0 (nan) 100.0 (-6.0) 100.0 (-6.0) 100.0 (-6.0) 29.6 (-18.7)
ProteinFolding_11 100.0 (1961.8) 100.0 (1961.8) 99.2 (1956.2) 100.0 (1961.8) 98.7 (1952.0) 97.6 (1944.4) 65.5 (1709.4)
ProteinFolding_12 100.0 (-1547.1) 100.0 (-1547.1) 100.0 (-1547.1) 100.0 (-1547.1) 100.0 (-1547.1) 100.0 (-1547.1) 100.0 (-1547.1)
ProteinFolding_13 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3)
ProteinFolding_14 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7)
ProteinFolding_15 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6)
ProteinFolding_16 100.0 (-855.5) 100.0 (-855.5) 100.0 (-855.5) 100.0 (-855.5) 100.0 (-855.5) 100.0 (-855.5) 100.0 (-855.5)
ProteinFolding_17 100.0 (16544.2) 100.0 (16544.2) 50.3 (12680.1) 100.0 (16544.2) 100.0 (16544.2) 94.3 (16103.7) 0.0 (8114.9)
ProteinFolding_18 100.0 (18606.3) 88.0 (17492.9) 53.9 (14316.5) 100.0 (18606.3) 100.0 (18606.3) 100.0 (18606.3) 33.8 (12444.4)
ProteinFolding_19 72.1 (2448.7) 83.8 (2545.1) 0.0 (1679.1) 100.0 (2678.5) 100.0 (2678.5) 95.5 (2641.7) 0.0 (1580.7)
ProteinFolding_20 99.9 (5577.3) 100.0 (5578.7) 18.8 (4396.8) 100.0 (5578.7) 100.0 (5578.7) 100.0 (5578.7) 0.0 (1399.8)
ProteinFolding_21 100.0 (7958.7) 85.8 (7880.7) 0.0 (7087.7) 100.0 (7958.7) 100.0 (7958.7) 100.0 (7958.7) 0.0 (5232.2)
ProteinFolding_22 100.0 (10547.2) 100.0 (10547.2) 68.3 (10373.9) 100.0 (10547.2) 100.0 (10547.2) 100.0 (10547.2) 0.0 (5525.9)
ProteinFolding_23 75.0 (4049.8) 70.1 (4004.2) 63.1 (3940.5) 100.0 (4279.1) 100.0 (4279.1) 99.7 (4276.5) 10.2 (3454.3)
ProteinFolding_24 98.1 (5868.8) 99.5 (5892.9) 79.4 (5566.6) 100.0 (5900.4) 100.0 (5900.4) 100.0 (5900.4) 0.0 (2652.5)
ProteinFolding_25 100.0 (8656.3) 100.0 (8656.3) 51.6 (7587.7) 100.0 (8656.3) 100.0 (8656.3) 100.0 (8656.3) 0.0 (4459.6)
Segmentation_11 100.0 (-135.8) 69.4 (-138.7) 72.1 (-138.4) 100.0 (-135.8) 100.0 (-135.8) 100.0 (-135.8) 100.0 (-135.8)
Segmentation_12 100.0 (-22.2) 100.0 (-22.2) 100.0 (-22.2) 100.0 (-22.2) 100.0 (-22.2) 100.0 (-22.2) 100.0 (-22.2)
Segmentation_13 100.0 (-21.7) 100.0 (-21.7) 100.0 (-21.7) 100.0 (-21.7) 100.0 (-21.7) 100.0 (-21.7) 100.0 (-21.7)
Segmentation_14 100.0 (-40.1) 100.0 (-40.1) 100.0 (-40.1) 100.0 (-40.1) 100.0 (-40.1) 100.0 (-40.1) 100.0 (-40.1)
Segmentation_15 100.0 (-165.2) 70.2 (-172.0) 91.5 (-167.1) 100.0 (-165.2) 100.0 (-165.2) 100.0 (-165.2) 100.0 (-165.2)
Segmentation_16 100.0 (-41.3) 100.0 (-41.3) 100.0 (-41.3) 100.0 (-41.3) 100.0 (-41.3) 100.0 (-41.3) 100.0 (-41.3)
Segmentation_17 100.0 (-176.8) 89.3 (-178.8) 97.7 (-177.2) 100.0 (-176.8) 100.0 (-176.8) 100.0 (-176.8) 97.2 (-177.3)
Segmentation_18 100.0 (-35.9) 100.0 (-35.9) 100.0 (-35.9) 100.0 (-35.9) 100.0 (-35.9) 100.0 (-35.9) 100.0 (-35.9)
Segmentation_19 100.0 (-25.5) 100.0 (-25.5) 100.0 (-25.5) 100.0 (-25.5) 100.0 (-25.5) 100.0 (-25.5) 100.0 (-25.5)
Segmentation_20 100.0 (-113.9) 94.2 (-115.0) 98.8 (-114.1) 100.0 (-113.9) 100.0 (-113.9) 100.0 (-113.9) 100.0 (-113.9)
wcsp_11 55.6 (-3.4) 0.0 (-3.5) 22.3 (-3.4) 66.6 (-3.3) 66.6 (-3.3) 77.8 (-3.3) 0.0 (-3.5)
wcsp_12 99.6 (-2.6) 39.9 (-3.1) 79.7 (-2.8) 99.7 (-2.6) 99.8 (-2.6) 100.0 (-2.6) 69.6 (-2.9)
wcsp_13 100.0 (-0.2) 100.0 (-0.2) 97.0 (-4.1) 94.0 (-8.1) 94.0 (-8.1) 94.0 (-8.1) 91.1 (-12.0)
wcsp_14 81.3 (-24.1) 78.2 (-28.0) 84.4 (-20.0) 87.6 (-16.0) 87.5 (-16.1) 90.7 (-12.1) 78.2 (-28.0)
wcsp_15 100.0 (-76.0) 96.6 (-80.0) 3.4 (-188.0) 100.0 (-76.0) 96.6 (-80.0) 79.3 (-100.0) 13.8 (-176.0)
wcsp_16 98.2 (-18.3) 78.9 (-37.0) 41.0 (-74.0) 100.0 (-16.5) 100.0 (-16.5) 100.0 (-16.5) 100.0 (-16.5)
wcsp_17 93.4 (-25.5) 84.5 (-43.1) 42.9 (-125.6) 68.2 (-75.3) 99.5 (-13.3) 100.0 (-12.4) 99.6 (-13.2)
wcsp_18 70.7 (-20.0) 58.9 (-28.0) 76.5 (-16.0) 64.8 (-24.0) 58.9 (-28.0) 58.9 (-28.0) 53.0 (-32.0)

1200sec

Problem daoopt daoopt-lh-mpe daoopt-test toulbar2-ipr-mpe toulbar2-vacint-mpe toulbar2-vns-mpe uai14-mpe
Grids_18 100.0 (5674.4) 98.7 (5643.4) 95.7 (5576.2) 100.0 (5674.4) 95.5 (5569.8) 97.8 (5622.9) 60.8 (4770.6)
Grids_19 100.0 (1179.2) 99.3 (1176.9) 99.5 (1177.6) 100.0 (1179.2) 98.3 (1173.5) 99.5 (1177.6) 57.4 (1033.4)
Grids_20 100.0 (4677.7) 99.4 (4669.6) 96.3 (4631.5) 99.9 (4676.6) 95.3 (4618.0) 99.8 (4674.6) 56.7 (4130.7)
Grids_21 100.0 (8496.7) 99.4 (8475.5) 95.4 (8332.8) 98.6 (8447.7) 94.0 (8285.4) 98.2 (8434.3) 64.0 (7226.5)
Grids_22 100.0 (2825.5) 97.9 (2804.1) 98.6 (2810.7) 100.0 (2825.5) 94.4 (2768.3) 98.7 (2812.1) 56.1 (2376.4)
Grids_23 100.0 (2781.6) 99.7 (2778.7) 99.1 (2773.0) 100.0 (2781.6) 95.8 (2743.1) 98.7 (2769.4) 60.3 (2412.8)
Grids_24 100.0 (8234.3) 99.9 (8231.8) 98.5 (8191.7) 98.2 (8182.0) 95.0 (8087.8) 97.8 (8169.7) 59.6 (7049.3)
Grids_25 100.0 (1167.8) 99.7 (1167.0) 99.8 (1167.3) 100.0 (1167.8) 87.4 (1127.2) 99.5 (1166.1) 69.1 (1068.5)
Grids_26 100.0 (1325.0) 97.6 (1313.0) 98.2 (1315.7) 100.0 (1325.0) 98.9 (1319.4) 97.0 (1309.6) 60.6 (1125.1)
Grids_27 100.0 (5504.4) 99.5 (5494.0) 99.4 (5492.2) 99.1 (5486.4) 93.0 (5369.6) 98.8 (5480.4) 59.6 (4727.8)
Grids_28 100.0 (1981.8) 100.0 (1981.8) 98.6 (1970.7) 100.0 (1981.8) 98.9 (1973.3) 98.2 (1967.6) 67.0 (1724.8)
Grids_29 100.0 (670.0) 100.0 (670.0) 100.0 (670.0) 100.0 (670.0) 98.9 (667.4) 96.6 (661.9) 65.2 (586.6)
Grids_30 100.0 (1309.7) 100.0 (1309.7) 100.0 (1309.7) 100.0 (1309.7) 98.5 (1302.6) 98.5 (1302.7) 64.3 (1138.7)
ImageAlignment_11 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2)
ImageAlignment_12 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7)
ImageAlignment_13 100.0 (-2999.9) 100.0 (-2999.9) 100.0 (-2999.9) 100.0 (-2999.9) 100.0 (-2999.9) 100.0 (-2999.9) 100.0 (-2999.9)
ImageAlignment_14 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5)
ImageAlignment_15 100.0 (-1177.5) 97.2 (-1188.2) 100.0 (-1177.5) 100.0 (-1177.5) 100.0 (-1177.5) 100.0 (-1177.5) 100.0 (-1177.5)
ObjectDetection_11 85.6 (4237.9) 81.0 (4181.6) 0.0 (2667.2) 100.0 (4412.7) 100.0 (4412.7) 99.8 (4409.8) 0.0 (3083.8)
ObjectDetection_12 88.8 (6685.0) 94.6 (6725.5) 0.0 (4223.3) 100.0 (6762.5) 100.0 (6762.5) 100.0 (6762.5) 0.0 (2984.0)
ObjectDetection_13 82.9 (9854.2) 99.6 (9967.7) 0.0 (8572.3) 100.0 (9970.6) 100.0 (9970.6) 100.0 (9970.6) 0.0 (5777.3)
ObjectDetection_14 94.3 (9020.8) 94.3 (9020.8) 0.0 (6845.3) 100.0 (9093.7) 100.0 (9093.7) 100.0 (9093.7) 0.0 (3204.4)
ObjectDetection_15 93.3 (12478.6) 59.7 (11703.8) 27.4 (10958.1) 100.0 (12633.3) 100.0 (12633.3) 100.0 (12633.3) 0.0 (3970.8)
ObjectDetection_16 70.3 (13536.2) 92.9 (14153.8) 6.3 (11789.5) 100.0 (14347.1) 100.0 (14347.1) 100.0 (14347.1) 0.0 (7589.9)
ObjectDetection_17 97.4 (4816.0) 93.7 (4716.4) 85.2 (4485.5) 100.0 (4887.4) 100.0 (4887.4) 100.0 (4887.4) 39.7 (3248.4)
ObjectDetection_18 92.0 (8849.5) 92.0 (8849.5) 15.3 (7246.9) 100.0 (9017.1) 100.0 (9017.1) 100.0 (9017.1) 0.0 (2413.4)
Promedas_11 99.1 (-21.5) 77.7 (-31.9) 0.0 (nan) 100.0 (-21.0) 100.0 (-21.0) 100.0 (-21.0) 49.2 (-45.9)
Promedas_12 100.0 (-15.3) 98.4 (-16.0) 0.0 (nan) 100.0 (-15.3) 100.0 (-15.3) 100.0 (-15.3) 43.8 (-40.9)
Promedas_13 100.0 (-27.1) 97.9 (-28.4) 0.0 (nan) 100.0 (-27.1) 100.0 (-27.1) 100.0 (-27.1) 44.8 (-62.5)
Promedas_14 100.0 (-18.6) 98.8 (-19.1) 0.0 (nan) 100.0 (-18.6) 100.0 (-18.6) 100.0 (-18.6) 57.7 (-37.2)
Promedas_15 100.0 (-24.5) 95.4 (-26.9) 0.0 (nan) 100.0 (-24.5) 100.0 (-24.5) 100.0 (-24.5) 64.2 (-43.0)
Promedas_16 100.0 (-19.7) 97.1 (-21.0) 69.2 (-33.1) 100.0 (-19.7) 100.0 (-19.7) 100.0 (-19.7) 0.0 (nan)
Promedas_17 100.0 (-19.8) 100.0 (-19.8) 0.0 (nan) 100.0 (-19.8) 100.0 (-19.8) 100.0 (-19.8) 84.7 (-26.3)
Promedas_18 100.0 (-24.4) 99.0 (-24.9) 0.0 (nan) 100.0 (-24.4) 100.0 (-24.4) 100.0 (-24.4) 0.0 (nan)
Promedas_19 100.0 (-26.1) 97.6 (-27.9) 0.0 (nan) 100.0 (-26.1) 100.0 (-26.1) 100.0 (-26.1) 33.8 (-73.6)
Promedas_20 100.0 (-12.2) 97.3 (-13.3) 42.3 (-36.3) 100.0 (-12.2) 100.0 (-12.2) 100.0 (-12.2) 57.5 (-30.0)
Promedas_21 100.0 (-17.4) 99.9 (-17.5) 57.3 (-40.2) 100.0 (-17.4) 100.0 (-17.4) 100.0 (-17.4) 14.7 (-62.9)
Promedas_22 100.0 (-16.1) 99.8 (-16.2) 0.0 (nan) 100.0 (-16.1) 100.0 (-16.1) 100.0 (-16.1) 53.3 (-39.9)
Promedas_23 100.0 (-23.5) 97.5 (-24.7) 0.0 (nan) 100.0 (-23.5) 100.0 (-23.5) 100.0 (-23.5) 37.4 (-55.1)
Promedas_24 100.0 (-12.5) 100.0 (-12.5) 91.5 (-14.8) 100.0 (-12.5) 100.0 (-12.5) 100.0 (-12.5) 39.0 (-28.8)
Promedas_25 100.0 (-14.7) 100.0 (-14.7) 66.4 (-25.4) 100.0 (-14.7) 100.0 (-14.7) 100.0 (-14.7) 39.0 (-34.1)
Promedas_26 100.0 (-19.2) 99.1 (-19.6) 0.0 (nan) 100.0 (-19.2) 100.0 (-19.2) 100.0 (-19.2) 0.0 (nan)
Promedas_27 100.0 (-10.0) 98.0 (-10.6) 79.5 (-15.9) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 27.4 (-30.7)
Promedas_28 100.0 (-6.0) 100.0 (-6.0) 68.1 (-15.8) 100.0 (-6.0) 100.0 (-6.0) 100.0 (-6.0) 0.0 (nan)
Promedas_29 100.0 (-19.8) 99.1 (-20.1) 0.0 (nan) 100.0 (-19.8) 100.0 (-19.8) 100.0 (-19.8) 44.1 (-39.9)
Promedas_30 100.0 (-10.4) 100.0 (-10.4) 0.0 (nan) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 39.5 (-35.8)
Promedas_31 100.0 (-12.2) 99.1 (-12.5) 77.7 (-20.5) 100.0 (-12.2) 100.0 (-12.2) 100.0 (-12.2) 77.2 (-20.8)
Promedas_32 100.0 (-13.9) 100.0 (-13.9) 0.0 (nan) 100.0 (-13.9) 100.0 (-13.9) 100.0 (-13.9) 0.0 (nan)
Promedas_33 100.0 (-14.0) 100.0 (-14.0) 100.0 (-14.0) 100.0 (-14.0) 100.0 (-14.0) 100.0 (-14.0) 40.4 (-38.2)
Promedas_34 100.0 (-17.0) 100.0 (-17.0) 69.6 (-27.8) 100.0 (-17.0) 100.0 (-17.0) 100.0 (-17.0) 45.9 (-36.3)
Promedas_35 100.0 (-11.3) 100.0 (-11.3) 95.6 (-12.1) 100.0 (-11.3) 100.0 (-11.3) 100.0 (-11.3) 3.2 (-29.8)
Promedas_36 100.0 (-8.2) 100.0 (-8.2) 57.8 (-17.1) 100.0 (-8.2) 100.0 (-8.2) 100.0 (-8.2) 19.6 (-25.2)
Promedas_37 100.0 (-15.4) 100.0 (-15.4) 0.0 (nan) 100.0 (-15.4) 100.0 (-15.4) 100.0 (-15.4) 23.7 (-40.0)
Promedas_38 100.0 (-12.1) 100.0 (-12.1) 95.4 (-13.4) 100.0 (-12.1) 100.0 (-12.1) 100.0 (-12.1) 45.9 (-27.3)
Promedas_39 100.0 (-20.7) 97.7 (-21.5) 89.7 (-24.1) 100.0 (-20.7) 100.0 (-20.7) 100.0 (-20.7) 59.2 (-34.1)
Promedas_40 100.0 (-7.3) 94.7 (-8.3) 43.7 (-18.3) 100.0 (-7.3) 100.0 (-7.3) 100.0 (-7.3) 33.7 (-20.3)
Promedas_41 100.0 (-9.7) 100.0 (-9.7) 97.4 (-10.4) 100.0 (-9.7) 100.0 (-9.7) 100.0 (-9.7) 63.8 (-19.4)
Promedas_42 100.0 (-12.8) 100.0 (-12.8) 0.0 (nan) 100.0 (-12.8) 100.0 (-12.8) 100.0 (-12.8) 22.2 (-38.3)
Promedas_43 100.0 (-7.5) 100.0 (-7.5) 91.0 (-9.2) 100.0 (-7.5) 100.0 (-7.5) 100.0 (-7.5) 25.5 (-20.9)
Promedas_44 100.0 (-9.3) 100.0 (-9.3) 58.7 (-21.9) 100.0 (-9.3) 100.0 (-9.3) 100.0 (-9.3) 0.0 (nan)
Promedas_45 100.0 (-7.5) 100.0 (-7.5) 97.6 (-8.0) 100.0 (-7.5) 100.0 (-7.5) 100.0 (-7.5) 86.7 (-10.1)
Promedas_46 100.0 (-12.8) 100.0 (-12.8) 100.0 (-12.8) 100.0 (-12.8) 100.0 (-12.8) 100.0 (-12.8) 53.8 (-26.9)
Promedas_47 100.0 (-14.0) 100.0 (-14.0) 0.0 (nan) 100.0 (-14.0) 100.0 (-14.0) 100.0 (-14.0) 92.7 (-16.5)
Promedas_48 100.0 (-10.8) 100.0 (-10.8) 0.0 (nan) 100.0 (-10.8) 100.0 (-10.8) 100.0 (-10.8) 17.1 (-28.5)
Promedas_49 100.0 (-8.4) 99.8 (-8.4) 69.9 (-15.6) 100.0 (-8.4) 100.0 (-8.4) 100.0 (-8.4) 69.4 (-15.7)
Promedas_50 100.0 (-9.0) 100.0 (-9.0) 99.0 (-9.2) 100.0 (-9.0) 100.0 (-9.0) 100.0 (-9.0) 16.0 (-23.5)
Promedas_51 100.0 (-12.3) 100.0 (-12.3) 97.3 (-12.9) 100.0 (-12.3) 100.0 (-12.3) 100.0 (-12.3) 60.3 (-21.4)
Promedas_52 100.0 (-10.8) 100.0 (-10.8) 100.0 (-10.8) 100.0 (-10.8) 100.0 (-10.8) 100.0 (-10.8) 0.0 (nan)
Promedas_53 100.0 (-9.1) 100.0 (-9.1) 99.3 (-9.3) 100.0 (-9.1) 100.0 (-9.1) 100.0 (-9.1) 24.2 (-27.1)
Promedas_54 100.0 (-10.3) 100.0 (-10.3) 92.5 (-11.7) 100.0 (-10.3) 100.0 (-10.3) 100.0 (-10.3) 75.9 (-14.8)
Promedas_55 100.0 (-12.7) 100.0 (-12.7) 97.3 (-13.2) 100.0 (-12.7) 100.0 (-12.7) 100.0 (-12.7) 5.6 (-30.3)
Promedas_56 100.0 (-10.8) 97.8 (-11.3) 100.0 (-10.8) 100.0 (-10.8) 100.0 (-10.8) 100.0 (-10.8) 44.6 (-23.6)
Promedas_57 100.0 (-10.4) 100.0 (-10.4) 99.6 (-10.6) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 86.3 (-15.5)
Promedas_58 100.0 (-19.9) 100.0 (-19.9) 100.0 (-19.9) 100.0 (-19.9) 100.0 (-19.9) 100.0 (-19.9) 25.1 (-54.3)
Promedas_59 100.0 (-10.6) 100.0 (-10.6) 94.5 (-11.6) 100.0 (-10.6) 100.0 (-10.6) 100.0 (-10.6) 21.9 (-26.1)
Promedas_60 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 51.4 (-19.9)
Promedas_61 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9) 73.3 (-10.8)
Promedas_62 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7) 83.5 (-8.2)
Promedas_63 100.0 (-6.1) 100.0 (-6.1) 30.5 (-15.9) 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1) 34.1 (-15.4)
Promedas_64 100.0 (-11.5) 100.0 (-11.5) 76.5 (-15.0) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5) 84.4 (-13.8)
Promedas_65 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2) 46.1 (-15.0)
Promedas_66 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 74.6 (-14.5)
Promedas_67 100.0 (-13.4) 100.0 (-13.4) 0.0 (nan) 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4) 0.0 (nan)
Promedas_68 100.0 (-18.9) 100.0 (-18.9) 95.9 (-20.4) 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9) 30.1 (-44.8)
Promedas_69 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2) 5.0 (-23.3)
Promedas_70 100.0 (-4.1) 100.0 (-4.1) 39.0 (-8.9) 100.0 (-4.1) 100.0 (-4.1) 100.0 (-4.1) 51.6 (-7.9)
Promedas_71 100.0 (-6.0) 100.0 (-6.0) 91.6 (-7.5) 100.0 (-6.0) 100.0 (-6.0) 100.0 (-6.0) 29.6 (-18.7)
ProteinFolding_11 100.0 (1961.8) 100.0 (1961.8) 100.0 (1961.8) 100.0 (1961.8) 99.6 (1959.0) 97.6 (1944.4) 65.5 (1709.4)
ProteinFolding_12 100.0 (-1547.1) 100.0 (-1547.1) 100.0 (-1547.1) 100.0 (-1547.1) 100.0 (-1547.1) 100.0 (-1547.1) 100.0 (-1547.1)
ProteinFolding_13 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3)
ProteinFolding_14 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7)
ProteinFolding_15 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6)
ProteinFolding_16 100.0 (-855.5) 100.0 (-855.5) 100.0 (-855.5) 100.0 (-855.5) 100.0 (-855.5) 100.0 (-855.5) 100.0 (-855.5)
ProteinFolding_17 100.0 (16544.2) 100.0 (16544.2) 2.9 (8984.2) 100.0 (16544.2) 100.0 (16544.2) 94.3 (16103.7) 0.0 (7107.9)
ProteinFolding_18 100.0 (18606.3) 88.0 (17492.9) 78.6 (16619.0) 100.0 (18606.3) 100.0 (18606.3) 100.0 (18606.3) 7.8 (10028.2)
ProteinFolding_19 72.1 (2448.7) 83.8 (2545.1) 60.1 (2350.1) 100.0 (2678.5) 100.0 (2678.5) 100.0 (2678.5) 62.0 (2365.7)
ProteinFolding_20 99.9 (5577.3) 100.0 (5578.7) 24.8 (4484.1) 100.0 (5578.7) 100.0 (5578.7) 100.0 (5578.7) 0.0 (3729.9)
ProteinFolding_21 100.0 (7958.7) 85.8 (7880.7) 0.0 (7101.0) 100.0 (7958.7) 100.0 (7958.7) 100.0 (7958.7) 0.0 (3674.0)
ProteinFolding_22 100.0 (10547.2) 100.0 (10547.2) 63.3 (10346.3) 100.0 (10547.2) 100.0 (10547.2) 100.0 (10547.2) 0.0 (6737.1)
ProteinFolding_23 92.5 (4210.2) 70.1 (4004.2) 8.2 (3436.4) 100.0 (4279.1) 100.0 (4279.1) 99.7 (4276.5) 82.4 (4117.9)
ProteinFolding_24 98.1 (5868.8) 99.5 (5892.9) 27.8 (4728.5) 100.0 (5900.4) 100.0 (5900.4) 100.0 (5900.4) 0.0 (4241.3)
ProteinFolding_25 100.0 (8656.3) 100.0 (8656.3) 20.0 (6887.6) 100.0 (8656.3) 100.0 (8656.3) 100.0 (8656.3) 0.0 (3769.2)
Segmentation_11 100.0 (-135.8) 69.4 (-138.7) 100.0 (-135.8) 100.0 (-135.8) 100.0 (-135.8) 100.0 (-135.8) 100.0 (-135.8)
Segmentation_12 100.0 (-22.2) 100.0 (-22.2) 100.0 (-22.2) 100.0 (-22.2) 100.0 (-22.2) 100.0 (-22.2) 100.0 (-22.2)
Segmentation_13 100.0 (-21.7) 100.0 (-21.7) 100.0 (-21.7) 100.0 (-21.7) 100.0 (-21.7) 100.0 (-21.7) 100.0 (-21.7)
Segmentation_14 100.0 (-40.1) 100.0 (-40.1) 100.0 (-40.1) 100.0 (-40.1) 100.0 (-40.1) 100.0 (-40.1) 100.0 (-40.1)
Segmentation_15 100.0 (-165.2) 70.2 (-172.0) 100.0 (-165.2) 100.0 (-165.2) 100.0 (-165.2) 100.0 (-165.2) 100.0 (-165.2)
Segmentation_16 100.0 (-41.3) 100.0 (-41.3) 100.0 (-41.3) 100.0 (-41.3) 100.0 (-41.3) 100.0 (-41.3) 100.0 (-41.3)
Segmentation_17 100.0 (-176.8) 89.3 (-178.8) 100.0 (-176.8) 100.0 (-176.8) 100.0 (-176.8) 100.0 (-176.8) 100.0 (-176.8)
Segmentation_18 100.0 (-35.9) 100.0 (-35.9) 100.0 (-35.9) 100.0 (-35.9) 100.0 (-35.9) 100.0 (-35.9) 100.0 (-35.9)
Segmentation_19 100.0 (-25.5) 100.0 (-25.5) 100.0 (-25.5) 100.0 (-25.5) 100.0 (-25.5) 100.0 (-25.5) 100.0 (-25.5)
Segmentation_20 100.0 (-113.9) 94.2 (-115.0) 100.0 (-113.9) 100.0 (-113.9) 100.0 (-113.9) 100.0 (-113.9) 100.0 (-113.9)
wcsp_11 55.6 (-3.4) 66.7 (-3.3) 22.3 (-3.4) 100.0 (-3.3) 77.8 (-3.3) 100.0 (-3.3) 0.0 (-3.5)
wcsp_12 99.9 (-2.6) 99.7 (-2.6) 69.8 (-2.9) 100.0 (-2.6) 99.9 (-2.6) 100.0 (-2.6) 89.5 (-2.7)
wcsp_13 100.0 (-0.2) 100.0 (-0.2) 100.0 (-0.2) 91.0 (-12.1) 94.0 (-8.1) 94.0 (-8.1) 91.1 (-12.0)
wcsp_14 100.0 (-0.1) 78.2 (-28.0) 87.6 (-16.0) 87.6 (-16.1) 87.6 (-16.1) 87.6 (-16.1) 78.2 (-28.0)
wcsp_15 100.0 (-76.0) 96.6 (-80.0) 17.2 (-172.0) 100.0 (-76.0) 96.6 (-80.0) 93.1 (-84.0) 13.8 (-176.0)
wcsp_16 100.0 (-16.5) 78.9 (-37.0) 95.3 (-21.1) 100.0 (-16.5) 100.0 (-16.5) 100.0 (-16.5) 88.3 (-27.9)
wcsp_17 99.6 (-13.2) 84.5 (-43.1) 75.8 (-60.2) 100.0 (-12.3) 100.0 (-12.3) 100.0 (-12.3) 75.9 (-60.0)
wcsp_18 100.0 (-0.1) 58.9 (-28.0) 76.6 (-16.0) 58.9 (-28.0) 58.9 (-28.0) 58.9 (-28.0) 53.0 (-32.0)

3600sec

Problem daoopt daoopt-lh-mpe daoopt-test toulbar2-ipr-mpe toulbar2-vacint-mpe toulbar2-vns-mpe uai14-mpe
Grids_18 100.0 (5674.4) 98.9 (5650.0) 95.7 (5576.2) 100.0 (5674.4) 95.5 (5569.8) 97.8 (5622.9) 60.8 (4770.6)
Grids_19 100.0 (1179.2) 98.7 (1174.9) 99.5 (1177.6) 100.0 (1179.2) 98.3 (1173.5) 99.5 (1177.6) 57.4 (1033.4)
Grids_20 100.0 (4677.6) 99.1 (4666.3) 96.8 (4637.8) 100.0 (4677.7) 95.8 (4624.8) 99.8 (4674.6) 56.7 (4130.7)
Grids_21 100.0 (8496.7) 98.3 (8436.7) 95.4 (8332.8) 100.0 (8496.7) 94.1 (8287.3) 98.2 (8434.3) 64.0 (7226.5)
Grids_22 100.0 (2825.5) 97.7 (2801.6) 98.6 (2810.7) 100.0 (2825.5) 94.7 (2771.1) 98.7 (2812.1) 56.1 (2376.4)
Grids_23 100.0 (2781.6) 100.0 (2781.6) 99.1 (2773.0) 100.0 (2781.6) 95.8 (2743.1) 98.7 (2769.4) 60.3 (2412.8)
Grids_24 100.0 (8234.3) 99.2 (8210.8) 98.5 (8191.7) 100.0 (8234.3) 95.0 (8087.8) 97.8 (8169.7) 59.6 (7049.3)
Grids_25 100.0 (1167.8) 99.2 (1165.2) 99.8 (1167.3) 100.0 (1167.8) 87.4 (1127.2) 99.5 (1166.1) 69.1 (1068.5)
Grids_26 100.0 (1325.0) 100.0 (1325.0) 98.9 (1319.7) 100.0 (1325.0) 98.9 (1319.4) 99.1 (1320.5) 60.6 (1125.1)
Grids_27 100.0 (5504.4) 97.6 (5458.5) 99.4 (5492.2) 100.0 (5504.4) 93.4 (5376.9) 98.8 (5480.4) 59.6 (4727.8)
Grids_28 100.0 (1981.8) 100.0 (1981.8) 98.6 (1970.7) 100.0 (1981.8) 99.4 (1977.3) 98.2 (1967.6) 67.0 (1724.8)
Grids_29 100.0 (670.0) 100.0 (670.0) 100.0 (670.0) 100.0 (670.0) 98.9 (667.4) 96.6 (661.9) 65.2 (586.6)
Grids_30 100.0 (1309.7) 100.0 (1309.7) 100.0 (1309.7) 100.0 (1309.7) 98.9 (1304.2) 98.5 (1302.7) 64.3 (1138.7)
ImageAlignment_11 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2)
ImageAlignment_12 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7)
ImageAlignment_13 100.0 (-2999.9) 100.0 (-2999.9) 100.0 (-2999.9) 100.0 (-2999.9) 100.0 (-2999.9) 100.0 (-2999.9) 100.0 (-2999.9)
ImageAlignment_14 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5)
ImageAlignment_15 100.0 (-1177.5) 100.0 (-1177.5) 100.0 (-1177.5) 100.0 (-1177.5) 100.0 (-1177.5) 100.0 (-1177.5) 100.0 (-1177.5)
ObjectDetection_11 85.6 (4237.9) 81.0 (4181.6) 0.0 (2667.2) 100.0 (4412.7) 100.0 (4412.7) 99.8 (4409.8) 30.8 (3571.3)
ObjectDetection_12 88.8 (6685.0) 94.6 (6725.5) 0.0 (4223.3) 100.0 (6762.5) 100.0 (6762.5) 100.0 (6762.5) 0.0 (2984.0)
ObjectDetection_13 82.9 (9854.2) 99.6 (9967.7) 0.0 (8572.3) 100.0 (9970.6) 100.0 (9970.6) 100.0 (9970.6) 0.0 (5280.9)
ObjectDetection_14 94.3 (9020.8) 94.3 (9020.8) 0.0 (6845.3) 100.0 (9093.7) 100.0 (9093.7) 100.0 (9093.7) 0.0 (3204.4)
ObjectDetection_15 93.3 (12478.6) 59.7 (11703.8) 27.4 (10958.1) 100.0 (12633.3) 100.0 (12633.3) 100.0 (12633.3) 0.0 (4258.8)
ObjectDetection_16 70.3 (13536.2) 92.9 (14153.8) 6.3 (11789.5) 100.0 (14347.1) 100.0 (14347.1) 100.0 (14347.1) 0.0 (8533.0)
ObjectDetection_17 97.4 (4816.0) 93.7 (4716.4) 85.2 (4485.5) 100.0 (4887.4) 100.0 (4887.4) 100.0 (4887.4) 39.7 (3248.4)
ObjectDetection_18 92.0 (8849.5) 92.0 (8849.5) 15.3 (7246.9) 100.0 (9017.1) 100.0 (9017.1) 100.0 (9017.1) 0.0 (2413.4)
Promedas_11 100.0 (-21.0) 0.0 (nan) 0.0 (nan) 100.0 (-21.0) 100.0 (-21.0) 100.0 (-21.0) 50.6 (-45.2)
Promedas_12 99.7 (-15.4) 98.4 (-16.0) 0.0 (nan) 100.0 (-15.3) 100.0 (-15.3) 100.0 (-15.3) 42.1 (-41.7)
Promedas_13 100.0 (-27.1) 97.9 (-28.4) 0.0 (nan) 100.0 (-27.1) 100.0 (-27.1) 100.0 (-27.1) 36.9 (-67.5)
Promedas_14 100.0 (-18.6) 98.8 (-19.1) 0.0 (nan) 100.0 (-18.6) 100.0 (-18.6) 100.0 (-18.6) 57.7 (-37.2)
Promedas_15 100.0 (-24.5) 95.4 (-26.9) 0.0 (nan) 100.0 (-24.5) 100.0 (-24.5) 100.0 (-24.5) 65.5 (-42.3)
Promedas_16 100.0 (-19.7) 97.1 (-21.0) 0.0 (nan) 100.0 (-19.7) 100.0 (-19.7) 100.0 (-19.7) 0.0 (nan)
Promedas_17 100.0 (-19.8) 100.0 (-19.8) 0.0 (nan) 100.0 (-19.8) 100.0 (-19.8) 100.0 (-19.8) 86.3 (-25.6)
Promedas_18 100.0 (-24.4) 99.0 (-24.9) 0.0 (nan) 100.0 (-24.4) 100.0 (-24.4) 100.0 (-24.4) 0.0 (nan)
Promedas_19 100.0 (-26.1) 97.6 (-27.9) 0.0 (nan) 100.0 (-26.1) 100.0 (-26.1) 100.0 (-26.1) 32.3 (-74.7)
Promedas_20 100.0 (-12.2) 97.3 (-13.3) 42.3 (-36.3) 100.0 (-12.2) 100.0 (-12.2) 100.0 (-12.2) 16.4 (-47.1)
Promedas_21 100.0 (-17.4) 99.9 (-17.5) 57.3 (-40.2) 100.0 (-17.4) 100.0 (-17.4) 100.0 (-17.4) 15.6 (-62.4)
Promedas_22 100.0 (-16.1) 99.8 (-16.2) 0.0 (nan) 100.0 (-16.1) 100.0 (-16.1) 100.0 (-16.1) 47.3 (-43.0)
Promedas_23 100.0 (-23.5) 97.5 (-24.7) 0.0 (nan) 100.0 (-23.5) 100.0 (-23.5) 100.0 (-23.5) 34.4 (-56.6)
Promedas_24 100.0 (-12.5) 100.0 (-12.5) 91.5 (-14.8) 100.0 (-12.5) 100.0 (-12.5) 100.0 (-12.5) 51.9 (-25.4)
Promedas_25 100.0 (-14.7) 100.0 (-14.7) 73.6 (-23.1) 100.0 (-14.7) 100.0 (-14.7) 100.0 (-14.7) 39.0 (-34.1)
Promedas_26 100.0 (-19.2) 99.1 (-19.6) 0.0 (nan) 100.0 (-19.2) 100.0 (-19.2) 100.0 (-19.2) 0.0 (nan)
Promedas_27 100.0 (-10.0) 99.4 (-10.2) 76.0 (-16.8) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 47.9 (-24.8)
Promedas_28 100.0 (-6.0) 100.0 (-6.0) 68.1 (-15.8) 100.0 (-6.0) 100.0 (-6.0) 100.0 (-6.0) 0.0 (nan)
Promedas_29 100.0 (-19.8) 99.1 (-20.1) 89.1 (-23.7) 100.0 (-19.8) 100.0 (-19.8) 100.0 (-19.8) 44.0 (-39.9)
Promedas_30 100.0 (-10.4) 100.0 (-10.4) 0.0 (nan) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 39.5 (-35.8)
Promedas_31 100.0 (-12.2) 99.1 (-12.5) 84.5 (-18.0) 100.0 (-12.2) 100.0 (-12.2) 100.0 (-12.2) 77.2 (-20.8)
Promedas_32 100.0 (-13.9) 100.0 (-13.9) 0.0 (nan) 100.0 (-13.9) 100.0 (-13.9) 100.0 (-13.9) 0.0 (nan)
Promedas_33 100.0 (-14.0) 100.0 (-14.0) 95.3 (-15.9) 100.0 (-14.0) 100.0 (-14.0) 100.0 (-14.0) 61.3 (-29.7)
Promedas_34 100.0 (-17.0) 100.0 (-17.0) 88.1 (-21.2) 100.0 (-17.0) 100.0 (-17.0) 100.0 (-17.0) 46.6 (-36.0)
Promedas_35 100.0 (-11.3) 100.0 (-11.3) 95.6 (-12.1) 100.0 (-11.3) 100.0 (-11.3) 100.0 (-11.3) 14.3 (-27.7)
Promedas_36 100.0 (-8.2) 100.0 (-8.2) 56.1 (-17.5) 100.0 (-8.2) 100.0 (-8.2) 100.0 (-8.2) 0.0 (-29.7)
Promedas_37 100.0 (-15.4) 100.0 (-15.4) 84.9 (-20.3) 100.0 (-15.4) 100.0 (-15.4) 100.0 (-15.4) 14.0 (-43.2)
Promedas_38 100.0 (-12.1) 100.0 (-12.1) 99.0 (-12.4) 100.0 (-12.1) 100.0 (-12.1) 100.0 (-12.1) 47.5 (-26.8)
Promedas_39 100.0 (-20.7) 99.1 (-21.0) 89.7 (-24.1) 100.0 (-20.7) 100.0 (-20.7) 100.0 (-20.7) 68.3 (-31.1)
Promedas_40 100.0 (-7.3) 94.7 (-8.3) 81.8 (-10.9) 100.0 (-7.3) 100.0 (-7.3) 100.0 (-7.3) 38.6 (-19.3)
Promedas_41 100.0 (-9.7) 100.0 (-9.7) 97.4 (-10.4) 100.0 (-9.7) 100.0 (-9.7) 100.0 (-9.7) 63.8 (-19.4)
Promedas_42 100.0 (-12.8) 100.0 (-12.8) 95.2 (-14.3) 100.0 (-12.8) 100.0 (-12.8) 100.0 (-12.8) 24.6 (-37.5)
Promedas_43 100.0 (-7.5) 100.0 (-7.5) 91.0 (-9.2) 100.0 (-7.5) 100.0 (-7.5) 100.0 (-7.5) 23.1 (-21.4)
Promedas_44 100.0 (-9.3) 100.0 (-9.3) 58.7 (-21.9) 100.0 (-9.3) 100.0 (-9.3) 100.0 (-9.3) 0.0 (nan)
Promedas_45 100.0 (-7.5) 100.0 (-7.5) 97.6 (-8.0) 100.0 (-7.5) 100.0 (-7.5) 100.0 (-7.5) 86.7 (-10.1)
Promedas_46 100.0 (-12.8) 100.0 (-12.8) 89.3 (-16.1) 100.0 (-12.8) 100.0 (-12.8) 100.0 (-12.8) 53.8 (-26.9)
Promedas_47 100.0 (-14.0) 100.0 (-14.0) 99.3 (-14.2) 100.0 (-14.0) 100.0 (-14.0) 100.0 (-14.0) 92.7 (-16.5)
Promedas_48 100.0 (-10.8) 100.0 (-10.8) 0.0 (nan) 100.0 (-10.8) 100.0 (-10.8) 100.0 (-10.8) 17.9 (-28.3)
Promedas_49 100.0 (-8.4) 100.0 (-8.4) 69.9 (-15.6) 100.0 (-8.4) 100.0 (-8.4) 100.0 (-8.4) 69.4 (-15.7)
Promedas_50 100.0 (-9.0) 100.0 (-9.0) 99.0 (-9.2) 100.0 (-9.0) 100.0 (-9.0) 100.0 (-9.0) 15.7 (-23.6)
Promedas_51 100.0 (-12.3) 100.0 (-12.3) 97.3 (-12.9) 100.0 (-12.3) 100.0 (-12.3) 100.0 (-12.3) 76.9 (-17.6)
Promedas_52 100.0 (-10.8) 100.0 (-10.8) 0.0 (nan) 100.0 (-10.8) 100.0 (-10.8) 100.0 (-10.8) 0.0 (nan)
Promedas_53 100.0 (-9.1) 100.0 (-9.1) 0.0 (nan) 100.0 (-9.1) 100.0 (-9.1) 100.0 (-9.1) 20.5 (-28.0)
Promedas_54 100.0 (-10.3) 100.0 (-10.3) 100.0 (-10.3) 100.0 (-10.3) 100.0 (-10.3) 100.0 (-10.3) 75.9 (-14.8)
Promedas_55 100.0 (-12.7) 100.0 (-12.7) 100.0 (-12.7) 100.0 (-12.7) 100.0 (-12.7) 100.0 (-12.7) 25.9 (-26.5)
Promedas_56 100.0 (-10.8) 100.0 (-10.8) 100.0 (-10.8) 100.0 (-10.8) 100.0 (-10.8) 100.0 (-10.8) 91.8 (-12.7)
Promedas_57 100.0 (-10.4) 100.0 (-10.4) 99.6 (-10.6) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 86.3 (-15.5)
Promedas_58 100.0 (-19.9) 100.0 (-19.9) 100.0 (-19.9) 100.0 (-19.9) 100.0 (-19.9) 100.0 (-19.9) 12.8 (-60.0)
Promedas_59 100.0 (-10.6) 100.0 (-10.6) 94.5 (-11.6) 100.0 (-10.6) 100.0 (-10.6) 100.0 (-10.6) 34.8 (-23.5)
Promedas_60 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0) 55.4 (-19.1)
Promedas_61 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9) 73.3 (-10.8)
Promedas_62 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7) 92.2 (-6.3)
Promedas_63 100.0 (-6.1) 100.0 (-6.1) 52.8 (-12.8) 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1) 67.7 (-10.7)
Promedas_64 100.0 (-11.5) 100.0 (-11.5) 76.5 (-15.0) 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5) 86.7 (-13.5)
Promedas_65 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2) 46.1 (-15.0)
Promedas_66 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4) 74.6 (-14.5)
Promedas_67 100.0 (-13.4) 100.0 (-13.4) 0.0 (nan) 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4) 0.0 (nan)
Promedas_68 100.0 (-18.9) 100.0 (-18.9) 95.9 (-20.4) 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9) 30.3 (-44.7)
Promedas_69 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2) 5.0 (-23.3)
Promedas_70 100.0 (-4.1) 100.0 (-4.1) 39.0 (-8.9) 100.0 (-4.1) 100.0 (-4.1) 100.0 (-4.1) 51.6 (-7.9)
Promedas_71 100.0 (-6.0) 100.0 (-6.0) 91.6 (-7.5) 100.0 (-6.0) 100.0 (-6.0) 100.0 (-6.0) 87.5 (-8.3)
ProteinFolding_11 100.0 (1961.8) 100.0 (1961.8) 100.0 (1961.8) 100.0 (1961.8) 99.6 (1959.0) 97.6 (1944.4) 65.5 (1709.4)
ProteinFolding_12 100.0 (-1547.1) 100.0 (-1547.1) 100.0 (-1547.1) 100.0 (-1547.1) 100.0 (-1547.1) 100.0 (-1547.1) 100.0 (-1547.1)
ProteinFolding_13 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3)
ProteinFolding_14 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7)
ProteinFolding_15 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6)
ProteinFolding_16 100.0 (-855.5) 100.0 (-855.5) 100.0 (-855.5) 100.0 (-855.5) 100.0 (-855.5) 100.0 (-855.5) 100.0 (-855.5)
ProteinFolding_17 100.0 (16544.2) 100.0 (16544.2) 3.4 (9024.0) 100.0 (16544.2) 100.0 (16544.2) 100.0 (16544.2) 0.0 (7141.5)
ProteinFolding_18 100.0 (18606.3) 88.0 (17492.9) 79.6 (16705.1) 100.0 (18606.3) 100.0 (18606.3) 100.0 (18606.3) 8.6 (10102.6)
ProteinFolding_19 72.1 (2448.7) 83.8 (2545.1) 60.1 (2350.1) 100.0 (2678.5) 100.0 (2678.5) 100.0 (2678.5) 62.0 (2365.7)
ProteinFolding_20 99.9 (5577.3) 100.0 (5578.7) 24.8 (4484.1) 100.0 (5578.7) 100.0 (5578.7) 100.0 (5578.7) 0.0 (3729.9)
ProteinFolding_21 100.0 (7958.7) 85.8 (7880.7) 0.0 (7101.0) 100.0 (7958.7) 100.0 (7958.7) 100.0 (7958.7) 0.0 (3190.3)
ProteinFolding_22 100.0 (10547.2) 100.0 (10547.2) 63.3 (10346.3) 100.0 (10547.2) 100.0 (10547.2) 100.0 (10547.2) 0.0 (5678.5)
ProteinFolding_23 93.0 (4215.1) 70.1 (4004.2) 10.3 (3455.8) 100.0 (4279.1) 100.0 (4279.1) 99.7 (4276.5) 82.4 (4117.9)
ProteinFolding_24 98.1 (5868.8) 99.5 (5892.9) 36.3 (4866.5) 100.0 (5900.4) 100.0 (5900.4) 100.0 (5900.4) 0.0 (4241.3)
ProteinFolding_25 100.0 (8656.3) 100.0 (8656.3) 20.0 (6887.6) 100.0 (8656.3) 100.0 (8656.3) 100.0 (8656.3) 0.0 (3879.1)
Segmentation_11 100.0 (-135.8) 100.0 (-135.8) 100.0 (-135.8) 100.0 (-135.8) 100.0 (-135.8) 100.0 (-135.8) 100.0 (-135.8)
Segmentation_12 100.0 (-22.2) 100.0 (-22.2) 100.0 (-22.2) 100.0 (-22.2) 100.0 (-22.2) 100.0 (-22.2) 100.0 (-22.2)
Segmentation_13 100.0 (-21.7) 100.0 (-21.7) 100.0 (-21.7) 100.0 (-21.7) 100.0 (-21.7) 100.0 (-21.7) 100.0 (-21.7)
Segmentation_14 100.0 (-40.1) 100.0 (-40.1) 100.0 (-40.1) 100.0 (-40.1) 100.0 (-40.1) 100.0 (-40.1) 100.0 (-40.1)
Segmentation_15 100.0 (-165.2) 100.0 (-165.2) 100.0 (-165.2) 100.0 (-165.2) 100.0 (-165.2) 100.0 (-165.2) 100.0 (-165.2)
Segmentation_16 100.0 (-41.3) 100.0 (-41.3) 100.0 (-41.3) 100.0 (-41.3) 100.0 (-41.3) 100.0 (-41.3) 100.0 (-41.3)
Segmentation_17 100.0 (-176.8) 100.0 (-176.8) 100.0 (-176.8) 100.0 (-176.8) 100.0 (-176.8) 100.0 (-176.8) 100.0 (-176.8)
Segmentation_18 100.0 (-35.9) 100.0 (-35.9) 100.0 (-35.9) 100.0 (-35.9) 100.0 (-35.9) 100.0 (-35.9) 100.0 (-35.9)
Segmentation_19 100.0 (-25.5) 100.0 (-25.5) 100.0 (-25.5) 100.0 (-25.5) 100.0 (-25.5) 100.0 (-25.5) 100.0 (-25.5)
Segmentation_20 100.0 (-113.9) 100.0 (-113.9) 100.0 (-113.9) 100.0 (-113.9) 100.0 (-113.9) 100.0 (-113.9) 100.0 (-113.9)
wcsp_11 100.0 (-3.3) 44.5 (-3.4) 22.3 (-3.4) 100.0 (-3.3) 88.9 (-3.3) 100.0 (-3.3) 0.0 (-3.5)
wcsp_12 99.9 (-2.6) 99.7 (-2.6) 69.8 (-2.9) 100.0 (-2.6) 99.9 (-2.6) 100.0 (-2.6) 89.5 (-2.7)
wcsp_13 100.0 (-0.2) 100.0 (-0.2) 100.0 (-0.2) 91.0 (-12.1) 94.0 (-8.1) 94.0 (-8.1) 91.1 (-12.0)
wcsp_14 100.0 (-0.1) 90.7 (-12.1) 87.6 (-16.0) 87.6 (-16.1) 87.6 (-16.1) 87.6 (-16.1) 78.2 (-28.0)
wcsp_15 100.0 (-76.0) 96.6 (-80.0) 17.2 (-172.0) 100.0 (-76.0) 96.6 (-80.0) 93.1 (-84.0) 20.7 (-168.0)
wcsp_16 100.0 (-16.5) 78.9 (-37.0) 95.3 (-21.1) 100.0 (-16.5) 100.0 (-16.5) 100.0 (-16.5) 91.9 (-24.4)
wcsp_17 99.6 (-13.2) 84.5 (-43.1) 76.0 (-59.8) 100.0 (-12.3) 100.0 (-12.3) 100.0 (-12.3) 84.3 (-43.4)
wcsp_18 100.0 (-0.1) 58.9 (-28.0) 76.6 (-16.0) 58.9 (-28.0) 58.9 (-28.0) 58.9 (-28.0) 53.0 (-32.0)

Updated: