The results below are organized as follows:

  • each table below displays various solvers’ performance for individual problem instances for the given task and time limit
  • table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria

overall

20sec

Problem Abstraction-Sampling ibia-pr lbp uai14-pr wmbsearch-aobfs-pr
Alchemy_11 99.8 (606.3) 100.0 (606.3) 0.0 (nan) 100.0 (606.3) 100.0 (606.3)
CSP_11 100.0 (13.6) 100.0 (13.6) 0.0 (nan) 99.8 (13.6) 100.0 (13.6)
CSP_12 100.0 (16.5) 100.0 (16.5) 86.2 (17.3) 100.0 (16.5) 100.0 (16.5)
CSP_13 100.0 (15.3) 100.0 (15.3) 0.0 (nan) 100.0 (15.3) 97.2 (15.7)
DBN_11 99.3 (57.9) 100.0 (58.5) 0.0 (nan) 100.0 (58.5) 100.0 (58.5)
DBN_12 100.0 (63.1) 100.0 (63.1) 0.0 (nan) 100.0 (63.1) 100.0 (63.1)
DBN_13 99.9 (66.4) 100.0 (66.6) 0.0 (nan) 94.3 (73.3) 99.9 (66.7)
DBN_14 100.0 (151.2) 100.0 (151.2) 0.0 (nan) 100.0 (151.2) 100.0 (151.2)
DBN_15 100.0 (152.6) 100.0 (152.6) 0.0 (nan) 100.0 (152.6) 100.0 (152.6)
DBN_16 100.0 (166.1) 100.0 (166.1) 0.0 (nan) 100.0 (166.1) 100.0 (166.1)
Grids_11 99.9 (169.4) 100.0 (169.4) 65.2 (184.9) 100.0 (169.4) 100.0 (169.4)
Grids_12 100.0 (303.1) 100.0 (303.1) 49.8 (349.7) 100.0 (303.1) 100.0 (303.1)
Grids_13 99.4 (332.8) 100.0 (333.3) 64.7 (364.2) 100.0 (333.3) 100.0 (333.3)
Grids_14 99.9 (497.6) 100.0 (497.8) 81.4 (522.2) 100.0 (497.8) 100.0 (497.8)
Grids_15 100.0 (291.7) 100.0 (291.7) 0.0 (nan) 100.0 (291.7) 100.0 (291.7)
Grids_16 99.2 (663.8) 100.0 (665.1) 0.0 (nan) 100.0 (665.1) 100.0 (665.1)
Grids_17 97.7 (1304.6) 100.0 (1312.0) 0.0 (nan) 100.0 (1312.0) 100.0 (1312.0)
Grids_18 97.2 (1949.5) 99.9 (1963.5) 0.0 (nan) 100.0 (1963.0) 100.0 (1963.0)
ObjectDetection_11 100.0 (-74.9) 100.0 (-74.9) 0.0 (nan) 99.9 (-74.9) 0.0 (nan)
ObjectDetection_12 99.8 (-67.4) 100.0 (-67.4) 0.0 (nan) 100.0 (-67.4) 0.0 (nan)
ObjectDetection_13 99.9 (-70.4) 99.3 (-70.4) 0.0 (nan) 98.5 (-70.4) 0.0 (nan)
ObjectDetection_14 100.0 (-64.1) 99.1 (-64.1) 0.0 (nan) 96.9 (-64.2) 0.0 (nan)
ObjectDetection_15 100.0 (-51.9) 100.0 (-51.9) 0.0 (nan) 98.9 (-51.9) 0.0 (nan)
ObjectDetection_16 100.0 (-34.4) 99.4 (-34.4) 0.0 (nan) 98.7 (-34.4) 0.0 (nan)
ObjectDetection_17 100.0 (-29.8) 99.4 (-29.8) 0.0 (nan) 97.5 (-29.8) 0.0 (nan)
ObjectDetection_18 99.9 (-37.1) 100.0 (-37.0) 0.0 (nan) 100.0 (-37.0) 0.0 (nan)
ObjectDetection_19 99.4 (-38.4) 95.3 (-38.5) 0.0 (nan) 70.7 (-39.0) 0.0 (nan)
ObjectDetection_20 99.9 (-34.8) 97.9 (-34.9) 0.0 (nan) 78.7 (-35.3) 0.0 (nan)
ObjectDetection_21 100.0 (-24.4) 100.0 (-24.4) 0.0 (nan) 96.7 (-24.4) 0.0 (nan)
ObjectDetection_22 100.0 (-36.7) 100.0 (-36.7) 0.0 (nan) 100.0 (-36.7) 0.0 (nan)
ObjectDetection_23 100.0 (-31.6) 99.2 (-31.6) 0.0 (nan) 98.3 (-31.6) 0.0 (nan)
ObjectDetection_24 100.0 (-26.4) 99.2 (-26.4) 0.0 (nan) 96.6 (-26.4) 0.0 (nan)
ObjectDetection_25 100.0 (-18.7) 100.0 (-18.7) 0.0 (nan) 99.0 (-18.7) 0.0 (nan)
ObjectDetection_26 99.9 (-33.8) 99.1 (-33.8) 0.0 (nan) 97.7 (-33.8) 0.0 (nan)
ObjectDetection_27 99.8 (-29.9) 99.3 (-29.9) 0.0 (nan) 97.1 (-29.9) 0.0 (nan)
ObjectDetection_28 100.0 (-46.8) 99.9 (-46.8) 0.0 (nan) 100.0 (-46.8) 0.0 (nan)
ObjectDetection_29 100.0 (-50.8) 100.0 (-50.8) 0.0 (nan) 99.9 (-50.8) 0.0 (nan)
ObjectDetection_30 99.9 (-52.4) 100.0 (-52.4) 0.0 (nan) 98.8 (-52.4) 0.0 (nan)
ObjectDetection_31 100.0 (-44.1) 100.0 (-44.1) 0.0 (nan) 99.0 (-44.1) 0.0 (nan)
ObjectDetection_32 99.9 (-46.7) 100.0 (-46.7) 0.0 (nan) 100.0 (-46.7) 0.0 (nan)
ObjectDetection_33 99.9 (-44.1) 100.0 (-44.1) 0.0 (nan) 98.2 (-44.1) 0.0 (nan)
ObjectDetection_34 100.0 (-35.4) 100.0 (-35.4) 0.0 (nan) 100.0 (-35.4) 0.0 (nan)
ObjectDetection_35 100.0 (-37.6) 100.0 (-37.6) 0.0 (nan) 99.9 (-37.6) 0.0 (nan)
ObjectDetection_36 99.8 (-30.7) 100.0 (-30.7) 0.0 (nan) 99.8 (-30.7) 0.0 (nan)
ObjectDetection_37 99.8 (-30.0) 100.0 (-30.0) 0.0 (nan) 99.5 (-30.0) 0.0 (nan)
ObjectDetection_38 100.0 (-75.1) 100.0 (-75.1) 0.0 (nan) 100.0 (-75.1) 0.0 (nan)
ObjectDetection_39 99.9 (-70.2) 100.0 (-70.2) 0.0 (nan) 99.9 (-70.2) 0.0 (nan)
ObjectDetection_40 99.9 (-72.3) 100.0 (-72.3) 0.0 (nan) 100.0 (-72.3) 0.0 (nan)
ObjectDetection_41 99.9 (-71.1) 100.0 (-71.1) 0.0 (nan) 0.0 (-73.6) 0.0 (nan)
ObjectDetection_42 100.0 (-45.2) 100.0 (-45.2) 0.0 (nan) 100.0 (-45.2) 0.0 (nan)
ObjectDetection_43 100.0 (-39.5) 100.0 (-39.5) 0.0 (nan) 99.9 (-39.5) 0.0 (nan)
ObjectDetection_44 100.0 (-41.0) 100.0 (-41.0) 0.0 (nan) 100.0 (-41.0) 0.0 (nan)
ObjectDetection_45 99.9 (-38.9) 100.0 (-38.9) 0.0 (nan) 99.5 (-38.9) 0.0 (nan)
ObjectDetection_46 100.0 (-42.0) 100.0 (-42.0) 0.0 (nan) 100.0 (-42.0) 0.0 (nan)
ObjectDetection_47 100.0 (-44.7) 100.0 (-44.7) 0.0 (nan) 99.9 (-44.7) 0.0 (nan)
ObjectDetection_48 99.9 (-36.6) 100.0 (-36.6) 0.0 (nan) 100.0 (-36.6) 0.0 (nan)
ObjectDetection_49 99.9 (-38.7) 100.0 (-38.7) 0.0 (nan) 100.0 (-38.7) 0.0 (nan)
ObjectDetection_50 100.0 (-36.1) 100.0 (-36.1) 0.0 (nan) 33.5 (-37.1) 0.0 (nan)
ObjectDetection_51 100.0 (-53.4) 100.0 (-53.4) 0.0 (nan) 100.0 (-53.4) 0.0 (nan)
ObjectDetection_52 100.0 (-57.0) 100.0 (-57.0) 0.0 (nan) 100.0 (-57.0) 0.0 (nan)
ObjectDetection_53 99.9 (-47.7) 100.0 (-47.7) 0.0 (nan) 99.9 (-47.7) 0.0 (nan)
ObjectDetection_54 100.0 (-41.5) 100.0 (-41.5) 0.0 (nan) 100.0 (-41.5) 0.0 (nan)
ObjectDetection_55 100.0 (-34.1) 100.0 (-34.1) 0.0 (nan) 99.9 (-34.1) 0.0 (nan)
ObjectDetection_56 99.9 (-36.3) 100.0 (-36.3) 0.0 (nan) 100.0 (-36.3) 0.0 (nan)
ObjectDetection_57 100.0 (-33.4) 100.0 (-33.4) 0.0 (nan) 99.4 (-33.4) 0.0 (nan)
ObjectDetection_58 100.0 (-41.7) 100.0 (-41.7) 0.0 (nan) 100.0 (-41.7) 0.0 (nan)
ObjectDetection_59 99.9 (-35.9) 100.0 (-35.9) 0.0 (nan) 100.0 (-35.9) 0.0 (nan)
ObjectDetection_60 99.9 (-35.3) 100.0 (-35.3) 0.0 (nan) 97.1 (-35.3) 0.0 (nan)
ObjectDetection_61 100.0 (-23.2) 100.0 (-23.2) 0.0 (nan) 100.0 (-23.2) 0.0 (nan)
ObjectDetection_62 100.0 (-24.8) 100.0 (-24.8) 0.0 (nan) 100.0 (-24.8) 0.0 (nan)
ObjectDetection_63 99.9 (-19.9) 100.0 (-19.9) 0.0 (nan) 99.9 (-19.9) 0.0 (nan)
ObjectDetection_64 100.0 (-21.3) 100.0 (-21.3) 0.0 (nan) 100.0 (-21.3) 0.0 (nan)
ObjectDetection_65 100.0 (-19.7) 100.0 (-19.7) 0.0 (nan) 99.6 (-19.7) 0.0 (nan)
ObjectDetection_66 100.0 (-47.0) 100.0 (-47.0) 0.0 (nan) 100.0 (-47.0) 0.0 (nan)
ObjectDetection_67 100.0 (-40.6) 100.0 (-40.6) 0.0 (nan) 100.0 (-40.6) 0.0 (nan)
ObjectDetection_68 99.9 (-42.7) 100.0 (-42.7) 0.0 (nan) 100.0 (-42.7) 0.0 (nan)
ObjectDetection_69 99.9 (-40.3) 100.0 (-40.3) 0.0 (nan) 99.4 (-40.3) 0.0 (nan)
ObjectDetection_70 100.0 (-31.2) 100.0 (-31.2) 96.6 (-31.3) 100.0 (-31.2) 0.0 (nan)
ObjectDetection_71 99.9 (-33.6) 100.0 (-33.6) 0.0 (nan) 99.9 (-33.6) 0.0 (nan)
ObjectDetection_72 99.6 (-26.4) 100.0 (-26.4) 0.0 (nan) 100.0 (-26.4) 0.0 (nan)
ObjectDetection_73 99.8 (-25.6) 100.0 (-25.6) 0.0 (nan) 94.7 (-25.7) 0.0 (nan)
ObjectDetection_74 100.0 (-31.8) 100.0 (-31.8) 0.0 (nan) 100.0 (-31.8) 0.0 (nan)
ObjectDetection_75 100.0 (-33.8) 100.0 (-33.8) 0.0 (nan) 100.0 (-33.8) 0.0 (nan)
Pedigree_11 100.0 (-17.2) 100.0 (-17.2) 0.0 (nan) 100.0 (-17.2) 0.0 (nan)
Pedigree_12 100.0 (-11.5) 100.0 (-11.5) 0.0 (nan) 100.0 (-11.5) 0.0 (nan)
Pedigree_13 100.0 (-15.2) 100.0 (-15.2) 0.0 (nan) 100.0 (-15.2) 0.0 (nan)
Promedus_11 100.0 (-8.4) 100.0 (-8.4) 0.0 (nan) 100.0 (-8.4) 0.0 (nan)
Promedus_12 97.9 (-3.2) 100.0 (-3.2) 0.0 (nan) 100.0 (-3.2) 0.0 (nan)
Promedus_13 100.0 (-4.5) 100.0 (-4.5) 0.0 (nan) 100.0 (-4.5) 100.0 (-4.5)
Promedus_14 99.4 (-7.8) 100.0 (-7.8) 96.6 (-8.0) 99.7 (-7.8) 0.0 (nan)
Promedus_15 100.0 (-3.6) 100.0 (-3.6) 91.4 (-3.8) 100.0 (-3.6) 100.0 (-3.6)
Promedus_16 100.0 (-7.0) 100.0 (-7.0) 0.0 (nan) 100.0 (-7.0) 100.0 (-7.0)
Promedus_17 99.6 (-9.4) 100.0 (-9.5) 0.0 (nan) 100.0 (-9.5) 0.0 (nan)
Promedus_18 99.8 (-4.7) 99.9 (-4.7) 0.0 (nan) 100.0 (-4.7) 0.0 (nan)
Promedus_19 99.4 (-4.3) 99.9 (-4.3) 0.0 (nan) 100.0 (-4.3) 0.0 (nan)
Promedus_20 91.7 (-7.4) 100.0 (-7.1) 0.0 (nan) 100.0 (-7.1) 0.0 (nan)
Promedus_21 100.0 (-5.6) 100.0 (-5.6) 0.0 (nan) 100.0 (-5.6) 100.0 (-5.6)
Promedus_22 100.0 (-2.5) 100.0 (-2.5) 93.1 (-2.6) 100.0 (-2.5) 100.0 (-2.5)
Promedus_23 99.9 (-11.3) 100.0 (-11.3) 0.0 (nan) 100.0 (-11.3) 0.0 (nan)
Promedus_24 100.0 (-5.9) 100.0 (-5.9) 0.0 (nan) 100.0 (-5.9) 100.0 (-5.9)
Promedus_25 98.6 (-9.4) 100.0 (-9.4) 0.0 (nan) 100.0 (-9.4) 0.0 (nan)
Promedus_26 100.0 (-7.3) 100.0 (-7.3) 0.0 (nan) 100.0 (-7.3) 100.0 (-7.3)
Promedus_27 100.0 (-8.1) 100.0 (-8.1) 91.4 (-8.4) 100.0 (-8.1) 0.0 (nan)
Promedus_28 100.0 (-8.1) 100.0 (-8.1) 0.0 (nan) 100.0 (-8.1) 0.0 (nan)
Promedus_29 100.0 (-10.5) 100.0 (-10.5) 99.2 (-10.5) 100.0 (-10.5) 100.0 (-10.5)
Promedus_30 100.0 (-22.1) 100.0 (-22.1) 95.3 (-22.2) 100.0 (-22.1) 100.0 (-22.1)
Promedus_31 100.0 (-1.8) 100.0 (-1.8) 0.0 (nan) 100.0 (-1.8) 100.0 (-1.8)
Promedus_32 100.0 (-2.2) 100.0 (-2.2) 0.0 (nan) 100.0 (-2.2) 100.0 (-2.2)
Promedus_33 100.0 (-2.8) 100.0 (-2.8) 0.0 (nan) 100.0 (-2.8) 100.0 (-2.8)
Promedus_34 100.0 (-3.1) 100.0 (-3.1) 0.0 (nan) 100.0 (-3.1) 0.0 (nan)
Promedus_35 100.0 (-1.7) 100.0 (-1.7) 88.6 (-1.9) 100.0 (-1.7) 100.0 (-1.7)
Promedus_36 100.0 (-1.7) 100.0 (-1.7) 0.0 (nan) 100.0 (-1.7) 100.0 (-1.7)
Promedus_37 95.9 (-4.3) 100.0 (-4.2) 0.0 (nan) 100.0 (-4.2) 0.0 (nan)
Promedus_38 93.1 (-5.3) 100.0 (-5.0) 0.0 (nan) 100.0 (-5.0) 0.0 (nan)
Segmentation_11 100.0 (-24.0) 100.0 (-24.0) 0.0 (nan) 100.0 (-24.0) 100.0 (-24.0)
Segmentation_12 100.0 (-10.3) 100.0 (-10.3) 0.0 (nan) 0.0 (nan) 100.0 (-10.3)
Segmentation_13 100.0 (-33.4) 100.0 (-33.4) 0.0 (nan) 100.0 (-33.4) 100.0 (-33.4)
Segmentation_14 100.0 (-39.5) 100.0 (-39.5) 0.0 (nan) 100.0 (-39.5) 100.0 (-39.5)
Segmentation_15 100.0 (-26.2) 100.0 (-26.2) 0.0 (nan) 100.0 (-26.2) 100.0 (-26.2)
Segmentation_16 100.0 (-38.1) 100.0 (-38.1) 0.0 (nan) 100.0 (-38.1) 100.0 (-38.1)
grid10x10.f10 100.0 (303.1) 100.0 (303.1) 49.8 (349.7) 100.0 (303.1) 100.0 (303.1)
linkage_12 99.7 (-69.5) 99.9 (-69.6) 0.0 (nan) 99.9 (-69.6) 0.0 (nan)
linkage_13 99.5 (-76.4) 99.9 (-76.0) 0.0 (nan) 99.8 (-75.9) 0.0 (nan)
linkage_14 99.9 (-30.8) 99.7 (-30.8) 0.0 (nan) 98.2 (-31.0) 0.0 (nan)
linkage_16 100.0 (-38.6) 100.0 (-38.6) 0.0 (nan) 99.9 (-38.5) 0.0 (nan)
linkage_18 99.9 (-78.5) 99.9 (-78.6) 0.0 (nan) 100.0 (-78.5) 0.0 (nan)
linkage_19 98.7 (-59.8) 99.9 (-59.1) 0.0 (nan) 99.4 (-58.7) 0.0 (nan)
linkage_21 100.0 (-29.6) 99.9 (-29.7) 0.0 (nan) 99.4 (-29.8) 0.0 (nan)
linkage_22 99.6 (-54.5) 100.0 (-54.3) 0.0 (nan) 98.8 (-54.8) 0.0 (nan)
linkage_23 99.8 (-116.7) 99.5 (-116.9) 0.0 (nan) 99.7 (-116.8) 0.0 (nan)
linkage_24 100.0 (-83.7) 100.0 (-83.7) 0.0 (nan) 100.0 (-83.7) 0.0 (nan)
linkage_26 100.0 (-115.8) 100.0 (-115.8) 0.0 (nan) 100.0 (-115.8) 0.0 (nan)
linkage_27 100.0 (-63.5) 99.9 (-63.5) 0.0 (nan) 100.0 (-63.5) 0.0 (nan)

1200sec

Problem Abstraction-Sampling ibia-pr lbp uai14-pr wmbsearch-aobfs-pr
Alchemy_11 100.0 (606.3) 100.0 (606.3) 96.7 (606.3) 100.0 (606.3) 100.0 (606.3)
CSP_11 100.0 (13.6) 100.0 (13.6) 86.3 (14.7) 100.0 (13.6) 100.0 (13.6)
CSP_12 100.0 (16.5) 100.0 (16.5) 86.2 (17.3) 100.0 (16.5) 100.0 (16.5)
CSP_13 100.0 (15.3) 100.0 (15.3) 86.5 (17.0) 100.0 (15.3) 100.0 (15.3)
DBN_11 100.0 (58.5) 100.0 (58.5) 99.9 (58.5) 100.0 (58.5) 100.0 (58.5)
DBN_12 100.0 (63.1) 100.0 (63.1) 100.0 (63.1) 100.0 (63.1) 100.0 (63.1)
DBN_13 100.0 (66.6) 100.0 (66.6) 99.6 (66.1) 100.0 (66.6) 100.0 (66.6)
DBN_14 100.0 (151.2) 100.0 (151.2) 100.0 (151.2) 100.0 (151.2) 100.0 (151.2)
DBN_15 100.0 (152.6) 100.0 (152.6) 80.3 (150.7) 100.0 (152.6) 100.0 (152.6)
DBN_16 100.0 (166.1) 100.0 (166.1) 99.9 (166.1) 100.0 (166.1) 100.0 (166.1)
Grids_11 100.0 (169.4) 100.0 (169.4) 65.2 (184.9) 100.0 (169.4) 100.0 (169.4)
Grids_12 100.0 (303.1) 100.0 (303.1) 49.8 (349.7) 100.0 (303.1) 100.0 (303.1)
Grids_13 100.0 (333.3) 100.0 (333.3) 64.7 (364.2) 100.0 (333.3) 100.0 (333.3)
Grids_14 100.0 (497.8) 100.0 (497.8) 81.4 (522.2) 100.0 (497.8) 100.0 (497.8)
Grids_15 100.0 (291.7) 100.0 (291.7) 95.5 (294.7) 100.0 (291.7) 100.0 (291.7)
Grids_16 100.0 (665.1) 100.0 (665.1) 66.4 (719.3) 100.0 (665.1) 100.0 (665.1)
Grids_17 100.0 (1312.0) 100.0 (1312.0) 50.1 (1471.1) 100.0 (1312.0) 100.0 (1312.0)
Grids_18 100.0 (1963.0) 100.0 (1963.0) 74.5 (2084.4) 100.0 (1963.0) 100.0 (1963.0)
ObjectDetection_11 100.0 (-74.9) 100.0 (-74.9) 94.8 (-75.0) 100.0 (-74.9) 100.0 (-74.9)
ObjectDetection_12 100.0 (-67.4) 100.0 (-67.4) 92.1 (-67.6) 100.0 (-67.4) 100.0 (-67.4)
ObjectDetection_13 100.0 (-70.4) 100.0 (-70.4) 93.1 (-70.6) 100.0 (-70.4) 0.0 (nan)
ObjectDetection_14 100.0 (-64.1) 100.0 (-64.1) 90.9 (-64.3) 100.0 (-64.1) 0.0 (nan)
ObjectDetection_15 100.0 (-51.9) 100.0 (-51.9) 94.6 (-51.9) 100.0 (-51.9) 100.0 (-51.9)
ObjectDetection_16 100.0 (-34.4) 100.0 (-34.4) 93.8 (-34.5) 100.0 (-34.4) 0.0 (nan)
ObjectDetection_17 100.0 (-29.8) 100.0 (-29.8) 93.7 (-29.9) 100.0 (-29.8) 0.0 (nan)
ObjectDetection_18 100.0 (-37.0) 100.0 (-37.0) 85.6 (-37.3) 100.0 (-37.0) 100.0 (-37.0)
ObjectDetection_19 100.0 (-38.5) 100.0 (-38.5) 61.6 (-39.2) 100.0 (-38.5) 0.0 (nan)
ObjectDetection_20 100.0 (-34.8) 100.0 (-34.8) 71.8 (-35.5) 100.0 (-34.8) 0.0 (nan)
ObjectDetection_21 100.0 (-24.4) 100.0 (-24.4) 89.1 (-24.5) 100.0 (-24.4) 100.0 (-24.4)
ObjectDetection_22 100.0 (-36.7) 100.0 (-36.7) 91.3 (-36.8) 100.0 (-36.7) 100.0 (-36.7)
ObjectDetection_23 100.0 (-31.6) 100.0 (-31.6) 92.0 (-31.7) 100.0 (-31.6) 0.0 (nan)
ObjectDetection_24 100.0 (-26.4) 100.0 (-26.4) 92.3 (-26.5) 100.0 (-26.4) 0.0 (nan)
ObjectDetection_25 100.0 (-18.7) 100.0 (-18.7) 96.0 (-18.7) 100.0 (-18.7) 100.0 (-18.7)
ObjectDetection_26 100.0 (-33.8) 100.0 (-33.8) 92.1 (-33.8) 100.0 (-33.8) 0.0 (nan)
ObjectDetection_27 100.0 (-29.9) 100.0 (-29.9) 93.8 (-29.9) 100.0 (-29.9) 0.0 (nan)
ObjectDetection_28 100.0 (-46.8) 99.9 (-46.8) 98.3 (-46.8) 100.0 (-46.8) 0.0 (nan)
ObjectDetection_29 100.0 (-50.8) 100.0 (-50.8) 95.6 (-50.9) 100.0 (-50.8) 0.0 (nan)
ObjectDetection_30 100.0 (-52.4) 100.0 (-52.4) 88.0 (-52.6) 100.0 (-52.4) 0.0 (nan)
ObjectDetection_31 100.0 (-44.1) 100.0 (-44.1) 92.5 (-44.2) 100.0 (-44.1) 0.0 (nan)
ObjectDetection_32 100.0 (-46.7) 100.0 (-46.7) 88.7 (-46.8) 100.0 (-46.7) 100.0 (-46.7)
ObjectDetection_33 100.0 (-44.1) 100.0 (-44.1) 89.2 (-44.2) 100.0 (-44.1) 100.0 (-44.1)
ObjectDetection_34 100.0 (-35.4) 100.0 (-35.4) 98.0 (-35.4) 100.0 (-35.4) 100.0 (-35.4)
ObjectDetection_35 100.0 (-37.6) 100.0 (-37.6) 97.2 (-37.6) 100.0 (-37.6) 0.0 (nan)
ObjectDetection_36 100.0 (-30.7) 100.0 (-30.7) 97.3 (-30.7) 100.0 (-30.7) 0.0 (nan)
ObjectDetection_37 100.0 (-30.0) 100.0 (-30.0) 96.1 (-30.0) 100.0 (-30.0) 100.0 (-30.0)
ObjectDetection_38 100.0 (-75.1) 100.0 (-75.1) 96.3 (-75.1) 100.0 (-75.1) 0.0 (nan)
ObjectDetection_39 100.0 (-70.2) 100.0 (-70.2) 95.1 (-70.3) 100.0 (-70.2) 0.0 (nan)
ObjectDetection_40 100.0 (-72.3) 100.0 (-72.3) 95.2 (-72.4) 100.0 (-72.3) 100.0 (-72.3)
ObjectDetection_41 100.0 (-71.1) 100.0 (-71.1) 0.0 (-73.7) 100.0 (-71.1) 100.0 (-71.1)
ObjectDetection_42 100.0 (-45.2) 100.0 (-45.2) 97.3 (-45.2) 100.0 (-45.2) 0.0 (nan)
ObjectDetection_43 100.0 (-39.5) 100.0 (-39.5) 95.7 (-39.5) 100.0 (-39.5) 0.0 (nan)
ObjectDetection_44 100.0 (-41.0) 100.0 (-41.0) 94.7 (-41.1) 100.0 (-41.0) 100.0 (-41.0)
ObjectDetection_45 100.0 (-38.9) 100.0 (-38.9) 94.6 (-39.0) 100.0 (-38.9) 100.0 (-38.9)
ObjectDetection_46 100.0 (-42.0) 100.0 (-42.0) 0.0 (-43.0) 100.0 (-42.0) 100.0 (-42.0)
ObjectDetection_47 100.0 (-44.7) 100.0 (-44.7) 0.0 (-45.8) 100.0 (-44.7) 0.0 (nan)
ObjectDetection_48 100.0 (-36.6) 100.0 (-36.6) 0.0 (-38.0) 100.0 (-36.6) 0.0 (nan)
ObjectDetection_49 100.0 (-38.7) 100.0 (-38.7) 0.0 (-40.1) 100.0 (-38.7) 100.0 (-38.7)
ObjectDetection_50 100.0 (-36.1) 100.0 (-36.1) 32.2 (-37.1) 100.0 (-36.1) 100.0 (-36.1)
ObjectDetection_51 100.0 (-53.4) 100.0 (-53.4) 97.6 (-53.4) 100.0 (-53.4) 100.0 (-53.4)
ObjectDetection_52 100.0 (-57.0) 100.0 (-57.0) 97.4 (-57.0) 100.0 (-57.0) 0.0 (nan)
ObjectDetection_53 100.0 (-47.7) 100.0 (-47.7) 97.5 (-47.8) 100.0 (-47.7) 0.0 (nan)
ObjectDetection_54 100.0 (-41.5) 100.0 (-41.5) 98.2 (-41.5) 100.0 (-41.5) 0.0 (nan)
ObjectDetection_55 100.0 (-34.1) 100.0 (-34.1) 98.2 (-34.1) 100.0 (-34.1) 0.0 (nan)
ObjectDetection_56 100.0 (-36.3) 100.0 (-36.3) 97.9 (-36.3) 100.0 (-36.3) 100.0 (-36.3)
ObjectDetection_57 100.0 (-33.4) 100.0 (-33.4) 97.8 (-33.4) 100.0 (-33.4) 100.0 (-33.4)
ObjectDetection_58 100.0 (-41.7) 100.0 (-41.7) 95.4 (-41.7) 100.0 (-41.7) 0.0 (nan)
ObjectDetection_59 100.0 (-35.9) 100.0 (-35.9) 93.6 (-35.9) 100.0 (-35.9) 0.0 (nan)
ObjectDetection_60 100.0 (-35.3) 100.0 (-35.3) 92.9 (-35.3) 100.0 (-35.3) 100.0 (-35.3)
ObjectDetection_61 100.0 (-23.2) 100.0 (-23.2) 98.4 (-23.2) 100.0 (-23.2) 100.0 (-23.2)
ObjectDetection_62 100.0 (-24.8) 100.0 (-24.8) 98.7 (-24.8) 100.0 (-24.8) 0.0 (nan)
ObjectDetection_63 100.0 (-19.9) 100.0 (-19.9) 98.2 (-19.9) 100.0 (-19.9) 0.0 (nan)
ObjectDetection_64 100.0 (-21.3) 100.0 (-21.3) 98.4 (-21.3) 100.0 (-21.3) 100.0 (-21.3)
ObjectDetection_65 100.0 (-19.7) 100.0 (-19.7) 98.1 (-19.7) 100.0 (-19.7) 100.0 (-19.7)
ObjectDetection_66 100.0 (-47.0) 100.0 (-47.0) 95.9 (-47.1) 100.0 (-47.0) 0.0 (nan)
ObjectDetection_67 100.0 (-40.6) 100.0 (-40.6) 95.3 (-40.7) 100.0 (-40.6) 0.0 (nan)
ObjectDetection_68 100.0 (-42.7) 100.0 (-42.7) 95.6 (-42.7) 100.0 (-42.7) 100.0 (-42.7)
ObjectDetection_69 100.0 (-40.3) 100.0 (-40.3) 95.3 (-40.3) 100.0 (-40.3) 100.0 (-40.3)
ObjectDetection_70 100.0 (-31.2) 100.0 (-31.2) 96.6 (-31.3) 100.0 (-31.2) 100.0 (-31.2)
ObjectDetection_71 100.0 (-33.6) 100.0 (-33.6) 97.3 (-33.7) 100.0 (-33.6) 0.0 (nan)
ObjectDetection_72 100.0 (-26.4) 100.0 (-26.4) 93.0 (-26.5) 100.0 (-26.4) 0.0 (nan)
ObjectDetection_73 100.0 (-25.6) 100.0 (-25.6) 93.1 (-25.7) 100.0 (-25.6) 100.0 (-25.6)
ObjectDetection_74 100.0 (-31.8) 100.0 (-31.8) 98.7 (-31.8) 100.0 (-31.8) 100.0 (-31.8)
ObjectDetection_75 100.0 (-33.8) 100.0 (-33.8) 98.5 (-33.8) 100.0 (-33.8) 0.0 (nan)
Pedigree_11 100.0 (-17.2) 100.0 (-17.2) 96.0 (-18.2) 100.0 (-17.2) 100.0 (-17.2)
Pedigree_12 100.0 (-11.5) 100.0 (-11.5) 96.4 (-12.1) 100.0 (-11.5) 0.0 (nan)
Pedigree_13 100.0 (-15.2) 100.0 (-15.2) 92.5 (-16.7) 100.0 (-15.2) 100.0 (-15.2)
Promedus_11 100.0 (-8.4) 100.0 (-8.4) 96.0 (-8.6) 100.0 (-8.4) 100.0 (-8.4)
Promedus_12 100.0 (-3.2) 100.0 (-3.2) 93.6 (-3.3) 100.0 (-3.2) 100.0 (-3.2)
Promedus_13 100.0 (-4.5) 100.0 (-4.5) 97.4 (-4.6) 100.0 (-4.5) 100.0 (-4.5)
Promedus_14 100.0 (-7.8) 100.0 (-7.8) 96.6 (-8.0) 100.0 (-7.8) 0.0 (nan)
Promedus_15 100.0 (-3.6) 100.0 (-3.6) 91.4 (-3.8) 100.0 (-3.6) 100.0 (-3.6)
Promedus_16 100.0 (-7.0) 100.0 (-7.0) 99.3 (-7.0) 100.0 (-7.0) 100.0 (-7.0)
Promedus_17 100.0 (-9.5) 100.0 (-9.5) 99.6 (-9.5) 100.0 (-9.5) 0.0 (nan)
Promedus_18 100.0 (-4.7) 100.0 (-4.7) 99.9 (-4.7) 100.0 (-4.7) 0.0 (nan)
Promedus_19 100.0 (-4.3) 100.0 (-4.3) 100.0 (-4.3) 100.0 (-4.3) 0.0 (nan)
Promedus_20 100.0 (-7.1) 100.0 (-7.1) 94.1 (-7.3) 100.0 (-7.1) 0.0 (nan)
Promedus_21 100.0 (-5.6) 100.0 (-5.6) 88.9 (-5.8) 100.0 (-5.6) 100.0 (-5.6)
Promedus_22 100.0 (-2.5) 100.0 (-2.5) 93.1 (-2.6) 100.0 (-2.5) 100.0 (-2.5)
Promedus_23 100.0 (-11.3) 100.0 (-11.3) 94.9 (-11.5) 100.0 (-11.3) 100.0 (-11.3)
Promedus_24 100.0 (-5.9) 100.0 (-5.9) 99.8 (-5.9) 100.0 (-5.9) 100.0 (-5.9)
Promedus_25 100.0 (-9.4) 100.0 (-9.4) 98.4 (-9.5) 100.0 (-9.4) 0.0 (nan)
Promedus_26 100.0 (-7.3) 100.0 (-7.3) 98.8 (-7.3) 100.0 (-7.3) 100.0 (-7.3)
Promedus_27 100.0 (-8.1) 100.0 (-8.1) 91.4 (-8.4) 100.0 (-8.1) 0.0 (nan)
Promedus_28 100.0 (-8.1) 100.0 (-8.1) 95.0 (-8.3) 100.0 (-8.1) 100.0 (-8.1)
Promedus_29 100.0 (-10.5) 100.0 (-10.5) 99.2 (-10.5) 100.0 (-10.5) 100.0 (-10.5)
Promedus_30 100.0 (-22.1) 100.0 (-22.1) 95.3 (-22.2) 100.0 (-22.1) 100.0 (-22.1)
Promedus_31 100.0 (-1.8) 100.0 (-1.8) 89.3 (-2.0) 100.0 (-1.8) 100.0 (-1.8)
Promedus_32 100.0 (-2.2) 100.0 (-2.2) 95.4 (-2.3) 100.0 (-2.2) 100.0 (-2.2)
Promedus_33 100.0 (-2.8) 100.0 (-2.8) 99.9 (-2.8) 100.0 (-2.8) 100.0 (-2.8)
Promedus_34 100.0 (-3.1) 100.0 (-3.1) 90.2 (-3.3) 100.0 (-3.1) 100.0 (-3.1)
Promedus_35 100.0 (-1.7) 100.0 (-1.7) 88.6 (-1.9) 100.0 (-1.7) 100.0 (-1.7)
Promedus_36 100.0 (-1.7) 100.0 (-1.7) 88.6 (-1.9) 100.0 (-1.7) 100.0 (-1.7)
Promedus_37 100.0 (-4.2) 100.0 (-4.2) 96.4 (-4.3) 100.0 (-4.2) 0.0 (nan)
Promedus_38 100.0 (-5.0) 100.0 (-5.0) 95.5 (-5.2) 100.0 (-5.0) 0.0 (nan)
Segmentation_11 100.0 (-24.0) 100.0 (-24.0) 88.4 (-25.9) 100.0 (-24.0) 100.0 (-24.0)
Segmentation_12 100.0 (-10.3) 100.0 (-10.3) 100.0 (-10.3) 100.0 (-10.3) 100.0 (-10.3)
Segmentation_13 100.0 (-33.4) 100.0 (-33.4) 94.5 (-34.4) 100.0 (-33.4) 100.0 (-33.4)
Segmentation_14 100.0 (-39.5) 100.0 (-39.5) 99.1 (-39.7) 100.0 (-39.5) 100.0 (-39.5)
Segmentation_15 100.0 (-26.2) 100.0 (-26.2) 49.7 (-31.6) 100.0 (-26.2) 100.0 (-26.2)
Segmentation_16 100.0 (-38.1) 100.0 (-38.1) 98.3 (-38.5) 100.0 (-38.1) 100.0 (-38.1)
grid10x10.f10 100.0 (303.1) 100.0 (303.1) 49.8 (349.7) 100.0 (303.1) 100.0 (303.1)
linkage_12 0.0 (nan) 100.0 (-69.7) 97.4 (-71.7) 100.0 (-69.7) 0.0 (nan)
linkage_13 0.0 (nan) 99.9 (-76.1) 97.9 (-77.3) 99.8 (-76.2) 0.0 (nan)
linkage_14 0.0 (nan) 100.0 (-30.8) 92.6 (-32.0) 100.0 (-30.8) 0.0 (nan)
linkage_16 100.0 (-38.6) 100.0 (-38.6) 82.2 (-41.3) 100.0 (-38.6) 0.0 (nan)
linkage_18 100.0 (-78.5) 99.9 (-78.5) 95.5 (-81.7) 100.0 (-78.5) 0.0 (nan)
linkage_19 100.0 (-59.0) 100.0 (-59.0) 94.1 (-62.6) 99.9 (-58.9) 0.0 (nan)
linkage_21 100.0 (-29.6) 99.9 (-29.7) 93.8 (-31.4) 100.0 (-29.6) 0.0 (nan)
linkage_22 100.0 (-54.3) 99.9 (-54.2) 93.7 (-57.2) 99.9 (-54.3) 0.0 (nan)
linkage_23 0.0 (nan) 99.9 (-116.6) 85.2 (-125.3) 98.5 (-115.7) 0.0 (nan)
linkage_24 100.0 (-83.7) 100.0 (-83.7) 95.0 (-87.0) 100.0 (-83.7) 0.0 (nan)
linkage_26 100.0 (-115.8) 100.0 (-115.8) 95.3 (-118.8) 100.0 (-115.8) 0.0 (nan)
linkage_27 100.0 (-63.5) 100.0 (-63.5) 90.5 (-67.7) 100.0 (-63.5) 0.0 (nan)

3600sec

Problem Abstraction-Sampling ibia-pr lbp uai14-pr wmbsearch-aobfs-pr
Alchemy_11 100.0 (606.3) 100.0 (606.3) 96.7 (606.3) 100.0 (606.3) 100.0 (606.3)
CSP_11 100.0 (13.6) 100.0 (13.6) 86.3 (14.7) 100.0 (13.6) 100.0 (13.6)
CSP_12 100.0 (16.5) 100.0 (16.5) 86.2 (17.3) 100.0 (16.5) 100.0 (16.5)
CSP_13 100.0 (15.3) 100.0 (15.3) 86.5 (17.0) 100.0 (15.3) 100.0 (15.3)
DBN_11 100.0 (58.5) 100.0 (58.5) 99.9 (58.5) 100.0 (58.5) 100.0 (58.5)
DBN_12 100.0 (63.1) 100.0 (63.1) 100.0 (63.1) 100.0 (63.1) 100.0 (63.1)
DBN_13 100.0 (66.6) 100.0 (66.6) 99.6 (66.1) 100.0 (66.6) 100.0 (66.6)
DBN_14 100.0 (151.2) 100.0 (151.2) 100.0 (151.2) 100.0 (151.2) 100.0 (151.2)
DBN_15 100.0 (152.6) 100.0 (152.6) 80.3 (150.7) 100.0 (152.6) 100.0 (152.6)
DBN_16 100.0 (166.1) 100.0 (166.1) 99.9 (166.1) 100.0 (166.1) 100.0 (166.1)
Grids_11 100.0 (169.4) 100.0 (169.4) 65.2 (184.9) 100.0 (169.4) 100.0 (169.4)
Grids_12 100.0 (303.1) 100.0 (303.1) 49.8 (349.7) 100.0 (303.1) 100.0 (303.1)
Grids_13 100.0 (333.3) 100.0 (333.3) 64.7 (364.2) 100.0 (333.3) 100.0 (333.3)
Grids_14 100.0 (497.8) 100.0 (497.8) 81.4 (522.2) 100.0 (497.8) 100.0 (497.8)
Grids_15 100.0 (291.7) 100.0 (291.7) 95.5 (294.7) 100.0 (291.7) 100.0 (291.7)
Grids_16 100.0 (665.1) 100.0 (665.1) 66.4 (719.3) 100.0 (665.1) 100.0 (665.1)
Grids_17 100.0 (1312.0) 100.0 (1312.0) 50.1 (1471.1) 100.0 (1312.0) 100.0 (1312.0)
Grids_18 100.0 (1963.0) 100.0 (1963.0) 74.5 (2084.4) 100.0 (1963.0) 100.0 (1963.0)
ObjectDetection_11 100.0 (-74.9) 100.0 (-74.9) 94.8 (-75.0) 100.0 (-74.9) 100.0 (-74.9)
ObjectDetection_12 100.0 (-67.4) 100.0 (-67.4) 92.1 (-67.6) 100.0 (-67.4) 100.0 (-67.4)
ObjectDetection_13 100.0 (-70.4) 100.0 (-70.4) 93.1 (-70.6) 100.0 (-70.4) 0.0 (nan)
ObjectDetection_14 100.0 (-64.1) 100.0 (-64.1) 90.9 (-64.3) 100.0 (-64.1) 0.0 (nan)
ObjectDetection_15 100.0 (-51.9) 100.0 (-51.9) 94.6 (-51.9) 100.0 (-51.9) 100.0 (-51.9)
ObjectDetection_16 100.0 (-34.4) 100.0 (-34.4) 93.8 (-34.5) 100.0 (-34.4) 0.0 (nan)
ObjectDetection_17 100.0 (-29.8) 100.0 (-29.8) 93.7 (-29.9) 100.0 (-29.8) 0.0 (nan)
ObjectDetection_18 100.0 (-37.0) 100.0 (-37.0) 85.6 (-37.3) 100.0 (-37.0) 100.0 (-37.0)
ObjectDetection_19 100.0 (-38.5) 100.0 (-38.5) 61.6 (-39.2) 100.0 (-38.5) 0.0 (nan)
ObjectDetection_20 100.0 (-34.8) 100.0 (-34.8) 71.8 (-35.5) 100.0 (-34.8) 0.0 (nan)
ObjectDetection_21 100.0 (-24.4) 100.0 (-24.4) 89.1 (-24.5) 100.0 (-24.4) 100.0 (-24.4)
ObjectDetection_22 100.0 (-36.7) 100.0 (-36.7) 91.3 (-36.8) 100.0 (-36.7) 100.0 (-36.7)
ObjectDetection_23 100.0 (-31.6) 100.0 (-31.6) 92.0 (-31.7) 100.0 (-31.6) 0.0 (nan)
ObjectDetection_24 100.0 (-26.4) 100.0 (-26.4) 92.3 (-26.5) 100.0 (-26.4) 0.0 (nan)
ObjectDetection_25 100.0 (-18.7) 100.0 (-18.7) 96.0 (-18.7) 100.0 (-18.7) 100.0 (-18.7)
ObjectDetection_26 100.0 (-33.8) 100.0 (-33.8) 92.1 (-33.8) 100.0 (-33.8) 0.0 (nan)
ObjectDetection_27 100.0 (-29.9) 100.0 (-29.9) 93.8 (-29.9) 100.0 (-29.9) 0.0 (nan)
ObjectDetection_28 100.0 (-46.8) 99.9 (-46.8) 98.3 (-46.8) 100.0 (-46.8) 0.0 (nan)
ObjectDetection_29 100.0 (-50.8) 100.0 (-50.8) 95.6 (-50.9) 100.0 (-50.8) 0.0 (nan)
ObjectDetection_30 100.0 (-52.4) 100.0 (-52.4) 88.0 (-52.6) 100.0 (-52.4) 0.0 (nan)
ObjectDetection_31 100.0 (-44.1) 100.0 (-44.1) 92.5 (-44.2) 100.0 (-44.1) 0.0 (nan)
ObjectDetection_32 100.0 (-46.7) 100.0 (-46.7) 88.7 (-46.8) 100.0 (-46.7) 100.0 (-46.7)
ObjectDetection_33 100.0 (-44.1) 100.0 (-44.1) 89.2 (-44.2) 100.0 (-44.1) 100.0 (-44.1)
ObjectDetection_34 100.0 (-35.4) 100.0 (-35.4) 98.0 (-35.4) 100.0 (-35.4) 100.0 (-35.4)
ObjectDetection_35 100.0 (-37.6) 100.0 (-37.6) 97.2 (-37.6) 100.0 (-37.6) 0.0 (nan)
ObjectDetection_36 100.0 (-30.7) 100.0 (-30.7) 97.3 (-30.7) 100.0 (-30.7) 0.0 (nan)
ObjectDetection_37 100.0 (-30.0) 100.0 (-30.0) 96.1 (-30.0) 100.0 (-30.0) 100.0 (-30.0)
ObjectDetection_38 100.0 (-75.1) 100.0 (-75.1) 96.3 (-75.1) 100.0 (-75.1) 0.0 (nan)
ObjectDetection_39 100.0 (-70.2) 100.0 (-70.2) 95.1 (-70.3) 100.0 (-70.2) 0.0 (nan)
ObjectDetection_40 100.0 (-72.3) 100.0 (-72.3) 95.2 (-72.4) 100.0 (-72.3) 100.0 (-72.3)
ObjectDetection_41 100.0 (-71.1) 100.0 (-71.1) 0.0 (-73.7) 100.0 (-71.1) 100.0 (-71.1)
ObjectDetection_42 100.0 (-45.2) 100.0 (-45.2) 97.3 (-45.2) 100.0 (-45.2) 0.0 (nan)
ObjectDetection_43 100.0 (-39.5) 100.0 (-39.5) 95.7 (-39.5) 100.0 (-39.5) 0.0 (nan)
ObjectDetection_44 100.0 (-41.0) 100.0 (-41.0) 94.7 (-41.1) 100.0 (-41.0) 100.0 (-41.0)
ObjectDetection_45 100.0 (-38.9) 100.0 (-38.9) 94.6 (-39.0) 100.0 (-38.9) 100.0 (-38.9)
ObjectDetection_46 100.0 (-42.0) 100.0 (-42.0) 0.0 (-43.0) 100.0 (-42.0) 100.0 (-42.0)
ObjectDetection_47 100.0 (-44.7) 100.0 (-44.7) 0.0 (-45.8) 100.0 (-44.7) 0.0 (nan)
ObjectDetection_48 100.0 (-36.6) 100.0 (-36.6) 0.0 (-38.0) 100.0 (-36.6) 0.0 (nan)
ObjectDetection_49 100.0 (-38.7) 100.0 (-38.7) 0.0 (-40.1) 100.0 (-38.7) 100.0 (-38.7)
ObjectDetection_50 100.0 (-36.1) 100.0 (-36.1) 32.2 (-37.1) 100.0 (-36.1) 100.0 (-36.1)
ObjectDetection_51 100.0 (-53.4) 100.0 (-53.4) 97.6 (-53.4) 100.0 (-53.4) 100.0 (-53.4)
ObjectDetection_52 100.0 (-57.0) 100.0 (-57.0) 97.4 (-57.0) 100.0 (-57.0) 0.0 (nan)
ObjectDetection_53 100.0 (-47.7) 100.0 (-47.7) 97.5 (-47.8) 100.0 (-47.7) 0.0 (nan)
ObjectDetection_54 100.0 (-41.5) 100.0 (-41.5) 98.2 (-41.5) 100.0 (-41.5) 0.0 (nan)
ObjectDetection_55 100.0 (-34.1) 100.0 (-34.1) 98.2 (-34.1) 100.0 (-34.1) 0.0 (nan)
ObjectDetection_56 100.0 (-36.3) 100.0 (-36.3) 97.9 (-36.3) 100.0 (-36.3) 100.0 (-36.3)
ObjectDetection_57 100.0 (-33.4) 100.0 (-33.4) 97.8 (-33.4) 100.0 (-33.4) 100.0 (-33.4)
ObjectDetection_58 100.0 (-41.7) 100.0 (-41.7) 95.4 (-41.7) 100.0 (-41.7) 0.0 (nan)
ObjectDetection_59 100.0 (-35.9) 100.0 (-35.9) 93.6 (-35.9) 100.0 (-35.9) 0.0 (nan)
ObjectDetection_60 100.0 (-35.3) 100.0 (-35.3) 92.9 (-35.3) 100.0 (-35.3) 100.0 (-35.3)
ObjectDetection_61 100.0 (-23.2) 100.0 (-23.2) 98.4 (-23.2) 100.0 (-23.2) 100.0 (-23.2)
ObjectDetection_62 100.0 (-24.8) 100.0 (-24.8) 98.7 (-24.8) 100.0 (-24.8) 0.0 (nan)
ObjectDetection_63 100.0 (-19.9) 100.0 (-19.9) 98.2 (-19.9) 100.0 (-19.9) 0.0 (nan)
ObjectDetection_64 100.0 (-21.3) 100.0 (-21.3) 98.4 (-21.3) 100.0 (-21.3) 100.0 (-21.3)
ObjectDetection_65 100.0 (-19.7) 100.0 (-19.7) 98.1 (-19.7) 100.0 (-19.7) 100.0 (-19.7)
ObjectDetection_66 100.0 (-47.0) 100.0 (-47.0) 95.9 (-47.1) 100.0 (-47.0) 0.0 (nan)
ObjectDetection_67 100.0 (-40.6) 100.0 (-40.6) 95.3 (-40.7) 100.0 (-40.6) 0.0 (nan)
ObjectDetection_68 100.0 (-42.7) 100.0 (-42.7) 95.6 (-42.7) 100.0 (-42.7) 100.0 (-42.7)
ObjectDetection_69 100.0 (-40.3) 100.0 (-40.3) 95.3 (-40.3) 100.0 (-40.3) 100.0 (-40.3)
ObjectDetection_70 100.0 (-31.2) 100.0 (-31.2) 96.6 (-31.3) 100.0 (-31.2) 100.0 (-31.2)
ObjectDetection_71 100.0 (-33.6) 100.0 (-33.6) 97.3 (-33.7) 100.0 (-33.6) 0.0 (nan)
ObjectDetection_72 100.0 (-26.4) 100.0 (-26.4) 93.0 (-26.5) 100.0 (-26.4) 0.0 (nan)
ObjectDetection_73 100.0 (-25.6) 100.0 (-25.6) 93.1 (-25.7) 100.0 (-25.6) 100.0 (-25.6)
ObjectDetection_74 100.0 (-31.8) 100.0 (-31.8) 98.7 (-31.8) 100.0 (-31.8) 100.0 (-31.8)
ObjectDetection_75 100.0 (-33.8) 100.0 (-33.8) 98.5 (-33.8) 100.0 (-33.8) 0.0 (nan)
Pedigree_11 100.0 (-17.2) 100.0 (-17.2) 96.0 (-18.2) 100.0 (-17.2) 100.0 (-17.2)
Pedigree_12 100.0 (-11.5) 100.0 (-11.5) 96.4 (-12.1) 100.0 (-11.5) 0.0 (nan)
Pedigree_13 100.0 (-15.2) 100.0 (-15.2) 92.5 (-16.7) 100.0 (-15.2) 100.0 (-15.2)
Promedus_11 100.0 (-8.4) 100.0 (-8.4) 96.0 (-8.6) 100.0 (-8.4) 100.0 (-8.4)
Promedus_12 100.0 (-3.2) 100.0 (-3.2) 93.6 (-3.3) 100.0 (-3.2) 100.0 (-3.2)
Promedus_13 100.0 (-4.5) 100.0 (-4.5) 97.4 (-4.6) 100.0 (-4.5) 100.0 (-4.5)
Promedus_14 100.0 (-7.8) 100.0 (-7.8) 96.6 (-8.0) 100.0 (-7.8) 0.0 (nan)
Promedus_15 100.0 (-3.6) 100.0 (-3.6) 91.4 (-3.8) 100.0 (-3.6) 100.0 (-3.6)
Promedus_16 100.0 (-7.0) 100.0 (-7.0) 99.3 (-7.0) 100.0 (-7.0) 100.0 (-7.0)
Promedus_17 100.0 (-9.5) 100.0 (-9.5) 99.6 (-9.5) 100.0 (-9.5) 0.0 (nan)
Promedus_18 100.0 (-4.7) 100.0 (-4.7) 99.9 (-4.7) 100.0 (-4.7) 0.0 (nan)
Promedus_19 100.0 (-4.3) 100.0 (-4.3) 100.0 (-4.3) 100.0 (-4.3) 0.0 (nan)
Promedus_20 100.0 (-7.1) 100.0 (-7.1) 94.1 (-7.3) 100.0 (-7.1) 0.0 (nan)
Promedus_21 100.0 (-5.6) 100.0 (-5.6) 88.9 (-5.8) 100.0 (-5.6) 100.0 (-5.6)
Promedus_22 100.0 (-2.5) 100.0 (-2.5) 93.1 (-2.6) 100.0 (-2.5) 100.0 (-2.5)
Promedus_23 100.0 (-11.3) 100.0 (-11.3) 94.9 (-11.5) 100.0 (-11.3) 100.0 (-11.3)
Promedus_24 100.0 (-5.9) 100.0 (-5.9) 99.8 (-5.9) 100.0 (-5.9) 100.0 (-5.9)
Promedus_25 100.0 (-9.4) 100.0 (-9.4) 98.4 (-9.5) 100.0 (-9.4) 0.0 (nan)
Promedus_26 100.0 (-7.3) 100.0 (-7.3) 98.8 (-7.3) 100.0 (-7.3) 100.0 (-7.3)
Promedus_27 100.0 (-8.1) 100.0 (-8.1) 91.4 (-8.4) 100.0 (-8.1) 0.0 (nan)
Promedus_28 100.0 (-8.1) 100.0 (-8.1) 95.0 (-8.3) 100.0 (-8.1) 100.0 (-8.1)
Promedus_29 100.0 (-10.5) 100.0 (-10.5) 99.2 (-10.5) 100.0 (-10.5) 100.0 (-10.5)
Promedus_30 100.0 (-22.1) 100.0 (-22.1) 95.3 (-22.2) 100.0 (-22.1) 100.0 (-22.1)
Promedus_31 100.0 (-1.8) 100.0 (-1.8) 89.3 (-2.0) 100.0 (-1.8) 100.0 (-1.8)
Promedus_32 100.0 (-2.2) 100.0 (-2.2) 95.4 (-2.3) 100.0 (-2.2) 100.0 (-2.2)
Promedus_33 100.0 (-2.8) 100.0 (-2.8) 99.9 (-2.8) 100.0 (-2.8) 100.0 (-2.8)
Promedus_34 100.0 (-3.1) 100.0 (-3.1) 90.2 (-3.3) 100.0 (-3.1) 100.0 (-3.1)
Promedus_35 100.0 (-1.7) 100.0 (-1.7) 88.6 (-1.9) 100.0 (-1.7) 100.0 (-1.7)
Promedus_36 100.0 (-1.7) 100.0 (-1.7) 88.6 (-1.9) 100.0 (-1.7) 100.0 (-1.7)
Promedus_37 100.0 (-4.2) 100.0 (-4.2) 96.4 (-4.3) 100.0 (-4.2) 0.0 (nan)
Promedus_38 100.0 (-5.0) 100.0 (-5.0) 95.5 (-5.2) 100.0 (-5.0) 0.0 (nan)
Segmentation_11 100.0 (-24.0) 100.0 (-24.0) 88.4 (-25.9) 100.0 (-24.0) 100.0 (-24.0)
Segmentation_12 100.0 (-10.3) 100.0 (-10.3) 100.0 (-10.3) 100.0 (-10.3) 100.0 (-10.3)
Segmentation_13 100.0 (-33.4) 100.0 (-33.4) 94.5 (-34.4) 100.0 (-33.4) 100.0 (-33.4)
Segmentation_14 100.0 (-39.5) 100.0 (-39.5) 99.1 (-39.7) 100.0 (-39.5) 100.0 (-39.5)
Segmentation_15 100.0 (-26.2) 100.0 (-26.2) 49.7 (-31.6) 100.0 (-26.2) 100.0 (-26.2)
Segmentation_16 100.0 (-38.1) 100.0 (-38.1) 98.3 (-38.5) 100.0 (-38.1) 100.0 (-38.1)
grid10x10.f10 100.0 (303.1) 100.0 (303.1) 49.8 (349.7) 100.0 (303.1) 100.0 (303.1)
linkage_12 0.0 (nan) 100.0 (-69.7) 97.4 (-71.7) 100.0 (-69.7) 0.0 (nan)
linkage_13 0.0 (nan) 99.9 (-76.1) 97.9 (-77.3) 99.6 (-76.3) 0.0 (nan)
linkage_14 100.0 (-30.8) 100.0 (-30.8) 92.6 (-32.0) 100.0 (-30.8) 0.0 (nan)
linkage_16 100.0 (-38.6) 100.0 (-38.6) 82.2 (-41.3) 100.0 (-38.6) 0.0 (nan)
linkage_18 100.0 (-78.5) 99.9 (-78.5) 95.5 (-81.7) 100.0 (-78.5) 0.0 (nan)
linkage_19 100.0 (-59.0) 100.0 (-59.0) 94.1 (-62.6) 100.0 (-59.0) 0.0 (nan)
linkage_21 100.0 (-29.6) 99.9 (-29.7) 93.8 (-31.4) 100.0 (-29.6) 0.0 (nan)
linkage_22 0.0 (nan) 99.9 (-54.2) 93.7 (-57.2) 98.3 (-53.5) 0.0 (nan)
linkage_23 100.0 (-116.6) 99.9 (-116.6) 85.2 (-125.3) 99.7 (-116.8) 0.0 (nan)
linkage_24 100.0 (-83.7) 100.0 (-83.7) 95.0 (-87.0) 100.0 (-83.7) 0.0 (nan)
linkage_26 100.0 (-115.8) 100.0 (-115.8) 95.3 (-118.8) 100.0 (-115.8) 0.0 (nan)
linkage_27 100.0 (-63.5) 100.0 (-63.5) 90.5 (-67.7) 100.0 (-63.5) 0.0 (nan)

Updated: