wmbsearch-aobfs-pr Scores
The results below are organized as follows:
- each table displays the solver’s performance for individual problem instances for the given task under different time limits
- table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria
PR
overall
| Problem | 20sec | 1200sec | 3600sec |
|---|---|---|---|
| Alchemy_11 | 100.0 (606.3) | 100.0 (606.3) | 100.0 (606.3) |
| CSP_11 | 100.0 (13.6) | 100.0 (13.6) | 100.0 (13.6) |
| CSP_12 | 100.0 (16.5) | 100.0 (16.5) | 100.0 (16.5) |
| CSP_13 | 97.2 (15.7) | 100.0 (15.3) | 100.0 (15.3) |
| DBN_11 | 100.0 (58.5) | 100.0 (58.5) | 100.0 (58.5) |
| DBN_12 | 100.0 (63.1) | 100.0 (63.1) | 100.0 (63.1) |
| DBN_13 | 99.9 (66.7) | 100.0 (66.6) | 100.0 (66.6) |
| DBN_14 | 100.0 (151.2) | 100.0 (151.2) | 100.0 (151.2) |
| DBN_15 | 100.0 (152.6) | 100.0 (152.6) | 100.0 (152.6) |
| DBN_16 | 100.0 (166.1) | 100.0 (166.1) | 100.0 (166.1) |
| Grids_11 | 100.0 (169.4) | 100.0 (169.4) | 100.0 (169.4) |
| Grids_12 | 100.0 (303.1) | 100.0 (303.1) | 100.0 (303.1) |
| Grids_13 | 100.0 (333.3) | 100.0 (333.3) | 100.0 (333.3) |
| Grids_14 | 100.0 (497.8) | 100.0 (497.8) | 100.0 (497.8) |
| Grids_15 | 100.0 (291.7) | 100.0 (291.7) | 100.0 (291.7) |
| Grids_16 | 100.0 (665.1) | 100.0 (665.1) | 100.0 (665.1) |
| Grids_17 | 100.0 (1312.0) | 100.0 (1312.0) | 100.0 (1312.0) |
| Grids_18 | 100.0 (1963.0) | 100.0 (1963.0) | 100.0 (1963.0) |
| ObjectDetection_11 | 0.0 (nan) | 100.0 (-74.9) | 100.0 (-74.9) |
| ObjectDetection_12 | 0.0 (nan) | 100.0 (-67.4) | 100.0 (-67.4) |
| ObjectDetection_13 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_14 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_15 | 0.0 (nan) | 100.0 (-51.9) | 100.0 (-51.9) |
| ObjectDetection_16 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_17 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_18 | 0.0 (nan) | 100.0 (-37.0) | 100.0 (-37.0) |
| ObjectDetection_19 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_20 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_21 | 0.0 (nan) | 100.0 (-24.4) | 100.0 (-24.4) |
| ObjectDetection_22 | 0.0 (nan) | 100.0 (-36.7) | 100.0 (-36.7) |
| ObjectDetection_23 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_24 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_25 | 0.0 (nan) | 100.0 (-18.7) | 100.0 (-18.7) |
| ObjectDetection_26 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_27 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_28 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_29 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_30 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_31 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_32 | 0.0 (nan) | 100.0 (-46.7) | 100.0 (-46.7) |
| ObjectDetection_33 | 0.0 (nan) | 100.0 (-44.1) | 100.0 (-44.1) |
| ObjectDetection_34 | 0.0 (nan) | 100.0 (-35.4) | 100.0 (-35.4) |
| ObjectDetection_35 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_36 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_37 | 0.0 (nan) | 100.0 (-30.0) | 100.0 (-30.0) |
| ObjectDetection_38 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_39 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_40 | 0.0 (nan) | 100.0 (-72.3) | 100.0 (-72.3) |
| ObjectDetection_41 | 0.0 (nan) | 100.0 (-71.1) | 100.0 (-71.1) |
| ObjectDetection_42 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_43 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_44 | 0.0 (nan) | 100.0 (-41.0) | 100.0 (-41.0) |
| ObjectDetection_45 | 0.0 (nan) | 100.0 (-38.9) | 100.0 (-38.9) |
| ObjectDetection_46 | 0.0 (nan) | 100.0 (-42.0) | 100.0 (-42.0) |
| ObjectDetection_47 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_48 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_49 | 0.0 (nan) | 100.0 (-38.7) | 100.0 (-38.7) |
| ObjectDetection_50 | 0.0 (nan) | 100.0 (-36.1) | 100.0 (-36.1) |
| ObjectDetection_51 | 0.0 (nan) | 100.0 (-53.4) | 100.0 (-53.4) |
| ObjectDetection_52 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_53 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_54 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_55 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_56 | 0.0 (nan) | 100.0 (-36.3) | 100.0 (-36.3) |
| ObjectDetection_57 | 0.0 (nan) | 100.0 (-33.4) | 100.0 (-33.4) |
| ObjectDetection_58 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_59 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_60 | 0.0 (nan) | 100.0 (-35.3) | 100.0 (-35.3) |
| ObjectDetection_61 | 0.0 (nan) | 100.0 (-23.2) | 100.0 (-23.2) |
| ObjectDetection_62 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_63 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_64 | 0.0 (nan) | 100.0 (-21.3) | 100.0 (-21.3) |
| ObjectDetection_65 | 0.0 (nan) | 100.0 (-19.7) | 100.0 (-19.7) |
| ObjectDetection_66 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_67 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_68 | 0.0 (nan) | 100.0 (-42.7) | 100.0 (-42.7) |
| ObjectDetection_69 | 0.0 (nan) | 100.0 (-40.3) | 100.0 (-40.3) |
| ObjectDetection_70 | 0.0 (nan) | 100.0 (-31.2) | 100.0 (-31.2) |
| ObjectDetection_71 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_72 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| ObjectDetection_73 | 0.0 (nan) | 100.0 (-25.6) | 100.0 (-25.6) |
| ObjectDetection_74 | 0.0 (nan) | 100.0 (-31.8) | 100.0 (-31.8) |
| ObjectDetection_75 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Pedigree_11 | 0.0 (nan) | 100.0 (-17.2) | 100.0 (-17.2) |
| Pedigree_12 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Pedigree_13 | 0.0 (nan) | 100.0 (-15.2) | 100.0 (-15.2) |
| Promedus_11 | 0.0 (nan) | 100.0 (-8.4) | 100.0 (-8.4) |
| Promedus_12 | 0.0 (nan) | 100.0 (-3.2) | 100.0 (-3.2) |
| Promedus_13 | 100.0 (-4.5) | 100.0 (-4.5) | 100.0 (-4.5) |
| Promedus_14 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Promedus_15 | 100.0 (-3.6) | 100.0 (-3.6) | 100.0 (-3.6) |
| Promedus_16 | 100.0 (-7.0) | 100.0 (-7.0) | 100.0 (-7.0) |
| Promedus_17 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Promedus_18 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Promedus_19 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Promedus_20 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Promedus_21 | 100.0 (-5.6) | 100.0 (-5.6) | 100.0 (-5.6) |
| Promedus_22 | 100.0 (-2.5) | 100.0 (-2.5) | 100.0 (-2.5) |
| Promedus_23 | 0.0 (nan) | 100.0 (-11.3) | 100.0 (-11.3) |
| Promedus_24 | 100.0 (-5.9) | 100.0 (-5.9) | 100.0 (-5.9) |
| Promedus_25 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Promedus_26 | 100.0 (-7.3) | 100.0 (-7.3) | 100.0 (-7.3) |
| Promedus_27 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Promedus_28 | 0.0 (nan) | 100.0 (-8.1) | 100.0 (-8.1) |
| Promedus_29 | 100.0 (-10.5) | 100.0 (-10.5) | 100.0 (-10.5) |
| Promedus_30 | 100.0 (-22.1) | 100.0 (-22.1) | 100.0 (-22.1) |
| Promedus_31 | 100.0 (-1.8) | 100.0 (-1.8) | 100.0 (-1.8) |
| Promedus_32 | 100.0 (-2.2) | 100.0 (-2.2) | 100.0 (-2.2) |
| Promedus_33 | 100.0 (-2.8) | 100.0 (-2.8) | 100.0 (-2.8) |
| Promedus_34 | 0.0 (nan) | 100.0 (-3.1) | 100.0 (-3.1) |
| Promedus_35 | 100.0 (-1.7) | 100.0 (-1.7) | 100.0 (-1.7) |
| Promedus_36 | 100.0 (-1.7) | 100.0 (-1.7) | 100.0 (-1.7) |
| Promedus_37 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Promedus_38 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| Segmentation_11 | 100.0 (-24.0) | 100.0 (-24.0) | 100.0 (-24.0) |
| Segmentation_12 | 100.0 (-10.3) | 100.0 (-10.3) | 100.0 (-10.3) |
| Segmentation_13 | 100.0 (-33.4) | 100.0 (-33.4) | 100.0 (-33.4) |
| Segmentation_14 | 100.0 (-39.5) | 100.0 (-39.5) | 100.0 (-39.5) |
| Segmentation_15 | 100.0 (-26.2) | 100.0 (-26.2) | 100.0 (-26.2) |
| Segmentation_16 | 100.0 (-38.1) | 100.0 (-38.1) | 100.0 (-38.1) |
| grid10x10.f10 | 100.0 (303.1) | 100.0 (303.1) | 100.0 (303.1) |
| linkage_12 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| linkage_13 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| linkage_14 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| linkage_16 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| linkage_18 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| linkage_19 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| linkage_21 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| linkage_22 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| linkage_23 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| linkage_24 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| linkage_26 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| linkage_27 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |