lbp-mmap Scores
The results below are organized as follows:
- each table displays the solver’s performance for individual problem instances for the given task under different time limits
- table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria
MMAP
overall
| Problem | 20sec | 1200sec | 3600sec |
|---|---|---|---|
| 75-17-5.Q0.5.I4 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| 75-19-5.Q0.5.I2 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| 75-22-5.Q0.5.I2 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| 75-23-5.Q0.5.I3 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| 75-26-5.Q0.5.I4 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| 90-22-5.Q0.5.I4 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| 90-24-5.Q0.5.I2 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| 90-25-5.Q0.5.I2 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| 90-26-5.Q0.5.I1 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| 90-30-5.Q0.5.I1 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| 90-34-5.Q0.5.I2 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| 90-38-5.Q0.5.I4 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| 90-42-5.Q0.5.I4 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| 90-46-5.Q0.5.I4 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| 90-50-5.Q0.5.I3 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| Grids_20 | 84.2 (4813.6) | 78.7 (4804.9) | 78.7 (4804.9) |
| Grids_21 | 62.3 (8320.4) | 62.8 (8322.9) | 62.8 (8322.9) |
| Grids_22 | 53.5 (2780.6) | 38.9 (2763.4) | 38.9 (2763.4) |
| Grids_23 | 63.5 (2752.8) | 51.3 (2739.2) | 51.3 (2739.2) |
| Grids_24 | 55.8 (8056.1) | 68.1 (8106.5) | 68.1 (8106.5) |
| Grids_25 | 79.9 (1200.5) | 88.6 (1204.6) | 88.6 (1204.6) |
| Grids_26 | 76.8 (1314.0) | 51.4 (1300.4) | 51.4 (1300.4) |
| Grids_27 | 53.5 (5416.0) | 37.0 (5383.1) | 37.0 (5383.1) |
| Grids_28 | 0.0 (1941.5) | 0.0 (1924.7) | 0.0 (1924.7) |
| Grids_29 | 70.6 (666.8) | 50.5 (662.6) | 50.5 (662.6) |
| ImageAlignment_11 | 100.0 (-824.2) | 100.0 (-824.2) | 100.0 (-824.2) |
| ImageAlignment_12 | 100.0 (-436.7) | 100.0 (-436.7) | 100.0 (-436.7) |
| ImageAlignment_13 | 91.6 (-3044.5) | 100.0 (-2998.9) | 100.0 (-2998.9) |
| ImageAlignment_14 | 100.0 (-1557.5) | 100.0 (-1557.5) | 100.0 (-1557.5) |
| ImageAlignment_15 | 96.3 (-1191.7) | 100.0 (-1177.5) | 100.0 (-1177.5) |
| ObjectDetection_13 | 0.0 (8826.5) | 0.0 (8826.5) | 0.0 (8826.5) |
| ObjectDetection_14 | 41.5 (8341.9) | 41.5 (8341.9) | 41.5 (8341.9) |
| ObjectDetection_15 | 52.8 (11543.7) | 52.8 (11543.7) | 52.8 (11543.7) |
| ObjectDetection_16 | 70.5 (13547.6) | 70.5 (13547.6) | 70.5 (13547.6) |
| ObjectDetection_17 | 59.3 (3804.5) | 59.0 (3794.9) | 59.0 (3794.9) |
| ProteinFolding_11 | 78.4 (1830.2) | 79.9 (1839.4) | 79.9 (1839.4) |
| ProteinFolding_12 | 100.0 (-1547.0) | 99.7 (-1548.0) | 99.7 (-1548.0) |
| ProteinFolding_13 | 100.0 (-143.3) | 100.0 (-143.3) | 100.0 (-143.3) |
| ProteinFolding_14 | 100.0 (-331.7) | 100.0 (-331.7) | 100.0 (-331.7) |
| ProteinFolding_15 | 100.0 (-51.6) | 100.0 (-51.6) | 100.0 (-51.6) |
| Segmentation_11 | 85.5 (-133.3) | 85.5 (-133.3) | 85.5 (-133.3) |
| Segmentation_12 | 52.8 (-30.1) | 52.8 (-30.1) | 52.8 (-30.1) |
| Segmentation_13 | 100.0 (-21.4) | 100.0 (-21.4) | 100.0 (-21.4) |
| Segmentation_14 | 76.4 (-40.2) | 76.4 (-40.2) | 76.4 (-40.2) |
| Segmentation_15 | 76.6 (-168.5) | 76.6 (-168.5) | 76.6 (-168.5) |
| Segmentation_16 | 100.0 (-40.4) | 100.0 (-40.4) | 100.0 (-40.4) |
| Segmentation_17 | 93.7 (-175.3) | 93.7 (-175.3) | 93.7 (-175.3) |
| Segmentation_18 | 86.9 (-35.9) | 86.9 (-35.9) | 86.9 (-35.9) |
| Segmentation_19 | 88.8 (-25.4) | 88.8 (-25.4) | 88.8 (-25.4) |
| Segmentation_20 | 98.0 (-112.4) | 98.0 (-112.4) | 98.0 (-112.4) |
| bw_p24_16 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| bw_p24_20 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| bw_p34_15 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| bw_p34_20 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| bw_p44_15 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| bw_p44_19 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| bw_p54_10 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| bw_p54_16 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| comm_p01_16 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| comm_p01_20 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| or_chain_11.fg.Q0.5.I3 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| or_chain_16.fg.Q0.5.I3 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| or_chain_22.fg.Q0.5.I3 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| or_chain_24.fg.Q0.5.I3 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| or_chain_25.fg.Q0.5.I3 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| or_chain_32.fg.Q0.5.I3 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| or_chain_36.fg.Q0.5.I3 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| or_chain_39.fg.Q0.5.I3 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| or_chain_40.fg.Q0.5.I3 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| or_chain_41.fg.Q0.5.I3 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| or_chain_43.fg.Q0.5.I3 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| or_chain_6.fg.Q0.5.I3 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| or_chain_60.fg.Q0.5.I3 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| or_chain_63.fg.Q0.5.I3 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| or_chain_8.fg.Q0.5.I3 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| pedigree1.Q0.5.I3 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree13.Q0.5.I1 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree18.Q0.5.I1 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree19.Q0.5.I4 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree20.Q0.5.I2 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree25.Q0.5.I2 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree30.Q0.5.I2 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree31.Q0.5.I2 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree33.Q0.5.I2 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree38.Q0.5.I2 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree41.Q0.5.I2 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree44.Q0.5.I4 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree50.Q0.5.I1 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree7.Q0.5.I2 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pedigree9.Q0.5.I3 | 0.0 (-inf) | 0.0 (-inf) | 0.0 (-inf) |
| pomdp10-12_7_3_8_4.mmap | 0.0 (nan) | 100.0 (1.2) | 100.0 (1.2) |
| pomdp6-12_6_2_6_3.mmap | 95.2 (1.0) | 95.2 (1.0) | 95.2 (1.0) |
| pomdp7-20_10_2_10_3.mmap | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| pomdp8-14_9_3_12_4.mmap | 89.9 (1.4) | 100.0 (1.4) | 100.0 (1.4) |
| pomdp9-14_8_3_10_4.mmap | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| wcsp_14 | 0.0 (-402.5) | 0.0 (-637.3) | 0.0 (-402.4) |
| wcsp_15 | 0.0 (-1503.1) | 0.0 (-1503.1) | 0.0 (-1503.1) |
| wcsp_16 | 0.0 (-302.0) | 0.0 (-334.1) | 0.0 (-251.5) |
| wcsp_17 | 0.0 (-526.8) | 0.0 (-513.4) | 0.0 (-549.1) |
| wcsp_18 | 0.0 (-110.9) | 57.0 (-24.8) | 72.1 (-16.0) |