lbp-mmap

Description

The lbp solvers are implementations of residual-scheduled loopy belief propagation on the factor graph representation of the model by Alex Ihler

Authors

Alex Ihler

The results below are organized as follows:

• each table displays the solver’s normalized score for individual problem instances (and the associated log10 likelihood value) for the given task under different time limits
• table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria

MMAP

overall

Problem	20sec	1200sec	3600sec
75-17-5.Q0.5.I4	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
75-19-5.Q0.5.I2	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
75-22-5.Q0.5.I2	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
75-23-5.Q0.5.I3	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
75-26-5.Q0.5.I4	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
90-22-5.Q0.5.I4	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
90-24-5.Q0.5.I2	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
90-25-5.Q0.5.I2	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
90-26-5.Q0.5.I1	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
90-30-5.Q0.5.I1	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
90-34-5.Q0.5.I2	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
90-38-5.Q0.5.I4	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
90-42-5.Q0.5.I4	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
90-46-5.Q0.5.I4	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
90-50-5.Q0.5.I3	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
Grids_20	84.2 (4813.6)	78.7 (4804.9)	78.7 (4804.9)
Grids_21	62.3 (8320.4)	62.8 (8322.9)	62.8 (8322.9)
Grids_22	53.5 (2780.6)	38.9 (2763.4)	38.9 (2763.4)
Grids_23	63.5 (2752.8)	51.3 (2739.2)	51.3 (2739.2)
Grids_24	55.8 (8056.1)	68.1 (8106.5)	68.1 (8106.5)
Grids_25	79.9 (1200.5)	88.6 (1204.6)	88.6 (1204.6)
Grids_26	76.8 (1314.0)	51.4 (1300.4)	51.4 (1300.4)
Grids_27	53.5 (5416.0)	37.0 (5383.1)	37.0 (5383.1)
Grids_28	0.0 (1941.5)	0.0 (1924.7)	0.0 (1924.7)
Grids_29	70.6 (666.8)	50.5 (662.6)	50.5 (662.6)
ImageAlignment_11	100.0 (-824.2)	100.0 (-824.2)	100.0 (-824.2)
ImageAlignment_12	100.0 (-436.7)	100.0 (-436.7)	100.0 (-436.7)
ImageAlignment_13	91.6 (-3044.5)	100.0 (-2998.9)	100.0 (-2998.9)
ImageAlignment_14	100.0 (-1557.5)	100.0 (-1557.5)	100.0 (-1557.5)
ImageAlignment_15	96.3 (-1191.7)	100.0 (-1177.5)	100.0 (-1177.5)
ObjectDetection_13	0.0 (8826.5)	0.0 (8826.5)	0.0 (8826.5)
ObjectDetection_14	41.5 (8341.9)	41.5 (8341.9)	41.5 (8341.9)
ObjectDetection_15	52.8 (11543.7)	52.8 (11543.7)	52.8 (11543.7)
ObjectDetection_16	70.5 (13547.6)	70.5 (13547.6)	70.5 (13547.6)
ObjectDetection_17	59.3 (3804.5)	59.0 (3794.9)	59.0 (3794.9)
ProteinFolding_11	78.4 (1830.2)	79.9 (1839.4)	79.9 (1839.4)
ProteinFolding_12	100.0 (-1547.0)	99.7 (-1548.0)	99.7 (-1548.0)
ProteinFolding_13	100.0 (-143.3)	100.0 (-143.3)	100.0 (-143.3)
ProteinFolding_14	100.0 (-331.7)	100.0 (-331.7)	100.0 (-331.7)
ProteinFolding_15	100.0 (-51.6)	100.0 (-51.6)	100.0 (-51.6)
Segmentation_11	85.5 (-133.3)	85.5 (-133.3)	85.5 (-133.3)
Segmentation_12	52.8 (-30.1)	52.8 (-30.1)	52.8 (-30.1)
Segmentation_13	100.0 (-21.4)	100.0 (-21.4)	100.0 (-21.4)
Segmentation_14	76.4 (-40.2)	76.4 (-40.2)	76.4 (-40.2)
Segmentation_15	76.6 (-168.5)	76.6 (-168.5)	76.6 (-168.5)
Segmentation_16	100.0 (-40.4)	100.0 (-40.4)	100.0 (-40.4)
Segmentation_17	93.7 (-175.3)	93.7 (-175.3)	93.7 (-175.3)
Segmentation_18	86.9 (-35.9)	86.9 (-35.9)	86.9 (-35.9)
Segmentation_19	88.8 (-25.4)	88.8 (-25.4)	88.8 (-25.4)
Segmentation_20	98.0 (-112.4)	98.0 (-112.4)	98.0 (-112.4)
bw_p24_16	0.0 (nan)	0.0 (nan)	0.0 (nan)
bw_p24_20	0.0 (nan)	0.0 (nan)	0.0 (nan)
bw_p34_15	0.0 (nan)	0.0 (nan)	0.0 (nan)
bw_p34_20	0.0 (nan)	0.0 (nan)	0.0 (nan)
bw_p44_15	0.0 (nan)	0.0 (nan)	0.0 (nan)
bw_p44_19	0.0 (nan)	0.0 (nan)	0.0 (nan)
bw_p54_10	0.0 (nan)	0.0 (nan)	0.0 (nan)
bw_p54_16	0.0 (nan)	0.0 (nan)	0.0 (nan)
comm_p01_16	0.0 (nan)	0.0 (nan)	0.0 (nan)
comm_p01_20	0.0 (nan)	0.0 (nan)	0.0 (nan)
or_chain_11.fg.Q0.5.I3	0.0 (nan)	0.0 (nan)	0.0 (nan)
or_chain_16.fg.Q0.5.I3	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
or_chain_22.fg.Q0.5.I3	0.0 (nan)	0.0 (nan)	0.0 (nan)
or_chain_24.fg.Q0.5.I3	0.0 (nan)	0.0 (nan)	0.0 (nan)
or_chain_25.fg.Q0.5.I3	0.0 (nan)	0.0 (nan)	0.0 (nan)
or_chain_32.fg.Q0.5.I3	0.0 (nan)	0.0 (nan)	0.0 (nan)
or_chain_36.fg.Q0.5.I3	0.0 (nan)	0.0 (nan)	0.0 (nan)
or_chain_39.fg.Q0.5.I3	0.0 (nan)	0.0 (nan)	0.0 (nan)
or_chain_40.fg.Q0.5.I3	0.0 (nan)	0.0 (nan)	0.0 (nan)
or_chain_41.fg.Q0.5.I3	0.0 (nan)	0.0 (nan)	0.0 (nan)
or_chain_43.fg.Q0.5.I3	0.0 (nan)	0.0 (nan)	0.0 (nan)
or_chain_6.fg.Q0.5.I3	0.0 (nan)	0.0 (nan)	0.0 (nan)
or_chain_60.fg.Q0.5.I3	0.0 (nan)	0.0 (nan)	0.0 (nan)
or_chain_63.fg.Q0.5.I3	0.0 (nan)	0.0 (nan)	0.0 (nan)
or_chain_8.fg.Q0.5.I3	0.0 (nan)	0.0 (nan)	0.0 (nan)
pedigree1.Q0.5.I3	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
pedigree13.Q0.5.I1	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
pedigree18.Q0.5.I1	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
pedigree19.Q0.5.I4	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
pedigree20.Q0.5.I2	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
pedigree25.Q0.5.I2	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
pedigree30.Q0.5.I2	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
pedigree31.Q0.5.I2	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
pedigree33.Q0.5.I2	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
pedigree38.Q0.5.I2	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
pedigree41.Q0.5.I2	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
pedigree44.Q0.5.I4	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
pedigree50.Q0.5.I1	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
pedigree7.Q0.5.I2	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
pedigree9.Q0.5.I3	0.0 (-inf)	0.0 (-inf)	0.0 (-inf)
pomdp10-12_7_3_8_4.mmap	0.0 (nan)	100.0 (1.2)	100.0 (1.2)
pomdp6-12_6_2_6_3.mmap	95.2 (1.0)	95.2 (1.0)	95.2 (1.0)
pomdp7-20_10_2_10_3.mmap	0.0 (nan)	0.0 (nan)	0.0 (nan)
pomdp8-14_9_3_12_4.mmap	89.9 (1.4)	100.0 (1.4)	100.0 (1.4)
pomdp9-14_8_3_10_4.mmap	0.0 (nan)	0.0 (nan)	0.0 (nan)
wcsp_14	0.0 (-402.5)	0.0 (-637.3)	0.0 (-402.4)
wcsp_15	0.0 (-1503.1)	0.0 (-1503.1)	0.0 (-1503.1)
wcsp_16	0.0 (-302.0)	0.0 (-334.1)	0.0 (-251.5)
wcsp_17	0.0 (-526.8)	0.0 (-513.4)	0.0 (-549.1)
wcsp_18	0.0 (-110.9)	57.0 (-24.8)	72.1 (-16.0)