Description

The lbp solvers are implementations of residual-scheduled loopy belief propagation on the factor graph representation of the model by Alex Ihler

Authors

Alex Ihler

The results below are organized as follows:

  • each table displays the solver’s normalized score for individual problem instances (and, for PR, MPE, and MMAP, the associated log10 likelihood value) for the task under different time limits
  • table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria

MAR

overall

Problem 20sec 1200sec 3600sec
1aie 100.0 100.0 100.0
1bxv 100.0 100.0 100.0
1g6x 100.0 100.0 100.0
1jer 100.0 100.0 100.0
1npl 100.0 100.0 100.0
1qt9 100.0 100.0 100.0
1rfs 100.0 100.0 100.0
2rta 100.0 100.0 100.0
BN_12 97.5 97.5 97.5
BN_13 98.7 98.7 98.7
BN_15 97.7 97.7 97.7
BN_31 87.6 87.6 87.6
blockmap_10_01-0009 0.0 0.0 0.0
blockmap_10_02-0009 0.0 0.0 0.0
blockmap_10_03-0009 0.0 0.0 0.0
blockmap_10_03-0010 0.0 0.0 0.0
blockmap_15_01-0008 0.0 0.0 0.0
blockmap_15_02-0008 0.0 0.0 0.0
blockmap_15_03-0010 0.0 0.0 0.0
blockmap_20_01-0009 0.0 0.0 0.0
bwt3ac.wcsp 47.2 47.2 47.2
fs-07 0.0 0.0 0.0
mastermind_03_08_04-0000 57.6 57.6 57.6
mastermind_03_08_04-0001 87.6 87.6 87.6
mastermind_03_08_04-0002 80.0 80.0 80.0
mastermind_03_08_04-0003 75.8 75.8 75.8
mastermind_03_08_04-0007 94.4 94.4 94.4
mastermind_03_08_04-0008 87.7 87.8 87.8
mastermind_03_08_04-0010 81.5 81.5 81.5
mastermind_03_08_04-0012 0.0 0.0 0.0
mastermind_03_08_04-0013 2.5 1.9 1.9
mastermind_03_08_04-0014 13.0 9.1 9.1
mastermind_03_08_04-0015 21.0 6.2 6.2
mastermind_03_08_05-0001 86.6 86.6 86.6
mastermind_03_08_05-0003 92.2 92.2 92.2
mastermind_03_08_05-0009 74.5 74.5 74.5
mastermind_04_08_03-0000 71.9 71.9 71.9
mastermind_04_08_03-0011 37.9 37.9 37.9
mastermind_04_08_03-0012 46.2 46.8 46.8
mastermind_04_08_03-0013 47.4 47.6 47.6
mastermind_04_08_03-0014 18.8 18.8 18.8
mastermind_04_08_03-0015 7.8 7.8 7.8
mastermind_04_08_04-0001 85.0 85.0 85.0
mastermind_04_08_04-0002 62.7 62.7 62.7
mastermind_04_08_04-0003 69.5 69.5 69.5
mastermind_04_08_04-0004 63.3 63.3 63.3
mastermind_04_08_04-0005 89.7 89.7 89.7
mastermind_05_08_03-0001 79.2 79.2 79.2
mastermind_05_08_03-0002 72.4 72.4 72.4
mastermind_05_08_03-0003 67.2 67.2 67.2
mastermind_05_08_03-0004 82.5 82.5 82.5
mastermind_05_08_03-0009 57.4 57.4 57.4
mastermind_05_08_03-0011 42.5 42.8 42.8
mastermind_05_08_03-0012 64.9 64.9 64.9
mastermind_05_08_03-0013 53.9 53.8 53.8
mastermind_05_08_03-0015 27.8 28.0 28.0
mastermind_06_08_03-0002 69.2 69.2 69.2
mastermind_06_08_03-0003 79.8 79.8 79.8
mastermind_06_08_03-0005 79.3 79.3 79.3
mastermind_06_08_03-0009 58.8 58.8 58.8
mastermind_10_08_03-0008 30.5 30.5 30.5
mastermind_10_08_03-0009 77.7 77.7 77.7
myciel5g_3.wcsp 100.0 100.0 100.0
or_chain_102.fg 10.3 10.3 10.3
or_chain_106.fg 91.2 91.2 91.2
or_chain_107.fg 68.2 68.2 68.2
or_chain_12.fg 7.0 7.0 7.0
or_chain_128.fg 71.4 71.4 71.4
or_chain_132.fg 37.0 37.0 37.0
or_chain_138.fg 95.7 95.7 95.7
or_chain_140.fg 0.0 0.0 0.0
or_chain_149.fg 97.6 97.6 97.6
or_chain_15.fg 91.6 91.6 91.6
or_chain_150.fg 37.1 37.1 37.1
or_chain_153.fg 0.0 0.0 0.0
or_chain_155.fg 93.1 93.1 93.1
or_chain_161.fg 46.8 46.8 46.8
or_chain_186.fg 84.1 84.1 84.1
or_chain_188.fg 45.3 45.3 45.3
or_chain_198.fg 99.2 99.2 99.2
or_chain_209.fg 74.5 74.5 74.5
or_chain_242.fg 56.9 56.9 56.9
or_chain_4.fg 0.1 0.1 0.1
or_chain_53.fg 99.7 99.7 99.7
or_chain_61.fg 82.2 82.2 82.2
or_chain_64.fg 0.0 0.0 0.0
or_chain_90.fg 45.6 45.6 45.6
queen5_5_3.wcsp 100.0 100.0 100.0

Updated: