Description

(paper)[https://www.ics.uci.edu/~dechter/publications/r195.pdf]

Authors

Lars Otten and Rina Dechter

The results below are organized as follows:

  • each table displays the solver’s normalized score for individual problem instances (and the associated log10 likelihood value) for the given task under different time limits
  • table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria

MPE

overall

Problem 20sec 1200sec 3600sec
1CKK 78.3 (5335.5) 90.5 (5439.5) 90.6 (5441.0)
1CM1 95.4 (5372.4) 99.9 (5413.8) 99.9 (5413.8)
1SY9 97.3 (3970.7) 89.1 (3926.8) 100.0 (3985.1)
2BBN 75.8 (5183.5) 98.2 (5317.9) 99.8 (5327.5)
2BCX 88.3 (5878.2) 95.1 (5951.0) 99.3 (5995.0)
BN-d-10000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan)
BN-d-200-5-10 86.3 (-47.5) 94.6 (-46.9) 99.3 (-46.6)
BN-d-20000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan)
BN-d-250-5-10 88.8 (-57.4) 85.7 (-57.6) 93.1 (-57.1)
BN-d-500-5-10 72.5 (-120.4) 77.9 (-119.8) 71.5 (-120.6)
BN-nd-10000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan)
BN-nd-200-5-10 79.6 (-55.7) 84.4 (-55.4) 99.1 (-54.5)
BN-nd-20000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan)
BN-nd-250-5-10 74.1 (-67.1) 83.1 (-66.4) 91.9 (-65.8)
BN-nd-500-5-10 76.8 (-137.5) 62.1 (-139.2) 66.6 (-138.7)
Maxsat_aes_64_1_keyfind_1 95.2 (1866.5) 99.6 (1869.4) 100.0 (1869.6)
Maxsat_gss-25-s100 0.0 (nan) 66.2 (63393.0) 64.3 (63382.3)
Maxsat_mod2c-rand3bip-sat-240-3.shuffled-as.sat05-2520 83.9 (1629.8) 86.2 (1631.2) 89.9 (1633.4)
Maxsat_mod2c-rand3bip-sat-250-3.shuffled-as.sat05-2535 95.3 (1690.2) 81.6 (1682.2) 81.6 (1682.2)
Maxsat_mod4block_2vars_10gates_u2_autoenc 0.0 (nan) 0.0 (80856.5) 0.0 (80856.5)
Promedas_60 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0)
Promedas_61 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9)
Promedas_62 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7)
Promedas_63 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1)
Promedas_64 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5)
Promedas_65 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2)
Promedas_66 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4)
Promedas_67 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4)
Promedas_68 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9)
Promedas_69 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2)
driverlog04ac.wcsp 80.9 (-20.0) 100.0 (-0.2) 100.0 (-0.2)
driverlog05ac.wcsp 72.1 (-28.0) 100.0 (-0.1) 100.0 (-0.1)
driverlog08ac.wcsp 74.2 (-28.0) 77.8 (-24.1) 100.0 (-0.1)
grid20x20.f10 100.0 (1309.7) 100.0 (1309.7) 100.0 (1309.7)
grid20x20.f10.wrap 100.0 (1325.0) 100.0 (1325.0) 100.0 (1325.0)
grid20x20.f15 100.0 (1961.8) 100.0 (1961.8) 100.0 (1961.8)
grid20x20.f15.wrap 100.0 (1981.8) 100.0 (1981.8) 100.0 (1981.8)
grid20x20.f5.wrap 100.0 (670.0) 100.0 (670.0) 100.0 (670.0)
grid40x40.f10 100.0 (5504.4) 100.0 (5504.4) 100.0 (5504.4)
grid40x40.f10.wrap 100.0 (5674.0) 100.0 (5674.4) 100.0 (5674.4)
grid40x40.f15 99.8 (8227.6) 100.0 (8234.3) 100.0 (8234.3)
grid40x40.f15.wrap 100.0 (8495.2) 100.0 (8496.7) 100.0 (8496.7)
grid40x40.f2 100.0 (1167.8) 100.0 (1167.8) 100.0 (1167.8)
grid40x40.f2.wrap 100.0 (1179.2) 100.0 (1179.2) 100.0 (1179.2)
grid40x40.f5 100.0 (2781.6) 100.0 (2781.6) 100.0 (2781.6)
grid40x40.f5.wrap 99.3 (2817.8) 100.0 (2825.5) 100.0 (2825.5)
grid80x80.f10 93.3 (21368.9) 100.0 (21925.9) 100.0 (21925.9)
grid80x80.f10.wrap 91.1 (21291.4) 99.5 (21976.5) 100.0 (22019.3)
grid80x80.f15 93.6 (31999.4) 100.0 (32803.4) 100.0 (32808.8)
grid80x80.f15.wrap 92.8 (32269.9) 99.9 (33209.6) 100.0 (33223.8)
grid80x80.f2 92.9 (4588.4) 100.0 (4677.7) 100.0 (4677.6)
grid80x80.f2.wrap 94.2 (4655.1) 100.0 (4735.3) 100.0 (4735.7)
grid80x80.f5 92.3 (10872.1) 100.0 (11156.3) 100.0 (11155.6)
grid80x80.f5.wrap 91.7 (10794.3) 100.0 (11116.8) 99.9 (11113.9)
pdb1jmx 100.0 (-501.4) 100.0 (-501.4) 100.0 (-501.4)
pdb1kgn 99.8 (-749.2) 100.0 (-748.7) 100.0 (-748.7)
pdb1kwh 100.0 (-305.5) 100.0 (-305.5) 100.0 (-305.5)
pdb1m3y 99.9 (-1054.6) 100.0 (-1054.2) 100.0 (-1054.2)
pdb1qks 100.0 (-657.0) 100.0 (-657.0) 100.0 (-657.0)
pedigree1 100.0 (-45.6) 100.0 (-45.6) 100.0 (-45.6)
pedigree13 100.0 (-73.4) 100.0 (-73.4) 100.0 (-73.4)
pedigree18 100.0 (-125.3) 100.0 (-125.3) 100.0 (-125.3)
pedigree19 99.3 (-97.7) 100.0 (-97.1) 100.0 (-97.1)
pedigree20 100.0 (-53.8) 100.0 (-53.8) 100.0 (-53.8)
pedigree23 100.0 (-62.4) 100.0 (-62.4) 100.0 (-62.4)
pedigree25 100.0 (-160.8) 100.0 (-160.8) 100.0 (-160.8)
pedigree30 100.0 (-137.0) 100.0 (-137.0) 100.0 (-137.0)
pedigree31 99.9 (-130.6) 100.0 (-130.5) 100.0 (-130.5)
pedigree33 100.0 (-74.9) 100.0 (-74.9) 100.0 (-74.9)
pedigree34 100.0 (-111.1) 100.0 (-111.1) 100.0 (-111.1)
pedigree37 100.0 (-144.9) 100.0 (-144.9) 100.0 (-144.9)
pedigree38 100.0 (-87.3) 100.0 (-87.3) 100.0 (-87.3)
pedigree39 100.0 (-155.6) 100.0 (-155.6) 100.0 (-155.6)
pedigree40 99.4 (-130.8) 100.0 (-130.2) 100.0 (-130.2)
pedigree41 100.0 (-120.7) 100.0 (-120.7) 100.0 (-120.7)
pedigree42 100.0 (-81.8) 100.0 (-81.8) 100.0 (-81.8)
pedigree44 100.0 (-97.0) 100.0 (-97.0) 100.0 (-97.0)
pedigree50 100.0 (-61.7) 100.0 (-61.7) 100.0 (-61.7)
pedigree51 99.9 (-109.7) 100.0 (-109.6) 100.0 (-109.6)
pedigree7 100.0 (-113.9) 100.0 (-113.9) 100.0 (-113.9)
pedigree9 99.9 (-123.0) 100.0 (-122.9) 100.0 (-122.9)
rovers02ac.wcsp 100.0 (-0.2) 100.0 (-0.2) 100.0 (-0.2)
rus_100_200_1_1 0.0 (nan) 59.4 (2651.4) 59.4 (2651.4)
rus_100_200_2_1 0.0 (nan) 91.3 (2633.9) 84.3 (2629.5)
rus_100_200_3_1 0.0 (nan) 98.8 (2538.3) 98.8 (2538.3)
rus_100_200_3_3 0.0 (nan) 75.0 (2434.9) 75.0 (2434.9)
rus_100_200_4_3 0.0 (nan) 93.4 (2474.0) 93.4 (2474.0)
rus_100_200_5_3 0.0 (nan) 54.1 (2538.3) 54.1 (2538.3)
rus_100_200_6_1 0.0 (nan) 54.1 (2240.3) 54.1 (2240.3)
rus_50_100_4_1 33.6 (1512.1) 62.3 (1522.4) 62.3 (1522.4)
rus_50_100_4_3 94.9 (1613.9) 94.9 (1613.9) 94.9 (1613.9)
rus_50_100_6_1 63.6 (1325.1) 100.0 (1338.1) 100.0 (1338.1)
rus_50_100_6_2 80.7 (1648.7) 80.7 (1648.7) 80.7 (1648.7)
rus_50_100_7_1 30.2 (1471.7) 81.7 (1495.6) 81.7 (1495.6)
rus_50_100_7_2 86.6 (1503.8) 86.6 (1503.8) 86.6 (1503.8)
rus_50_100_8_1 96.3 (1444.5) 96.3 (1444.5) 96.3 (1444.5)
rus_50_100_9_3 61.2 (1596.7) 64.0 (1597.9) 64.0 (1597.9)
satellite01ac.wcsp 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1)
satellite02ac.wcsp 37.6 (-20.0) 100.0 (-0.0) 100.0 (-0.0)
scen06.wcsp 98.9 (-14.3) 98.9 (-14.3) 98.9 (-14.3)
scen07.wcsp 99.5 (-1.8) 99.8 (-1.5) 99.7 (-1.6)
zenotravel02ac.wcsp 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1)
zenotravel04ac.wcsp 76.5 (-16.0) 100.0 (-0.1) 100.0 (-0.1)

Updated: