Description

DAOOPT scheme with lookahead by William Lam. paper

Authors

William Lam, Kalev Kask, Javier Larrosa, and Rina Dechter

The results below are organized as follows:

  • each table displays the solver’s normalized score for individual problem instances (and the associated log10 likelihood value) for the given task under different time limits
  • table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria

MPE

overall

Problem 20sec 1200sec 3600sec
1CKK 76.0 (5316.3) 76.0 (5316.3) 76.0 (5316.3)
1CM1 77.1 (5206.7) 77.1 (5206.7) 77.1 (5206.7)
1SY9 78.9 (3872.4) 78.9 (3872.4) 78.9 (3872.4)
2BBN 58.2 (5078.1) 81.6 (5218.7) 81.6 (5218.7)
2BCX 83.5 (5828.5) 83.5 (5828.5) 83.5 (5828.5)
BN-d-10000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan)
BN-d-200-5-10 92.2 (-47.1) 92.2 (-47.1) 92.2 (-47.1)
BN-d-20000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan)
BN-d-250-5-10 73.9 (-58.4) 73.9 (-58.4) 73.9 (-58.4)
BN-d-500-5-10 74.2 (-120.2) 74.2 (-120.2) 74.2 (-120.2)
BN-nd-10000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan)
BN-nd-200-5-10 85.2 (-55.4) 85.2 (-55.4) 85.2 (-55.4)
BN-nd-20000-4-2 0.0 (nan) 0.0 (nan) 0.0 (nan)
BN-nd-250-5-10 74.2 (-67.1) 74.2 (-67.1) 74.2 (-67.1)
BN-nd-500-5-10 83.6 (-136.8) 83.6 (-136.8) 83.6 (-136.8)
Maxsat_aes_64_1_keyfind_1 87.2 (1861.5) 95.8 (1866.9) 96.8 (1867.6)
Maxsat_gss-25-s100 0.0 (nan) 46.5 (63283.8) 100.0 (63581.0)
Maxsat_mod2c-rand3bip-sat-240-3.shuffled-as.sat05-2520 75.9 (1625.1) 88.9 (1632.8) 83.2 (1629.4)
Maxsat_mod2c-rand3bip-sat-250-3.shuffled-as.sat05-2535 81.5 (1682.2) 91.4 (1687.9) 93.7 (1689.3)
Maxsat_mod4block_2vars_10gates_u2_autoenc 0.0 (nan) 1.4 (80881.7) 25.4 (80987.3)
Promedas_60 100.0 (-10.0) 100.0 (-10.0) 100.0 (-10.0)
Promedas_61 100.0 (-6.9) 100.0 (-6.9) 100.0 (-6.9)
Promedas_62 100.0 (-4.7) 100.0 (-4.7) 100.0 (-4.7)
Promedas_63 100.0 (-6.1) 100.0 (-6.1) 100.0 (-6.1)
Promedas_64 100.0 (-11.5) 100.0 (-11.5) 100.0 (-11.5)
Promedas_65 100.0 (-5.2) 100.0 (-5.2) 100.0 (-5.2)
Promedas_66 100.0 (-10.4) 100.0 (-10.4) 100.0 (-10.4)
Promedas_67 100.0 (-13.4) 100.0 (-13.4) 100.0 (-13.4)
Promedas_68 100.0 (-18.9) 100.0 (-18.9) 100.0 (-18.9)
Promedas_69 100.0 (-11.2) 100.0 (-11.2) 100.0 (-11.2)
driverlog04ac.wcsp 65.5 (-36.0) 65.5 (-36.0) 88.6 (-12.0)
driverlog05ac.wcsp 68.1 (-32.0) 68.1 (-32.0) 84.0 (-16.0)
driverlog08ac.wcsp 59.4 (-44.0) 59.4 (-44.0) 59.4 (-44.0)
grid20x20.f10 100.0 (1309.7) 99.9 (1309.4) 100.0 (1309.7)
grid20x20.f10.wrap 100.0 (1325.0) 100.0 (1325.0) 100.0 (1325.0)
grid20x20.f15 99.9 (1961.1) 100.0 (1961.8) 100.0 (1961.8)
grid20x20.f15.wrap 100.0 (1981.8) 100.0 (1981.8) 99.1 (1975.0)
grid20x20.f5.wrap 100.0 (670.0) 100.0 (670.0) 100.0 (670.0)
grid40x40.f10 94.3 (5395.3) 99.0 (5484.3) 99.8 (5499.8)
grid40x40.f10.wrap 91.7 (5482.9) 98.3 (5636.0) 99.9 (5672.4)
grid40x40.f15 95.2 (8093.3) 99.2 (8210.4) 99.2 (8210.6)
grid40x40.f15.wrap 92.3 (8225.5) 98.7 (8451.7) 99.3 (8472.0)
grid40x40.f2 94.9 (1151.4) 99.9 (1167.4) 99.9 (1167.6)
grid40x40.f2.wrap 91.7 (1150.8) 99.7 (1178.4) 99.4 (1177.3)
grid40x40.f5 93.9 (2725.1) 99.7 (2778.7) 99.8 (2779.7)
grid40x40.f5.wrap 92.1 (2744.5) 98.7 (2812.4) 99.2 (2817.0)
grid80x80.f10 93.3 (21375.3) 98.9 (21833.6) 98.8 (21823.6)
grid80x80.f10.wrap 91.4 (21310.0) 97.4 (21803.5) 97.6 (21821.3)
grid80x80.f15 93.6 (32004.1) 98.2 (32579.3) 98.3 (32587.8)
grid80x80.f15.wrap 93.2 (32330.4) 97.5 (32894.0) 97.7 (32914.3)
grid80x80.f2 91.7 (4573.3) 99.3 (4668.5) 98.7 (4661.1)
grid80x80.f2.wrap 90.7 (4606.9) 99.0 (4722.3) 99.3 (4725.5)
grid80x80.f5 90.9 (10820.2) 98.6 (11103.3) 98.1 (11085.6)
grid80x80.f5.wrap 92.1 (10811.7) 98.5 (11060.2) 97.2 (11006.6)
pdb1jmx 93.1 (-510.6) 93.1 (-510.6) 96.5 (-506.1)
pdb1kgn 90.7 (-768.1) 90.7 (-768.1) 92.4 (-764.6)
pdb1kwh 98.2 (-307.5) 98.2 (-307.5) 98.2 (-307.5)
pdb1m3y 93.6 (-1073.7) 94.1 (-1072.2) 93.6 (-1073.7)
pdb1qks 97.3 (-661.7) 97.3 (-661.7) 99.0 (-658.8)
pedigree1 100.0 (-45.6) 100.0 (-45.6) 100.0 (-45.6)
pedigree13 99.9 (-73.4) 99.9 (-73.4) 100.0 (-73.4)
pedigree18 100.0 (-125.3) 99.9 (-125.3) 100.0 (-125.3)
pedigree19 99.2 (-97.8) 99.4 (-97.6) 99.4 (-97.6)
pedigree20 100.0 (-53.8) 100.0 (-53.8) 100.0 (-53.8)
pedigree23 100.0 (-62.4) 100.0 (-62.4) 100.0 (-62.4)
pedigree25 100.0 (-160.8) 100.0 (-160.8) 100.0 (-160.8)
pedigree30 100.0 (-137.0) 100.0 (-137.0) 100.0 (-137.0)
pedigree31 99.8 (-130.7) 99.8 (-130.7) 100.0 (-130.5)
pedigree33 100.0 (-74.9) 100.0 (-74.9) 100.0 (-74.9)
pedigree34 99.5 (-111.4) 99.5 (-111.4) 100.0 (-111.1)
pedigree37 100.0 (-144.9) 100.0 (-144.9) 100.0 (-144.9)
pedigree38 99.8 (-87.4) 99.8 (-87.4) 100.0 (-87.3)
pedigree39 99.2 (-156.4) 100.0 (-155.6) 100.0 (-155.6)
pedigree40 99.5 (-130.8) 99.6 (-130.6) 99.9 (-130.4)
pedigree41 99.9 (-120.9) 99.9 (-120.9) 100.0 (-120.7)
pedigree42 99.9 (-81.8) 100.0 (-81.8) 100.0 (-81.8)
pedigree44 99.8 (-97.1) 99.3 (-97.4) 100.0 (-97.0)
pedigree50 99.7 (-61.8) 100.0 (-61.7) 100.0 (-61.7)
pedigree51 99.7 (-109.9) 99.9 (-109.7) 99.7 (-109.9)
pedigree7 99.6 (-114.1) 100.0 (-113.9) 100.0 (-113.9)
pedigree9 100.0 (-122.9) 100.0 (-122.9) 100.0 (-122.9)
rovers02ac.wcsp 100.0 (-0.2) 100.0 (-0.2) 100.0 (-0.2)
rus_100_200_1_1 0.0 (nan) 96.7 (2681.2) 96.7 (2681.2)
rus_100_200_2_1 0.0 (nan) 78.6 (2626.0) 78.6 (2626.0)
rus_100_200_3_1 0.0 (nan) 98.8 (2538.3) 98.8 (2538.3)
rus_100_200_3_3 0.0 (nan) 99.9 (2449.5) 99.9 (2449.5)
rus_100_200_4_3 0.0 (nan) 93.9 (2474.4) 93.9 (2474.4)
rus_100_200_5_3 0.0 (nan) 97.0 (2571.1) 97.0 (2571.1)
rus_100_200_6_1 0.0 (nan) 69.4 (2252.4) 69.6 (2252.6)
rus_50_100_4_1 0.0 (1496.1) 78.0 (1528.0) 78.0 (1528.0)
rus_50_100_4_3 94.9 (1613.9) 100.0 (1615.8) 100.0 (1615.8)
rus_50_100_6_1 64.7 (1325.5) 92.3 (1335.4) 92.3 (1335.4)
rus_50_100_6_2 66.2 (1642.9) 100.0 (1656.5) 100.0 (1656.5)
rus_50_100_7_1 33.9 (1473.5) 97.3 (1502.9) 100.0 (1504.1)
rus_50_100_7_2 86.6 (1503.8) 96.5 (1508.3) 96.5 (1508.3)
rus_50_100_8_1 68.6 (1432.5) 100.0 (1446.2) 100.0 (1446.2)
rus_50_100_9_3 54.8 (1593.7) 71.1 (1601.1) 100.0 (1614.3)
satellite01ac.wcsp 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1)
satellite02ac.wcsp 37.6 (-20.0) 37.6 (-20.0) 37.6 (-20.0)
scen06.wcsp 98.3 (-14.8) 98.3 (-14.8) 98.3 (-14.8)
scen07.wcsp 98.7 (-2.4) 98.7 (-2.4) 98.7 (-2.4)
zenotravel02ac.wcsp 100.0 (-0.1) 100.0 (-0.1) 100.0 (-0.1)
zenotravel04ac.wcsp 58.9 (-28.0) 58.9 (-28.0) 58.9 (-28.0)

Updated: