The results below are organized as follows:

  • each table below displays various solvers’ performance for individual problem instances for the given task and time limit
  • table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria

overall

20sec

Problem baseline braobb-mmap daoopt-lh-mmap daoopt-mmap lbp-mmap toulbar2-ipr-mmap toulbar2-vacint-mmap toulbar2-vns-mmap uai14-mmap
75-17-5.Q0.5.I4 0.0 (-18.6) 92.4 (-8.3) 97.9 (-7.7) 97.9 (-7.7) 0.0 (-inf) 97.9 (-7.7) 97.9 (-7.7) 97.9 (-7.7) 0.0 (-inf)
75-19-5.Q0.5.I2 0.0 (-23.6) 76.8 (-12.9) 100.0 (-9.6) 100.0 (-9.6) 0.0 (-inf) 100.0 (-9.6) 100.0 (-9.6) 100.0 (-9.6) 0.0 (-inf)
75-22-5.Q0.5.I2 0.0 (-32.9) 100.0 (-11.3) 98.2 (-11.7) 98.3 (-11.7) 0.0 (-inf) 98.3 (-11.7) 98.3 (-11.7) 98.3 (-11.7) 0.0 (-inf)
75-23-5.Q0.5.I3 0.0 (-33.9) 0.0 (-inf) 96.2 (-13.3) 100.0 (-12.5) 0.0 (-inf) 100.0 (-12.5) 100.0 (-12.5) 100.0 (-12.5) 0.0 (-inf)
75-26-5.Q0.5.I4 0.0 (-47.0) 80.0 (-23.9) 97.0 (-18.9) 100.0 (-18.1) 0.0 (-inf) 100.0 (-18.1) 99.5 (-18.2) 98.3 (-18.6) 0.0 (-inf)
90-22-5.Q0.5.I4 0.0 (-19.0) 96.6 (-6.0) 100.0 (-5.6) 100.0 (-5.6) 0.0 (-inf) 100.0 (-5.6) 100.0 (-5.6) 100.0 (-5.6) 0.0 (-inf)
90-24-5.Q0.5.I2 0.0 (-17.9) 0.0 (nan) 87.4 (-7.2) 99.4 (-5.7) 0.0 (-inf) 99.4 (-5.7) 99.4 (-5.7) 99.4 (-5.7) 0.0 (-inf)
90-25-5.Q0.5.I2 0.0 (-27.8) 92.6 (-9.2) 98.7 (-8.0) 99.3 (-7.9) 0.0 (-inf) 100.0 (-7.7) 100.0 (-7.7) 100.0 (-7.7) 0.0 (-inf)
90-26-5.Q0.5.I1 0.0 (-23.8) 0.0 (-inf) 95.2 (-9.3) 100.0 (-8.6) 0.0 (-inf) 99.5 (-8.7) 99.5 (-8.7) 99.5 (-8.7) 0.0 (-inf)
90-30-5.Q0.5.I1 0.0 (-27.3) 0.0 (nan) 95.2 (-11.7) 100.0 (-10.9) 0.0 (-inf) 100.0 (-10.9) 100.0 (-10.9) 100.0 (-10.9) 0.0 (-inf)
90-34-5.Q0.5.I2 0.0 (-38.5) 0.0 (-inf) 92.2 (-14.2) 100.0 (-12.2) 0.0 (-inf) 100.0 (-12.2) 100.0 (-12.2) 100.0 (-12.2) 0.0 (-inf)
90-38-5.Q0.5.I4 0.0 (-38.6) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (-inf) 100.0 (-16.8) 100.0 (-16.8) 97.3 (-17.4) 0.0 (-inf)
90-42-5.Q0.5.I4 0.0 (-49.1) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (-inf) 100.0 (-17.0) 100.0 (-17.0) 97.7 (-17.7) 0.0 (-inf)
90-46-5.Q0.5.I4 0.0 (-61.1) 0.0 (nan) 0.0 (nan) 96.9 (-25.6) 0.0 (-inf) 98.7 (-24.9) 99.0 (-24.8) 99.1 (-24.8) 0.0 (-inf)
90-50-5.Q0.5.I3 0.0 (-74.0) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (-inf) 100.0 (-25.7) 98.7 (-26.4) 100.0 (-25.7) 0.0 (-inf)
Grids_20 0.0 (4678.4) 0.0 (4551.8) 81.9 (4810.0) 84.1 (4813.4) 84.2 (4813.6) 0.0 (nan) 51.7 (4761.5) 73.2 (4796.0) 70.3 (4791.3)
Grids_21 0.0 (8024.1) 1.2 (8029.6) 63.3 (8325.4) 99.7 (8498.3) 62.3 (8320.4) 54.1 (8281.5) 69.2 (8353.4) 83.3 (8420.1) 38.5 (8207.2)
Grids_22 0.0 (2717.7) 0.0 (2673.2) 70.2 (2800.2) 98.5 (2833.3) 53.5 (2780.6) 35.6 (2759.6) 59.9 (2788.1) 71.0 (2801.1) 51.1 (2777.8)
Grids_23 0.0 (2682.2) 0.0 (2652.1) 64.1 (2753.4) 99.7 (2793.0) 63.5 (2752.8) 98.8 (2792.1) 84.5 (2776.2) 88.3 (2780.3) 65.8 (2755.4)
Grids_24 0.0 (7827.3) 0.0 (7772.1) 79.6 (8153.5) 98.5 (8231.1) 55.8 (8056.1) 82.5 (8165.6) 80.6 (8157.8) 80.1 (8155.9) 45.8 (8015.2)
Grids_25 0.0 (1163.5) 0.0 (1148.2) 83.7 (1202.3) 98.7 (1209.3) 79.9 (1200.5) 98.7 (1209.3) 77.7 (1199.5) 98.4 (1209.1) 86.4 (1203.6)
Grids_26 0.0 (1273.1) 11.5 (1279.2) 100.0 (1326.3) 100.0 (1326.3) 76.8 (1314.0) 100.0 (1326.3) 89.1 (1320.5) 87.3 (1319.6) 29.5 (1288.8)
Grids_27 0.0 (5309.3) 0.0 (5097.4) 68.3 (5445.6) 100.0 (5508.9) 53.5 (5416.0) 43.4 (5395.9) 49.4 (5407.8) 84.3 (5477.6) 31.3 (5371.7)
Grids_28 0.0 (1942.1) 0.0 (1906.2) 98.0 (1981.7) 100.0 (1982.5) 0.0 (1941.5) 100.0 (1982.5) 65.6 (1968.6) 75.5 (1972.6) 0.0 (1923.8)
Grids_29 0.0 (652.0) 0.0 (651.2) 97.7 (672.5) 100.0 (673.0) 70.6 (666.8) 100.0 (673.0) 53.1 (663.2) 87.7 (670.4) 38.3 (660.1)
ImageAlignment_11 0.0 (-1262.4) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2)
ImageAlignment_12 0.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7)
ImageAlignment_13 0.0 (-3544.6) 100.0 (-2998.9) 99.8 (-2999.8) 99.8 (-2999.8) 91.6 (-3044.5) 99.8 (-2999.8) 99.8 (-2999.8) 99.8 (-2999.8) 99.0 (-3004.4)
ImageAlignment_14 0.0 (-1977.8) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5)
ImageAlignment_15 0.0 (-1563.7) 100.0 (-1177.5) 97.3 (-1188.0) 100.0 (-1177.5) 96.3 (-1191.7) 100.0 (-1177.5) 100.0 (-1177.5) 100.0 (-1177.5) 100.0 (-1177.5)
ObjectDetection_13 0.0 (9300.4) 0.0 (3426.7) 99.6 (9967.7) 82.6 (9854.2) 0.0 (8826.5) 100.0 (9970.6) 100.0 (9970.6) 100.0 (9970.6) 0.0 (8569.1)
ObjectDetection_14 0.0 (7808.8) 0.0 (4931.7) 94.3 (9020.8) 94.3 (9020.8) 41.5 (8341.9) 100.0 (9093.7) 100.0 (9093.7) 100.0 (9093.7) 64.6 (8638.2)
ObjectDetection_15 0.0 (10326.6) 0.0 (6985.6) 59.7 (11703.8) 93.3 (12478.6) 52.8 (11543.7) 100.0 (12633.3) 100.0 (12633.3) 100.0 (12633.3) 68.9 (11916.6)
ObjectDetection_16 0.0 (11636.8) 0.0 (6928.8) 92.9 (14154.2) 62.3 (13326.1) 70.5 (13547.6) 100.0 (14347.1) 100.0 (14347.1) 100.0 (14347.1) 83.5 (13900.5)
ObjectDetection_17 0.0 (2224.9) 0.0 (-837.6) 93.6 (4716.4) 97.3 (4816.0) 59.3 (3804.5) 100.0 (4887.4) 100.0 (4887.4) 100.0 (4887.4) 66.4 (3992.8)
ProteinFolding_11 0.0 (1351.6) 100.0 (1962.3) 100.0 (1962.3) 100.0 (1962.3) 78.4 (1830.2) 100.0 (1962.3) 98.4 (1952.7) 97.1 (1944.8) 16.6 (1452.8)
ProteinFolding_12 0.0 (-1857.9) 100.0 (-1547.0) 100.0 (-1547.0) 100.0 (-1547.0) 100.0 (-1547.0) 100.0 (-1547.0) 100.0 (-1547.0) 100.0 (-1547.0) 99.3 (-1549.1)
ProteinFolding_13 0.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3)
ProteinFolding_14 0.0 (-620.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7)
ProteinFolding_15 0.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6)
Segmentation_11 0.0 (-140.3) 75.8 (-134.1) 62.6 (-135.2) 97.8 (-132.3) 85.5 (-133.3) 97.8 (-132.3) 97.8 (-132.3) 97.8 (-132.3) 57.0 (-135.6)
Segmentation_12 0.0 (-39.3) 100.0 (-21.9) 100.0 (-21.9) 100.0 (-21.9) 52.8 (-30.1) 100.0 (-21.9) 100.0 (-21.9) 100.0 (-21.9) 100.0 (-21.9)
Segmentation_13 0.0 (-39.5) 100.0 (-21.4) 100.0 (-21.4) 100.0 (-21.4) 100.0 (-21.4) 100.0 (-21.4) 100.0 (-21.4) 100.0 (-21.4) 100.0 (-21.4)
Segmentation_14 0.0 (-43.0) 100.0 (-39.3) 100.0 (-39.3) 100.0 (-39.3) 76.4 (-40.2) 100.0 (-39.3) 100.0 (-39.3) 100.0 (-39.3) 52.4 (-41.1)
Segmentation_15 0.0 (-184.1) 96.3 (-164.5) 70.2 (-169.8) 100.0 (-163.8) 76.6 (-168.5) 100.0 (-163.8) 100.0 (-163.8) 100.0 (-163.8) 73.4 (-169.2)
Segmentation_16 0.0 (-44.6) 100.0 (-40.4) 100.0 (-40.4) 100.0 (-40.4) 100.0 (-40.4) 100.0 (-40.4) 100.0 (-40.4) 100.0 (-40.4) 91.5 (-40.8)
Segmentation_17 0.0 (-189.8) 93.0 (-175.4) 92.9 (-175.4) 100.0 (-174.3) 93.7 (-175.3) 100.0 (-174.3) 100.0 (-174.3) 100.0 (-174.3) 89.6 (-175.9)
Segmentation_18 0.0 (-48.3) 100.0 (-34.0) 100.0 (-34.0) 100.0 (-34.0) 86.9 (-35.9) 100.0 (-34.0) 100.0 (-34.0) 100.0 (-34.0) 71.3 (-38.1)
Segmentation_19 0.0 (-35.9) 100.0 (-24.1) 100.0 (-24.1) 100.0 (-24.1) 88.8 (-25.4) 100.0 (-24.1) 100.0 (-24.1) 100.0 (-24.1) 100.0 (-24.1)
Segmentation_20 0.0 (-130.1) 99.8 (-112.0) 96.0 (-112.7) 100.0 (-112.0) 98.0 (-112.4) 100.0 (-112.0) 100.0 (-112.0) 100.0 (-112.0) 74.0 (-116.7)
bw_p24_16 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p24_20 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p34_15 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p34_20 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p44_15 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p44_19 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p54_10 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p54_16 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
comm_p01_16 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
comm_p01_20 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_11.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_16.fg.Q0.5.I3 0.0 (-73.1) 0.0 (nan) 97.5 (-24.7) 100.0 (-23.4) 0.0 (-inf) 100.0 (-23.4) 100.0 (-23.4) 99.7 (-23.6) 0.0 (-inf)
or_chain_22.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_24.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_25.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_32.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_36.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_39.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_40.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_41.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_43.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_6.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_60.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_63.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_8.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
pedigree1.Q0.5.I3 0.0 (-42.1) 0.0 (-inf) 78.2 (-37.1) 78.2 (-37.1) 0.0 (-inf) 78.2 (-37.1) 100.0 (-35.7) 94.0 (-36.1) 53.4 (-38.7)
pedigree13.Q0.5.I1 0.0 (-94.6) 0.0 (-inf) 98.4 (-62.9) 99.8 (-62.5) 0.0 (-inf) 99.0 (-62.7) 99.2 (-62.7) 99.7 (-62.5) 0.0 (-inf)
pedigree18.Q0.5.I1 0.0 (-167.0) 0.0 (-inf) 100.0 (-111.7) 95.5 (-114.1) 0.0 (-inf) 97.8 (-112.9) 97.2 (-113.2) 96.7 (-113.5) 0.0 (-inf)
pedigree19.Q0.5.I4 0.0 (-156.8) 86.7 (-95.9) 98.5 (-87.7) 94.8 (-90.3) 0.0 (-inf) 95.5 (-89.8) 93.0 (-91.5) 93.9 (-90.9) 0.0 (-inf)
pedigree20.Q0.5.I2 0.0 (-89.8) 88.7 (-51.0) 98.7 (-46.7) 97.7 (-47.1) 0.0 (-inf) 97.7 (-47.1) 100.0 (-46.1) 100.0 (-46.1) 0.0 (-inf)
pedigree25.Q0.5.I2 0.0 (-193.7) 70.4 (-159.8) 94.5 (-148.2) 97.0 (-147.0) 0.0 (-inf) 96.0 (-147.5) 96.4 (-147.3) 100.0 (-145.6) 0.0 (-inf)
pedigree30.Q0.5.I2 0.0 (-186.6) 0.0 (-inf) 94.3 (-126.7) 98.3 (-124.2) 0.0 (-inf) 98.2 (-124.2) 97.6 (-124.6) 98.8 (-123.9) 0.0 (-inf)
pedigree31.Q0.5.I2 0.0 (-195.5) 88.7 (-124.5) 99.0 (-116.2) 98.0 (-117.0) 0.0 (-inf) 99.6 (-115.8) 97.2 (-117.6) 100.0 (-115.4) 59.7 (-147.7)
pedigree33.Q0.5.I2 0.0 (-127.2) 80.4 (-79.4) 95.4 (-70.5) 97.1 (-69.5) 0.0 (-inf) 94.1 (-71.3) 95.6 (-70.4) 94.4 (-71.1) 0.0 (-inf)
pedigree38.Q0.5.I2 0.0 (-124.7) 62.8 (-95.0) 99.7 (-77.5) 100.0 (-77.4) 0.0 (-inf) 99.5 (-77.6) 99.6 (-77.6) 99.2 (-77.8) 0.0 (-inf)
pedigree41.Q0.5.I2 0.0 (-175.4) 0.0 (-inf) 96.1 (-108.3) 97.2 (-107.5) 0.0 (-inf) 97.0 (-107.7) 96.4 (-108.1) 98.4 (-106.7) 0.0 (-inf)
pedigree44.Q0.5.I4 0.0 (-135.0) 85.6 (-94.5) 97.7 (-88.8) 96.1 (-89.5) 0.0 (-inf) 96.4 (-89.3) 97.8 (-88.7) 100.0 (-87.7) 0.0 (-inf)
pedigree50.Q0.5.I1 0.0 (-83.2) 95.7 (-53.3) 97.2 (-52.9) 98.3 (-52.5) 0.0 (-inf) 95.1 (-53.5) 96.5 (-53.1) 100.0 (-52.0) 64.0 (-63.2)
pedigree7.Q0.5.I2 0.0 (-136.9) 0.0 (-inf) 94.3 (-99.8) 97.5 (-98.5) 0.0 (-inf) 97.2 (-98.6) 98.9 (-98.0) 97.9 (-98.3) 0.0 (-inf)
pedigree9.Q0.5.I3 0.0 (-178.2) 0.0 (nan) 97.9 (-114.1) 98.2 (-113.9) 0.0 (-inf) 98.3 (-113.8) 99.8 (-112.8) 95.9 (-115.4) 0.0 (-inf)
pomdp10-12_7_3_8_4.mmap 0.0 (1.2) 0.0 (nan) 100.0 (1.2) 99.5 (1.2) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
pomdp6-12_6_2_6_3.mmap 0.0 (0.9) 95.2 (1.0) 94.4 (1.0) 70.8 (1.0) 95.2 (1.0) 64.2 (1.0) 72.0 (1.0) 93.8 (1.0) 100.0 (1.0)
pomdp7-20_10_2_10_3.mmap 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
pomdp8-14_9_3_12_4.mmap 0.0 (1.4) 0.0 (nan) 88.9 (1.4) 89.8 (1.4) 89.9 (1.4) 0.0 (nan) 89.6 (1.4) 88.3 (1.4) 0.0 (nan)
pomdp9-14_8_3_10_4.mmap 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
wcsp_14 0.0 (-125.3) 78.5 (-26.1) 82.5 (-21.0) 81.5 (-22.3) 0.0 (-402.5) 92.0 (-9.0) 100.0 (1.1) 100.0 (1.1) 0.0 (nan)
wcsp_15 0.0 (-184.6) 0.0 (-185.1) 95.1 (-80.0) 95.1 (-80.0) 0.0 (-1503.1) 99.3 (-75.4) 96.4 (-78.6) 78.3 (-98.4) 0.0 (-409.1)
wcsp_16 0.0 (-72.0) 52.8 (-21.7) 80.6 (4.8) 99.5 (22.8) 0.0 (-302.0) 99.6 (22.8) 99.6 (22.8) 100.0 (23.2) 76.3 (0.7)
wcsp_17 0.0 (-153.8) 0.0 (-744.5) 86.1 (8.7) 92.2 (20.3) 0.0 (-526.8) 69.8 (-22.1) 99.1 (33.4) 99.9 (34.8) 67.9 (-25.6)
wcsp_18 0.0 (-57.9) 0.0 (-698.7) 58.1 (-24.1) 75.2 (-14.2) 0.0 (-110.9) 100.0 (0.2) 100.0 (0.2) 100.0 (0.2) 0.0 (-73.4)

1200sec

Problem baseline braobb-mmap daoopt-lh-mmap daoopt-mmap lbp-mmap toulbar2-ipr-mmap toulbar2-vacint-mmap toulbar2-vns-mmap uai14-mmap
75-17-5.Q0.5.I4 0.0 (-18.6) 100.0 (-7.5) 97.9 (-7.7) 97.9 (-7.7) 0.0 (-inf) 97.9 (-7.7) 97.9 (-7.7) 97.9 (-7.7) 54.2 (-12.6)
75-19-5.Q0.5.I2 0.0 (-23.6) 99.6 (-9.7) 100.0 (-9.6) 100.0 (-9.6) 0.0 (-inf) 100.0 (-9.6) 100.0 (-9.6) 100.0 (-9.6) 55.0 (-15.9)
75-22-5.Q0.5.I2 0.0 (-32.9) 0.0 (-inf) 98.3 (-11.7) 98.3 (-11.7) 0.0 (-inf) 98.3 (-11.7) 98.3 (-11.7) 98.3 (-11.7) 0.0 (-inf)
75-23-5.Q0.5.I3 0.0 (-33.9) 94.0 (-13.8) 100.0 (-12.5) 100.0 (-12.5) 0.0 (-inf) 100.0 (-12.5) 100.0 (-12.5) 100.0 (-12.5) 0.0 (-inf)
75-26-5.Q0.5.I4 0.0 (-47.0) 99.3 (-18.3) 100.0 (-18.1) 100.0 (-18.1) 0.0 (-inf) 100.0 (-18.1) 100.0 (-18.1) 100.0 (-18.1) 0.0 (-inf)
90-22-5.Q0.5.I4 0.0 (-19.0) 100.0 (-5.6) 100.0 (-5.6) 100.0 (-5.6) 0.0 (-inf) 100.0 (-5.6) 100.0 (-5.6) 100.0 (-5.6) 0.0 (-inf)
90-24-5.Q0.5.I2 0.0 (-17.9) 100.0 (-5.6) 99.3 (-5.7) 99.4 (-5.7) 0.0 (-inf) 99.4 (-5.7) 99.4 (-5.7) 99.4 (-5.7) 0.0 (-inf)
90-25-5.Q0.5.I2 0.0 (-27.8) 0.0 (nan) 98.7 (-8.0) 100.0 (-7.7) 0.0 (-inf) 100.0 (-7.7) 100.0 (-7.7) 100.0 (-7.7) 0.0 (-inf)
90-26-5.Q0.5.I1 0.0 (-23.8) 0.0 (-inf) 95.2 (-9.3) 99.5 (-8.7) 0.0 (-inf) 99.5 (-8.7) 99.5 (-8.7) 99.5 (-8.7) 0.0 (-inf)
90-30-5.Q0.5.I1 0.0 (-27.3) 95.6 (-11.6) 100.0 (-10.9) 100.0 (-10.9) 0.0 (-inf) 100.0 (-10.9) 100.0 (-10.9) 100.0 (-10.9) 0.0 (-inf)
90-34-5.Q0.5.I2 0.0 (-38.5) 0.0 (nan) 92.2 (-14.2) 100.0 (-12.2) 0.0 (-inf) 100.0 (-12.2) 100.0 (-12.2) 100.0 (-12.2) 0.0 (-inf)
90-38-5.Q0.5.I4 0.0 (-38.6) 0.0 (nan) 0.0 (nan) 100.0 (-16.8) 0.0 (-inf) 100.0 (-16.8) 100.0 (-16.8) 100.0 (-16.8) 0.0 (-inf)
90-42-5.Q0.5.I4 0.0 (-49.1) 0.0 (nan) 0.0 (nan) 100.0 (-17.0) 0.0 (-inf) 100.0 (-17.0) 100.0 (-17.0) 100.0 (-17.0) 0.0 (-inf)
90-46-5.Q0.5.I4 0.0 (-61.1) 0.0 (nan) 0.0 (nan) 98.7 (-24.9) 0.0 (-inf) 98.7 (-24.9) 98.7 (-24.9) 98.4 (-25.0) 0.0 (-inf)
90-50-5.Q0.5.I3 0.0 (-74.0) 76.9 (-36.9) 0.0 (nan) 99.2 (-26.1) 0.0 (-inf) 100.0 (-25.7) 100.0 (-25.7) 100.0 (-25.7) 0.0 (-inf)
Grids_20 0.0 (4678.4) 0.0 (4551.2) 96.7 (4833.8) 99.6 (4838.4) 78.7 (4804.9) 99.0 (4837.5) 82.7 (4811.2) 98.4 (4836.5) 0.0 (nan)
Grids_21 0.0 (8024.1) 4.5 (8045.3) 83.3 (8420.1) 100.0 (8499.7) 62.8 (8322.9) 94.1 (8471.7) 70.2 (8357.8) 87.0 (8438.1) 37.8 (8203.9)
Grids_22 0.0 (2717.7) 0.0 (2686.7) 96.7 (2831.3) 100.0 (2835.2) 38.9 (2763.4) 100.0 (2835.2) 66.9 (2796.2) 90.0 (2823.4) 56.2 (2783.7)
Grids_23 0.0 (2682.2) 0.0 (2654.3) 98.1 (2791.3) 99.7 (2793.0) 51.3 (2739.2) 99.7 (2793.0) 86.8 (2778.7) 88.3 (2780.3) 72.5 (2762.8)
Grids_24 0.0 (7827.3) 0.0 (7746.2) 97.8 (8228.5) 100.0 (8237.3) 68.1 (8106.5) 94.4 (8214.3) 81.4 (8160.9) 84.8 (8175.2) 62.1 (8082.1)
Grids_25 0.0 (1163.5) 100.0 (1209.9) 98.7 (1209.3) 98.7 (1209.3) 88.6 (1204.6) 98.7 (1209.3) 77.7 (1199.5) 98.4 (1209.1) 85.3 (1203.1)
Grids_26 0.0 (1273.1) 92.4 (1322.2) 100.0 (1326.3) 100.0 (1326.3) 51.4 (1300.4) 100.0 (1326.3) 90.8 (1321.4) 87.3 (1319.6) 45.8 (1297.5)
Grids_27 0.0 (5309.3) 99.1 (5507.0) 95.3 (5499.6) 100.0 (5508.9) 37.0 (5383.1) 97.6 (5504.1) 49.5 (5408.1) 90.4 (5489.7) 37.4 (5384.0)
Grids_28 0.0 (1942.1) 66.7 (1969.1) 100.0 (1982.5) 100.0 (1982.5) 0.0 (1924.7) 100.0 (1982.5) 88.1 (1977.7) 75.5 (1972.6) 0.0 (1940.8)
Grids_29 0.0 (652.0) 81.6 (669.2) 100.0 (673.0) 100.0 (673.0) 50.5 (662.6) 100.0 (673.0) 96.6 (672.3) 87.7 (670.4) 35.2 (659.4)
ImageAlignment_11 0.0 (-1262.4) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2)
ImageAlignment_12 0.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7)
ImageAlignment_13 0.0 (-3544.6) 100.0 (-2998.9) 99.8 (-2999.8) 99.8 (-2999.8) 100.0 (-2998.9) 99.8 (-2999.8) 99.8 (-2999.8) 99.8 (-2999.8) 100.0 (-2998.9)
ImageAlignment_14 0.0 (-1977.8) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5)
ImageAlignment_15 0.0 (-1563.7) 100.0 (-1177.5) 97.3 (-1188.0) 100.0 (-1177.5) 100.0 (-1177.5) 100.0 (-1177.5) 100.0 (-1177.5) 100.0 (-1177.5) 0.0 (nan)
ObjectDetection_13 0.0 (9300.4) 0.0 (6684.3) 99.6 (9967.7) 82.6 (9854.2) 0.0 (8826.5) 100.0 (9970.6) 100.0 (9970.6) 100.0 (9970.6) 0.0 (8883.1)
ObjectDetection_14 0.0 (7808.8) 0.0 (6712.5) 94.3 (9020.8) 94.3 (9020.8) 41.5 (8341.9) 100.0 (9093.7) 100.0 (9093.7) 100.0 (9093.7) 58.7 (8562.9)
ObjectDetection_15 0.0 (10326.6) 13.1 (10627.8) 59.7 (11703.8) 93.3 (12478.6) 52.8 (11543.7) 100.0 (12633.3) 100.0 (12633.3) 100.0 (12633.3) 71.5 (11976.2)
ObjectDetection_16 0.0 (11636.8) 14.3 (12023.3) 92.9 (14154.2) 70.1 (13536.2) 70.5 (13547.6) 100.0 (14347.1) 100.0 (14347.1) 100.0 (14347.1) 88.0 (14021.5)
ObjectDetection_17 0.0 (2224.9) 8.6 (2454.9) 93.6 (4716.4) 97.3 (4816.0) 59.0 (3794.9) 100.0 (4887.4) 100.0 (4887.4) 100.0 (4887.4) 86.1 (4518.2)
ProteinFolding_11 0.0 (1351.6) 100.0 (1962.3) 100.0 (1962.3) 100.0 (1962.3) 79.9 (1839.4) 100.0 (1962.3) 99.6 (1959.7) 97.1 (1944.8) 16.9 (1455.1)
ProteinFolding_12 0.0 (-1857.9) 100.0 (-1547.0) 100.0 (-1547.0) 100.0 (-1547.0) 99.7 (-1548.0) 100.0 (-1547.0) 100.0 (-1547.0) 100.0 (-1547.0) 0.0 (nan)
ProteinFolding_13 0.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3)
ProteinFolding_14 0.0 (-620.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7)
ProteinFolding_15 0.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6)
Segmentation_11 0.0 (-140.3) 100.0 (-132.1) 62.6 (-135.2) 97.8 (-132.3) 85.5 (-133.3) 97.8 (-132.3) 97.8 (-132.3) 97.8 (-132.3) 84.5 (-133.4)
Segmentation_12 0.0 (-39.3) 100.0 (-21.9) 100.0 (-21.9) 100.0 (-21.9) 52.8 (-30.1) 100.0 (-21.9) 100.0 (-21.9) 100.0 (-21.9) 100.0 (-21.9)
Segmentation_13 0.0 (-39.5) 100.0 (-21.4) 100.0 (-21.4) 100.0 (-21.4) 100.0 (-21.4) 100.0 (-21.4) 100.0 (-21.4) 100.0 (-21.4) 100.0 (-21.4)
Segmentation_14 0.0 (-43.0) 100.0 (-39.3) 100.0 (-39.3) 100.0 (-39.3) 76.4 (-40.2) 100.0 (-39.3) 100.0 (-39.3) 100.0 (-39.3) 84.9 (-39.8)
Segmentation_15 0.0 (-184.1) 71.3 (-169.6) 70.2 (-169.8) 100.0 (-163.8) 76.6 (-168.5) 100.0 (-163.8) 100.0 (-163.8) 100.0 (-163.8) 75.1 (-168.8)
Segmentation_16 0.0 (-44.6) 100.0 (-40.4) 100.0 (-40.4) 100.0 (-40.4) 100.0 (-40.4) 100.0 (-40.4) 100.0 (-40.4) 100.0 (-40.4) 91.5 (-40.8)
Segmentation_17 0.0 (-189.8) 88.0 (-176.2) 92.9 (-175.4) 100.0 (-174.3) 93.7 (-175.3) 100.0 (-174.3) 100.0 (-174.3) 100.0 (-174.3) 90.0 (-175.9)
Segmentation_18 0.0 (-48.3) 100.0 (-34.0) 100.0 (-34.0) 100.0 (-34.0) 86.9 (-35.9) 100.0 (-34.0) 100.0 (-34.0) 100.0 (-34.0) 100.0 (-34.0)
Segmentation_19 0.0 (-35.9) 100.0 (-24.1) 100.0 (-24.1) 100.0 (-24.1) 88.8 (-25.4) 100.0 (-24.1) 100.0 (-24.1) 100.0 (-24.1) 100.0 (-24.1)
Segmentation_20 0.0 (-130.1) 100.0 (-112.0) 96.0 (-112.7) 100.0 (-112.0) 98.0 (-112.4) 100.0 (-112.0) 100.0 (-112.0) 100.0 (-112.0) 92.0 (-113.5)
bw_p24_16 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p24_20 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p34_15 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p34_20 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p44_15 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p44_19 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p54_10 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p54_16 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
comm_p01_16 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
comm_p01_20 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_11.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_16.fg.Q0.5.I3 0.0 (-73.1) 44.1 (-51.2) 96.5 (-25.2) 100.0 (-23.4) 0.0 (-inf) 100.0 (-23.4) 100.0 (-23.4) 100.0 (-23.4) 0.0 (-inf)
or_chain_22.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_24.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_25.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_32.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_36.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_39.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_40.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_41.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_43.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_6.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_60.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_63.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_8.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
pedigree1.Q0.5.I3 0.0 (-42.1) 0.0 (-inf) 76.0 (-37.3) 98.7 (-35.8) 0.0 (-inf) 100.0 (-35.7) 100.0 (-35.7) 94.0 (-36.1) 68.1 (-37.8)
pedigree13.Q0.5.I1 0.0 (-94.6) 0.0 (-inf) 98.4 (-62.9) 100.0 (-62.4) 0.0 (-inf) 98.8 (-62.8) 99.2 (-62.7) 99.7 (-62.5) 0.0 (-inf)
pedigree18.Q0.5.I1 0.0 (-167.0) 0.0 (-inf) 99.1 (-112.2) 95.4 (-114.2) 0.0 (-inf) 99.0 (-112.2) 96.8 (-113.4) 96.7 (-113.5) 91.5 (-116.4)
pedigree19.Q0.5.I4 0.0 (-156.8) 87.4 (-95.4) 100.0 (-86.6) 97.9 (-88.1) 0.0 (-inf) 99.2 (-87.2) 94.6 (-90.4) 94.8 (-90.2) 0.0 (-inf)
pedigree20.Q0.5.I2 0.0 (-89.8) 0.0 (-inf) 98.4 (-46.8) 99.4 (-46.4) 0.0 (-inf) 95.8 (-47.9) 100.0 (-46.1) 100.0 (-46.1) 38.8 (-72.8)
pedigree25.Q0.5.I2 0.0 (-193.7) 81.1 (-154.6) 94.6 (-148.1) 96.4 (-147.3) 0.0 (-inf) 95.8 (-147.6) 96.4 (-147.3) 95.4 (-147.8) 37.4 (-175.7)
pedigree30.Q0.5.I2 0.0 (-186.6) 0.0 (-inf) 96.7 (-125.2) 99.7 (-123.3) 0.0 (-inf) 99.3 (-123.6) 100.0 (-123.1) 98.2 (-124.3) 72.1 (-140.8)
pedigree31.Q0.5.I2 0.0 (-195.5) 96.1 (-118.5) 99.0 (-116.2) 98.5 (-116.6) 0.0 (-inf) 98.1 (-117.0) 97.2 (-117.6) 99.8 (-115.6) 0.0 (-inf)
pedigree33.Q0.5.I2 0.0 (-127.2) 100.0 (-67.8) 94.1 (-71.3) 94.6 (-71.0) 0.0 (-inf) 94.6 (-71.0) 95.6 (-70.4) 94.4 (-71.1) 0.0 (-inf)
pedigree38.Q0.5.I2 0.0 (-124.7) 70.3 (-91.4) 99.7 (-77.5) 98.5 (-78.1) 0.0 (-inf) 99.9 (-77.5) 99.6 (-77.6) 99.2 (-77.8) 72.2 (-90.5)
pedigree41.Q0.5.I2 0.0 (-175.4) 0.0 (-inf) 98.5 (-106.6) 99.0 (-106.3) 0.0 (-inf) 97.9 (-107.0) 97.0 (-107.7) 96.3 (-108.2) 21.0 (-160.7)
pedigree44.Q0.5.I4 0.0 (-135.0) 77.9 (-98.2) 96.8 (-89.2) 97.8 (-88.7) 0.0 (-inf) 96.8 (-89.2) 96.3 (-89.4) 96.5 (-89.3) 0.0 (-inf)
pedigree50.Q0.5.I1 0.0 (-83.2) 88.2 (-55.7) 96.5 (-53.1) 99.3 (-52.2) 0.0 (-inf) 96.3 (-53.1) 96.5 (-53.1) 100.0 (-52.0) 43.6 (-69.6)
pedigree7.Q0.5.I2 0.0 (-136.9) 0.0 (-inf) 98.9 (-98.0) 96.0 (-99.1) 0.0 (-inf) 97.8 (-98.4) 98.9 (-98.0) 97.9 (-98.3) 0.0 (-inf)
pedigree9.Q0.5.I3 0.0 (-178.2) 0.0 (-inf) 98.3 (-113.8) 99.0 (-113.3) 0.0 (-inf) 98.3 (-113.8) 100.0 (-112.7) 98.0 (-114.0) 29.3 (-159.0)
pomdp10-12_7_3_8_4.mmap 0.0 (1.2) 0.0 (nan) 100.0 (1.2) 99.3 (1.2) 100.0 (1.2) 41.0 (1.2) 100.0 (1.2) 100.0 (1.2) 100.0 (1.2)
pomdp6-12_6_2_6_3.mmap 0.0 (0.9) 95.2 (1.0) 94.4 (1.0) 55.2 (0.9) 95.2 (1.0) 93.8 (1.0) 93.8 (1.0) 93.8 (1.0) 95.2 (1.0)
pomdp7-20_10_2_10_3.mmap 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
pomdp8-14_9_3_12_4.mmap 0.0 (1.4) 0.0 (nan) 90.0 (1.4) 55.5 (1.4) 100.0 (1.4) 88.8 (1.4) 89.6 (1.4) 89.3 (1.4) 0.0 (nan)
pomdp9-14_8_3_10_4.mmap 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
wcsp_14 0.0 (-125.3) 76.0 (-29.2) 82.5 (-21.0) 100.0 (1.1) 0.0 (-637.3) 100.0 (1.1) 100.0 (1.1) 100.0 (1.1) 82.3 (-21.3)
wcsp_15 0.0 (-184.6) 19.2 (-163.6) 95.1 (-80.0) 100.0 (-74.6) 0.0 (-1503.1) 99.3 (-75.4) 96.4 (-78.6) 92.0 (-83.4) 0.0 (-228.9)
wcsp_16 0.0 (-72.0) 70.6 (-4.8) 80.6 (4.8) 99.9 (23.2) 0.0 (-334.1) 99.6 (22.9) 99.6 (22.8) 100.0 (23.2) 74.3 (-1.3)
wcsp_17 0.0 (-153.8) 26.5 (-103.7) 86.1 (8.7) 99.3 (33.6) 0.0 (-513.4) 99.9 (34.9) 100.0 (35.0) 99.9 (34.8) 0.0 (nan)
wcsp_18 0.0 (-57.9) 0.0 (-508.3) 58.1 (-24.1) 100.0 (0.2) 57.0 (-24.8) 100.0 (0.2) 100.0 (0.2) 100.0 (0.2) 70.6 (-16.9)

3600sec

Problem baseline braobb-mmap daoopt-lh-mmap daoopt-mmap lbp-mmap toulbar2-ipr-mmap toulbar2-vacint-mmap toulbar2-vns-mmap uai14-mmap
75-17-5.Q0.5.I4 0.0 (-18.6) 100.0 (-7.5) 97.9 (-7.7) 97.9 (-7.7) 0.0 (-inf) 97.9 (-7.7) 97.9 (-7.7) 97.9 (-7.7) 41.0 (-14.1)
75-19-5.Q0.5.I2 0.0 (-23.6) 99.6 (-9.7) 100.0 (-9.6) 100.0 (-9.6) 0.0 (-inf) 100.0 (-9.6) 100.0 (-9.6) 100.0 (-9.6) 55.0 (-15.9)
75-22-5.Q0.5.I2 0.0 (-32.9) 0.0 (-inf) 97.8 (-11.8) 98.3 (-11.7) 0.0 (-inf) 98.3 (-11.7) 98.3 (-11.7) 98.3 (-11.7) 0.0 (-inf)
75-23-5.Q0.5.I3 0.0 (-33.9) 94.0 (-13.8) 100.0 (-12.5) 100.0 (-12.5) 0.0 (-inf) 100.0 (-12.5) 100.0 (-12.5) 100.0 (-12.5) 0.0 (-inf)
75-26-5.Q0.5.I4 0.0 (-47.0) 99.4 (-18.3) 100.0 (-18.1) 100.0 (-18.1) 0.0 (-inf) 100.0 (-18.1) 100.0 (-18.1) 100.0 (-18.1) 0.0 (-inf)
90-22-5.Q0.5.I4 0.0 (-19.0) 100.0 (-5.6) 100.0 (-5.6) 100.0 (-5.6) 0.0 (-inf) 100.0 (-5.6) 100.0 (-5.6) 100.0 (-5.6) 0.0 (-inf)
90-24-5.Q0.5.I2 0.0 (-17.9) 100.0 (-5.6) 99.4 (-5.7) 99.4 (-5.7) 0.0 (-inf) 99.4 (-5.7) 99.4 (-5.7) 99.4 (-5.7) 0.0 (-inf)
90-25-5.Q0.5.I2 0.0 (-27.8) 0.0 (nan) 99.7 (-7.8) 100.0 (-7.7) 0.0 (-inf) 100.0 (-7.7) 100.0 (-7.7) 100.0 (-7.7) 0.0 (-inf)
90-26-5.Q0.5.I1 0.0 (-23.8) 0.0 (-inf) 96.5 (-9.1) 99.5 (-8.7) 0.0 (-inf) 99.5 (-8.7) 99.5 (-8.7) 99.5 (-8.7) 0.0 (-inf)
90-30-5.Q0.5.I1 0.0 (-27.3) 96.5 (-11.5) 100.0 (-10.9) 100.0 (-10.9) 0.0 (-inf) 100.0 (-10.9) 100.0 (-10.9) 100.0 (-10.9) 0.0 (-inf)
90-34-5.Q0.5.I2 0.0 (-38.5) 0.0 (nan) 92.2 (-14.2) 100.0 (-12.2) 0.0 (-inf) 100.0 (-12.2) 100.0 (-12.2) 100.0 (-12.2) 0.0 (-inf)
90-38-5.Q0.5.I4 0.0 (-38.6) 0.0 (nan) 0.0 (nan) 100.0 (-16.8) 0.0 (-inf) 100.0 (-16.8) 100.0 (-16.8) 100.0 (-16.8) 0.0 (-inf)
90-42-5.Q0.5.I4 0.0 (-49.1) 0.0 (nan) 0.0 (nan) 100.0 (-17.0) 0.0 (-inf) 100.0 (-17.0) 100.0 (-17.0) 100.0 (-17.0) 0.0 (-inf)
90-46-5.Q0.5.I4 0.0 (-61.1) 0.0 (nan) 0.0 (nan) 99.0 (-24.8) 0.0 (-inf) 98.7 (-24.9) 98.7 (-24.9) 100.0 (-24.5) 0.0 (-inf)
90-50-5.Q0.5.I3 0.0 (-74.0) 76.9 (-36.9) 0.0 (nan) 97.7 (-26.8) 0.0 (-inf) 100.0 (-25.7) 100.0 (-25.7) 100.0 (-25.7) 0.0 (-inf)
Grids_20 0.0 (4678.4) 0.0 (4518.7) 96.8 (4833.9) 100.0 (4839.0) 78.7 (4804.9) 99.0 (4837.5) 86.1 (4816.7) 98.4 (4836.5) 0.0 (nan)
Grids_21 0.0 (8024.1) 0.0 (8002.4) 85.2 (8429.3) 100.0 (8499.7) 62.8 (8322.9) 100.0 (8499.7) 70.2 (8357.8) 87.0 (8438.1) 41.7 (8222.4)
Grids_22 0.0 (2717.7) 0.0 (2687.2) 98.8 (2833.8) 100.0 (2835.2) 38.9 (2763.4) 100.0 (2835.2) 67.6 (2797.1) 90.0 (2823.4) 62.2 (2790.8)
Grids_23 0.0 (2682.2) 94.5 (2787.3) 100.0 (2793.4) 99.7 (2793.0) 51.3 (2739.2) 99.7 (2793.0) 86.8 (2778.7) 88.3 (2780.3) 74.5 (2765.0)
Grids_24 0.0 (7827.3) 92.0 (8204.5) 99.3 (8234.4) 100.0 (8237.3) 68.1 (8106.5) 100.0 (8237.3) 81.4 (8160.9) 84.8 (8175.2) 47.8 (8023.4)
Grids_25 0.0 (1163.5) 100.0 (1209.9) 97.8 (1208.9) 98.7 (1209.3) 88.6 (1204.6) 98.7 (1209.3) 77.7 (1199.5) 98.4 (1209.1) 98.0 (1209.0)
Grids_26 0.0 (1273.1) 92.4 (1322.2) 100.0 (1326.3) 100.0 (1326.3) 51.4 (1300.4) 100.0 (1326.3) 90.8 (1321.4) 92.4 (1322.2) 14.7 (1280.9)
Grids_27 0.0 (5309.3) 99.1 (5507.0) 99.0 (5506.8) 100.0 (5508.9) 37.0 (5383.1) 100.0 (5508.9) 56.7 (5422.5) 90.4 (5489.7) 34.7 (5378.4)
Grids_28 0.0 (1942.1) 66.7 (1969.1) 100.0 (1982.5) 100.0 (1982.5) 0.0 (1924.7) 100.0 (1982.5) 89.4 (1978.2) 75.5 (1972.6) 15.0 (1948.2)
Grids_29 0.0 (652.0) 81.6 (669.2) 100.0 (673.0) 100.0 (673.0) 50.5 (662.6) 100.0 (673.0) 96.6 (672.3) 87.7 (670.4) 67.8 (666.3)
ImageAlignment_11 0.0 (-1262.4) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2) 100.0 (-824.2)
ImageAlignment_12 0.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7) 100.0 (-436.7)
ImageAlignment_13 0.0 (-3544.6) 100.0 (-2998.9) 99.8 (-2999.8) 99.8 (-2999.8) 100.0 (-2998.9) 99.8 (-2999.8) 99.8 (-2999.8) 99.8 (-2999.8) 100.0 (-2998.9)
ImageAlignment_14 0.0 (-1977.8) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5) 100.0 (-1557.5)
ImageAlignment_15 0.0 (-1563.7) 100.0 (-1177.5) 100.0 (-1177.5) 100.0 (-1177.5) 100.0 (-1177.5) 100.0 (-1177.5) 100.0 (-1177.5) 100.0 (-1177.5) 0.0 (nan)
ObjectDetection_13 0.0 (9300.4) 0.0 (6684.3) 99.6 (9967.7) 82.6 (9854.2) 0.0 (8826.5) 100.0 (9970.6) 100.0 (9970.6) 100.0 (9970.6) 0.0 (8883.1)
ObjectDetection_14 0.0 (7808.8) 0.0 (6712.5) 94.3 (9020.8) 94.3 (9020.8) 41.5 (8341.9) 100.0 (9093.7) 100.0 (9093.7) 100.0 (9093.7) 58.7 (8562.9)
ObjectDetection_15 0.0 (10326.6) 13.1 (10627.8) 59.7 (11703.8) 93.3 (12478.6) 52.8 (11543.7) 100.0 (12633.3) 100.0 (12633.3) 100.0 (12633.3) 71.5 (11976.2)
ObjectDetection_16 0.0 (11636.8) 14.3 (12023.3) 92.9 (14154.2) 70.1 (13536.2) 70.5 (13547.6) 100.0 (14347.1) 100.0 (14347.1) 100.0 (14347.1) 88.0 (14021.5)
ObjectDetection_17 0.0 (2224.9) 8.6 (2454.9) 93.6 (4716.4) 97.3 (4816.0) 59.0 (3794.9) 100.0 (4887.4) 100.0 (4887.4) 100.0 (4887.4) 86.1 (4518.2)
ProteinFolding_11 0.0 (1351.6) 100.0 (1962.3) 100.0 (1962.3) 100.0 (1962.3) 79.9 (1839.4) 100.0 (1962.3) 99.6 (1959.7) 97.1 (1944.8) 29.0 (1528.7)
ProteinFolding_12 0.0 (-1857.9) 100.0 (-1547.0) 100.0 (-1547.0) 100.0 (-1547.0) 99.7 (-1548.0) 100.0 (-1547.0) 100.0 (-1547.0) 100.0 (-1547.0) 0.0 (nan)
ProteinFolding_13 0.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3) 100.0 (-143.3)
ProteinFolding_14 0.0 (-620.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7) 100.0 (-331.7)
ProteinFolding_15 0.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6) 100.0 (-51.6)
Segmentation_11 0.0 (-140.3) 100.0 (-132.1) 97.8 (-132.3) 97.8 (-132.3) 85.5 (-133.3) 97.8 (-132.3) 97.8 (-132.3) 97.8 (-132.3) 84.5 (-133.4)
Segmentation_12 0.0 (-39.3) 100.0 (-21.9) 100.0 (-21.9) 100.0 (-21.9) 52.8 (-30.1) 100.0 (-21.9) 100.0 (-21.9) 100.0 (-21.9) 100.0 (-21.9)
Segmentation_13 0.0 (-39.5) 100.0 (-21.4) 100.0 (-21.4) 100.0 (-21.4) 100.0 (-21.4) 100.0 (-21.4) 100.0 (-21.4) 100.0 (-21.4) 100.0 (-21.4)
Segmentation_14 0.0 (-43.0) 100.0 (-39.3) 100.0 (-39.3) 100.0 (-39.3) 76.4 (-40.2) 100.0 (-39.3) 100.0 (-39.3) 100.0 (-39.3) 84.9 (-39.8)
Segmentation_15 0.0 (-184.1) 71.3 (-169.6) 100.0 (-163.8) 100.0 (-163.8) 76.6 (-168.5) 100.0 (-163.8) 100.0 (-163.8) 100.0 (-163.8) 75.1 (-168.8)
Segmentation_16 0.0 (-44.6) 100.0 (-40.4) 100.0 (-40.4) 100.0 (-40.4) 100.0 (-40.4) 100.0 (-40.4) 100.0 (-40.4) 100.0 (-40.4) 91.5 (-40.8)
Segmentation_17 0.0 (-189.8) 88.0 (-176.2) 100.0 (-174.3) 100.0 (-174.3) 93.7 (-175.3) 100.0 (-174.3) 100.0 (-174.3) 100.0 (-174.3) 91.2 (-175.7)
Segmentation_18 0.0 (-48.3) 100.0 (-34.0) 100.0 (-34.0) 100.0 (-34.0) 86.9 (-35.9) 100.0 (-34.0) 100.0 (-34.0) 100.0 (-34.0) 100.0 (-34.0)
Segmentation_19 0.0 (-35.9) 100.0 (-24.1) 100.0 (-24.1) 100.0 (-24.1) 88.8 (-25.4) 100.0 (-24.1) 100.0 (-24.1) 100.0 (-24.1) 100.0 (-24.1)
Segmentation_20 0.0 (-130.1) 100.0 (-112.0) 100.0 (-112.0) 100.0 (-112.0) 98.0 (-112.4) 100.0 (-112.0) 100.0 (-112.0) 100.0 (-112.0) 92.0 (-113.5)
bw_p24_16 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p24_20 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p34_15 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p34_20 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p44_15 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p44_19 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p54_10 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
bw_p54_16 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
comm_p01_16 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
comm_p01_20 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_11.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_16.fg.Q0.5.I3 0.0 (-73.1) 38.8 (-53.8) 96.5 (-25.2) 100.0 (-23.4) 0.0 (-inf) 100.0 (-23.4) 100.0 (-23.4) 100.0 (-23.4) 0.0 (-inf)
or_chain_22.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_24.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_25.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_32.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_36.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_39.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_40.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_41.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_43.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_6.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_60.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_63.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
or_chain_8.fg.Q0.5.I3 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
pedigree1.Q0.5.I3 0.0 (-42.1) 0.0 (-inf) 97.8 (-35.9) 76.0 (-37.3) 0.0 (-inf) 100.0 (-35.7) 100.0 (-35.7) 94.0 (-36.1) 68.1 (-37.8)
pedigree13.Q0.5.I1 0.0 (-94.6) 0.0 (-inf) 98.7 (-62.8) 100.0 (-62.4) 0.0 (-inf) 98.8 (-62.8) 99.2 (-62.7) 99.7 (-62.5) 0.0 (-inf)
pedigree18.Q0.5.I1 0.0 (-167.0) 0.0 (-inf) 98.5 (-112.5) 99.5 (-111.9) 0.0 (-inf) 98.5 (-112.5) 97.7 (-112.9) 96.7 (-113.5) 91.5 (-116.4)
pedigree19.Q0.5.I4 0.0 (-156.8) 87.5 (-95.3) 95.8 (-89.5) 98.7 (-87.5) 0.0 (-inf) 99.3 (-87.1) 95.8 (-89.5) 95.7 (-89.6) 0.0 (-inf)
pedigree20.Q0.5.I2 0.0 (-89.8) 0.0 (-inf) 98.3 (-46.8) 98.6 (-46.7) 0.0 (-inf) 95.8 (-47.9) 100.0 (-46.1) 100.0 (-46.1) 38.8 (-72.8)
pedigree25.Q0.5.I2 0.0 (-193.7) 81.1 (-154.6) 93.9 (-148.5) 95.3 (-147.8) 0.0 (-inf) 95.8 (-147.6) 96.4 (-147.3) 95.4 (-147.8) 49.3 (-170.0)
pedigree30.Q0.5.I2 0.0 (-186.6) 0.0 (-inf) 99.3 (-123.6) 97.5 (-124.7) 0.0 (-inf) 99.3 (-123.6) 100.0 (-123.1) 98.2 (-124.3) 72.1 (-140.8)
pedigree31.Q0.5.I2 0.0 (-195.5) 96.3 (-118.4) 99.0 (-116.2) 99.2 (-116.0) 0.0 (-inf) 98.1 (-117.0) 97.2 (-117.6) 99.8 (-115.6) 43.0 (-161.1)
pedigree33.Q0.5.I2 0.0 (-127.2) 97.3 (-69.4) 95.8 (-70.3) 94.8 (-70.9) 0.0 (-inf) 94.6 (-71.0) 95.6 (-70.4) 94.4 (-71.1) 0.0 (-inf)
pedigree38.Q0.5.I2 0.0 (-124.7) 70.3 (-91.4) 98.2 (-78.2) 99.5 (-77.6) 0.0 (-inf) 99.9 (-77.5) 99.6 (-77.6) 99.2 (-77.8) 72.2 (-90.5)
pedigree41.Q0.5.I2 0.0 (-175.4) 0.0 (-inf) 100.0 (-105.6) 97.5 (-107.3) 0.0 (-inf) 98.2 (-106.8) 97.0 (-107.7) 96.3 (-108.2) 21.0 (-160.7)
pedigree44.Q0.5.I4 0.0 (-135.0) 77.9 (-98.2) 96.9 (-89.1) 98.2 (-88.5) 0.0 (-inf) 97.0 (-89.1) 96.3 (-89.4) 95.6 (-89.7) 0.0 (-inf)
pedigree50.Q0.5.I1 0.0 (-83.2) 88.2 (-55.7) 98.6 (-52.4) 97.4 (-52.8) 0.0 (-inf) 96.3 (-53.1) 96.5 (-53.1) 100.0 (-52.0) 43.6 (-69.6)
pedigree7.Q0.5.I2 0.0 (-136.9) 0.0 (-inf) 100.0 (-97.5) 99.7 (-97.6) 0.0 (-inf) 97.8 (-98.4) 98.9 (-98.0) 97.9 (-98.3) 1.1 (-136.4)
pedigree9.Q0.5.I3 0.0 (-178.2) 0.0 (-inf) 98.3 (-113.8) 98.5 (-113.7) 0.0 (-inf) 98.9 (-113.4) 100.0 (-112.7) 98.0 (-114.0) 29.3 (-159.0)
pomdp10-12_7_3_8_4.mmap 0.0 (1.2) 100.0 (1.2) 100.0 (1.2) 99.4 (1.2) 100.0 (1.2) 88.3 (1.2) 100.0 (1.2) 100.0 (1.2) 100.0 (1.2)
pomdp6-12_6_2_6_3.mmap 0.0 (0.9) 86.8 (1.0) 94.4 (1.0) 56.9 (1.0) 95.2 (1.0) 93.8 (1.0) 93.8 (1.0) 93.8 (1.0) 95.2 (1.0)
pomdp7-20_10_2_10_3.mmap 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
pomdp8-14_9_3_12_4.mmap 0.0 (1.4) 0.3 (1.4) 90.0 (1.4) 36.1 (1.4) 100.0 (1.4) 89.5 (1.4) 89.6 (1.4) 89.3 (1.4) 91.5 (1.4)
pomdp9-14_8_3_10_4.mmap 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan) 0.0 (nan)
wcsp_14 0.0 (-125.3) 76.0 (-29.2) 91.5 (-9.6) 100.0 (1.1) 0.0 (-402.4) 100.0 (1.1) 100.0 (1.1) 100.0 (1.1) 82.6 (-20.9)
wcsp_15 0.0 (-184.6) 19.2 (-163.6) 95.1 (-80.0) 100.0 (-74.6) 0.0 (-1503.1) 99.3 (-75.4) 96.4 (-78.6) 92.0 (-83.4) 0.0 (-193.8)
wcsp_16 0.0 (-72.0) 70.0 (-5.3) 80.6 (4.8) 99.9 (23.1) 0.0 (-251.5) 99.6 (22.9) 99.6 (22.8) 100.0 (23.2) 66.7 (-8.5)
wcsp_17 0.0 (-153.8) 27.5 (-101.8) 85.8 (8.3) 99.2 (33.6) 0.0 (-549.1) 99.9 (34.9) 100.0 (35.0) 99.9 (34.8) 0.0 (nan)
wcsp_18 0.0 (-57.9) 0.0 (-540.0) 58.1 (-24.1) 100.0 (0.2) 72.1 (-16.0) 100.0 (0.2) 100.0 (0.2) 100.0 (0.2) 70.6 (-16.9)

Updated: