ibia-pr Scores
The results below are organized as follows:
- each table displays the solver’s performance for individual problem instances for the given task under different time limits
- table values are normalized scores for each evaluated problem as outlined in Evaluation Criteria
PR
overall
| Problem | 20sec | 1200sec | 3600sec |
|---|---|---|---|
| 1a7w | 100.0 (-1.0) | 100.0 (-1.0) | 100.0 (-1.0) |
| 1aie | 100.0 (2.8) | 100.0 (2.8) | 100.0 (2.8) |
| 1b2v | 100.0 (-53.4) | 100.0 (-53.4) | 100.0 (-53.4) |
| 1bxv | 100.0 (-9.7) | 100.0 (-9.7) | 100.0 (-9.7) |
| 1cpq | 100.0 (-21.7) | 100.0 (-21.7) | 100.0 (-21.7) |
| 1ctj | 100.0 (-13.3) | 100.0 (-13.3) | 100.0 (-13.3) |
| 1cxy | 100.0 (-38.0) | 100.0 (-38.0) | 100.0 (-38.0) |
| 1f94 | 100.0 (-61.4) | 100.0 (-61.4) | 100.0 (-61.4) |
| 1fas | 100.0 (-33.3) | 100.0 (-33.3) | 100.0 (-33.3) |
| 1g6x | 100.0 (-27.2) | 100.0 (-27.2) | 100.0 (-27.2) |
| 1jer | 100.0 (-31.5) | 100.0 (-31.5) | 100.0 (-31.5) |
| 1kp6 | 100.0 (-45.1) | 100.0 (-45.1) | 100.0 (-45.1) |
| 1nkd | 100.0 (-8.8) | 100.0 (-8.8) | 100.0 (-8.8) |
| 1npl | 100.0 (-42.9) | 100.0 (-42.9) | 100.0 (-42.9) |
| 1qt9 | 100.0 (-59.7) | 100.0 (-59.7) | 100.0 (-59.7) |
| 1rfs | 100.0 (-50.6) | 100.0 (-50.6) | 100.0 (-50.6) |
| 1svy | 100.0 (-38.6) | 100.0 (-38.6) | 100.0 (-38.6) |
| 1vfy | 100.0 (-20.1) | 100.0 (-20.1) | 100.0 (-20.1) |
| 2rta | 100.0 (-55.2) | 100.0 (-55.2) | 100.0 (-55.2) |
| BN_12 | 100.0 (-3.6) | 100.0 (-3.6) | 100.0 (-3.6) |
| BN_13 | 100.0 (-2.3) | 100.0 (-2.3) | 100.0 (-2.3) |
| BN_15 | 100.0 (-5.7) | 100.0 (-5.7) | 100.0 (-5.7) |
| BN_31 | 100.0 (-11.0) | 100.0 (-11.0) | 100.0 (-11.0) |
| BN_74 | 100.0 (0.0) | 100.0 (0.0) | 100.0 (0.0) |
| blockmap_10_01-0006 | 0.0 (nan) | 100.0 (-1.0) | 100.0 (-1.0) |
| blockmap_10_01-0009 | 0.0 (nan) | 100.0 (-1.0) | 100.0 (-1.0) |
| blockmap_10_02-0009 | 0.0 (nan) | 100.0 (-2.2) | 100.0 (-2.2) |
| blockmap_10_03-0009 | 0.0 (nan) | 100.0 (-3.2) | 100.0 (-3.2) |
| blockmap_10_03-0010 | 0.0 (nan) | 100.0 (-2.9) | 100.0 (-2.9) |
| blockmap_15_01-0008 | 0.0 (nan) | 100.0 (-1.2) | 100.0 (-1.2) |
| blockmap_15_02-0008 | 0.0 (nan) | 100.0 (-2.4) | 100.0 (-2.4) |
| blockmap_15_03-0008 | 0.0 (nan) | 100.0 (-3.2) | 100.0 (-3.2) |
| blockmap_15_03-0010 | 0.0 (nan) | 100.0 (-3.1) | 100.0 (-3.1) |
| blockmap_20_01-0009 | 0.0 (nan) | 0.0 (nan) | 100.0 (-1.3) |
| blockmap_20_02-0009 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| blockmap_20_03-0010 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| blockmap_22_01-0006 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| blockmap_22_03-0009 | 0.0 (nan) | 0.0 (nan) | 0.0 (nan) |
| bwt3ac.wcsp | 100.0 (0.0) | 100.0 (0.0) | 100.0 (0.0) |
| fs-07 | 92.8 (-14.1) | 92.8 (-14.1) | 92.8 (-14.1) |
| mastermind_03_08_04-0000 | 100.0 (0.0) | 100.0 (0.0) | 100.0 (0.0) |
| mastermind_03_08_04-0001 | 100.0 (-12.7) | 100.0 (-12.7) | 100.0 (-12.7) |
| mastermind_03_08_04-0002 | 100.0 (-14.5) | 100.0 (-14.5) | 100.0 (-14.5) |
| mastermind_03_08_04-0003 | 100.0 (-11.5) | 100.0 (-11.5) | 100.0 (-11.5) |
| mastermind_03_08_04-0007 | 100.0 (-16.6) | 100.0 (-16.6) | 100.0 (-16.6) |
| mastermind_03_08_04-0008 | 100.0 (-16.3) | 100.0 (-16.3) | 100.0 (-16.3) |
| mastermind_03_08_04-0010 | 100.0 (-14.5) | 100.0 (-14.5) | 100.0 (-14.5) |
| mastermind_03_08_04-0011 | 99.9 (-10.1) | 99.7 (-10.5) | 99.7 (-10.5) |
| mastermind_03_08_04-0012 | 99.9 (-8.3) | 99.9 (-7.8) | 99.9 (-7.8) |
| mastermind_03_08_04-0013 | 99.9 (-8.8) | 100.0 (-8.7) | 100.0 (-8.7) |
| mastermind_03_08_04-0014 | 99.9 (-9.2) | 99.9 (-9.1) | 99.9 (-9.1) |
| mastermind_03_08_04-0015 | 100.0 (-8.0) | 100.0 (-8.1) | 100.0 (-8.1) |
| mastermind_03_08_05-0000 | 100.0 (0.0) | 100.0 (0.0) | 100.0 (0.0) |
| mastermind_03_08_05-0001 | 0.0 (nan) | 100.0 (-15.4) | 100.0 (-15.4) |
| mastermind_03_08_05-0003 | 0.0 (nan) | 100.0 (-15.1) | 100.0 (-15.1) |
| mastermind_03_08_05-0004 | 0.0 (nan) | 100.0 (-14.2) | 100.0 (-14.2) |
| mastermind_03_08_05-0008 | 0.0 (nan) | 100.0 (-14.6) | 100.0 (-14.6) |
| mastermind_03_08_05-0009 | 0.0 (nan) | 100.0 (-21.5) | 100.0 (-21.5) |
| mastermind_03_08_05-0011 | 0.0 (nan) | 99.4 (-12.6) | 99.4 (-12.6) |
| mastermind_03_08_05-0012 | 0.0 (nan) | 99.9 (-9.5) | 99.9 (-9.5) |
| mastermind_03_08_05-0013 | 0.0 (nan) | 99.9 (-9.4) | 99.9 (-9.4) |
| mastermind_03_08_05-0014 | 0.0 (nan) | 100.0 (-9.2) | 100.0 (-9.2) |
| mastermind_03_08_05-0015 | 0.0 (nan) | 99.9 (-9.5) | 99.9 (-9.5) |
| mastermind_04_08_03-0000 | 100.0 (0.0) | 100.0 (0.0) | 100.0 (0.0) |
| mastermind_04_08_03-0011 | 100.0 (-4.7) | 100.0 (-4.7) | 100.0 (-4.7) |
| mastermind_04_08_03-0012 | 100.0 (-6.0) | 100.0 (-6.0) | 100.0 (-6.0) |
| mastermind_04_08_03-0013 | 100.0 (-7.2) | 100.0 (-7.2) | 100.0 (-7.2) |
| mastermind_04_08_03-0014 | 100.0 (-6.5) | 100.0 (-6.5) | 100.0 (-6.5) |
| mastermind_04_08_03-0015 | 100.0 (-7.1) | 100.0 (-7.1) | 100.0 (-7.1) |
| mastermind_04_08_04-0000 | 100.0 (0.0) | 100.0 (0.0) | 100.0 (0.0) |
| mastermind_04_08_04-0001 | 100.0 (-11.7) | 100.0 (-11.7) | 100.0 (-11.7) |
| mastermind_04_08_04-0002 | 100.0 (-12.1) | 100.0 (-12.1) | 100.0 (-12.1) |
| mastermind_04_08_04-0003 | 100.0 (-13.6) | 100.0 (-13.6) | 100.0 (-13.6) |
| mastermind_04_08_04-0004 | 100.0 (-11.2) | 100.0 (-11.2) | 100.0 (-11.2) |
| mastermind_04_08_04-0005 | 100.0 (-15.9) | 100.0 (-15.9) | 100.0 (-15.9) |
| mastermind_04_08_04-0011 | 0.0 (nan) | 100.0 (-8.3) | 100.0 (-8.3) |
| mastermind_04_08_04-0012 | 0.0 (nan) | 100.0 (-8.0) | 100.0 (-8.0) |
| mastermind_04_08_04-0013 | 0.0 (nan) | 99.7 (-7.9) | 99.7 (-7.9) |
| mastermind_04_08_04-0014 | 0.0 (nan) | 99.9 (-9.0) | 99.9 (-9.0) |
| mastermind_04_08_04-0015 | 0.0 (nan) | 100.0 (-7.7) | 100.0 (-7.7) |
| mastermind_05_08_03-0000 | 100.0 (0.0) | 100.0 (0.0) | 100.0 (0.0) |
| mastermind_05_08_03-0001 | 100.0 (-9.8) | 100.0 (-9.8) | 100.0 (-9.8) |
| mastermind_05_08_03-0002 | 100.0 (-12.2) | 100.0 (-12.2) | 100.0 (-12.2) |
| mastermind_05_08_03-0003 | 100.0 (-8.6) | 100.0 (-8.6) | 100.0 (-8.6) |
| mastermind_05_08_03-0004 | 100.0 (-11.6) | 100.0 (-11.6) | 100.0 (-11.6) |
| mastermind_05_08_03-0009 | 100.0 (-8.0) | 100.0 (-8.0) | 100.0 (-8.0) |
| mastermind_05_08_03-0011 | 99.9 (-6.3) | 100.0 (-6.2) | 100.0 (-6.2) |
| mastermind_05_08_03-0012 | 99.6 (-8.2) | 100.0 (-7.6) | 100.0 (-7.6) |
| mastermind_05_08_03-0013 | 100.0 (-6.6) | 100.0 (-6.6) | 100.0 (-6.6) |
| mastermind_05_08_03-0014 | 100.0 (-4.9) | 100.0 (-4.9) | 100.0 (-4.9) |
| mastermind_05_08_03-0015 | 99.9 (-6.1) | 100.0 (-6.3) | 100.0 (-6.3) |
| mastermind_06_08_03-0000 | 100.0 (0.0) | 100.0 (0.0) | 100.0 (0.0) |
| mastermind_06_08_03-0001 | 100.0 (-12.6) | 100.0 (-12.6) | 100.0 (-12.6) |
| mastermind_06_08_03-0002 | 100.0 (-10.5) | 100.0 (-10.5) | 100.0 (-10.5) |
| mastermind_06_08_03-0003 | 100.0 (-11.2) | 100.0 (-11.2) | 100.0 (-11.2) |
| mastermind_06_08_03-0005 | 100.0 (-11.9) | 100.0 (-11.9) | 100.0 (-11.9) |
| mastermind_06_08_03-0009 | 100.0 (-8.4) | 100.0 (-8.4) | 100.0 (-8.4) |
| mastermind_06_08_03-0011 | 99.9 (-4.9) | 99.8 (-5.0) | 99.8 (-5.0) |
| mastermind_06_08_03-0012 | 100.0 (-5.9) | 100.0 (-5.9) | 100.0 (-5.9) |
| mastermind_06_08_03-0014 | 100.0 (-6.3) | 100.0 (-6.3) | 100.0 (-6.3) |
| mastermind_06_08_03-0015 | 99.8 (-7.4) | 99.8 (-7.4) | 99.8 (-7.4) |
| mastermind_10_08_03-0001 | 100.0 (-13.6) | 100.0 (-13.6) | 100.0 (-13.6) |
| mastermind_10_08_03-0003 | 100.0 (-15.5) | 100.0 (-15.5) | 100.0 (-15.5) |
| mastermind_10_08_03-0004 | 100.0 (-16.5) | 100.0 (-16.5) | 100.0 (-16.5) |
| mastermind_10_08_03-0008 | 100.0 (-23.2) | 100.0 (-23.2) | 100.0 (-23.2) |
| mastermind_10_08_03-0009 | 100.0 (-17.8) | 100.0 (-17.8) | 100.0 (-17.8) |
| mastermind_10_08_03-0010 | 100.0 (-10.1) | 100.0 (-10.1) | 100.0 (-10.1) |
| myciel5g_3.wcsp | 92.3 (-55.4) | 96.3 (-58.4) | 96.3 (-58.4) |
| myciel5g_4.wcsp | 64.8 (2.7) | 79.5 (-1.8) | 79.5 (-1.8) |
| or_chain_1.fg | 97.4 (-10.6) | 91.4 (-11.3) | 91.4 (-11.3) |
| or_chain_102.fg | 92.6 (-10.4) | 94.0 (-10.4) | 94.0 (-10.4) |
| or_chain_106.fg | 94.9 (-9.7) | 95.5 (-10.4) | 95.5 (-10.4) |
| or_chain_107.fg | 99.5 (-11.6) | 99.2 (-11.6) | 99.2 (-11.6) |
| or_chain_12.fg | 96.3 (-12.5) | 97.1 (-12.4) | 97.1 (-12.4) |
| or_chain_128.fg | 97.3 (-11.1) | 92.0 (-11.6) | 92.0 (-11.6) |
| or_chain_132.fg | 93.7 (-8.0) | 97.5 (-8.6) | 97.5 (-8.6) |
| or_chain_138.fg | 98.1 (-10.2) | 99.7 (-10.1) | 99.7 (-10.1) |
| or_chain_140.fg | 98.6 (-5.5) | 97.3 (-5.4) | 97.3 (-5.4) |
| or_chain_149.fg | 99.8 (-8.6) | 99.9 (-8.6) | 99.9 (-8.6) |
| or_chain_15.fg | 92.6 (-12.4) | 99.6 (-11.8) | 99.6 (-11.8) |
| or_chain_150.fg | 80.9 (-8.0) | 93.1 (-7.5) | 93.1 (-7.5) |
| or_chain_153.fg | 92.4 (-9.2) | 95.6 (-9.0) | 95.6 (-9.0) |
| or_chain_155.fg | 99.8 (-9.9) | 100.0 (-9.9) | 100.0 (-9.9) |
| or_chain_161.fg | 73.0 (-7.6) | 97.2 (-9.4) | 97.2 (-9.4) |
| or_chain_186.fg | 87.2 (-10.0) | 99.4 (-9.5) | 99.4 (-9.5) |
| or_chain_188.fg | 99.0 (-12.4) | 99.2 (-12.3) | 99.2 (-12.3) |
| or_chain_198.fg | 81.3 (-3.3) | 81.3 (-3.3) | 81.3 (-3.3) |
| or_chain_209.fg | 91.9 (-12.0) | 98.9 (-11.5) | 98.9 (-11.5) |
| or_chain_242.fg | 93.9 (-5.8) | 99.9 (-5.4) | 99.9 (-5.4) |
| or_chain_4.fg | 93.4 (-12.2) | 97.7 (-11.9) | 97.7 (-11.9) |
| or_chain_53.fg | 99.6 (-9.2) | 86.8 (-8.1) | 86.8 (-8.1) |
| or_chain_61.fg | 90.0 (-7.4) | 88.0 (-7.3) | 88.0 (-7.3) |
| or_chain_64.fg | 99.5 (-8.9) | 90.3 (-8.2) | 90.3 (-8.2) |
| or_chain_90.fg | 91.3 (-9.1) | 94.2 (-8.9) | 94.2 (-8.9) |
| pedigree51 | 95.4 (-74.1) | 95.1 (-73.9) | 95.1 (-73.9) |
| queen5_5_3.wcsp | 96.3 (-108.6) | 96.3 (-108.6) | 96.3 (-108.6) |
| queen5_5_4.wcsp | 83.6 (-36.2) | 97.8 (-44.4) | 97.8 (-44.4) |
| rus2_20_40_0_1 | 0.0 (nan) | 99.9 (107.0) | 99.9 (107.0) |
| rus2_20_40_0_2 | 0.0 (nan) | 99.7 (120.8) | 99.7 (120.8) |
| rus2_20_40_0_3 | 0.0 (nan) | 99.9 (88.2) | 99.9 (88.2) |
| rus2_20_40_1_1 | 0.0 (nan) | 100.0 (107.4) | 100.0 (107.4) |
| rus2_20_40_1_2 | 0.0 (nan) | 99.9 (104.5) | 99.9 (104.5) |
| rus2_20_40_1_3 | 0.0 (nan) | 98.4 (102.8) | 98.4 (102.8) |
| rus2_20_40_2_1 | 0.0 (nan) | 99.7 (119.4) | 99.7 (119.4) |
| rus2_20_40_2_2 | 0.0 (nan) | 98.5 (119.4) | 98.5 (119.4) |
| rus2_20_40_2_3 | 0.0 (nan) | 100.0 (112.4) | 100.0 (112.4) |
| rus2_20_40_3_1 | 0.0 (nan) | 99.4 (110.6) | 99.4 (110.6) |
| rus2_20_40_3_2 | 0.0 (nan) | 99.8 (141.1) | 99.8 (141.1) |
| rus2_20_40_3_3 | 0.0 (nan) | 99.9 (123.5) | 99.9 (123.5) |
| rus2_20_40_4_1 | 0.0 (nan) | 99.9 (99.1) | 99.9 (99.1) |
| rus2_20_40_4_2 | 0.0 (nan) | 99.9 (107.1) | 99.9 (107.1) |
| rus2_20_40_4_3 | 0.0 (nan) | 100.0 (95.2) | 100.0 (95.2) |
| rus2_20_40_5_1 | 0.0 (nan) | 99.8 (95.6) | 99.8 (95.6) |
| rus2_20_40_5_2 | 0.0 (nan) | 100.0 (88.4) | 100.0 (88.4) |
| rus2_20_40_5_3 | 0.0 (nan) | 99.3 (170.3) | 99.3 (170.3) |
| rus2_20_40_6_1 | 0.0 (nan) | 99.6 (119.4) | 99.6 (119.4) |
| rus2_20_40_6_2 | 0.0 (nan) | 99.8 (68.2) | 99.8 (68.2) |
| rus2_20_40_6_3 | 0.0 (nan) | 99.9 (134.2) | 99.9 (134.2) |
| rus2_20_40_7_1 | 0.0 (nan) | 99.0 (89.1) | 99.0 (89.1) |
| rus2_20_40_7_2 | 0.0 (nan) | 99.7 (111.4) | 99.7 (111.4) |
| rus2_20_40_7_3 | 0.0 (nan) | 100.0 (81.5) | 100.0 (81.5) |
| rus2_20_40_8_1 | 0.0 (nan) | 99.9 (107.0) | 99.9 (107.0) |
| rus2_20_40_8_2 | 0.0 (nan) | 99.8 (99.7) | 99.8 (99.7) |
| rus2_20_40_8_3 | 0.0 (nan) | 100.0 (100.6) | 100.0 (100.6) |
| rus2_20_40_9_1 | 0.0 (nan) | 100.0 (94.6) | 100.0 (94.6) |
| rus2_20_40_9_2 | 0.0 (nan) | 99.8 (94.5) | 99.8 (94.5) |
| rus2_20_40_9_3 | 0.0 (nan) | 99.9 (63.6) | 99.9 (63.6) |
| rus_20_40_0_1 | 0.0 (nan) | 100.0 (617.3) | 100.0 (617.3) |
| rus_20_40_0_2 | 0.0 (nan) | 97.9 (795.7) | 97.9 (795.7) |
| rus_20_40_0_3 | 0.0 (nan) | 99.5 (904.0) | 99.5 (904.0) |
| rus_20_40_1_1 | 0.0 (nan) | 100.0 (1004.7) | 100.0 (1004.7) |
| rus_20_40_1_2 | 0.0 (nan) | 100.0 (910.2) | 100.0 (910.2) |
| rus_20_40_1_3 | 0.0 (nan) | 99.5 (901.6) | 99.5 (901.6) |
| rus_20_40_2_1 | 0.0 (nan) | 100.0 (797.8) | 100.0 (797.8) |
| rus_20_40_2_2 | 0.0 (nan) | 97.6 (684.5) | 97.6 (684.5) |
| rus_20_40_2_3 | 0.0 (nan) | 100.0 (749.3) | 100.0 (749.3) |
| rus_20_40_3_1 | 0.0 (nan) | 99.1 (827.6) | 99.1 (827.6) |
| rus_20_40_3_2 | 0.0 (nan) | 99.7 (839.6) | 99.7 (839.6) |
| rus_20_40_3_3 | 0.0 (nan) | 99.7 (842.6) | 99.7 (842.6) |
| rus_20_40_4_1 | 0.0 (nan) | 100.0 (931.5) | 100.0 (931.5) |
| rus_20_40_4_2 | 0.0 (nan) | 99.8 (936.2) | 99.8 (936.2) |
| rus_20_40_4_3 | 0.0 (nan) | 100.0 (853.3) | 100.0 (853.3) |
| rus_20_40_5_1 | 0.0 (nan) | 99.6 (876.6) | 99.6 (876.6) |
| rus_20_40_5_2 | 0.0 (nan) | 99.8 (840.0) | 99.8 (840.0) |
| rus_20_40_5_3 | 0.0 (nan) | 98.7 (884.7) | 98.7 (884.7) |
| rus_20_40_6_1 | 0.0 (nan) | 100.0 (723.9) | 100.0 (723.9) |
| rus_20_40_6_2 | 0.0 (nan) | 100.0 (982.4) | 100.0 (982.4) |
| rus_20_40_6_3 | 0.0 (nan) | 100.0 (966.7) | 100.0 (966.7) |
| rus_20_40_7_1 | 0.0 (nan) | 99.9 (752.3) | 99.9 (752.3) |
| rus_20_40_7_2 | 0.0 (nan) | 99.5 (757.2) | 99.5 (757.2) |
| rus_20_40_7_3 | 0.0 (nan) | 100.0 (869.7) | 100.0 (869.7) |
| rus_20_40_8_1 | 0.0 (nan) | 99.6 (727.6) | 99.6 (727.6) |
| rus_20_40_8_2 | 0.0 (nan) | 100.0 (898.7) | 100.0 (898.7) |
| rus_20_40_8_3 | 0.0 (nan) | 100.0 (703.8) | 100.0 (703.8) |
| rus_20_40_9_1 | 0.0 (nan) | 100.0 (866.6) | 100.0 (866.6) |
| rus_20_40_9_2 | 0.0 (nan) | 100.0 (834.5) | 100.0 (834.5) |
| rus_20_40_9_3 | 0.0 (nan) | 100.0 (864.0) | 100.0 (864.0) |