Median and Best Results

This page displays the median and best objective values (median,  best) out of 31 runs obtained by the 20 competing algorithms on the 5 selected instances per domain. The last row shows the best (min) results. For each of the training domains: max-SAT,   bin packing,      personnel scheduling, flow shop; 3 test instances and 2 hidden instances were used in the competition. For more information, please refer to How the Results were Calculated. More details on the instances are given in CHeSCInstanceSummary.pdf.

Max-SAT

Algorithm
 Test 1
 Test 2
 Test 3
 Hidden 1
 Hidden 2
VNS-TW 3,     1 3,    1 2,    1 3,    1 10,    7
SA-ILS 13,    10 23,    14 12,    6 15,    11 9,    7
DynILS 23,    14 56,    18 37,    10 31,    19 19,    12
ML 5,    1 10,    3 3,    1 9,    4 8,    7
AdapHH 3,    1 5,    3 2,    1 3,    1 8,    7
KSATS 4,    2 7,    1 2,    1 4,    1 9,    7
EPH 7,    4 11,    5 6,    2 14,    5 13,    7
GenHive 16,    9 44,    13 31,    9 19,    12 14,    9
PHUNTER 5,    1 11,    5 4,    2 9,    4 8,    7
ACO-HH 11,    4 35,    12 9,    4 17,    12 13,    8
HAHA 3,    0 4,    1 2,    0 5,    1 8,    7
ISEA 5,    2 11,    4 4,    1 9,    4 11,    8
GISS 16,    7 21,    12 13,    4 17,    10 9,    7
SelfS 13,    7 36,    9 14,    6 14,    8 10,    7
XCJ 6,    2 8,    5 5,    2 9,    6 10,    8
AVEGNep 8,    4 10,    6 5,    2 9,    3 7,    7
MCHH-S 8,    4 14,    9 8,    3 8,    4 9,    7
HAEA 6,    2 12,    5 5,    2 12,    4 11,    8
Ant-Q 23,    12 52,    30 38,    14 27,    19 14,    8
NAHH 8,    5 10,    5 4,    2 9,    5 7,    7
Min 3,    0 3,    1 2,    0 3,    1 7,    7
[Top]

Bin Packing 

Algorithms
 Test 1
 Test 2
 Test 3
 Hidden 1
 Hidden 2
VNS-TW 0.0370,   0.0298 0.0072,  0.0036 0.0167,  0.0136 0.1088,  0.1087 0.0278,  0.0238
SA-ILS 0.0787,  0.0734 0.0115,  0.0081 0.0146,  0.0123 0.1104,  0.1100 0.0296,  0.0239
DynILS 0.0403,  0.0349 0.0077,  0.0036 0.0102,  0.0069 0.1087,  0.1086 0.0129,  0.0086
ML 0.0421,  0.0323 0.0075,  0.0067 0.0146,  0.0124 0.1085,  0.1084 0.0218,  0.0178
AdapHH 0.0161,  0.0131 0.0036,  0.0028 0.0036,  0.0004 0.1083,  0.1083 0.0035,  0.0031
KSATS 0.0192,  0.0162 0.0078,  0.0071 0.0115,  0.0094 0.1089,  0.1088 0.0220,  0.0188
EPH 0.0504,  0.0430 0.0036,  0.0034 0.0113,  0.0080 0.1087,  0.1083 0.0224,  0.0136
GenHive 0.0299,  0.0133 0.0071,  0.0067 0.0104,  0.0069 0.1086,  0.1084 0.0229,  0.0157
PHUNTER 0.0479,  0.0397 0.0036,  0.0034 0.0201,  0.0178 0.1091,  0.1088 0.0395,  0.0318
ACO-HH 0.0477,  0.0404 0.0032,  0.0029 0.0039,  0.0024 0.1099,  0.1097 0.0149,  0.0108
HAHA 0.0883,  0.0617 0.0073,  0.0035 0.0145,  0.0037 0.1102,  0.1095 0.0279,  0.0076
ISEA 0.0342,  0.0219 0.0033,  0.0029 0.0037,  0.0017 0.1086,  0.1085 0.0064,  0.0033
GISS 0.0692,  0.0591 0.0084,  0.0077 0.0322,  0.0278 0.1126,  0.1110 0.0592,  0.0515
SelfS 0.0664,  0.0531 0.0074,  0.0067 0.0144,  0.0102 0.1097,  0.1091 0.0239,  0.0177
XCJ 0.0220,  0.0168 0.0115,  0.0075 0.0157,  0.0145 0.1086,  0.1085 0.0285,  0.0247
AVEGNep 0.0874,  0.0530 0.0077,  0.0072 0.0181,  0.0138 0.1114,  0.1104 0.0375,  0.0280
MCHH-S 0.0623,  0.0492 0.0073,  0.0067 0.0146,  0.0113 0.1098,  0.1092 0.0286,  0.0218
HAEA 0.0452,  0.0349 0.0036,  0.0033 0.0138,  0.0083 0.1087,  0.1087 0.0240,  0.0168
Ant-Q 0.0491,  0.0410 0.0165,  0.0083 0.0210,  0.0158 0.1099,  0.1093 0.0377,  0.0317
NAHH 0.0550,  0.0473 0.0035,  0.0030 0.0047,  0.0027 0.1088,  0.1083 0.0055,  0.0046
Min 0.0161,  0.0131 0.0032,  0.0028 0.0036,  0.0004 0.1083,  0.1083 0.0035,  0.0031
[Top]

Personnel Scheduling

Algorithm
 Test 1
 Test 2
 Test 3
 Hidden 1
 Hidden 2
VNS-TW 19, 13 9628, 9347 3223, 3124 1590, 1370 320, 290
SA-ILS 20, 14 9750, 9351 3228, 3169 1625, 1447 340, 310
DynILS 33, 19 9893, 9611 3324, 3142 1870, 1545 465, 350
ML 18, 11 9812, 9436 3228, 3138 1605, 1384 315, 300
AdapHH 24, 17 9667, 9435 3289, 3142 1765, 1448 325, 295
KSATS 22, 14 9681, 9405 3241, 3150 1640, 1410 355, 315
EPH 22, 16 10074, 9747 3232, 3142 1615, 1469 345, 310
GenHive 21, 16 12708, 9597 3274, 3180 1727, 1457 330, 300
PHUNTER 25, 13 10136, 9624 3255, 3142 1595, 1350 320, 290
ACO-HH 26, 19 11212, 10204 3346, 3200 1760, 1480 355, 315
HAHA 21, 14 9666, 9325 3236, 3136 1558, 1410 335, 300
ISEA 20, 12 9966, 9566 3308, 3181 1660, 1369 315, 280
GISS 25, 19 9625, 9433 3294, 3158 1785, 1453 370, 330
SelfS 26, 18 9803, 9602 3249, 3151 1635, 1460 350, 315
XCJ 30, 20 33390, 9845 3277, 3167 1658, 1518 380, 315
VEGNep 26, 21 10230, 9431 3283, 3155 1765, 1554 360, 320
MCHH-S 32, 25 13297, 9825 3344, 3157 1785, 1480 370, 340
HAEA 25, 18 9795, 9454 3266, 3146 1699, 1479 345, 300
Ant-Q 33, 24 73535, 66487 3348, 3247 1970, 1530 425, 370
NAHH 27, 16 9827, 9461 3246, 3150 1644, 1455 345, 300
Min 18, 11 9625, 9325 3223, 3124 1558, 1350 315, 280
[Top]

Flow Shop

Algorithm
 Test 1
 Test 2
 Test 3
 Hidden 1
 Hidden 2
VNS-TW 6251, 6230 26803, 26765 6328, 6303 11376, 11333 26602, 26535
SA-ILS 6336, 6320 26886, 26823 6390, 6369 11514, 11482 26703, 26648
DynILS 6269, 6248 26875, 26777 6365, 6323 11419, 11372 26670, 26601
ML 6245, 6226 26800, 26744 6323, 6304 11384, 11338 26610, 26559
AdapHH 6240, 6214 26814, 26757 6326, 6303 11359, 11318 26643, 26541
KSATS 6292, 6271 26860, 26809 6366, 6330 11466, 11432 26683, 26637
EPH 6250, 6232 26816, 26738 6347, 6309 11397, 11328 26640, 26569
GenHive 6279, 6260 26835, 26722 6366, 6336 11434, 11378 26648, 26578
PHUNTER 6253, 6221 26858, 26786 6350, 6303 11388, 11336 26677, 26600
ACO-HH 6249, 6236 26904, 26827 6353, 6307 11393, 11341 26724, 26677
HAHA 6269, 6246 26850, 26784 6353, 6323 11419, 11383 26663, 26603
ISEA 6262, 6241 26844, 26792 6366, 6308 11419, 11359 26663, 26590
GISS 6329, 6304 26979, 26910 6385, 6369 11516, 11464 26758, 26698
SelfS 6287, 6249 26859, 26795 6369, 6330 11443, 11405 26678, 26606
XCJ 6271, 6246 26910, 26825 6366, 6329 11481, 11419 26710, 26647
AVEGNep 6322, 6298 26952, 26896 6379, 6369 11507, 11462 26743, 26653
MCHH-S 6336, 6309 26937, 26859 6397, 6367 11527, 11501 26716, 26658
HAEA 6261, 6244 26826, 26767 6353, 6318 11408, 11359 26651, 26600
Ant-Q 6358, 6308 26971, 26916 6407, 6374 11545, 11469 26792, 26701
NAHH 6245, 6222 26885, 26773 6323, 6290 11383, 11319 26671, 26590
Min 6240, 6214 26800, 26722 6323, 6290 11359, 11318 26602, 26535
[Top]

TSP 

Algorithm
 Test 1
 Test 2
 Test 3
 Test 4
 Test 5
VNS-TW 48194.9, 48194.9 21042675.8, 20848555.6 6819.1, 6796.0 67378.0, 66830.2 54028.6, 52896.5
SA-ILS 49046.8, 48665.5 21281226.6, 21038161.5 6994.6, 6942.7 70614.9, 68522.1 57607.5, 55112.2
DynILS 48194.9, 48194.9 20987358.7, 20877088.8 6823.1, 6806.1 67308.1, 66193.4 54100.9, 52746.5
ML 48194.9, 48194.9 21093828.3, 20793219.8 6820.6, 6805.3 66894.0, 66428.2 54368.4, 52626.7
AdapHH 48194.9, 48194.9 20822145.7, 20752853.8 6810.5, 6797.5 66879.8, 66277.1 53099.8, 52383.8
KSATS 48578.7, 48365.3 21557455.9, 21136630.6 6947.8, 6928.3 72027.8, 69214.2 58738.2, 54698.1
EPH 48194.9, 48194.9 21064606.3, 20941645.1 6811.9, 6799.2 66756.2, 65958.6 52925.3, 52053.4
GenHive 48271.9, 48212.8 21083157.6, 20784101.4 6868.7, 6836.4 67236.8, 66720.4 56022.2, 53984.4
PHUNTER 48194.9, 48194.9 21246427.7, 20754199.8 6813.6, 6796.0 67136.8, 66641.4 52934.4, 52172.0
ACO-HH 48200.2, 48194.9 21137472.3, 20883391.2 6851.6, 6809.5 67202.3, 66756.3 53428.1, 52603.8
HAHA 48414.8, 48253.5 21291914.4, 21060054.0 6918.0, 6871.2 69324.3, 68029.7 56039.9, 54218.6
ISEA 48194.9, 48194.9 20868203.1, 20771174.3 6832.6, 6804.7 67282.1, 66239.6 54129.2, 52882.9
GISS 49010.6, 48654.7 21651052.8, 21268254.2 7001.9, 6971.0 72630.4, 69536.0 59804.5, 55588.1
SelfS 49043.7, 48598.2 21040810.2, 20890074.1 6984.4, 6921.7 69646.7, 67630.4 56647.6, 54538.2
XCJ 48412.8, 48194.9 21162559.8, 21032275.3 6884.5, 6841.2 68006.0, 67124.7 54967.2, 53467.1
AVEGNep 48639.4, 48488.9 21520601.0, 20997873.4 6969.4, 6940.7 70194.9, 68396.6 57998.3, 54071.5
MCHH-S 49412.8, 48636.3 21504030.4, 21288769.7 6997.2, 6939.6 70685.4, 67951.8 57836.4, 54062.4
HAEA 48194.9, 48194.9 20925949.5, 20766449.3 6824.6, 6799.2 67488.5, 66763.3 54144.9, 52920.9
Ant-Q 49613.9, 49359.9 21277953.0, 21108521.2 7016.1, 6970.3 69987.5, 68606.3 55314.8, 53976.9
NAHH 48194.9, 48194.9 20971771.0, 20747367.7 6841.8, 6813.4 67418.2, 66879.6 53097.7, 52476.9
Min 48194.9, 48194.9 20822145.7, 20747367.7 6810.5, 6796.0 66756.2, 65958.6 52925.3, 52053.4
[Top]

VRP

Algorithm
 Test 1
 Test 2
Test 3
 Test 4
 Test 5
VNS-TW 76147.1, 68340.4 13367.9, 13298.1 148206.2, 144012.6 21642.9, 20651.1 149132.4, 146513.6
SA-ILS 64185.8, 62359.7 13390.8, 13355.5 162642.7, 154536.9 20667.6, 20658.5 152271.1, 150293.6
DynILS 69798.8, 66264.1 14359.2, 13344.5 149869.4, 146856.9 21654.0, 20653.8 150060.8, 147795.8
ML 80671.3, 67622.1 13329.8, 13298.4 145333.5, 142517.0 20654.1, 20651.1 148975.1, 146200.8
AdapHH 60900.6, 58052.1 13347.6, 13304.9 148516.8, 145481.5 20656.6, 20652.3 148689.2, 146154.0
KSATS 64495.5, 60480.8 13296.8, 12305.2 156577.9, 147659.2 20655.4, 20654.6 147124.6, 145199.5
EPH 74715.8, 63932.2 13335.6, 13284.0 162188.5, 143510.8 20650.8, 20650.8 155224.7, 145976.5
GenHive 67475.4, 62377.0 13353.5, 13320.6 167297.5, 145371.7 20718.5, 20656.6 147960.7, 146326.9
PHUNTER 64717.8, 61139.3 12290.0, 12263.0 146944.4, 143663.9 20650.8, 20650.8 148659.0, 146472.9
ACO-HH 73348.5, 65223.0 14371.8, 13329.1 149672.9, 145278.7 21663.2, 20658.1 151610.3, 149277.8
HAHA 65498.4, 62794.0 13317.4, 12298.4 155941.2, 151677.6 20654.6, 20651.3 148655.5, 146760.6
ISEA 70471.7, 64026.7 13339.8, 12310.2 149149.6, 146453.8 20657.2, 20651.3 150474.0, 147544.0
GISS 61580.6, 59994.4 13352.4, 13329.7 162266.9, 156326.0 20657.4, 20653.2 149590.7, 147260.6
SelfS 73894.6, 64467.1 14386.3, 13329.1 203667.7, 195254.2 20687.6, 20655.8 153590.6, 150950.3
XCJ 63654.3, 60356.7 13354.8, 12287.7 152321.9, 145463.3 20658.7, 20651.1 153110.9, 150776.4
AVEGNep 77884.2, 71552.8 12397.8, 12325.7 184710.9, 157144.3 20655.8, 20653.0 166742.7, 160152.7
MCHH-S 72005.7, 65043.4 13534.1, 12366.9 207891.7, 153683.3 20850.9, 20652.4 160303.0, 153743.8
HAEA 60608.2, 58813.8 13342.2, 12313.1 146951.5, 142592.6 20655.7, 20652.5 147283.6, 144269.4
Ant-Q 76678.9, 67372.8 14382.1, 13314.7 193827.1, 181945.4 21656.6, 20655.4 160684.9, 151974.8
NAHH 65398.3, 63475.5 13358.4, 13332.6 157243.0, 149897.9 20654.3, 20650.8 152081.6, 149898.1
Min 60608.2, 58052.1 12290.0, 12263.0 145333.5, 142517.0 20650.8, 20650.8 147124.6, 144269.4
[Top]
Last Updated: 09 September 2011 by Gabriela Ochoa.