Last dimension | Dimension = 2 | Next dimension
| Δ fopt f1, 2-D |
1e1 2.0 |
1e0 6.0 |
1e-1 6.0 |
1e-2 6.0 |
1e-3 6.0 |
1e-5 6.0 |
1e-7 6.0 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1.3 (1) | 4.1 (4) | 11 (7) | 22 (4) | 32 (3) | 52 (4) | 74 (8) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 3.0 (2) | 3.6 (3) | 7.5 (6) | 14 (5) | 18 (5) | 27 (10) | 36 (7) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 4.9 (4) | 4.8 (5) | 7.9 (5) | 11 (4) | 13 (0.7) | 16 (2) | 20 (3) | 15/15 |
| CMAES posik noiseless | 3.4 (5) | 4.6 (3) | 9.0 (4) | 15 (5) | 19 (7) | 30 (4) | 41 (6) | 15/15 |
| CMA brockhoff noiseless | 2.6 (2) | 4.1 (2) | 9.4 (3) | 14 (5) | 18 (4) | 28 (6) | 38 (7) | 15/15 |
| CMAa brockhoff noiseless | 3.1 (4) | 3.0 (2) | 7.7 (5) | 11 (9) | 18 (4) | 27 (5) | 39 (13) | 15/15 |
| CMAm brockhoff noiseless | 2.8 (3) | 3.1 (3) | 6.0 (4) | 11 (3) | 15 (5) | 23 (4) | 31 (4) | 15/15 |
| CMAma brockhoff noiseless | 2.7 (3) | 3.6 (2) | 7.3 (5) | 11 (4) | 15 (5) | 23 (4) | 30 (6) | 15/15 |
| CMAmah brockhoff noiseless | 3.1 (3) | 3.1 (1) | 5.7 (3) | 9.2 (3) | 13 (4) | 20 (8) | 28 (5) | 15/15 |
| CMAmh brockhoff noiseless | 3.7 (4) | 2.5 (2) | 5.9 (2) | 9.2 (2) | 12 (2) | 21 (6) | 29 (3) | 15/15 |
| DBRCGA chuang noiseless | 1.6 (1) | 4.5 (3) | 14 (9) | 26 (11) | 37 (7) | 56 (9) | 79 (12) | 15/15 |
| DE-AUTO voglis noiseless | 1.4 (0.5) | 3.2 (2) | 8.3 (2) | 10 (0.1) | 10 (0.1) | 10 (0.1) | 10 (0.1) | 15/15 |
| DE-BFGS voglis noiseless | 2.6 (2) | 3.9 (3) | 8.7 (0.7) | 9.4 (0) | 9.4 (0.2) | 9.4 (0.2) | 9.4 (0.2) | 15/15 |
| DE-ROLL voglis noiseless | 1.9 (3) | 2.4 (2) | 11 (18) | 13 (1) | 13 (1) | 13 (0.3) | 13 (8) | 15/15 |
| DE-SIMPLEX voglis noiseless | 2.6 (1) | 4.9 (4) | 10 (5) | 12 (1) | 14 (2) | 16 (2) | 18 (2) | 15/15 |
| DEAE posik noiseless | 1.9 (1) | 5.0 (7) | 14 (9) | 25 (10) | 35 (7) | 53 (22) | 75 (16) | 15/15 |
| DE posik noiseless | 1.7 (2) | 3.4 (5) | 12 (8) | 22 (8) | 33 (15) | 51 (12) | 70 (27) | 15/15 |
| DEb posik noiseless | 1.7 (2) | 3.4 (2) | 12 (8) | 22 (8) | 33 (8) | 51 (7) | 70 (30) | 15/15 |
| DEctpb posik noiseless | 2.3 (2) | 4.4 (4) | 13 (7) | 24 (3) | 37 (4) | 54 (6) | 75 (6) | 15/15 |
| IPOPsaACM loshchilov noiseless | 2.8 (2) | 3.4 (3) | 6.6 (5) | 10 (2) | 12 (0.9) | 15 (1) | 19 (1) | 15/15 |
| JADE posik noiseless | 2.1 (2) | 3.8 (3) | 8.7 (4) | 14 (7) | 23 (7) | 37 (6) | 53 (6) | 15/15 |
| JADEctpb posik noiseless | 2.1 (2) | 3.8 (4) | 8.7 (5) | 14 (8) | 23 (9) | 37 (5) | 53 (3) | 15/15 |
| MVDE melo noiseless | 2.0 (5) | 3.5 (4) | 19 (9) | 45 (28) | 81 (20) | 134 (31) | 181 (40) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 4.3 (6) | 3.8 (3) | 7.2 (4) | 12 (5) | 16 (7) | 28 (5) | 38 (7) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.3 (2) | 3.5 (3) | 7.2 (4) | 12 (4) | 17 (4) | 27 (6) | 35 (6) | 15/15 |
| PSO-BFGS voglis noiseless | 1.7 (3) | 5.0 (4) | 8.6 (2) | 9.4 (0.2) | 10 (0.2) | 10 (0.2) | 10 (0.1) | 15/15 |
| SNES schaul noiseless | 5.9 (9) | 4.2 (4) | 6.7 (5) | 13 (8) | 19 (15) | 40 (5) | 53 (15) | 15/15 |
| xNES schaul noiseless | 3.8 (4) | 3.9 (4) | 6.9 (6) | 10 (7) | 18 (7) | 33 (5) | 46 (11) | 15/15 |
| xNESas schaul noiseless | 5.9 (8) | 4.1 (5) | 7.5 (4) | 13 (6) | 19 (10) | 29 (9) | 42 (9) | 15/15 |
| Δ fopt f2, 2-D |
1e1 16 |
1e0 19 |
1e-1 25 |
1e-2 25 |
1e-3 26 |
1e-5 28 |
1e-7 29 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 13 (3) | 14 (3) | 13 (2) | 15 (3) | 17 (4) | 20 (2) | 24 (2) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 14 (8) | 16 (7) | 14 (4) | 15 (6) | 16 (2) | 17 (4) | 18 (3) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 6.5 (2) | 7.0 (2) | 5.7 (0.2) | 6.2 (0.8) | 6.4 (2) | 6.8 (2) | 7.3 (0.8) | 15/15 |
| CMAES posik noiseless | 18 (11) | 22 (4) | 20 (3) | 21 (3) | 21 (4) | 23 (2) | 24 (3) | 15/15 |
| CMA brockhoff noiseless | 13 (12) | 18 (10) | 17 (5) | 19 (4) | 20 (3) | 21 (3) | 22 (3) | 15/15 |
| CMAa brockhoff noiseless | 13 (9) | 15 (5) | 14 (2) | 15 (3) | 15 (2) | 16 (1) | 17 (1) | 15/15 |
| CMAm brockhoff noiseless | 12 (10) | 20 (8) | 17 (6) | 19 (7) | 19 (5) | 20 (4) | 21 (4) | 15/15 |
| CMAma brockhoff noiseless | 13 (10) | 19 (4) | 15 (4) | 17 (2) | 17 (2) | 17 (2) | 19 (2) | 15/15 |
| CMAmah brockhoff noiseless | 19 (10) | 23 (8) | 20 (3) | 21 (4) | 21 (3) | 21 (2) | 22 (3) | 15/15 |
| CMAmh brockhoff noiseless | 23 (15) | 27 (10) | 26 (3) | 27 (3) | 27 (2) | 27 (2) | 28 (3) | 15/15 |
| DBRCGA chuang noiseless | 11 (11) | 15 (5) | 16 (6) | 18 (5) | 19 (5) | 23 (5) | 29 (8) | 15/15 |
| DE-AUTO voglis noiseless | 4.4 (0.2) | 3.8 (0.2) | 3.0 (0.2) | 3.1 (0.4) | 3.2 (0.4) | 3.3 (0.4) | 3.4 (0.6) | 15/15 |
| DE-BFGS voglis noiseless | 4.1 (0.4) | 3.7 (0.5) | 3.0 (0.1) | 3.2 (0.6) | 3.2 (0.8) | 3.2 (0.3) | 3.3 (0.8) | 15/15 |
| DE-ROLL voglis noiseless | 5.1 (0.5) | 4.5 (3) | 3.5 (2) | 3.7 (1) | 3.7 (2) | 3.8 (1) | 4.1 (1) | 15/15 |
| DE-SIMPLEX voglis noiseless | 5.2 (1) | 5.3 (1) | 4.2 (1) | 4.6 (0.8) | 4.7 (0.5) | 4.9 (0.8) | 5.2 (0.9) | 15/15 |
| DEAE posik noiseless | 11 (4) | 12 (5) | 13 (2) | 15 (2) | 17 (1) | 21 (2) | 24 (3) | 15/15 |
| DE posik noiseless | 11 (2) | 12 (4) | 11 (3) | 13 (3) | 15 (4) | 18 (5) | 21 (2) | 15/15 |
| DEb posik noiseless | 11 (2) | 12 (4) | 11 (4) | 13 (2) | 15 (4) | 18 (2) | 21 (2) | 15/15 |
| DEctpb posik noiseless | 11 (4) | 12 (5) | 12 (2) | 14 (3) | 16 (2) | 19 (5) | 22 (4) | 15/15 |
| IPOPsaACM loshchilov noiseless | 5.2 (3) | 5.7 (3) | 5.3 (0.9) | 5.7 (1.0) | 5.9 (0.8) | 6.1 (0.7) | 6.7 (2) | 15/15 |
| JADE posik noiseless | 7.6 (2) | 9.4 (3) | 9.3 (2) | 11 (2) | 12 (3) | 15 (2) | 17 (2) | 15/15 |
| JADEb posik noiseless | 6.6 (0.9) | 7.6 (2) | 7.1 (0.6) | 8.1 (1) | 9.0 (2) | 11 (0.9) | 13 (3) | 15/15 |
| JADEctpb posik noiseless | 7.6 (4) | 9.4 (3) | 9.3 (2) | 11 (3) | 12 (2) | 15 (3) | 17 (2) | 15/15 |
| MVDE melo noiseless | 23 (10) | 28 (10) | 28 (7) | 35 (1) | 39 (5) | 50 (6) | 59 (5) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 14 (10) | 18 (6) | 15 (4) | 16 (2) | 17 (4) | 17 (4) | 19 (3) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 11 (6) | 15 (7) | 14 (3) | 16 (2) | 16 (2) | 17 (2) | 19 (2) | 15/15 |
| PSO-BFGS voglis noiseless | 4.3 (0.5) | 3.8 (0.4) | 3.0 (0.5) | 3.2 (0.4) | 3.1 (0.3) | 3.1 (0.3) | 3.2 (0.4) | 15/15 |
| SNES schaul noiseless | 11 (6) | 12 (5) | 11 (4) | 13 (3) | 14 (2) | 17 (2) | 19 (1) | 15/15 |
| xNES schaul noiseless | 6.7 (5) | 11 (5) | 11 (4) | 12 (4) | 13 (3) | 15 (3) | 17 (2) | 15/15 |
| xNESas schaul noiseless | 9.2 (9) | 19 (28) | 17 (21) | 19 (12) | 27 (76) | 38 (84) | 42 (14) | 15/15 |
| Δ fopt f3, 2-D |
1e1 15 |
1e0 271 |
1e-1 445 |
1e-2 446 |
1e-3 450 |
1e-5 454 |
1e-7 464 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 5.0 (3) | 1.8 (0.7) | 17 (30) | 18 (58) | 18 (1) | 18 (1) | 18 (56) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 3.3 (2) | 3.9 (4) | 7.6 (11) | 7.8 (9) | 7.9 (10) | 8.1 (11) | 8.2 (7) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 6.1 (3) | 1.9 (2) | 5.0 (9) | 6.4 (2) | 6.8 (11) | 6.8 (3) | 7.1 (6) | 15/15 |
| CMAES posik noiseless | 3.8 (4) | 4.2 (4) | 10 (8) | 10 (11) | 10 (20) | 10 (8) | 10 (8) | 15/15 |
| CMA brockhoff noiseless | 3.9 (4) | 5.5 (4) | 8.0 (7) | 8.4 (8) | 8.5 (8) | 8.8 (8) | 9.0 (7) | 15/15 |
| CMAa brockhoff noiseless | 2.5 (3) | 3.2 (3) | 5.2 (3) | 5.6 (7) | 5.7 (7) | 5.9 (3) | 6.0 (5) | 15/15 |
| CMAm brockhoff noiseless | 2.7 (3) | 3.2 (3) | 5.9 (5) | 6.3 (5) | 6.6 (8) | 6.9 (9) | 7.0 (10) | 15/15 |
| CMAma brockhoff noiseless | 2.4 (4) | 2.8 (4) | 6.0 (4) | 9.1 (6) | 10 (9) | 10 (6) | 11 (20) | 15/15 |
| CMAmah brockhoff noiseless | 5.4 (5) | 5.2 (7) | 6.1 (8) | 6.3 (9) | 6.7 (9) | 6.9 (3) | 7.1 (10) | 15/15 |
| CMAmh brockhoff noiseless | 6.6 (10) | 3.9 (4) | 6.4 (7) | 7.5 (7) | 7.9 (8) | 8.2 (8) | 8.3 (9) | 15/15 |
| DBRCGA chuang noiseless | 2.8 (3) | 2.0 (2) | 2.4 (2) | 2.6 (2) | 2.8 (2) | 3.1 (2) | 3.7 (3) | 15/15 |
| DE-AUTO voglis noiseless | 3.5 (2) | 3.7 (3) | 5.8 (8) | 5.9 (5) | 5.9 (5) | 5.8 (8) | 5.7 (6) | 15/15 |
| DE-BFGS voglis noiseless | 6.3 (8) | 1.6 (1) | 1.7 (0.7) | 1.7 (0.8) | 1.7 (0.6) | 1.7 (0.7) | 1.7 (0.8) | 15/15 |
| DE-ROLL voglis noiseless | 4.4 (4) | 0.50 (0.2) | 1.5 (2) | 1.5 (0.9) | 1.5 (1) | 1.5 (2) | 1.5 (1) | 15/15 |
| DE-SIMPLEX voglis noiseless | 8.7 (4) | 2.7 (2) | 2.6 (2) | 2.7 (2) | 2.7 (1.0) | 2.7 (1) | 2.7 (2) | 15/15 |
| DEAE posik noiseless | 3.7 (2) | 1.9 (0.5) | 2.7 (3) | 2.9 (4) | 3.0 (2) | 3.3 (3) | 3.5 (3) | 15/15 |
| DE posik noiseless | 3.8 (3) | 0.96 (0.3) | 1.9 (0.1) | 2.0 (2) | 2.1 (2) | 2.3 (2) | 2.5 (4) | 15/15 |
| DEb posik noiseless | 3.8 (3) | 0.96 (0.3) | 1.9 (3) | 2.0 (3) | 2.1 (2) | 2.3 (1) | 2.5 (0.8) | 15/15 |
| DEctpb posik noiseless | 4.0 (2) | 1.3 (0.4) | 1.4 (0.6) | 1.6 (2) | 1.9 (2) | 2.3 (0.6) | 2.6 (0.5) | 15/15 |
| IPOPsaACM loshchilov noiseless | 3.1 (3) | 3.0 (2) | 5.2 (7) | 6.4 (5) | 7.0 (16) | 7.2 (7) | 7.2 (6) | 15/15 |
| JADE posik noiseless | 3.1 (2) | 0.96 (0.5) | 0.76 (0.2) | 1.0 (0.4) | 1.3 (0.3) | 1.5 (0.3) | 1.7 (0.3) | 15/15 |
| JADEb posik noiseless | 3.9 (3) | 1.3 (3) | 3.4 (3) | 3.5 (2) | 3.5 (3) | 3.7 (3) | 3.7 (2) | 15/15 |
| JADEctpb posik noiseless | 3.1 (2) | 0.96 (0.5) | 0.76 (0.3) | 1.0 (0.3) | 1.3 (0.4) | 1.5 (0.3) | 1.7 (0.2) | 15/15 |
| MVDE melo noiseless | 6.2 (3) | 1.9 (0.5) | 1.7 (0.4) | 2.1 (0.4) | 2.4 (0.3) | 3.3 (0.4) | 4.0 (0.5) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 5.8 (25) | 2.4 (3) | 8.8 (5) | 9.2 (13) | 10 (21) | 10 (12) | 10 (13) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.3 (2) | 3.1 (4) | 10 (11) | 14 (23) | 16 (14) | 16 (22) | 17 (22) | 15/15 |
| PSO-BFGS voglis noiseless | 6.8 (2) | 1.6 (2) | 3.0 (2) | 3.0 (3) | 3.0 (4) | 2.9 (2) | 2.9 (2) | 15/15 |
| SNES schaul noiseless | 12 (6) | 5.8 (6) | 21 (9) | 34 (52) | 34 (73) | 34 (23) | 33 (20) | 15/15 |
| xNES schaul noiseless | 13 (35) | 13 (22) | 23 (8) | 24 (44) | 24 (19) | 24 (33) | 23 (19) | 15/15 |
| xNESas schaul noiseless | 13 (23) | 6.6 (10) | 20 (29) | 20 (23) | 20 (22) | 20 (13) | 20 (14) | 15/15 |
| Δ fopt f4, 2-D |
1e1 22 |
1e0 344 |
1e-1 459 |
1e-2 496 |
1e-3 523 |
1e-5 544 |
1e-7 566 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 4.4 (2) | 22 (75) | 92 (220) | 86 (52) | 82 (50) | 79 (117) | 76 (47) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 4.0 (8) | 8.1 (16) | 41 (32) | 40 (32) | 39 (24) | 39 (39) | 38 (43) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 3.7 (5) | 6.3 (9) | 34 (29) | 73 (28) | 92 (124) | 229 (231) | 224 (223) | 15/15 |
| CMAES posik noiseless | 4.5 (11) | 4.4 (7) | 42 (18) | 41 (16) | 42 (39) | 40 (36) | 39 (25) | 15/15 |
| CMA brockhoff noiseless | 2.6 (2) | 6.7 (6) | 50 (47) | 79 (52) | 95 (110) | 104 (88) | 105 (92) | 15/15 |
| CMAa brockhoff noiseless | 2.1 (2) | 11 (10) | 66 (40) | 108 (93) | 140 (93) | 151 (146) | 154 (166) | 15/15 |
| CMAm brockhoff noiseless | 2.1 (1) | 8.2 (10) | 74 (84) | 120 (115) | 163 (115) | 175 (126) | 178 (237) | 15/15 |
| CMAma brockhoff noiseless | 2.1 (5) | 10 (15) | 112 (79) | 208 (156) | 218 (221) | 241 (109) | 243 (175) | 15/15 |
| CMAmah brockhoff noiseless | 6.6 (13) | 7.3 (10) | 56 (56) | 117 (231) | 133 (150) | 144 (193) | 144 (69) | 15/15 |
| CMAmh brockhoff noiseless | 3.6 (14) | 7.0 (8) | 71 (64) | 135 (212) | 144 (203) | 161 (209) | 162 (271) | 15/15 |
| DBRCGA chuang noiseless | 3.6 (2) | 1.8 (1) | 2.7 (2) | 2.8 (1) | 2.7 (2) | 2.9 (2) | 3.1 (2) | 15/15 |
| DE-AUTO voglis noiseless | 2.6 (0.8) | 4.0 (7) | 8.4 (8) | 7.8 (7) | 7.4 (6) | 7.1 (5) | 6.8 (6) | 15/15 |
| DE-BFGS voglis noiseless | 3.4 (3) | 1.6 (1) | 2.7 (5) | 2.5 (1) | 2.4 (5) | 2.4 (2) | 2.3 (4) | 15/15 |
| DE-ROLL voglis noiseless | 2.3 (1) | 1.1 (1) | 2.4 (2) | 2.3 (2) | 2.2 (3) | 2.1 (3) | 2.0 (2) | 15/15 |
| DE-SIMPLEX voglis noiseless | 4.7 (3) | 1.9 (2) | 4.2 (4) | 3.9 (4) | 3.7 (0.6) | 3.6 (6) | 3.5 (0.9) | 15/15 |
| DEAE posik noiseless | 3.9 (2) | 2.8 (1.0) | 5.0 (4) | 4.8 (7) | 4.8 (3) | 4.8 (4) | 4.9 (3) | 15/15 |
| DE posik noiseless | 3.1 (3) | 2.1 (2) | 3.8 (5) | 3.6 (2) | 3.6 (4) | 4.0 (4) | 4.0 (3) | 15/15 |
| DEb posik noiseless | 3.1 (3) | 2.1 (2) | 3.8 (4) | 3.6 (4) | 3.6 (3) | 4.0 (2) | 4.0 (3) | 15/15 |
| DEctpb posik noiseless | 4.2 (1) | 1.2 (0.4) | 2.2 (3) | 2.2 (0.6) | 2.3 (3) | 2.6 (2) | 2.8 (2) | 15/15 |
| IPOPsaACM loshchilov noiseless | 2.5 (2) | 4.5 (5) | 69 (69) | 98 (96) | 283 (186) | 1074 (1177) | 1130 (1632) | 14/15 |
| JADE posik noiseless | 2.6 (2) | 1.1 (0.5) | 1.4 (1) | 1.4 (0.9) | 1.5 (1) | 1.7 (0.8) | 1.8 (1) | 15/15 |
| JADEb posik noiseless | 4.4 (2) | 2.6 (6) | 6.9 (10) | 6.5 (3) | 6.2 (4) | 6.1 (7) | 6.0 (4) | 15/15 |
| JADEctpb posik noiseless | 2.6 (1) | 1.1 (2) | 1.4 (0.5) | 1.4 (0.4) | 1.5 (0.9) | 1.7 (1) | 1.8 (1) | 15/15 |
| MVDE melo noiseless | 5.6 (4) | 1.7 (0.7) | 1.7 (0.5) | 2.1 (0.4) | 2.4 (0.3) | 3.0 (0.3) | 3.5 (0.5) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 2.4 (1) | 8.0 (6) | 67 (125) | 73 (53) | 71 (116) | 71 (121) | 69 (96) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.8 (1) | 5.7 (4) | 120 (74) | 162 (310) | 177 (249) | 178 (281) | 175 (78) | 15/15 |
| PSO-BFGS voglis noiseless | 4.4 (6) | 2.1 (3) | 4.5 (2) | 4.1 (9) | 3.9 (3) | 3.8 (8) | 4.4 (4) | 15/15 |
| SNES schaul noiseless | 8.4 (25) | 12 (20) | 47 (61) | 44 (45) | 44 (39) | 42 (90) | 41 (85) | 15/15 |
| xNES schaul noiseless | 8.5 (1) | 20 (17) | 64 (81) | 60 (60) | 57 (74) | 55 (32) | 53 (46) | 15/15 |
| xNESas schaul noiseless | 11 (34) | 11 (6) | 46 (73) | 46 (69) | 44 (69) | 42 (43) | 41 (54) | 15/15 |
| Δ fopt f5, 2-D |
1e1 4.0 |
1e0 4.0 |
1e-1 4.0 |
1e-2 4.0 |
1e-3 4.0 |
1e-5 4.0 |
1e-7 4.0 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 3.6 (1) | 15 (1) | 17 (1) | 17 (2) | 17 (2) | 17 (0.9) | 17 (1) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 2.6 (1) | 5.8 (5) | 6.2 (2) | 6.2 (5) | 6.2 (4) | 6.2 (4) | 6.2 (2) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 3.6 (2) | 6.3 (2) | 7.1 (6) | 7.1 (6) | 7.1 (4) | 7.1 (5) | 7.1 (5) | 15/15 |
| CMAES posik noiseless | 2.8 (3) | 6.4 (4) | 6.7 (2) | 6.7 (6) | 6.8 (3) | 6.8 (4) | 6.8 (7) | 15/15 |
| CMA brockhoff noiseless | 3.5 (4) | 8.5 (6) | 9.2 (8) | 9.2 (8) | 9.2 (8) | 9.2 (7) | 9.2 (8) | 15/15 |
| CMAa brockhoff noiseless | 4.3 (4) | 6.7 (3) | 6.8 (4) | 6.9 (5) | 6.9 (5) | 6.9 (5) | 6.9 (5) | 15/15 |
| CMAm brockhoff noiseless | 2.5 (2) | 4.6 (2) | 5.0 (2) | 5.1 (2) | 5.1 (3) | 5.1 (3) | 5.1 (2) | 15/15 |
| CMAma brockhoff noiseless | 2.7 (2) | 4.7 (3) | 4.9 (3) | 4.9 (4) | 5.2 (2) | 5.2 (2) | 5.2 (3) | 15/15 |
| CMAmah brockhoff noiseless | 3.0 (2) | 5.2 (3) | 5.6 (4) | 5.7 (8) | 5.7 (3) | 5.7 (6) | 5.7 (3) | 15/15 |
| CMAmh brockhoff noiseless | 2.0 (0.7) | 3.5 (2) | 3.9 (2) | 3.9 (3) | 3.9 (2) | 3.9 (3) | 3.9 (0.9) | 15/15 |
| DBRCGA chuang noiseless | 3.1 (2) | 10 (6) | 12 (5) | 12 (6) | 12 (4) | 12 (5) | 12 (4) | 15/15 |
| DE-AUTO voglis noiseless | 3.3 (2) | 10 (3) | 11 (3) | 11 (3) | 11 (3) | 11 (4) | 11 (4) | 15/15 |
| DE-BFGS voglis noiseless | 5.4 (2) | 14 (0.9) | 14 (3) | 14 (0.2) | 14 (0.9) | 14 (3) | 14 (0.4) | 15/15 |
| DE-ROLL voglis noiseless | 3.3 (3) | 10 (3) | 12 (2) | 12 (3) | 12 (3) | 13 (2) | 13 (3) | 15/15 |
| DE-SIMPLEX voglis noiseless | 4.5 (2) | 9.0 (6) | 12 (4) | 13 (8) | 13 (8) | 15 (10) | 40 (62) | 15/15 |
| DEAE posik noiseless | 2.9 (2) | 10 (3) | 11 (3) | 12 (5) | 12 (12) | 12 (15) | 12 (12) | 15/15 |
| DE posik noiseless | 3.1 (2) | 8.4 (5) | 8.9 (7) | 8.9 (4) | 8.9 (6) | 8.9 (5) | 8.9 (6) | 15/15 |
| DEb posik noiseless | 3.1 (4) | 8.4 (5) | 8.9 (5) | 8.9 (6) | 8.9 (3) | 8.9 (6) | 8.9 (6) | 15/15 |
| DEctpb posik noiseless | 4.2 (4) | 10 (6) | 11 (10) | 12 (7) | 12 (8) | 12 (8) | 12 (8) | 15/15 |
| IPOPsaACM loshchilov noiseless | 2.8 (3) | 6.7 (5) | 7.5 (5) | 7.5 (6) | 7.5 (2) | 7.5 (5) | 7.5 (6) | 15/15 |
| JADE posik noiseless | 2.8 (2) | 10 (8) | 12 (9) | 12 (12) | 12 (9) | 12 (12) | 12 (12) | 15/15 |
| JADEb posik noiseless | 3.2 (1) | 7.0 (8) | 8.4 (8) | 8.6 (3) | 8.6 (6) | 8.6 (6) | 8.6 (3) | 15/15 |
| JADEctpb posik noiseless | 2.8 (2) | 10 (8) | 12 (8) | 12 (9) | 12 (9) | 12 (7) | 12 (5) | 15/15 |
| MVDE melo noiseless | 4.8 (6) | 37 (11) | 49 (12) | 49 (15) | 49 (17) | 49 (6) | 49 (17) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 3.7 (2) | 6.5 (3) | 7.0 (3) | 7.0 (4) | 7.0 (3) | 7.0 (4) | 7.0 (5) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.9 (3) | 5.4 (3) | 5.9 (3) | 5.9 (3) | 5.9 (4) | 5.9 (4) | 5.9 (4) | 15/15 |
| PSO-BFGS voglis noiseless | 5.8 (6) | 15 (0.6) | 15 (0.4) | 15 (0.4) | 15 (0.4) | 15 (0.2) | 15 (0.2) | 15/15 |
| SNES schaul noiseless | 4.8 (3) | 11 (7) | 13 (5) | 13 (8) | 13 (6) | 13 (9) | 13 (8) | 15/15 |
| xNES schaul noiseless | 6.3 (3) | 15 (10) | 16 (19) | 16 (10) | 16 (17) | 16 (12) | 16 (17) | 15/15 |
| xNESas schaul noiseless | 5.4 (4) | 21 (8) | 22 (11) | 22 (22) | 22 (33) | 22 (32) | 22 (31) | 15/15 |
| Δ fopt f6, 2-D |
1e1 13 |
1e0 23 |
1e-1 41 |
1e-2 54 |
1e-3 67 |
1e-5 95 |
1e-7 124 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 2.1 (3) | 6.1 (4) | 6.0 (2) | 7.3 (1) | 8.1 (2) | 8.3 (2) | 8.9 (1) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 1.9 (2) | 3.4 (1) | 3.1 (0.8) | 3.4 (1) | 3.5 (0.4) | 3.7 (1) | 3.8 (0.6) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.2 (1) | 3.0 (1.0) | 3.1 (1) | 3.3 (1) | 4.0 (3) | 4.0 (2) | 4.2 (2) | 15/15 |
| CMAES posik noiseless | 2.6 (2) | 4.0 (3) | 4.3 (2) | 4.2 (1) | 4.3 (2) | 4.2 (1) | 4.3 (1) | 15/15 |
| CMA brockhoff noiseless | 2.1 (1.0) | 3.8 (4) | 4.1 (2) | 4.1 (1) | 3.9 (1) | 4.1 (1) | 4.1 (1.0) | 15/15 |
| CMAa brockhoff noiseless | 2.9 (5) | 4.3 (3) | 3.2 (2) | 4.0 (1) | 3.9 (1) | 3.9 (0.6) | 3.9 (0.6) | 15/15 |
| CMAm brockhoff noiseless | 3.9 (4) | 5.5 (3) | 4.3 (2) | 4.3 (1) | 4.4 (0.8) | 4.5 (2) | 4.6 (1) | 15/15 |
| CMAma brockhoff noiseless | 2.0 (4) | 3.7 (4) | 4.0 (2) | 4.1 (2) | 4.0 (1) | 4.1 (1.0) | 4.3 (0.5) | 15/15 |
| CMAmah brockhoff noiseless | 2.3 (2) | 3.6 (1) | 2.8 (0.9) | 2.7 (0.9) | 3.0 (0.4) | 2.9 (0.4) | 2.9 (0.5) | 15/15 |
| CMAmh brockhoff noiseless | 2.4 (1) | 3.3 (4) | 3.2 (3) | 3.3 (1) | 3.4 (1) | 3.2 (0.9) | 3.3 (0.4) | 15/15 |
| DBRCGA chuang noiseless | 2.0 (2) | 6.4 (2) | 6.7 (3) | 6.9 (3) | 7.4 (2) | 7.4 (1) | 8.1 (2) | 15/15 |
| DE-AUTO voglis noiseless | 1.5 (1) | 3.0 (1.0) | 2.3 (1) | 2.1 (0.6) | 1.9 (0.9) | 1.7 (0.7) | 1.5 (0.6) | 15/15 |
| DE-BFGS voglis noiseless | 1.9 (2) | 3.1 (2) | 2.4 (1) | 2.0 (0.6) | 1.8 (0.6) | 1.5 (0.6) | 1.6 (2) | 15/15 |
| DE-ROLL voglis noiseless | 1.4 (1) | 9.4 (20) | 22 (62) | 20 (56) | 18 (20) | 50 (135) | 136 (459) | 14/15 |
| DE-SIMPLEX voglis noiseless | 2.0 (1) | 3.0 (0.9) | 2.2 (0.4) | 2.0 (0.9) | 1.9 (0.3) | 1.6 (0.6) | 1.6 (0.5) | 15/15 |
| DEAE posik noiseless | 2.9 (4) | 5.3 (4) | 5.4 (2) | 5.9 (2) | 6.5 (3) | 6.4 (2) | 6.7 (1) | 15/15 |
| DE posik noiseless | 2.8 (3) | 4.7 (3) | 6.2 (2) | 7.0 (3) | 7.5 (2) | 8.0 (1) | 8.4 (2) | 15/15 |
| DEb posik noiseless | 2.8 (2) | 4.7 (4) | 6.2 (0.8) | 7.0 (3) | 7.5 (2) | 8.0 (2) | 8.4 (1) | 15/15 |
| DEctpb posik noiseless | 3.4 (2) | 5.9 (1) | 6.3 (3) | 8.0 (2) | 8.9 (2) | 8.9 (3) | 9.4 (2) | 15/15 |
| IPOPsaACM loshchilov noiseless | 2.5 (2) | 3.3 (4) | 4.2 (1) | 3.9 (1) | 3.8 (3) | 3.8 (1) | 3.9 (1) | 15/15 |
| JADE posik noiseless | 1.7 (2) | 3.6 (2) | 3.4 (3) | 4.3 (1) | 4.5 (1) | 4.8 (1) | 5.1 (0.9) | 15/15 |
| JADEb posik noiseless | 2.3 (2) | 3.0 (2) | 3.2 (2) | 3.5 (0.9) | 3.8 (1) | 4.3 (1) | 4.4 (1) | 15/15 |
| JADEctpb posik noiseless | 1.7 (2) | 3.6 (2) | 3.4 (2) | 4.3 (2) | 4.5 (1) | 4.8 (1) | 5.1 (0.6) | 15/15 |
| MVDE melo noiseless | 1.9 (3) | 8.5 (7) | 12 (5) | 17 (5) | 22 (8) | 28 (7) | 30 (5) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 2.7 (4) | 3.8 (2) | 3.5 (1) | 3.9 (1) | 3.9 (0.9) | 4.0 (1) | 4.0 (0.9) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.9 (3) | 3.9 (3) | 3.2 (1) | 3.6 (1) | 3.8 (0.6) | 3.8 (0.9) | 3.9 (0.3) | 15/15 |
| PSO-BFGS voglis noiseless | 3.1 (3) | 3.8 (0.8) | 2.7 (0.6) | 2.3 (0.3) | 2.1 (0.5) | 1.7 (0.3) | 1.6 (0.7) | 15/15 |
| SNES schaul noiseless | 2.6 (3) | 3.3 (2) | 3.4 (1.0) | 4.1 (1) | 4.8 (2) | 5.0 (0.9) | 5.3 (1) | 15/15 |
| xNES schaul noiseless | 5.0 (18) | 4.6 (7) | 4.5 (5) | 5.7 (1) | 5.8 (6) | 5.5 (5) | 5.2 (4) | 15/15 |
| xNESas schaul noiseless | 5.4 (7) | 6.1 (3) | 14 (2) | 13 (1) | 11 (25) | 9.3 (34) | 8.5 (26) | 15/15 |
| Δ fopt f7, 2-D |
1e1 3.0 |
1e0 21 |
1e-1 60 |
1e-2 193 |
1e-3 217 |
1e-5 217 |
1e-7 241 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 5.0 (7) | 4.1 (2) | 3.8 (2) | 2.0 (2) | 2.0 (2) | 2.0 (1.0) | 2.5 (3) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 6.7 (3) | 5.6 (7) | 3.2 (3) | 1.9 (1) | 1.9 (2) | 1.9 (2) | 1.9 (3) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 4.7 (4) | 2.8 (3) | 2.5 (2) | 1.1 (0.6) | 1.2 (1) | 1.2 (1) | 1.2 (0.9) | 15/15 |
| CMAES posik noiseless | 5.6 (17) | 2.8 (2) | 2.6 (2) | 1.5 (0.6) | 1.6 (3) | 1.6 (0.6) | 2.2 (2) | 15/15 |
| CMA brockhoff noiseless | 3.4 (1) | 2.2 (1) | 1.8 (2) | 1.3 (2) | 1.4 (2) | 1.4 (2) | 1.8 (1) | 15/15 |
| CMAa brockhoff noiseless | 5.4 (5) | 2.6 (4) | 2.1 (2) | 1.1 (1) | 1.2 (0.7) | 1.2 (0.7) | 1.3 (0.7) | 15/15 |
| CMAm brockhoff noiseless | 5.7 (5) | 3.7 (9) | 2.1 (0.7) | 1.2 (0.6) | 1.1 (0.6) | 1.1 (1) | 1.2 (2) | 15/15 |
| CMAma brockhoff noiseless | 6.9 (5) | 3.6 (2) | 3.1 (2) | 1.2 (0.7) | 1.2 (0.4) | 1.2 (1) | 1.4 (1) | 15/15 |
| CMAmah brockhoff noiseless | 3.4 (4) | 2.1 (3) | 2.7 (2) | 1.1 (0.9) | 1.7 (2) | 1.7 (2) | 1.9 (0.9) | 15/15 |
| CMAmh brockhoff noiseless | 2.7 (2) | 2.4 (1) | 4.5 (4) | 1.8 (2) | 1.7 (0.5) | 1.7 (2) | 2.0 (1) | 15/15 |
| DBRCGA chuang noiseless | 4.6 (2) | 3.1 (3) | 2.9 (3) | 1.8 (0.9) | 2.9 (4) | 2.9 (3) | 3.7 (4) | 15/15 |
| DE-AUTO voglis noiseless | 3.3 (3) | 4.5 (10) | 12 (9) | 6.3 (5) | 9.2 (4) | 9.2 (5) | 8.4 (7) | 15/15 |
| DE-BFGS voglis noiseless | 3.6 (4) | 12 (4) | 6.0 (2) | 2.3 (4) | 2.3 (3) | 2.3 (0.7) | 5.4 (5) | 15/15 |
| DE-ROLL voglis noiseless | 5.4 (7) | 7.0 (23) | 6.5 (7) | 2.8 (3) | 3.7 (3) | 3.7 (2) | 4.1 (3) | 15/15 |
| DE-SIMPLEX voglis noiseless | 5.0 (6) | 2.7 (3) | 2.2 (1) | 1.0 (0.7) | 1.1 (0.6) | 1.1 (0.9) | 1.2 (0.7) | 15/15 |
| DEAE posik noiseless | 5.8 (12) | 3.5 (4) | 3.0 (2) | 1.4 (0.3) | 1.6 (2) | 1.6 (0.8) | 1.7 (1) | 15/15 |
| DE posik noiseless | 5.5 (7) | 3.0 (2) | 2.9 (2) | 1.3 (1) | 1.7 (0.6) | 1.7 (0.3) | 1.9 (1) | 15/15 |
| DEb posik noiseless | 5.5 (9) | 3.0 (3) | 2.9 (2) | 1.3 (1) | 1.7 (0.5) | 1.7 (0.9) | 1.9 (0.8) | 15/15 |
| DEctpb posik noiseless | 9.2 (9) | 3.8 (2) | 3.4 (2) | 1.7 (0.7) | 1.7 (0.6) | 1.7 (1.0) | 2.1 (0.8) | 15/15 |
| IPOPsaACM loshchilov noiseless | 4.8 (8) | 5.1 (6) | 3.7 (3) | 1.5 (0.9) | 1.3 (1) | 1.3 (1) | 1.6 (1) | 15/15 |
| JADE posik noiseless | 6.2 (5) | 2.6 (2) | 2.0 (1) | 0.90 (0.3) | 0.97 (0.2) | 0.97 (0.1) | 1.1 (0.2) | 15/15 |
| JADEb posik noiseless | 2.6 (3) | 1.8 (2) | 4.1 (11) | 1.5 (6) | 34 (6) | 34 (118) | 31 (104) | 14/15 |
| JADEctpb posik noiseless | 6.2 (3) | 2.6 (2) | 2.0 (1) | 0.90 (0.3) | 0.97 (0.2) | 0.97 (0.1) | 1.1 (0.3) | 15/15 |
| MVDE melo noiseless | 6.6 (5) | 4.3 (1) | 5.6 (4) | 3.0 (2) | 4.0 (2) | 4.0 (1) | 5.1 (2) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 6.3 (7) | 3.6 (1) | 3.2 (4) | 1.6 (0.9) | 1.7 (2) | 1.7 (1.0) | 1.8 (1) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 4.8 (6) | 3.0 (3) | 3.6 (4) | 1.7 (2) | 1.6 (1) | 1.6 (2) | 1.6 (1) | 15/15 |
| PSO-BFGS voglis noiseless | 19 (95) | 54 (32) | 79 (102) | 27 (22) | 27 (33) | 27 (27) | 90 (118) | 12/15 |
| SNES schaul noiseless | 7.0 (7) | 34 (25) | 21 (50) | 11 (5) | 11 (18) | 11 (20) | 22 (20) | 13/15 |
| xNES schaul noiseless | 51 (171) | 39 (45) | 28 (25) | 9.0 (8) | 12 (15) | 12 (15) | 11 (14) | 15/15 |
| xNESas schaul noiseless | 5.5 (5) | 38 (53) | 26 (58) | 8.2 (18) | 7.4 (9) | 7.4 (13) | 7.8 (14) | 15/15 |
| Δ fopt f8, 2-D |
1e1 5.0 |
1e0 12 |
1e-1 37 |
1e-2 46 |
1e-3 86 |
1e-5 94 |
1e-7 112 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 6.4 (7) | 12 (7) | 12 (3) | 19 (7) | 17 (4) | 32 (6) | 39 (12) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 4.7 (3) | 8.9 (15) | 8.0 (6) | 8.6 (3) | 5.3 (3) | 5.6 (3) | 5.2 (1) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 5.2 (4) | 6.2 (8) | 3.8 (4) | 4.0 (3) | 2.5 (1) | 2.6 (1) | 2.4 (1) | 15/15 |
| CMAES posik noiseless | 7.1 (18) | 12 (22) | 9.5 (4) | 10 (4) | 6.1 (2) | 6.5 (3) | 6.0 (2) | 15/15 |
| CMA brockhoff noiseless | 6.7 (7) | 12 (17) | 7.4 (8) | 8.6 (4) | 5.4 (2) | 5.8 (4) | 5.4 (2) | 15/15 |
| CMAa brockhoff noiseless | 7.6 (14) | 13 (8) | 8.1 (8) | 8.8 (8) | 5.2 (3) | 5.5 (1) | 5.2 (2) | 15/15 |
| CMAm brockhoff noiseless | 5.2 (6) | 8.0 (3) | 10 (3) | 10 (8) | 6.1 (4) | 6.5 (3) | 5.9 (3) | 15/15 |
| CMAma brockhoff noiseless | 7.2 (12) | 8.4 (10) | 5.7 (11) | 6.9 (3) | 4.5 (3) | 4.7 (1) | 4.5 (1) | 15/15 |
| CMAmah brockhoff noiseless | 4.0 (3) | 6.4 (2) | 7.2 (5) | 8.6 (3) | 5.3 (2) | 5.4 (2) | 5.1 (1) | 15/15 |
| CMAmh brockhoff noiseless | 4.4 (3) | 14 (17) | 9.3 (10) | 12 (6) | 7.2 (5) | 7.3 (3) | 6.6 (2) | 15/15 |
| DBRCGA chuang noiseless | 4.8 (3) | 7.1 (7) | 12 (24) | 17 (17) | 15 (11) | 18 (10) | 19 (8) | 15/15 |
| DE-AUTO voglis noiseless | 5.8 (6) | 6.5 (3) | 3.0 (0.8) | 2.7 (1.0) | 1.6 (0.5) | 1.5 (0.4) | 1.3 (0.3) | 15/15 |
| DE-BFGS voglis noiseless | 5.9 (6) | 8.6 (2) | 3.6 (1) | 3.3 (0.9) | 1.8 (0.3) | 1.7 (0.4) | 1.5 (0.4) | 15/15 |
| DE-ROLL voglis noiseless | 33 (106) | 49 (77) | 103 (96) | 218 (147) | 209 (93) | 312 (32) | 1189 (815) | 6/15 |
| DE-SIMPLEX voglis noiseless | 5.5 (3) | 6.3 (5) | 3.2 (1) | 2.9 (0.8) | 1.7 (0.7) | 1.7 (0.7) | 1.5 (0.4) | 15/15 |
| DEAE posik noiseless | 6.6 (7) | 11 (5) | 8.2 (5) | 10 (9) | 6.8 (5) | 7.7 (5) | 7.4 (1) | 15/15 |
| DE posik noiseless | 7.4 (6) | 9.5 (8) | 7.3 (2) | 9.3 (4) | 6.2 (3) | 8.7 (4) | 9.4 (2) | 15/15 |
| DEb posik noiseless | 7.4 (6) | 9.5 (5) | 7.3 (4) | 9.3 (6) | 6.2 (2) | 8.7 (4) | 9.4 (2) | 15/15 |
| DEctpb posik noiseless | 11 (16) | 18 (16) | 12 (14) | 14 (14) | 8.7 (6) | 12 (4) | 13 (2) | 15/15 |
| IPOPsaACM loshchilov noiseless | 6.2 (5) | 11 (12) | 6.4 (5) | 6.4 (2) | 3.8 (1) | 3.8 (2) | 3.4 (1) | 15/15 |
| JADE posik noiseless | 4.2 (7) | 7.0 (7) | 6.7 (4) | 10 (4) | 6.0 (3) | 7.1 (1) | 7.2 (1) | 15/15 |
| JADEb posik noiseless | 5.2 (5) | 11 (6) | 7.8 (8) | 8.8 (4) | 5.4 (3) | 6.0 (3) | 6.1 (2) | 15/15 |
| JADEctpb posik noiseless | 4.2 (4) | 7.0 (5) | 6.7 (4) | 10 (3) | 6.0 (2) | 7.1 (2) | 7.2 (2) | 15/15 |
| MVDE melo noiseless | 10 (6) | 20 (14) | 20 (14) | 34 (28) | 22 (12) | 32 (12) | 36 (6) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 4.3 (5) | 11 (14) | 7.7 (4) | 8.6 (5) | 5.2 (2) | 5.5 (2) | 5.1 (2) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 5.3 (4) | 10 (8) | 7.5 (7) | 8.5 (5) | 5.2 (2) | 5.4 (2) | 5.0 (2) | 15/15 |
| PSO-BFGS voglis noiseless | 8.7 (6) | 10 (4) | 4.1 (0.8) | 3.6 (0.8) | 2.0 (0.2) | 1.9 (0.3) | 1.6 (0.2) | 15/15 |
| SNES schaul noiseless | 6.9 (5) | 881 (2122) | 572 (1242) | 824 (1510) | 731 (1762) | 1282 (1161) | 1523 (83) | 13/15 |
| xNES schaul noiseless | 6.9 (14) | 15 (40) | 21 (11) | 22 (7) | 13 (19) | 13 (9) | 12 (25) | 15/15 |
| xNESas schaul noiseless | 4.0 (5) | 17 (45) | 16 (3) | 18 (26) | 11 (13) | 11 (19) | 10 (15) | 15/15 |
| Δ fopt f9, 2-D |
1e1 1 |
1e0 18 |
1e-1 30 |
1e-2 44 |
1e-3 68 |
1e-5 81 |
1e-7 92 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 28 (25) | 4.9 (5) | 7.8 (3) | 11 (6) | 12 (8) | 21 (15) | 26 (21) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 28 (9) | 3.2 (2) | 7.1 (6) | 7.2 (2) | 5.3 (4) | 5.3 (2) | 5.4 (0.9) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 19 (22) | 5.9 (4) | 7.5 (5) | 6.6 (3) | 4.6 (3) | 4.2 (2) | 3.9 (1) | 15/15 |
| CMAES posik noiseless | 21 (18) | 5.7 (7) | 9.0 (7) | 9.1 (6) | 6.5 (4) | 6.7 (2) | 6.5 (2) | 15/15 |
| CMA brockhoff noiseless | 40 (16) | 7.8 (5) | 11 (7) | 10 (7) | 7.6 (5) | 7.4 (4) | 7.2 (5) | 15/15 |
| CMAa brockhoff noiseless | 26 (50) | 6.8 (7) | 10 (4) | 9.1 (5) | 6.7 (3) | 6.5 (2) | 6.3 (2) | 15/15 |
| CMAm brockhoff noiseless | 25 (19) | 6.6 (11) | 10 (12) | 9.1 (8) | 6.8 (4) | 6.7 (3) | 6.4 (4) | 15/15 |
| CMAma brockhoff noiseless | 19 (18) | 4.9 (4) | 8.4 (6) | 7.5 (5) | 5.8 (3) | 5.6 (2) | 5.5 (3) | 15/15 |
| CMAmah brockhoff noiseless | 39 (87) | 5.6 (12) | 8.8 (4) | 8.5 (11) | 6.4 (3) | 6.2 (3) | 6.2 (1) | 15/15 |
| CMAmh brockhoff noiseless | 44 (94) | 10 (20) | 13 (15) | 13 (5) | 9.2 (7) | 8.6 (4) | 8.2 (4) | 15/15 |
| DBRCGA chuang noiseless | 31 (29) | 6.1 (5) | 12 (17) | 18 (21) | 18 (17) | 18 (5) | 18 (9) | 15/15 |
| DE-AUTO voglis noiseless | 35 (26) | 5.8 (2) | 4.8 (1) | 3.6 (1) | 2.5 (0.6) | 2.1 (0.4) | 1.9 (0.5) | 15/15 |
| DE-BFGS voglis noiseless | 22 (21) | 4.9 (3) | 3.8 (2) | 3.1 (1) | 2.1 (0.7) | 1.9 (0.6) | 1.7 (0.6) | 15/15 |
| DE-ROLL voglis noiseless | 23 (12) | 32 (62) | 95 (81) | 158 (104) | 206 (108) | 296 (111) | 1543 (2153) | 9/15 |
| DE-SIMPLEX voglis noiseless | 37 (21) | 4.0 (2) | 3.4 (1) | 2.7 (0.8) | 1.9 (0.7) | 1.8 (0.6) | 1.7 (0.6) | 15/15 |
| DEAE posik noiseless | 26 (14) | 5.7 (4) | 7.4 (4) | 8.6 (3) | 7.0 (2) | 7.3 (2) | 7.9 (1) | 15/15 |
| DE posik noiseless | 45 (70) | 7.7 (7) | 10 (8) | 10 (7) | 8.4 (4) | 10 (2) | 12 (3) | 15/15 |
| DEb posik noiseless | 45 (33) | 7.7 (8) | 10 (7) | 10 (7) | 8.4 (3) | 10 (3) | 12 (3) | 15/15 |
| DEctpb posik noiseless | 38 (56) | 8.5 (9) | 15 (9) | 16 (6) | 12 (3) | 14 (4) | 16 (3) | 15/15 |
| IPOPsaACM loshchilov noiseless | 19 (12) | 6.3 (7) | 7.8 (2) | 6.4 (4) | 4.5 (2) | 4.2 (2) | 3.8 (2) | 15/15 |
| JADE posik noiseless | 31 (19) | 3.9 (2) | 6.3 (3) | 6.1 (1) | 5.7 (2) | 6.9 (1.0) | 7.3 (1) | 15/15 |
| JADEb posik noiseless | 26 (22) | 5.5 (7) | 8.3 (11) | 7.8 (8) | 6.2 (5) | 6.3 (3) | 6.5 (2) | 15/15 |
| JADEctpb posik noiseless | 31 (21) | 3.9 (2) | 6.3 (3) | 6.1 (2) | 5.7 (1) | 6.9 (1) | 7.3 (1) | 15/15 |
| MVDE melo noiseless | 30 (37) | 11 (7) | 22 (19) | 33 (14) | 28 (15) | 37 (12) | 44 (14) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 25 (18) | 7.1 (11) | 9.0 (10) | 8.9 (5) | 6.5 (4) | 6.4 (4) | 6.2 (2) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 27 (30) | 6.6 (3) | 8.8 (8) | 7.7 (6) | 5.8 (3) | 5.9 (3) | 5.8 (2) | 15/15 |
| PSO-BFGS voglis noiseless | 42 (32) | 4.2 (2) | 3.6 (2) | 2.9 (0.4) | 2.0 (0.9) | 1.8 (0.5) | 1.6 (0.3) | 15/15 |
| SNES schaul noiseless | 16 (14) | 14 (34) | 175 (766) | 375 (194) | 442 (771) | 739 (809) | 1052 (898) | 13/15 |
| xNES schaul noiseless | 18 (18) | 10 (7) | 16 (12) | 20 (43) | 16 (4) | 15 (25) | 14 (22) | 15/15 |
| xNESas schaul noiseless | 27 (18) | 4.7 (8) | 14 (6) | 16 (29) | 12 (11) | 11 (17) | 10 (10) | 15/15 |
| Δ fopt f10, 2-D |
1e1 30 |
1e0 46 |
1e-1 54 |
1e-2 61 |
1e-3 68 |
1e-5 82 |
1e-7 98 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 79 (32) | 140 (227) | 281 (194) | 447 (239) | 557 (499) | 759 (407) | 871 (497) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 7.0 (5) | 6.6 (3) | 6.6 (1) | 6.2 (2) | 6.0 (1) | 5.7 (0.9) | 5.4 (1) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 3.5 (0.8) | 2.5 (0.5) | 2.4 (0.5) | 2.4 (0.3) | 2.3 (0.2) | 2.2 (0.5) | 2.0 (0.2) | 15/15 |
| CMAES posik noiseless | 10 (5) | 8.1 (3) | 7.6 (3) | 7.4 (1) | 7.3 (2) | 6.9 (1) | 6.5 (1) | 15/15 |
| CMA brockhoff noiseless | 8.7 (6) | 8.2 (3) | 7.9 (2) | 7.6 (2) | 7.2 (2) | 6.7 (1) | 6.3 (0.5) | 15/15 |
| CMAa brockhoff noiseless | 5.9 (4) | 5.8 (3) | 6.1 (1) | 6.0 (1) | 5.9 (0.9) | 5.6 (0.9) | 5.3 (0.6) | 15/15 |
| CMAm brockhoff noiseless | 7.1 (7) | 7.3 (4) | 8.3 (1.0) | 8.2 (1) | 7.7 (2) | 7.0 (1) | 6.3 (0.6) | 15/15 |
| CMAma brockhoff noiseless | 6.4 (4) | 6.2 (3) | 6.2 (2) | 6.0 (1) | 5.8 (1) | 5.4 (1.0) | 5.0 (0.9) | 15/15 |
| CMAmah brockhoff noiseless | 10 (8) | 10 (3) | 9.1 (3) | 8.5 (2) | 8.3 (2) | 7.4 (1) | 6.7 (1) | 15/15 |
| CMAmh brockhoff noiseless | 13 (10) | 11 (6) | 12 (3) | 11 (2) | 11 (1) | 9.3 (0.5) | 8.4 (1) | 15/15 |
| DBRCGA chuang noiseless | 7.8 (2) | 17 (5) | 23 (23) | 29 (38) | 28 (26) | 27 (13) | 28 (13) | 15/15 |
| DE-AUTO voglis noiseless | 2.3 (0.1) | 1.6 (0.1) | 1.4 (0.1) | 1.3 (0.1) | 1.2 (0.1) | 1.1 (0.1) | 1.9 (7) | 15/15 |
| DE-BFGS voglis noiseless | 2.2 (0.3) | 1.6 (0.5) | 1.4 (0.3) | 1.3 (0.1) | 1.3 (0.3) | 1.1 (0.4) | 1.1 (0.5) | 15/15 |
| DE-ROLL voglis noiseless | 29 (34) | 83 (66) | 234 (151) | 307 (199) | 343 (253) | 439 (124) | 1260 (1259) | 5/15 |
| DE-SIMPLEX voglis noiseless | 2.8 (0.6) | 2.1 (0.4) | 1.9 (0.4) | 1.9 (0.2) | 1.8 (0.1) | 1.7 (0.2) | 1.5 (0.1) | 15/15 |
| DEAE posik noiseless | 5.9 (1) | 5.0 (1) | 5.4 (1) | 6.2 (0.8) | 6.5 (0.9) | 6.6 (1) | 7.5 (0.7) | 15/15 |
| DE posik noiseless | 11 (7) | 11 (6) | 12 (5) | 14 (7) | 15 (5) | 16 (7) | 17 (5) | 15/15 |
| DEb posik noiseless | 11 (7) | 11 (6) | 12 (2) | 14 (7) | 15 (6) | 16 (7) | 17 (4) | 15/15 |
| DEctpb posik noiseless | 11 (7) | 11 (5) | 12 (3) | 13 (3) | 14 (3) | 15 (3) | 16 (2) | 15/15 |
| IPOPsaACM loshchilov noiseless | 3.3 (1) | 2.6 (1) | 2.8 (1) | 2.8 (1) | 2.7 (1) | 2.5 (0.8) | 2.3 (0.5) | 15/15 |
| JADE posik noiseless | 4.8 (4) | 5.4 (3) | 5.7 (1) | 6.2 (2) | 6.7 (0.8) | 7.2 (0.9) | 7.3 (1) | 15/15 |
| JADEb posik noiseless | 5.7 (5) | 6.8 (6) | 7.4 (5) | 8.0 (3) | 8.1 (4) | 7.9 (4) | 7.4 (3) | 15/15 |
| JADEctpb posik noiseless | 4.8 (2) | 5.4 (2) | 5.7 (2) | 6.2 (1) | 6.7 (2) | 7.2 (0.9) | 7.3 (1) | 15/15 |
| MVDE melo noiseless | 21 (17) | 27 (10) | 33 (16) | 40 (7) | 44 (6) | 53 (9) | 56 (7) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 6.4 (6) | 5.6 (4) | 5.7 (3) | 5.6 (2) | 5.6 (1) | 5.4 (1) | 5.2 (1) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 7.7 (4) | 7.0 (2) | 7.0 (1) | 6.6 (1.0) | 6.4 (1) | 6.2 (1) | 5.8 (0.8) | 15/15 |
| PSO-BFGS voglis noiseless | 2.4 (0.5) | 1.6 (0.3) | 1.4 (0.3) | 1.3 (0.1) | 1.2 (0.3) | 1.1 (0.3) | 1.2 (0.6) | 15/15 |
| SNES schaul noiseless | 273 (1714) | 363 (45) | 1546 (1278) | 4289 (3233) | 1.4e4 (1e4) | ∞ | ∞2e5 | 0/15 |
| xNES schaul noiseless | 5.7 (3) | 5.7 (2) | 5.5 (2) | 5.8 (1) | 6.1 (1) | 5.9 (4) | 5.8 (0.7) | 15/15 |
| xNESas schaul noiseless | 3.5 (2) | 4.8 (2) | 5.0 (1) | 5.4 (3) | 5.7 (2) | 8.3 (3) | 7.7 (1) | 15/15 |
| Δ fopt f11, 2-D |
1e1 35 |
1e0 45 |
1e-1 50 |
1e-2 62 |
1e-3 67 |
1e-5 81 |
1e-7 97 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 83 (219) | 196 (134) | 320 (200) | 445 (327) | 603 (346) | 810 (463) | 883 (542) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 6.6 (4) | 6.5 (3) | 7.3 (2) | 6.3 (1.0) | 6.3 (1) | 5.9 (1.0) | 5.5 (0.7) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.6 (0.9) | 2.5 (0.5) | 2.5 (0.4) | 2.2 (0.2) | 2.2 (0.3) | 2.1 (0.2) | 1.9 (0.1) | 15/15 |
| CMAES posik noiseless | 6.7 (6) | 7.8 (2) | 8.4 (2) | 7.3 (3) | 7.4 (1) | 6.9 (0.7) | 6.5 (0.3) | 15/15 |
| CMA brockhoff noiseless | 7.2 (5) | 9.2 (3) | 9.2 (2) | 7.9 (1) | 7.8 (2) | 7.1 (2) | 6.4 (1) | 15/15 |
| CMAa brockhoff noiseless | 4.4 (3) | 5.9 (2) | 6.8 (1) | 6.1 (0.9) | 6.1 (1) | 5.9 (0.8) | 5.6 (0.8) | 15/15 |
| CMAm brockhoff noiseless | 7.2 (5) | 8.6 (3) | 8.9 (2) | 7.8 (0.3) | 7.6 (1) | 6.9 (1) | 6.3 (0.9) | 15/15 |
| CMAma brockhoff noiseless | 4.6 (4) | 6.7 (2) | 6.8 (2) | 5.9 (0.9) | 5.8 (1) | 5.5 (1) | 5.1 (0.8) | 15/15 |
| CMAmah brockhoff noiseless | 8.3 (7) | 9.3 (5) | 10 (3) | 8.7 (2) | 8.6 (2) | 7.6 (1) | 6.9 (0.6) | 15/15 |
| CMAmh brockhoff noiseless | 7.2 (8) | 8.8 (6) | 13 (4) | 11 (0.8) | 11 (1) | 9.5 (0.9) | 8.4 (0.7) | 15/15 |
| DBRCGA chuang noiseless | 8.0 (13) | 10 (8) | 13 (3) | 13 (7) | 15 (6) | 17 (8) | 20 (5) | 15/15 |
| DE-AUTO voglis noiseless | 2.0 (0.2) | 1.6 (0.1) | 1.5 (0.2) | 1.3 (0.2) | 1.2 (0.1) | 1.1 (0.1) | 1.4 (0.1) | 15/15 |
| DE-BFGS voglis noiseless | 1.9 (0.2) | 1.5 (0.1) | 1.4 (0.1) | 1.2 (0.1) | 1.2 (0.1) | 1.0 (0.2) | 0.92 (0.1) | 15/15 |
| DE-ROLL voglis noiseless | 195 (593) | 207 (237) | 313 (175) | 319 (203) | 416 (202) | 485 (458) | 1585 (1941) | 7/15 |
| DE-SIMPLEX voglis noiseless | 2.4 (0.5) | 2.2 (0.3) | 2.1 (0.3) | 1.9 (0.2) | 1.9 (0.2) | 1.7 (0.2) | 1.6 (0.1) | 15/15 |
| DEAE posik noiseless | 5.0 (2) | 5.4 (0.9) | 6.1 (1) | 6.0 (0.9) | 6.2 (2) | 6.9 (1) | 6.9 (0.9) | 15/15 |
| DE posik noiseless | 7.2 (2) | 9.4 (2) | 11 (3) | 13 (5) | 13 (4) | 15 (6) | 15 (3) | 15/15 |
| DEb posik noiseless | 7.2 (3) | 9.4 (10) | 11 (10) | 13 (8) | 13 (8) | 15 (4) | 15 (5) | 15/15 |
| DEctpb posik noiseless | 8.6 (1) | 9.5 (3) | 12 (3) | 12 (4) | 13 (0.9) | 15 (2) | 15 (2) | 15/15 |
| IPOPsaACM loshchilov noiseless | 2.8 (2) | 2.9 (0.7) | 2.9 (0.9) | 2.5 (0.9) | 2.5 (0.6) | 2.2 (0.2) | 2.2 (0.5) | 15/15 |
| JADE posik noiseless | 4.4 (2) | 5.4 (2) | 6.2 (1) | 6.1 (1) | 6.5 (0.8) | 7.1 (0.3) | 6.9 (0.8) | 15/15 |
| JADEb posik noiseless | 4.6 (3) | 7.2 (4) | 7.9 (6) | 7.1 (5) | 7.5 (6) | 7.6 (4) | 7.5 (3) | 15/15 |
| JADEctpb posik noiseless | 4.4 (2) | 5.4 (1) | 6.2 (2) | 6.1 (1.0) | 6.5 (1) | 7.1 (1) | 6.9 (1) | 15/15 |
| MVDE melo noiseless | 16 (10) | 28 (16) | 34 (10) | 37 (7) | 42 (9) | 49 (7) | 53 (8) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 5.7 (4) | 6.7 (4) | 7.2 (2) | 6.3 (1) | 6.3 (0.8) | 5.9 (0.9) | 5.4 (0.9) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 5.2 (4) | 6.8 (3) | 6.8 (3) | 6.3 (1) | 6.3 (2) | 5.8 (0.9) | 5.4 (1) | 15/15 |
| PSO-BFGS voglis noiseless | 1.9 (0.2) | 1.6 (0.1) | 1.5 (0.2) | 1.3 (0.2) | 1.2 (0.2) | 1.1 (0.1) | 1.0 (0.2) | 15/15 |
| SNES schaul noiseless | 28 (45) | 808 (584) | 1484 (1306) | 2579 (1524) | 5307 (7070) | 1.7e4 (4940) | 2.9e4 (5e4) | 1/15 |
| xNES schaul noiseless | 4.8 (2) | 6.3 (4) | 7.1 (4) | 6.4 (3) | 6.5 (1) | 6.6 (4) | 6.3 (3) | 15/15 |
| xNESas schaul noiseless | 6.7 (5) | 6.9 (4) | 7.6 (12) | 7.1 (2) | 7.5 (3) | 7.3 (2) | 6.9 (2) | 15/15 |
| Δ fopt f12, 2-D |
1e1 35 |
1e0 46 |
1e-1 75 |
1e-2 94 |
1e-3 105 |
1e-5 153 |
1e-7 195 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 12 (4) | 48 (128) | 54 (139) | 98 (110) | 140 (134) | 177 (187) | 184 (329) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 4.7 (3) | 6.7 (3) | 6.9 (6) | 7.4 (9) | 7.2 (1) | 6.4 (4) | 6.0 (4) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 3.1 (2) | 3.2 (1) | 6.3 (1) | 6.4 (4) | 6.2 (7) | 5.1 (3) | 4.3 (3) | 15/15 |
| CMAES posik noiseless | 7.2 (6) | 6.9 (4) | 5.4 (2) | 5.3 (4) | 5.6 (4) | 4.9 (0.7) | 4.6 (7) | 15/15 |
| CMA brockhoff noiseless | 9.1 (30) | 15 (26) | 15 (12) | 14 (7) | 14 (26) | 11 (14) | 10 (15) | 15/15 |
| CMAa brockhoff noiseless | 4.9 (2) | 12 (19) | 11 (13) | 11 (12) | 11 (19) | 10 (12) | 8.5 (4) | 15/15 |
| CMAm brockhoff noiseless | 4.9 (5) | 7.1 (2) | 7.8 (4) | 7.5 (4) | 7.5 (4) | 7.2 (9) | 6.9 (6) | 15/15 |
| CMAma brockhoff noiseless | 7.7 (8) | 12 (31) | 10 (7) | 10 (0.9) | 9.3 (7) | 7.6 (14) | 6.8 (0.7) | 15/15 |
| CMAmah brockhoff noiseless | 13 (0.9) | 21 (49) | 18 (28) | 16 (18) | 15 (23) | 12 (13) | 11 (17) | 15/15 |
| CMAmh brockhoff noiseless | 10 (8) | 11 (7) | 8.8 (6) | 8.7 (1) | 8.5 (2) | 7.6 (0.8) | 7.2 (6) | 15/15 |
| DBRCGA chuang noiseless | 5.6 (3) | 30 (150) | 33 (5) | 40 (82) | 41 (44) | 41 (71) | 39 (77) | 15/15 |
| DE-AUTO voglis noiseless | 1.8 (0.7) | 1.6 (0.1) | 1.2 (0.3) | 1.1 (0.7) | 1.1 (0.8) | 1.1 (0.8) | 1.0 (0.5) | 15/15 |
| DE-BFGS voglis noiseless | 2.0 (0.3) | 1.8 (0.3) | 1.5 (0.5) | 1.3 (0.9) | 1.3 (0.5) | 1.1 (1) | 1.0 (0.6) | 15/15 |
| DE-ROLL voglis noiseless | 16 (7) | 47 (76) | 48 (75) | 56 (44) | 68 (112) | 110 (153) | 311 (338) | 12/15 |
| DE-SIMPLEX voglis noiseless | 2.4 (1) | 3.0 (2) | 2.6 (3) | 2.6 (3) | 2.5 (3) | 2.1 (2) | 1.9 (2) | 15/15 |
| DEAE posik noiseless | 7.4 (4) | 11 (12) | 11 (13) | 11 (14) | 11 (18) | 11 (21) | 11 (15) | 15/15 |
| DE posik noiseless | 10 (6) | 18 (18) | 19 (39) | 20 (31) | 21 (30) | 19 (23) | 18 (25) | 15/15 |
| DEb posik noiseless | 10 (8) | 18 (6) | 19 (30) | 20 (32) | 21 (18) | 19 (28) | 18 (21) | 15/15 |
| DEctpb posik noiseless | 16 (4) | 25 (58) | 22 (47) | 22 (47) | 25 (17) | 23 (30) | 23 (7) | 15/15 |
| IPOPsaACM loshchilov noiseless | 5.2 (7) | 6.1 (9) | 4.7 (10) | 4.4 (1) | 4.2 (7) | 3.4 (6) | 3.2 (2) | 15/15 |
| JADE posik noiseless | 5.3 (4) | 5.9 (5) | 5.0 (2) | 6.6 (5) | 7.5 (6) | 7.9 (2) | 7.6 (7) | 15/15 |
| JADEb posik noiseless | 12 (5) | 19 (42) | 19 (22) | 20 (18) | 20 (15) | 16 (23) | 15 (14) | 15/15 |
| JADEctpb posik noiseless | 5.3 (3) | 5.9 (5) | 5.0 (2) | 6.6 (4) | 7.5 (6) | 7.9 (4) | 7.6 (6) | 15/15 |
| MVDE melo noiseless | 17 (11) | 29 (16) | 25 (20) | 789 (2673) | 712 (19) | 504 (1657) | 408 (1294) | 14/15 |
| NBIPOPaCMA loshchilov noiseless | 5.9 (5) | 7.7 (6) | 5.6 (5) | 5.1 (4) | 5.0 (1) | 4.1 (0.9) | 3.6 (0.7) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 9.4 (5) | 13 (27) | 12 (15) | 11 (18) | 10 (6) | 8.6 (8) | 7.7 (13) | 15/15 |
| PSO-BFGS voglis noiseless | 3.1 (3) | 4.0 (5) | 3.4 (5) | 3.1 (3) | 2.9 (3) | 2.3 (4) | 2.1 (3) | 15/15 |
| SNES schaul noiseless | 23 (42) | 128 (45) | 504 (1073) | 884 (1595) | 2203 (1906) | 2625 (2942) | 2062 (2062) | 5/15 |
| xNES schaul noiseless | 5.9 (3) | 17 (44) | 25 (77) | 27 (77) | 29 (18) | 24 (1) | 22 (31) | 15/15 |
| xNESas schaul noiseless | 3.8 (3) | 9.2 (15) | 14 (17) | 15 (14) | 19 (41) | 21 (8) | 27 (67) | 15/15 |
| Δ fopt f13, 2-D |
1e1 23 |
1e0 35 |
1e-1 46 |
1e-2 60 |
1e-3 71 |
1e-5 95 |
1e-7 122 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 4.8 (6) | 16 (4) | 53 (70) | 112 (125) | 277 (188) | 1.4e4 (6884) | 3.3e5 (9e5) | 1/15 |
| BIPOPaCMA loshchilov noiseless | 4.5 (2) | 4.9 (2) | 5.1 (2) | 5.1 (0.9) | 5.8 (1) | 5.7 (1) | 5.5 (1) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.4 (2) | 2.8 (1) | 2.9 (1) | 2.7 (0.9) | 2.8 (0.5) | 2.7 (0.6) | 2.7 (0.5) | 15/15 |
| CMAES posik noiseless | 3.8 (3) | 7.1 (5) | 7.3 (2) | 7.3 (1) | 7.3 (2) | 7.7 (1) | 7.5 (2) | 15/15 |
| CMA brockhoff noiseless | 5.2 (5) | 6.2 (3) | 6.0 (2) | 6.3 (2) | 6.6 (1) | 7.1 (1) | 6.7 (0.9) | 15/15 |
| CMAa brockhoff noiseless | 4.5 (3) | 5.1 (1) | 5.7 (2) | 5.5 (2) | 5.6 (0.9) | 5.5 (0.7) | 5.4 (1) | 15/15 |
| CMAm brockhoff noiseless | 7.1 (8) | 9.1 (3) | 9.1 (2) | 8.5 (3) | 8.2 (2) | 8.0 (2) | 7.9 (1.0) | 15/15 |
| CMAma brockhoff noiseless | 4.5 (5) | 5.1 (4) | 6.5 (2) | 5.9 (1) | 6.4 (1) | 6.1 (0.8) | 5.9 (1) | 15/15 |
| CMAmah brockhoff noiseless | 7.8 (9) | 10 (6) | 10 (4) | 9.2 (3) | 9.3 (2) | 9.0 (2) | 8.4 (0.8) | 15/15 |
| CMAmh brockhoff noiseless | 6.5 (10) | 9.3 (7) | 10 (9) | 10 (4) | 11 (6) | 12 (7) | 13 (5) | 15/15 |
| DBRCGA chuang noiseless | 4.0 (3) | 6.5 (2) | 9.4 (1) | 12 (8) | 14 (9) | 25 (18) | 42 (23) | 15/15 |
| DE-AUTO voglis noiseless | 2.7 (0.4) | 2.2 (0.2) | 1.8 (0.1) | 1.5 (0.1) | 1.3 (0.0) | 1.1 (0.1) | 1.6 (1) | 15/15 |
| DE-BFGS voglis noiseless | 2.8 (0.3) | 2.1 (0.2) | 1.7 (0.1) | 1.5 (0.1) | 1.3 (0.2) | 1.1 (0.1) | 1.4 (1) | 15/15 |
| DE-ROLL voglis noiseless | 10 (16) | 30 (35) | 43 (25) | 47 (26) | 54 (36) | 57 (20) | 176 (181) | 14/15 |
| DE-SIMPLEX voglis noiseless | 2.1 (0.7) | 2.3 (1) | 2.1 (0.4) | 1.8 (0.2) | 1.7 (0.3) | 1.5 (0.3) | 1.4 (0.1) | 15/15 |
| DEAE posik noiseless | 3.5 (3) | 5.7 (2) | 6.5 (1) | 6.2 (0.8) | 6.7 (1) | 6.8 (1) | 6.7 (0.7) | 15/15 |
| DE posik noiseless | 5.8 (0.8) | 7.5 (3) | 9.4 (2) | 15 (3) | 20 (32) | 20 (21) | 23 (4) | 15/15 |
| DEb posik noiseless | 5.8 (2) | 7.5 (3) | 9.4 (3) | 15 (3) | 20 (25) | 20 (10) | 23 (13) | 15/15 |
| DEctpb posik noiseless | 4.4 (4) | 8.6 (2) | 11 (2) | 12 (4) | 14 (2) | 15 (2) | 15 (2) | 15/15 |
| IPOPsaACM loshchilov noiseless | 2.8 (0.8) | 3.0 (1) | 3.3 (1) | 3.0 (1) | 2.8 (1) | 2.7 (0.6) | 2.5 (0.5) | 15/15 |
| JADE posik noiseless | 2.6 (2) | 4.2 (1) | 5.2 (1) | 5.9 (1) | 6.4 (0.9) | 7.0 (0.6) | 6.8 (0.7) | 15/15 |
| JADEb posik noiseless | 3.6 (1) | 4.8 (3) | 5.3 (4) | 5.3 (1) | 6.3 (3) | 8.3 (6) | 9.2 (5) | 15/15 |
| JADEctpb posik noiseless | 2.6 (1) | 4.2 (2) | 5.2 (2) | 5.9 (1) | 6.4 (1.0) | 7.0 (0.5) | 6.8 (0.7) | 15/15 |
| MVDE melo noiseless | 7.8 (5) | 19 (4) | 26 (12) | 37 (16) | 42 (8) | 49 (10) | 55 (7) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 3.7 (3) | 4.5 (2) | 4.7 (1) | 4.8 (2) | 5.7 (1) | 5.7 (1) | 5.4 (1.0) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.8 (5) | 5.4 (3) | 5.8 (3) | 5.3 (2) | 5.4 (2) | 5.8 (0.8) | 5.6 (0.5) | 15/15 |
| PSO-BFGS voglis noiseless | 3.0 (0.2) | 2.2 (0.2) | 1.9 (0.6) | 1.6 (0.2) | 1.4 (0.2) | 1.2 (0.4) | 1.3 (0.6) | 15/15 |
| SNES schaul noiseless | 20 (86) | 71 (112) | 322 (590) | 819 (796) | 1596 (966) | 5282 (6992) | 2.4e4 (2e4) | 0/15 |
| xNES schaul noiseless | 7.5 (22) | 7.4 (2) | 7.4 (19) | 7.0 (3) | 7.1 (7) | 6.9 (9) | 6.6 (0.7) | 15/15 |
| xNESas schaul noiseless | 3.5 (2) | 4.6 (2) | 5.7 (4) | 5.9 (5) | 6.8 (4) | 7.1 (3) | 8.5 (2) | 15/15 |
| Δ fopt f14, 2-D |
1e1 1 |
1e0 7.0 |
1e-1 16 |
1e-2 24 |
1e-3 38 |
1e-5 67 |
1e-7 90 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1.3 (0.8) | 2.8 (3) | 7.0 (2) | 8.3 (1) | 10 (3) | 49 (37) | 870 (491) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 3.6 (6) | 2.4 (3) | 3.1 (2) | 4.1 (1.0) | 4.3 (1) | 5.4 (0.7) | 5.6 (1) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 3.0 (4) | 3.0 (2) | 3.2 (3) | 4.1 (2) | 3.5 (0.7) | 2.8 (0.6) | 3.0 (0.5) | 15/15 |
| CMAES posik noiseless | 2.9 (0.2) | 2.6 (3) | 3.5 (2) | 4.0 (1) | 4.7 (2) | 6.5 (3) | 7.5 (1) | 15/15 |
| CMA brockhoff noiseless | 3.3 (8) | 3.8 (6) | 3.7 (1) | 4.4 (1) | 4.8 (3) | 6.4 (2) | 6.7 (0.5) | 15/15 |
| CMAa brockhoff noiseless | 4.4 (4) | 3.7 (3) | 4.0 (2) | 4.8 (2) | 4.8 (2) | 5.4 (1.0) | 5.7 (1) | 15/15 |
| CMAm brockhoff noiseless | 3.5 (6) | 3.1 (4) | 3.2 (3) | 4.1 (1) | 4.0 (1) | 5.9 (0.7) | 7.2 (0.9) | 15/15 |
| CMAma brockhoff noiseless | 2.9 (2) | 3.4 (3) | 4.2 (2) | 4.2 (1) | 5.5 (2) | 5.5 (2) | 6.1 (0.8) | 15/15 |
| CMAmah brockhoff noiseless | 2.8 (2) | 1.8 (1) | 2.3 (0.9) | 3.1 (0.9) | 4.1 (0.8) | 6.4 (1.0) | 8.0 (0.8) | 15/15 |
| CMAmh brockhoff noiseless | 2.7 (3) | 2.6 (3) | 2.8 (1.0) | 4.1 (1) | 5.8 (3) | 9.0 (4) | 10 (2) | 15/15 |
| DBRCGA chuang noiseless | 1.7 (0.5) | 3.1 (5) | 6.8 (3) | 8.6 (2) | 8.8 (0.9) | 12 (6) | 21 (23) | 15/15 |
| DE-AUTO voglis noiseless | 2.3 (1) | 3.9 (3) | 3.5 (0.8) | 2.8 (0.3) | 2.0 (0.3) | 1.4 (0.2) | 6.1 (5) | 15/15 |
| DE-BFGS voglis noiseless | 3.3 (2) | 3.0 (3) | 3.7 (0.2) | 2.8 (0.2) | 2.0 (0.2) | 1.4 (0.1) | 2.7 (3) | 15/15 |
| DE-ROLL voglis noiseless | 1.8 (1) | 2.9 (2) | 5.3 (2) | 6.0 (3) | 58 (79) | 148 (180) | 446 (404) | 14/15 |
| DE-SIMPLEX voglis noiseless | 1.5 (1) | 4.0 (3) | 3.8 (0.5) | 3.0 (0.3) | 2.3 (0.2) | 1.7 (0.2) | 1.5 (0.3) | 15/15 |
| DEAE posik noiseless | 4.4 (4) | 2.8 (2) | 5.8 (3) | 9.0 (3) | 7.3 (2) | 7.1 (1) | 7.5 (0.9) | 15/15 |
| DE posik noiseless | 2.1 (2) | 3.1 (2) | 5.1 (4) | 8.5 (3) | 9.1 (3) | 10 (4) | 12 (4) | 15/15 |
| DEb posik noiseless | 2.1 (2) | 3.1 (2) | 5.1 (4) | 8.5 (3) | 9.1 (2) | 10 (4) | 12 (3) | 15/15 |
| DEctpb posik noiseless | 2.7 (2) | 4.2 (2) | 7.4 (4) | 8.4 (2) | 9.0 (3) | 11 (4) | 12 (3) | 15/15 |
| IPOPsaACM loshchilov noiseless | 6.9 (10) | 4.9 (3) | 3.5 (2) | 3.9 (2) | 3.8 (1) | 3.1 (0.9) | 3.0 (0.7) | 15/15 |
| JADE posik noiseless | 2.8 (2) | 2.3 (2) | 4.1 (2) | 4.8 (1) | 5.5 (2) | 6.2 (1.0) | 6.7 (2) | 15/15 |
| JADEb posik noiseless | 3.5 (2) | 4.6 (5) | 3.9 (1) | 4.5 (2) | 5.0 (3) | 5.1 (1) | 6.0 (1) | 15/15 |
| JADEctpb posik noiseless | 2.8 (2) | 2.3 (2) | 4.1 (2) | 4.8 (2) | 5.5 (2) | 6.2 (2) | 6.7 (2) | 15/15 |
| MVDE melo noiseless | 2.2 (2) | 5.2 (6) | 14 (6) | 20 (7) | 21 (8) | 31 (7) | 41 (8) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 4.3 (4) | 2.5 (4) | 3.4 (4) | 4.2 (4) | 4.5 (1) | 5.6 (0.6) | 6.1 (1) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.7 (4) | 3.1 (5) | 3.1 (3) | 4.5 (2) | 4.7 (0.6) | 5.0 (1) | 5.6 (1) | 15/15 |
| PSO-BFGS voglis noiseless | 2.5 (1) | 4.9 (4) | 4.1 (0.3) | 3.0 (0.2) | 2.2 (0.1) | 1.5 (0.2) | 13 (0.9) | 15/15 |
| SNES schaul noiseless | 5.8 (7) | 3.5 (1) | 2.9 (2) | 4.8 (2) | 19 (39) | 1976 (1483) | 7551 (1e4) | 1/15 |
| xNES schaul noiseless | 5.3 (6) | 3.4 (1) | 3.8 (2) | 6.2 (3) | 5.8 (3) | 5.9 (1) | 6.2 (2) | 15/15 |
| xNESas schaul noiseless | 1.8 (0.5) | 2.4 (4) | 2.7 (2) | 5.0 (1) | 4.6 (2) | 5.1 (2) | 5.3 (0.8) | 15/15 |
| Δ fopt f15, 2-D |
1e1 37 |
1e0 291 |
1e-1 1033 |
1e-2 1066 |
1e-3 1113 |
1e-5 1231 |
1e-7 1412 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 2.1 (2) | 2.3 (0.9) | 11 (0.5) | 11 (13) | 11 (12) | 10 (22) | 9.0 (10) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 1.4 (3) | 1.8 (1) | 2.7 (2) | 2.7 (2) | 2.6 (2) | 2.5 (2) | 2.2 (2) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.4 (5) | 2.0 (1) | 2.8 (3) | 2.7 (4) | 2.7 (2) | 2.5 (2) | 2.2 (2) | 15/15 |
| CMAES posik noiseless | 1.1 (1.0) | 2.6 (3) | 3.8 (4) | 3.7 (4) | 3.6 (4) | 3.3 (3) | 2.9 (3) | 15/15 |
| CMA brockhoff noiseless | 0.93 (0.4) | 2.5 (3) | 2.9 (1) | 3.0 (1) | 2.9 (1) | 2.8 (1) | 2.5 (2) | 15/15 |
| CMAa brockhoff noiseless | 1.4 (0.7) | 2.0 (2) | 2.0 (2) | 2.0 (0.9) | 2.0 (3) | 1.9 (3) | 1.7 (2) | 15/15 |
| CMAm brockhoff noiseless | 1.2 (1) | 1.8 (1) | 1.9 (2) | 2.5 (2) | 2.4 (2) | 2.3 (2) | 2.1 (1) | 15/15 |
| CMAma brockhoff noiseless | 1.3 (0.5) | 3.1 (5) | 2.4 (2) | 2.6 (3) | 2.6 (3) | 2.5 (2) | 2.2 (1) | 15/15 |
| CMAmah brockhoff noiseless | 1.2 (1) | 2.9 (3) | 2.7 (3) | 2.8 (3) | 2.7 (2) | 2.6 (3) | 2.4 (1) | 15/15 |
| CMAmh brockhoff noiseless | 2.6 (0.7) | 3.8 (4) | 2.6 (2) | 2.8 (2) | 2.7 (1) | 2.6 (2) | 2.4 (2) | 15/15 |
| DBRCGA chuang noiseless | 1.8 (2) | 2.4 (2) | 1.8 (2) | 1.8 (2) | 1.8 (2) | 1.8 (2) | 1.6 (1) | 15/15 |
| DE-AUTO voglis noiseless | 7.5 (14) | 10 (8) | 6.9 (9) | 6.7 (5) | 6.4 (7) | 5.8 (6) | 5.1 (3) | 15/15 |
| DE-BFGS voglis noiseless | 1.4 (1) | 0.71 (0.6) | 0.46 (0.5) | 0.45 (0.4) | 0.44 (0.2) | 0.41 (0.2) | 0.36 (0.3) | 15/15 |
| DE-ROLL voglis noiseless | 3.5 (0.8) | 4.5 (3) | 7.3 (6) | 7.2 (5) | 6.9 (4) | 6.3 (6) | 5.6 (4) | 15/15 |
| DE-SIMPLEX voglis noiseless | 2.7 (0.7) | 1.7 (3) | 2.8 (5) | 2.7 (5) | 2.6 (5) | 2.4 (4) | 2.1 (1) | 15/15 |
| DEAE posik noiseless | 1.8 (1) | 1.8 (0.6) | 1.4 (1) | 1.4 (1) | 1.4 (1) | 1.3 (1) | 1.3 (0.6) | 15/15 |
| DE posik noiseless | 2.6 (2) | 1.9 (3) | 1.8 (3) | 1.9 (2) | 1.9 (3) | 1.8 (3) | 1.7 (1) | 15/15 |
| DEb posik noiseless | 2.6 (2) | 1.9 (1.0) | 1.8 (0.6) | 1.9 (0.9) | 1.9 (3) | 1.8 (3) | 1.7 (1) | 15/15 |
| DEctpb posik noiseless | 2.3 (2) | 2.6 (1) | 1.2 (0.7) | 1.5 (0.6) | 1.6 (0.3) | 1.7 (0.8) | 1.7 (0.3) | 15/15 |
| IPOPsaACM loshchilov noiseless | 1.3 (1) | 2.6 (2) | 1.4 (1) | 1.9 (1) | 1.8 (2) | 1.7 (2) | 1.5 (1.0) | 15/15 |
| JADE posik noiseless | 1.1 (0.7) | 1.4 (0.5) | 0.95 (1) | 1.0 (0.6) | 1.1 (1.0) | 1.1 (1) | 1.1 (0.6) | 15/15 |
| JADEb posik noiseless | 1.3 (2) | 3.4 (5) | 3.4 (3) | 3.4 (5) | 3.3 (2) | 3.0 (4) | 2.7 (3) | 15/15 |
| JADEctpb posik noiseless | 1.1 (0.9) | 1.4 (0.5) | 0.95 (0.3) | 1.0 (2) | 1.1 (2) | 1.1 (0.5) | 1.1 (0.8) | 15/15 |
| MVDE melo noiseless | 2.7 (2) | 4.9 (3) | 244 (727) | 237 (704) | 227 (225) | 206 (609) | 180 (355) | 12/15 |
| NBIPOPaCMA loshchilov noiseless | 1.4 (0.9) | 2.6 (4) | 2.8 (3) | 3.1 (4) | 3.0 (2) | 2.8 (3) | 2.6 (2) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 1.7 (2) | 3.7 (4) | 2.8 (3) | 2.8 (3) | 2.9 (2) | 2.7 (2) | 2.4 (3) | 15/15 |
| PSO-BFGS voglis noiseless | 2.0 (0.7) | 2.8 (3) | 2.0 (3) | 2.0 (4) | 1.9 (2) | 1.7 (1) | 1.5 (0.8) | 15/15 |
| SNES schaul noiseless | 1.5 (2) | 5.9 (5) | 10 (11) | 10 (5) | 10 (17) | 8.9 (16) | 7.8 (6) | 15/15 |
| xNES schaul noiseless | 13 (29) | 9.5 (9) | 15 (17) | 18 (21) | 17 (11) | 15 (22) | 13 (8) | 15/15 |
| xNESas schaul noiseless | 0.81 (0.8) | 4.0 (3) | 4.4 (4) | 4.5 (2) | 4.4 (1) | 4.0 (2) | 3.6 (4) | 15/15 |
| Δ fopt f16, 2-D |
1e1 9.0 |
1e0 50 |
1e-1 174 |
1e-2 326 |
1e-3 358 |
1e-5 409 |
1e-7 538 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 2.7 (1) | 4.6 (7) | 5.1 (4) | 17 (12) | 36 (27) | 43 (122) | 33 (13) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 1.5 (2) | 2.6 (0.5) | 2.8 (3) | 2.3 (2) | 2.8 (2) | 2.7 (2) | 2.2 (3) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 3.2 (3) | 4.4 (6) | 5.1 (3) | 3.6 (8) | 4.4 (6) | 4.7 (6) | 3.8 (2) | 15/15 |
| CMAES posik noiseless | 4.7 (9) | 7.4 (20) | 3.6 (8) | 2.7 (1) | 2.6 (2) | 2.4 (1) | 1.9 (2) | 15/15 |
| CMA brockhoff noiseless | 5.2 (10) | 8.5 (1) | 4.2 (4) | 3.7 (3) | 3.5 (4) | 3.3 (3) | 2.6 (2) | 15/15 |
| CMAa brockhoff noiseless | 4.7 (4) | 11 (13) | 6.3 (8) | 3.8 (5) | 3.8 (3) | 4.0 (4) | 3.2 (3) | 15/15 |
| CMAm brockhoff noiseless | 2.5 (4) | 5.8 (8) | 4.6 (7) | 3.1 (4) | 3.4 (3) | 3.5 (3) | 2.8 (3) | 15/15 |
| CMAma brockhoff noiseless | 8.9 (5) | 10 (9) | 4.4 (6) | 3.1 (2) | 4.2 (7) | 4.1 (4) | 3.3 (2) | 15/15 |
| CMAmah brockhoff noiseless | 4.0 (3) | 6.5 (15) | 5.6 (2) | 10 (24) | 11 (28) | 10 (46) | 8.2 (3) | 15/15 |
| CMAmh brockhoff noiseless | 10 (2) | 13 (11) | 6.9 (4) | 4.5 (4) | 4.6 (3) | 4.6 (5) | 3.7 (2) | 15/15 |
| DBRCGA chuang noiseless | 2.3 (4) | 2.4 (3) | 5.4 (7) | 4.6 (3) | 6.2 (8) | 8.4 (10) | 6.7 (7) | 15/15 |
| DE-AUTO voglis noiseless | 3.2 (4) | 33 (53) | 32 (35) | 24 (26) | 25 (36) | 38 (26) | 34 (64) | 15/15 |
| DE-BFGS voglis noiseless | 2.7 (0.8) | 6.1 (6) | 4.5 (3) | 4.9 (2) | 5.4 (1) | 6.5 (0.4) | 14 (8) | 14/15 |
| DE-ROLL voglis noiseless | 3.2 (3) | 26 (78) | 33 (38) | 27 (11) | 41 (37) | 47 (37) | 115 (212) | 12/15 |
| DE-SIMPLEX voglis noiseless | 1.3 (0.9) | 5.4 (9) | 2.8 (4) | 2.2 (2) | 2.1 (2) | 2.2 (2) | 1.8 (1) | 15/15 |
| DEAE posik noiseless | 4.6 (7) | 5.7 (8) | 2.7 (0.7) | 1.9 (1) | 2.4 (0.9) | 3.2 (3) | 2.6 (1) | 15/15 |
| DE posik noiseless | 4.1 (3) | 4.8 (4) | 5.4 (2) | 3.4 (4) | 3.5 (5) | 3.5 (2) | 3.4 (4) | 15/15 |
| DEb posik noiseless | 4.1 (9) | 4.8 (4) | 5.4 (4) | 3.4 (1) | 3.5 (4) | 3.5 (2) | 3.4 (3) | 15/15 |
| DEctpb posik noiseless | 3.4 (3) | 3.8 (2) | 5.1 (3) | 4.9 (3) | 13 (8) | 19 (8) | 16 (29) | 15/15 |
| IPOPsaACM loshchilov noiseless | 3.8 (4) | 6.6 (12) | 4.3 (3) | 3.0 (3) | 3.0 (3) | 3.1 (3) | 2.9 (2) | 15/15 |
| JADE posik noiseless | 2.9 (2) | 3.8 (3) | 3.8 (2) | 2.6 (5) | 2.8 (1) | 3.2 (3) | 2.8 (2) | 15/15 |
| JADEb posik noiseless | 2.1 (2) | 4.3 (1) | 2.7 (7) | 2.1 (0.3) | 2.0 (3) | 2.0 (2) | 1.7 (3) | 15/15 |
| JADEctpb posik noiseless | 2.9 (2) | 3.8 (3) | 3.8 (6) | 2.6 (0.9) | 2.8 (3) | 3.2 (4) | 2.8 (1) | 15/15 |
| MVDE melo noiseless | 2.4 (2) | 2.4 (2) | 6.2 (5) | 225 (3) | 207 (3) | 183 (3) | 141 (3) | 14/15 |
| NBIPOPaCMA loshchilov noiseless | 3.3 (3) | 6.8 (12) | 4.0 (6) | 3.4 (2) | 3.5 (6) | 3.3 (1) | 2.6 (2) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.4 (4) | 6.2 (21) | 4.0 (2) | 2.4 (2) | 2.5 (3) | 2.4 (2) | 2.0 (2) | 15/15 |
| PSO-BFGS voglis noiseless | 5.3 (7) | 9.4 (2) | 7.7 (7) | 10 (7) | 14 (11) | 22 (20) | 106 (71) | 12/15 |
| SNES schaul noiseless | 1.8 (2) | 5.1 (4) | 4.7 (1) | 4.4 (6) | 6.7 (8) | 12 (19) | 12 (20) | 14/15 |
| xNES schaul noiseless | 3.4 (4) | 13 (30) | 6.5 (9) | 5.0 (8) | 5.4 (6) | 5.0 (5) | 3.9 (3) | 15/15 |
| xNESas schaul noiseless | 3.2 (4) | 5.4 (6) | 3.8 (7) | 3.9 (6) | 3.7 (3) | 4.4 (6) | 4.6 (5) | 15/15 |
| Δ fopt f17, 2-D |
1e1 3.0 |
1e0 61 |
1e-1 133 |
1e-2 275 |
1e-3 396 |
1e-5 1086 |
1e-7 1657 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1.2 (0.6) | 0.94 (0.6) | 2.1 (0.6) | 1.7 (0.4) | 1.8 (0.3) | 1.1 (0.2) | 0.98 (0.2) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 17 (56) | 3.4 (3) | 2.8 (3) | 1.9 (1) | 1.6 (1) | 1.6 (0.7) | 1.4 (0.6) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.8 (5) | 1.2 (0.5) | 2.1 (1) | 2.0 (1) | 2.2 (1) | 2.4 (1) | 1.7 (2) | 15/15 |
| CMAES posik noiseless | 2.1 (0.7) | 1.5 (0.4) | 2.3 (8) | 2.0 (3) | 2.0 (1) | 2.9 (3) | 2.7 (3) | 15/15 |
| CMA brockhoff noiseless | 3.0 (5) | 1.8 (0.9) | 1.9 (2) | 1.4 (1) | 2.1 (2) | 1.6 (1) | 1.3 (0.7) | 15/15 |
| CMAa brockhoff noiseless | 1.7 (2) | 0.78 (0.5) | 1.7 (0.3) | 1.8 (3) | 1.7 (1) | 1.4 (0.3) | 1.1 (0.5) | 15/15 |
| CMAm brockhoff noiseless | 3.8 (1) | 1.4 (0.4) | 3.0 (6) | 1.9 (3) | 1.7 (2) | 1.3 (0.7) | 0.99 (0.7) | 15/15 |
| CMAma brockhoff noiseless | 1.6 (2) | 1.3 (0.2) | 1.6 (0.4) | 1.2 (1) | 1.3 (1.0) | 1.1 (1.0) | 0.82 (0.7) | 15/15 |
| CMAmah brockhoff noiseless | 1.9 (2) | 3.9 (7) | 2.8 (4) | 2.1 (2) | 2.0 (1) | 1.7 (0.9) | 1.3 (1.0) | 15/15 |
| CMAmh brockhoff noiseless | 3.2 (2) | 5.2 (9) | 3.1 (3) | 2.1 (2) | 2.3 (1) | 1.8 (0.8) | 1.6 (1) | 15/15 |
| DBRCGA chuang noiseless | 1.5 (0.7) | 2.1 (1) | 2.6 (0.8) | 2.3 (2) | 3.2 (4) | 5.0 (2) | 3.5 (8) | 15/15 |
| DE-AUTO voglis noiseless | 1.2 (1) | 6.9 (3) | 9.0 (10) | 10 (11) | 10 (11) | 7.6 (6) | 5.0 (3) | 15/15 |
| DE-BFGS voglis noiseless | 1.8 (3) | 2.2 (3) | 3.9 (1) | 3.6 (1) | 4.1 (1.0) | 2.5 (0.3) | 4.1 (3) | 15/15 |
| DE-ROLL voglis noiseless | 2.1 (2) | 3.7 (4) | 6.2 (5) | 5.9 (2) | 5.4 (3) | 4.4 (1) | 3.0 (0.7) | 15/15 |
| DE-SIMPLEX voglis noiseless | 1.6 (2) | 6.5 (9) | 6.7 (5) | 4.7 (3) | 3.9 (2) | 2.1 (2) | 337 (423) | 3/15 |
| DEAE posik noiseless | 2.3 (2) | 1.7 (1) | 1.8 (1) | 1.6 (0.6) | 1.8 (0.5) | 2.5 (3) | 1.9 (1) | 15/15 |
| DE posik noiseless | 2.7 (3) | 1.5 (1) | 3.1 (4) | 2.2 (3) | 2.5 (0.4) | 2.1 (2) | 1.6 (1) | 15/15 |
| DEb posik noiseless | 2.7 (4) | 1.5 (1.0) | 3.1 (0.8) | 2.2 (2) | 2.5 (3) | 2.1 (2) | 1.6 (1) | 15/15 |
| DEctpb posik noiseless | 1.6 (1) | 2.1 (0.9) | 2.6 (0.8) | 2.3 (0.6) | 2.3 (0.6) | 1.6 (2) | 1.4 (0.3) | 15/15 |
| IPOPsaACM loshchilov noiseless | 3.8 (2) | 1.5 (0.9) | 2.0 (2) | 2.1 (1) | 2.1 (0.9) | 2.0 (0.8) | 1.7 (1) | 15/15 |
| JADE posik noiseless | 2.4 (2) | 1.2 (0.5) | 1.5 (0.4) | 1.2 (0.3) | 1.3 (0.2) | 1.2 (1) | 0.95 (1.0) | 15/15 |
| JADEb posik noiseless | 1.5 (2) | 1.0 (0.8) | 1.0 (0.5) | 0.83 (0.1) | 19 (0.7) | 8.7 (24) | 5.8 (31) | 14/15 |
| JADEctpb posik noiseless | 2.4 (1) | 1.2 (0.5) | 1.5 (0.5) | 1.2 (0.3) | 1.3 (0.2) | 1.2 (0.1) | 0.95 (0.7) | 15/15 |
| MVDE melo noiseless | 1.4 (2) | 2.1 (1) | 5.4 (2) | 5.0 (1) | 5.7 (2) | 69 (0.8) | 47 (0.9) | 14/15 |
| NBIPOPaCMA loshchilov noiseless | 3.7 (4) | 1.7 (0.1) | 1.4 (2) | 0.97 (0.9) | 1.2 (1) | 1.4 (1.0) | 1.1 (0.4) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 1.7 (3) | 1.7 (0.8) | 1.4 (0.2) | 1.00 (0.8) | 1.4 (1) | 1.2 (0.9) | 1.1 (0.8) | 15/15 |
| PSO-BFGS voglis noiseless | 1.5 (2) | 10 (7) | 12 (9) | 8.3 (5) | 9.0 (2) | 5.8 (2) | 16 (12) | 12/15 |
| SNES schaul noiseless | 6.5 (5) | 3.6 (2) | 3.4 (4) | 3.1 (6) | 2.5 (0.3) | 5.9 (14) | 6.4 (5) | 15/15 |
| xNES schaul noiseless | 11 (39) | 8.0 (17) | 6.2 (8) | 5.9 (0.4) | 6.7 (8) | 15 (8) | 13 (14) | 15/15 |
| xNESas schaul noiseless | 3.7 (6) | 7.9 (17) | 4.3 (5) | 6.8 (17) | 12 (24) | 25 (16) | 25 (39) | 15/15 |
| Δ fopt f18, 2-D |
1e1 19 |
1e0 134 |
1e-1 666 |
1e-2 1249 |
1e-3 1708 |
1e-5 2438 |
1e-7 2858 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1.6 (2) | 2.6 (2) | 1.5 (0.8) | 1.4 (0.8) | 1.9 (0.9) | 2.4 (2) | 3.0 (2) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 2.1 (2) | 4.4 (4) | 2.2 (1) | 1.6 (2) | 1.3 (0.7) | 1.1 (0.4) | 1.2 (1) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 3.3 (6) | 1.8 (0.8) | 0.84 (1) | 0.61 (1.0) | 0.71 (0.8) | 1.4 (1) | 1.7 (1) | 15/15 |
| CMAES posik noiseless | 1.5 (1) | 5.1 (7) | 2.0 (3) | 1.6 (2) | 1.5 (1) | 9.1 (7) | 10 (6) | 14/15 |
| CMA brockhoff noiseless | 1.4 (2) | 3.8 (3) | 1.6 (1) | 1.0 (0.6) | 0.84 (0.5) | 0.91 (0.4) | 0.91 (0.4) | 15/15 |
| CMAa brockhoff noiseless | 1.3 (1) | 2.7 (4) | 1.4 (2) | 0.90 (0.8) | 0.93 (0.9) | 0.92 (0.7) | 0.91 (0.6) | 15/15 |
| CMAm brockhoff noiseless | 3.2 (19) | 6.3 (7) | 2.1 (1) | 1.4 (0.8) | 1.3 (0.7) | 1.4 (2) | 1.3 (1) | 15/15 |
| CMAma brockhoff noiseless | 3.3 (0.9) | 5.3 (7) | 1.6 (1.0) | 1.1 (0.6) | 0.98 (0.6) | 1.0 (0.4) | 1.00 (0.3) | 15/15 |
| CMAmah brockhoff noiseless | 1.3 (2) | 5.3 (4) | 1.9 (0.8) | 1.4 (0.8) | 1.4 (0.4) | 1.2 (0.5) | 1.1 (0.3) | 15/15 |
| CMAmh brockhoff noiseless | 1.2 (0.9) | 7.7 (9) | 2.6 (2) | 1.9 (0.9) | 1.6 (0.1) | 1.3 (0.1) | 1.2 (0.3) | 15/15 |
| DBRCGA chuang noiseless | 1.5 (1) | 1.8 (0.6) | 1.7 (1) | 4.3 (10) | 7.7 (4) | 18 (17) | 16 (19) | 15/15 |
| DE-AUTO voglis noiseless | 1.8 (0.6) | 12 (26) | 6.6 (7) | 6.0 (5) | 5.6 (3) | 5.7 (4) | 4.9 (4) | 15/15 |
| DE-BFGS voglis noiseless | 2.5 (0.7) | 5.8 (10) | 1.9 (0.7) | 1.6 (2) | 1.6 (0.2) | 1.8 (0.7) | 8.6 (10) | 4/15 |
| DE-ROLL voglis noiseless | 2.3 (1) | 4.5 (2) | 2.7 (2) | 2.9 (1) | 2.9 (1.0) | 5.1 (2) | 24 (15) | 11/15 |
| DE-SIMPLEX voglis noiseless | 3.2 (11) | 9.2 (13) | 2.9 (1) | 2.1 (2) | 1.9 (2) | 1.8 (0.5) | 103 (121) | 1/15 |
| DEAE posik noiseless | 2.0 (2) | 1.5 (0.5) | 0.56 (0.2) | 0.63 (0.4) | 0.60 (0.1) | 1.0 (0.6) | 0.99 (0.5) | 15/15 |
| DE posik noiseless | 3.1 (3) | 3.1 (1) | 1.4 (0.3) | 1.4 (3) | 2.3 (5) | 3.8 (4) | 3.5 (3) | 15/15 |
| DEb posik noiseless | 3.1 (2) | 3.1 (5) | 1.4 (0.3) | 1.4 (1) | 2.3 (5) | 3.8 (5) | 3.5 (4) | 15/15 |
| DEctpb posik noiseless | 1.9 (1) | 1.7 (1) | 0.93 (0.1) | 0.84 (0.2) | 0.85 (0.1) | 1.1 (0.1) | 1.2 (0.7) | 15/15 |
| IPOPsaACM loshchilov noiseless | 2.0 (2) | 3.0 (2) | 1.4 (0.9) | 0.90 (0.3) | 0.83 (0.6) | 1.1 (0.9) | 1.4 (2) | 15/15 |
| JADE posik noiseless | 2.1 (2) | 1.5 (0.9) | 0.63 (0.3) | 0.47 (0.2) | 0.47 (0.1) | 0.68 (0.6) | 0.69 (0.5) | 15/15 |
| JADEb posik noiseless | 1.5 (0.7) | 1.4 (2) | 11 (75) | 6.5 (0.4) | 5.0 (16) | 18 (33) | 15 (36) | 11/15 |
| JADEctpb posik noiseless | 2.1 (0.9) | 1.5 (2) | 0.63 (0.3) | 0.47 (0.2) | 0.47 (0.1) | 0.68 (0.3) | 0.69 (0.3) | 15/15 |
| MVDE melo noiseless | 3.3 (2) | 3.7 (3) | 2.1 (0.5) | 59 (401) | 44 (147) | 32 (1) | 28 (88) | 14/15 |
| NBIPOPaCMA loshchilov noiseless | 4.9 (2) | 4.6 (3) | 2.6 (2) | 1.6 (1) | 1.4 (1) | 1.3 (1) | 1.3 (0.6) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 1.8 (1) | 2.6 (3) | 0.72 (0.6) | 1.0 (0.8) | 0.88 (0.6) | 0.84 (0.4) | 0.82 (0.4) | 15/15 |
| PSO-BFGS voglis noiseless | 6.8 (5) | 11 (12) | 4.5 (1) | 3.7 (0.9) | 3.8 (2) | 5.0 (1.0) | 24 (7) | 2/15 |
| SNES schaul noiseless | 1.5 (1) | 11 (37) | 18 (16) | 44 (93) | 81 (141) | 181 (220) | 156 (289) | 5/15 |
| xNES schaul noiseless | 1.7 (1) | 13 (19) | 4.9 (10) | 3.8 (5) | 3.9 (3) | 12 (11) | 18 (16) | 14/15 |
| xNESas schaul noiseless | 28 (43) | 13 (17) | 5.3 (6) | 5.5 (5) | 7.0 (8) | 12 (11) | 17 (8) | 14/15 |
| Δ fopt f19, 2-D |
1e1 1 |
1e0 1 |
1e-1 26 |
1e-2 216 |
1e-3 227 |
1e-5 252 |
1e-7 276 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 3.6 (4) | 38 (22) | 7.0 (6) | 72 (5) | 72 (126) | 70 (231) | 68 (211) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 5.3 (4) | 21 (23) | 7.6 (16) | 21 (14) | 21 (19) | 21 (30) | 20 (16) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 5.0 (7) | 24 (14) | 11 (7) | 12 (22) | 16 (25) | 23 (4) | 21 (64) | 15/15 |
| CMAES posik noiseless | 5.6 (6) | 198 (284) | 25 (21) | 19 (26) | 22 (20) | 20 (26) | 19 (16) | 15/15 |
| CMA brockhoff noiseless | 5.4 (5) | 58 (66) | 5.2 (7) | 7.8 (7) | 12 (13) | 11 (10) | 11 (9) | 15/15 |
| CMAa brockhoff noiseless | 10 (2) | 42 (19) | 11 (8) | 10 (16) | 10 (12) | 11 (13) | 11 (16) | 15/15 |
| CMAm brockhoff noiseless | 4.5 (3) | 77 (35) | 14 (2) | 7.6 (9) | 12 (11) | 15 (13) | 14 (9) | 15/15 |
| CMAma brockhoff noiseless | 4.5 (5) | 137 (199) | 15 (22) | 15 (36) | 25 (62) | 24 (33) | 24 (47) | 15/15 |
| CMAmah brockhoff noiseless | 3.5 (2) | 48 (95) | 8.3 (18) | 21 (48) | 22 (46) | 30 (84) | 29 (25) | 15/15 |
| CMAmh brockhoff noiseless | 7.1 (5) | 78 (178) | 17 (25) | 7.7 (8) | 9.0 (9) | 8.5 (12) | 8.1 (9) | 15/15 |
| DBRCGA chuang noiseless | 3.9 (2) | 33 (32) | 6.3 (3) | 13 (10) | 15 (11) | 15 (20) | 15 (16) | 15/15 |
| DE-AUTO voglis noiseless | 3.3 (2) | 86 (226) | 54 (30) | 84 (91) | 81 (86) | 76 (84) | 70 (61) | 15/15 |
| DE-BFGS voglis noiseless | 4.3 (3) | 61 (52) | 11 (7) | 25 (32) | 24 (41) | 21 (31) | 31 (30) | 15/15 |
| DE-ROLL voglis noiseless | 2.9 (2) | 76 (152) | 12 (11) | 64 (131) | 65 (32) | 66 (24) | 160 (126) | 11/15 |
| DE-SIMPLEX voglis noiseless | 4.3 (1) | 77 (26) | 17 (14) | 43 (4) | 41 (137) | 37 (119) | 34 (4) | 15/15 |
| DEAE posik noiseless | 3.5 (2) | 54 (54) | 10 (13) | 234 (579) | 223 (331) | 202 (298) | 185 (634) | 10/15 |
| DE posik noiseless | 3.4 (2) | 55 (31) | 10 (6) | 125 (348) | 120 (233) | 109 (110) | 100 (280) | 12/15 |
| DEb posik noiseless | 3.4 (1) | 55 (47) | 10 (8) | 125 (11) | 120 (8) | 109 (109) | 100 (278) | 12/15 |
| DEctpb posik noiseless | 4.0 (6) | 73 (86) | 9.3 (8) | 76 (233) | 75 (553) | 69 (101) | 66 (191) | 13/15 |
| IPOPsaACM loshchilov noiseless | 4.7 (6) | 33 (19) | 7.9 (14) | 9.5 (11) | 10 (11) | 17 (31) | 16 (28) | 15/15 |
| JADE posik noiseless | 3.6 (4) | 34 (58) | 6.7 (7) | 119 (117) | 115 (6) | 104 (6) | 96 (273) | 12/15 |
| JADEb posik noiseless | 4.3 (4) | 25 (38) | 5.5 (5) | 120 (232) | 116 (223) | 105 (298) | 96 (99) | 12/15 |
| JADEctpb posik noiseless | 3.6 (4) | 34 (24) | 6.7 (4) | 119 (233) | 115 (221) | 104 (100) | 96 (182) | 12/15 |
| MVDE melo noiseless | 8.6 (18) | 68 (46) | 12 (10) | 3244 (8099) | 3432 (4407) | 3095 (995) | 3183 (8154) | 8/15 |
| NBIPOPaCMA loshchilov noiseless | 5.7 (4) | 32 (10) | 25 (44) | 27 (8) | 31 (43) | 31 (41) | 28 (40) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 7.0 (5) | 93 (400) | 15 (13) | 32 (137) | 34 (23) | 36 (23) | 34 (15) | 15/15 |
| PSO-BFGS voglis noiseless | 7.2 (5) | 91 (53) | 21 (21) | 13 (8) | 13 (10) | 12 (12) | 27 (10) | 15/15 |
| SNES schaul noiseless | 5.7 (10) | 24 (20) | 7.6 (14) | 12 (26) | 16 (12) | 51 (67) | 168 (137) | 14/15 |
| xNES schaul noiseless | 4.1 (4) | 31 (36) | 11 (2) | 31 (51) | 33 (53) | 40 (66) | 37 (30) | 15/15 |
| xNESas schaul noiseless | 5.9 (8) | 38 (45) | 15 (36) | 50 (46) | 65 (73) | 69 (75) | 64 (60) | 15/15 |
| Δ fopt f20, 2-D |
1e1 4.0 |
1e0 61 |
1e-1 365 |
1e-2 366 |
1e-3 366 |
1e-5 370 |
1e-7 375 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1.0 (1) | 3.7 (3) | 57 (70) | 58 (70) | 58 (70) | 58 (70) | 57 (68) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 3.8 (4) | 6.9 (6) | 7.8 (3) | 12 (11) | 13 (14) | 13 (17) | 13 (17) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 3.6 (6) | 7.0 (9) | 5.3 (5) | 5.8 (9) | 5.9 (8) | 5.9 (7) | 6.0 (6) | 15/15 |
| CMAES posik noiseless | 2.3 (2) | 17 (26) | 21 (20) | 23 (25) | 23 (27) | 23 (34) | 23 (15) | 15/15 |
| CMA brockhoff noiseless | 4.1 (4) | 11 (21) | 8.2 (5) | 11 (10) | 11 (5) | 12 (4) | 12 (20) | 15/15 |
| CMAa brockhoff noiseless | 2.4 (2) | 9.5 (4) | 10 (10) | 12 (5) | 13 (6) | 14 (15) | 14 (23) | 15/15 |
| CMAm brockhoff noiseless | 2.2 (3) | 19 (27) | 16 (13) | 17 (17) | 17 (11) | 18 (20) | 19 (20) | 15/15 |
| CMAma brockhoff noiseless | 3.9 (3) | 14 (13) | 9.3 (7) | 11 (11) | 12 (10) | 12 (12) | 13 (12) | 15/15 |
| CMAmah brockhoff noiseless | 2.4 (4) | 14 (15) | 9.1 (8) | 11 (6) | 14 (10) | 14 (10) | 15 (16) | 15/15 |
| CMAmh brockhoff noiseless | 2.2 (1) | 12 (14) | 11 (11) | 12 (12) | 13 (12) | 13 (10) | 13 (13) | 15/15 |
| DBRCGA chuang noiseless | 2.2 (2) | 6.8 (16) | 4.8 (4) | 5.1 (5) | 5.2 (5) | 5.5 (5) | 5.8 (3) | 15/15 |
| DE-AUTO voglis noiseless | 1.7 (4) | 14 (28) | 42 (67) | 42 (32) | 42 (84) | 42 (32) | 41 (96) | 15/15 |
| DE-BFGS voglis noiseless | 3.4 (3) | 4.9 (4) | 12 (12) | 12 (0.3) | 12 (38) | 12 (22) | 12 (9) | 15/15 |
| DE-ROLL voglis noiseless | 1.6 (3) | 13 (19) | 30 (54) | 30 (87) | 30 (54) | 30 (80) | 30 (16) | 15/15 |
| DE-SIMPLEX voglis noiseless | 2.9 (2) | 5.0 (8) | 21 (51) | 21 (14) | 21 (86) | 21 (10) | 21 (84) | 15/15 |
| DEAE posik noiseless | 3.5 (5) | 5.6 (1) | 7.3 (8) | 7.4 (8) | 7.6 (7) | 7.8 (15) | 8.1 (12) | 15/15 |
| DE posik noiseless | 2.2 (2) | 5.1 (2) | 7.3 (6) | 7.5 (8) | 7.6 (7) | 8.0 (5) | 8.2 (7) | 15/15 |
| DEb posik noiseless | 2.2 (4) | 5.1 (13) | 7.3 (6) | 7.5 (6) | 7.6 (8) | 8.0 (7) | 8.2 (8) | 15/15 |
| DEctpb posik noiseless | 1.5 (2) | 2.7 (2) | 2.2 (3) | 2.6 (1) | 3.1 (2) | 3.6 (3) | 4.1 (3) | 15/15 |
| IPOPsaACM loshchilov noiseless | 2.4 (3) | 8.1 (15) | 6.9 (12) | 12 (15) | 13 (17) | 13 (12) | 13 (8) | 15/15 |
| JADE posik noiseless | 2.9 (4) | 3.8 (1) | 2.6 (1) | 2.9 (3) | 3.2 (3) | 3.6 (6) | 3.8 (3) | 15/15 |
| JADEb posik noiseless | 2.7 (2) | 7.7 (12) | 3.1 (3) | 3.2 (5) | 3.3 (5) | 3.5 (6) | 3.7 (2) | 15/15 |
| JADEctpb posik noiseless | 2.9 (3) | 3.8 (1) | 2.6 (4) | 2.9 (3) | 3.2 (4) | 3.6 (2) | 3.8 (2) | 15/15 |
| MVDE melo noiseless | 3.5 (3) | 7.3 (5) | 916 (2740) | 997 (1) | 998 (3415) | 989 (1353) | 977 (1335) | 11/15 |
| NBIPOPaCMA loshchilov noiseless | 2.6 (3) | 8.1 (13) | 5.6 (4) | 7.1 (12) | 7.5 (4) | 7.6 (8) | 7.7 (5) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.0 (1) | 12 (16) | 10 (6) | 11 (10) | 11 (8) | 13 (8) | 14 (10) | 15/15 |
| PSO-BFGS voglis noiseless | 6.1 (7) | 8.6 (8) | 4.9 (7) | 4.9 (6) | 4.9 (3) | 4.9 (5) | 4.8 (3) | 15/15 |
| SNES schaul noiseless | 5.3 (5) | 34 (49) | 18 (14) | 25 (34) | 29 (50) | 29 (18) | 29 (32) | 15/15 |
| xNES schaul noiseless | 6.1 (11) | 28 (34) | 22 (21) | 22 (21) | 22 (16) | 22 (25) | 22 (18) | 15/15 |
| xNESas schaul noiseless | 3.5 (2) | 27 (44) | 21 (10) | 21 (25) | 23 (33) | 23 (21) | 23 (32) | 15/15 |
| Δ fopt f21, 2-D |
1e1 2.0 |
1e0 51 |
1e-1 174 |
1e-2 276 |
1e-3 290 |
1e-5 324 |
1e-7 330 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1.3 (0.5) | 1.1 (2) | 0.93 (1) | 1.1 (0.7) | 1.4 (0.6) | 1.6 (0.4) | 1.8 (0.1) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 1.7 (2) | 5.5 (6) | 8.4 (18) | 6.6 (4) | 21 (67) | 22 (2) | 27 (4) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.4 (0.6) | 3.9 (6) | 5.1 (5) | 3.6 (3) | 3.6 (4) | 5.0 (5) | 5.1 (11) | 15/15 |
| CMAES posik noiseless | 0.80 (0) | 10 (24) | 8.3 (6) | 5.3 (2) | 5.1 (4) | 4.7 (5) | 4.7 (2) | 15/15 |
| CMA brockhoff noiseless | 0.97 (1) | 6.1 (15) | 7.2 (21) | 4.8 (9) | 4.8 (15) | 4.7 (3) | 4.9 (3) | 15/15 |
| CMAa brockhoff noiseless | 0.77 (0.1) | 5.0 (13) | 3.8 (8) | 2.5 (5) | 2.6 (5) | 2.5 (0.1) | 2.6 (5) | 15/15 |
| CMAm brockhoff noiseless | 2.0 (5) | 7.2 (6) | 5.9 (1) | 4.0 (3) | 3.9 (5) | 3.7 (3) | 3.8 (10) | 15/15 |
| CMAma brockhoff noiseless | 1.2 (2) | 8.6 (19) | 8.0 (9) | 7.6 (14) | 7.7 (19) | 10 (19) | 21 (16) | 15/15 |
| CMAmah brockhoff noiseless | 1.7 (2) | 7.1 (7) | 6.9 (9) | 4.5 (5) | 4.4 (3) | 4.2 (4) | 4.2 (1) | 15/15 |
| CMAmh brockhoff noiseless | 1.1 (0.6) | 6.0 (12) | 3.5 (3) | 2.2 (3) | 2.2 (1.0) | 2.1 (1) | 3.0 (1) | 15/15 |
| DBRCGA chuang noiseless | 1.3 (1) | 1.3 (1) | 0.84 (0.6) | 0.78 (0.6) | 0.97 (0.3) | 1.2 (0.3) | 1.5 (0.4) | 15/15 |
| DE-AUTO voglis noiseless | 1 (0.5) | 19 (40) | 20 (16) | 13 (33) | 12 (5) | 11 (29) | 11 (10) | 15/15 |
| DE-BFGS voglis noiseless | 1.1 (1) | 2.3 (2) | 10 (0.4) | 6.2 (7) | 5.9 (5) | 5.4 (5) | 5.9 (15) | 15/15 |
| DE-ROLL voglis noiseless | 1.1 (0.4) | 15 (0.5) | 24 (11) | 15 (23) | 15 (34) | 14 (10) | 18 (20) | 15/15 |
| DE-SIMPLEX voglis noiseless | 1.1 (1) | 3.8 (4) | 19 (43) | 12 (27) | 11 (27) | 10 (24) | 10 (12) | 15/15 |
| DEAE posik noiseless | 1.3 (2) | 1.6 (2) | 2.6 (0.9) | 1.8 (3) | 1.9 (0.7) | 1.9 (2) | 2.1 (1) | 15/15 |
| DE posik noiseless | 0.90 (0.2) | 3.8 (19) | 4.4 (4) | 2.9 (4) | 3.0 (3) | 3.0 (1) | 3.2 (3) | 15/15 |
| DEb posik noiseless | 0.90 (0.9) | 3.8 (1) | 4.4 (7) | 2.9 (3) | 3.0 (3) | 3.0 (3) | 3.2 (5) | 15/15 |
| DEctpb posik noiseless | 1.2 (0.5) | 4.2 (6) | 2.8 (6) | 2.0 (0.4) | 2.3 (7) | 2.4 (0.6) | 2.8 (0.4) | 15/15 |
| IPOPsaACM loshchilov noiseless | 1.1 (0.8) | 6.7 (11) | 5.6 (6) | 4.0 (4) | 10 (5) | 10 (53) | 11 (29) | 15/15 |
| JADE posik noiseless | 0.90 (0.9) | 1.1 (2) | 4.0 (9) | 2.7 (5) | 2.8 (2) | 2.9 (2) | 3.1 (1) | 15/15 |
| JADEb posik noiseless | 1.2 (0.8) | 2.4 (1) | 3.6 (6) | 2.4 (2) | 2.3 (2) | 2.2 (2) | 2.3 (1) | 15/15 |
| JADEctpb posik noiseless | 0.90 (1) | 1.1 (1) | 4.0 (0.4) | 2.7 (5) | 2.8 (4) | 2.9 (3) | 3.1 (5) | 15/15 |
| MVDE melo noiseless | 1.1 (1) | 1.8 (3) | 384 (1) | 243 (1) | 248 (863) | 224 (0.8) | 221 (1) | 14/15 |
| NBIPOPaCMA loshchilov noiseless | 1 (0.5) | 22 (42) | 10 (14) | 9.0 (7) | 8.6 (9) | 7.8 (10) | 7.8 (10) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 0.63 (0.2) | 13 (9) | 68 (432) | 45 (147) | 43 (137) | 39 (123) | 38 (15) | 15/15 |
| PSO-BFGS voglis noiseless | 1.0 (0.8) | 3.3 (4) | 2.6 (2) | 1.7 (0.9) | 1.6 (1) | 1.5 (1) | 16 (21) | 15/15 |
| SNES schaul noiseless | 0.93 (2) | 43 (57) | 23 (40) | 14 (25) | 14 (12) | 13 (15) | 13 (17) | 15/15 |
| xNES schaul noiseless | 1.1 (1) | 29 (59) | 21 (26) | 14 (21) | 14 (20) | 14 (21) | 14 (15) | 15/15 |
| xNESas schaul noiseless | 1.2 (0.1) | 19 (36) | 17 (42) | 11 (29) | 10 (5) | 9.4 (15) | 9.4 (22) | 15/15 |
| Δ fopt f22, 2-D |
1e1 5.0 |
1e0 27 |
1e-1 168 |
1e-2 218 |
1e-3 249 |
1e-5 289 |
1e-7 306 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1.4 (2) | 2.2 (2) | 42 (80) | 34 (121) | 30 (106) | 28 (0.7) | 28 (45) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 3.3 (8) | 16 (35) | 5.3 (2) | 5.6 (10) | 5.7 (8) | 5.2 (7) | 5.1 (5) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 5.3 (2) | 10 (16) | 5.4 (8) | 4.8 (6) | 6.3 (19) | 6.8 (12) | 6.5 (15) | 15/15 |
| CMAES posik noiseless | 1.6 (2) | 8.2 (10) | 4.9 (11) | 5.3 (5) | 4.9 (8) | 4.4 (11) | 4.3 (8) | 15/15 |
| CMA brockhoff noiseless | 1.8 (2) | 6.4 (7) | 6.8 (12) | 16 (34) | 14 (11) | 62 (156) | 108 (234) | 14/15 |
| CMAa brockhoff noiseless | 1.4 (2) | 11 (28) | 7.5 (10) | 8.2 (7) | 7.9 (11) | 8.8 (16) | 11 (24) | 14/15 |
| CMAm brockhoff noiseless | 1.7 (0.5) | 19 (28) | 11 (7) | 8.7 (17) | 8.3 (16) | 8.9 (4) | 9.0 (20) | 15/15 |
| CMAma brockhoff noiseless | 8.4 (1) | 14 (24) | 6.7 (6) | 7.2 (12) | 7.9 (8) | 12 (10) | 12 (44) | 15/15 |
| CMAmah brockhoff noiseless | 6.6 (1) | 8.6 (18) | 11 (26) | 8.9 (17) | 7.9 (15) | 26 (6) | 129 (369) | 14/15 |
| CMAmh brockhoff noiseless | 1.6 (0.9) | 14 (26) | 10 (18) | 16 (18) | 40 (207) | 49 (101) | 104 (250) | 15/15 |
| DBRCGA chuang noiseless | 0.93 (0.3) | 2.3 (0.9) | 0.96 (1) | 1.1 (0.7) | 1.3 (2) | 1.4 (0.5) | 1.9 (0.8) | 15/15 |
| DE-AUTO voglis noiseless | 1.3 (0.8) | 8.7 (23) | 15 (1) | 11 (2) | 10 (32) | 8.6 (29) | 9.3 (53) | 15/15 |
| DE-BFGS voglis noiseless | 1.4 (1) | 2.2 (2) | 0.63 (0.4) | 0.61 (0.5) | 0.58 (0.2) | 0.53 (0.3) | 1.7 (1) | 15/15 |
| DE-ROLL voglis noiseless | 0.89 (0.7) | 8.2 (30) | 15 (20) | 14 (19) | 14 (5) | 23 (25) | 55 (52) | 15/15 |
| DE-SIMPLEX voglis noiseless | 1.5 (2) | 2.4 (1.0) | 2.8 (0.6) | 2.3 (0.9) | 2.1 (0.6) | 1.9 (5) | 1.8 (0.4) | 15/15 |
| DEAE posik noiseless | 2.3 (4) | 10 (2) | 2.5 (4) | 2.1 (2) | 2.0 (3) | 2.1 (0.5) | 2.2 (1) | 15/15 |
| DE posik noiseless | 1.1 (1) | 6.4 (14) | 4.5 (5) | 3.9 (5) | 3.7 (5) | 3.6 (6) | 3.8 (4) | 15/15 |
| DEb posik noiseless | 1.1 (0.9) | 6.4 (13) | 4.5 (9) | 3.9 (5) | 3.7 (4) | 3.6 (3) | 3.8 (5) | 15/15 |
| DEctpb posik noiseless | 1.4 (1) | 3.5 (2) | 2.1 (5) | 2.1 (0.6) | 2.1 (2) | 2.5 (0.7) | 2.8 (2) | 15/15 |
| IPOPsaACM loshchilov noiseless | 1.5 (1) | 10 (14) | 3.0 (4) | 2.9 (5) | 3.4 (7) | 6.3 (3) | 16 (3) | 15/15 |
| JADE posik noiseless | 1.2 (0.5) | 2.0 (2) | 1.7 (3) | 1.5 (3) | 1.5 (3) | 1.6 (2) | 1.9 (0.4) | 15/15 |
| JADEb posik noiseless | 1.2 (0.6) | 2.0 (1) | 5.7 (12) | 4.8 (5) | 4.3 (4) | 3.9 (3) | 3.9 (3) | 15/15 |
| JADEctpb posik noiseless | 1.2 (2) | 2.0 (2) | 1.7 (3) | 1.5 (2) | 1.5 (2) | 1.6 (3) | 1.9 (0.2) | 15/15 |
| MVDE melo noiseless | 1.1 (1) | 3.4 (4) | 2.0 (0.8) | 2.1 (1) | 3.3 (2) | 5.0 (1) | 5.8 (3) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 1.3 (0.5) | 10 (1) | 11 (7) | 10 (6) | 9.1 (5) | 8.2 (7) | 8.0 (6) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.4 (3) | 55 (125) | 12 (14) | 10 (26) | 13 (33) | 12 (25) | 11 (29) | 15/15 |
| PSO-BFGS voglis noiseless | 1.3 (1) | 2.4 (2) | 1.1 (1) | 0.95 (1.0) | 0.85 (0.9) | 0.80 (1.0) | 17 (10) | 15/15 |
| SNES schaul noiseless | 2.5 (1) | 70 (130) | 40 (53) | 73 (113) | 105 (166) | 107 (88) | 141 (197) | 15/15 |
| xNES schaul noiseless | 2.0 (2) | 71 (92) | 27 (37) | 22 (19) | 20 (30) | 23 (23) | 21 (14) | 15/15 |
| xNESas schaul noiseless | 4.5 (12) | 45 (89) | 21 (31) | 20 (22) | 21 (20) | 18 (13) | 17 (22) | 15/15 |
| Δ fopt f23, 2-D |
1e1 8.0 |
1e0 193 |
1e-1 234 |
1e-2 263 |
1e-3 299 |
1e-5 348 |
1e-7 379 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1.4 (0.3) | 10 (14) | 1019 (618) | 5.7e5 (9e5) | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 3.5 (3) | 5.6 (3) | 8.7 (9) | 8.0 (8) | 7.4 (11) | 6.8 (6) | 6.7 (6) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.3 (4) | 7.9 (8) | 12 (6) | 11 (15) | 10 (11) | 11 (8) | 10 (8) | 15/15 |
| CMAES posik noiseless | 3.9 (3) | 6.3 (6) | 14 (11) | 13 (9) | 12 (7) | 11 (9) | 10 (6) | 15/15 |
| CMA brockhoff noiseless | 1.5 (1) | 4.1 (5) | 10 (7) | 10 (11) | 8.8 (7) | 8.2 (10) | 8.0 (3) | 15/15 |
| CMAa brockhoff noiseless | 1.4 (2) | 5.5 (8) | 22 (41) | 23 (37) | 20 (15) | 18 (28) | 17 (24) | 15/15 |
| CMAm brockhoff noiseless | 2.5 (2) | 7.5 (6) | 60 (22) | 123 (392) | 109 (345) | 94 (297) | 87 (11) | 14/15 |
| CMAma brockhoff noiseless | 2.5 (2) | 5.0 (3) | 15 (43) | 14 (13) | 12 (11) | 11 (30) | 11 (29) | 15/15 |
| CMAmah brockhoff noiseless | 2.4 (3) | 5.9 (6) | 13 (9) | 12 (10) | 11 (8) | 10 (15) | 10 (14) | 15/15 |
| CMAmh brockhoff noiseless | 2.4 (2) | 5.6 (4) | 17 (9) | 15 (15) | 14 (17) | 12 (10) | 12 (11) | 15/15 |
| DBRCGA chuang noiseless | 1.6 (1) | 9.4 (5) | 58 (69) | 68 (48) | 61 (50) | 53 (58) | 50 (50) | 15/15 |
| DE-AUTO voglis noiseless | 2.0 (1) | 1.4 (1) | 3.1 (2) | 3.3 (0.8) | 3.1 (1) | 2.9 (5) | 2.8 (0.5) | 15/15 |
| DE-BFGS voglis noiseless | 1.9 (2) | 2.4 (2) | 4.0 (4) | 4.9 (6) | 5.8 (5) | 12 (4) | 348 (597) | 2/15 |
| DE-ROLL voglis noiseless | 1.6 (1) | 5.2 (5) | 22 (20) | 28 (19) | 34 (21) | 36 (18) | 265 (265) | 10/15 |
| DE-SIMPLEX voglis noiseless | 1.3 (1.0) | 0.84 (0.3) | 0.78 (0.5) | 0.76 (0.5) | 0.72 (0.4)★ | 9.4 (2) | 500 (625) | 3/15 |
| DEAE posik noiseless | 7.4 (6) | 13 (26) | 63 (60) | 67 (37) | 60 (91) | 52 (67) | 49 (40) | 15/15 |
| DE posik noiseless | 2.8 (3) | 9.5 (7) | 30 (21) | 29 (33) | 26 (26) | 24 (35) | 24 (23) | 15/15 |
| DEb posik noiseless | 2.8 (2) | 9.5 (17) | 30 (22) | 29 (18) | 26 (15) | 24 (24) | 24 (18) | 15/15 |
| DEctpb posik noiseless | 2.2 (3) | 18 (24) | 229 (340) | 652 (613) | 1504 (1304) | 2016 (4454) | 1861 (4042) | 1/15 |
| IPOPsaACM loshchilov noiseless | 2.1 (4) | 7.4 (7) | 9.0 (9) | 9.5 (7) | 8.6 (6) | 8.5 (10) | 8.0 (8) | 15/15 |
| JADE posik noiseless | 2.3 (2) | 5.1 (2) | 48 (83) | 49 (83) | 50 (61) | 43 (58) | 40 (57) | 15/15 |
| JADEb posik noiseless | 2.1 (1) | 4.9 (5) | 18 (10) | 26 (9) | 23 (39) | 21 (33) | 20 (5) | 15/15 |
| JADEctpb posik noiseless | 2.3 (3) | 5.1 (8) | 48 (32) | 49 (75) | 50 (20) | 43 (42) | 40 (53) | 15/15 |
| MVDE melo noiseless | 0.97 (0.4) | 6.3 (6) | 2166 (2142) | 7640 (8552) | 6728 (7529) | 5787 (5026) | 5318 (1e4) | 5/15 |
| NBIPOPaCMA loshchilov noiseless | 1.8 (2) | 6.2 (8) | 12 (11) | 11 (6) | 11 (10) | 10 (12) | 9.3 (4) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.3 (2) | 9.0 (3) | 16 (10) | 17 (8) | 15 (51) | 14 (26) | 13 (7) | 15/15 |
| PSO-BFGS voglis noiseless | 3.4 (3) | 1.9 (2) | 3.3 (3) | 3.6 (4) | 4.2 (3) | 44 (32) | ∞2e5 | 0/15 |
| SNES schaul noiseless | 2.0 (3) | 11 (12) | 305 (602) | 404 (535) | 461 (473) | 399 (421) | 477 (762) | 8/15 |
| xNES schaul noiseless | 1.4 (2) | 18 (13) | 95 (86) | 86 (73) | 79 (92) | 82 (108) | 79 (69) | 15/15 |
| xNESas schaul noiseless | 2.5 (4) | 15 (16) | 95 (80) | 109 (100) | 100 (91) | 87 (75) | 159 (224) | 0/15 |
| Δ fopt f24, 2-D |
1e1 18 |
1e0 857 |
1e-1 8515 |
1e-2 23399 |
1e-3 24113 |
1e-5 24721 |
1e-7 24721 |
#succ 5/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 2.1 (2) | 546 (845) | 59 (50) | 22 (15) | 21 (7) | 21 (23) | 21 (20) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 1.3 (1) | 12 (9) | 28 (18) | 16 (16) | 15 (13) | 18 (17) | 18 (27) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.5 (0.8) | 23 (60) | 10 (11) | 11 (4) | 19 (34) | 34 (34) | 34 (35) | 14/15 |
| CMAES posik noiseless | 1.9 (1) | 6.9 (9) | 5.9 (6) | 8.6 (9) | 8.4 (13) | 8.2 (9) | 8.2 (15) | 6/15 |
| CMA brockhoff noiseless | 4.3 (0.8) | 52 (43) | 130 (176) | 240 (244) | 233 (341) | 227 (235) | 227 (187) | 1/15 |
| CMAa brockhoff noiseless | 1.0 (1.0) | 119 (264) | 132 (84) | 113 (240) | 110 (158) | 107 (105) | 107 (109) | 2/15 |
| CMAm brockhoff noiseless | 1.7 (3) | 106 (382) | 95 (129) | 35 (47) | 46 (46) | 45 (57) | 45 (32) | 4/15 |
| CMAma brockhoff noiseless | 2.0 (2) | 73 (147) | 307 (318) | 240 (240) | ∞ | ∞ | ∞4e5 | 0/15 |
| CMAmah brockhoff noiseless | 1.6 (0.9) | 56 (9) | 130 (224) | 112 (90) | 109 (138) | 106 (178) | 106 (49) | 2/15 |
| CMAmh brockhoff noiseless | 1.2 (0.7) | 98 (178) | 133 (106) | 116 (60) | 113 (92) | 110 (61) | 110 (105) | 2/15 |
| DBRCGA chuang noiseless | 1.2 (2) | 4.8 (8) | 4.2 (7) | 5.0 (3) | 5.0 (4) | 4.9 (6) | 4.9 (8) | 12/15 |
| DE-AUTO voglis noiseless | 1.4 (2) | 79 (14) | 10 (12) | 4.1 (6) | 4.0 (7) | 3.9 (5) | 3.9 (4) | 11/15 |
| DE-BFGS voglis noiseless | 1.6 (1) | 41 (40) | 4.2 (3) | 1.6 (2) | 1.5 (0.8) | 1.5 (1) | 1.5 (2) | 15/15 |
| DE-ROLL voglis noiseless | 8.7 (1) | 314 (213) | 33 (60) | 12 (15) | 12 (15) | 12 (18) | 12 (12) | 7/15 |
| DE-SIMPLEX voglis noiseless | 1.1 (1) | 79 (53) | 8.1 (7) | 3.0 (2) | 2.9 (2) | 2.8 (2) | 2.8 (3) | 15/15 |
| DEAE posik noiseless | 1.6 (1) | 7.7 (13) | 5.0 (7) | 3.7 (2) | 3.6 (3) | 3.5 (1.0) | 3.5 (2) | 11/15 |
| DE posik noiseless | 2.0 (2) | 18 (13) | 3.1 (4) | 2.4 (2) | 2.4 (4) | 2.3 (5) | 2.3 (2) | 13/15 |
| DEb posik noiseless | 2.0 (3) | 18 (15) | 3.1 (5) | 2.4 (4) | 2.4 (3) | 2.3 (3) | 2.3 (2) | 13/15 |
| DEctpb posik noiseless | 1.5 (2) | 124 (174) | 15 (13) | 5.4 (5) | 5.3 (8) | 5.2 (4) | 5.2 (3) | 8/15 |
| IPOPsaACM loshchilov noiseless | 1.8 (2) | 58 (25) | 258 (470) | 365 (197) | 573 (556) | 559 (708) | 559 (364) | 2/15 |
| JADE posik noiseless | 2.1 (2) | 5.3 (7) | 1.9 (3) | 0.81 (0.6) | 0.80 (0.5) | 0.78 (0.6) | 0.79 (0.5) | 15/15 |
| JADEb posik noiseless | 2.2 (3) | 5.7 (4) | 2.9 (2) | 3.0 (2) | 3.0 (7) | 2.9 (2) | 2.9 (2) | 12/15 |
| JADEctpb posik noiseless | 2.1 (2) | 5.3 (3) | 1.9 (2) | 0.81 (0.9) | 0.80 (1) | 0.78 (0.6) | 0.79 (0.7) | 15/15 |
| MVDE melo noiseless | 1.8 (3) | 4670 (4959) | 470 (793) | 278 (417) | 270 (467) | 263 (233) | 263 (233) | 2/15 |
| NBIPOPaCMA loshchilov noiseless | 4.8 (1) | 6.9 (7) | 14 (18) | 7.5 (10) | 7.9 (9) | 7.8 (10) | 7.8 (7) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 1.7 (2) | 38 (134) | 23 (0.9) | 21 (49) | 22 (37) | 22 (25) | 22 (31) | 14/15 |
| PSO-BFGS voglis noiseless | 1.4 (2) | 3.2 (3) | 0.97 (0.8) | 0.55 (0.5) | 0.53 (0.2) | 0.52 (0.3) | 0.52 (0.3) | 15/15 |
| SNES schaul noiseless | 16 (114) | 4.5 (5) | 4.9 (7) | 5.6 (5) | 13 (31) | 15 (37) | 15 (19) | 6/15 |
| xNES schaul noiseless | 3.7 (1) | 5.8 (6) | 10 (18) | 15 (9) | 20 (27) | 19 (12) | 19 (20) | 4/15 |
| xNESas schaul noiseless | 2.2 (5) | 7.7 (10) | 13 (30) | 21 (27) | 28 (34) | 27 (13) | 27 (30) | 4/15 |
Previous dimension | Dimension = 3 | Next dimension
| Δ fopt f1, 3-D |
1e1 4.0 |
1e0 8.0 |
1e-1 8.0 |
1e-2 8.0 |
1e-3 8.0 |
1e-5 8.0 |
1e-7 8.0 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1.7 (3) | 6.8 (5) | 17 (8) | 28 (10) | 40 (7) | 59 (8) | 82 (8) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 3.5 (3) | 4.7 (3) | 11 (5) | 17 (3) | 21 (4) | 32 (4) | 42 (5) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.8 (3) | 4.0 (3) | 7.9 (3) | 10 (2) | 12 (0.9) | 15 (1) | 19 (0.5) | 15/15 |
| CMAES posik noiseless | 3.0 (4) | 5.4 (3) | 11 (3) | 18 (5) | 25 (4) | 36 (8) | 46 (6) | 15/15 |
| CMA brockhoff noiseless | 1.9 (2) | 5.6 (3) | 10 (3) | 16 (5) | 22 (5) | 33 (6) | 46 (4) | 15/15 |
| CMAa brockhoff noiseless | 2.6 (5) | 4.2 (3) | 9.0 (4) | 15 (4) | 20 (5) | 30 (6) | 41 (4) | 15/15 |
| CMAm brockhoff noiseless | 2.1 (2) | 4.4 (3) | 9.2 (2) | 13 (5) | 17 (4) | 25 (4) | 34 (4) | 15/15 |
| CMAma brockhoff noiseless | 2.9 (2) | 5.0 (2) | 9.5 (3) | 13 (4) | 18 (2) | 26 (4) | 35 (6) | 15/15 |
| CMAmah brockhoff noiseless | 2.5 (2) | 3.8 (2) | 7.0 (4) | 11 (2) | 15 (2) | 22 (4) | 30 (4) | 15/15 |
| CMAmh brockhoff noiseless | 2.0 (2) | 3.6 (1.0) | 7.7 (2) | 11 (2) | 16 (2) | 24 (4) | 33 (3) | 15/15 |
| DBRCGA chuang noiseless | 1.6 (1) | 15 (11) | 34 (10) | 61 (14) | 79 (28) | 129 (30) | 171 (30) | 15/15 |
| DE-AUTO voglis noiseless | 1.7 (2) | 5.8 (1) | 8.1 (0.1) | 8.1 (0.1) | 8.1 (0.1) | 8.1 (0.1) | 8.1 (0.1) | 15/15 |
| DE-BFGS voglis noiseless | 2.0 (3) | 5.8 (2) | 7.3 (0.2) | 7.3 (0.2) | 7.3 (0.2) | 7.3 (0.2) | 7.3 (0.2) | 15/15 |
| DE-ROLL voglis noiseless | 2.4 (2) | 10 (9) | 13 (6) | 13 (13) | 13 (0.8) | 13 (11) | 13 (7) | 15/15 |
| DE-SIMPLEX voglis noiseless | 2.5 (3) | 8.6 (2) | 12 (2) | 13 (1) | 15 (3) | 18 (3) | 21 (3) | 15/15 |
| DEAE posik noiseless | 2.3 (3) | 11 (6) | 22 (9) | 36 (20) | 54 (7) | 80 (18) | 107 (11) | 15/15 |
| DE posik noiseless | 2.1 (2) | 11 (4) | 21 (11) | 36 (16) | 49 (6) | 77 (9) | 102 (13) | 15/15 |
| DEb posik noiseless | 2.1 (2) | 11 (3) | 21 (6) | 36 (9) | 49 (7) | 77 (8) | 102 (12) | 15/15 |
| DEctpb posik noiseless | 3.2 (6) | 13 (3) | 27 (8) | 42 (7) | 58 (10) | 84 (4) | 116 (8) | 15/15 |
| IPOPsaACM loshchilov noiseless | 2.9 (3) | 5.5 (3) | 9.3 (1) | 11 (1) | 12 (2) | 16 (1) | 19 (2) | 15/15 |
| JADE posik noiseless | 3.1 (3) | 8.4 (5) | 18 (6) | 29 (4) | 42 (6) | 65 (5) | 87 (7) | 15/15 |
| JADEctpb posik noiseless | 3.1 (3) | 8.4 (5) | 18 (6) | 29 (8) | 42 (8) | 65 (6) | 87 (11) | 15/15 |
| MVDE melo noiseless | 1.4 (1) | 15 (10) | 49 (17) | 87 (23) | 125 (20) | 197 (20) | 285 (18) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 2.5 (3) | 5.0 (4) | 11 (4) | 16 (4) | 21 (3) | 33 (6) | 42 (7) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.5 (5) | 5.7 (6) | 10 (6) | 17 (6) | 22 (7) | 34 (3) | 44 (8) | 15/15 |
| PSO-BFGS voglis noiseless | 1.6 (1) | 7.0 (0.2) | 7.4 (0.2) | 7.4 (0.1) | 7.4 (0.2) | 7.4 (0.2) | 7.4 (0.1) | 15/15 |
| SNES schaul noiseless | 3.5 (2) | 4.8 (2) | 9.2 (2) | 17 (6) | 27 (11) | 44 (5) | 62 (5) | 15/15 |
| xNES schaul noiseless | 3.5 (4) | 5.1 (3) | 12 (4) | 20 (3) | 29 (6) | 49 (5) | 67 (9) | 15/15 |
| xNESas schaul noiseless | 4.9 (4) | 5.7 (1) | 12 (4) | 20 (4) | 28 (4) | 45 (5) | 57 (6) | 15/15 |
| Δ fopt f2, 3-D |
1e1 38 |
1e0 42 |
1e-1 43 |
1e-2 44 |
1e-3 45 |
1e-5 47 |
1e-7 48 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 8.1 (1) | 9.3 (1) | 11 (0.8) | 12 (0.7) | 14 (1) | 17 (0.9) | 20 (1) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 11 (4) | 12 (2) | 14 (3) | 15 (3) | 15 (3) | 17 (2) | 18 (3) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 4.4 (1) | 4.4 (0.5) | 4.9 (1) | 5.2 (1) | 5.3 (1) | 5.6 (0.9) | 6.2 (0.7) | 15/15 |
| CMAES posik noiseless | 12 (8) | 17 (4) | 18 (3) | 19 (3) | 20 (2) | 21 (4) | 23 (2) | 15/15 |
| CMA brockhoff noiseless | 14 (5) | 16 (4) | 19 (2) | 19 (1) | 20 (1) | 21 (2) | 23 (1) | 15/15 |
| CMAa brockhoff noiseless | 11 (4) | 13 (3) | 14 (2) | 15 (2) | 16 (2) | 17 (1) | 18 (1) | 15/15 |
| CMAm brockhoff noiseless | 14 (7) | 17 (4) | 18 (6) | 19 (3) | 20 (2) | 20 (3) | 21 (1) | 15/15 |
| CMAma brockhoff noiseless | 11 (6) | 13 (3) | 14 (2) | 15 (2) | 16 (2) | 16 (1) | 18 (2) | 15/15 |
| CMAmah brockhoff noiseless | 16 (7) | 19 (2) | 19 (3) | 19 (3) | 20 (2) | 20 (3) | 21 (3) | 15/15 |
| CMAmh brockhoff noiseless | 21 (10) | 24 (4) | 26 (3) | 26 (4) | 26 (4) | 27 (3) | 28 (4) | 15/15 |
| DBRCGA chuang noiseless | 15 (5) | 20 (5) | 24 (4) | 26 (5) | 31 (6) | 37 (5) | 45 (5) | 15/15 |
| DE-AUTO voglis noiseless | 2.1 (0.3) | 2.0 (0.4) | 2.1 (0.8) | 2.2 (0.5) | 2.2 (0.2) | 2.4 (0.6) | 2.6 (0.8) | 15/15 |
| DE-BFGS voglis noiseless | 2.1 (0.1) | 2.0 (0.2) | 2.1 (0.6) | 2.1 (0.4) | 2.2 (0.1) | 2.3 (0.2) | 2.4 (0.5) | 15/15 |
| DE-ROLL voglis noiseless | 3.9 (1) | 3.7 (4) | 3.8 (3) | 3.7 (3) | 3.8 (2) | 4.0 (2) | 4.3 (2) | 15/15 |
| DE-SIMPLEX voglis noiseless | 2.7 (1) | 3.3 (0.9) | 3.8 (0.4) | 4.1 (0.7) | 4.2 (0.2) | 4.5 (0.7) | 4.9 (0.5) | 15/15 |
| DEAE posik noiseless | 11 (3) | 12 (2) | 15 (1) | 17 (1) | 19 (2) | 23 (3) | 27 (2) | 15/15 |
| DE posik noiseless | 9.5 (2) | 11 (2) | 13 (1) | 16 (2) | 18 (3) | 21 (2) | 28 (12) | 15/15 |
| DEb posik noiseless | 9.5 (2) | 11 (2) | 13 (2) | 16 (2) | 18 (3) | 21 (3) | 28 (14) | 15/15 |
| DEctpb posik noiseless | 10 (2) | 12 (2) | 15 (2) | 17 (2) | 19 (2) | 23 (0.9) | 28 (2) | 15/15 |
| IPOPsaACM loshchilov noiseless | 4.2 (2) | 4.3 (0.7) | 4.7 (1) | 4.9 (0.9) | 5.1 (1) | 5.6 (1) | 6.1 (1) | 15/15 |
| JADE posik noiseless | 7.8 (2) | 10 (1) | 12 (1) | 14 (2) | 15 (1) | 19 (0.9) | 23 (3) | 15/15 |
| JADEb posik noiseless | 6.3 (1) | 7.2 (1) | 8.5 (1) | 10 (2) | 11 (2) | 14 (1) | 17 (2) | 15/15 |
| JADEctpb posik noiseless | 7.8 (1) | 10 (1) | 12 (2) | 14 (1) | 15 (1) | 19 (2) | 23 (2) | 15/15 |
| MVDE melo noiseless | 23 (4) | 27 (4) | 33 (2) | 40 (7) | 46 (4) | 58 (6) | 70 (6) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 9.3 (4) | 11 (3) | 14 (4) | 15 (2) | 15 (2) | 17 (2) | 18 (2) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 11 (6) | 13 (4) | 14 (4) | 15 (3) | 15 (2) | 17 (2) | 18 (2) | 15/15 |
| PSO-BFGS voglis noiseless | 2.1 (0.4) | 2.0 (0.3) | 2.1 (0.3) | 2.1 (0.4) | 2.2 (0.4) | 2.3 (0.2) | 2.5 (0.6) | 15/15 |
| SNES schaul noiseless | 6.8 (2) | 8.0 (3) | 9.4 (2) | 11 (1) | 11 (2) | 15 (2) | 17 (1) | 15/15 |
| xNES schaul noiseless | 10 (7) | 13 (11) | 14 (14) | 19 (6) | 21 (1) | 25 (34) | 28 (3) | 15/15 |
| xNESas schaul noiseless | 8.5 (4) | 10 (4) | 11 (3) | 12 (5) | 13 (4) | 15 (3) | 17 (2) | 15/15 |
| Δ fopt f3, 3-D |
1e1 38 |
1e0 822 |
1e-1 830 |
1e-2 835 |
1e-3 842 |
1e-5 847 |
1e-7 853 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 5.0 (1) | 11 (32) | 113 (138) | 113 (153) | 112 (120) | 112 (106) | 111 (90) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 3.1 (2) | 4.3 (3) | 12 (17) | 12 (13) | 12 (20) | 12 (7) | 12 (15) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.6 (1.0) | 2.1 (2) | 13 (18) | 13 (12) | 13 (19) | 13 (18) | 13 (4) | 15/15 |
| CMAES posik noiseless | 6.1 (15) | 5.3 (3) | 21 (15) | 21 (24) | 21 (25) | 21 (16) | 21 (16) | 15/15 |
| CMA brockhoff noiseless | 10 (16) | 4.0 (4) | 21 (20) | 39 (58) | 41 (37) | 42 (69) | 43 (21) | 15/15 |
| CMAa brockhoff noiseless | 7.7 (3) | 2.8 (1) | 23 (43) | 29 (51) | 30 (50) | 31 (59) | 32 (56) | 15/15 |
| CMAm brockhoff noiseless | 5.4 (2) | 2.2 (2) | 18 (13) | 20 (47) | 21 (11) | 21 (48) | 22 (12) | 15/15 |
| CMAma brockhoff noiseless | 3.2 (2) | 4.2 (8) | 11 (16) | 12 (15) | 12 (10) | 12 (13) | 13 (19) | 15/15 |
| CMAmah brockhoff noiseless | 7.2 (7) | 2.7 (3) | 27 (49) | 29 (10) | 33 (27) | 34 (74) | 34 (22) | 15/15 |
| CMAmh brockhoff noiseless | 4.4 (3) | 3.4 (2) | 30 (83) | 81 (115) | 86 (117) | 89 (193) | 90 (195) | 15/15 |
| DBRCGA chuang noiseless | 7.9 (3) | 1.9 (0.4) | 3.3 (1) | 3.6 (2) | 3.8 (2) | 4.1 (2) | 4.5 (2) | 15/15 |
| DE-AUTO voglis noiseless | 7.6 (10) | 3.1 (3) | 6.8 (5) | 6.8 (4) | 6.7 (5) | 6.7 (6) | 6.7 (4) | 15/15 |
| DE-BFGS voglis noiseless | 8.2 (7) | 1.4 (0.6) | 2.9 (3) | 2.9 (2) | 2.9 (2) | 2.9 (3) | 2.9 (0.8) | 15/15 |
| DE-ROLL voglis noiseless | 5.9 (5) | 1.4 (1) | 3.6 (3) | 3.6 (3) | 3.6 (2) | 3.6 (2) | 3.5 (2) | 15/15 |
| DE-SIMPLEX voglis noiseless | 11 (8) | 3.1 (1) | 8.7 (6) | 8.7 (15) | 8.6 (4) | 8.6 (15) | 8.6 (15) | 15/15 |
| DEAE posik noiseless | 6.3 (3) | 2.3 (0.4) | 6.3 (6) | 6.4 (8) | 6.5 (5) | 6.7 (8) | 6.9 (6) | 15/15 |
| DE posik noiseless | 4.8 (3) | 0.65 (0.3) | 1.6 (0.1) | 1.7 (1.0) | 1.8 (0.3) | 2.1 (0.8) | 2.3 (0.8) | 15/15 |
| DEb posik noiseless | 4.8 (4) | 0.65 (0.3) | 1.6 (2) | 1.7 (0.9) | 1.8 (0.9) | 2.1 (2) | 2.3 (5) | 15/15 |
| DEctpb posik noiseless | 4.7 (2) | 0.96 (0.6) | 1.3 (0.4) | 1.7 (0.4) | 1.9 (0.2) | 2.3 (0.2) | 2.6 (0.3) | 15/15 |
| IPOPsaACM loshchilov noiseless | 5.2 (9) | 3.4 (3) | 17 (19) | 57 (195) | 76 (218) | 76 (13) | 77 (25) | 15/15 |
| JADE posik noiseless | 3.4 (1) | 0.78 (0.3) | 1.2 (0.4) | 1.4 (0.3) | 1.5 (0.3) | 1.8 (0.3) | 2.1 (0.4) | 15/15 |
| JADEb posik noiseless | 3.5 (2) | 0.81 (0.3) | 4.1 (3) | 4.2 (9) | 4.2 (9) | 4.4 (3) | 4.5 (6) | 15/15 |
| JADEctpb posik noiseless | 3.4 (1) | 0.78 (0.4) | 1.2 (0.3) | 1.4 (0.3) | 1.5 (0.3) | 1.8 (0.3) | 2.1 (0.3) | 15/15 |
| MVDE melo noiseless | 8.8 (3) | 1.5 (0.3) | 1.8 (0.4) | 2.3 (0.3) | 2.8 (0.3) | 3.5 (0.3) | 4.2 (0.4) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 3.8 (1) | 6.8 (5) | 37 (28) | 42 (27) | 43 (35) | 43 (63) | 43 (32) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 5.0 (10) | 3.9 (4) | 13 (14) | 43 (13) | 43 (125) | 43 (14) | 43 (16) | 15/15 |
| PSO-BFGS voglis noiseless | 14 (18) | 4.8 (2) | 9.0 (6) | 8.9 (7) | 8.9 (2) | 8.8 (4) | 8.8 (7) | 15/15 |
| SNES schaul noiseless | 4.3 (5) | 10 (9) | 47 (43) | 47 (60) | 46 (27) | 46 (58) | 46 (60) | 15/15 |
| xNES schaul noiseless | 3.0 (3) | 11 (5) | 69 (114) | 69 (88) | 69 (87) | 68 (97) | 68 (51) | 15/15 |
| xNESas schaul noiseless | 11 (0.9) | 7.1 (8) | 66 (98) | 65 (80) | 65 (79) | 65 (71) | 64 (51) | 15/15 |
| Δ fopt f4, 3-D |
1e1 40 |
1e0 808 |
1e-1 866 |
1e-2 921 |
1e-3 952 |
1e-5 1015 |
1e-7 1044 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 7.2 (3) | 81 (96) | 218 (89) | 205 (129) | 199 (163) | 187 (126) | 182 (112) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 4.1 (2) | 183 (538) | 2702 (2720) | 3755 (4487) | 3633 (4687) | 3408 (3802) | 3313 (2824) | 8/15 |
| BIPOPsaACM loshchilov noiseless | 6.0 (6) | 47 (137) | 3273 (2661) | 3201 (3705) | 3097 (3242) | 2905 (4218) | 2825 (2731) | 9/15 |
| CMAES posik noiseless | 8.4 (15) | 19 (9) | 134 (278) | 126 (126) | 122 (144) | 114 (47) | 111 (28) | 11/15 |
| CMA brockhoff noiseless | 7.2 (11) | 390 (455) | ∞ | ∞ | ∞ | ∞ | ∞6e5 | 0/15 |
| CMAa brockhoff noiseless | 9.2 (3) | 621 (909) | ∞ | ∞ | ∞ | ∞ | ∞6e5 | 0/15 |
| CMAm brockhoff noiseless | 6.6 (2) | 538 (746) | 4728 (6501) | ∞ | ∞ | ∞ | ∞6e5 | 0/15 |
| CMAma brockhoff noiseless | 6.7 (7) | 788 (1015) | ∞ | ∞ | ∞ | ∞ | ∞6e5 | 0/15 |
| CMAmah brockhoff noiseless | 10 (21) | 1039 (1482) | 8694 (4858) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CMAmh brockhoff noiseless | 15 (10) | 653 (607) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DBRCGA chuang noiseless | 9.0 (6) | 3.1 (2) | 5.9 (4) | 5.8 (4) | 5.7 (4) | 5.6 (3) | 5.7 (3) | 15/15 |
| DE-AUTO voglis noiseless | 19 (14) | 6.1 (4) | 16 (7) | 15 (12) | 14 (5) | 13 (7) | 13 (14) | 15/15 |
| DE-BFGS voglis noiseless | 13 (10) | 1.6 (0.5) | 5.6 (5) | 5.3 (11) | 5.2 (6) | 4.9 (8) | 4.8 (9) | 15/15 |
| DE-ROLL voglis noiseless | 5.7 (4) | 3.1 (3) | 6.1 (6) | 5.8 (4) | 5.6 (4) | 5.3 (2) | 5.2 (3) | 15/15 |
| DE-SIMPLEX voglis noiseless | 24 (15) | 5.3 (7) | 9.0 (10) | 8.5 (8) | 8.2 (7) | 7.7 (8) | 7.6 (5) | 15/15 |
| DEAE posik noiseless | 12 (10) | 6.9 (9) | 18 (16) | 18 (11) | 17 (9) | 16 (16) | 16 (11) | 15/15 |
| DE posik noiseless | 5.8 (2) | 1.5 (2) | 2.9 (5) | 2.9 (5) | 2.9 (4) | 3.0 (2) | 3.1 (1) | 15/15 |
| DEb posik noiseless | 5.8 (2) | 1.5 (2) | 2.9 (5) | 2.9 (2) | 2.9 (2) | 3.0 (2) | 3.1 (1) | 15/15 |
| DEctpb posik noiseless | 6.8 (3) | 1.6 (1) | 2.0 (1) | 2.2 (1) | 2.4 (2) | 2.6 (2) | 2.8 (0.2) | 15/15 |
| IPOPsaACM loshchilov noiseless | 8.6 (8) | 240 (400) | 1.6e4 (2e4) | 1.5e4 (8967) | 1.5e4 (1e4) | 1.4e4 (2e4) | 1.3e4 (9560) | 3/15 |
| JADE posik noiseless | 4.5 (2) | 1.7 (0.4) | 2.2 (2) | 2.3 (1) | 2.3 (2) | 2.5 (1) | 2.6 (2) | 15/15 |
| JADEb posik noiseless | 4.1 (2) | 2.9 (3) | 8.4 (17) | 8.0 (5) | 7.8 (24) | 7.5 (23) | 7.5 (6) | 15/15 |
| JADEctpb posik noiseless | 4.5 (2) | 1.7 (0.3) | 2.2 (4) | 2.3 (1) | 2.3 (2) | 2.5 (0.3) | 2.6 (4) | 15/15 |
| MVDE melo noiseless | 13 (4) | 2.1 (0.4) | 180 (289) | 170 (815) | 165 (263) | 155 (247) | 151 (240) | 13/15 |
| NBIPOPaCMA loshchilov noiseless | 10 (35) | 29 (24) | 243 (161) | 229 (129) | 221 (303) | 208 (399) | 202 (320) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.9 (2) | 254 (433) | 1.1e4 (2e4) | 1.4e4 (9779) | 1.3e4 (1e4) | 1.3e4 (8130) | 1.2e4 (1e4) | 3/15 |
| PSO-BFGS voglis noiseless | 28 (20) | 11 (8) | 49 (21) | 46 (26) | 44 (23) | 42 (41) | 41 (51) | 15/15 |
| SNES schaul noiseless | 14 (38) | 28 (34) | 140 (179) | 132 (152) | 128 (93) | 120 (142) | 117 (181) | 14/15 |
| xNES schaul noiseless | 6.1 (3) | 37 (46) | 285 (292) | 268 (287) | 259 (253) | 244 (167) | 237 (248) | 9/15 |
| xNESas schaul noiseless | 5.0 (3) | 31 (45) | 136 (210) | 128 (136) | 124 (56) | 116 (76) | 113 (65) | 14/15 |
| Δ fopt f5, 3-D |
1e1 7.0 |
1e0 7.0 |
1e-1 7.0 |
1e-2 7.0 |
1e-3 7.0 |
1e-5 7.0 |
1e-7 7.0 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 6.9 (3) | 11 (2) | 12 (1) | 12 (2) | 12 (2) | 12 (3) | 12 (2) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 3.2 (2) | 4.9 (5) | 5.0 (3) | 5.0 (2) | 5.0 (3) | 5.0 (5) | 5.0 (3) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 4.0 (2) | 5.8 (5) | 6.0 (3) | 6.0 (3) | 6.0 (3) | 6.0 (3) | 6.0 (4) | 15/15 |
| CMAES posik noiseless | 3.5 (2) | 5.6 (3) | 5.8 (4) | 5.9 (4) | 5.9 (3) | 5.9 (3) | 5.9 (3) | 15/15 |
| CMA brockhoff noiseless | 2.7 (2) | 4.2 (3) | 4.7 (2) | 4.7 (2) | 4.7 (0.9) | 4.7 (2) | 4.7 (3) | 15/15 |
| CMAa brockhoff noiseless | 4.7 (2) | 6.3 (3) | 6.5 (2) | 6.5 (2) | 6.5 (2) | 6.5 (3) | 6.5 (3) | 15/15 |
| CMAm brockhoff noiseless | 2.8 (1) | 5.0 (2) | 5.2 (2) | 5.3 (2) | 5.3 (2) | 5.3 (2) | 5.3 (2) | 15/15 |
| CMAma brockhoff noiseless | 3.1 (1) | 4.3 (2) | 4.5 (2) | 4.5 (2) | 4.5 (1) | 4.5 (2) | 4.5 (1) | 15/15 |
| CMAmah brockhoff noiseless | 2.3 (1) | 3.9 (2) | 4.1 (2) | 4.1 (2) | 4.1 (1) | 4.1 (2) | 4.1 (3) | 15/15 |
| CMAmh brockhoff noiseless | 2.2 (1) | 3.6 (1) | 4.0 (1) | 4.1 (2) | 4.1 (1) | 4.1 (1) | 4.1 (0.7) | 15/15 |
| DBRCGA chuang noiseless | 5.2 (4) | 16 (13) | 17 (10) | 18 (6) | 18 (4) | 18 (10) | 18 (8) | 15/15 |
| DE-AUTO voglis noiseless | 5.4 (3) | 8.7 (0.4) | 8.7 (0.4) | 8.7 (0.2) | 8.7 (0.2) | 8.7 (0.3) | 8.7 (0.2) | 15/15 |
| DE-BFGS voglis noiseless | 4.8 (2) | 8.2 (2) | 8.4 (1) | 8.4 (2) | 8.4 (2) | 8.4 (0.8) | 8.4 (0.8) | 15/15 |
| DE-ROLL voglis noiseless | 4.8 (1) | 7.9 (0.7) | 8.3 (0.5) | 8.3 (1) | 8.3 (1) | 8.3 (0.4) | 8.3 (2) | 15/15 |
| DE-SIMPLEX voglis noiseless | 3.6 (3) | 16 (9) | 23 (8) | 31 (9) | 43 (19) | 82 (51) | 91 (51) | 15/15 |
| DEAE posik noiseless | 4.5 (3) | 8.6 (3) | 9.1 (3) | 9.1 (2) | 9.1 (4) | 9.1 (2) | 9.1 (4) | 15/15 |
| DE posik noiseless | 3.9 (2) | 7.7 (4) | 8.6 (4) | 8.6 (3) | 8.6 (4) | 8.6 (4) | 8.6 (3) | 15/15 |
| DEb posik noiseless | 3.9 (1) | 7.7 (4) | 8.6 (4) | 8.6 (2) | 8.6 (3) | 8.6 (3) | 8.6 (3) | 15/15 |
| DEctpb posik noiseless | 4.8 (3) | 11 (6) | 13 (3) | 13 (6) | 13 (4) | 13 (4) | 13 (3) | 15/15 |
| IPOPsaACM loshchilov noiseless | 3.8 (2) | 5.5 (3) | 5.8 (2) | 5.9 (2) | 5.9 (3) | 5.9 (3) | 5.9 (2) | 15/15 |
| JADE posik noiseless | 5.7 (3) | 14 (4) | 15 (11) | 16 (8) | 16 (11) | 16 (4) | 16 (7) | 15/15 |
| JADEb posik noiseless | 4.1 (2) | 8.4 (6) | 9.3 (3) | 9.5 (7) | 9.5 (5) | 9.5 (3) | 9.5 (5) | 15/15 |
| JADEctpb posik noiseless | 5.7 (3) | 14 (8) | 15 (4) | 16 (7) | 16 (8) | 16 (7) | 16 (9) | 15/15 |
| MVDE melo noiseless | 17 (10) | 48 (14) | 57 (20) | 59 (11) | 59 (10) | 59 (12) | 59 (15) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 3.3 (2) | 5.8 (2) | 6.1 (3) | 6.2 (2) | 6.2 (3) | 6.2 (3) | 6.2 (3) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.7 (2) | 5.5 (2) | 6.0 (4) | 6.0 (3) | 6.0 (2) | 6.0 (3) | 6.0 (3) | 15/15 |
| PSO-BFGS voglis noiseless | 7.3 (2) | 10 (0.4) | 10 (0.3) | 10 (0.3) | 10 (0.6) | 10 (0.6) | 10 (0.6) | 15/15 |
| SNES schaul noiseless | 6.5 (4) | 11 (4) | 12 (3) | 12 (7) | 12 (4) | 12 (3) | 12 (5) | 15/15 |
| xNES schaul noiseless | 6.7 (5) | 11 (6) | 12 (9) | 12 (7) | 12 (6) | 12 (10) | 12 (9) | 15/15 |
| xNESas schaul noiseless | 5.4 (3) | 10 (3) | 10 (3) | 10 (2) | 10 (5) | 10 (5) | 10 (4) | 15/15 |
| Δ fopt f6, 3-D |
1e1 34 |
1e0 56 |
1e-1 90 |
1e-2 117 |
1e-3 149 |
1e-5 215 |
1e-7 265 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 2.4 (2) | 5.3 (3) | 5.7 (1) | 6.4 (1) | 6.6 (1) | 6.6 (2) | 7.2 (2) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 2.8 (2) | 2.8 (1) | 2.8 (0.8) | 2.8 (0.8) | 2.7 (0.6) | 2.7 (0.5) | 2.8 (0.4) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.5 (2) | 3.3 (2) | 2.9 (2) | 3.4 (0.6) | 3.1 (1) | 3.1 (0.6) | 3.2 (2) | 15/15 |
| CMAES posik noiseless | 2.2 (2) | 3.1 (2) | 3.1 (1) | 3.2 (0.6) | 3.3 (0.6) | 3.1 (0.4) | 3.2 (0.6) | 15/15 |
| CMA brockhoff noiseless | 2.2 (1) | 3.1 (1) | 3.0 (0.9) | 3.1 (0.4) | 3.0 (0.4) | 2.9 (0.4) | 2.9 (0.5) | 15/15 |
| CMAa brockhoff noiseless | 2.1 (1) | 3.0 (1) | 2.9 (0.9) | 3.0 (0.8) | 3.0 (0.3) | 2.8 (0.5) | 3.0 (0.4) | 15/15 |
| CMAm brockhoff noiseless | 2.1 (2) | 3.1 (2) | 3.1 (1) | 3.1 (1) | 3.1 (1) | 3.1 (0.6) | 3.3 (0.5) | 15/15 |
| CMAma brockhoff noiseless | 2.9 (2) | 3.1 (0.9) | 2.8 (0.4) | 2.9 (0.6) | 2.9 (0.6) | 2.9 (0.5) | 3.1 (0.3) | 15/15 |
| CMAmah brockhoff noiseless | 2.1 (2) | 2.8 (0.9) | 2.6 (1) | 2.5 (1) | 2.4 (0.8) | 2.2 (0.6) | 2.3 (0.7) | 15/15 |
| CMAmh brockhoff noiseless | 2.0 (3) | 2.6 (2) | 2.4 (0.7) | 2.5 (1) | 2.6 (0.4) | 2.3 (1) | 2.4 (0.9) | 15/15 |
| DBRCGA chuang noiseless | 5.0 (4) | 9.5 (5) | 10 (3) | 11 (2) | 11 (4) | 10 (3) | 10 (3) | 15/15 |
| DE-AUTO voglis noiseless | 2.4 (1) | 2.2 (0.8) | 1.6 (0.4) | 1.5 (0.3) | 1.3 (0.3) | 1.2 (0.3) | 1.5 (0.9) | 15/15 |
| DE-BFGS voglis noiseless | 2.7 (2) | 2.7 (1.0) | 2.2 (2) | 2.0 (0.9) | 1.7 (0.6) | 1.6 (0.8) | 2.1 (0.6) | 15/15 |
| DE-ROLL voglis noiseless | 27 (45) | 28 (38) | 25 (23) | 32 (38) | 28 (24) | 35 (38) | 51 (23) | 15/15 |
| DE-SIMPLEX voglis noiseless | 3.2 (2) | 2.8 (1) | 2.4 (1) | 2.0 (0.8) | 1.8 (0.9) | 1.6 (0.5) | 1.5 (0.6) | 15/15 |
| DEAE posik noiseless | 3.8 (1) | 5.8 (2) | 5.9 (0.7) | 6.3 (2) | 6.7 (1) | 6.7 (0.7) | 7.5 (2) | 15/15 |
| DE posik noiseless | 3.8 (3) | 7.3 (3) | 7.7 (1) | 8.6 (3) | 8.7 (2) | 8.9 (3) | 10 (3) | 15/15 |
| DEb posik noiseless | 3.8 (2) | 7.3 (3) | 7.7 (2) | 8.6 (2) | 8.7 (2) | 8.9 (4) | 10 (3) | 15/15 |
| DEctpb posik noiseless | 5.4 (2) | 7.8 (4) | 8.2 (3) | 8.9 (3) | 8.8 (3) | 9.2 (3) | 10 (2) | 15/15 |
| IPOPsaACM loshchilov noiseless | 2.8 (2) | 3.3 (0.7) | 2.9 (1) | 3.4 (2) | 3.4 (0.9) | 3.2 (0.8) | 3.6 (0.8) | 15/15 |
| JADE posik noiseless | 2.5 (1) | 4.7 (2) | 5.0 (1.0) | 5.4 (0.9) | 5.4 (0.9) | 5.5 (0.8) | 5.9 (0.9) | 15/15 |
| JADEb posik noiseless | 2.3 (2) | 3.6 (1) | 4.0 (0.7) | 4.5 (1) | 4.7 (1) | 4.9 (0.8) | 5.1 (1) | 15/15 |
| JADEctpb posik noiseless | 2.5 (2) | 4.7 (2) | 5.0 (2) | 5.4 (1) | 5.4 (1) | 5.5 (0.9) | 5.9 (0.3) | 15/15 |
| MVDE melo noiseless | 8.1 (6) | 14 (6) | 19 (5) | 24 (10) | 27 (7) | 35 (9) | 40 (14) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 2.3 (1) | 3.3 (2) | 3.0 (0.9) | 2.9 (1.0) | 2.9 (0.6) | 2.8 (0.4) | 2.9 (0.4) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.9 (3) | 3.4 (1) | 3.0 (0.7) | 3.1 (0.6) | 3.0 (0.3) | 2.8 (0.8) | 2.9 (0.6) | 15/15 |
| PSO-BFGS voglis noiseless | 2.8 (1) | 2.8 (0.7) | 2.0 (0.8) | 1.8 (0.2) | 1.6 (0.4) | 1.5 (0.9) | 2.7 (1) | 15/15 |
| SNES schaul noiseless | 1.3 (0.6) | 2.7 (0.9) | 3.0 (0.7) | 3.3 (0.9) | 3.6 (1) | 5.1 (6) | 24 (3) | 15/15 |
| xNES schaul noiseless | 2.5 (2) | 3.3 (2) | 3.0 (0.9) | 3.8 (1.0) | 4.1 (1.0) | 4.3 (0.5) | 4.4 (3) | 15/15 |
| xNESas schaul noiseless | 2.4 (2) | 2.9 (1) | 3.1 (0.8) | 3.3 (0.9) | 3.2 (0.7) | 3.6 (0.5) | 3.8 (0.7) | 15/15 |
| Δ fopt f7, 3-D |
1e1 11 |
1e0 65 |
1e-1 342 |
1e-2 464 |
1e-3 482 |
1e-5 482 |
1e-7 535 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 3.9 (2) | 2.6 (1) | 5.6 (17) | 4.8 (13) | 4.8 (1) | 4.8 (12) | 4.7 (4) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 3.3 (2) | 1.7 (1) | 0.74 (0.3) | 0.80 (0.3) | 0.85 (0.3) | 0.85 (0.9) | 0.89 (0.5) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 3.3 (2) | 3.9 (3) | 1.4 (1) | 1.4 (0.8) | 1.5 (0.8) | 1.5 (1) | 1.4 (1) | 15/15 |
| CMAES posik noiseless | 3.3 (2) | 2.3 (3) | 1.0 (2) | 1.1 (1) | 1.5 (1) | 1.5 (2) | 1.6 (3) | 15/15 |
| CMA brockhoff noiseless | 2.7 (2) | 1.8 (0.6) | 1.2 (0.9) | 1.0 (0.4) | 1.0 (0.5) | 1.0 (0.7) | 1.0 (0.4) | 15/15 |
| CMAa brockhoff noiseless | 2.7 (2) | 1.6 (0.9) | 1.0 (0.5) | 0.95 (0.5) | 1.00 (0.1) | 1.00 (0.4) | 1.00 (0.3) | 15/15 |
| CMAm brockhoff noiseless | 3.8 (5) | 2.5 (3) | 1.4 (0.6) | 1.2 (0.7) | 1.4 (0.7) | 1.4 (0.7) | 1.4 (0.2) | 15/15 |
| CMAma brockhoff noiseless | 3.9 (3) | 1.7 (1.0) | 0.87 (0.6) | 0.78 (0.6) | 0.82 (0.5) | 0.82 (0.6) | 0.79 (0.6) | 15/15 |
| CMAmah brockhoff noiseless | 7.8 (21) | 3.3 (4) | 1.3 (2) | 1.2 (1) | 1.4 (0.8) | 1.4 (0.9) | 1.3 (0.9) | 15/15 |
| CMAmh brockhoff noiseless | 2.8 (3) | 2.9 (0.7) | 2.1 (1) | 1.8 (0.8) | 1.8 (1) | 1.8 (0.9) | 1.7 (1) | 15/15 |
| DBRCGA chuang noiseless | 5.7 (8) | 4.1 (2) | 2.0 (1.0) | 3.2 (2) | 3.6 (4) | 3.6 (2) | 3.8 (3) | 15/15 |
| DE-AUTO voglis noiseless | 3.2 (3) | 13 (16) | 6.0 (4) | 6.4 (7) | 7.4 (6) | 7.4 (7) | 6.7 (6) | 15/15 |
| DE-BFGS voglis noiseless | 5.5 (3) | 8.9 (23) | 2.2 (0.3) | 2.0 (3) | 2.2 (2) | 2.2 (3) | 11 (9) | 15/15 |
| DE-ROLL voglis noiseless | 4.6 (3) | 10 (9) | 4.6 (2) | 4.6 (1) | 5.3 (3) | 5.3 (1) | 7.3 (4) | 15/15 |
| DE-SIMPLEX voglis noiseless | 4.3 (5) | 4.3 (3) | 2.2 (0.6) | 1.8 (2) | 2.0 (2) | 2.0 (0.5) | 1.8 (2) | 15/15 |
| DEAE posik noiseless | 5.5 (5) | 2.5 (2) | 0.91 (0.3) | 0.97 (0.2) | 1.1 (0.4) | 1.1 (0.7) | 1.1 (0.5) | 15/15 |
| DE posik noiseless | 3.6 (5) | 3.4 (1) | 1.4 (0.5) | 25 (0.9) | 24 (79) | 24 (0.7) | 22 (71) | 14/15 |
| DEb posik noiseless | 3.6 (4) | 3.4 (1) | 1.4 (0.5) | 25 (0.8) | 24 (156) | 24 (78) | 22 (0.8) | 14/15 |
| DEctpb posik noiseless | 2.9 (3) | 3.4 (3) | 1.6 (0.7) | 1.8 (0.7) | 2.0 (0.8) | 2.0 (0.8) | 2.2 (0.9) | 15/15 |
| IPOPsaACM loshchilov noiseless | 2.7 (2) | 2.3 (2) | 0.89 (0.8) | 0.94 (0.5) | 1.1 (0.5) | 1.1 (0.7) | 1.1 (0.6) | 15/15 |
| JADE posik noiseless | 3.0 (2) | 2.0 (0.8) | 0.90 (0.3) | 1.1 (0.2) | 1.3 (0.3) | 1.3 (0.2) | 1.3 (0.2) | 15/15 |
| JADEb posik noiseless | 3.3 (4) | 1.8 (0.9) | 32 (0.3) | 81 (242) | 79 (156) | 79 (78) | 71 (70) | 12/15 |
| JADEctpb posik noiseless | 3.0 (4) | 2.0 (0.8) | 0.90 (0.3) | 1.1 (0.4) | 1.3 (0.3) | 1.3 (0.2) | 1.3 (0.4) | 15/15 |
| MVDE melo noiseless | 6.1 (3) | 5.2 (3) | 2.6 (1) | 3.8 (3) | 4.6 (1) | 4.6 (2) | 5.0 (0.8) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 3.9 (6) | 2.9 (1) | 0.88 (1) | 0.83 (0.5) | 0.92 (1) | 0.92 (0.9) | 1.0 (0.5) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.9 (2) | 1.9 (0.8) | 0.99 (0.9) | 0.85 (1) | 0.87 (1.0) | 0.87 (1.0) | 1.0 (0.9) | 15/15 |
| PSO-BFGS voglis noiseless | 37 (59) | 110 (386) | 160 (209) | 130 (165) | 147 (212) | 147 (120) | 319 (310) | 6/15 |
| SNES schaul noiseless | 3.2 (5) | 18 (24) | 24 (44) | 22 (20) | 42 (38) | 42 (21) | 46 (12) | 15/15 |
| xNES schaul noiseless | 3.4 (3) | 14 (24) | 5.8 (2) | 4.5 (5) | 4.4 (6) | 4.4 (5) | 4.0 (4) | 15/15 |
| xNESas schaul noiseless | 3.0 (1) | 14 (25) | 8.1 (0.9) | 8.5 (20) | 9.1 (16) | 9.1 (20) | 8.4 (6) | 15/15 |
| Δ fopt f8, 3-D |
1e1 27 |
1e0 45 |
1e-1 152 |
1e-2 179 |
1e-3 188 |
1e-5 198 |
1e-7 208 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 5.9 (3) | 10 (8) | 18 (3) | 33 (6) | 54 (9) | 95 (20) | 129 (17) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 3.0 (2) | 6.9 (5) | 3.7 (1) | 3.8 (2) | 4.0 (2) | 4.3 (1) | 4.5 (2) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 4.1 (5) | 6.3 (9) | 2.5 (2) | 2.3 (1) | 2.4 (0.8) | 2.7 (2) | 2.7 (1) | 15/15 |
| CMAES posik noiseless | 3.7 (2) | 6.4 (3) | 3.8 (2) | 4.2 (2) | 4.4 (2) | 4.9 (2) | 5.2 (1) | 15/15 |
| CMA brockhoff noiseless | 3.5 (2) | 8.3 (7) | 4.7 (1) | 4.8 (1) | 4.9 (3) | 5.3 (3) | 5.5 (3) | 15/15 |
| CMAa brockhoff noiseless | 3.0 (3) | 6.7 (2) | 3.6 (3) | 3.8 (1) | 4.1 (1.0) | 4.4 (2) | 4.6 (1) | 15/15 |
| CMAm brockhoff noiseless | 2.9 (2) | 6.1 (4) | 3.7 (1) | 4.0 (1) | 4.2 (1) | 4.6 (1) | 4.8 (0.9) | 15/15 |
| CMAma brockhoff noiseless | 3.1 (3) | 7.3 (2) | 3.5 (1) | 3.6 (3) | 3.9 (3) | 4.1 (2) | 4.3 (0.7) | 15/15 |
| CMAmah brockhoff noiseless | 3.6 (5) | 11 (7) | 5.4 (3) | 5.6 (2) | 5.8 (5) | 6.0 (1) | 6.0 (3) | 15/15 |
| CMAmh brockhoff noiseless | 5.4 (12) | 15 (24) | 6.8 (8) | 6.7 (6) | 6.8 (7) | 7.0 (6) | 7.0 (4) | 15/15 |
| DBRCGA chuang noiseless | 7.2 (3) | 12 (4) | 8.5 (4) | 12 (5) | 16 (9) | 21 (10) | 25 (8) | 15/15 |
| DE-AUTO voglis noiseless | 2.4 (0.3) | 8.7 (25) | 2.7 (8) | 2.4 (0.2) | 2.4 (6) | 2.3 (6) | 2.2 (5) | 15/15 |
| DE-BFGS voglis noiseless | 3.0 (2) | 3.3 (0.7) | 1.2 (0.5) | 1.1 (0.5) | 1.1 (0.2) | 1.1 (0.4) | 1.1 (0.6) | 15/15 |
| DE-ROLL voglis noiseless | 3.7 (9) | 28 (12) | 46 (21) | 90 (69) | 120 (68) | 174 (50) | 646 (642) | 8/15 |
| DE-SIMPLEX voglis noiseless | 2.1 (0.4) | 3.5 (3) | 1.4 (0.8) | 1.4 (0.7) | 1.4 (0.7) | 1.4 (0.4) | 1.5 (0.6) | 15/15 |
| DEAE posik noiseless | 7.0 (3) | 12 (4) | 6.2 (2) | 6.4 (2) | 6.8 (2) | 7.5 (2) | 8.1 (2) | 15/15 |
| DE posik noiseless | 7.8 (3) | 12 (12) | 7.6 (4) | 10 (2) | 11 (5) | 14 (3) | 18 (5) | 15/15 |
| DEb posik noiseless | 7.8 (1) | 12 (6) | 7.6 (4) | 10 (4) | 11 (4) | 14 (4) | 18 (4) | 15/15 |
| DEctpb posik noiseless | 7.1 (3) | 12 (9) | 8.6 (8) | 11 (5) | 13 (6) | 17 (5) | 21 (4) | 15/15 |
| IPOPsaACM loshchilov noiseless | 3.3 (3) | 5.8 (5) | 2.5 (2) | 2.4 (1) | 2.4 (1) | 2.4 (1.0) | 2.4 (0.7) | 15/15 |
| JADE posik noiseless | 5.6 (2) | 8.6 (4) | 6.8 (2) | 8.2 (3) | 9.1 (3) | 10 (4) | 11 (4) | 15/15 |
| JADEb posik noiseless | 4.1 (1) | 13 (13) | 6.7 (6) | 6.8 (1) | 7.0 (2) | 7.9 (2) | 8.8 (3) | 15/15 |
| JADEctpb posik noiseless | 5.6 (3) | 8.6 (2) | 6.8 (4) | 8.2 (7) | 9.1 (5) | 10 (3) | 11 (1) | 15/15 |
| MVDE melo noiseless | 11 (4) | 24 (12) | 18 (10) | 31 (12) | 43 (14) | 65 (6) | 87 (12) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 3.7 (3) | 7.3 (5) | 3.8 (1) | 3.8 (1) | 3.9 (0.8) | 4.3 (2) | 4.5 (1) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.1 (3) | 8.6 (4) | 4.4 (3) | 4.4 (2) | 4.5 (1.0) | 4.8 (2) | 5.0 (1) | 15/15 |
| PSO-BFGS voglis noiseless | 3.4 (1) | 4.7 (2) | 1.6 (0.4) | 1.5 (0.4) | 1.5 (0.5) | 1.4 (0.5) | 1.4 (0.4) | 15/15 |
| SNES schaul noiseless | 2.8 (2) | 210 (545) | 157 (175) | 318 (281) | 517 (25) | 931 (84) | 1493 (1115) | 2/15 |
| xNES schaul noiseless | 2.8 (2) | 5.1 (3) | 5.8 (1) | 6.9 (7) | 11 (16) | 12 (11) | 13 (17) | 15/15 |
| xNESas schaul noiseless | 2.5 (0.8) | 7.7 (7) | 5.9 (3) | 6.4 (5) | 6.9 (6) | 7.4 (7) | 7.7 (6) | 15/15 |
| Δ fopt f9, 3-D |
1e1 21 |
1e0 65 |
1e-1 127 |
1e-2 149 |
1e-3 159 |
1e-5 169 |
1e-7 178 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 5.6 (2) | 6.2 (3) | 15 (6) | 36 (27) | 60 (36) | 111 (52) | 154 (91) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 3.5 (2) | 3.3 (2) | 3.4 (1) | 3.8 (1) | 3.9 (1) | 4.2 (1) | 4.6 (0.7) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 3.2 (0.8) | 4.4 (2) | 3.1 (1) | 3.0 (1) | 3.0 (1) | 3.0 (1) | 3.0 (1) | 15/15 |
| CMAES posik noiseless | 3.4 (3) | 7.3 (8) | 6.0 (5) | 6.2 (4) | 6.3 (4) | 6.7 (2) | 7.0 (2) | 15/15 |
| CMA brockhoff noiseless | 4.0 (1) | 6.0 (6) | 5.3 (3) | 5.6 (3) | 5.6 (2) | 6.0 (3) | 6.3 (0.8) | 15/15 |
| CMAa brockhoff noiseless | 3.5 (2) | 4.1 (1) | 3.9 (1) | 3.9 (0.9) | 4.1 (2) | 4.4 (0.9) | 4.8 (1) | 15/15 |
| CMAm brockhoff noiseless | 4.0 (1) | 4.6 (2) | 4.8 (2) | 5.2 (0.9) | 5.4 (3) | 5.7 (0.9) | 5.9 (1) | 15/15 |
| CMAma brockhoff noiseless | 2.9 (2) | 4.6 (3) | 4.3 (1) | 4.6 (2) | 4.7 (0.8) | 5.0 (1) | 5.2 (0.9) | 15/15 |
| CMAmah brockhoff noiseless | 2.6 (0.9) | 3.6 (2) | 4.2 (1) | 4.5 (2) | 4.7 (2) | 5.0 (2) | 5.2 (2) | 15/15 |
| CMAmh brockhoff noiseless | 5.1 (1) | 7.4 (12) | 6.7 (6) | 6.7 (4) | 6.8 (5) | 7.2 (3) | 7.2 (4) | 15/15 |
| DBRCGA chuang noiseless | 10 (5) | 12 (11) | 16 (17) | 21 (13) | 25 (16) | 34 (14) | 38 (22) | 15/15 |
| DE-AUTO voglis noiseless | 3.0 (0.9) | 1.9 (1) | 1.2 (0.7) | 1.1 (0.5) | 1.1 (0.5) | 1.1 (0.5) | 1.1 (0.5) | 15/15 |
| DE-BFGS voglis noiseless | 3.7 (0.5) | 2.2 (0.8) | 1.4 (0.7) | 1.3 (0.4) | 1.3 (0.4) | 1.3 (0.6) | 1.2 (0.4) | 15/15 |
| DE-ROLL voglis noiseless | 5.2 (6) | 41 (125) | 52 (92) | 110 (83) | 144 (91) | 213 (71) | 1142 (2120) | 4/15 |
| DE-SIMPLEX voglis noiseless | 3.1 (1) | 2.3 (1) | 1.6 (0.7) | 1.5 (0.6) | 1.5 (0.3) | 1.6 (0.5) | 1.7 (0.2) | 15/15 |
| DEAE posik noiseless | 7.3 (3) | 8.5 (13) | 7.5 (8) | 8.0 (7) | 8.2 (7) | 9.2 (3) | 10 (2) | 15/15 |
| DE posik noiseless | 8.8 (8) | 9.3 (10) | 8.6 (6) | 10 (5) | 12 (4) | 15 (5) | 20 (4) | 15/15 |
| DEb posik noiseless | 8.8 (6) | 9.3 (13) | 8.6 (8) | 10 (6) | 12 (3) | 15 (6) | 20 (4) | 15/15 |
| DEctpb posik noiseless | 8.5 (7) | 10 (7) | 11 (6) | 13 (6) | 15 (4) | 19 (7) | 23 (6) | 15/15 |
| IPOPsaACM loshchilov noiseless | 3.9 (2) | 3.1 (3) | 2.6 (1) | 2.6 (1.0) | 2.6 (1) | 2.6 (1) | 2.7 (0.7) | 15/15 |
| JADE posik noiseless | 5.6 (3) | 6.8 (5) | 7.4 (1) | 8.9 (1) | 9.4 (1) | 11 (3) | 12 (2) | 15/15 |
| JADEb posik noiseless | 5.0 (2) | 5.8 (3) | 5.6 (4) | 6.3 (3) | 6.8 (3) | 7.8 (2) | 8.7 (2) | 15/15 |
| JADEctpb posik noiseless | 5.6 (4) | 6.8 (6) | 7.4 (3) | 8.9 (3) | 9.4 (3) | 11 (2) | 12 (1) | 15/15 |
| MVDE melo noiseless | 15 (14) | 14 (6) | 22 (17) | 37 (22) | 48 (22) | 71 (28) | 92 (26) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 3.5 (2) | 4.9 (4) | 4.5 (3) | 4.6 (2) | 4.7 (2) | 5.1 (1) | 5.3 (4) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.1 (0.5) | 3.4 (1) | 3.8 (1) | 4.1 (1) | 4.2 (0.9) | 4.5 (0.9) | 4.7 (0.7) | 15/15 |
| PSO-BFGS voglis noiseless | 4.9 (0.9) | 2.5 (0.7) | 1.6 (0.7) | 1.5 (0.2) | 1.5 (0.3) | 1.4 (0.4) | 1.4 (0.4) | 15/15 |
| SNES schaul noiseless | 2.8 (0.6) | 4.9 (3) | 112 (60) | 312 (669) | 564 (485) | 1076 (1376) | 2173 (3780) | 6/15 |
| xNES schaul noiseless | 3.2 (0.8) | 4.8 (6) | 4.6 (5) | 5.3 (2) | 5.7 (5) | 6.2 (5) | 6.6 (4) | 15/15 |
| xNESas schaul noiseless | 3.7 (0.8) | 6.7 (12) | 8.7 (8) | 9.1 (4) | 12 (3) | 13 (25) | 14 (31) | 15/15 |
| Δ fopt f10, 3-D |
1e1 114 |
1e0 152 |
1e-1 168 |
1e-2 180 |
1e-3 194 |
1e-5 218 |
1e-7 242 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 94 (176) | 499 (469) | 1011 (708) | 1343 (1609) | 1793 (1582) | 2280 (2496) | 1.1e4 (1e4) | 9/15 |
| BIPOPaCMA loshchilov noiseless | 3.4 (2) | 3.6 (1) | 3.6 (0.9) | 3.6 (0.8) | 3.6 (0.8) | 3.7 (0.6) | 3.7 (0.6) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.4 (0.5) | 1.3 (0.1) | 1.3 (0.1) | 1.3 (0.2) | 1.3 (0.1) | 1.3 (0.2) | 1.3 (0.1) | 15/15 |
| CMAES posik noiseless | 4.6 (3) | 4.7 (1) | 4.7 (1) | 4.8 (0.8) | 4.7 (0.8) | 4.6 (0.8) | 4.5 (0.5) | 15/15 |
| CMA brockhoff noiseless | 5.3 (3) | 4.8 (1) | 4.7 (0.3) | 4.7 (0.7) | 4.6 (0.5) | 4.5 (0.3) | 4.4 (0.2) | 15/15 |
| CMAa brockhoff noiseless | 3.5 (1) | 3.4 (0.7) | 3.3 (1) | 3.5 (0.8) | 3.5 (0.4) | 3.5 (0.5) | 3.6 (0.5) | 15/15 |
| CMAm brockhoff noiseless | 5.1 (3) | 4.9 (2) | 5.0 (0.4) | 4.9 (0.7) | 4.8 (0.3) | 4.6 (0.3) | 4.5 (0.3) | 15/15 |
| CMAma brockhoff noiseless | 3.7 (2) | 3.5 (0.9) | 3.6 (0.5) | 3.7 (0.5) | 3.6 (0.3) | 3.5 (0.3) | 3.5 (0.3) | 15/15 |
| CMAmah brockhoff noiseless | 4.3 (2) | 4.7 (1) | 4.8 (0.7) | 4.7 (0.6) | 4.5 (0.6) | 4.3 (0.3) | 4.2 (0.4) | 15/15 |
| CMAmh brockhoff noiseless | 6.2 (3) | 6.5 (0.5) | 6.5 (0.3) | 6.3 (1.0) | 6.0 (0.2) | 5.7 (0.4) | 5.4 (0.3) | 15/15 |
| DBRCGA chuang noiseless | 14 (4) | 67 (203) | 89 (129) | 117 (140) | 152 (128) | 227 (257) | 258 (186) | 15/15 |
| DE-AUTO voglis noiseless | 0.70 (0.0) | 0.54 (0.1) | 0.51 (0.0) | 0.50 (0.0) | 0.49 (0.1) | 0.47 (0.0) | 0.47 (0.0) | 15/15 |
| DE-BFGS voglis noiseless | 0.76 (0.6) | 0.60 (0.3) | 0.56 (0.1) | 0.55 (0.1) | 0.55 (0.2) | 0.54 (0.2) | 0.53 (0.0) | 15/15 |
| DE-ROLL voglis noiseless | 58 (59) | 100 (54) | 158 (39) | 176 (65) | 207 (132) | 263 (59) | 1345 (1093) | 4/15 |
| DE-SIMPLEX voglis noiseless | 1.4 (0.4) | 1.5 (0.7) | 1.4 (0.9) | 1.4 (0.4) | 1.4 (0.7) | 1.4 (0.8) | 1.3 (0.5) | 15/15 |
| DEAE posik noiseless | 3.1 (0.9) | 3.1 (0.3) | 3.5 (0.9) | 3.9 (0.7) | 4.1 (0.9) | 4.6 (0.5) | 5.0 (0.5) | 15/15 |
| DE posik noiseless | 9.4 (2) | 11 (3) | 13 (3) | 15 (1) | 17 (3) | 20 (4) | 22 (3) | 15/15 |
| DEb posik noiseless | 9.4 (4) | 11 (3) | 13 (3) | 15 (1) | 17 (4) | 20 (4) | 22 (3) | 15/15 |
| DEctpb posik noiseless | 11 (5) | 12 (2) | 14 (3) | 16 (3) | 18 (4) | 22 (3) | 25 (3) | 15/15 |
| IPOPsaACM loshchilov noiseless | 1.4 (0.2) | 1.3 (0.2) | 1.3 (0.4) | 1.3 (0.3) | 1.3 (0.3) | 1.3 (0.3) | 1.3 (0.1) | 15/15 |
| JADE posik noiseless | 5.2 (0.7) | 5.1 (1) | 5.5 (1) | 6.1 (1) | 6.3 (1) | 7.0 (1) | 7.2 (0.9) | 15/15 |
| JADEb posik noiseless | 5.5 (3) | 5.4 (3) | 6.3 (2) | 6.4 (2) | 6.7 (2) | 6.9 (1) | 7.1 (2) | 15/15 |
| JADEctpb posik noiseless | 5.2 (1) | 5.1 (1) | 5.5 (1) | 6.1 (1) | 6.3 (0.8) | 7.0 (0.8) | 7.2 (1.0) | 15/15 |
| MVDE melo noiseless | 33 (17) | 51 (18) | 63 (23) | 75 (5) | 86 (14) | 105 (15) | 122 (15) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 3.6 (1) | 3.3 (1.0) | 3.4 (0.9) | 3.3 (1) | 3.4 (0.8) | 3.5 (0.3) | 3.5 (0.6) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.7 (2) | 3.6 (0.3) | 3.7 (0.4) | 3.6 (0.6) | 3.7 (0.4) | 3.7 (0.2) | 3.7 (0.3) | 15/15 |
| PSO-BFGS voglis noiseless | 0.69 (0.1) | 0.57 (0.1) | 0.54 (0.0) | 0.53 (0.0) | 0.53 (0.1) | 0.53 (0.1) | 0.57 (0.1) | 15/15 |
| SNES schaul noiseless | 356 (411) | 654 (580) | 2450 (1778) | 4897 (1e4) | 6436 (2e4) | ∞ | ∞3e5 | 0/15 |
| xNES schaul noiseless | 3.2 (2) | 4.7 (0.4) | 7.8 (17) | 12 (0.4) | 12 (5) | 13 (3) | 13 (3) | 15/15 |
| xNESas schaul noiseless | 3.8 (2) | 3.9 (2) | 4.3 (2) | 4.5 (2) | 4.5 (1) | 4.6 (2) | 4.7 (2) | 15/15 |
| Δ fopt f11, 3-D |
1e1 67 |
1e0 105 |
1e-1 227 |
1e-2 263 |
1e-3 277 |
1e-5 302 |
1e-7 327 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 115 (159) | 193 (187) | 180 (150) | 242 (125) | 282 (151) | 381 (192) | 489 (224) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 5.2 (1) | 4.2 (2) | 2.4 (0.7) | 2.3 (0.4) | 2.4 (0.5) | 2.5 (0.5) | 2.5 (0.3) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.3 (0.6) | 1.8 (0.4) | 0.91 (0.1) | 0.85 (0.1) | 0.84 (0.1) | 0.87 (0.1) | 0.90 (0.2) | 15/15 |
| CMAES posik noiseless | 9.2 (4) | 7.4 (2) | 3.9 (0.6) | 3.6 (0.7) | 3.6 (0.6) | 3.7 (0.5) | 3.7 (0.3) | 15/15 |
| CMA brockhoff noiseless | 8.7 (5) | 7.0 (2) | 3.8 (0.4) | 3.5 (0.3) | 3.6 (0.5) | 3.6 (0.3) | 3.6 (0.3) | 15/15 |
| CMAa brockhoff noiseless | 5.9 (4) | 5.2 (1) | 2.6 (0.4) | 2.5 (0.2) | 2.5 (0.5) | 2.6 (0.3) | 2.7 (0.2) | 15/15 |
| CMAm brockhoff noiseless | 9.3 (5) | 9.0 (0.8) | 4.4 (0.6) | 4.0 (0.6) | 3.9 (0.4) | 3.9 (0.4) | 3.8 (0.4) | 15/15 |
| CMAma brockhoff noiseless | 6.2 (2) | 5.4 (1.0) | 2.8 (0.4) | 2.6 (0.3) | 2.6 (0.2) | 2.6 (0.3) | 2.6 (0.2) | 15/15 |
| CMAmah brockhoff noiseless | 10 (6) | 8.2 (1) | 4.2 (0.1) | 3.8 (0.3) | 3.7 (0.5) | 3.6 (0.3) | 3.5 (0.5) | 15/15 |
| CMAmh brockhoff noiseless | 13 (8) | 12 (4) | 5.8 (0.6) | 5.1 (0.6) | 5.0 (0.9) | 4.8 (1) | 4.6 (0.8) | 15/15 |
| DBRCGA chuang noiseless | 7.4 (6) | 39 (37) | 43 (57) | 79 (110) | 93 (54) | 147 (79) | 257 (261) | 12/15 |
| DE-AUTO voglis noiseless | 1.1 (0.1) | 3.5 (10) | 1.6 (5) | 1.4 (4) | 1.4 (0.0) | 1.3 (4) | 1.6 (1) | 15/15 |
| DE-BFGS voglis noiseless | 1.1 (0.1) | 0.73 (0.1) | 0.37 (0.1) | 0.34 (0.1) | 0.34 (0.0) | 0.34 (0.0) | 0.44 (0.4) | 15/15 |
| DE-ROLL voglis noiseless | 73 (77) | 148 (52) | 116 (37) | 138 (50) | 157 (54) | 218 (42) | 1748 (1851) | 2/15 |
| DE-SIMPLEX voglis noiseless | 3.6 (3) | 3.1 (2) | 1.8 (0.5) | 1.6 (0.5) | 1.6 (0.4) | 1.5 (0.7) | 1.5 (0.6) | 15/15 |
| DEAE posik noiseless | 3.9 (1) | 3.8 (1.0) | 2.3 (0.4) | 2.5 (0.4) | 2.7 (0.2) | 3.2 (0.3) | 3.7 (0.5) | 15/15 |
| DE posik noiseless | 11 (8) | 13 (4) | 8.1 (2) | 8.9 (2) | 10 (5) | 13 (3) | 15 (6) | 15/15 |
| DEb posik noiseless | 11 (6) | 13 (10) | 8.1 (5) | 8.9 (4) | 10 (5) | 13 (3) | 15 (6) | 15/15 |
| DEctpb posik noiseless | 10 (7) | 13 (10) | 8.1 (4) | 10 (3) | 11 (4) | 14 (3) | 16 (4) | 15/15 |
| IPOPsaACM loshchilov noiseless | 2.2 (0.8) | 1.8 (0.4) | 0.91 (0.1) | 0.84 (0.1) | 0.85 (0.1) | 0.90 (0.1) | 0.92 (0.1) | 15/15 |
| JADE posik noiseless | 7.0 (2) | 6.4 (2) | 4.0 (1.0) | 4.1 (1) | 4.4 (0.6) | 5.0 (1) | 5.6 (1) | 15/15 |
| JADEb posik noiseless | 8.3 (3) | 8.3 (6) | 4.9 (5) | 4.7 (4) | 4.8 (3) | 5.2 (2) | 5.5 (3) | 15/15 |
| JADEctpb posik noiseless | 7.0 (3) | 6.4 (3) | 4.0 (1) | 4.1 (1.0) | 4.4 (0.8) | 5.0 (0.9) | 5.6 (1) | 15/15 |
| MVDE melo noiseless | 21 (13) | 35 (18) | 26 (12) | 38 (13) | 48 (13) | 67 (14) | 79 (9) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 6.2 (1) | 5.1 (1) | 2.7 (0.5) | 2.5 (0.4) | 2.6 (0.4) | 2.7 (0.3) | 2.8 (0.3) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 5.6 (1) | 5.2 (2) | 2.7 (0.9) | 2.5 (0.5) | 2.5 (0.7) | 2.7 (0.5) | 2.8 (0.3) | 15/15 |
| PSO-BFGS voglis noiseless | 1.2 (0.3) | 0.85 (0.2) | 0.42 (0.1) | 0.38 (0.1) | 0.38 (0.1) | 0.38 (0.1) | 0.42 (0.2) | 15/15 |
| SNES schaul noiseless | 152 (178) | 2288 (2755) | 6040 (5951) | 1.6e4 (1e4) | ∞ | ∞ | ∞3e5 | 0/15 |
| xNES schaul noiseless | 4.4 (2) | 4.6 (5) | 2.5 (1) | 2.5 (2) | 2.7 (0.3) | 3.5 (4) | 4.6 (7) | 15/15 |
| xNESas schaul noiseless | 4.8 (3) | 6.6 (2) | 6.9 (2) | 6.5 (2) | 6.4 (27) | 6.2 (13) | 6.2 (2) | 15/15 |
| Δ fopt f12, 3-D |
1e1 65 |
1e0 168 |
1e-1 338 |
1e-2 401 |
1e-3 445 |
1e-5 696 |
1e-7 790 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 150 (93) | 1635 (5016) | 1935 (2868) | 3190 (4874) | 5410 (7704) | 1.0e4 (7812) | 3.7e4 (2e4) | 2/15 |
| BIPOPaCMA loshchilov noiseless | 7.3 (7) | 5.5 (4) | 3.8 (3) | 3.7 (2) | 3.8 (2) | 3.0 (2) | 3.1 (2) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.9 (2) | 2.5 (1) | 2.0 (0.8) | 4.1 (2) | 4.3 (9) | 5.2 (8) | 28 (9) | 15/15 |
| CMAES posik noiseless | 10 (9) | 7.2 (6) | 5.5 (4) | 5.4 (3) | 5.4 (3) | 4.7 (4) | 4.8 (5) | 15/15 |
| CMA brockhoff noiseless | 11 (15) | 9.1 (13) | 6.5 (8) | 6.3 (3) | 6.2 (5) | 4.8 (2) | 4.8 (4) | 15/15 |
| CMAa brockhoff noiseless | 10 (9) | 7.6 (8) | 5.1 (5) | 5.0 (5) | 5.0 (4) | 4.2 (2) | 4.3 (2) | 15/15 |
| CMAm brockhoff noiseless | 9.1 (7) | 9.3 (10) | 7.1 (6) | 6.9 (5) | 6.9 (5) | 5.4 (2) | 5.5 (3) | 15/15 |
| CMAma brockhoff noiseless | 7.9 (4) | 6.5 (4) | 4.7 (3) | 4.5 (2) | 4.5 (4) | 3.6 (2) | 3.6 (2) | 15/15 |
| CMAmah brockhoff noiseless | 10 (11) | 8.6 (9) | 6.0 (3) | 5.8 (4) | 5.8 (5) | 4.5 (4) | 4.4 (4) | 15/15 |
| CMAmh brockhoff noiseless | 16 (21) | 12 (8) | 9.0 (6) | 8.9 (7) | 8.5 (1) | 6.6 (6) | 6.6 (4) | 15/15 |
| DBRCGA chuang noiseless | 121 (148) | 182 (191) | 166 (189) | 184 (187) | 191 (164) | 169 (181) | 205 (105) | 13/15 |
| DE-AUTO voglis noiseless | 4.6 (7) | 2.4 (2) | 1.4 (0.6) | 1.5 (1) | 1.5 (1) | 1.2 (1) | 1.2 (0.6) | 15/15 |
| DE-BFGS voglis noiseless | 2.1 (1) | 1.1 (0.7) | 0.73 (0.9) | 0.75 (0.4) | 0.75 (0.5) | 0.59 (0.5) | 0.59 (0.4) | 15/15 |
| DE-ROLL voglis noiseless | 79 (242) | 55 (13) | 53 (22) | 66 (85) | 104 (27) | 136 (97) | 671 (381) | 2/15 |
| DE-SIMPLEX voglis noiseless | 2.5 (0.6) | 2.0 (0.7) | 1.4 (1) | 1.4 (0.6) | 1.4 (1.0) | 1.1 (0.8) | 1.1 (0.7) | 15/15 |
| DEAE posik noiseless | 14 (14) | 11 (14) | 7.7 (0.6) | 7.6 (9) | 7.6 (3) | 6.0 (8) | 6.0 (4) | 15/15 |
| DE posik noiseless | 42 (69) | 34 (50) | 26 (30) | 26 (28) | 26 (21) | 21 (20) | 22 (15) | 15/15 |
| DEb posik noiseless | 42 (74) | 34 (50) | 26 (21) | 26 (29) | 26 (19) | 21 (15) | 22 (23) | 15/15 |
| DEctpb posik noiseless | 22 (11) | 18 (14) | 16 (13) | 19 (12) | 21 (15) | 19 (11) | 20 (14) | 15/15 |
| IPOPsaACM loshchilov noiseless | 4.4 (6) | 3.1 (3) | 2.1 (2) | 2.2 (3) | 2.2 (2) | 1.8 (2) | 1.8 (2) | 15/15 |
| JADE posik noiseless | 11 (2) | 8.7 (8) | 6.1 (6) | 6.1 (3) | 6.2 (2) | 5.0 (3) | 5.0 (3) | 15/15 |
| JADEb posik noiseless | 9.1 (3) | 10 (8) | 7.5 (6) | 7.3 (6) | 7.4 (5) | 5.7 (4) | 5.7 (3) | 15/15 |
| JADEctpb posik noiseless | 11 (4) | 8.7 (3) | 6.1 (5) | 6.1 (5) | 6.2 (3) | 5.0 (3) | 5.0 (2) | 15/15 |
| MVDE melo noiseless | 75 (87) | 101 (202) | 97 (137) | 109 (114) | 118 (123) | 109 (96) | 116 (118) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 6.0 (5) | 5.3 (4) | 4.2 (5) | 4.3 (4) | 4.4 (4) | 3.3 (3) | 3.6 (3) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 8.5 (11) | 6.0 (9) | 4.4 (5) | 4.3 (3) | 4.3 (2) | 3.4 (2) | 3.4 (4) | 15/15 |
| PSO-BFGS voglis noiseless | 1.8 (0.8) | 0.95 (0.6) | 0.57 (0.4) | 0.55 (0.3) | 0.57 (0.3) | 0.53 (0.4) | 0.66 (0.8) | 15/15 |
| SNES schaul noiseless | 20 (24) | 81 (309) | 221 (231) | 755 (688) | 2439 (1905) | 6447 (1e4) | ∞3e5 | 0/15 |
| xNES schaul noiseless | 17 (30) | 19 (92) | 17 (50) | 16 (20) | 23 (56) | 18 (44) | 17 (29) | 15/15 |
| xNESas schaul noiseless | 17 (19) | 22 (87) | 33 (88) | 32 (78) | 30 (38) | 26 (28) | 35 (51) | 15/15 |
| Δ fopt f13, 3-D |
1e1 49 |
1e0 85 |
1e-1 108 |
1e-2 136 |
1e-3 215 |
1e-5 281 |
1e-7 365 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 11 (13) | 133 (286) | 1488 (4021) | 3314 (2605) | 4705 (3023) | 8.5e4 (1e5) | 4.0e5 (3e5) | 1/15 |
| BIPOPaCMA loshchilov noiseless | 3.1 (0.6) | 3.7 (4) | 3.9 (0.9) | 4.5 (2) | 3.3 (1) | 3.5 (1) | 3.4 (0.3) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.1 (0.2) | 1.8 (0.7) | 1.8 (0.4) | 1.7 (0.5) | 1.3 (0.4) | 1.3 (0.3) | 1.2 (0.2) | 15/15 |
| CMAES posik noiseless | 3.5 (2) | 5.3 (3) | 6.0 (2) | 6.1 (2) | 4.3 (1) | 4.5 (1) | 4.5 (1) | 15/15 |
| CMA brockhoff noiseless | 3.1 (1) | 5.3 (3) | 5.2 (2) | 5.4 (2) | 4.0 (1.0) | 4.1 (0.8) | 4.3 (0.7) | 15/15 |
| CMAa brockhoff noiseless | 3.0 (0.7) | 3.4 (0.5) | 4.0 (0.3) | 4.0 (0.5) | 3.1 (0.5) | 3.5 (0.7) | 3.4 (0.7) | 15/15 |
| CMAm brockhoff noiseless | 4.2 (1) | 4.9 (3) | 6.4 (3) | 6.1 (0.7) | 4.5 (2) | 4.7 (2) | 5.0 (0.8) | 15/15 |
| CMAma brockhoff noiseless | 3.4 (2) | 4.3 (3) | 4.8 (2) | 4.7 (1) | 3.6 (0.6) | 3.8 (0.6) | 3.5 (0.5) | 15/15 |
| CMAmah brockhoff noiseless | 4.5 (4) | 5.0 (5) | 6.6 (4) | 7.1 (2) | 5.5 (1) | 6.7 (2) | 5.8 (2) | 15/15 |
| CMAmh brockhoff noiseless | 7.7 (6) | 8.6 (6) | 9.0 (5) | 10 (4) | 9.3 (3) | 8.1 (2) | 8.0 (2) | 15/15 |
| DBRCGA chuang noiseless | 8.3 (3) | 14 (6) | 18 (16) | 29 (15) | 46 (31) | 81 (69) | 572 (1136) | 8/15 |
| DE-AUTO voglis noiseless | 1.8 (0.1) | 1.2 (0.1) | 1.1 (0.1) | 1.0 (0.1) | 0.73 (0.1) | 1.9 (2) | 3.6 (0.5) | 15/15 |
| DE-BFGS voglis noiseless | 1.7 (0.4) | 1.2 (0.1) | 1.1 (0.1) | 1.0 (0.2) | 0.73 (0.1) | 5.9 (4) | 862 (1057) | 0/15 |
| DE-ROLL voglis noiseless | 48 (77) | 51 (81) | 75 (53) | 79 (45) | 53 (31) | 55 (23) | 148 (132) | 13/15 |
| DE-SIMPLEX voglis noiseless | 3.0 (2) | 2.9 (0.6) | 2.8 (0.9) | 2.5 (0.7) | 1.7 (0.5) | 1.6 (0.2) | 1.9 (3) | 15/15 |
| DEAE posik noiseless | 5.0 (2) | 5.0 (0.6) | 5.9 (1) | 6.1 (0.9) | 4.6 (0.6) | 4.8 (0.4) | 4.7 (0.5) | 15/15 |
| DE posik noiseless | 9.3 (2) | 12 (2) | 14 (4) | 18 (7) | 16 (5) | 19 (4) | 22 (8) | 15/15 |
| DEb posik noiseless | 9.3 (3) | 12 (3) | 14 (4) | 18 (4) | 16 (7) | 19 (4) | 22 (6) | 15/15 |
| DEctpb posik noiseless | 9.2 (4) | 13 (4) | 17 (7) | 20 (3) | 18 (3) | 21 (3) | 22 (3) | 15/15 |
| IPOPsaACM loshchilov noiseless | 2.4 (1) | 1.8 (0.5) | 1.9 (0.6) | 1.9 (0.6) | 1.4 (0.4) | 1.4 (0.2) | 1.3 (0.2) | 15/15 |
| JADE posik noiseless | 6.0 (2) | 7.2 (2) | 8.8 (2) | 9.3 (2) | 7.4 (1) | 7.4 (0.7) | 6.7 (0.6) | 15/15 |
| JADEb posik noiseless | 4.8 (2) | 5.0 (2) | 6.1 (2) | 7.9 (3) | 6.4 (2) | 7.1 (2) | 6.8 (2) | 15/15 |
| JADEctpb posik noiseless | 6.0 (1) | 7.2 (1) | 8.8 (3) | 9.3 (0.7) | 7.4 (0.9) | 7.4 (0.6) | 6.7 (0.3) | 15/15 |
| MVDE melo noiseless | 18 (12) | 31 (6) | 55 (25) | 75 (32) | 75 (10) | 98 (19) | 114 (12) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 3.9 (0.9) | 3.7 (1) | 4.6 (0.7) | 4.4 (1) | 3.3 (0.6) | 3.6 (0.8) | 3.4 (0.2) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.8 (2) | 3.8 (1) | 4.4 (1) | 4.4 (2) | 3.4 (1) | 3.6 (0.6) | 3.4 (0.6) | 15/15 |
| PSO-BFGS voglis noiseless | 1.7 (0.1) | 1.2 (0.1) | 1.1 (0.1) | 1.00 (0.1) | 0.72 (0.1) | 95 (34) | 1.2e4 (2e4) | 0/15 |
| SNES schaul noiseless | 25 (46) | 83 (112) | 229 (300) | 606 (519) | 1781 (1867) | 1.6e4 (2e4) | ∞3e5 | 0/15 |
| xNES schaul noiseless | 4.8 (4) | 4.3 (2) | 4.5 (2) | 4.6 (0.3) | 3.5 (0.8) | 3.7 (0.6) | 3.6 (0.6) | 15/15 |
| xNESas schaul noiseless | 12 (32) | 8.0 (0.8) | 7.6 (0.7) | 6.9 (0.6) | 4.9 (0.8) | 4.8 (0.6) | 4.5 (0.4) | 15/15 |
| Δ fopt f14, 3-D |
1e1 2.0 |
1e0 17 |
1e-1 28 |
1e-2 43 |
1e-3 71 |
1e-5 110 |
1e-7 194 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 2.1 (3) | 3.8 (2) | 6.2 (2) | 7.3 (2) | 7.3 (2) | 77 (65) | 1805 (1453) | 11/15 |
| BIPOPaCMA loshchilov noiseless | 3.2 (5) | 2.8 (2) | 3.5 (2) | 4.4 (1) | 4.1 (0.9) | 4.9 (1.0) | 4.1 (0.3) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.0 (3) | 2.3 (2) | 3.3 (0.9) | 3.0 (1) | 2.5 (0.8) | 2.5 (0.4) | 1.9 (0.3) | 15/15 |
| CMAES posik noiseless | 2.9 (4) | 2.8 (2) | 3.7 (2) | 4.4 (2) | 4.7 (1) | 6.6 (1) | 5.8 (1) | 15/15 |
| CMA brockhoff noiseless | 3.0 (3) | 3.1 (2) | 4.4 (1) | 4.6 (1) | 4.1 (0.7) | 6.9 (2) | 5.8 (0.9) | 15/15 |
| CMAa brockhoff noiseless | 4.3 (8) | 2.8 (2) | 4.1 (2) | 4.4 (0.7) | 4.3 (0.7) | 4.8 (1) | 4.2 (0.6) | 15/15 |
| CMAm brockhoff noiseless | 3.1 (5) | 2.5 (1) | 3.5 (1) | 4.0 (1) | 3.6 (2) | 6.1 (2) | 5.7 (0.8) | 15/15 |
| CMAma brockhoff noiseless | 4.0 (3) | 3.1 (2) | 3.9 (2) | 4.1 (1) | 4.1 (1) | 5.2 (0.2) | 4.4 (0.9) | 15/15 |
| CMAmah brockhoff noiseless | 3.9 (4) | 2.2 (1) | 2.8 (1) | 3.1 (1) | 3.6 (1) | 6.7 (1) | 6.1 (0.8) | 15/15 |
| CMAmh brockhoff noiseless | 2.6 (2) | 2.1 (2) | 2.5 (1) | 2.8 (2) | 4.3 (1) | 7.8 (3) | 7.6 (1) | 15/15 |
| DBRCGA chuang noiseless | 2.1 (2) | 6.1 (6) | 13 (4) | 16 (4) | 15 (11) | 45 (59) | 371 (764) | 14/15 |
| DE-AUTO voglis noiseless | 2.5 (3) | 3.2 (2) | 2.8 (0.6) | 2.1 (0.3) | 1.4 (0.1) | 1.2 (0.1) | 4.9 (4) | 15/15 |
| DE-BFGS voglis noiseless | 2.1 (1) | 1.9 (2) | 2.5 (0.3) | 1.9 (0.3) | 1.3 (0.2) | 1.1 (0.2) | 2.1 (2) | 15/15 |
| DE-ROLL voglis noiseless | 2.5 (2) | 6.4 (2) | 7.2 (3) | 6.0 (15) | 20 (13) | 195 (53) | 846 (716) | 1/15 |
| DE-SIMPLEX voglis noiseless | 1.9 (1) | 5.0 (2) | 4.0 (0.9) | 3.3 (0.8) | 2.3 (0.5) | 2.0 (0.4) | 1.4 (0.3) | 15/15 |
| DEAE posik noiseless | 3.5 (5) | 5.5 (4) | 8.0 (3) | 9.4 (2) | 7.7 (1) | 7.8 (0.8) | 6.0 (0.5) | 15/15 |
| DE posik noiseless | 2.2 (2) | 4.2 (2) | 6.6 (3) | 8.3 (2) | 9.1 (2) | 14 (3) | 16 (3) | 15/15 |
| DEb posik noiseless | 2.2 (2) | 4.2 (3) | 6.6 (2) | 8.3 (1) | 9.1 (2) | 14 (4) | 16 (6) | 15/15 |
| DEctpb posik noiseless | 2.0 (2) | 4.2 (3) | 8.7 (2) | 10 (4) | 10 (4) | 17 (5) | 18 (5) | 15/15 |
| IPOPsaACM loshchilov noiseless | 3.7 (4) | 2.5 (2) | 3.3 (0.9) | 3.1 (0.8) | 2.4 (0.7) | 2.4 (0.3) | 1.8 (0.3) | 15/15 |
| JADE posik noiseless | 2.3 (2) | 4.4 (2) | 5.9 (2) | 7.3 (2) | 7.1 (2) | 9.1 (1) | 7.9 (1) | 15/15 |
| JADEb posik noiseless | 2.5 (2) | 3.1 (1) | 4.6 (2) | 5.4 (0.8) | 5.3 (1) | 7.2 (2) | 7.1 (3) | 15/15 |
| JADEctpb posik noiseless | 2.3 (2) | 4.4 (1) | 5.9 (2) | 7.3 (2) | 7.1 (1) | 9.1 (1) | 7.9 (1) | 15/15 |
| MVDE melo noiseless | 2.2 (3) | 6.1 (5) | 17 (7) | 24 (4) | 26 (8) | 57 (22) | 76 (21) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 2.7 (2) | 2.0 (0.8) | 3.1 (0.9) | 3.8 (1) | 3.7 (0.7) | 4.6 (1) | 4.0 (0.4) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.8 (3) | 2.1 (2) | 3.3 (2) | 3.7 (1) | 4.1 (0.6) | 4.9 (0.6) | 4.2 (0.5) | 15/15 |
| PSO-BFGS voglis noiseless | 2.4 (2) | 3.2 (2) | 2.7 (0.3) | 2.0 (0.2) | 1.4 (0.2) | 1.1 (0.1) | 24 (4) | 10/15 |
| SNES schaul noiseless | 7.5 (6) | 3.3 (2) | 3.7 (0.9) | 5.1 (1) | 14 (8) | 4803 (3890) | ∞3e5 | 0/15 |
| xNES schaul noiseless | 4.1 (4) | 2.9 (2) | 3.7 (2) | 4.6 (2) | 4.4 (1) | 5.0 (0.7) | 3.9 (0.3) | 15/15 |
| xNESas schaul noiseless | 4.7 (4) | 2.7 (3) | 3.4 (2) | 4.6 (2) | 4.4 (1) | 7.0 (1) | 5.3 (5) | 15/15 |
| Δ fopt f15, 3-D |
1e1 121 |
1e0 1372 |
1e-1 6285 |
1e-2 8282 |
1e-3 8429 |
1e-5 8787 |
1e-7 9041 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1.7 (0.9) | 8.1 (11) | 10 (7) | 7.6 (15) | 7.5 (5) | 7.2 (10) | 7.1 (3) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 1.4 (0.4) | 1.5 (0.5) | 1.4 (2) | 1.2 (2) | 1.2 (1.0) | 1.2 (0.9) | 1.2 (0.9) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.2 (0.8) | 1.2 (0.9) | 0.97 (1) | 0.76 (0.9) | 0.76 (0.9) | 0.74 (0.6) | 0.73 (0.5) | 15/15 |
| CMAES posik noiseless | 0.97 (0.7) | 2.1 (2) | 1.6 (3) | 1.2 (2) | 1.2 (1) | 1.2 (1) | 1.2 (0.5) | 15/15 |
| CMA brockhoff noiseless | 1.0 (0.7) | 1.7 (2) | 1.1 (2) | 0.92 (0.4) | 0.92 (0.3) | 0.92 (1) | 0.92 (0.7) | 15/15 |
| CMAa brockhoff noiseless | 1.2 (2) | 1.3 (2) | 0.97 (1) | 0.76 (0.3) | 0.76 (0.8) | 0.76 (0.2) | 0.77 (0.6) | 15/15 |
| CMAm brockhoff noiseless | 0.92 (0.6) | 1.6 (2) | 1.2 (1) | 0.92 (0.9) | 0.93 (0.5) | 0.92 (1.0) | 0.93 (0.5) | 15/15 |
| CMAma brockhoff noiseless | 0.96 (0.4) | 1.5 (1) | 1.3 (1) | 1.0 (1) | 1.0 (1) | 1.0 (0.9) | 1.1 (1) | 15/15 |
| CMAmah brockhoff noiseless | 2.4 (4) | 2.0 (1) | 0.92 (0.5) | 0.77 (0.8) | 0.78 (0.7) | 0.78 (0.7) | 0.78 (0.6) | 15/15 |
| CMAmh brockhoff noiseless | 2.6 (7) | 1.3 (1) | 0.88 (1) | 0.69 (0.9) | 0.70 (0.7) | 0.70 (0.6) | 0.71 (0.8) | 15/15 |
| DBRCGA chuang noiseless | 2.8 (0.7) | 3.8 (3) | 2.1 (2) | 1.7 (2) | 1.7 (2) | 1.6 (1) | 1.6 (2) | 15/15 |
| DE-AUTO voglis noiseless | 8.2 (17) | 5.4 (5) | 4.0 (6) | 3.1 (2) | 3.0 (3) | 2.9 (3) | 2.8 (3) | 15/15 |
| DE-BFGS voglis noiseless | 1.3 (2) | 1.0 (0.9) | 0.98 (0.9) | 0.74 (0.6) | 0.73 (0.7) | 0.70 (0.7) | 0.68 (0.7) | 15/15 |
| DE-ROLL voglis noiseless | 6.9 (9) | 7.5 (5) | 5.1 (3) | 3.8 (4) | 3.8 (5) | 3.6 (5) | 3.5 (3) | 15/15 |
| DE-SIMPLEX voglis noiseless | 5.3 (5) | 2.3 (2) | 1.8 (2) | 1.4 (1) | 1.4 (1) | 1.3 (1.0) | 1.3 (1.0) | 15/15 |
| DEAE posik noiseless | 1.9 (0.7) | 1.8 (2) | 1.3 (0.9) | 1.0 (1.0) | 1.0 (0.9) | 1.0 (0.4) | 1.0 (0.9) | 15/15 |
| DE posik noiseless | 2.2 (1) | 2.5 (2) | 1.8 (2) | 1.4 (1) | 1.4 (1) | 1.4 (1) | 1.3 (1) | 15/15 |
| DEb posik noiseless | 2.2 (2) | 2.5 (3) | 1.8 (2) | 1.4 (1) | 1.4 (1) | 1.4 (1) | 1.3 (1) | 15/15 |
| DEctpb posik noiseless | 2.0 (2) | 2.5 (1) | 1.4 (2) | 1.1 (0.7) | 1.2 (0.8) | 1.2 (1) | 1.2 (0.9) | 15/15 |
| IPOPsaACM loshchilov noiseless | 0.90 (0.5) | 1.2 (2) | 0.97 (0.6) | 0.79 (0.5) | 0.79 (0.8) | 0.77 (0.5) | 0.76 (0.4) | 15/15 |
| JADE posik noiseless | 1.8 (0.6) | 1.6 (1) | 0.94 (1) | 0.77 (1) | 0.80 (0.8) | 0.82 (0.8) | 0.82 (0.7) | 15/15 |
| JADEb posik noiseless | 1.4 (0.6) | 3.1 (4) | 3.8 (3) | 2.9 (5) | 2.9 (2) | 2.8 (1) | 2.7 (2) | 15/15 |
| JADEctpb posik noiseless | 1.8 (0.5) | 1.6 (1) | 0.94 (1) | 0.77 (0.1) | 0.80 (1) | 0.82 (0.9) | 0.82 (0.6) | 15/15 |
| MVDE melo noiseless | 2.9 (2) | 56 (2) | 26 (0.7) | 20 (91) | 20 (30) | 19 (29) | 19 (56) | 13/15 |
| NBIPOPaCMA loshchilov noiseless | 1.0 (0.5) | 1.8 (2) | 2.8 (6) | 2.3 (2) | 2.2 (0.8) | 2.2 (2) | 2.3 (0.9) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 0.94 (0.5) | 1.8 (0.8) | 1.1 (0.9) | 0.90 (1) | 0.91 (0.9) | 0.90 (0.6) | 0.92 (0.6) | 15/15 |
| PSO-BFGS voglis noiseless | 5.1 (4) | 3.4 (1) | 1.9 (2) | 1.4 (1) | 1.4 (1) | 1.4 (0.8) | 1.3 (0.9) | 15/15 |
| SNES schaul noiseless | 1.3 (0.9) | 5.5 (3) | 10 (11) | 8.0 (3) | 7.8 (4) | 7.5 (8) | 7.3 (11) | 15/15 |
| xNES schaul noiseless | 2.8 (0.6) | 10 (9) | 10 (28) | 7.7 (6) | 7.6 (6) | 7.3 (4) | 7.1 (3) | 14/15 |
| xNESas schaul noiseless | 1.2 (0.5) | 5.5 (10) | 5.1 (4) | 3.9 (3) | 3.8 (4) | 3.7 (4) | 3.6 (2) | 15/15 |
| Δ fopt f16, 3-D |
1e1 41 |
1e0 319 |
1e-1 582 |
1e-2 789 |
1e-3 1864 |
1e-5 3204 |
1e-7 3361 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1.7 (1) | 10 (11) | 63 (130) | 65 (137) | 31 (86) | 18 (10) | 17 (20) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 1.5 (2) | 2.6 (4) | 4.1 (4) | 4.1 (1) | 1.8 (2) | 1.1 (2) | 1.1 (0.7) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.0 (2) | 2.9 (3) | 2.4 (2) | 3.1 (2) | 1.4 (1) | 0.92 (0.7) | 0.94 (0.6) | 15/15 |
| CMAES posik noiseless | 1.5 (0.8) | 2.9 (5) | 4.9 (8) | 4.7 (8) | 3.1 (4) | 2.2 (3) | 2.1 (1) | 15/15 |
| CMA brockhoff noiseless | 1.4 (0.9) | 2.7 (3) | 2.3 (2) | 2.2 (2) | 1.4 (2) | 0.95 (1) | 0.96 (1) | 15/15 |
| CMAa brockhoff noiseless | 1.7 (0.6) | 2.8 (4) | 2.7 (2) | 3.4 (4) | 1.6 (2) | 1.1 (0.7) | 1.2 (1) | 15/15 |
| CMAm brockhoff noiseless | 1.7 (0.8) | 3.0 (3) | 3.1 (3) | 2.8 (2) | 1.3 (0.8) | 1.2 (1) | 1.2 (1) | 15/15 |
| CMAma brockhoff noiseless | 4.2 (3) | 3.6 (3) | 3.5 (6) | 3.5 (3) | 1.6 (2) | 1.1 (1) | 1.1 (1) | 15/15 |
| CMAmah brockhoff noiseless | 6.7 (6) | 3.5 (2) | 3.6 (4) | 3.4 (2) | 1.6 (0.3) | 0.98 (0.5) | 0.98 (0.2) | 15/15 |
| CMAmh brockhoff noiseless | 1.6 (1) | 3.7 (3) | 5.3 (5) | 4.6 (3) | 2.7 (3) | 1.8 (2) | 1.7 (1) | 15/15 |
| DBRCGA chuang noiseless | 1.7 (1) | 5.6 (11) | 8.3 (6) | 20 (19) | 15 (32) | 15 (6) | 15 (6) | 15/15 |
| DE-AUTO voglis noiseless | 11 (54) | 26 (40) | 38 (29) | 71 (33) | 37 (56) | 26 (10) | 35 (42) | 14/15 |
| DE-BFGS voglis noiseless | 1.5 (2) | 3.6 (4) | 34 (89) | 29 (28) | 13 (0.6) | 7.8 (0.2) | 54 (54) | 4/15 |
| DE-ROLL voglis noiseless | 0.90 (0.9) | 23 (32) | 69 (25) | 115 (212) | 58 (128) | 38 (50) | 74 (71) | 5/15 |
| DE-SIMPLEX voglis noiseless | 2.0 (3) | 2.6 (2) | 3.2 (3) | 2.8 (3) | 1.7 (0.9) | 1.9 (3) | 7.6 (22) | 15/15 |
| DEAE posik noiseless | 0.92 (0.2) | 2.6 (2) | 4.2 (2) | 4.5 (7) | 2.0 (2) | 1.3 (0.8) | 1.3 (2) | 15/15 |
| DE posik noiseless | 2.2 (1) | 4.8 (3) | 5.1 (5) | 7.1 (10) | 3.2 (4) | 2.1 (3) | 2.1 (2) | 15/15 |
| DEb posik noiseless | 2.2 (2) | 4.8 (3) | 5.1 (8) | 7.1 (7) | 3.2 (3) | 2.1 (0.2) | 2.1 (1) | 15/15 |
| DEctpb posik noiseless | 1.9 (1) | 6.3 (4) | 8.9 (5) | 13 (10) | 7.0 (5) | 8.8 (14) | 12 (12) | 13/15 |
| IPOPsaACM loshchilov noiseless | 2.7 (1) | 3.9 (3) | 2.8 (2) | 2.3 (3) | 1.1 (1.0) | 0.81 (0.6) | 0.84 (0.9) | 15/15 |
| JADE posik noiseless | 1.2 (2) | 3.5 (3) | 6.2 (3) | 8.7 (12) | 4.4 (4) | 3.0 (3) | 4.8 (2) | 15/15 |
| JADEb posik noiseless | 1.2 (1) | 2.1 (3) | 2.2 (4) | 2.1 (4) | 1.8 (2) | 1.3 (0.4) | 1.4 (4) | 15/15 |
| JADEctpb posik noiseless | 1.2 (0.7) | 3.5 (3) | 6.2 (6) | 8.7 (8) | 4.4 (4) | 3.0 (2) | 4.8 (2) | 15/15 |
| MVDE melo noiseless | 1.0 (2) | 5.3 (7) | 15 (8) | 109 (328) | 204 (537) | 120 (158) | 115 (224) | 11/15 |
| NBIPOPaCMA loshchilov noiseless | 1.5 (2) | 2.4 (3) | 2.2 (1) | 2.3 (3) | 1.1 (0.7) | 0.74 (0.9) | 0.74 (0.8) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 1.5 (3) | 2.6 (3) | 2.8 (3) | 2.2 (2) | 0.99 (0.7) | 0.71 (0.5) | 0.72 (0.4) | 15/15 |
| PSO-BFGS voglis noiseless | 3.4 (3) | 4.4 (4) | 9.2 (3) | 15 (20) | 14 (20) | 11 (13) | 59 (69) | 6/15 |
| SNES schaul noiseless | 1.9 (3) | 3.0 (3) | 5.0 (5) | 7.7 (12) | 11 (39) | 15 (33) | 35 (88) | 12/15 |
| xNES schaul noiseless | 1.4 (1) | 2.6 (5) | 4.3 (4) | 3.8 (8) | 1.8 (3) | 1.2 (3) | 1.1 (2) | 15/15 |
| xNESas schaul noiseless | 0.92 (0.3) | 2.8 (7) | 3.2 (12) | 2.6 (6) | 1.1 (0.9) | 0.71 (0.6) | 0.73 (1) | 15/15 |
| Δ fopt f17, 3-D |
1e1 4.0 |
1e0 78 |
1e-1 282 |
1e-2 491 |
1e-3 1134 |
1e-5 2347 |
1e-7 3469 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 2.1 (2) | 2.0 (0.8) | 1.5 (0.2) | 1.5 (0.4) | 6.0 (19) | 3.2 (18) | 4.6 (0.1) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 3.8 (2) | 1.8 (3) | 1.5 (1.0) | 1.3 (0.6) | 0.89 (0.6) | 1.0 (0.8) | 0.81 (0.4) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 3.0 (5) | 1.3 (0.9) | 1.9 (0.9) | 2.6 (2) | 1.3 (0.7) | 1.6 (0.9) | 1.4 (0.9) | 15/15 |
| CMAES posik noiseless | 4.0 (2) | 1.1 (0.3) | 1.6 (2) | 1.7 (0.6) | 1.1 (0.9) | 2.6 (1) | 3.3 (7) | 15/15 |
| CMA brockhoff noiseless | 2.6 (3) | 2.1 (7) | 1.1 (0.2) | 1.6 (2) | 1.00 (0.7) | 0.66 (0.4) | 0.72 (0.8) | 15/15 |
| CMAa brockhoff noiseless | 4.0 (5) | 2.4 (4) | 1.4 (1) | 1.6 (3) | 0.94 (1) | 0.96 (0.7) | 0.84 (0.7) | 15/15 |
| CMAm brockhoff noiseless | 3.3 (3) | 3.4 (8) | 1.3 (2) | 1.4 (1) | 0.88 (0.7) | 1.0 (0.6) | 0.94 (0.5) | 15/15 |
| CMAma brockhoff noiseless | 4.5 (6) | 1.7 (0.4) | 1.7 (6) | 1.5 (4) | 0.98 (1) | 0.80 (0.8) | 0.78 (0.4) | 15/15 |
| CMAmah brockhoff noiseless | 3.3 (3) | 2.4 (13) | 4.0 (4) | 3.1 (2) | 2.0 (0.7) | 1.3 (0.3) | 1.2 (0.4) | 15/15 |
| CMAmh brockhoff noiseless | 4.7 (2) | 10 (26) | 4.7 (9) | 4.1 (4) | 2.5 (2) | 1.6 (0.8) | 1.3 (0.5) | 15/15 |
| DBRCGA chuang noiseless | 1.8 (2) | 3.7 (0.9) | 3.1 (2) | 3.1 (0.3) | 3.2 (0.2) | 4.4 (1) | 8.1 (14) | 15/15 |
| DE-AUTO voglis noiseless | 2.2 (3) | 31 (43) | 22 (15) | 27 (10) | 16 (10) | 13 (8) | 16 (21) | 15/15 |
| DE-BFGS voglis noiseless | 2.8 (5) | 5.5 (4) | 4.0 (2) | 4.7 (2) | 2.7 (1) | 2.0 (0.5) | 50 (58) | 3/15 |
| DE-ROLL voglis noiseless | 17 (1) | 15 (13) | 24 (11) | 29 (18) | 19 (12) | 15 (8) | 127 (156) | 5/15 |
| DE-SIMPLEX voglis noiseless | 2.4 (3) | 9.0 (6) | 5.8 (2) | 6.4 (2) | 3.7 (0.5) | 3.1 (0.7) | 242 (216) | 0/15 |
| DEAE posik noiseless | 1.9 (2) | 2.8 (0.9) | 1.9 (0.2) | 1.8 (0.2) | 1.1 (0.2) | 1.1 (0.7) | 1.3 (0.7) | 15/15 |
| DE posik noiseless | 1.6 (1) | 2.7 (1) | 2.3 (0.7) | 2.3 (0.6) | 1.4 (0.4) | 1.4 (0.7) | 1.8 (2) | 15/15 |
| DEb posik noiseless | 1.6 (2) | 2.7 (1) | 2.3 (0.8) | 2.3 (0.6) | 1.4 (0.4) | 1.4 (1) | 1.8 (1) | 15/15 |
| DEctpb posik noiseless | 1.7 (2) | 3.1 (1) | 2.5 (0.7) | 2.8 (1) | 1.8 (0.3) | 1.6 (0.3) | 1.6 (0.8) | 15/15 |
| IPOPsaACM loshchilov noiseless | 2.2 (2) | 1.2 (0.3) | 1.3 (3) | 1.6 (2) | 1.3 (0.7) | 1.1 (0.9) | 0.97 (0.6) | 15/15 |
| JADE posik noiseless | 1.7 (2) | 1.7 (0.8) | 1.8 (0.5) | 1.9 (0.4) | 1.2 (0.2) | 0.99 (0.2) | 0.92 (0.2) | 15/15 |
| JADEb posik noiseless | 1.8 (2) | 1.4 (1) | 1.2 (0.3) | 2.3 (5) | 1.3 (0.2) | 1.4 (0.9) | 3.6 (6) | 15/15 |
| JADEctpb posik noiseless | 1.7 (2) | 1.7 (0.9) | 1.8 (0.5) | 1.9 (0.3) | 1.2 (0.2) | 0.99 (0.1) | 0.92 (0.1) | 15/15 |
| MVDE melo noiseless | 1.6 (2) | 4.7 (2) | 5.2 (2) | 6.3 (2) | 4.9 (0.9) | 4.5 (1) | 4.4 (1) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 2.8 (3) | 2.2 (0.4) | 1.3 (2) | 1.4 (1) | 0.99 (0.7) | 1.0 (0.3) | 1.3 (1) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.0 (3) | 3.1 (0.4) | 1.4 (2) | 1.5 (1) | 0.87 (0.6) | 0.98 (0.3) | 0.92 (0.7) | 15/15 |
| PSO-BFGS voglis noiseless | 1.9 (3) | 11 (17) | 14 (6) | 11 (5) | 6.6 (1) | 4.9 (1) | 63 (67) | 1/15 |
| SNES schaul noiseless | 6.2 (4) | 4.0 (11) | 2.9 (4) | 2.1 (2) | 1.7 (1) | 6.3 (4) | 8.0 (9) | 14/15 |
| xNES schaul noiseless | 5.0 (5) | 1.6 (1.0) | 2.4 (3) | 2.3 (2) | 1.9 (2) | 3.1 (4) | 3.0 (2) | 15/15 |
| xNESas schaul noiseless | 4.8 (8) | 3.4 (18) | 1.7 (0.8) | 2.6 (3) | 1.3 (1) | 3.3 (3) | 2.8 (2) | 15/15 |
| Δ fopt f18, 3-D |
1e1 40 |
1e0 145 |
1e-1 1289 |
1e-2 3084 |
1e-3 3523 |
1e-5 4738 |
1e-7 5527 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 2.2 (0.8) | 3.0 (0.7) | 23 (0.5) | 12 (13) | 15 (8) | 29 (31) | 31 (58) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 1.3 (1) | 2.3 (0.2) | 0.95 (1) | 0.66 (0.3) | 0.69 (0.5) | 0.70 (0.4) | 0.75 (0.5) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.2 (0.7) | 2.2 (7) | 0.97 (0.5) | 0.58 (0.5) | 0.62 (0.5) | 1.1 (0.3) | 1.0 (0.7) | 15/15 |
| CMAES posik noiseless | 1.3 (0.7) | 3.1 (3) | 2.5 (2) | 2.5 (3) | 3.4 (3) | 6.5 (7) | 11 (5) | 13/15 |
| CMA brockhoff noiseless | 3.6 (0.8) | 2.0 (3) | 1.0 (0.8) | 0.86 (0.6) | 0.83 (0.4) | 0.85 (0.4) | 0.86 (0.4) | 15/15 |
| CMAa brockhoff noiseless | 1.3 (1) | 2.5 (0.6) | 1.0 (0.7) | 0.88 (0.6) | 0.93 (0.6) | 0.87 (0.4) | 0.90 (0.3) | 15/15 |
| CMAm brockhoff noiseless | 1.5 (0.9) | 2.3 (5) | 1.2 (3) | 0.99 (1.0) | 1.4 (1) | 1.3 (0.5) | 1.3 (0.7) | 15/15 |
| CMAma brockhoff noiseless | 1.2 (1.0) | 4.3 (6) | 1.6 (1) | 0.97 (0.5) | 0.90 (0.5) | 0.85 (0.4) | 0.83 (0.3) | 15/15 |
| CMAmah brockhoff noiseless | 6.1 (15) | 4.8 (7) | 1.8 (1) | 1.2 (0.6) | 1.3 (0.6) | 1.2 (0.4) | 1.2 (0.5) | 15/15 |
| CMAmh brockhoff noiseless | 2.9 (1) | 5.2 (8) | 2.8 (4) | 1.5 (1) | 1.6 (0.8) | 1.4 (0.7) | 1.3 (0.2) | 15/15 |
| DBRCGA chuang noiseless | 2.7 (2) | 3.5 (1) | 4.1 (6) | 8.3 (9) | 22 (37) | 32 (37) | 60 (50) | 9/15 |
| DE-AUTO voglis noiseless | 22 (49) | 37 (31) | 10 (6) | 12 (6) | 15 (5) | 16 (8) | 24 (5) | 13/15 |
| DE-BFGS voglis noiseless | 2.3 (2) | 9.0 (10) | 2.2 (0.5) | 1.8 (2) | 2.2 (0.7) | 2.2 (2) | 91 (69) | 0/15 |
| DE-ROLL voglis noiseless | 16 (33) | 34 (37) | 14 (7) | 11 (4) | 17 (12) | 23 (14) | 188 (296) | 0/15 |
| DE-SIMPLEX voglis noiseless | 9.5 (12) | 27 (115) | 10 (13) | 5.3 (8) | 5.1 (4) | 4.7 (3) | 170 (254) | 0/15 |
| DEAE posik noiseless | 2.3 (2) | 2.4 (0.8) | 0.52 (0.1) | 0.76 (0.1) | 1.1 (1) | 1.2 (1) | 1.2 (1) | 15/15 |
| DE posik noiseless | 2.7 (0.8) | 3.9 (3) | 1.0 (0.5) | 0.87 (0.4) | 1.2 (0.9) | 1.7 (1) | 3.4 (4) | 15/15 |
| DEb posik noiseless | 2.7 (3) | 3.9 (1) | 1.0 (0.6) | 0.87 (0.5) | 1.2 (2) | 1.7 (1) | 3.4 (1) | 15/15 |
| DEctpb posik noiseless | 2.6 (1) | 4.1 (1) | 1.2 (0.4) | 0.96 (0.2) | 1.2 (0.2) | 1.9 (1.0) | 5.8 (6) | 14/15 |
| IPOPsaACM loshchilov noiseless | 1.4 (1) | 4.0 (5) | 1.3 (2) | 0.84 (0.9) | 0.91 (0.5) | 1.1 (0.4) | 1.3 (0.6) | 15/15 |
| JADE posik noiseless | 1.9 (0.5) | 2.8 (0.7) | 0.74 (0.2) | 0.50 (0.1) | 0.57 (0.1) | 0.65 (0.1) | 0.76 (0.8) | 15/15 |
| JADEb posik noiseless | 1.3 (0.7) | 1.8 (0.6) | 1.8 (5) | 1.4 (1) | 2.7 (3) | 6.8 (5) | 13 (17) | 13/15 |
| JADEctpb posik noiseless | 1.9 (0.6) | 2.8 (3) | 0.74 (0.1) | 0.50 (0.1) | 0.57 (0.1) | 0.65 (0.1) | 0.76 (0.1) | 15/15 |
| MVDE melo noiseless | 3.5 (2) | 8.0 (1) | 3.3 (1) | 3.0 (0.8) | 3.9 (1) | 5.5 (1) | 6.4 (2) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 3.0 (1) | 3.0 (3) | 1.0 (0.8) | 0.92 (1) | 0.89 (0.8) | 0.91 (0.4) | 1.1 (0.5) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 1.5 (1) | 5.2 (9) | 1.6 (1) | 1.1 (0.7) | 1.1 (0.9) | 1.0 (0.4) | 0.95 (0.6) | 15/15 |
| PSO-BFGS voglis noiseless | 7.8 (8) | 24 (16) | 20 (23) | 10 (7) | 10 (17) | 12 (8) | 243 (371) | 0/15 |
| SNES schaul noiseless | 1.7 (1) | 3.6 (7) | 5.5 (3) | 9.5 (32) | 71 (87) | 443 (475) | 390 (584) | 2/15 |
| xNES schaul noiseless | 1.7 (1) | 5.9 (11) | 1.5 (2) | 0.83 (0.7) | 1.3 (2) | 2.8 (3) | 3.8 (3) | 15/15 |
| xNESas schaul noiseless | 1.1 (0.8) | 2.4 (0.6) | 0.72 (0.0) | 0.43 (0.7) | 0.61 (0.2) | 1.5 (2) | 2.4 (2) | 15/15 |
| Δ fopt f19, 3-D |
1e1 1 |
1e0 1 |
1e-1 109 |
1e-2 6764 |
1e-3 7367 |
1e-5 7399 |
1e-7 7441 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 4.3 (4) | 170 (152) | 31 (8) | 3.8 (5) | 13 (14) | 14 (24) | 15 (14) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 10 (10) | 140 (86) | 38 (42) | 2.7 (2) | 3.9 (4) | 3.9 (3) | 3.9 (2) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 8.4 (17) | 424 (531) | 31 (58) | 1.6 (3) | 1.8 (2) | 1.8 (3) | 1.8 (0.4) | 15/15 |
| CMAES posik noiseless | 10 (20) | 312 (567) | 50 (114) | 3.4 (5) | 7.6 (10) | 7.6 (21) | 7.6 (11) | 13/15 |
| CMA brockhoff noiseless | 7.7 (8) | 203 (56) | 132 (172) | 9.1 (10) | 8.4 (8) | 8.5 (8) | 8.5 (9) | 15/15 |
| CMAa brockhoff noiseless | 7.3 (7) | 109 (69) | 88 (163) | 4.4 (5) | 4.4 (8) | 4.5 (3) | 4.5 (3) | 15/15 |
| CMAm brockhoff noiseless | 10 (9) | 493 (395) | 154 (403) | 9.1 (7) | 8.9 (7) | 8.9 (5) | 8.9 (10) | 15/15 |
| CMAma brockhoff noiseless | 5.7 (7) | 382 (675) | 60 (20) | 5.3 (7) | 5.6 (7) | 5.6 (9) | 5.6 (4) | 15/15 |
| CMAmah brockhoff noiseless | 5.3 (6) | 168 (189) | 228 (685) | 6.3 (3) | 6.1 (5) | 6.2 (4) | 6.2 (14) | 15/15 |
| CMAmh brockhoff noiseless | 6.4 (6) | 325 (647) | 102 (130) | 3.5 (0.8) | 4.5 (5) | 4.5 (5) | 4.5 (4) | 15/15 |
| DBRCGA chuang noiseless | 12 (10) | 235 (99) | 38 (67) | 10 (9) | 19 (39) | 19 (33) | 19 (33) | 12/15 |
| DE-AUTO voglis noiseless | 4.1 (4) | 1701 (1028) | 81 (68) | 4.9 (4) | 15 (15) | 15 (13) | 19 (19) | 12/15 |
| DE-BFGS voglis noiseless | 18 (18) | 310 (302) | 19 (21) | 1.7 (1) | 11 (13) | 11 (18) | 18 (19) | 7/15 |
| DE-ROLL voglis noiseless | 10 (7) | 879 (1188) | 72 (70) | 12 (11) | 22 (34) | 22 (24) | 35 (45) | 6/15 |
| DE-SIMPLEX voglis noiseless | 12 (8) | 685 (220) | 32 (37) | 3.1 (5) | 9.4 (16) | 9.4 (27) | 9.3 (21) | 14/15 |
| DEAE posik noiseless | 5.6 (7) | 253 (220) | 25 (23) | 6.4 (17) | 10 (9) | 10 (11) | 10 (10) | 11/15 |
| DE posik noiseless | 14 (17) | 276 (199) | 36 (30) | 2.5 (3) | 5.1 (4) | 5.2 (6) | 5.2 (14) | 14/15 |
| DEb posik noiseless | 14 (17) | 276 (132) | 36 (19) | 2.5 (3) | 5.1 (12) | 5.2 (7) | 5.2 (2) | 14/15 |
| DEctpb posik noiseless | 10 (8) | 279 (320) | 24 (15) | 1.3 (1) | 1.6 (2) | 2.1 (1.0) | 2.2 (1.0) | 15/15 |
| IPOPsaACM loshchilov noiseless | 8.1 (6) | 268 (379) | 138 (213) | 4.5 (7) | 5.3 (6) | 5.4 (6) | 5.4 (2) | 15/15 |
| JADE posik noiseless | 13 (20) | 166 (426) | 27 (22) | 2.9 (2) | 3.0 (1) | 3.2 (0.7) | 3.3 (1) | 14/15 |
| JADEb posik noiseless | 12 (8) | 159 (148) | 20 (15) | 1.4 (1) | 4.0 (10) | 4.7 (7) | 4.7 (16) | 13/15 |
| JADEctpb posik noiseless | 13 (11) | 166 (265) | 27 (23) | 2.9 (7) | 3.0 (11) | 3.2 (6) | 3.3 (5) | 14/15 |
| MVDE melo noiseless | 10 (12) | 387 (273) | 30 (37) | 25 (38) | 70 (68) | 71 (102) | 71 (101) | 10/15 |
| NBIPOPaCMA loshchilov noiseless | 9.2 (5) | 174 (278) | 41 (50) | 2.9 (2) | 3.4 (8) | 3.4 (8) | 3.4 (3) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 11 (5) | 114 (74) | 110 (275) | 10 (13) | 13 (18) | 13 (20) | 13 (10) | 15/15 |
| PSO-BFGS voglis noiseless | 8.4 (8) | 491 (279) | 41 (40) | 2.6 (4) | 2.9 (4) | 2.9 (4) | 14 (32) | 9/15 |
| SNES schaul noiseless | 9.1 (9) | 264 (35) | 28 (35) | 3.3 (3) | 8.1 (4) | 16 (16) | 23 (19) | 11/15 |
| xNES schaul noiseless | 7.5 (3) | 137 (215) | 41 (84) | 3.3 (4) | 5.5 (4) | 5.8 (7) | 5.8 (8) | 15/15 |
| xNESas schaul noiseless | 8.3 (12) | 526 (1574) | 63 (89) | 8.6 (10) | 10 (7) | 14 (7) | 14 (17) | 14/15 |
| Δ fopt f20, 3-D |
1e1 8.0 |
1e0 385 |
1e-1 2291 |
1e-2 2398 |
1e-3 2481 |
1e-5 2573 |
1e-7 2776 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 4.2 (4) | 1.5 (0.8) | 2.3 (0.3) | 2.4 (0.3) | 2.3 (6) | 2.3 (5) | 2.2 (0.3) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 1.4 (1) | 5.6 (7) | 6.0 (5) | 6.3 (6) | 6.2 (8) | 6.1 (3) | 5.8 (4) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 3.0 (2) | 2.7 (7) | 3.7 (3) | 3.7 (4) | 3.6 (4) | 3.5 (3) | 3.3 (3) | 15/15 |
| CMAES posik noiseless | 2.6 (3) | 7.1 (4) | 17 (10) | 17 (9) | 16 (16) | 16 (18) | 14 (15) | 15/15 |
| CMA brockhoff noiseless | 2.9 (5) | 5.5 (6) | 5.2 (3) | 5.5 (5) | 5.5 (4) | 5.5 (4) | 5.3 (3) | 15/15 |
| CMAa brockhoff noiseless | 3.1 (3) | 6.5 (8) | 6.7 (7) | 6.8 (5) | 6.7 (6) | 6.7 (5) | 6.4 (3) | 15/15 |
| CMAm brockhoff noiseless | 3.2 (5) | 7.3 (9) | 6.0 (4) | 6.1 (5) | 6.1 (5) | 6.1 (3) | 5.8 (4) | 15/15 |
| CMAma brockhoff noiseless | 1.9 (2) | 7.3 (2) | 6.7 (3) | 7.1 (6) | 7.1 (6) | 7.1 (4) | 6.8 (3) | 15/15 |
| CMAmah brockhoff noiseless | 2.0 (2) | 5.9 (7) | 6.7 (3) | 7.0 (5) | 7.0 (4) | 7.0 (3) | 6.7 (6) | 15/15 |
| CMAmh brockhoff noiseless | 2.3 (0.7) | 6.0 (5) | 7.0 (4) | 7.1 (4) | 7.2 (8) | 7.2 (8) | 6.8 (8) | 15/15 |
| DBRCGA chuang noiseless | 5.6 (2) | 2.2 (0.7) | 4.5 (4) | 4.4 (3) | 4.4 (5) | 4.4 (4) | 4.2 (4) | 15/15 |
| DE-AUTO voglis noiseless | 2.9 (3) | 6.1 (4) | 13 (20) | 12 (18) | 12 (17) | 12 (9) | 11 (10) | 15/15 |
| DE-BFGS voglis noiseless | 5.3 (2) | 2.0 (2) | 14 (27) | 13 (9) | 12 (17) | 12 (16) | 11 (15) | 15/15 |
| DE-ROLL voglis noiseless | 4.1 (4) | 4.3 (5) | 29 (57) | 28 (55) | 27 (62) | 26 (64) | 24 (59) | 14/15 |
| DE-SIMPLEX voglis noiseless | 3.6 (3) | 3.6 (4) | 41 (33) | 39 (42) | 38 (29) | 36 (38) | 34 (40) | 15/15 |
| DEAE posik noiseless | 3.0 (2) | 2.1 (3) | 3.6 (4) | 3.5 (4) | 3.4 (3) | 3.4 (2) | 3.2 (3) | 15/15 |
| DE posik noiseless | 5.0 (2) | 1.6 (2) | 1.5 (3) | 1.6 (2) | 1.6 (1) | 1.6 (4) | 1.6 (1) | 15/15 |
| DEb posik noiseless | 5.0 (3) | 1.6 (0.7) | 1.5 (1) | 1.6 (3) | 1.6 (0.8) | 1.6 (1) | 1.6 (2) | 15/15 |
| DEctpb posik noiseless | 3.1 (6) | 1.7 (0.3) | 1.4 (1) | 1.5 (1) | 1.5 (1) | 1.7 (2) | 1.7 (1) | 15/15 |
| IPOPsaACM loshchilov noiseless | 2.3 (2) | 3.0 (5) | 2.4 (2) | 2.6 (3) | 2.6 (1) | 2.5 (2) | 2.3 (2) | 15/15 |
| JADE posik noiseless | 3.1 (3) | 1.1 (0.8) | 1.2 (2) | 1.4 (1.0) | 1.4 (1) | 1.4 (0.9) | 1.4 (0.9) | 15/15 |
| JADEb posik noiseless | 3.0 (3) | 1.7 (2) | 2.0 (2) | 2.0 (1) | 1.9 (1) | 1.9 (1) | 1.8 (1) | 15/15 |
| JADEctpb posik noiseless | 3.1 (2) | 1.1 (0.6) | 1.2 (0.2) | 1.4 (1) | 1.4 (1) | 1.4 (1) | 1.4 (1) | 15/15 |
| MVDE melo noiseless | 5.6 (6) | 2.2 (2) | 110 (219) | 106 (209) | 103 (202) | 99 (292) | 93 (91) | 12/15 |
| NBIPOPaCMA loshchilov noiseless | 3.7 (2) | 3.2 (4) | 8.0 (6) | 8.0 (6) | 8.0 (8) | 7.9 (5) | 7.6 (3) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.0 (2) | 3.4 (4) | 6.6 (9) | 6.6 (7) | 6.7 (7) | 6.6 (6) | 6.4 (10) | 15/15 |
| PSO-BFGS voglis noiseless | 6.2 (3) | 2.4 (2) | 7.9 (4) | 7.6 (12) | 7.3 (11) | 7.1 (13) | 6.6 (11) | 15/15 |
| SNES schaul noiseless | 1.9 (1) | 8.9 (11) | 10 (6) | 10 (9) | 9.3 (5) | 9.0 (6) | 8.4 (13) | 15/15 |
| xNES schaul noiseless | 2.0 (2) | 14 (14) | 19 (20) | 21 (20) | 20 (20) | 20 (11) | 18 (13) | 15/15 |
| xNESas schaul noiseless | 3.1 (3) | 7.6 (8) | 12 (6) | 14 (10) | 14 (12) | 13 (16) | 12 (18) | 15/15 |
| Δ fopt f21, 3-D |
1e1 6.0 |
1e0 184 |
1e-1 425 |
1e-2 439 |
1e-3 458 |
1e-5 469 |
1e-7 482 |
#succ 14/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1.5 (0.5) | 112 (2) | 57 (61) | 56 (59) | 54 (222) | 53 (29) | 52 (54) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 1.3 (2) | 7.9 (33) | 11 (18) | 11 (17) | 16 (12) | 16 (30) | 16 (9) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.3 (2) | 3.4 (7) | 7.2 (8) | 7.4 (5) | 7.5 (18) | 7.5 (18) | 7.4 (18) | 15/15 |
| CMAES posik noiseless | 1.8 (3) | 9.1 (8) | 11 (14) | 11 (12) | 10 (13) | 10 (13) | 10 (13) | 15/15 |
| CMA brockhoff noiseless | 1.3 (1) | 7.3 (12) | 6.1 (12) | 6.7 (3) | 6.6 (16) | 7.1 (23) | 7.0 (15) | 15/15 |
| CMAa brockhoff noiseless | 2.3 (3) | 4.0 (6) | 5.5 (6) | 7.1 (4) | 15 (6) | 15 (5) | 15 (17) | 15/15 |
| CMAm brockhoff noiseless | 1.2 (1) | 10 (12) | 49 (292) | 48 (14) | 46 (137) | 46 (134) | 45 (8) | 14/15 |
| CMAma brockhoff noiseless | 1.2 (0.8) | 8.3 (19) | 8.3 (3) | 12 (23) | 12 (11) | 12 (15) | 12 (23) | 15/15 |
| CMAmah brockhoff noiseless | 0.96 (1) | 6.0 (7) | 8.0 (9) | 8.2 (5) | 7.9 (23) | 8.8 (17) | 8.8 (8) | 15/15 |
| CMAmh brockhoff noiseless | 1.5 (3) | 4.7 (7) | 13 (48) | 14 (36) | 13 (36) | 14 (32) | 14 (15) | 15/15 |
| DBRCGA chuang noiseless | 1.4 (1) | 3.4 (9) | 4.4 (2) | 5.0 (12) | 5.1 (5) | 5.7 (9) | 6.1 (5) | 15/15 |
| DE-AUTO voglis noiseless | 1.8 (3) | 30 (12) | 71 (174) | 69 (78) | 66 (205) | 65 (200) | 63 (154) | 15/15 |
| DE-BFGS voglis noiseless | 1.1 (0.6) | 2.7 (7) | 8.1 (37) | 7.9 (22) | 7.6 (21) | 7.5 (5) | 17 (21) | 15/15 |
| DE-ROLL voglis noiseless | 1.7 (2) | 27 (52) | 48 (115) | 47 (53) | 45 (80) | 44 (104) | 43 (67) | 15/15 |
| DE-SIMPLEX voglis noiseless | 1.3 (1) | 11 (2) | 9.1 (20) | 9.0 (15) | 8.7 (14) | 8.5 (14) | 8.3 (18) | 15/15 |
| DEAE posik noiseless | 1.2 (1.0) | 5.5 (8) | 7.8 (6) | 8.0 (15) | 7.9 (5) | 8.0 (6) | 8.0 (5) | 15/15 |
| DE posik noiseless | 1.8 (2) | 3.5 (4) | 4.1 (6) | 4.4 (6) | 4.3 (5) | 4.7 (6) | 5.1 (3) | 15/15 |
| DEb posik noiseless | 1.8 (2) | 3.5 (5) | 4.1 (6) | 4.4 (5) | 4.3 (5) | 4.7 (5) | 5.1 (6) | 15/15 |
| DEctpb posik noiseless | 2.4 (4) | 1.8 (2) | 2.0 (4) | 2.5 (7) | 2.9 (7) | 3.6 (2) | 4.2 (4) | 15/15 |
| IPOPsaACM loshchilov noiseless | 1.4 (0.8) | 3.0 (2) | 6.7 (16) | 23 (73) | 38 (8) | 38 (125) | 37 (235) | 15/15 |
| JADE posik noiseless | 1.3 (0.9) | 4.5 (8) | 2.7 (4) | 3.0 (5) | 3.2 (3) | 3.6 (2) | 3.8 (3) | 15/15 |
| JADEb posik noiseless | 1.8 (2) | 8.1 (6) | 10 (14) | 9.4 (8) | 9.2 (9) | 9.2 (12) | 9.1 (15) | 15/15 |
| JADEctpb posik noiseless | 1.3 (0.9) | 4.5 (5) | 2.7 (5) | 3.0 (3) | 3.2 (4) | 3.6 (3) | 3.8 (4) | 15/15 |
| MVDE melo noiseless | 1.2 (1) | 4.2 (2) | 3.1 (4) | 4.7 (4) | 5.9 (4) | 10 (6) | 11 (4) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 2.1 (1) | 11 (34) | 24 (88) | 24 (61) | 23 (43) | 22 (22) | 22 (55) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 1.8 (2) | 21 (64) | 193 (135) | 193 (133) | 185 (423) | 182 (570) | 178 (402) | 15/15 |
| PSO-BFGS voglis noiseless | 1.5 (0.7) | 2.5 (6) | 3.7 (5) | 3.6 (5) | 3.5 (4) | 3.5 (5) | 45 (11) | 14/15 |
| SNES schaul noiseless | 1.9 (2) | 20 (44) | 18 (17) | 17 (26) | 17 (22) | 16 (20) | 16 (24) | 15/15 |
| xNES schaul noiseless | 1.4 (2) | 16 (12) | 36 (82) | 35 (31) | 34 (44) | 33 (53) | 33 (72) | 15/15 |
| xNESas schaul noiseless | 1.5 (1) | 43 (115) | 41 (72) | 39 (24) | 38 (19) | 37 (17) | 36 (44) | 15/15 |
| Δ fopt f22, 3-D |
1e1 18 |
1e0 170 |
1e-1 354 |
1e-2 362 |
1e-3 384 |
1e-5 401 |
1e-7 414 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 2.1 (2) | 141 (77) | 175 (637) | 173 (624) | 165 (68) | 159 (348) | 156 (184) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 4.6 (14) | 4.3 (5) | 32 (24) | 32 (6) | 30 (79) | 29 (21) | 28 (20) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.3 (6) | 4.1 (4) | 11 (25) | 12 (4) | 11 (16) | 11 (15) | 11 (15) | 15/15 |
| CMAES posik noiseless | 0.76 (0.5) | 9.5 (22) | 14 (18) | 14 (14) | 13 (17) | 13 (20) | 13 (14) | 15/15 |
| CMA brockhoff noiseless | 1.6 (1) | 2.8 (4) | 47 (29) | 232 (169) | 335 (655) | 415 (916) | 481 (785) | 9/15 |
| CMAa brockhoff noiseless | 4.6 (1) | 14 (11) | 32 (50) | 137 (176) | 315 (605) | 461 (319) | 447 (606) | 9/15 |
| CMAm brockhoff noiseless | 4.1 (11) | 13 (8) | 60 (32) | 74 (31) | 128 (497) | 335 (621) | 325 (293) | 10/15 |
| CMAma brockhoff noiseless | 4.8 (5) | 12 (19) | 60 (122) | 189 (408) | 198 (267) | 406 (513) | 395 (238) | 10/15 |
| CMAmah brockhoff noiseless | 3.7 (0.4) | 11 (33) | 24 (13) | 102 (71) | 234 (382) | 288 (469) | 282 (613) | 11/15 |
| CMAmh brockhoff noiseless | 3.3 (0.9) | 3.9 (4) | 17 (8) | 34 (63) | 57 (188) | 175 (524) | 246 (620) | 11/15 |
| DBRCGA chuang noiseless | 1.6 (2) | 1.8 (2) | 3.2 (2) | 4.0 (9) | 4.3 (4) | 5.2 (8) | 6.1 (4) | 15/15 |
| DE-AUTO voglis noiseless | 1.2 (1) | 16 (15) | 105 (213) | 102 (5) | 96 (151) | 93 (252) | 91 (244) | 15/15 |
| DE-BFGS voglis noiseless | 1.0 (1) | 3.2 (4) | 2.7 (3) | 2.7 (4) | 2.6 (2) | 2.6 (3) | 19 (23) | 15/15 |
| DE-ROLL voglis noiseless | 1.5 (1) | 11 (17) | 90 (431) | 89 (30) | 85 (396) | 87 (60) | 123 (300) | 14/15 |
| DE-SIMPLEX voglis noiseless | 1.4 (2) | 18 (24) | 20 (21) | 20 (19) | 18 (20) | 18 (17) | 17 (17) | 15/15 |
| DEAE posik noiseless | 1.8 (3) | 3.0 (15) | 4.5 (17) | 5.0 (10) | 4.9 (10) | 5.2 (0.8) | 5.3 (3) | 15/15 |
| DE posik noiseless | 2.0 (2) | 2.1 (5) | 4.5 (2) | 4.8 (0.6) | 5.2 (8) | 5.7 (9) | 6.2 (6) | 15/15 |
| DEb posik noiseless | 2.0 (3) | 2.1 (0.9) | 4.5 (11) | 4.8 (1.0) | 5.2 (0.9) | 5.7 (4) | 6.2 (0.8) | 15/15 |
| DEctpb posik noiseless | 1.7 (2) | 2.2 (2) | 6.8 (6) | 7.9 (16) | 8.0 (14) | 9.2 (14) | 10 (8) | 15/15 |
| IPOPsaACM loshchilov noiseless | 1.4 (2) | 5.3 (5) | 17 (29) | 37 (35) | 101 (259) | 100 (193) | 98 (241) | 15/15 |
| JADE posik noiseless | 1.5 (2) | 4.5 (9) | 4.4 (8) | 4.8 (6) | 4.8 (5) | 5.3 (3) | 5.8 (3) | 15/15 |
| JADEb posik noiseless | 15 (31) | 5.1 (8) | 5.6 (11) | 5.7 (3) | 5.5 (4) | 5.5 (11) | 5.8 (10) | 15/15 |
| JADEctpb posik noiseless | 1.5 (3) | 4.5 (9) | 4.4 (6) | 4.8 (4) | 4.8 (4) | 5.3 (4) | 5.8 (6) | 15/15 |
| MVDE melo noiseless | 1.1 (0.6) | 2.0 (2) | 2.5 (2) | 5.0 (2) | 6.8 (4) | 11 (7) | 16 (7) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 12 (28) | 21 (47) | 16 (14) | 19 (24) | 18 (27) | 17 (13) | 17 (19) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 8.1 (24) | 19 (13) | 207 (663) | 211 (211) | 210 (630) | 205 (566) | 202 (593) | 15/15 |
| PSO-BFGS voglis noiseless | 4.5 (5) | 2.2 (3) | 2.7 (2) | 2.7 (3) | 2.5 (2) | 2.7 (3) | 65 (56) | 12/15 |
| SNES schaul noiseless | 13 (3) | 25 (14) | 39 (43) | 45 (44) | 50 (27) | 69 (56) | 90 (69) | 15/15 |
| xNES schaul noiseless | 18 (64) | 28 (44) | 36 (67) | 37 (41) | 35 (64) | 33 (70) | 33 (37) | 15/15 |
| xNESas schaul noiseless | 14 (48) | 29 (8) | 68 (68) | 74 (172) | 70 (162) | 67 (89) | 65 (40) | 15/15 |
| Δ fopt f23, 3-D |
1e1 3.0 |
1e0 407 |
1e-1 906 |
1e-2 1215 |
1e-3 2214 |
1e-5 2293 |
1e-7 2393 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 3.6 (3) | 19 (18) | 2.2e4 (2e4) | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 4.1 (2) | 4.4 (2) | 5.2 (5) | 4.5 (4) | 2.6 (2) | 2.6 (2) | 2.9 (2) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 6.8 (7) | 5.9 (4) | 5.8 (3) | 5.8 (7) | 4.9 (9) | 4.8 (9) | 5.1 (3) | 15/15 |
| CMAES posik noiseless | 2.4 (2) | 7.0 (6) | 14 (13) | 12 (16) | 6.5 (8) | 6.8 (6) | 6.6 (10) | 15/15 |
| CMA brockhoff noiseless | 4.2 (4) | 8.0 (6) | 13 (8) | 10 (13) | 5.8 (3) | 5.8 (7) | 5.7 (4) | 15/15 |
| CMAa brockhoff noiseless | 2.1 (2) | 8.5 (5) | 11 (14) | 8.8 (7) | 4.9 (7) | 5.0 (5) | 5.0 (6) | 15/15 |
| CMAm brockhoff noiseless | 4.3 (7) | 5.9 (7) | 113 (16) | 84 (127) | 46 (72) | 45 (201) | 43 (191) | 13/15 |
| CMAma brockhoff noiseless | 5.1 (3) | 5.3 (4) | 7.6 (5) | 5.8 (3) | 3.3 (2) | 3.4 (4) | 3.4 (1) | 15/15 |
| CMAmah brockhoff noiseless | 4.1 (2) | 5.0 (4) | 60 (17) | 45 (7) | 25 (6) | 24 (6) | 23 (7) | 14/15 |
| CMAmh brockhoff noiseless | 4.1 (6) | 13 (9) | 16 (19) | 12 (13) | 6.9 (6) | 8.4 (7) | 8.3 (6) | 15/15 |
| DBRCGA chuang noiseless | 3.5 (3) | 9.3 (11) | 102 (106) | 96 (115) | 53 (77) | 52 (47) | 50 (29) | 14/15 |
| DE-AUTO voglis noiseless | 2.2 (0.8) | 2.5 (4) | 4.4 (7) | 3.9 (4) | 2.9 (5) | 2.8 (3) | 2.8 (4) | 15/15 |
| DE-BFGS voglis noiseless | 1.9 (2) | 1.9 (2) | 3.4 (6) | 3.6 (2) | 3.1 (6) | 6.1 (8) | 281 (406) | 2/15 |
| DE-ROLL voglis noiseless | 3.0 (2) | 3.2 (5) | 17 (27) | 49 (89) | 32 (44) | 33 (72) | 126 (137) | 1/15 |
| DE-SIMPLEX voglis noiseless | 1.8 (2) | 0.66 (0.8) | 1.2 (2) | 0.98 (1) | 0.66 (0.7) | 5.9 (3) | 354 (353) | 1/15 |
| DEAE posik noiseless | 2.4 (1) | 16 (13) | 64 (57) | 49 (14) | 34 (29) | 33 (37) | 32 (19) | 13/15 |
| DE posik noiseless | 3.0 (3) | 20 (14) | 80 (75) | 63 (87) | 35 (19) | 42 (22) | 40 (55) | 11/15 |
| DEb posik noiseless | 3.0 (2) | 20 (12) | 80 (66) | 63 (46) | 35 (28) | 42 (22) | 40 (28) | 11/15 |
| DEctpb posik noiseless | 3.2 (7) | 21 (12) | 353 (309) | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| IPOPsaACM loshchilov noiseless | 4.8 (11) | 7.5 (3) | 11 (8) | 8.0 (7) | 4.5 (4) | 4.5 (3) | 4.4 (4) | 15/15 |
| JADE posik noiseless | 2.4 (2) | 10 (5) | 22 (20) | 16 (14) | 10 (9) | 10 (4) | 10 (9) | 15/15 |
| JADEb posik noiseless | 2.8 (2) | 7.3 (9) | 25 (18) | 28 (27) | 21 (45) | 21 (19) | 20 (19) | 14/15 |
| JADEctpb posik noiseless | 2.4 (1) | 10 (4) | 22 (19) | 16 (8) | 10 (4) | 10 (8) | 10 (7) | 15/15 |
| MVDE melo noiseless | 3.6 (4) | 11 (10) | 1018 (1396) | 1.2e4 (2e4) | 6369 (7679) | 6156 (7196) | 5902 (5537) | 1/15 |
| NBIPOPaCMA loshchilov noiseless | 4.0 (8) | 4.2 (4) | 4.6 (1) | 3.7 (4) | 2.1 (3) | 2.4 (3) | 3.2 (3) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.7 (4) | 11 (5) | 10 (11) | 8.6 (7) | 4.8 (4) | 4.9 (1) | 4.9 (4) | 15/15 |
| PSO-BFGS voglis noiseless | 3.1 (1) | 1.4 (1) | 4.4 (5) | 6.9 (3) | 8.8 (12) | 88 (132) | ∞3e5 | 0/15 |
| SNES schaul noiseless | 3.2 (5) | 13 (10) | 80 (191) | 302 (299) | 380 (287) | 525 (412) | 503 (471) | 3/15 |
| xNES schaul noiseless | 3.6 (3) | 16 (24) | 280 (266) | 440 (253) | 328 (436) | 318 (451) | 437 (305) | 3/15 |
| xNESas schaul noiseless | 4.3 (8) | 16 (18) | 271 (206) | 229 (246) | 186 (149) | 217 (291) | 256 (199) | 0/15 |
| Δ fopt f24, 3-D |
1e1 97 |
1e0 10391 |
1e-1 1.0e5 |
1e-2 3.6e5 |
1e-3 3.6e5 |
1e-5 3.6e5 |
1e-7 3.6e5 |
#succ 2/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 2.9 (3) | 341 (319) | 37 (30) | 12 (12) | 12 (15) | 12 (16) | 12 (15) | 13/15 |
| BIPOPaCMA loshchilov noiseless | 1.6 (2) | 3.1 (4) | 11 (7) | 4.3 (4) | 4.8 (3) | 4.8 (4) | 5.7 (6) | 12/15 |
| BIPOPsaACM loshchilov noiseless | 1.6 (1) | 6.8 (9) | 7.2 (11) | 5.6 (6) | 5.6 (5) | 5.7 (9) | 5.9 (11) | 11/15 |
| CMAES posik noiseless | 3.5 (1) | 3.5 (3) | 6.1 (6) | 2.8 (5) | 2.8 (3) | 2.8 (2) | 2.8 (4) | 2/15 |
| CMA brockhoff noiseless | 1.5 (1) | 117 (102) | ∞ | ∞ | ∞ | ∞ | ∞6e5 | 0/15 |
| CMAa brockhoff noiseless | 1.7 (2) | 116 (217) | ∞ | ∞ | ∞ | ∞ | ∞6e5 | 0/15 |
| CMAm brockhoff noiseless | 2.6 (2) | 67 (101) | 38 (37) | 11 (16) | 11 (21) | 11 (11) | 11 (11) | 2/15 |
| CMAma brockhoff noiseless | 2.4 (4) | 232 (303) | ∞ | ∞ | ∞ | ∞ | ∞6e5 | 0/15 |
| CMAmah brockhoff noiseless | 1.1 (0.8) | 88 (247) | 38 (67) | ∞ | ∞ | ∞ | ∞6e5 | 0/15 |
| CMAmh brockhoff noiseless | 2.9 (3) | 160 (231) | ∞ | ∞ | ∞ | ∞ | ∞6e5 | 0/15 |
| DBRCGA chuang noiseless | 3.9 (3) | 4.6 (5) | 5.9 (2) | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| DE-AUTO voglis noiseless | 26 (16) | 64 (78) | 6.8 (8) | 2.0 (2) | 2.0 (4) | 2.0 (1) | 2.0 (1) | 5/15 |
| DE-BFGS voglis noiseless | 2.5 (2) | 8.4 (11) | 0.89 (0.8) | 0.26 (0.5) | 0.26 (0.3) | 0.26 (0.2) | 0.26 (0.4) | 14/15 |
| DE-ROLL voglis noiseless | 33 (36) | 62 (65) | 6.9 (8) | 2.0 (1) | 2.0 (3) | 2.0 (2) | 2.6 (3) | 4/15 |
| DE-SIMPLEX voglis noiseless | 3.4 (4) | 21 (40) | 2.2 (3) | 0.65 (0.6) | 0.65 (1) | 0.65 (0.4) | 0.65 (0.4) | 10/15 |
| DEAE posik noiseless | 2.5 (2) | 3.5 (4) | 2.9 (6) | 2.8 (2) | 2.8 (2) | 2.8 (4) | 2.8 (6) | 2/15 |
| DE posik noiseless | 3.2 (2) | 5.3 (3) | 6.6 (6) | 6.3 (6) | 6.3 (7) | 6.3 (4) | 6.3 (5) | 1/15 |
| DEb posik noiseless | 3.2 (2) | 5.3 (7) | 6.6 (5) | 6.3 (7) | 6.3 (2) | 6.3 (10) | 6.3 (6) | 1/15 |
| DEctpb posik noiseless | 3.0 (2) | 21 (18) | 4.6 (2) | 2.9 (4) | 2.9 (6) | 3.0 (4) | 3.0 (3) | 2/15 |
| IPOPsaACM loshchilov noiseless | 2.3 (3) | 402 (737) | 433 (482) | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| JADE posik noiseless | 2.7 (1) | 2.2 (3) | 1.1 (0.8) | 0.66 (2) | 0.66 (1) | 0.66 (0.8) | 0.66 (0.6) | 7/15 |
| JADEb posik noiseless | 4.5 (9) | 1.4 (0.7) | 2.3 (3) | 3.0 (5) | 3.0 (3) | 3.0 (4) | 3.0 (4) | 2/15 |
| JADEctpb posik noiseless | 2.7 (1) | 2.2 (3) | 1.1 (2) | 0.66 (0.9) | 0.66 (0.6) | 0.66 (0.7) | 0.66 (0.6) | 7/15 |
| MVDE melo noiseless | 4.4 (4) | 1348 (1708) | 137 (100) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 1.4 (0.6) | 7.1 (2) | 5.9 (6) | 4.3 (3) | 4.3 (3) | 4.3 (7) | 4.3 (7) | 12/15 |
| NIPOPaCMA loshchilov noiseless | 3.9 (3) | 35 (35) | 5.6 (8) | 3.7 (4) | 3.9 (5) | 3.9 (4) | 3.9 (2) | 12/15 |
| PSO-BFGS voglis noiseless | 1.4 (2) | 1.3 (1.0) | 0.44 (0.3) | 0.24 (0.1) | 0.24 (0.2) | 0.24 (0.2) | 0.24 (0.1) | 15/15 |
| SNES schaul noiseless | 1.9 (1) | 4.0 (3) | 13 (24) | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| xNES schaul noiseless | 2.6 (5) | 3.0 (3) | 7.6 (5) | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| xNESas schaul noiseless | 1.6 (0.5) | 4.7 (5) | 29 (29) | 18 (20) | 18 (15) | 18 (10) | 18 (15) | 1/15 |
Previous dimension | Dimension = 5 | Next dimension
| Δ fopt f1, 5-D |
1e1 11 |
1e0 12 |
1e-1 12 |
1e-2 12 |
1e-3 12 |
1e-5 12 |
1e-7 12 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 4.7 (5) | 15 (5) | 26 (3) | 36 (4) | 47 (6) | 69 (7) | 92 (6) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 3.4 (2) | 8.3 (3) | 16 (2) | 22 (3) | 29 (5) | 41 (4) | 54 (5) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.7 (2) | 6.6 (2) | 8.9 (0.7) | 10 (1.0) | 12 (1) | 16 (1) | 19 (1) | 15/15 |
| CMAES posik noiseless | 2.3 (2) | 8.7 (3) | 15 (5) | 22 (5) | 28 (4) | 41 (5) | 53 (6) | 15/15 |
| CMA brockhoff noiseless | 2.6 (2) | 10 (3) | 16 (3) | 21 (3) | 28 (5) | 41 (5) | 55 (7) | 15/15 |
| CMAa brockhoff noiseless | 2.5 (2) | 8.2 (4) | 15 (4) | 21 (5) | 26 (5) | 39 (4) | 52 (8) | 15/15 |
| CMAm brockhoff noiseless | 2.8 (2) | 7.7 (3) | 12 (3) | 17 (4) | 22 (6) | 31 (5) | 42 (6) | 15/15 |
| CMAma brockhoff noiseless | 2.7 (2) | 7.4 (3) | 11 (3) | 17 (5) | 22 (4) | 31 (6) | 40 (6) | 15/15 |
| CMAmah brockhoff noiseless | 1.7 (1) | 5.0 (1) | 8.2 (1) | 12 (2) | 16 (3) | 24 (2) | 31 (3) | 15/15 |
| CMAmh brockhoff noiseless | 1.8 (1) | 5.2 (3) | 9.3 (2) | 13 (3) | 17 (4) | 25 (4) | 32 (4) | 15/15 |
| DBRCGA chuang noiseless | 5.1 (12) | 50 (33) | 97 (45) | 146 (8) | 201 (11) | 306 (40) | 423 (20) | 15/15 |
| DE-AUTO voglis noiseless | 3.3 (2) | 5.9 (0.6) | 6.0 (0.4) | 6.1 (0.2) | 6.1 (0.2) | 6.1 (0.3) | 6.1 (0.2) | 15/15 |
| DE-BFGS voglis noiseless | 3.3 (1) | 5.0 (0.2) | 5.0 (0.1) | 5.0 (0) | 5.0 (0.1) | 5.0 (0.1) | 5.0 (0) | 15/15 |
| DE-ROLL voglis noiseless | 3.3 (2) | 18 (22) | 19 (12) | 19 (21) | 19 (1) | 19 (21) | 19 (21) | 15/15 |
| DE-SIMPLEX voglis noiseless | 2.8 (2) | 6.8 (2) | 10 (4) | 12 (5) | 15 (1) | 19 (3) | 23 (2) | 15/15 |
| DEAE posik noiseless | 5.1 (6) | 23 (9) | 43 (10) | 65 (6) | 83 (9) | 126 (8) | 169 (10) | 15/15 |
| DE posik noiseless | 5.0 (5) | 21 (6) | 39 (10) | 61 (12) | 83 (8) | 124 (10) | 167 (9) | 15/15 |
| DEb posik noiseless | 5.0 (3) | 21 (8) | 39 (15) | 61 (8) | 83 (7) | 124 (9) | 167 (11) | 15/15 |
| DEctpb posik noiseless | 5.8 (3) | 26 (9) | 46 (11) | 70 (17) | 93 (13) | 141 (11) | 186 (7) | 15/15 |
| IPOPsaACM loshchilov noiseless | 3.0 (2) | 7.0 (2) | 8.8 (0.7) | 10 (1) | 12 (2) | 15 (1) | 18 (1) | 15/15 |
| JADE posik noiseless | 4.1 (3) | 18 (6) | 37 (10) | 57 (7) | 78 (9) | 117 (11) | 157 (8) | 15/15 |
| JADEb posik noiseless | 3.4 (2) | 14 (6) | 27 (4) | 36 (2) | 51 (8) | 77 (7) | 105 (11) | 15/15 |
| JADEctpb posik noiseless | 4.1 (4) | 18 (6) | 37 (3) | 57 (7) | 78 (8) | 117 (9) | 157 (8) | 15/15 |
| MVDE melo noiseless | 6.4 (8) | 46 (15) | 104 (13) | 160 (13) | 224 (23) | 334 (21) | 458 (24) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 2.4 (1) | 8.5 (2) | 15 (2) | 21 (2) | 28 (4) | 39 (3) | 51 (3) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.7 (2) | 7.5 (1) | 14 (2) | 20 (4) | 26 (3) | 37 (3) | 51 (5) | 15/15 |
| PSO-BFGS voglis noiseless | 3.1 (2) | 5.2 (0.1) | 5.2 (0.1) | 5.2 (0) | 5.2 (0.2) | 5.2 (0.2) | 5.2 (0.2) | 15/15 |
| SNES schaul noiseless | 4.3 (3) | 8.0 (3) | 15 (6) | 24 (4) | 34 (5) | 51 (4) | 69 (4) | 15/15 |
| xNES schaul noiseless | 3.0 (2) | 6.4 (4) | 21 (2) | 34 (8) | 50 (6) | 82 (6) | 111 (8) | 15/15 |
| xNESas schaul noiseless | 2.9 (2) | 6.7 (2) | 16 (4) | 28 (7) | 38 (4) | 61 (15) | 79 (9) | 15/15 |
| Δ fopt f2, 5-D |
1e1 83 |
1e0 87 |
1e-1 88 |
1e-2 89 |
1e-3 90 |
1e-5 92 |
1e-7 94 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 6.1 (0.6) | 7.5 (0.6) | 8.7 (0.6) | 10 (0.8) | 12 (1.0) | 14 (0.7) | 17 (0.8) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 10 (4) | 12 (1) | 13 (0.9) | 14 (3) | 15 (2) | 16 (2) | 18 (1) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 3.2 (0.6) | 3.5 (0.5) | 3.7 (0.5) | 3.9 (0.6) | 4.1 (0.4) | 4.6 (0.6) | 4.9 (0.3) | 15/15 |
| CMAES posik noiseless | 16 (4) | 17 (2) | 18 (1) | 19 (2) | 20 (1) | 21 (1) | 22 (2) | 15/15 |
| CMA brockhoff noiseless | 14 (3) | 16 (4) | 17 (5) | 19 (3) | 20 (3) | 22 (3) | 23 (2) | 15/15 |
| CMAa brockhoff noiseless | 11 (2) | 12 (2) | 13 (1) | 14 (2) | 14 (1) | 16 (0.9) | 17 (1) | 15/15 |
| CMAm brockhoff noiseless | 13 (5) | 16 (4) | 17 (3) | 18 (2) | 19 (2) | 20 (1) | 21 (1) | 15/15 |
| CMAma brockhoff noiseless | 11 (2) | 13 (1) | 14 (2) | 15 (1) | 15 (0.8) | 16 (1) | 17 (1) | 15/15 |
| CMAmah brockhoff noiseless | 13 (3) | 15 (3) | 15 (1) | 16 (2) | 16 (3) | 17 (2) | 17 (2) | 15/15 |
| CMAmh brockhoff noiseless | 16 (5) | 18 (4) | 21 (3) | 21 (3) | 21 (2) | 22 (2) | 23 (2) | 15/15 |
| DBRCGA chuang noiseless | 27 (3) | 33 (5) | 41 (6) | 47 (7) | 54 (5) | 67 (6) | 81 (9) | 15/15 |
| DE-AUTO voglis noiseless | 1.4 (0.2) | 1.5 (0.4) | 1.6 (0.2) | 1.6 (0.4) | 1.8 (0.4) | 1.9 (0.4) | 2.1 (0.5) | 15/15 |
| DE-BFGS voglis noiseless | 1.4 (0.3) | 1.4 (0.7) | 1.6 (0.5) | 1.6 (0.2) | 1.7 (0.3) | 1.9 (0.3) | 2.0 (0.7) | 15/15 |
| DE-ROLL voglis noiseless | 5.1 (7) | 5.3 (6) | 5.4 (7) | 5.5 (3) | 5.5 (6) | 5.8 (3) | 5.9 (5) | 15/15 |
| DE-SIMPLEX voglis noiseless | 6.1 (5) | 10 (6) | 11 (6) | 11 (5) | 11 (9) | 12 (6) | 12 (5) | 15/15 |
| DEAE posik noiseless | 12 (3) | 14 (2) | 17 (4) | 19 (2) | 22 (2) | 27 (3) | 32 (3) | 15/15 |
| DE posik noiseless | 11 (1.0) | 13 (2) | 16 (1) | 18 (1) | 21 (2) | 27 (1) | 31 (1) | 15/15 |
| DEb posik noiseless | 11 (1) | 13 (2) | 16 (1) | 18 (1) | 21 (2) | 27 (1) | 31 (3) | 15/15 |
| DEctpb posik noiseless | 13 (0.9) | 16 (0.7) | 19 (2) | 21 (2) | 24 (2) | 30 (3) | 35 (3) | 15/15 |
| IPOPsaACM loshchilov noiseless | 3.6 (0.9) | 3.7 (0.7) | 4.1 (1.0) | 4.4 (0.8) | 4.6 (1) | 5.0 (1) | 5.3 (0.3) | 15/15 |
| JADE posik noiseless | 10 (1) | 12 (0.7) | 15 (1) | 18 (2) | 20 (2) | 26 (2) | 31 (2) | 15/15 |
| JADEb posik noiseless | 6.8 (3) | 8.5 (2) | 10 (0.9) | 12 (2) | 14 (2) | 18 (2) | 22 (2) | 15/15 |
| JADEctpb posik noiseless | 10 (1) | 12 (1) | 15 (1) | 18 (2) | 20 (2) | 26 (1) | 31 (2) | 15/15 |
| MVDE melo noiseless | 27 (3) | 34 (4) | 43 (3) | 49 (2) | 56 (4) | 70 (4) | 84 (2) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 11 (3) | 12 (3) | 14 (2) | 15 (0.8) | 15 (1) | 17 (1) | 18 (1) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 10 (3) | 12 (2) | 13 (2) | 14 (2) | 14 (1) | 16 (2) | 17 (2) | 15/15 |
| PSO-BFGS voglis noiseless | 1.7 (0.8) | 1.7 (0.6) | 1.8 (0.7) | 1.9 (0.7) | 1.9 (0.5) | 2.1 (0.7) | 2.3 (0.9) | 15/15 |
| SNES schaul noiseless | 5.0 (0.6) | 5.9 (1) | 7.0 (1) | 8.1 (0.5) | 9.2 (0.6) | 11 (0.8) | 13 (0.8) | 15/15 |
| xNES schaul noiseless | 8.7 (2) | 11 (1) | 12 (2) | 14 (2) | 16 (1) | 20 (1) | 23 (1) | 15/15 |
| xNESas schaul noiseless | 11 (3) | 14 (13) | 19 (18) | 25 (1) | 39 (59) | 43 (67) | 49 (48) | 15/15 |
| Δ fopt f3, 5-D |
1e1 716 |
1e0 1622 |
1e-1 1637 |
1e-2 1642 |
1e-3 1646 |
1e-5 1650 |
1e-7 1654 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1.7 (0.6) | 30 (80) | 241 (259) | 240 (227) | 240 (136) | 239 (274) | 239 (158) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 1.6 (0.2) | 12 (24) | 190 (298) | 190 (445) | 190 (395) | 190 (438) | 189 (390) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.1 (0.3) | 5.3 (5) | 264 (336) | 264 (500) | 263 (145) | 263 (439) | 264 (466) | 15/15 |
| CMAES posik noiseless | 1.7 (2) | 23 (24) | 293 (323) | 292 (381) | 292 (814) | 291 (181) | 290 (587) | 6/15 |
| CMA brockhoff noiseless | 1.4 (2) | 7.9 (6) | 718 (725) | 716 (714) | 715 (1649) | 713 (1089) | 712 (814) | 6/15 |
| CMAa brockhoff noiseless | 0.91 (0.3) | 30 (79) | 1333 (2163) | 1329 (847) | 1326 (1787) | 1324 (2034) | 1321 (1092) | 4/15 |
| CMAm brockhoff noiseless | 1.1 (1) | 7.0 (10) | 960 (1417) | 957 (1397) | 955 (474) | 953 (2317) | 951 (957) | 5/15 |
| CMAma brockhoff noiseless | 0.74 (0.8) | 39 (8) | 556 (503) | 555 (252) | 554 (956) | 553 (369) | 552 (1331) | 7/15 |
| CMAmah brockhoff noiseless | 2.4 (2) | 5.9 (5) | 3146 (3779) | 3136 (1674) | 3129 (2553) | 3121 (2896) | 3114 (2403) | 2/15 |
| CMAmh brockhoff noiseless | 1.7 (2) | 100 (669) | 1004 (1010) | 1001 (1648) | 999 (1410) | 997 (1815) | 995 (998) | 5/15 |
| DBRCGA chuang noiseless | 2.3 (0.9) | 8.0 (3) | 11 (6) | 11 (4) | 11 (4) | 12 (5) | 12 (3) | 15/15 |
| DE-AUTO voglis noiseless | 1.3 (1) | 11 (6) | 21 (9) | 20 (7) | 20 (14) | 20 (6) | 20 (24) | 15/15 |
| DE-BFGS voglis noiseless | 2.0 (2) | 3.7 (2) | 7.7 (4) | 7.6 (6) | 7.6 (7) | 7.6 (9) | 7.6 (7) | 15/15 |
| DE-ROLL voglis noiseless | 2.2 (1) | 4.4 (4) | 6.6 (5) | 6.6 (3) | 6.6 (4) | 6.6 (3) | 6.6 (4) | 15/15 |
| DE-SIMPLEX voglis noiseless | 4.1 (2) | 10 (7) | 19 (20) | 19 (9) | 19 (7) | 19 (13) | 19 (12) | 15/15 |
| DEAE posik noiseless | 2.4 (1) | 11 (10) | 70 (75) | 70 (81) | 70 (92) | 70 (111) | 70 (90) | 13/15 |
| DE posik noiseless | 1.1 (0.4) | 1.4 (0.2) | 2.5 (2) | 2.7 (4) | 2.8 (2) | 3.1 (2) | 3.4 (2) | 15/15 |
| DEb posik noiseless | 1.1 (0.4) | 1.4 (2) | 2.5 (1) | 2.7 (4) | 2.8 (2) | 3.1 (2) | 3.4 (2) | 15/15 |
| DEctpb posik noiseless | 1.3 (0.5) | 2.1 (0.4) | 2.5 (0.5) | 2.9 (0.6) | 3.2 (0.5) | 3.6 (0.6) | 3.9 (0.3) | 15/15 |
| IPOPsaACM loshchilov noiseless | 1.1 (1) | 30 (91) | 1790 (3476) | 1785 (2136) | 1780 (1240) | 1776 (1069) | 1772 (1954) | 12/15 |
| JADE posik noiseless | 1.1 (0.5) | 1.6 (0.3) | 2.2 (0.2) | 2.5 (0.2) | 2.7 (1) | 3.0 (0.3) | 3.4 (0.2) | 15/15 |
| JADEb posik noiseless | 0.80 (0.2) | 1.9 (3) | 6.6 (8) | 6.7 (6) | 6.8 (5) | 7.1 (7) | 7.3 (6) | 15/15 |
| JADEctpb posik noiseless | 1.1 (0.5) | 1.6 (0.2) | 2.2 (3) | 2.5 (3) | 2.7 (1) | 3.0 (0.3) | 3.4 (0.2) | 15/15 |
| MVDE melo noiseless | 2.2 (0.6) | 2.4 (0.5) | 2.9 (0.3) | 3.4 (0.2) | 3.8 (0.3) | 4.6 (0.2) | 5.5 (0.2) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 0.87 (0.9) | 13 (24) | 473 (857) | 472 (846) | 471 (430) | 471 (653) | 470 (304) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 1.4 (1) | 29 (142) | 799 (1081) | 797 (511) | 795 (1404) | 793 (1471) | 792 (972) | 15/15 |
| PSO-BFGS voglis noiseless | 9.4 (12) | 26 (39) | 121 (129) | 120 (231) | 120 (94) | 120 (136) | 120 (131) | 13/15 |
| SNES schaul noiseless | 4.4 (7) | 91 (44) | 785 (982) | 783 (615) | 781 (1120) | 779 (593) | 777 (1062) | 8/15 |
| xNES schaul noiseless | 3.0 (14) | 92 (102) | 415 (148) | 413 (480) | 412 (1021) | 412 (540) | 411 (415) | 9/15 |
| xNESas schaul noiseless | 1.5 (0.3) | 69 (54) | 454 (347) | 453 (422) | 452 (611) | 451 (368) | 450 (260) | 13/15 |
| Δ fopt f4, 5-D |
1e1 809 |
1e0 1633 |
1e-1 1688 |
1e-2 1758 |
1e-3 1817 |
1e-5 1886 |
1e-7 1903 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 2.0 (2) | 784 (849) | 2.5e4 (4e4) | 2.4e4 (2e4) | 2.3e4 (2e4) | 2.2e4 (4e4) | 2.2e4 (2e4) | 3/15 |
| BIPOPaCMA loshchilov noiseless | 1.6 (1) | 1.4e4 (1e4) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| BIPOPsaACM loshchilov noiseless | 1.3 (0.9) | 6336 (3820) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| CMAES posik noiseless | 2.2 (1) | 216 (280) | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| CMA brockhoff noiseless | 2.7 (3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞9e5 | 0/15 |
| CMAa brockhoff noiseless | 1.7 (1) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞9e5 | 0/15 |
| CMAm brockhoff noiseless | 2.9 (3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞9e5 | 0/15 |
| CMAma brockhoff noiseless | 1.7 (1) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞9e5 | 0/15 |
| CMAmah brockhoff noiseless | 2.5 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞9e5 | 0/15 |
| CMAmh brockhoff noiseless | 1.8 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞9e5 | 0/15 |
| DBRCGA chuang noiseless | 2.6 (1.0) | 11 (8) | 17 (11) | 16 (8) | 16 (8) | 16 (8) | 16 (10) | 15/15 |
| DE-AUTO voglis noiseless | 1.8 (1.0) | 16 (5) | 28 (28) | 27 (40) | 26 (21) | 25 (17) | 25 (24) | 15/15 |
| DE-BFGS voglis noiseless | 3.8 (2) | 9.0 (5) | 20 (15) | 19 (16) | 19 (14) | 18 (12) | 18 (11) | 15/15 |
| DE-ROLL voglis noiseless | 1.6 (2) | 4.7 (4) | 11 (11) | 11 (8) | 10 (5) | 10 (9) | 10 (8) | 15/15 |
| DE-SIMPLEX voglis noiseless | 6.8 (5) | 14 (6) | 24 (33) | 23 (15) | 23 (6) | 22 (9) | 22 (14) | 15/15 |
| DEAE posik noiseless | 4.1 (2) | 47 (22) | 323 (539) | 310 (181) | 300 (356) | 290 (227) | 287 (264) | 6/15 |
| DE posik noiseless | 1.2 (0.3) | 1.7 (1) | 9.4 (16) | 9.2 (15) | 9.0 (10) | 9.0 (13) | 9.2 (5) | 15/15 |
| DEb posik noiseless | 1.2 (0.3) | 1.7 (0.3) | 9.4 (9) | 9.2 (10) | 9.0 (10) | 9.0 (13) | 9.2 (10) | 15/15 |
| DEctpb posik noiseless | 1.4 (0.5) | 2.6 (0.6) | 4.9 (3) | 5.1 (5) | 5.2 (4) | 5.4 (4) | 5.7 (3) | 15/15 |
| IPOPsaACM loshchilov noiseless | 1.0 (0.8) | 4.3e4 (2e4) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| JADE posik noiseless | 1.4 (0.3) | 2.0 (0.5) | 3.9 (5) | 4.1 (4) | 4.1 (4) | 4.4 (4) | 4.7 (3) | 15/15 |
| JADEb posik noiseless | 0.80 (0.4) | 4.7 (3) | 25 (27) | 24 (27) | 24 (28) | 23 (17) | 23 (16) | 15/15 |
| JADEctpb posik noiseless | 1.4 (0.4) | 2.0 (0.5) | 3.9 (2) | 4.1 (3) | 4.1 (2) | 4.4 (3) | 4.7 (5) | 15/15 |
| MVDE melo noiseless | 2.4 (0.6) | 3.0 (0.6) | 95 (148) | 91 (285) | 89 (275) | 86 (133) | 86 (0.3) | 13/15 |
| NBIPOPaCMA loshchilov noiseless | 1.7 (1) | 738 (656) | 3819 (1810) | 3667 (3107) | 3548 (1952) | 3418 (2732) | 3388 (3453) | 9/15 |
| NIPOPaCMA loshchilov noiseless | 2.8 (2) | 2.2e4 (5e4) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| PSO-BFGS voglis noiseless | 14 (11) | 120 (113) | 410 (328) | 394 (258) | 381 (280) | 367 (632) | 364 (225) | 7/15 |
| SNES schaul noiseless | 3.2 (3) | 443 (276) | 3934 (7197) | 3777 (2710) | 3654 (2495) | 3521 (4240) | 3490 (4278) | 2/15 |
| xNES schaul noiseless | 4.5 (6) | 599 (1149) | 5871 (6810) | 5637 (1e4) | 5454 (6519) | 5255 (9130) | 5208 (4526) | 1/15 |
| xNESas schaul noiseless | 3.8 (5) | 381 (511) | 9998 (6512) | 9600 (1e4) | 9288 (6407) | 8949 (1e4) | 8869 (4693) | 1/15 |
| Δ fopt f5, 5-D |
1e1 10 |
1e0 10 |
1e-1 10 |
1e-2 10 |
1e-3 10 |
1e-5 10 |
1e-7 10 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 8.5 (2) | 12 (3) | 13 (2) | 13 (2) | 13 (2) | 13 (3) | 13 (3) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 5.7 (2) | 6.9 (3) | 6.9 (3) | 6.9 (3) | 6.9 (3) | 6.9 (2) | 6.9 (3) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 4.7 (2) | 5.8 (2) | 6.2 (2) | 6.2 (2) | 6.2 (2) | 6.2 (2) | 6.2 (2) | 15/15 |
| CMAES posik noiseless | 4.3 (1) | 5.8 (2) | 5.8 (2) | 5.9 (2) | 5.9 (2) | 5.9 (2) | 5.9 (2) | 15/15 |
| CMA brockhoff noiseless | 4.4 (3) | 6.5 (3) | 6.7 (1) | 6.7 (1) | 6.7 (2) | 6.7 (3) | 6.7 (4) | 15/15 |
| CMAa brockhoff noiseless | 4.2 (2) | 6.0 (2) | 6.3 (3) | 6.4 (3) | 6.4 (2) | 6.4 (3) | 6.4 (1) | 15/15 |
| CMAm brockhoff noiseless | 3.9 (2) | 5.1 (3) | 5.3 (2) | 5.4 (2) | 5.4 (2) | 5.4 (1) | 5.4 (0.9) | 15/15 |
| CMAma brockhoff noiseless | 3.4 (0.8) | 4.7 (2) | 4.8 (2) | 4.8 (2) | 4.8 (1) | 4.8 (2) | 4.8 (1) | 15/15 |
| CMAmah brockhoff noiseless | 3.3 (2) | 4.2 (2) | 4.7 (1) | 4.8 (1) | 4.8 (2) | 4.8 (2) | 4.8 (2) | 15/15 |
| CMAmh brockhoff noiseless | 2.9 (1) | 3.9 (1.0) | 4.0 (1.0) | 4.1 (1) | 4.1 (1) | 4.1 (0.8) | 4.1 (0.8) | 15/15 |
| DBRCGA chuang noiseless | 31 (33) | 50 (59) | 54 (55) | 54 (60) | 54 (30) | 54 (40) | 54 (39) | 15/15 |
| DE-AUTO voglis noiseless | 5.8 (0.3) | 6.3 (0.4) | 6.4 (0.2) | 6.4 (0.2) | 6.4 (0.3) | 6.4 (0.3) | 6.4 (0.2) | 15/15 |
| DE-BFGS voglis noiseless | 6.5 (1) | 8.8 (2) | 9.0 (0.3) | 9.0 (2) | 9.0 (2) | 9.0 (2) | 9.0 (2) | 15/15 |
| DE-ROLL voglis noiseless | 5.9 (0.2) | 6.4 (0.4) | 6.5 (0.3) | 6.6 (0.8) | 6.7 (0.4) | 6.9 (0.4) | 7.1 (4) | 15/15 |
| DE-SIMPLEX voglis noiseless | 29 (13) | 122 (60) | 266 (127) | 322 (76) | 324 (120) | 336 (82) | 369 (221) | 15/15 |
| DEAE posik noiseless | 8.0 (6) | 12 (8) | 13 (7) | 13 (4) | 13 (11) | 13 (7) | 13 (8) | 15/15 |
| DE posik noiseless | 8.3 (3) | 12 (3) | 12 (3) | 13 (3) | 13 (1) | 13 (3) | 13 (4) | 15/15 |
| DEb posik noiseless | 8.3 (3) | 12 (3) | 12 (3) | 13 (4) | 13 (2) | 13 (3) | 13 (3) | 15/15 |
| DEctpb posik noiseless | 11 (5) | 16 (2) | 17 (3) | 18 (4) | 18 (4) | 18 (3) | 18 (4) | 15/15 |
| IPOPsaACM loshchilov noiseless | 4.3 (2) | 6.1 (3) | 6.2 (2) | 6.3 (3) | 6.3 (3) | 6.3 (2) | 6.3 (4) | 15/15 |
| JADE posik noiseless | 11 (5) | 20 (8) | 21 (10) | 21 (7) | 21 (10) | 21 (5) | 21 (5) | 15/15 |
| JADEb posik noiseless | 8.4 (2) | 14 (4) | 15 (6) | 15 (6) | 15 (5) | 15 (6) | 15 (5) | 15/15 |
| JADEctpb posik noiseless | 11 (4) | 20 (5) | 21 (9) | 21 (8) | 21 (8) | 21 (10) | 21 (10) | 15/15 |
| MVDE melo noiseless | 48 (8) | 90 (22) | 99 (17) | 101 (15) | 101 (20) | 101 (18) | 101 (18) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 4.2 (2) | 5.6 (2) | 5.9 (2) | 5.9 (2) | 5.9 (2) | 5.9 (3) | 5.9 (0.6) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 4.1 (1) | 5.9 (3) | 6.1 (3) | 6.1 (2) | 6.1 (2) | 6.1 (3) | 6.1 (3) | 15/15 |
| PSO-BFGS voglis noiseless | 6.8 (0.3) | 8.8 (0.3) | 8.8 (0.6) | 8.8 (0.6) | 8.9 (0.6) | 8.9 (0.6) | 8.9 (0.6) | 15/15 |
| SNES schaul noiseless | 7.8 (2) | 12 (3) | 12 (3) | 12 (5) | 12 (4) | 12 (2) | 12 (5) | 15/15 |
| xNES schaul noiseless | 9.5 (4) | 15 (10) | 15 (10) | 16 (12) | 16 (3) | 16 (17) | 16 (6) | 15/15 |
| xNESas schaul noiseless | 10 (5) | 15 (12) | 16 (9) | 16 (5) | 16 (10) | 16 (6) | 16 (10) | 15/15 |
| Δ fopt f6, 5-D |
1e1 114 |
1e0 214 |
1e-1 281 |
1e-2 404 |
1e-3 580 |
1e-5 1038 |
1e-7 1332 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 3.4 (1) | 3.6 (0.4) | 4.1 (0.8) | 3.9 (0.7) | 3.4 (0.4) | 2.6 (0.3) | 2.7 (0.3) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 2.0 (1) | 1.9 (0.3) | 2.2 (0.3) | 1.9 (0.3) | 1.6 (0.3) | 1.2 (0.2) | 1.2 (0.2) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.9 (0.7) | 1.8 (0.9) | 2.1 (0.4) | 1.9 (0.4) | 1.8 (0.5) | 1.3 (0.5) | 1.4 (0.4) | 15/15 |
| CMAES posik noiseless | 2.4 (0.8) | 2.0 (0.5) | 2.2 (0.4) | 2.0 (0.3) | 1.7 (0.4) | 1.3 (0.3) | 1.3 (0.1) | 15/15 |
| CMA brockhoff noiseless | 2.5 (0.9) | 2.1 (0.4) | 2.2 (0.3) | 2.0 (0.2) | 1.7 (0.2) | 1.3 (0.1) | 1.2 (0.1) | 15/15 |
| CMAa brockhoff noiseless | 2.0 (0.7) | 1.9 (0.5) | 2.0 (0.3) | 1.7 (0.3) | 1.5 (0.2) | 1.2 (0.1) | 1.1 (0.1) | 15/15 |
| CMAm brockhoff noiseless | 2.2 (0.2) | 2.0 (0.7) | 2.1 (0.7) | 1.9 (0.4) | 1.7 (0.4) | 1.3 (0.2) | 1.3 (0.3) | 15/15 |
| CMAma brockhoff noiseless | 2.4 (1) | 2.1 (2) | 2.2 (0.9) | 1.9 (0.8) | 1.6 (0.4) | 1.2 (0.4) | 1.2 (0.2) | 15/15 |
| CMAmah brockhoff noiseless | 1.7 (0.9) | 1.5 (0.5) | 1.7 (0.5) | 1.5 (0.4) | 1.3 (0.3) | 0.94 (0.2) | 0.92 (0.2) | 15/15 |
| CMAmh brockhoff noiseless | 1.8 (1) | 1.7 (1) | 1.8 (1) | 1.7 (0.4) | 1.5 (0.7) | 1.1 (0.2) | 1.1 (0.2) | 15/15 |
| DBRCGA chuang noiseless | 7.4 (3) | 10 (2) | 12 (4) | 12 (3) | 10 (2) | 8.0 (1) | 8.2 (2) | 15/15 |
| DE-AUTO voglis noiseless | 1.3 (0.7) | 1.0 (0.4) | 1.00 (0.4) | 0.83 (0.1) | 0.79 (0.3) | 0.73 (0.4) | 0.79 (0.2) | 15/15 |
| DE-BFGS voglis noiseless | 5.1 (12) | 3.0 (6) | 2.5 (5) | 2.0 (4) | 1.5 (5) | 1.3 (3) | 2.8 (3) | 15/15 |
| DE-ROLL voglis noiseless | 13 (19) | 13 (23) | 19 (30) | 15 (21) | 18 (20) | 13 (15) | 53 (45) | 14/15 |
| DE-SIMPLEX voglis noiseless | 5.5 (7) | 5.6 (7) | 6.2 (7) | 5.6 (3) | 5.6 (5) | 5.9 (6) | 12 (29) | 15/15 |
| DEAE posik noiseless | 3.7 (2) | 4.8 (1.0) | 5.7 (1) | 5.2 (0.9) | 4.6 (0.5) | 3.8 (0.4) | 3.9 (0.3) | 15/15 |
| DE posik noiseless | 5.4 (2) | 6.6 (2) | 8.4 (2) | 8.6 (2) | 8.0 (2) | 6.3 (2) | 6.7 (1) | 15/15 |
| DEb posik noiseless | 5.4 (1) | 6.6 (2) | 8.4 (1) | 8.6 (1) | 8.0 (1.0) | 6.3 (1) | 6.7 (1) | 15/15 |
| DEctpb posik noiseless | 6.0 (2) | 6.6 (1) | 8.2 (1) | 7.9 (1) | 6.9 (1) | 5.6 (0.9) | 5.8 (0.3) | 15/15 |
| IPOPsaACM loshchilov noiseless | 2.3 (1) | 2.1 (1) | 2.6 (1) | 2.4 (1) | 1.9 (0.4) | 1.5 (0.4) | 1.7 (1) | 15/15 |
| JADE posik noiseless | 4.1 (2) | 4.5 (0.8) | 5.4 (1) | 5.0 (0.8) | 4.4 (0.6) | 3.6 (0.6) | 3.7 (0.6) | 15/15 |
| JADEb posik noiseless | 2.6 (1.0) | 3.4 (1.0) | 4.5 (1) | 4.6 (0.9) | 4.4 (0.9) | 3.7 (0.9) | 4.0 (0.5) | 15/15 |
| JADEctpb posik noiseless | 4.1 (2) | 4.5 (1) | 5.4 (0.7) | 5.0 (0.9) | 4.4 (0.5) | 3.6 (0.8) | 3.7 (0.5) | 15/15 |
| MVDE melo noiseless | 6.5 (2) | 13 (4) | 18 (4) | 20 (5) | 21 (5) | 21 (8) | 25 (11) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 2.1 (0.8) | 1.9 (0.5) | 2.0 (0.6) | 1.8 (0.5) | 1.5 (0.3) | 1.1 (0.2) | 1.1 (0.1) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.0 (0.5) | 1.7 (0.4) | 1.9 (0.3) | 1.7 (0.3) | 1.5 (0.2) | 1.2 (0.1) | 1.2 (0.1) | 15/15 |
| PSO-BFGS voglis noiseless | 6.4 (5) | 3.8 (5) | 3.1 (8) | 2.4 (6) | 1.9 (5) | 1.5 (0.8) | 54 (85) | 11/15 |
| SNES schaul noiseless | 1.5 (0.4) | 1.7 (0.5) | 2.2 (1) | 2.2 (1) | 2.0 (1) | 10 (28) | 23 (51) | 15/15 |
| xNES schaul noiseless | 1.6 (0.9) | 2.0 (0.5) | 2.5 (0.4) | 2.4 (0.3) | 2.2 (0.2) | 1.8 (0.1) | 1.8 (0.1) | 15/15 |
| xNESas schaul noiseless | 1.5 (1) | 2.1 (0.4) | 2.4 (0.5) | 2.3 (0.3) | 2.0 (0.3) | 1.5 (0.1) | 1.6 (0.2) | 15/15 |
| Δ fopt f7, 5-D |
1e1 24 |
1e0 324 |
1e-1 1171 |
1e-2 1451 |
1e-3 1572 |
1e-5 1572 |
1e-7 1597 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 6.4 (3) | 2.1 (2) | 32 (76) | 26 (20) | 25 (57) | 25 (57) | 25 (13) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 6.8 (3) | 1.3 (1) | 1.0 (0.8) | 0.98 (0.7) | 0.93 (0.6) | 0.93 (0.7) | 0.95 (0.5) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 4.4 (3) | 1.4 (0.2) | 0.83 (0.5) | 0.88 (0.6) | 0.91 (0.8) | 0.91 (0.8) | 0.93 (0.6) | 15/15 |
| CMAES posik noiseless | 5.0 (2) | 1.1 (1) | 2.0 (2) | 2.1 (2) | 2.6 (2) | 2.6 (1) | 2.6 (5) | 15/15 |
| CMA brockhoff noiseless | 4.7 (3) | 1.5 (0.9) | 0.88 (0.4) | 0.89 (0.4) | 0.92 (0.5) | 0.92 (0.6) | 0.94 (0.6) | 15/15 |
| CMAa brockhoff noiseless | 7.2 (10) | 1.1 (0.9) | 0.88 (0.5) | 0.79 (0.7) | 0.77 (0.2) | 0.77 (0.3) | 0.79 (0.3) | 15/15 |
| CMAm brockhoff noiseless | 3.8 (3) | 1.1 (0.7) | 1.3 (1) | 1.4 (1) | 1.3 (0.7) | 1.3 (0.9) | 1.4 (0.7) | 15/15 |
| CMAma brockhoff noiseless | 5.0 (3) | 1.4 (1.0) | 0.84 (0.4) | 0.80 (0.3) | 0.76 (0.3) | 0.76 (0.3) | 0.82 (0.3) | 15/15 |
| CMAmah brockhoff noiseless | 3.9 (2) | 1.5 (0.9) | 1.4 (0.7) | 1.3 (0.5) | 1.2 (0.5) | 1.2 (0.6) | 1.2 (0.6) | 15/15 |
| CMAmh brockhoff noiseless | 4.5 (4) | 2.1 (1) | 1.4 (0.7) | 1.5 (1) | 1.4 (0.5) | 1.4 (0.7) | 1.4 (0.6) | 15/15 |
| DBRCGA chuang noiseless | 16 (12) | 4.1 (1) | 4.9 (8) | 5.7 (6) | 7.9 (6) | 7.9 (11) | 8.0 (4) | 15/15 |
| DE-AUTO voglis noiseless | 40 (64) | 13 (11) | 6.9 (3) | 8.1 (2) | 9.1 (2) | 9.1 (5) | 14 (7) | 15/15 |
| DE-BFGS voglis noiseless | 8.8 (4) | 3.4 (5) | 10 (27) | 9.0 (18) | 9.2 (6) | 9.2 (1) | 41 (34) | 10/15 |
| DE-ROLL voglis noiseless | 29 (44) | 11 (16) | 8.4 (7) | 8.3 (5) | 8.3 (5) | 8.3 (4) | 8.5 (6) | 15/15 |
| DE-SIMPLEX voglis noiseless | 10 (7) | 7.9 (0.9) | 5.1 (8) | 4.6 (6) | 4.7 (6) | 4.7 (6) | 4.9 (4) | 15/15 |
| DEAE posik noiseless | 7.7 (5) | 1.4 (0.5) | 0.68 (0.2) | 0.83 (0.2) | 0.87 (0.2) | 0.87 (0.3) | 0.94 (0.2) | 15/15 |
| DE posik noiseless | 12 (11) | 3.4 (1) | 1.9 (0.6) | 2.5 (0.4) | 2.5 (0.4) | 2.5 (0.8) | 2.7 (0.4) | 15/15 |
| DEb posik noiseless | 12 (11) | 3.4 (2) | 1.9 (0.4) | 2.5 (0.4) | 2.5 (0.7) | 2.5 (0.3) | 2.7 (0.9) | 15/15 |
| DEctpb posik noiseless | 10 (8) | 3.3 (1) | 2.1 (0.6) | 2.7 (0.6) | 2.7 (1) | 2.7 (0.9) | 3.0 (0.7) | 15/15 |
| IPOPsaACM loshchilov noiseless | 3.7 (2) | 1.2 (1) | 0.68 (1) | 0.70 (0.6) | 0.77 (0.9) | 0.77 (0.6) | 0.90 (0.4) | 15/15 |
| JADE posik noiseless | 8.2 (5) | 2.0 (0.6) | 1.3 (0.2) | 1.4 (0.8) | 1.4 (1) | 1.4 (0.4) | 1.6 (0.3) | 15/15 |
| JADEb posik noiseless | 6.0 (4) | 57 (0.6) | 54 (107) | 64 (43) | 81 (278) | 81 (119) | 80 (118) | 10/15 |
| JADEctpb posik noiseless | 8.2 (4) | 2.0 (0.6) | 1.3 (2) | 1.4 (2) | 1.4 (0.9) | 1.4 (0.3) | 1.6 (0.3) | 15/15 |
| MVDE melo noiseless | 18 (10) | 7.0 (4) | 5.0 (2) | 7.2 (3) | 8.7 (2) | 8.7 (4) | 9.4 (4) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 4.7 (3) | 1.3 (1) | 0.86 (0.4) | 0.89 (0.7) | 0.86 (0.8) | 0.86 (0.4) | 0.88 (0.5) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 5.9 (3) | 1.3 (1) | 0.93 (0.8) | 1.0 (0.7) | 0.99 (0.7) | 0.99 (0.6) | 1.1 (0.6) | 15/15 |
| PSO-BFGS voglis noiseless | 579 (812) | 458 (425) | 930 (1387) | 1588 (1711) | 2363 (3644) | 2363 (3583) | 2326 (2391) | 1/15 |
| SNES schaul noiseless | 3.5 (4) | 37 (68) | 51 (41) | 81 (75) | 212 (156) | 212 (253) | 237 (236) | 14/15 |
| xNES schaul noiseless | 4.5 (4) | 2.9 (0.4) | 2.7 (4) | 2.3 (2) | 3.0 (6) | 3.0 (5) | 3.0 (6) | 15/15 |
| xNESas schaul noiseless | 4.3 (3) | 0.81 (0.3) | 3.2 (2) | 2.7 (5) | 2.6 (5) | 2.6 (6) | 2.6 (3) | 15/15 |
| Δ fopt f8, 5-D |
1e1 73 |
1e0 273 |
1e-1 336 |
1e-2 372 |
1e-3 391 |
1e-5 410 |
1e-7 422 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 5.5 (0.9) | 11 (2) | 43 (10) | 82 (5) | 120 (22) | 199 (22) | 278 (9) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 3.0 (1) | 5.9 (11) | 6.2 (3) | 6.2 (6) | 6.2 (4) | 6.4 (4) | 6.7 (2) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.2 (0.4) | 2.5 (7) | 2.5 (3) | 2.5 (1.0) | 2.5 (5) | 2.5 (0.9) | 2.5 (0.7) | 15/15 |
| CMAES posik noiseless | 4.3 (5) | 3.6 (1) | 4.4 (2) | 4.6 (2) | 4.7 (2) | 5.0 (1) | 5.2 (1) | 15/15 |
| CMA brockhoff noiseless | 3.4 (0.8) | 5.1 (5) | 5.7 (3) | 5.7 (4) | 5.8 (4) | 6.0 (4) | 6.3 (2) | 15/15 |
| CMAa brockhoff noiseless | 2.8 (1) | 4.5 (5) | 5.0 (2) | 5.0 (3) | 5.1 (4) | 5.3 (4) | 5.5 (4) | 15/15 |
| CMAm brockhoff noiseless | 2.6 (1) | 4.3 (1) | 4.9 (4) | 5.1 (4) | 5.2 (2) | 5.4 (2) | 5.6 (0.9) | 15/15 |
| CMAma brockhoff noiseless | 2.7 (2) | 3.2 (1) | 3.7 (1) | 3.9 (1) | 4.0 (1) | 4.2 (1) | 4.4 (1) | 15/15 |
| CMAmah brockhoff noiseless | 1.8 (1) | 3.5 (3) | 4.0 (3) | 4.2 (2) | 4.3 (2) | 4.4 (2) | 4.5 (1) | 15/15 |
| CMAmh brockhoff noiseless | 2.5 (1) | 4.5 (3) | 5.1 (4) | 5.3 (6) | 5.3 (5) | 5.5 (3) | 5.6 (5) | 15/15 |
| DBRCGA chuang noiseless | 18 (3) | 16 (14) | 24 (13) | 36 (19) | 43 (21) | 56 (11) | 75 (21) | 15/15 |
| DE-AUTO voglis noiseless | 1.6 (0.4) | 2.4 (2) | 2.1 (4) | 2.0 (3) | 1.9 (2) | 1.9 (3) | 1.8 (1) | 15/15 |
| DE-BFGS voglis noiseless | 2.8 (2) | 1.2 (0.3) | 1.1 (0.2) | 1.1 (0.4) | 1.1 (0.3) | 1.1 (0.6) | 1.1 (0.3) | 15/15 |
| DE-ROLL voglis noiseless | 4.6 (4) | 13 (4) | 40 (32) | 59 (16) | 83 (39) | 120 (37) | 1134 (143) | 5/15 |
| DE-SIMPLEX voglis noiseless | 1.9 (0.7) | 2.2 (0.8) | 2.2 (1) | 2.1 (1) | 2.1 (2) | 2.2 (1) | 2.2 (1) | 15/15 |
| DEAE posik noiseless | 8.7 (2) | 10 (2) | 11 (9) | 11 (9) | 11 (8) | 11 (12) | 12 (2) | 15/15 |
| DE posik noiseless | 9.4 (4) | 14 (2) | 21 (25) | 26 (6) | 30 (19) | 40 (6) | 49 (21) | 15/15 |
| DEb posik noiseless | 9.4 (4) | 14 (26) | 21 (40) | 26 (23) | 30 (7) | 40 (4) | 49 (7) | 15/15 |
| DEctpb posik noiseless | 11 (4) | 10 (2) | 22 (4) | 28 (10) | 32 (8) | 44 (8) | 54 (10) | 15/15 |
| IPOPsaACM loshchilov noiseless | 2.3 (1) | 1.9 (2) | 2.0 (1) | 2.0 (0.3) | 2.0 (0.3) | 2.0 (0.2) | 2.1 (2) | 15/15 |
| JADE posik noiseless | 7.5 (3) | 7.3 (3) | 10 (3) | 11 (2) | 12 (1) | 13 (1) | 14 (1) | 15/15 |
| JADEb posik noiseless | 5.0 (1) | 11 (3) | 12 (26) | 12 (2) | 12 (12) | 13 (12) | 14 (15) | 15/15 |
| JADEctpb posik noiseless | 7.5 (3) | 7.3 (3) | 10 (3) | 11 (3) | 12 (2) | 13 (2) | 14 (1) | 15/15 |
| MVDE melo noiseless | 21 (8) | 20 (13) | 64 (68) | 134 (86) | 196 (118) | 388 (179) | 590 (144) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 2.9 (3) | 4.1 (0.7) | 4.6 (4) | 4.7 (3) | 4.8 (3) | 5.1 (0.5) | 5.3 (0.4) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 4.1 (3) | 4.4 (2) | 4.8 (2) | 5.0 (1) | 5.0 (0.7) | 5.2 (2) | 5.5 (4) | 15/15 |
| PSO-BFGS voglis noiseless | 3.0 (2) | 1.8 (0.9) | 1.6 (0.5) | 1.5 (0.7) | 1.5 (0.6) | 1.5 (0.6) | 1.4 (0.5) | 15/15 |
| SNES schaul noiseless | 3.7 (1) | 87 (148) | 219 (233) | 424 (327) | 667 (335) | 1770 (550) | 4065 (4345) | 4/15 |
| xNES schaul noiseless | 4.1 (2) | 3.9 (1) | 5.8 (2) | 7.0 (4) | 7.3 (4) | 7.7 (4) | 8.3 (1) | 15/15 |
| xNESas schaul noiseless | 3.4 (2) | 6.8 (3) | 8.7 (10) | 10 (3) | 16 (13) | 16 (51) | 16 (26) | 15/15 |
| Δ fopt f9, 5-D |
1e1 35 |
1e0 127 |
1e-1 214 |
1e-2 263 |
1e-3 300 |
1e-5 335 |
1e-7 369 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 12 (3) | 21 (14) | 59 (22) | 148 (68) | 251 (92) | 467 (247) | 655 (334) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 7.8 (3) | 10 (11) | 7.7 (4) | 7.1 (2) | 6.6 (3) | 6.4 (1) | 6.3 (3) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 4.2 (1) | 4.1 (4) | 3.1 (3) | 2.8 (0.7) | 2.6 (2) | 2.5 (2) | 2.3 (1.0) | 15/15 |
| CMAES posik noiseless | 5.5 (2) | 7.1 (3) | 6.5 (1) | 6.2 (0.9) | 5.8 (1.0) | 5.8 (1) | 5.7 (1) | 15/15 |
| CMA brockhoff noiseless | 6.9 (3) | 9.0 (11) | 7.7 (4) | 7.1 (6) | 6.8 (6) | 6.7 (3) | 6.5 (1.0) | 15/15 |
| CMAa brockhoff noiseless | 6.1 (1) | 6.5 (3) | 5.9 (1.0) | 5.6 (1) | 5.2 (1) | 5.2 (1.0) | 5.2 (1) | 15/15 |
| CMAm brockhoff noiseless | 5.4 (3) | 6.5 (3) | 6.2 (1) | 5.8 (0.7) | 5.6 (0.8) | 5.5 (0.9) | 5.3 (0.6) | 15/15 |
| CMAma brockhoff noiseless | 5.8 (5) | 6.9 (6) | 6.0 (2) | 5.8 (2) | 5.4 (1) | 5.3 (5) | 5.1 (4) | 15/15 |
| CMAmah brockhoff noiseless | 4.3 (1) | 9.4 (8) | 7.5 (5) | 6.8 (5) | 6.3 (3) | 6.1 (3) | 5.8 (3) | 15/15 |
| CMAmh brockhoff noiseless | 5.0 (2) | 11 (8) | 9.0 (10) | 8.2 (8) | 7.6 (7) | 7.4 (2) | 7.0 (2) | 15/15 |
| DBRCGA chuang noiseless | 34 (10) | 37 (13) | 42 (33) | 58 (53) | 72 (49) | 109 (84) | 129 (64) | 15/15 |
| DE-AUTO voglis noiseless | 3.6 (0.8) | 7.1 (6) | 4.5 (3) | 3.7 (8) | 3.3 (5) | 3.0 (7) | 2.8 (4) | 15/15 |
| DE-BFGS voglis noiseless | 4.2 (0.7) | 2.7 (0.9) | 1.9 (0.8) | 1.6 (1) | 1.5 (0.6) | 1.3 (0.3) | 1.2 (0.6) | 15/15 |
| DE-ROLL voglis noiseless | 8.0 (3) | 17 (10) | 71 (33) | 99 (53) | 124 (58) | 165 (64) | 361 (143) | 13/15 |
| DE-SIMPLEX voglis noiseless | 5.8 (3) | 4.4 (5) | 3.2 (3) | 2.8 (2) | 2.6 (1) | 2.5 (1) | 2.4 (1) | 15/15 |
| DEAE posik noiseless | 16 (4) | 13 (5) | 11 (4) | 10 (2) | 10 (2) | 10 (2) | 11 (3) | 15/15 |
| DE posik noiseless | 22 (8) | 37 (6) | 36 (10) | 39 (64) | 40 (7) | 50 (30) | 58 (34) | 15/15 |
| DEb posik noiseless | 22 (9) | 37 (6) | 36 (46) | 39 (8) | 40 (34) | 50 (10) | 58 (13) | 15/15 |
| DEctpb posik noiseless | 22 (10) | 29 (8) | 37 (8) | 41 (7) | 43 (16) | 53 (15) | 62 (19) | 15/15 |
| IPOPsaACM loshchilov noiseless | 5.0 (2) | 3.1 (0.9) | 2.5 (0.9) | 2.3 (0.7) | 2.1 (0.8) | 2.0 (0.6) | 2.0 (0.4) | 15/15 |
| JADE posik noiseless | 14 (2) | 24 (8) | 22 (14) | 20 (12) | 19 (11) | 19 (3) | 18 (4) | 15/15 |
| JADEb posik noiseless | 11 (2) | 20 (33) | 16 (4) | 15 (10) | 15 (14) | 15 (12) | 15 (11) | 15/15 |
| JADEctpb posik noiseless | 14 (2) | 24 (40) | 22 (3) | 20 (3) | 19 (4) | 19 (4) | 18 (13) | 15/15 |
| MVDE melo noiseless | 48 (8) | 79 (69) | 197 (70) | 263 (97) | 304 (57) | 454 (165) | 614 (205) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 5.2 (1) | 6.2 (2) | 5.6 (1) | 5.3 (1) | 5.0 (1) | 5.0 (1) | 5.0 (1) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 5.6 (2) | 5.4 (2) | 5.0 (1) | 4.7 (1) | 4.6 (0.8) | 4.6 (1) | 4.6 (1) | 15/15 |
| PSO-BFGS voglis noiseless | 4.0 (2) | 2.2 (2) | 1.6 (0.8) | 1.4 (1) | 1.3 (0.9) | 1.2 (0.8) | 1.1 (1) | 15/15 |
| SNES schaul noiseless | 5.2 (1) | 69 (119) | 211 (240) | 507 (278) | 1482 (518) | 2067 (1007) | 5488 (4461) | 4/15 |
| xNES schaul noiseless | 7.0 (2) | 8.2 (4) | 8.7 (2) | 8.8 (5) | 8.4 (5) | 8.3 (3) | 8.4 (2) | 15/15 |
| xNESas schaul noiseless | 6.3 (2) | 13 (19) | 12 (3) | 12 (3) | 11 (11) | 11 (14) | 11 (10) | 15/15 |
| Δ fopt f10, 5-D |
1e1 349 |
1e0 500 |
1e-1 574 |
1e-2 607 |
1e-3 626 |
1e-5 829 |
1e-7 880 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 663 (398) | 1847 (1423) | 3068 (1566) | 3981 (2408) | 5251 (3470) | 5799 (1732) | 9643 (5005) | 1/15 |
| BIPOPaCMA loshchilov noiseless | 2.6 (0.9) | 2.2 (0.5) | 2.1 (0.3) | 2.1 (0.2) | 2.2 (0.3) | 1.9 (0.2) | 2.0 (0.2) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 0.76 (0.1) | 0.59 (0.1) | 0.58 (0.1) | 0.58 (0.0) | 0.60 (0.1) | 0.51 (0.0) | 0.53 (0.0) | 15/15 |
| CMAES posik noiseless | 3.6 (0.6) | 2.9 (0.4) | 2.7 (0.2) | 2.8 (0.1) | 2.8 (0.2) | 2.3 (0.2) | 2.3 (0.2) | 15/15 |
| CMA brockhoff noiseless | 2.8 (0.6) | 2.7 (0.7) | 2.6 (0.5) | 2.7 (0.4) | 2.8 (0.3) | 2.3 (0.3) | 2.3 (0.2) | 15/15 |
| CMAa brockhoff noiseless | 2.6 (0.6) | 2.2 (0.5) | 2.1 (0.2) | 2.1 (0.2) | 2.2 (0.2) | 1.8 (0.2) | 1.9 (0.1) | 15/15 |
| CMAm brockhoff noiseless | 3.9 (1.0) | 3.2 (0.8) | 3.0 (0.3) | 3.0 (0.1) | 3.0 (0.2) | 2.4 (0.2) | 2.4 (0.2) | 15/15 |
| CMAma brockhoff noiseless | 2.5 (0.9) | 2.2 (0.5) | 2.1 (0.3) | 2.1 (0.2) | 2.2 (0.3) | 1.8 (0.2) | 1.8 (0.1) | 15/15 |
| CMAmah brockhoff noiseless | 2.9 (1) | 2.5 (0.6) | 2.4 (0.2) | 2.3 (0.2) | 2.3 (0.2) | 1.9 (0.1) | 1.9 (0.1) | 15/15 |
| CMAmh brockhoff noiseless | 4.1 (1) | 3.4 (0.9) | 3.3 (0.2) | 3.2 (0.2) | 3.2 (0.3) | 2.5 (0.2) | 2.5 (0.1) | 15/15 |
| DBRCGA chuang noiseless | 59 (38) | 194 (230) | 407 (256) | 692 (473) | 1183 (909) | 1630 (1180) | 4069 (2580) | 2/15 |
| DE-AUTO voglis noiseless | 2.6 (4) | 1.9 (2) | 1.6 (3) | 1.6 (1) | 1.5 (1) | 1.2 (1) | 1.1 (0.5) | 15/15 |
| DE-BFGS voglis noiseless | 0.75 (2) | 0.54 (0.0) | 0.49 (0.8) | 0.48 (0.7) | 0.48 (0.1) | 0.39 (0.5) | 0.50 (0.9) | 15/15 |
| DE-ROLL voglis noiseless | 93 (62) | 121 (93) | 129 (30) | 153 (63) | 176 (78) | 178 (42) | 1865 (1549) | 1/15 |
| DE-SIMPLEX voglis noiseless | 2.9 (4) | 2.7 (1.0) | 2.5 (1) | 2.4 (2) | 2.4 (1) | 1.9 (2) | 2.0 (2) | 15/15 |
| DEAE posik noiseless | 3.0 (0.4) | 2.5 (0.3) | 2.6 (0.2) | 2.9 (0.3) | 3.2 (0.2) | 3.0 (0.4) | 3.4 (0.2) | 15/15 |
| DE posik noiseless | 27 (6) | 28 (5) | 32 (5) | 36 (7) | 43 (9) | 42 (6) | 49 (6) | 15/15 |
| DEb posik noiseless | 27 (4) | 28 (4) | 32 (5) | 36 (7) | 43 (6) | 42 (6) | 49 (6) | 15/15 |
| DEctpb posik noiseless | 32 (8) | 32 (5) | 37 (4) | 43 (5) | 52 (8) | 51 (8) | 61 (7) | 15/15 |
| IPOPsaACM loshchilov noiseless | 0.77 (0.3) | 0.61 (0.1) | 0.57 (0.1) | 0.58 (0.1) | 0.60 (0.1) | 0.51 (0.1) | 0.53 (0.1) | 15/15 |
| JADE posik noiseless | 6.1 (1) | 5.1 (0.6) | 5.0 (0.7) | 5.2 (0.6) | 5.4 (0.6) | 4.8 (0.7) | 5.1 (0.6) | 15/15 |
| JADEb posik noiseless | 6.7 (3) | 5.7 (2) | 6.0 (1) | 6.4 (2) | 6.6 (2) | 5.8 (1) | 6.1 (1) | 15/15 |
| JADEctpb posik noiseless | 6.1 (1) | 5.1 (0.6) | 5.0 (0.8) | 5.2 (0.7) | 5.4 (0.6) | 4.8 (0.4) | 5.1 (0.6) | 15/15 |
| MVDE melo noiseless | 137 (69) | 198 (73) | 332 (145) | 535 (206) | 780 (234) | 996 (642) | 2755 (3219) | 1/15 |
| NBIPOPaCMA loshchilov noiseless | 2.8 (0.8) | 2.2 (0.5) | 2.1 (0.6) | 2.1 (0.3) | 2.2 (0.5) | 1.8 (0.2) | 1.9 (0.2) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.7 (0.8) | 2.3 (0.3) | 2.1 (0.2) | 2.1 (0.2) | 2.2 (0.3) | 1.8 (0.2) | 1.9 (0.2) | 15/15 |
| PSO-BFGS voglis noiseless | 1.3 (2) | 0.94 (0.5) | 0.84 (0.5) | 0.81 (1) | 0.79 (0.5) | 0.62 (1.0) | 1.7 (5) | 15/15 |
| SNES schaul noiseless | 3423 (4767) | 5372 (3743) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| xNES schaul noiseless | 2.1 (0.9) | 1.9 (0.5) | 1.9 (0.2) | 2.0 (0.2) | 2.3 (0.2) | 2.2 (0.3) | 2.5 (0.3) | 15/15 |
| xNESas schaul noiseless | 2.0 (0.9) | 1.8 (0.9) | 1.8 (0.8) | 1.9 (0.5) | 2.0 (0.1) | 1.9 (0.4) | 2.0 (0.3) | 15/15 |
| Δ fopt f11, 5-D |
1e1 143 |
1e0 202 |
1e-1 763 |
1e-2 977 |
1e-3 1177 |
1e-5 1467 |
1e-7 1673 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 129 (105) | 257 (73) | 118 (38) | 122 (24) | 130 (22) | 152 (42) | 177 (30) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 5.0 (1.0) | 4.6 (1) | 1.4 (0.2) | 1.2 (0.1) | 1.1 (0.1) | 0.94 (0.1) | 0.91 (0.1) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.1 (0.3) | 1.6 (0.3) | 0.47 (0.1) | 0.39 (0.0) | 0.34 (0.0) | 0.30 (0.0) | 0.29 (0.0) | 15/15 |
| CMAES posik noiseless | 9.1 (1) | 7.7 (1) | 2.3 (0.3) | 1.9 (0.2) | 1.6 (0.2) | 1.4 (0.2) | 1.3 (0.1) | 15/15 |
| CMA brockhoff noiseless | 8.7 (0.5) | 7.6 (0.7) | 2.2 (0.3) | 1.9 (0.2) | 1.6 (0.1) | 1.4 (0.2) | 1.3 (0.1) | 15/15 |
| CMAa brockhoff noiseless | 5.2 (2) | 4.6 (0.6) | 1.4 (0.2) | 1.2 (0.1) | 1.1 (0.1) | 0.95 (0.1) | 0.93 (0.0) | 15/15 |
| CMAm brockhoff noiseless | 8.4 (2) | 7.8 (1) | 2.3 (0.3) | 1.9 (0.2) | 1.7 (0.2) | 1.4 (0.1) | 1.3 (0.1) | 15/15 |
| CMAma brockhoff noiseless | 5.1 (1) | 4.4 (1) | 1.3 (0.1) | 1.1 (0.2) | 1.0 (0.1) | 0.88 (0.1) | 0.84 (0.1) | 15/15 |
| CMAmah brockhoff noiseless | 6.4 (3) | 6.2 (2) | 1.8 (0.3) | 1.5 (0.2) | 1.3 (0.2) | 1.1 (0.1) | 1.0 (0.1) | 15/15 |
| CMAmh brockhoff noiseless | 12 (3) | 10 (2) | 3.0 (0.3) | 2.4 (0.3) | 2.1 (0.2) | 1.7 (0.1) | 1.6 (0.1) | 15/15 |
| DBRCGA chuang noiseless | 18 (30) | 106 (144) | 77 (82) | 80 (57) | 100 (76) | 140 (74) | 177 (78) | 11/15 |
| DE-AUTO voglis noiseless | 2.5 (0.1) | 1.9 (5) | 0.51 (1) | 0.41 (0.0) | 0.35 (2) | 0.29 (0.0) | 0.61 (1) | 15/15 |
| DE-BFGS voglis noiseless | 0.69 (0.4) | 0.53 (0.2) | 0.15 (0.1) | 0.13 (0.0) | 0.11 (0.0) | 0.11 (0.0) | 0.12 (0.1) | 15/15 |
| DE-ROLL voglis noiseless | 76 (87) | 163 (63) | 63 (26) | 79 (20) | 81 (19) | 92 (19) | 2107 (1499) | 0/15 |
| DE-SIMPLEX voglis noiseless | 4.5 (3) | 5.3 (7) | 1.7 (0.5) | 1.5 (1) | 1.3 (0.3) | 1.1 (0.2) | 0.97 (0.6) | 15/15 |
| DEAE posik noiseless | 4.4 (1) | 4.9 (1) | 1.7 (0.3) | 1.6 (0.2) | 1.5 (0.2) | 1.5 (0.2) | 1.6 (0.2) | 15/15 |
| DE posik noiseless | 32 (16) | 42 (17) | 16 (4) | 17 (4) | 17 (3) | 19 (4) | 23 (5) | 15/15 |
| DEb posik noiseless | 32 (20) | 42 (19) | 16 (5) | 17 (5) | 17 (4) | 19 (6) | 23 (6) | 15/15 |
| DEctpb posik noiseless | 26 (18) | 44 (18) | 18 (5) | 19 (6) | 21 (4) | 24 (3) | 27 (7) | 15/15 |
| IPOPsaACM loshchilov noiseless | 2.0 (0.4) | 1.6 (0.3) | 0.46 (0.2) | 0.39 (0.1) | 0.34 (0.0) | 0.30 (0.0) | 0.29 (0.1) | 15/15 |
| JADE posik noiseless | 8.0 (2) | 8.9 (0.8) | 2.8 (0.3) | 2.5 (0.3) | 2.3 (0.3) | 2.2 (0.1) | 2.3 (0.2) | 15/15 |
| JADEb posik noiseless | 9.0 (3) | 12 (5) | 4.0 (2) | 3.4 (1) | 3.0 (0.9) | 2.8 (0.9) | 2.7 (0.4) | 15/15 |
| JADEctpb posik noiseless | 8.0 (3) | 8.9 (0.9) | 2.8 (0.4) | 2.5 (0.3) | 2.3 (0.2) | 2.2 (0.1) | 2.3 (0.2) | 15/15 |
| MVDE melo noiseless | 43 (30) | 195 (111) | 123 (51) | 190 (102) | 267 (121) | 383 (203) | 795 (792) | 6/15 |
| NBIPOPaCMA loshchilov noiseless | 6.1 (1) | 5.0 (0.8) | 1.5 (0.2) | 1.2 (0.1) | 1.1 (0.1) | 0.97 (0.1) | 0.94 (0.1) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 5.2 (1) | 4.3 (0.4) | 1.3 (0.1) | 1.2 (0.2) | 1.0 (0.1) | 0.93 (0.1) | 0.90 (0.1) | 15/15 |
| PSO-BFGS voglis noiseless | 0.59 (0.1) | 0.45 (0.0) | 0.13 (0.0) | 0.11 (0.0) | 0.10 (0.0) | 0.09 (0.0) | 0.11 (0.0) | 15/15 |
| SNES schaul noiseless | 3896 (1838) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| xNES schaul noiseless | 4.4 (1) | 3.9 (1) | 1.2 (0.2) | 1.1 (0.2) | 1.1 (0.1) | 1.1 (0.1) | 1.2 (0.1) | 15/15 |
| xNESas schaul noiseless | 4.2 (3) | 4.3 (1) | 1.3 (0.4) | 1.1 (0.3) | 1.1 (0.2) | 1.0 (0.2) | 1.1 (0.1) | 15/15 |
| Δ fopt f12, 5-D |
1e1 108 |
1e0 268 |
1e-1 371 |
1e-2 413 |
1e-3 461 |
1e-5 1303 |
1e-7 1494 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 4137 (1675) | 3.3e4 (3e4) | 7.8e4 (4e4) | 1.8e5 (1e5) | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 12 (4) | 8.3 (4) | 7.7 (9) | 7.6 (9) | 7.4 (7) | 3.0 (3) | 3.2 (4) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.6 (0.5) | 2.1 (2) | 2.1 (1) | 2.4 (3) | 2.5 (3) | 1.4 (0.8) | 1.7 (2) | 15/15 |
| CMAES posik noiseless | 8.4 (9) | 5.9 (6) | 7.1 (6) | 7.7 (4) | 7.9 (8) | 3.5 (3) | 3.8 (5) | 15/15 |
| CMA brockhoff noiseless | 10 (6) | 8.3 (5) | 8.4 (5) | 8.5 (4) | 8.6 (6) | 3.7 (3) | 3.7 (2) | 15/15 |
| CMAa brockhoff noiseless | 8.7 (15) | 7.2 (13) | 7.9 (4) | 8.4 (4) | 8.5 (3) | 3.7 (3) | 3.7 (2) | 15/15 |
| CMAm brockhoff noiseless | 7.4 (8) | 7.5 (2) | 8.2 (6) | 8.6 (7) | 8.7 (4) | 3.9 (3) | 3.9 (4) | 15/15 |
| CMAma brockhoff noiseless | 6.1 (5) | 4.9 (8) | 5.3 (0.7) | 5.7 (8) | 5.9 (8) | 2.6 (2) | 2.6 (2) | 15/15 |
| CMAmah brockhoff noiseless | 6.5 (6) | 7.3 (6) | 8.1 (6) | 8.8 (5) | 8.8 (6) | 3.9 (3) | 3.8 (2) | 15/15 |
| CMAmh brockhoff noiseless | 8.3 (9) | 8.9 (10) | 10 (9) | 10 (5) | 10 (7) | 4.5 (3) | 4.5 (3) | 15/15 |
| DBRCGA chuang noiseless | 616 (2359) | 1327 (933) | 9435 (1e4) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DE-AUTO voglis noiseless | 2.8 (3) | 2.2 (4) | 2.2 (2) | 2.2 (2) | 2.2 (2) | 0.93 (0.8) | 1.2 (1.0) | 15/15 |
| DE-BFGS voglis noiseless | 2.8 (2) | 2.0 (1) | 1.9 (1) | 2.0 (1.0) | 1.9 (1) | 0.80 (0.4) | 1.1 (2) | 15/15 |
| DE-ROLL voglis noiseless | 21 (8) | 112 (361) | 148 (21) | 173 (414) | 211 (404) | 118 (152) | 485 (458) | 1/15 |
| DE-SIMPLEX voglis noiseless | 4.1 (4) | 3.1 (2) | 3.4 (4) | 3.5 (3) | 3.4 (2) | 1.6 (1) | 2.0 (2) | 15/15 |
| DEAE posik noiseless | 15 (5) | 11 (4) | 11 (4) | 12 (5) | 13 (7) | 5.6 (3) | 5.6 (3) | 15/15 |
| DE posik noiseless | 103 (43) | 107 (132) | 117 (82) | 129 (98) | 135 (90) | 63 (41) | 66 (25) | 15/15 |
| DEb posik noiseless | 103 (70) | 107 (109) | 117 (85) | 129 (173) | 135 (147) | 63 (58) | 66 (43) | 15/15 |
| DEctpb posik noiseless | 89 (28) | 77 (92) | 104 (119) | 122 (52) | 138 (137) | 70 (14) | 80 (57) | 14/15 |
| IPOPsaACM loshchilov noiseless | 3.8 (3) | 2.9 (2) | 2.8 (2) | 2.8 (1) | 2.8 (3) | 1.2 (1) | 1.2 (1) | 15/15 |
| JADE posik noiseless | 24 (8) | 13 (3) | 12 (7) | 13 (4) | 14 (7) | 6.1 (2) | 6.2 (3) | 15/15 |
| JADEb posik noiseless | 18 (12) | 15 (8) | 15 (15) | 15 (14) | 15 (10) | 6.7 (5) | 6.7 (3) | 15/15 |
| JADEctpb posik noiseless | 24 (3) | 13 (3) | 12 (3) | 13 (7) | 14 (3) | 6.1 (3) | 6.2 (4) | 15/15 |
| MVDE melo noiseless | 207 (108) | 342 (520) | 714 (1426) | 1077 (1332) | 1417 (1655) | 1221 (1712) | 3255 (3831) | 2/15 |
| NBIPOPaCMA loshchilov noiseless | 11 (4) | 6.9 (4) | 6.5 (4) | 6.6 (6) | 6.5 (7) | 2.7 (2) | 2.8 (2) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 11 (2) | 8.2 (13) | 8.0 (10) | 8.0 (5) | 7.9 (9) | 3.4 (4) | 3.4 (2) | 15/15 |
| PSO-BFGS voglis noiseless | 2.8 (2) | 1.7 (1) | 1.5 (1) | 1.5 (1) | 1.7 (2) | 0.73 (0.7) | 0.86 (1) | 15/15 |
| SNES schaul noiseless | 43 (46) | 219 (273) | 296 (598) | 2093 (1611) | 5021 (4502) | ∞ | ∞1e6 | 0/15 |
| xNES schaul noiseless | 11 (2) | 24 (47) | 32 (41) | 48 (31) | 50 (114) | 22 (43) | 25 (36) | 15/15 |
| xNESas schaul noiseless | 16 (30) | 36 (27) | 36 (42) | 44 (70) | 51 (97) | 21 (37) | 31 (33) | 15/15 |
| Δ fopt f13, 5-D |
1e1 132 |
1e0 195 |
1e-1 250 |
1e-2 319 |
1e-3 1310 |
1e-5 1752 |
1e-7 2255 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 99 (245) | 474 (601) | 2135 (4650) | 5323 (5958) | 5449 (1e4) | 8.1e4 (9e4) | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 3.2 (2) | 3.8 (2) | 4.3 (0.6) | 4.1 (0.3) | 1.2 (0.2) | 1.2 (0.1) | 1.1 (0.1) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.2 (0.3) | 1.3 (0.4) | 1.3 (0.3) | 1.3 (0.4) | 0.37 (0.1) | 0.34 (0.1) | 0.32 (0.0) | 15/15 |
| CMAES posik noiseless | 4.5 (3) | 4.8 (3) | 5.1 (2) | 4.7 (1) | 1.5 (0.4) | 1.5 (0.3) | 1.4 (0.2) | 15/15 |
| CMA brockhoff noiseless | 3.3 (2) | 5.3 (3) | 5.5 (1) | 5.0 (1) | 1.4 (0.2) | 1.6 (0.2) | 1.5 (0.6) | 15/15 |
| CMAa brockhoff noiseless | 2.9 (1) | 4.1 (2) | 4.5 (1) | 4.1 (0.6) | 1.2 (0.2) | 1.2 (0.1) | 1.2 (0.1) | 15/15 |
| CMAm brockhoff noiseless | 4.0 (2) | 5.0 (3) | 4.7 (2) | 5.3 (3) | 1.7 (0.6) | 1.8 (0.7) | 2.0 (0.8) | 15/15 |
| CMAma brockhoff noiseless | 3.1 (2) | 4.5 (3) | 4.6 (2) | 4.2 (1) | 1.2 (0.3) | 1.3 (0.2) | 1.2 (0.2) | 15/15 |
| CMAmah brockhoff noiseless | 4.0 (4) | 5.6 (3) | 5.6 (2) | 5.1 (2) | 1.7 (0.5) | 1.7 (0.3) | 1.6 (0.4) | 15/15 |
| CMAmh brockhoff noiseless | 4.7 (5) | 10 (4) | 8.9 (2) | 8.6 (4) | 2.2 (0.4) | 2.5 (0.9) | 2.8 (0.9) | 15/15 |
| DBRCGA chuang noiseless | 22 (8) | 138 (152) | 603 (1392) | 1457 (2857) | 1034 (873) | 2061 (2314) | ∞5e5 | 0/15 |
| DE-AUTO voglis noiseless | 0.99 (0.1) | 0.87 (0.0) | 0.83 (0.1) | 0.78 (0.0) | 0.22 (0.0) | 1.1 (0.3) | 0.96 (0.2) | 15/15 |
| DE-BFGS voglis noiseless | 1.0 (0.4) | 0.91 (0.3) | 0.87 (0.0) | 0.82 (0.1) | 0.23 (0.0) | 2.6 (1) | 528 (433) | 0/15 |
| DE-ROLL voglis noiseless | 20 (42) | 43 (44) | 53 (35) | 55 (20) | 16 (6) | 16 (8) | 79 (15) | 12/15 |
| DE-SIMPLEX voglis noiseless | 4.8 (4) | 6.2 (3) | 8.4 (5) | 8.2 (6) | 2.3 (1) | 2.2 (1) | 2.7 (3) | 15/15 |
| DEAE posik noiseless | 6.0 (1) | 6.4 (0.4) | 6.7 (0.2) | 6.8 (0.4) | 2.0 (0.1) | 2.0 (0.1) | 2.0 (0.1) | 15/15 |
| DE posik noiseless | 14 (5) | 26 (10) | 39 (6) | 54 (17) | 19 (8) | 28 (6) | 45 (43) | 6/15 |
| DEb posik noiseless | 14 (5) | 26 (9) | 39 (7) | 54 (18) | 19 (4) | 28 (5) | 45 (22) | 6/15 |
| DEctpb posik noiseless | 17 (7) | 30 (12) | 49 (15) | 66 (15) | 23 (7) | 30 (5) | 34 (5) | 12/15 |
| IPOPsaACM loshchilov noiseless | 1.2 (0.4) | 1.1 (0.2) | 1.2 (0.4) | 1.2 (0.2) | 0.33 (0.1) | 0.35 (0.0) | 0.33 (0.0) | 15/15 |
| JADE posik noiseless | 8.2 (0.8) | 12 (2) | 12 (2) | 11 (1) | 3.1 (0.3) | 2.9 (0.3) | 2.6 (0.2) | 15/15 |
| JADEb posik noiseless | 5.4 (0.9) | 8.9 (3) | 11 (3) | 11 (3) | 3.5 (1) | 3.5 (0.8) | 3.3 (1) | 15/15 |
| JADEctpb posik noiseless | 8.2 (1) | 12 (2) | 12 (1) | 11 (2) | 3.1 (0.2) | 2.9 (0.2) | 2.6 (0.3) | 15/15 |
| MVDE melo noiseless | 29 (9) | 92 (42) | 239 (105) | 487 (223) | 280 (131) | 2644 (1552) | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 2.7 (0.5) | 3.3 (1) | 3.9 (1) | 3.7 (0.7) | 1.1 (0.2) | 1.2 (0.2) | 1.2 (0.1) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.9 (2) | 4.4 (2) | 4.7 (2) | 4.3 (1) | 1.2 (0.3) | 1.3 (0.3) | 1.2 (0.1) | 15/15 |
| PSO-BFGS voglis noiseless | 0.99 (0.1) | 0.87 (0.1) | 0.84 (0.1) | 0.79 (0.1) | 0.22 (0.0) | 181 (217) | ∞5e5 | 0/15 |
| SNES schaul noiseless | 44 (38) | 157 (125) | 335 (298) | 981 (736) | 860 (1123) | 2575 (1717) | 6384 (1e4) | 0/15 |
| xNES schaul noiseless | 3.6 (0.6) | 4.3 (0.2) | 4.7 (0.2) | 4.8 (0.1) | 1.4 (0.1) | 1.5 (0.1) | 1.5 (0.1) | 15/15 |
| xNESas schaul noiseless | 3.3 (0.5) | 3.7 (0.5) | 4.0 (0.3) | 4.0 (1) | 1.3 (0.2) | 1.4 (1.0) | 1.5 (0.1) | 15/15 |
| Δ fopt f14, 5-D |
1e1 10 |
1e0 41 |
1e-1 58 |
1e-2 90 |
1e-3 139 |
1e-5 251 |
1e-7 476 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1.7 (3) | 4.7 (1) | 6.4 (0.8) | 7.0 (2) | 9.2 (3) | 123 (79) | 4.8e4 (5e4) | 0/15 |
| BIPOPaCMA loshchilov noiseless | 2.2 (2) | 2.6 (1.0) | 3.3 (0.7) | 3.6 (0.6) | 3.9 (0.4) | 3.9 (0.5) | 3.2 (0.2) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.4 (2) | 2.3 (0.5) | 2.4 (0.3) | 2.5 (0.4) | 2.2 (0.3) | 1.8 (0.3) | 1.3 (0.1) | 15/15 |
| CMAES posik noiseless | 1.4 (1) | 2.9 (1) | 3.8 (0.8) | 4.0 (0.5) | 4.2 (0.9) | 5.4 (1) | 4.4 (0.3) | 15/15 |
| CMA brockhoff noiseless | 2.3 (3) | 2.8 (1) | 3.5 (1) | 3.9 (0.8) | 4.2 (0.9) | 5.4 (0.6) | 4.4 (0.5) | 15/15 |
| CMAa brockhoff noiseless | 2.5 (3) | 2.7 (2) | 3.5 (1.0) | 4.0 (1.0) | 4.0 (0.5) | 3.9 (0.6) | 3.1 (0.3) | 15/15 |
| CMAm brockhoff noiseless | 1.6 (1) | 2.8 (1) | 3.2 (1) | 3.3 (1) | 4.1 (1) | 5.4 (1) | 4.4 (0.4) | 15/15 |
| CMAma brockhoff noiseless | 1.8 (2) | 2.8 (0.8) | 3.3 (0.5) | 3.2 (1) | 3.7 (0.7) | 4.0 (0.8) | 3.0 (0.4) | 15/15 |
| CMAmah brockhoff noiseless | 1.4 (1) | 2.1 (0.8) | 2.4 (0.5) | 3.0 (0.8) | 3.4 (0.9) | 4.1 (0.9) | 3.5 (0.4) | 15/15 |
| CMAmh brockhoff noiseless | 1.4 (1) | 2.1 (0.9) | 2.5 (1.0) | 2.8 (2) | 4.1 (0.8) | 6.4 (0.7) | 5.1 (0.6) | 15/15 |
| DBRCGA chuang noiseless | 1.5 (2) | 15 (5) | 25 (3) | 24 (3) | 25 (10) | 110 (64) | 1315 (822) | 1/15 |
| DE-AUTO voglis noiseless | 1.7 (0.9) | 2.0 (0.3) | 1.7 (0.1) | 1.3 (0.2) | 0.99 (0.1) | 0.73 (0.1) | 5.1 (5) | 15/15 |
| DE-BFGS voglis noiseless | 1.0 (1) | 1.8 (0.1) | 1.5 (0.3) | 1.2 (0.2) | 0.94 (0.1) | 0.71 (0.1) | 6.4 (9) | 13/15 |
| DE-ROLL voglis noiseless | 1.4 (2) | 4.7 (5) | 4.9 (2) | 5.0 (3) | 10 (10) | 113 (17) | 1823 (2891) | 0/15 |
| DE-SIMPLEX voglis noiseless | 0.93 (2) | 5.3 (3) | 4.9 (2) | 3.9 (2) | 3.1 (0.9) | 2.2 (0.5) | 1.5 (0.2) | 15/15 |
| DEAE posik noiseless | 2.2 (1) | 6.3 (2) | 11 (2) | 11 (1) | 9.4 (1) | 7.9 (0.9) | 5.6 (0.3) | 15/15 |
| DE posik noiseless | 1.8 (1.0) | 7.2 (4) | 12 (2) | 12 (2) | 15 (3) | 37 (6) | 47 (18) | 15/15 |
| DEb posik noiseless | 1.8 (3) | 7.2 (4) | 12 (1) | 12 (3) | 15 (3) | 37 (8) | 47 (11) | 15/15 |
| DEctpb posik noiseless | 1.1 (1) | 6.2 (4) | 12 (2) | 14 (3) | 16 (4) | 40 (13) | 52 (10) | 15/15 |
| IPOPsaACM loshchilov noiseless | 2.8 (1) | 2.4 (1) | 2.5 (0.7) | 2.4 (0.3) | 2.1 (0.3) | 1.8 (0.2) | 1.3 (0.1) | 15/15 |
| JADE posik noiseless | 0.93 (0.8) | 5.3 (3) | 8.9 (1) | 9.1 (1) | 10 (2) | 12 (0.8) | 8.2 (0.5) | 15/15 |
| JADEb posik noiseless | 1.3 (1) | 4.0 (0.5) | 6.1 (0.8) | 6.2 (1) | 7.8 (2) | 10 (2) | 8.2 (3) | 15/15 |
| JADEctpb posik noiseless | 0.93 (1) | 5.3 (1) | 8.9 (1.0) | 9.1 (2) | 10 (2) | 12 (0.7) | 8.2 (0.9) | 15/15 |
| MVDE melo noiseless | 0.89 (1) | 14 (6) | 26 (6) | 29 (4) | 38 (10) | 173 (51) | 591 (259) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 1.7 (2) | 2.5 (1) | 3.6 (0.5) | 3.9 (0.9) | 4.1 (0.3) | 4.2 (0.3) | 3.2 (0.4) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.0 (2) | 3.1 (1) | 3.9 (2) | 3.9 (1) | 4.3 (0.5) | 4.0 (0.3) | 3.2 (0.4) | 15/15 |
| PSO-BFGS voglis noiseless | 2.2 (0.5) | 1.9 (0.3) | 1.6 (0.2) | 1.3 (0.1) | 0.98 (0.1) | 0.76 (0.1) | 134 (213) | 4/15 |
| SNES schaul noiseless | 2.5 (3) | 2.4 (1) | 3.3 (0.8) | 4.2 (0.3) | 8.3 (10) | 1.2e4 (7969) | ∞1e6 | 0/15 |
| xNES schaul noiseless | 2.3 (2) | 2.1 (1) | 4.2 (2) | 5.5 (0.8) | 5.5 (0.5) | 5.1 (0.6) | 3.9 (0.2) | 15/15 |
| xNESas schaul noiseless | 1.9 (0.9) | 1.9 (0.6) | 3.9 (0.8) | 4.9 (1) | 4.9 (0.5) | 4.6 (0.3) | 3.3 (0.3) | 15/15 |
| Δ fopt f15, 5-D |
1e1 511 |
1e0 9310 |
1e-1 19369 |
1e-2 19743 |
1e-3 20073 |
1e-5 20769 |
1e-7 21359 |
#succ 14/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 5.3 (5) | 7.7 (8) | 17 (27) | 16 (27) | 16 (26) | 16 (26) | 15 (24) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 1.5 (2) | 1.1 (1) | 1.4 (1) | 1.4 (1) | 1.3 (1) | 1.3 (1) | 1.3 (1) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.4 (0.5) | 0.59 (0.5) | 0.65 (0.5) | 0.65 (0.5) | 0.64 (0.4) | 0.62 (0.5) | 0.61 (0.4) | 15/15 |
| CMAES posik noiseless | 2.1 (4) | 5.0 (6) | 15 (12) | 15 (15) | 15 (23) | 14 (12) | 14 (9) | 9/15 |
| CMA brockhoff noiseless | 1.6 (0.6) | 0.74 (0.5) | 0.86 (0.5) | 0.86 (0.4) | 0.86 (0.7) | 0.86 (0.6) | 0.87 (0.8) | 15/15 |
| CMAa brockhoff noiseless | 1.5 (0.1) | 1.1 (0.8) | 1.2 (0.8) | 1.2 (0.6) | 1.2 (0.6) | 1.2 (0.6) | 1.2 (1) | 15/15 |
| CMAm brockhoff noiseless | 1.8 (2) | 0.74 (0.6) | 0.66 (0.3) | 0.67 (0.2) | 0.67 (0.4) | 0.67 (0.2) | 0.68 (0.4) | 15/15 |
| CMAma brockhoff noiseless | 1.0 (0.4) | 0.86 (0.5) | 1.1 (1) | 1.1 (1) | 1.1 (1) | 1.1 (0.7) | 1.1 (0.7) | 15/15 |
| CMAmah brockhoff noiseless | 2.0 (1) | 0.98 (0.2) | 1.1 (0.4) | 1.1 (0.3) | 1.1 (1) | 1.1 (0.6) | 1.1 (0.6) | 15/15 |
| CMAmh brockhoff noiseless | 3.2 (3) | 0.95 (0.6) | 1.1 (0.5) | 1.1 (0.5) | 1.1 (0.3) | 1.1 (0.4) | 1.1 (0.5) | 15/15 |
| DBRCGA chuang noiseless | 3.7 (2) | 26 (24) | 84 (102) | 83 (126) | 81 (90) | 79 (48) | 77 (43) | 4/15 |
| DE-AUTO voglis noiseless | 15 (7) | 6.1 (7) | 11 (18) | 11 (5) | 11 (10) | 11 (10) | 10 (14) | 13/15 |
| DE-BFGS voglis noiseless | 3.8 (5) | 1.1 (1) | 1.6 (1.0) | 1.6 (1) | 1.6 (1) | 1.5 (1) | 1.5 (0.8) | 15/15 |
| DE-ROLL voglis noiseless | 24 (13) | 7.0 (6) | 12 (13) | 12 (20) | 12 (9) | 12 (14) | 11 (11) | 13/15 |
| DE-SIMPLEX voglis noiseless | 10 (5) | 3.1 (2) | 3.2 (3) | 3.1 (3) | 3.0 (3) | 2.9 (3) | 2.9 (3) | 15/15 |
| DEAE posik noiseless | 3.9 (1) | 4.2 (3) | 4.8 (4) | 4.7 (3) | 4.6 (4) | 4.5 (3) | 4.4 (5) | 14/15 |
| DE posik noiseless | 6.1 (5) | 4.3 (4) | 6.0 (8) | 5.9 (3) | 5.9 (7) | 5.7 (6) | 5.6 (3) | 13/15 |
| DEb posik noiseless | 6.1 (4) | 4.3 (4) | 6.0 (7) | 5.9 (4) | 5.9 (5) | 5.7 (10) | 5.6 (7) | 13/15 |
| DEctpb posik noiseless | 6.0 (3) | 4.9 (6) | 7.1 (10) | 7.2 (7) | 7.2 (6) | 7.1 (7) | 7.1 (11) | 12/15 |
| IPOPsaACM loshchilov noiseless | 1.6 (2) | 0.42 (0.5) | 0.72 (0.3) | 0.71 (0.4) | 0.71 (0.8) | 0.70 (0.6) | 0.69 (0.6) | 15/15 |
| JADE posik noiseless | 3.7 (0.8) | 7.5 (28) | 39 (93) | 39 (51) | 39 (31) | 59 (52) | 175 (258) | 1/15 |
| JADEb posik noiseless | 3.0 (2) | 14 (9) | 32 (45) | 31 (36) | 39 (25) | 38 (48) | 37 (49) | 4/15 |
| JADEctpb posik noiseless | 3.7 (1) | 7.5 (9) | 39 (104) | 39 (35) | 39 (87) | 59 (76) | 175 (228) | 1/15 |
| MVDE melo noiseless | 5.1 (3) | 12 (12) | 26 (27) | 28 (51) | 31 (29) | 32 (44) | 32 (27) | 11/15 |
| NBIPOPaCMA loshchilov noiseless | 1.7 (2) | 0.99 (1.0) | 1.6 (1) | 1.6 (0.9) | 1.6 (0.8) | 1.5 (1) | 1.5 (1) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 1.4 (0.4) | 1.1 (1) | 1.2 (0.6) | 1.2 (0.7) | 1.2 (1.0) | 1.2 (1.0) | 1.2 (0.6) | 15/15 |
| PSO-BFGS voglis noiseless | 10 (6) | 6.6 (7) | 39 (54) | 38 (54) | 37 (61) | 36 (32) | 35 (48) | 8/15 |
| SNES schaul noiseless | 5.0 (6) | 14 (10) | 23 (24) | 23 (24) | 22 (17) | 22 (24) | 21 (38) | 14/15 |
| xNES schaul noiseless | 1.8 (1) | 5.3 (13) | 25 (67) | 25 (18) | 24 (30) | 24 (46) | 23 (16) | 11/15 |
| xNESas schaul noiseless | 3.6 (4) | 4.3 (3) | 18 (27) | 18 (14) | 18 (7) | 17 (31) | 16 (21) | 14/15 |
| Δ fopt f16, 5-D |
1e1 120 |
1e0 612 |
1e-1 2662 |
1e-2 10163 |
1e-3 10449 |
1e-5 11644 |
1e-7 12095 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 7.0 (9) | 325 (376) | 154 (150) | 65 (40) | 66 (74) | 70 (85) | 75 (90) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 3.6 (2) | 3.5 (5) | 1.8 (2) | 0.75 (1.0) | 0.74 (0.5) | 0.71 (0.7) | 0.71 (0.8) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 3.2 (4) | 4.3 (2) | 1.6 (0.7) | 0.69 (0.6) | 0.82 (0.7) | 0.77 (0.7) | 0.79 (0.6) | 15/15 |
| CMAES posik noiseless | 2.0 (1) | 3.6 (4) | 2.7 (4) | 3.2 (6) | 4.5 (8) | 5.8 (10) | 5.7 (4) | 15/15 |
| CMA brockhoff noiseless | 2.3 (2) | 3.1 (3) | 1.9 (2) | 0.73 (0.3) | 1.1 (1) | 1.00 (2) | 1.00 (1) | 15/15 |
| CMAa brockhoff noiseless | 1.7 (1) | 2.8 (2) | 2.2 (2) | 0.77 (0.6) | 0.84 (0.6) | 0.80 (0.3) | 0.80 (0.5) | 15/15 |
| CMAm brockhoff noiseless | 2.9 (2) | 5.0 (9) | 3.0 (4) | 1.0 (0.5) | 1.0 (0.9) | 1.1 (0.6) | 1.1 (0.5) | 15/15 |
| CMAma brockhoff noiseless | 2.3 (2) | 3.3 (2) | 1.7 (0.9) | 0.84 (0.4) | 0.88 (0.5) | 0.83 (0.8) | 0.83 (0.3) | 15/15 |
| CMAmah brockhoff noiseless | 2.3 (5) | 3.8 (4) | 2.4 (2) | 0.94 (0.4) | 0.94 (1) | 0.90 (1) | 0.90 (0.8) | 15/15 |
| CMAmh brockhoff noiseless | 2.9 (1) | 3.8 (2) | 2.5 (1) | 1.2 (2) | 1.2 (2) | 1.1 (1) | 1.1 (1) | 15/15 |
| DBRCGA chuang noiseless | 2.2 (1) | 27 (34) | 38 (57) | 34 (54) | 50 (77) | 86 (108) | 101 (85) | 5/15 |
| DE-AUTO voglis noiseless | 6.6 (2) | 115 (176) | 99 (182) | 65 (66) | 93 (192) | 86 (173) | 605 (676) | 1/15 |
| DE-BFGS voglis noiseless | 8.0 (4) | 17 (11) | 21 (7) | 12 (0.9) | 33 (21) | 30 (12) | 585 (436) | 0/15 |
| DE-ROLL voglis noiseless | 8.3 (17) | 69 (57) | 62 (99) | 69 (100) | 73 (53) | 110 (118) | 616 (394) | 0/15 |
| DE-SIMPLEX voglis noiseless | 2.4 (2) | 7.6 (8) | 19 (16) | 7.6 (4) | 10 (26) | 10 (7) | 37 (73) | 7/15 |
| DEAE posik noiseless | 3.2 (1) | 26 (21) | 12 (9) | 3.2 (2) | 3.2 (2) | 3.3 (3) | 3.2 (3) | 15/15 |
| DE posik noiseless | 5.2 (6) | 31 (32) | 17 (16) | 8.1 (7) | 11 (7) | 10 (8) | 10 (5) | 14/15 |
| DEb posik noiseless | 5.2 (3) | 31 (9) | 17 (10) | 8.1 (5) | 11 (13) | 10 (4) | 10 (5) | 14/15 |
| DEctpb posik noiseless | 3.9 (4) | 54 (33) | 52 (27) | 53 (59) | 165 (143) | 149 (140) | 144 (145) | 2/15 |
| IPOPsaACM loshchilov noiseless | 3.1 (4) | 2.4 (2) | 1.0 (0.8) | 0.49 (0.6) | 0.52 (0.5) | 0.55 (0.3) | 0.55 (0.2) | 15/15 |
| JADE posik noiseless | 2.9 (4) | 10 (2) | 36 (74) | 64 (78) | ∞ | ∞ | ∞2e5 | 0/15 |
| JADEb posik noiseless | 3.1 (3) | 4.5 (4) | 6.8 (3) | 4.4 (7) | 7.6 (7) | 8.4 (13) | 8.7 (16) | 12/15 |
| JADEctpb posik noiseless | 2.9 (5) | 10 (4) | 36 (53) | 64 (41) | ∞ | ∞ | ∞2e5 | 0/15 |
| MVDE melo noiseless | 1.8 (2) | 24 (14) | 90 (164) | 116 (130) | 1411 (1603) | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 2.6 (2) | 4.6 (7) | 2.4 (2) | 0.99 (0.5) | 0.99 (2) | 0.94 (0.7) | 0.93 (0.8) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 1.8 (2) | 2.7 (5) | 1.0 (1) | 0.55 (0.5) | 0.56 (0.6) | 0.55 (0.5) | 0.57 (0.5) | 15/15 |
| PSO-BFGS voglis noiseless | 7.0 (9) | 41 (31) | 75 (58) | 62 (115) | 111 (70) | 298 (353) | 594 (892) | 1/15 |
| SNES schaul noiseless | 3.0 (3) | 7.8 (12) | 13 (24) | 5.1 (6) | 11 (21) | 41 (24) | 61 (47) | 9/15 |
| xNES schaul noiseless | 2.0 (2) | 3.6 (8) | 4.4 (5) | 2.4 (1) | 2.5 (4) | 2.3 (4) | 2.2 (2) | 15/15 |
| xNESas schaul noiseless | 2.3 (3) | 5.3 (6) | 1.7 (2) | 1.6 (2) | 1.8 (2) | 1.6 (3) | 1.6 (1) | 15/15 |
| Δ fopt f17, 5-D |
1e1 5.0 |
1e0 215 |
1e-1 899 |
1e-2 2861 |
1e-3 3669 |
1e-5 6351 |
1e-7 7934 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 3.2 (7) | 1.8 (0.5) | 0.95 (0.2) | 0.49 (0.1) | 2.8 (9) | 7.5 (7) | 11 (13) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 3.9 (6) | 0.86 (0.3) | 1.1 (0.1) | 0.83 (0.6) | 0.83 (0.5) | 0.94 (0.6) | 1.4 (0.7) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 4.0 (2) | 1.0 (1) | 1.2 (0.6) | 0.80 (0.6) | 0.92 (0.5) | 1.1 (0.4) | 1.4 (1) | 15/15 |
| CMAES posik noiseless | 4.3 (8) | 0.96 (0.4) | 0.74 (0.2) | 0.74 (1) | 1.2 (2) | 8.5 (9) | 30 (14) | 9/15 |
| CMA brockhoff noiseless | 1.9 (3) | 0.82 (0.5) | 0.93 (0.2) | 0.75 (0.6) | 0.89 (0.5) | 1.1 (0.6) | 1.2 (0.4) | 15/15 |
| CMAa brockhoff noiseless | 2.7 (2) | 1.3 (2) | 0.77 (0.5) | 0.69 (0.6) | 0.89 (0.3) | 0.81 (0.5) | 1.0 (0.4) | 15/15 |
| CMAm brockhoff noiseless | 3.6 (5) | 0.85 (0.6) | 0.58 (0.7) | 0.47 (0.5) | 0.73 (0.2) | 0.77 (0.5) | 0.91 (0.3) | 15/15 |
| CMAma brockhoff noiseless | 3.5 (2) | 1.5 (0.2) | 1.1 (4) | 0.71 (1.0) | 0.84 (0.4) | 0.82 (0.5) | 0.96 (0.4) | 15/15 |
| CMAmah brockhoff noiseless | 3.2 (2) | 1.5 (2) | 2.1 (2) | 1.2 (0.6) | 1.3 (0.9) | 1.1 (0.6) | 1.0 (0.4) | 15/15 |
| CMAmh brockhoff noiseless | 2.6 (4) | 1.2 (4) | 2.6 (3) | 1.5 (1) | 1.5 (1) | 1.4 (0.5) | 1.5 (0.4) | 15/15 |
| DBRCGA chuang noiseless | 3.9 (1) | 5.4 (0.7) | 7.7 (18) | 12 (12) | 16 (18) | 38 (35) | 88 (157) | 4/15 |
| DE-AUTO voglis noiseless | 3.9 (5) | 163 (463) | 120 (170) | 52 (52) | 47 (35) | 35 (58) | 41 (33) | 10/15 |
| DE-BFGS voglis noiseless | 3.1 (3) | 7.1 (5) | 35 (56) | 12 (36) | 10 (29) | 6.9 (0.8) | 145 (230) | 0/15 |
| DE-ROLL voglis noiseless | 2.8 (3) | 47 (36) | 125 (64) | 60 (88) | 54 (73) | 45 (43) | 898 (821) | 1/15 |
| DE-SIMPLEX voglis noiseless | 2.6 (2) | 23 (11) | 55 (5) | 29 (38) | 24 (46) | 15 (17) | 887 (789) | 0/15 |
| DEAE posik noiseless | 3.2 (5) | 2.7 (0.9) | 1.5 (0.3) | 0.78 (0.1) | 0.85 (0.1) | 0.80 (0.1) | 0.91 (0.4) | 15/15 |
| DE posik noiseless | 4.2 (8) | 3.2 (0.7) | 2.2 (0.3) | 1.3 (0.4) | 2.1 (0.5) | 2.8 (2) | 3.3 (3) | 15/15 |
| DEb posik noiseless | 4.2 (2) | 3.2 (0.8) | 2.2 (0.3) | 1.3 (0.2) | 2.1 (0.5) | 2.8 (3) | 3.3 (3) | 15/15 |
| DEctpb posik noiseless | 4.3 (8) | 3.4 (2) | 2.6 (0.7) | 1.7 (0.5) | 2.1 (0.7) | 2.1 (0.5) | 3.7 (6) | 15/15 |
| IPOPsaACM loshchilov noiseless | 5.1 (5) | 1.7 (0.4) | 1.1 (0.3) | 0.83 (0.6) | 0.85 (0.4) | 1.2 (0.4) | 1.4 (0.7) | 15/15 |
| JADE posik noiseless | 3.5 (4) | 2.5 (1) | 1.9 (0.3) | 1.0 (0.2) | 1.2 (0.2) | 1.2 (0.1) | 1.2 (0.2) | 15/15 |
| JADEb posik noiseless | 3.2 (4) | 1.4 (0.6) | 3.3 (3) | 3.7 (4) | 3.4 (7) | 5.3 (3) | 9.0 (5) | 13/15 |
| JADEctpb posik noiseless | 3.5 (4) | 2.5 (0.7) | 1.9 (0.3) | 1.0 (0.1) | 1.2 (0.2) | 1.2 (0.1) | 1.2 (0.2) | 15/15 |
| MVDE melo noiseless | 3.1 (3) | 5.8 (2) | 5.8 (2) | 4.5 (1) | 6.8 (2) | 10 (6) | 32 (67) | 13/15 |
| NBIPOPaCMA loshchilov noiseless | 6.7 (4) | 5.7 (2) | 2.1 (1) | 0.95 (1) | 1.1 (1) | 1.0 (0.7) | 1.3 (0.6) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 5.7 (7) | 0.99 (0.4) | 0.88 (1) | 0.49 (0.5) | 0.98 (0.7) | 0.90 (0.4) | 1.0 (0.4) | 15/15 |
| PSO-BFGS voglis noiseless | 1.6 (1) | 26 (10) | 21 (24) | 14 (3) | 13 (21) | 9.2 (12) | 907 (1467) | 0/15 |
| SNES schaul noiseless | 5.6 (7) | 4.2 (0.6) | 3.6 (11) | 2.6 (4) | 2.7 (3) | 8.1 (9) | 19 (17) | 14/15 |
| xNES schaul noiseless | 4.7 (5) | 1.1 (0.6) | 0.79 (0.1) | 0.42 (0.1) | 0.47 (0.1) | 1.3 (1.0) | 6.1 (8) | 15/15 |
| xNESas schaul noiseless | 7.1 (5) | 1.0 (0.3) | 1.1 (1) | 0.76 (1.0) | 0.81 (0.7) | 1.4 (2) | 2.0 (2) | 15/15 |
| Δ fopt f18, 5-D |
1e1 103 |
1e0 378 |
1e-1 3968 |
1e-2 8451 |
1e-3 9280 |
1e-5 10905 |
1e-7 12469 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1.9 (0.9) | 2.4 (1) | 5.8 (14) | 18 (16) | 36 (34) | 82 (48) | 80 (59) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 1.2 (0.6) | 2.0 (3) | 0.62 (0.7) | 0.69 (0.4) | 0.76 (0.4) | 0.86 (0.4) | 0.98 (0.7) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.5 (6) | 3.1 (4) | 0.82 (1.0) | 0.71 (0.6) | 0.76 (0.9) | 1.2 (0.9) | 1.4 (0.5) | 15/15 |
| CMAES posik noiseless | 1.2 (1) | 2.2 (4) | 1.5 (2) | 4.1 (6) | 11 (10) | 76 (118) | 92 (82) | 3/15 |
| CMA brockhoff noiseless | 1.2 (1) | 1.6 (0.2) | 1.6 (2) | 0.93 (0.7) | 0.97 (0.7) | 1.0 (0.2) | 1.1 (0.3) | 15/15 |
| CMAa brockhoff noiseless | 0.83 (0.3) | 1.7 (3) | 0.44 (0.4) | 0.48 (0.3) | 0.66 (0.4) | 0.76 (0.3) | 0.94 (0.3) | 15/15 |
| CMAm brockhoff noiseless | 0.94 (0.7) | 0.77 (0.3) | 0.53 (0.6) | 0.68 (0.4) | 0.79 (0.3) | 0.82 (0.2) | 0.85 (0.2) | 15/15 |
| CMAma brockhoff noiseless | 0.89 (0.4) | 1.2 (0.2) | 0.63 (0.9) | 0.52 (0.5) | 0.69 (0.7) | 0.67 (0.2) | 0.71 (0.5) | 15/15 |
| CMAmah brockhoff noiseless | 6.2 (39) | 7.2 (13) | 1.5 (0.7) | 1.1 (0.6) | 1.2 (0.5) | 1.1 (0.7) | 1.1 (0.4) | 15/15 |
| CMAmh brockhoff noiseless | 0.51 (0.3) | 2.6 (11) | 1.1 (1) | 1.1 (0.5) | 1.3 (0.7) | 1.3 (0.6) | 1.3 (0.7) | 15/15 |
| DBRCGA chuang noiseless | 5.0 (2) | 12 (46) | 5.4 (7) | 13 (13) | 100 (206) | ∞ | ∞5e5 | 0/15 |
| DE-AUTO voglis noiseless | 48 (21) | 161 (687) | 60 (67) | 55 (90) | 54 (97) | 60 (60) | 84 (37) | 2/15 |
| DE-BFGS voglis noiseless | 5.7 (3) | 18 (6) | 28 (32) | 14 (25) | 19 (27) | 20 (34) | 587 (343) | 0/15 |
| DE-ROLL voglis noiseless | 49 (69) | 112 (156) | 65 (48) | 60 (54) | 88 (41) | ∞ | ∞5e5 | 0/15 |
| DE-SIMPLEX voglis noiseless | 23 (14) | 155 (195) | 62 (63) | 68 (61) | 65 (74) | 74 (116) | 575 (1557) | 0/15 |
| DEAE posik noiseless | 2.4 (1) | 2.8 (0.8) | 0.50 (0.1) | 0.36 (0.0) | 0.43 (0.1) | 0.53 (0.1) | 0.69 (0.6) | 15/15 |
| DE posik noiseless | 2.5 (1) | 4.4 (2) | 1.4 (0.4) | 2.1 (4) | 2.8 (1) | 7.7 (12) | 40 (77) | 5/15 |
| DEb posik noiseless | 2.5 (2) | 4.4 (2) | 1.4 (0.7) | 2.1 (4) | 2.8 (2) | 7.7 (12) | 40 (70) | 5/15 |
| DEctpb posik noiseless | 2.9 (2) | 4.9 (3) | 1.5 (1) | 1.6 (0.6) | 2.3 (0.8) | 6.7 (8) | 290 (246) | 1/15 |
| IPOPsaACM loshchilov noiseless | 2.8 (14) | 1.5 (2) | 0.64 (0.7) | 0.79 (0.9) | 0.85 (0.7) | 1.0 (0.2) | 1.1 (0.4) | 15/15 |
| JADE posik noiseless | 1.9 (0.9) | 3.3 (1) | 0.72 (0.1) | 0.53 (0.1) | 0.60 (0.1) | 1.1 (0.1) | 1.1 (0.1) | 15/15 |
| JADEb posik noiseless | 1.8 (2) | 4.0 (8) | 2.5 (6) | 2.0 (1.0) | 12 (30) | 72 (65) | ∞2e5 | 0/15 |
| JADEctpb posik noiseless | 1.9 (2) | 3.3 (1) | 0.72 (0.1) | 0.53 (0.1) | 0.60 (0.1) | 1.1 (3) | 1.1 (1) | 15/15 |
| MVDE melo noiseless | 4.2 (2) | 10 (4) | 4.3 (2) | 7.9 (3) | 18 (5) | 39 (24) | 50 (27) | 12/15 |
| NBIPOPaCMA loshchilov noiseless | 1.0 (0.6) | 3.0 (5) | 0.68 (1) | 0.80 (0.6) | 0.99 (0.5) | 1.0 (0.4) | 1.1 (0.2) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 1.1 (0.9) | 1.5 (2) | 0.49 (0.4) | 0.90 (0.5) | 0.99 (0.7) | 1.1 (0.7) | 1.1 (0.3) | 15/15 |
| PSO-BFGS voglis noiseless | 24 (21) | 37 (43) | 16 (2) | 24 (35) | 38 (33) | 53 (46) | ∞5e5 | 0/15 |
| SNES schaul noiseless | 1.1 (0.9) | 6.3 (7) | 1.9 (2) | 5.9 (14) | 20 (17) | 647 (339) | ∞1e6 | 0/15 |
| xNES schaul noiseless | 1.2 (0.9) | 1.3 (0.3) | 0.43 (1) | 0.27 (0.1) | 0.51 (0.6) | 2.0 (2) | 3.6 (5) | 15/15 |
| xNESas schaul noiseless | 0.80 (0.9) | 1.4 (0.3) | 0.25 (0.0) | 0.31 (0.6) | 0.43 (0.8) | 1.4 (2) | 2.0 (3) | 15/15 |
| Δ fopt f19, 5-D |
1e1 1 |
1e0 1 |
1e-1 242 |
1e-2 1.0e5 |
1e-3 1.2e5 |
1e-5 1.2e5 |
1e-7 1.2e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 28 (28) | 3135 (6335) | 626 (758) | 10 (12) | 17 (29) | 17 (28) | 17 (40) | 14/15 |
| BIPOPaCMA loshchilov noiseless | 22 (38) | 1466 (1305) | 186 (184) | 1.9 (1) | 2.0 (1) | 2.0 (1) | 2.0 (1) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 16 (11) | 1834 (1064) | 92 (68) | 0.88 (0.6) | 0.85 (0.5) | 0.85 (0.4) | 0.85 (0.6) | 15/15 |
| CMAES posik noiseless | 21 (10) | 2230 (779) | 328 (381) | 7.5 (12) | ∞ | ∞ | ∞3e5 | 0/15 |
| CMA brockhoff noiseless | 15 (13) | 1796 (1158) | 573 (816) | 2.0 (2) | 2.1 (1) | 2.1 (2) | 2.1 (2) | 15/15 |
| CMAa brockhoff noiseless | 24 (26) | 6888 (2e4) | 463 (452) | 3.3 (2) | 3.0 (3) | 3.0 (1) | 3.0 (2) | 14/15 |
| CMAm brockhoff noiseless | 20 (17) | 1379 (1475) | 551 (613) | 2.4 (2) | 2.3 (2) | 2.3 (1) | 2.3 (2) | 15/15 |
| CMAma brockhoff noiseless | 18 (8) | 1297 (1378) | 259 (251) | 1.6 (3) | 1.9 (1) | 1.9 (3) | 1.9 (2) | 15/15 |
| CMAmah brockhoff noiseless | 17 (11) | 1167 (2320) | 518 (339) | 2.5 (2) | 2.4 (1) | 2.4 (2) | 2.3 (2) | 15/15 |
| CMAmh brockhoff noiseless | 12 (14) | 3.1e4 (7e4) | 421 (668) | 2.6 (3) | 2.5 (2) | 2.5 (4) | 2.5 (2) | 15/15 |
| DBRCGA chuang noiseless | 28 (49) | 3184 (1823) | 860 (1245) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DE-AUTO voglis noiseless | 323 (26) | 1.3e4 (1e4) | 361 (170) | 6.5 (11) | 19 (16) | 19 (18) | 19 (16) | 3/15 |
| DE-BFGS voglis noiseless | 40 (46) | 2166 (986) | 71 (56) | 2.1 (2) | 4.3 (6) | 4.3 (3) | 11 (10) | 2/15 |
| DE-ROLL voglis noiseless | 38 (29) | 5195 (8699) | 502 (308) | 34 (55) | 61 (83) | 61 (40) | ∞5e5 | 0/15 |
| DE-SIMPLEX voglis noiseless | 62 (12) | 2807 (2658) | 68 (65) | 1.5 (1) | 4.7 (3) | 4.7 (4) | 4.7 (6) | 9/15 |
| DEAE posik noiseless | 32 (26) | 3555 (2354) | 388 (315) | 3.9 (5) | 6.7 (12) | 6.7 (4) | 6.6 (6) | 4/15 |
| DE posik noiseless | 32 (35) | 4210 (3104) | 1107 (837) | 11 (16) | 15 (14) | 15 (10) | 15 (20) | 2/15 |
| DEb posik noiseless | 32 (17) | 4210 (1918) | 1107 (646) | 11 (7) | 15 (5) | 15 (11) | 15 (5) | 2/15 |
| DEctpb posik noiseless | 34 (8) | 3526 (3550) | 1051 (570) | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| IPOPsaACM loshchilov noiseless | 19 (14) | 1931 (3094) | 250 (183) | 1.2 (1) | 1.4 (1) | 1.4 (0.8) | 1.4 (1) | 15/15 |
| JADE posik noiseless | 35 (32) | 2139 (1806) | 276 (629) | 11 (13) | ∞ | ∞ | ∞2e5 | 0/15 |
| JADEb posik noiseless | 30 (16) | 3020 (3903) | 587 (588) | 6.0 (8) | 9.5 (8) | 9.4 (10) | 9.4 (9) | 3/15 |
| JADEctpb posik noiseless | 35 (29) | 2139 (1892) | 276 (151) | 11 (17) | ∞ | ∞ | ∞2e5 | 0/15 |
| MVDE melo noiseless | 34 (26) | 4483 (4842) | 757 (561) | 30 (34) | 56 (37) | 120 (109) | 120 (250) | 1/15 |
| NBIPOPaCMA loshchilov noiseless | 20 (8) | 2026 (3296) | 156 (300) | 2.6 (7) | 2.6 (2) | 2.6 (2) | 2.6 (2) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 16 (7) | 1813 (1969) | 324 (304) | 2.9 (3) | 2.7 (3) | 2.7 (2) | 2.7 (3) | 15/15 |
| PSO-BFGS voglis noiseless | 69 (164) | 2559 (2638) | 60 (45) | 2.3 (2) | 3.6 (6) | 3.6 (6) | 19 (21) | 1/15 |
| SNES schaul noiseless | 14 (9) | 3327 (881) | 1669 (1163) | 41 (52) | 36 (25) | 36 (27) | 36 (41) | 3/15 |
| xNES schaul noiseless | 15 (12) | 2009 (1172) | 386 (665) | 4.2 (6) | 5.3 (7) | 5.3 (6) | 5.6 (7) | 10/15 |
| xNESas schaul noiseless | 17 (16) | 3280 (4901) | 543 (677) | 8.8 (8) | 11 (11) | 20 (21) | 21 (25) | 6/15 |
| Δ fopt f20, 5-D |
1e1 16 |
1e0 851 |
1e-1 38111 |
1e-2 51362 |
1e-3 54470 |
1e-5 54861 |
1e-7 55313 |
#succ 14/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 6.0 (2) | 3.2 (0.9) | 3.3 (2) | 2.5 (3) | 2.3 (3) | 2.3 (2) | 2.3 (3) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 3.4 (2) | 10 (6) | 2.4 (1) | 1.8 (0.8) | 1.7 (0.9) | 1.8 (0.8) | 1.8 (2) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 3.1 (2) | 3.8 (2) | 1.7 (1) | 1.3 (1) | 1.2 (2) | 1.2 (1) | 1.2 (1.0) | 15/15 |
| CMAES posik noiseless | 3.7 (5) | 27 (32) | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| CMA brockhoff noiseless | 3.7 (2) | 8.3 (5) | 1.7 (0.5) | 1.3 (1) | 1.3 (1) | 1.3 (0.4) | 1.3 (1) | 15/15 |
| CMAa brockhoff noiseless | 2.5 (2) | 9.1 (3) | 1.7 (0.7) | 1.4 (1) | 1.4 (0.8) | 1.4 (0.9) | 1.4 (0.4) | 15/15 |
| CMAm brockhoff noiseless | 3.0 (1) | 9.0 (4) | 1.7 (1) | 1.3 (0.7) | 1.3 (0.7) | 1.3 (0.6) | 1.3 (0.8) | 15/15 |
| CMAma brockhoff noiseless | 2.4 (2) | 9.4 (5) | 1.7 (2) | 1.4 (1) | 1.3 (1) | 1.3 (1) | 1.4 (1) | 15/15 |
| CMAmah brockhoff noiseless | 2.3 (1) | 11 (4) | 1.6 (1) | 1.2 (1) | 1.2 (0.5) | 1.2 (1) | 1.2 (0.6) | 15/15 |
| CMAmh brockhoff noiseless | 2.6 (1) | 14 (7) | 1.7 (1) | 1.3 (0.5) | 1.3 (1) | 1.3 (0.5) | 1.3 (0.4) | 15/15 |
| DBRCGA chuang noiseless | 18 (16) | 4.4 (4) | 2.4 (4) | 1.8 (1) | 1.7 (0.9) | 1.7 (3) | 1.7 (1) | 14/15 |
| DE-AUTO voglis noiseless | 4.0 (1) | 7.2 (7) | 14 (26) | 10 (13) | 10 (15) | 10 (10) | 10 (7) | 9/15 |
| DE-BFGS voglis noiseless | 4.1 (2) | 2.8 (1) | 10 (10) | 7.5 (10) | 7.1 (1) | 7.0 (3) | 7.0 (17) | 10/15 |
| DE-ROLL voglis noiseless | 15 (19) | 3.1 (4) | 4.0 (5) | 3.0 (4) | 2.8 (5) | 2.8 (4) | 2.8 (6) | 14/15 |
| DE-SIMPLEX voglis noiseless | 6.4 (3) | 4.7 (5) | 19 (18) | 14 (22) | 13 (27) | 13 (14) | 13 (14) | 7/15 |
| DEAE posik noiseless | 10 (6) | 3.0 (1.0) | 1.6 (1) | 1.2 (0.9) | 1.1 (1) | 1.1 (1) | 1.1 (0.8) | 14/15 |
| DE posik noiseless | 8.8 (5) | 1.9 (0.5) | 0.57 (0.4) | 0.43 (0.4) | 0.41 (0.2) | 0.42 (0.5) | 0.42 (0.4) | 15/15 |
| DEb posik noiseless | 8.8 (7) | 1.9 (0.6) | 0.57 (0.3) | 0.43 (0.4) | 0.41 (0.4) | 0.42 (0.5) | 0.42 (0.5) | 15/15 |
| DEctpb posik noiseless | 7.7 (4) | 2.1 (1) | 0.14 (0.1) | 0.13 (0.0) | 0.14 (0.1) | 0.16 (0.0) | 0.17 (0.1) | 15/15 |
| IPOPsaACM loshchilov noiseless | 2.4 (2) | 3.5 (3) | 1.6 (2) | 1.2 (1) | 1.2 (0.9) | 1.2 (0.8) | 1.2 (0.9) | 15/15 |
| JADE posik noiseless | 4.9 (3) | 2.3 (1) | 0.25 (0.3) | 0.22 (0.2) | 0.25 (0.2) | 0.29 (0.3) | 0.33 (0.1) | 15/15 |
| JADEb posik noiseless | 5.8 (3) | 0.91 (0.3) | 1.7 (3) | 1.3 (2) | 1.2 (2) | 1.2 (3) | 1.2 (2) | 14/15 |
| JADEctpb posik noiseless | 4.9 (3) | 2.3 (1) | 0.25 (0.3) | 0.22 (0.4) | 0.25 (0.1) | 0.29 (0.2) | 0.33 (0.3) | 15/15 |
| MVDE melo noiseless | 14 (5) | 2.7 (2) | 0.23 (0.1) | 0.23 (0.1) | 0.26 (0.2) | 0.32 (0.1) | 0.35 (0.1) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 3.6 (3) | 11 (10) | 2.4 (0.6) | 1.8 (0.5) | 1.8 (0.5) | 1.8 (0.0) | 1.8 (1) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.2 (3) | 10 (6) | 2.1 (1) | 1.7 (1) | 1.6 (1) | 1.6 (1) | 1.7 (1) | 15/15 |
| PSO-BFGS voglis noiseless | 4.9 (0.8) | 5.4 (6) | 3.5 (3) | 2.6 (2) | 2.4 (5) | 2.4 (4) | 2.4 (3) | 14/15 |
| SNES schaul noiseless | 2.3 (2) | 29 (92) | 23 (16) | 17 (10) | 16 (7) | 16 (19) | 16 (12) | 11/15 |
| xNES schaul noiseless | 2.3 (2) | 10 (9) | 11 (9) | 8.5 (9) | 8.0 (8) | 8.0 (8) | 7.9 (5) | 13/15 |
| xNESas schaul noiseless | 3.2 (1) | 12 (23) | 21 (26) | 15 (22) | 15 (7) | 15 (12) | 14 (23) | 12/15 |
| Δ fopt f21, 5-D |
1e1 41 |
1e0 1157 |
1e-1 1674 |
1e-2 1692 |
1e-3 1705 |
1e-5 1729 |
1e-7 1757 |
#succ 14/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 3.8 (3) | 118 (307) | 299 (845) | 296 (836) | 294 (867) | 290 (818) | 285 (1480) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 1.8 (0.9) | 7.4 (9) | 49 (16) | 50 (18) | 50 (282) | 50 (150) | 49 (146) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.9 (2) | 3.4 (4) | 4.9 (2) | 5.0 (10) | 5.0 (3) | 4.9 (18) | 4.9 (13) | 15/15 |
| CMAES posik noiseless | 1.8 (1) | 3.1 (5) | 3.9 (5) | 3.9 (5) | 3.9 (3) | 3.9 (5) | 3.9 (1) | 15/15 |
| CMA brockhoff noiseless | 6.6 (18) | 7.3 (15) | 43 (174) | 43 (79) | 43 (36) | 43 (113) | 42 (78) | 13/15 |
| CMAa brockhoff noiseless | 1.9 (1) | 28 (87) | 23 (20) | 23 (20) | 23 (21) | 23 (109) | 22 (7) | 14/15 |
| CMAm brockhoff noiseless | 1.4 (1) | 26 (8) | 21 (6) | 21 (55) | 21 (14) | 21 (5) | 21 (14) | 14/15 |
| CMAma brockhoff noiseless | 2.0 (0.6) | 5.0 (10) | 22 (120) | 40 (60) | 39 (120) | 39 (119) | 39 (165) | 13/15 |
| CMAmah brockhoff noiseless | 3.6 (9) | 2.7 (2) | 5.7 (10) | 5.8 (11) | 5.9 (7) | 6.0 (11) | 6.1 (7) | 15/15 |
| CMAmh brockhoff noiseless | 3.3 (0.7) | 5.6 (8) | 40 (84) | 41 (63) | 41 (31) | 42 (21) | 42 (53) | 14/15 |
| DBRCGA chuang noiseless | 3.2 (2) | 2.2 (4) | 2.1 (4) | 2.4 (1) | 2.7 (1) | 3.3 (2) | 3.8 (0.7) | 15/15 |
| DE-AUTO voglis noiseless | 10 (10) | 26 (17) | 36 (76) | 36 (75) | 36 (44) | 35 (61) | 35 (35) | 15/15 |
| DE-BFGS voglis noiseless | 2.2 (2) | 1.6 (3) | 2.7 (2) | 2.7 (6) | 2.7 (4) | 2.7 (4) | 16 (40) | 12/15 |
| DE-ROLL voglis noiseless | 10 (1) | 33 (33) | 31 (52) | 31 (73) | 31 (27) | 30 (29) | 30 (22) | 15/15 |
| DE-SIMPLEX voglis noiseless | 3.2 (1) | 19 (5) | 19 (51) | 19 (9) | 19 (50) | 18 (45) | 18 (12) | 15/15 |
| DEAE posik noiseless | 3.1 (2) | 1.2 (0.7) | 2.5 (2) | 2.6 (4) | 2.7 (4) | 2.9 (4) | 2.9 (3) | 15/15 |
| DE posik noiseless | 2.7 (4) | 3.9 (7) | 3.7 (4) | 3.9 (6) | 4.0 (4) | 4.3 (4) | 4.5 (6) | 15/15 |
| DEb posik noiseless | 2.7 (2) | 3.9 (6) | 3.7 (4) | 3.9 (4) | 4.0 (4) | 4.3 (4) | 4.5 (3) | 15/15 |
| DEctpb posik noiseless | 3.2 (2) | 5.5 (1) | 4.5 (12) | 5.0 (4) | 5.3 (11) | 5.8 (12) | 6.2 (3) | 15/15 |
| IPOPsaACM loshchilov noiseless | 2.9 (1) | 1.6 (1) | 28 (89) | 28 (88) | 28 (15) | 28 (98) | 27 (167) | 15/15 |
| JADE posik noiseless | 1.7 (2) | 1.1 (3) | 1.2 (0.9) | 2.2 (0.3) | 2.8 (4) | 5.0 (9) | 8.2 (13) | 15/15 |
| JADEb posik noiseless | 2.3 (3) | 4.4 (4) | 4.4 (4) | 4.4 (7) | 4.4 (6) | 4.5 (4) | 4.6 (6) | 15/15 |
| JADEctpb posik noiseless | 1.7 (2) | 1.1 (2) | 1.2 (1) | 2.2 (4) | 2.8 (3) | 5.0 (12) | 8.2 (17) | 15/15 |
| MVDE melo noiseless | 4.3 (3) | 1.5 (0.8) | 2.8 (6) | 4.1 (1) | 5.9 (2) | 10 (8) | 13 (3) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 2.1 (3) | 11 (9) | 31 (12) | 30 (44) | 30 (69) | 30 (60) | 29 (11) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 4.1 (16) | 76 (153) | 272 (105) | 270 (734) | 269 (728) | 266 (719) | 263 (468) | 15/15 |
| PSO-BFGS voglis noiseless | 1.8 (1) | 0.88 (1) | 1.6 (2) | 1.6 (2) | 1.6 (2) | 1.6 (1) | 29 (5) | 13/15 |
| SNES schaul noiseless | 51 (244) | 46 (55) | 53 (81) | 53 (87) | 52 (41) | 52 (81) | 51 (59) | 15/15 |
| xNES schaul noiseless | 34 (124) | 29 (41) | 32 (52) | 32 (28) | 32 (50) | 31 (32) | 31 (50) | 15/15 |
| xNESas schaul noiseless | 12 (38) | 23 (12) | 36 (15) | 36 (108) | 35 (41) | 35 (40) | 35 (64) | 15/15 |
| Δ fopt f22, 5-D |
1e1 71 |
1e0 386 |
1e-1 938 |
1e-2 980 |
1e-3 1008 |
1e-5 1040 |
1e-7 1068 |
#succ 14/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 2.9 (2) | 143 (230) | 855 (183) | 819 (1724) | 797 (1593) | 775 (2153) | 756 (2055) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 14 (54) | 16 (18) | 38 (92) | 37 (88) | 36 (51) | 35 (53) | 34 (50) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.2 (4) | 3.2 (8) | 14 (30) | 14 (38) | 13 (5) | 13 (26) | 13 (47) | 15/15 |
| CMAES posik noiseless | 9.3 (10) | 21 (48) | 18 (23) | 17 (29) | 17 (44) | 16 (42) | 16 (41) | 15/15 |
| CMA brockhoff noiseless | 10 (20) | 87 (38) | 292 (334) | 431 (848) | 554 (838) | 537 (959) | 524 (427) | 6/15 |
| CMAa brockhoff noiseless | 15 (9) | 87 (20) | 379 (639) | 445 (418) | 433 (1029) | 421 (1149) | 411 (584) | 7/15 |
| CMAm brockhoff noiseless | 12 (21) | 17 (28) | 144 (251) | 456 (1011) | 444 (466) | 431 (500) | 421 (446) | 7/15 |
| CMAma brockhoff noiseless | 2.0 (0.5) | 94 (234) | 250 (555) | 475 (637) | 465 (504) | 453 (784) | 442 (325) | 7/15 |
| CMAmah brockhoff noiseless | 6.3 (11) | 130 (235) | 289 (657) | 277 (464) | 346 (628) | 336 (533) | 328 (471) | 8/15 |
| CMAmh brockhoff noiseless | 5.3 (8) | 38 (86) | 288 (518) | 351 (381) | 436 (624) | 425 (436) | 414 (786) | 7/15 |
| DBRCGA chuang noiseless | 2.6 (2) | 6.7 (12) | 11 (16) | 12 (16) | 12 (8) | 15 (15) | 16 (10) | 15/15 |
| DE-AUTO voglis noiseless | 8.1 (26) | 84 (30) | 102 (134) | 97 (93) | 95 (114) | 92 (121) | 95 (72) | 15/15 |
| DE-BFGS voglis noiseless | 6.7 (0.6) | 13 (18) | 23 (19) | 22 (33) | 21 (14) | 21 (18) | 131 (105) | 8/15 |
| DE-ROLL voglis noiseless | 16 (31) | 144 (259) | 150 (119) | 144 (209) | 143 (191) | 144 (166) | 208 (363) | 8/15 |
| DE-SIMPLEX voglis noiseless | 6.5 (10) | 29 (51) | 44 (56) | 42 (47) | 41 (33) | 40 (47) | 39 (49) | 15/15 |
| DEAE posik noiseless | 3.2 (2) | 6.2 (0.4) | 10 (26) | 10 (16) | 10 (19) | 10 (15) | 10 (15) | 15/15 |
| DE posik noiseless | 5.0 (2) | 13 (12) | 17 (21) | 17 (23) | 17 (20) | 18 (22) | 19 (21) | 15/15 |
| DEb posik noiseless | 5.0 (3) | 13 (8) | 17 (21) | 17 (20) | 17 (20) | 18 (19) | 19 (19) | 15/15 |
| DEctpb posik noiseless | 5.1 (4) | 7.9 (14) | 11 (15) | 12 (16) | 13 (17) | 16 (6) | 17 (11) | 15/15 |
| IPOPsaACM loshchilov noiseless | 3.4 (8) | 12 (4) | 85 (28) | 115 (163) | 116 (13) | 113 (258) | 110 (280) | 15/15 |
| JADE posik noiseless | 2.1 (0.8) | 3.4 (5) | 8.0 (5) | 10 (14) | 12 (10) | 16 (28) | 17 (32) | 15/15 |
| JADEb posik noiseless | 12 (20) | 16 (20) | 14 (15) | 14 (17) | 14 (13) | 14 (16) | 14 (11) | 15/15 |
| JADEctpb posik noiseless | 2.1 (1) | 3.4 (6) | 8.0 (7) | 10 (10) | 12 (10) | 16 (19) | 17 (32) | 15/15 |
| MVDE melo noiseless | 4.4 (4) | 5.5 (3) | 85 (9) | 92 (259) | 98 (499) | 113 (16) | 124 (279) | 14/15 |
| NBIPOPaCMA loshchilov noiseless | 8.9 (11) | 14 (20) | 18 (13) | 18 (24) | 17 (18) | 17 (21) | 17 (24) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 4.0 (5) | 258 (707) | 338 (714) | 325 (566) | 317 (196) | 308 (754) | 300 (734) | 15/15 |
| PSO-BFGS voglis noiseless | 1.6 (1) | 4.2 (2) | 3.4 (4) | 3.3 (4) | 3.2 (4) | 3.3 (3) | 170 (288) | 5/15 |
| SNES schaul noiseless | 91 (244) | 192 (212) | 134 (290) | 130 (119) | 130 (187) | 149 (264) | 161 (198) | 15/15 |
| xNES schaul noiseless | 66 (36) | 100 (209) | 104 (140) | 100 (103) | 97 (92) | 95 (107) | 92 (123) | 15/15 |
| xNESas schaul noiseless | 46 (54) | 44 (57) | 39 (42) | 38 (51) | 37 (51) | 36 (26) | 35 (44) | 15/15 |
| Δ fopt f23, 5-D |
1e1 3.0 |
1e0 518 |
1e-1 14249 |
1e-2 27890 |
1e-3 31654 |
1e-5 33030 |
1e-7 34256 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 2.6 (4) | 86 (45) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 3.2 (4) | 11 (20) | 1.6 (2) | 0.93 (1) | 0.86 (1) | 0.85 (0.6) | 0.84 (1) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 4.2 (4) | 14 (5) | 1.1 (1) | 0.86 (0.4) | 0.91 (0.6) | 0.88 (1.0) | 0.97 (0.4) | 15/15 |
| CMAES posik noiseless | 2.9 (4) | 13 (11) | 6.9 (12) | 5.5 (8) | 4.9 (10) | 4.7 (4) | 4.5 (7) | 12/15 |
| CMA brockhoff noiseless | 2.7 (4) | 20 (38) | 107 (176) | 55 (54) | 49 (63) | 47 (68) | 45 (88) | 6/15 |
| CMAa brockhoff noiseless | 2.4 (3) | 29 (12) | 39 (58) | 20 (39) | 18 (24) | 17 (48) | 17 (44) | 10/15 |
| CMAm brockhoff noiseless | 2.2 (2) | 16 (14) | 63 (125) | 42 (144) | 37 (56) | 36 (46) | 35 (45) | 7/15 |
| CMAma brockhoff noiseless | 2.5 (2) | 21 (27) | 37 (72) | 25 (45) | 22 (1) | 21 (30) | 20 (15) | 9/15 |
| CMAmah brockhoff noiseless | 1.9 (2) | 17 (41) | 52 (72) | 26 (45) | 23 (26) | 22 (17) | 22 (46) | 9/15 |
| CMAmh brockhoff noiseless | 4.5 (2) | 10 (8) | 38 (72) | 26 (36) | 23 (47) | 22 (17) | 21 (15) | 9/15 |
| DBRCGA chuang noiseless | 0.91 (0.8) | 19 (19) | 43 (45) | 126 (94) | 222 (265) | 212 (178) | 205 (237) | 1/15 |
| DE-AUTO voglis noiseless | 2.9 (3) | 4.6 (5) | 3.5 (5) | 4.5 (3) | 4.4 (2) | 4.8 (4) | 6.1 (3) | 14/15 |
| DE-BFGS voglis noiseless | 2.2 (2) | 2.5 (2) | 2.0 (3) | 1.2 (1) | 1.3 (0.5) | 1.4 (0.6) | 96 (84) | 0/15 |
| DE-ROLL voglis noiseless | 2.4 (2) | 4.4 (6) | 18 (26) | 15 (16) | 14 (21) | 16 (17) | 104 (165) | 0/15 |
| DE-SIMPLEX voglis noiseless | 2.3 (2) | 0.92 (0.7) | 0.88 (0.5) | 0.94 (0.6) | 0.91 (0.6) | 1.1 (0.2) | 99 (110) | 0/15 |
| DEAE posik noiseless | 2.8 (2) | 72 (64) | 124 (224) | 63 (34) | 56 (124) | 54 (81) | 52 (47) | 2/15 |
| DE posik noiseless | 2.9 (4) | 48 (51) | 57 (82) | 39 (50) | 35 (63) | 53 (45) | 105 (186) | 1/15 |
| DEb posik noiseless | 2.9 (4) | 48 (38) | 57 (60) | 39 (42) | 35 (38) | 53 (106) | 105 (142) | 1/15 |
| DEctpb posik noiseless | 3.5 (4) | 57 (64) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| IPOPsaACM loshchilov noiseless | 2.1 (2) | 13 (17) | 8.8 (2) | 7.5 (25) | 6.6 (24) | 6.4 (1.0) | 6.2 (9) | 15/15 |
| JADE posik noiseless | 2.4 (3) | 37 (21) | 8.3 (6) | 8.4 (6) | 7.6 (12) | 7.3 (8) | 7.1 (5) | 10/15 |
| JADEb posik noiseless | 2.3 (3) | 35 (46) | 32 (39) | 20 (28) | 17 (28) | 17 (16) | 16 (4) | 6/15 |
| JADEctpb posik noiseless | 2.4 (3) | 37 (19) | 8.3 (6) | 8.4 (6) | 7.6 (8) | 7.3 (9) | 7.1 (9) | 10/15 |
| MVDE melo noiseless | 1.8 (2) | 32 (36) | 190 (157) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 1.6 (1) | 8.2 (8) | 1.4 (1.0) | 0.95 (1.0) | 0.97 (1) | 0.95 (1) | 1.1 (0.9) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.2 (6) | 15 (16) | 1.8 (1.0) | 0.94 (0.6) | 0.86 (0.4) | 0.86 (0.9) | 0.87 (0.8) | 15/15 |
| PSO-BFGS voglis noiseless | 1.4 (1) | 3.5 (4) | 3.3 (5) | 10 (2) | 30 (29) | ∞ | ∞5e5 | 0/15 |
| SNES schaul noiseless | 2.8 (4) | 35 (41) | 46 (66) | 472 (783) | 416 (506) | 399 (200) | 384 (412) | 1/15 |
| xNES schaul noiseless | 3.4 (4) | 66 (118) | 755 (939) | 386 (668) | ∞ | ∞ | ∞8e5 | 0/15 |
| xNESas schaul noiseless | 2.2 (1) | 97 (98) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| Δ fopt f24, 5-D |
1e1 1622 |
1e0 2.2e5 |
1e-1 6.4e6 |
1e-2 9.6e6 |
1e-3 9.6e6 |
1e-5 1.3e7 |
1e-7 1.3e7 |
#succ 3/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 8.2 (4) | 155 (330) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 1.3 (1) | 1.0 (1.0) | 1.1 (1) | 1.3 (1) | 1.3 (0.8) | 0.96 (2) | 0.96 (2) | 5/15 |
| BIPOPsaACM loshchilov noiseless | 1.8 (2) | 1.0 (1) | 0.69 (1) | 0.82 (0.5) | 0.97 (0.8) | 0.73 (1) | 0.73 (1) | 6/15 |
| CMAES posik noiseless | 1.6 (2) | 3.1 (2) | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| CMA brockhoff noiseless | 1.9 (1) | 9.4 (12) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| CMAa brockhoff noiseless | 1.5 (1) | 13 (7) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| CMAm brockhoff noiseless | 2.2 (1) | 19 (42) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| CMAma brockhoff noiseless | 1.3 (1) | 65 (36) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| CMAmah brockhoff noiseless | 1.6 (0.7) | 19 (44) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| CMAmh brockhoff noiseless | 1.4 (1) | 13 (21) | 2.2 (4) | 1.5 (3) | 1.5 (2) | 1.1 (2) | 1.1 (0.8) | 1/15 |
| DBRCGA chuang noiseless | 11 (9) | 5.6 (15) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DE-AUTO voglis noiseless | 10 (12) | 10 (15) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DE-BFGS voglis noiseless | 1.3 (1) | 4.3 (6) | 0.19 (0.1) | 0.24 (0.2) | 0.24 (0.4) | 0.18 (0.2) | 0.18 (0.1) | 3/15 |
| DE-ROLL voglis noiseless | 13 (18) | 16 (8) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DE-SIMPLEX voglis noiseless | 3.5 (3) | 10 (14) | 0.56 (0.4) | 0.77 (0.8) | 0.76 (0.5) | 0.57 (1) | 0.57 (0.7) | 1/15 |
| DEAE posik noiseless | 6.1 (3) | 3.7 (4) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| DE posik noiseless | 10 (6) | 5.4 (4) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| DEb posik noiseless | 10 (8) | 5.4 (9) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| DEctpb posik noiseless | 12 (6) | 17 (18) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| IPOPsaACM loshchilov noiseless | 1.9 (2) | 42 (50) | 11 (17) | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| JADE posik noiseless | 6.5 (4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| JADEb posik noiseless | 4.2 (1) | 7.8 (14) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| JADEctpb posik noiseless | 6.5 (4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| MVDE melo noiseless | 13 (10) | 69 (64) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 2.0 (1) | 0.64 (0.3) | 0.92 (1) | 0.81 (0.8) | 0.81 (1) | 0.71 (1.0) | 0.88 (0.8) | 5/15 |
| NIPOPaCMA loshchilov noiseless | 1.8 (0.7) | 2.1 (5) | 0.61 (0.6) | 0.46 (0.4) | 0.46 (0.4) | 0.35 (0.4) | 0.35 (0.5) | 11/15 |
| PSO-BFGS voglis noiseless | 3.2 (3) | 0.69 (1) | 0.20 (0.2) | 0.24 (0.2) | 0.23 (0.2) | 0.18 (0.2) | 0.18 (0.3) | 3/15 |
| SNES schaul noiseless | 1.6 (2) | 3.2 (2) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| xNES schaul noiseless | 7.5 (5) | 12 (11) | ∞ | ∞ | ∞ | ∞ | ∞8e5 | 0/15 |
| xNESas schaul noiseless | 6.2 (3) | 26 (38) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
Previous dimension | Dimension = 10 | Next dimension
| Δ fopt f1, 10-D |
1e1 22 |
1e0 23 |
1e-1 23 |
1e-2 23 |
1e-3 23 |
1e-5 23 |
1e-7 23 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 11 (3) | 24 (4) | 36 (6) | 49 (4) | 63 (5) | 88 (6) | 113 (6) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 4.9 (2) | 12 (3) | 18 (3) | 25 (4) | 31 (2) | 44 (4) | 57 (5) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 4.8 (1) | 6.3 (0.7) | 7.6 (0.8) | 10 (1) | 11 (0.8) | 14 (0.9) | 17 (1) | 15/15 |
| CMAES posik noiseless | 5.8 (2) | 12 (2) | 18 (2) | 24 (3) | 31 (2) | 44 (3) | 57 (6) | 15/15 |
| CMA brockhoff noiseless | 5.3 (2) | 12 (2) | 18 (3) | 24 (2) | 31 (4) | 44 (4) | 57 (4) | 15/15 |
| CMAa brockhoff noiseless | 5.2 (2) | 11 (3) | 18 (1) | 24 (2) | 30 (3) | 44 (5) | 57 (7) | 15/15 |
| CMAm brockhoff noiseless | 4.4 (1) | 8.9 (2) | 14 (0.9) | 18 (2) | 23 (3) | 32 (2) | 42 (3) | 15/15 |
| CMAma brockhoff noiseless | 4.5 (1.0) | 8.6 (0.9) | 13 (3) | 18 (2) | 23 (2) | 31 (3) | 41 (2) | 15/15 |
| CMAmah brockhoff noiseless | 3.2 (1) | 6.4 (1) | 9.4 (0.9) | 13 (2) | 16 (3) | 22 (1) | 29 (2) | 15/15 |
| CMAmh brockhoff noiseless | 3.4 (0.9) | 6.5 (1) | 9.4 (2) | 13 (2) | 16 (2) | 22 (3) | 29 (2) | 15/15 |
| DBRCGA chuang noiseless | 77 (16) | 194 (76) | 334 (65) | 478 (51) | 612 (108) | 910 (91) | 1201 (83) | 15/15 |
| DE-AUTO voglis noiseless | 3.7 (0.3) | 4.1 (0.2) | 4.1 (0.2) | 4.1 (0.2) | 4.1 (0.1) | 4.1 (0.2) | 4.1 (0.1) | 15/15 |
| DE-BFGS voglis noiseless | 3.2 (0.2) | 3.2 (0) | 3.2 (0) | 3.2 (0) | 3.2 (0) | 3.2 (0) | 3.2 (0) | 15/15 |
| DE-ROLL voglis noiseless | 7.6 (8) | 18 (11) | 19 (13) | 19 (20) | 20 (11) | 20 (14) | 20 (4) | 15/15 |
| DE-SIMPLEX voglis noiseless | 8.5 (7) | 21 (12) | 34 (9) | 42 (18) | 46 (14) | 55 (9) | 67 (6) | 15/15 |
| DEAE posik noiseless | 26 (5) | 61 (6) | 95 (10) | 133 (11) | 169 (12) | 240 (14) | 312 (20) | 15/15 |
| DE posik noiseless | 28 (8) | 66 (14) | 106 (18) | 139 (24) | 179 (10) | 252 (23) | 328 (29) | 15/15 |
| DEb posik noiseless | 28 (10) | 66 (8) | 106 (7) | 139 (13) | 179 (17) | 252 (19) | 328 (28) | 15/15 |
| DEctpb posik noiseless | 28 (8) | 68 (6) | 114 (13) | 152 (14) | 201 (17) | 287 (10) | 368 (7) | 15/15 |
| IPOPsaACM loshchilov noiseless | 4.6 (0.9) | 6.1 (0.3) | 7.3 (0.6) | 9.0 (0.7) | 11 (1) | 14 (0.9) | 17 (0.8) | 15/15 |
| JADE posik noiseless | 18 (6) | 45 (13) | 78 (8) | 108 (11) | 141 (4) | 211 (4) | 282 (7) | 15/15 |
| JADEb posik noiseless | 13 (4) | 32 (7) | 52 (8) | 74 (6) | 98 (8) | 147 (10) | 201 (13) | 15/15 |
| JADEctpb posik noiseless | 18 (3) | 45 (9) | 78 (10) | 108 (9) | 141 (7) | 211 (7) | 282 (7) | 15/15 |
| MVDE melo noiseless | 47 (9) | 137 (8) | 225 (11) | 316 (20) | 409 (20) | 594 (25) | 781 (18) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 4.6 (3) | 11 (2) | 18 (4) | 24 (3) | 31 (3) | 43 (5) | 55 (3) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 5.9 (2) | 12 (2) | 19 (2) | 25 (4) | 31 (4) | 44 (2) | 57 (4) | 15/15 |
| PSO-BFGS voglis noiseless | 3.1 (0.2) | 3.2 (0) | 3.2 (0) | 3.2 (0) | 3.2 (0) | 3.2 (0) | 3.2 (0) | 15/15 |
| SNES schaul noiseless | 4.3 (2) | 10 (3) | 19 (3) | 29 (3) | 39 (3) | 57 (3) | 76 (3) | 15/15 |
| xNES schaul noiseless | 3.8 (1) | 18 (5) | 51 (3) | 81 (5) | 111 (6) | 176 (7) | 239 (7) | 15/15 |
| xNESas schaul noiseless | 4.0 (2) | 16 (2) | 37 (7) | 53 (13) | 64 (15) | 85 (21) | 103 (30) | 15/15 |
| Δ fopt f2, 10-D |
1e1 187 |
1e0 190 |
1e-1 191 |
1e-2 191 |
1e-3 193 |
1e-5 194 |
1e-7 195 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 6.9 (0.9) | 8.2 (1.0) | 10 (0.3) | 11 (2) | 12 (1) | 15 (1) | 18 (1) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 15 (3) | 17 (2) | 18 (2) | 19 (2) | 20 (2) | 21 (1) | 22 (2) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 3.9 (0.7) | 4.4 (0.6) | 4.8 (0.7) | 5.1 (0.6) | 5.3 (0.7) | 5.8 (0.8) | 6.2 (0.7) | 15/15 |
| CMAES posik noiseless | 21 (4) | 24 (4) | 26 (2) | 27 (1) | 28 (0.8) | 29 (1) | 31 (1) | 15/15 |
| CMA brockhoff noiseless | 22 (6) | 24 (5) | 26 (2) | 27 (2) | 28 (1) | 29 (2) | 30 (2) | 15/15 |
| CMAa brockhoff noiseless | 16 (2) | 17 (2) | 18 (0.5) | 19 (1) | 20 (1.0) | 21 (0.7) | 23 (0.9) | 15/15 |
| CMAm brockhoff noiseless | 21 (6) | 24 (3) | 25 (3) | 27 (1) | 27 (1) | 28 (0.6) | 30 (2) | 15/15 |
| CMAma brockhoff noiseless | 15 (4) | 17 (1) | 18 (0.7) | 19 (1) | 19 (0.9) | 20 (1.0) | 21 (0.5) | 15/15 |
| CMAmah brockhoff noiseless | 16 (3) | 18 (3) | 19 (3) | 20 (1) | 20 (1) | 21 (2) | 22 (2) | 15/15 |
| CMAmh brockhoff noiseless | 19 (3) | 24 (4) | 25 (1) | 27 (1) | 27 (2) | 28 (1) | 28 (2) | 15/15 |
| DBRCGA chuang noiseless | 60 (10) | 78 (9) | 96 (8) | 114 (7) | 129 (11) | 161 (13) | 191 (13) | 15/15 |
| DE-AUTO voglis noiseless | 1.7 (0.3) | 1.9 (0.7) | 2.0 (0.8) | 2.1 (0.8) | 2.1 (0.5) | 2.4 (0.8) | 2.7 (1) | 15/15 |
| DE-BFGS voglis noiseless | 1.9 (0.7) | 2.2 (0.6) | 2.4 (1) | 2.5 (0.9) | 2.7 (0.9) | 2.9 (1.0) | 3.1 (1) | 15/15 |
| DE-ROLL voglis noiseless | 7.4 (14) | 7.5 (7) | 7.6 (13) | 7.7 (9) | 7.7 (11) | 8.0 (7) | 8.3 (11) | 15/15 |
| DE-SIMPLEX voglis noiseless | 91 (52) | 109 (39) | 118 (38) | 133 (41) | 138 (22) | 144 (22) | 176 (93) | 15/15 |
| DEAE posik noiseless | 20 (2) | 24 (2) | 29 (3) | 33 (2) | 37 (2) | 45 (3) | 53 (3) | 15/15 |
| DE posik noiseless | 20 (2) | 24 (2) | 29 (3) | 33 (2) | 38 (3) | 47 (3) | 56 (1) | 15/15 |
| DEb posik noiseless | 20 (2) | 24 (2) | 29 (2) | 33 (3) | 38 (2) | 47 (3) | 56 (2) | 15/15 |
| DEctpb posik noiseless | 22 (2) | 27 (1) | 32 (2) | 37 (0.8) | 42 (3) | 52 (2) | 61 (2) | 15/15 |
| IPOPsaACM loshchilov noiseless | 4.1 (0.4) | 4.4 (0.8) | 4.7 (0.7) | 5.0 (0.7) | 5.3 (0.5) | 5.7 (0.7) | 6.1 (0.6) | 15/15 |
| JADE posik noiseless | 17 (2) | 21 (1.0) | 25 (3) | 30 (1) | 34 (2) | 43 (2) | 51 (2) | 15/15 |
| JADEb posik noiseless | 11 (1) | 14 (2) | 17 (2) | 21 (2) | 24 (2) | 31 (2) | 38 (3) | 15/15 |
| JADEctpb posik noiseless | 17 (1) | 21 (1) | 25 (2) | 30 (2) | 34 (1) | 43 (2) | 51 (3) | 15/15 |
| MVDE melo noiseless | 44 (3) | 54 (3) | 65 (2) | 77 (4) | 86 (5) | 109 (2) | 130 (3) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 14 (3) | 17 (2) | 18 (2) | 19 (0.9) | 20 (1) | 21 (0.8) | 23 (0.9) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 14 (3) | 16 (3) | 18 (2) | 19 (2) | 19 (2) | 21 (1) | 23 (1) | 15/15 |
| PSO-BFGS voglis noiseless | 2.6 (1) | 2.6 (1) | 2.7 (0.7) | 2.9 (1) | 3.0 (1) | 3.2 (0.8) | 3.6 (2) | 15/15 |
| SNES schaul noiseless | 4.8 (0.9) | 5.6 (0.7) | 6.7 (0.4) | 7.9 (0.6) | 8.9 (0.6) | 11 (0.6) | 13 (0.6) | 15/15 |
| xNES schaul noiseless | 15 (1) | 17 (0.8) | 21 (0.8) | 25 (0.7) | 28 (0.3) | 35 (0.7) | 43 (1) | 15/15 |
| xNESas schaul noiseless | 13 (1) | 16 (2) | 18 (2) | 20 (2) | 21 (2) | 25 (3) | 27 (4) | 15/15 |
| Δ fopt f3, 10-D |
1e1 1739 |
1e0 3600 |
1e-1 3609 |
1e-2 3636 |
1e-3 3642 |
1e-5 3646 |
1e-7 3651 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 15 (17) | 2427 (4013) | 9806 (7188) | 9733 (5255) | 9717 (1e4) | 9707 (1e4) | 9694 (1e4) | 4/15 |
| BIPOPaCMA loshchilov noiseless | 4.0 (5) | 307 (472) | 4151 (5436) | 4120 (6322) | 4114 (7081) | 4110 (4952) | 4105 (3117) | 7/15 |
| BIPOPsaACM loshchilov noiseless | 2.2 (1.0) | 231 (362) | 1682 (1156) | 1670 (2236) | 1667 (3299) | 1665 (1497) | 1663 (1722) | 12/15 |
| CMAES posik noiseless | 8.4 (11) | 2030 (1875) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CMA brockhoff noiseless | 3.7 (3) | 632 (1008) | 2699 (3483) | 2680 (2044) | 2676 (5761) | 2674 (4547) | 2671 (3676) | 2/15 |
| CMAa brockhoff noiseless | 4.4 (3) | 818 (1421) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| CMAm brockhoff noiseless | 3.0 (3) | 494 (415) | 5720 (5663) | 5679 (4736) | 5670 (7594) | 5665 (4811) | 5658 (8031) | 1/15 |
| CMAma brockhoff noiseless | 2.0 (2) | 366 (1127) | 2640 (3115) | 2621 (1398) | 2616 (4393) | 2614 (2415) | 2611 (3412) | 2/15 |
| CMAmah brockhoff noiseless | 3.0 (1) | 358 (484) | 5586 (3172) | 5545 (8047) | 5537 (6926) | 5532 (6100) | 5525 (5417) | 1/15 |
| CMAmh brockhoff noiseless | 4.2 (3) | 608 (788) | 5512 (9338) | 5471 (6931) | 5462 (3422) | 5456 (3882) | 5449 (7601) | 1/15 |
| DBRCGA chuang noiseless | 13 (4) | 38 (17) | 56 (41) | 56 (28) | 56 (33) | 57 (35) | 59 (32) | 15/15 |
| DE-AUTO voglis noiseless | 9.1 (8) | 24 (13) | 45 (22) | 45 (22) | 45 (24) | 45 (24) | 45 (21) | 15/15 |
| DE-BFGS voglis noiseless | 9.4 (6) | 16 (5) | 24 (15) | 24 (9) | 24 (19) | 24 (10) | 24 (14) | 15/15 |
| DE-ROLL voglis noiseless | 3.6 (3) | 13 (8) | 17 (10) | 17 (7) | 17 (11) | 17 (12) | 17 (9) | 15/15 |
| DE-SIMPLEX voglis noiseless | 37 (24) | 56 (31) | 80 (24) | 80 (19) | 80 (30) | 80 (38) | 80 (42) | 15/15 |
| DEAE posik noiseless | 132 (40) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DE posik noiseless | 5.5 (1) | 5.5 (2) | 16 (6) | 16 (23) | 16 (21) | 17 (4) | 17 (7) | 15/15 |
| DEb posik noiseless | 5.5 (0.9) | 5.5 (4) | 16 (11) | 16 (17) | 16 (10) | 17 (2) | 17 (13) | 15/15 |
| DEctpb posik noiseless | 7.6 (3) | 9.0 (1.0) | 10 (0.8) | 10 (0.4) | 11 (1) | 11 (0.9) | 12 (2) | 15/15 |
| IPOPsaACM loshchilov noiseless | 2.3 (2) | 174 (244) | 7894 (7387) | 7835 (1e4) | 7823 (4971) | 7814 (4514) | 7804 (1e4) | 4/14 |
| JADE posik noiseless | 3.9 (0.5) | 3.1 (0.1) | 3.5 (0.3) | 3.9 (0.2) | 4.3 (0.1) | 5.0 (0.1) | 5.7 (0.2) | 15/15 |
| JADEb posik noiseless | 3.5 (0.7) | 6.3 (5) | 19 (23) | 19 (16) | 19 (15) | 20 (21) | 20 (24) | 15/15 |
| JADEctpb posik noiseless | 3.9 (0.7) | 3.1 (0.2) | 3.5 (0.4) | 3.9 (0.2) | 4.3 (0.2) | 5.0 (0.1) | 5.7 (0.2) | 15/15 |
| MVDE melo noiseless | 5.8 (2) | 5.6 (0.4) | 6.3 (0.4) | 6.9 (0.3) | 7.4 (0.4) | 8.7 (0.3) | 10 (0.3) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 3.7 (5) | 1586 (965) | 7792 (8166) | 7734 (8401) | 7722 (8928) | 7714 (1e4) | 7704 (2e4) | 4/15 |
| NIPOPaCMA loshchilov noiseless | 2.3 (1) | 1021 (1215) | 6291 (6065) | 6245 (8769) | 6235 (1e4) | 6229 (1e4) | 6221 (5869) | 5/15 |
| PSO-BFGS voglis noiseless | 69 (40) | 1999 (2175) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| SNES schaul noiseless | 18 (17) | 5463 (3221) | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| xNES schaul noiseless | 15 (13) | 4196 (5911) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| xNESas schaul noiseless | 16 (12) | 8179 (7313) | 1.7e4 (1e4) | 1.7e4 (1e4) | 1.7e4 (8762) | 1.7e4 (3e4) | 1.7e4 (7904) | 1/15 |
| Δ fopt f4, 10-D |
1e1 2234 |
1e0 3626 |
1e-1 3660 |
1e-2 3695 |
1e-3 3707 |
1e-5 3744 |
1e-7 28767 |
#succ 12/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 31 (61) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 5.6 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPsaACM loshchilov noiseless | 5.3 (4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/5 |
| CMAES posik noiseless | 24 (32) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CMA brockhoff noiseless | 6.6 (3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMAa brockhoff noiseless | 7.5 (3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMAm brockhoff noiseless | 5.5 (4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMAma brockhoff noiseless | 5.6 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMAmah brockhoff noiseless | 8.6 (9) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| CMAmh brockhoff noiseless | 8.6 (8) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DBRCGA chuang noiseless | 25 (14) | 64 (33) | 166 (269) | 165 (117) | 165 (180) | 164 (142) | 22 (25) | 13/15 |
| DE-AUTO voglis noiseless | 12 (8) | 49 (30) | 139 (207) | 138 (198) | 137 (190) | 136 (64) | 18 (14) | 13/15 |
| DE-BFGS voglis noiseless | 14 (3) | 52 (43) | 80 (70) | 79 (67) | 79 (62) | 78 (61) | 10 (9) | 14/15 |
| DE-ROLL voglis noiseless | 5.2 (2) | 17 (19) | 44 (52) | 44 (36) | 44 (44) | 43 (30) | 5.6 (3) | 15/15 |
| DE-SIMPLEX voglis noiseless | 37 (15) | 102 (67) | 239 (223) | 237 (414) | 236 (223) | 259 (215) | 117 (56) | 2/15 |
| DEAE posik noiseless | 102 (53) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DE posik noiseless | 4.1 (1) | 18 (26) | 48 (34) | 48 (64) | 48 (44) | 48 (91) | 6.3 (9) | 14/15 |
| DEb posik noiseless | 4.1 (0.9) | 18 (16) | 48 (61) | 48 (35) | 48 (44) | 48 (74) | 6.3 (8) | 14/15 |
| DEctpb posik noiseless | 6.9 (3) | 11 (1) | 17 (9) | 18 (5) | 18 (8) | 18 (8) | 2.5 (1.0) | 15/15 |
| IPOPsaACM loshchilov noiseless | 5.6 (7) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/5 |
| JADE posik noiseless | 3.6 (0.2) | 3.4 (0.2) | 3.9 (0.1) | 4.4 (0.1) | 4.8 (0.2) | 5.5 (0.2) | 0.82 (0.0) | 15/15 |
| JADEb posik noiseless | 3.6 (4) | 25 (21) | 125 (153) | 124 (121) | 124 (80) | 123 (142) | 16 (36) | 10/15 |
| JADEctpb posik noiseless | 3.6 (0.3) | 3.4 (0.2) | 3.9 (0.1) | 4.4 (0.2) | 4.8 (0.1) | 5.5 (0.2) | 0.82 (0.0) | 15/15 |
| MVDE melo noiseless | 6.0 (0.9) | 26 (70) | 143 (274) | 143 (135) | 143 (270) | 143 (535) | 19 (44) | 10/15 |
| NBIPOPaCMA loshchilov noiseless | 8.4 (11) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| NIPOPaCMA loshchilov noiseless | 4.9 (8) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| PSO-BFGS voglis noiseless | 156 (79) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| SNES schaul noiseless | 25 (23) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| xNES schaul noiseless | 17 (20) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| xNESas schaul noiseless | 7.8 (7) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| Δ fopt f5, 10-D |
1e1 20 |
1e0 20 |
1e-1 20 |
1e-2 20 |
1e-3 20 |
1e-5 20 |
1e-7 20 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 8.9 (2) | 11 (2) | 11 (3) | 11 (3) | 11 (3) | 11 (3) | 11 (3) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 5.0 (2) | 6.0 (2) | 6.1 (2) | 6.1 (2) | 6.1 (2) | 6.1 (1) | 6.1 (0.7) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 5.1 (2) | 6.2 (3) | 6.5 (2) | 6.5 (2) | 6.5 (1) | 6.5 (1) | 6.5 (2) | 15/15 |
| CMAES posik noiseless | 5.3 (1) | 6.4 (1) | 6.6 (0.8) | 6.6 (1) | 6.6 (1) | 6.6 (0.8) | 6.6 (1) | 15/15 |
| CMA brockhoff noiseless | 5.4 (2) | 6.2 (2) | 6.3 (1) | 6.3 (0.7) | 6.3 (1) | 6.3 (2) | 6.3 (1) | 15/15 |
| CMAa brockhoff noiseless | 5.2 (1) | 6.6 (0.9) | 6.7 (1) | 6.7 (2) | 6.8 (2) | 6.8 (2) | 6.8 (2) | 15/15 |
| CMAm brockhoff noiseless | 4.6 (1) | 5.6 (1) | 5.7 (1) | 5.7 (1) | 5.7 (0.8) | 5.7 (2) | 5.7 (1) | 15/15 |
| CMAma brockhoff noiseless | 4.0 (0.6) | 4.8 (0.9) | 4.9 (0.5) | 4.9 (1) | 4.9 (1) | 4.9 (1) | 4.9 (0.8) | 15/15 |
| CMAmah brockhoff noiseless | 3.1 (1) | 3.9 (1) | 4.0 (1) | 4.0 (0.9) | 4.0 (0.9) | 4.0 (0.8) | 4.0 (1) | 15/15 |
| CMAmh brockhoff noiseless | 3.1 (1) | 3.8 (1) | 4.1 (0.9) | 4.1 (0.9) | 4.1 (1) | 4.1 (0.8) | 4.1 (1) | 15/15 |
| DBRCGA chuang noiseless | 116 (70) | 156 (100) | 158 (64) | 159 (75) | 159 (59) | 159 (91) | 159 (109) | 15/15 |
| DE-AUTO voglis noiseless | 3.9 (0.2) | 4.0 (0.3) | 4.1 (0.3) | 4.1 (0.4) | 4.1 (0.4) | 4.1 (0.2) | 4.1 (0.3) | 15/15 |
| DE-BFGS voglis noiseless | 7.4 (3) | 9.4 (7) | 9.5 (7) | 9.5 (3) | 9.5 (5) | 10 (10) | 11 (5) | 15/15 |
| DE-ROLL voglis noiseless | 6.4 (18) | 6.7 (10) | 6.9 (0.7) | 7.1 (0.9) | 7.3 (2) | 7.7 (0.5) | 8.1 (5) | 15/15 |
| DE-SIMPLEX voglis noiseless | 354 (71) | 596 (312) | 832 (342) | 1028 (414) | 1142 (462) | 1320 (423) | 7246 (5978) | 15/15 |
| DEAE posik noiseless | 17 (8) | 22 (6) | 23 (6) | 23 (9) | 23 (8) | 23 (8) | 23 (8) | 15/15 |
| DE posik noiseless | 16 (4) | 22 (6) | 22 (5) | 22 (4) | 22 (5) | 22 (5) | 22 (4) | 15/15 |
| DEb posik noiseless | 16 (4) | 22 (5) | 22 (4) | 22 (4) | 22 (6) | 22 (5) | 22 (5) | 15/15 |
| DEctpb posik noiseless | 21 (4) | 28 (4) | 29 (6) | 30 (5) | 30 (4) | 30 (4) | 30 (4) | 15/15 |
| IPOPsaACM loshchilov noiseless | 5.0 (1) | 6.2 (1.0) | 6.2 (0.8) | 6.3 (1.0) | 6.3 (1) | 6.3 (1) | 6.3 (0.7) | 15/15 |
| JADE posik noiseless | 25 (8) | 34 (8) | 36 (5) | 36 (8) | 36 (5) | 36 (7) | 36 (11) | 15/15 |
| JADEb posik noiseless | 15 (5) | 21 (6) | 22 (5) | 22 (3) | 22 (5) | 22 (5) | 22 (5) | 15/15 |
| JADEctpb posik noiseless | 25 (10) | 34 (6) | 36 (8) | 36 (7) | 36 (4) | 36 (6) | 36 (9) | 15/15 |
| MVDE melo noiseless | 111 (11) | 165 (20) | 184 (29) | 197 (20) | 199 (31) | 199 (39) | 199 (26) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 4.9 (0.7) | 6.2 (0.7) | 6.2 (2) | 6.2 (1) | 6.2 (1) | 6.2 (1) | 6.2 (1) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 5.8 (0.8) | 6.8 (1) | 7.1 (2) | 7.1 (1) | 7.1 (1) | 7.1 (2) | 7.1 (0.9) | 15/15 |
| PSO-BFGS voglis noiseless | 7.7 (3) | 11 (6) | 12 (0.4) | 12 (8) | 12 (2) | 12 (5) | 12 (8) | 15/15 |
| SNES schaul noiseless | 10 (4) | 13 (3) | 14 (3) | 14 (3) | 14 (5) | 14 (5) | 14 (6) | 15/15 |
| xNES schaul noiseless | 9.0 (3) | 12 (3) | 13 (3) | 13 (3) | 13 (4) | 13 (3) | 13 (4) | 15/15 |
| xNESas schaul noiseless | 9.0 (2) | 12 (3) | 12 (2) | 12 (3) | 12 (4) | 12 (2) | 12 (2) | 15/15 |
| Δ fopt f6, 10-D |
1e1 412 |
1e0 623 |
1e-1 826 |
1e-2 1039 |
1e-3 1292 |
1e-5 1841 |
1e-7 2370 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 3.9 (0.7) | 4.3 (0.9) | 4.5 (0.4) | 4.6 (0.5) | 4.5 (0.8) | 4.3 (0.9) | 4.3 (0.7) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 2.0 (0.5) | 1.9 (0.2) | 1.9 (0.2) | 1.8 (0.3) | 1.7 (0.2) | 1.6 (0.2) | 1.6 (0.2) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.8 (0.3) | 1.8 (0.3) | 1.9 (0.4) | 1.9 (0.4) | 1.8 (0.2) | 1.8 (0.4) | 1.7 (0.3) | 15/15 |
| CMAES posik noiseless | 1.9 (0.6) | 1.9 (0.5) | 1.9 (0.4) | 1.9 (0.4) | 1.8 (0.3) | 1.7 (0.2) | 1.7 (0.1) | 15/15 |
| CMA brockhoff noiseless | 1.8 (0.4) | 1.8 (0.4) | 1.9 (0.2) | 1.9 (0.1) | 1.8 (0.3) | 1.7 (0.2) | 1.6 (0.2) | 15/15 |
| CMAa brockhoff noiseless | 1.8 (0.5) | 1.8 (0.4) | 1.8 (0.4) | 1.8 (0.2) | 1.8 (0.3) | 1.7 (0.2) | 1.6 (0.1) | 15/15 |
| CMAm brockhoff noiseless | 1.9 (0.4) | 2.0 (0.3) | 1.9 (0.3) | 1.9 (0.3) | 1.8 (0.3) | 1.7 (0.2) | 1.7 (0.2) | 15/15 |
| CMAma brockhoff noiseless | 1.9 (0.4) | 1.8 (0.3) | 1.8 (0.4) | 1.7 (0.4) | 1.7 (0.3) | 1.5 (0.2) | 1.5 (0.2) | 15/15 |
| CMAmah brockhoff noiseless | 1.3 (0.4) | 1.4 (0.4) | 1.5 (0.5) | 1.5 (0.5) | 1.5 (0.4) | 1.4 (0.3) | 1.5 (0.4) | 15/15 |
| CMAmh brockhoff noiseless | 1.4 (0.4) | 1.6 (0.6) | 1.6 (0.3) | 1.7 (0.7) | 1.7 (0.6) | 1.6 (0.4) | 1.7 (0.4) | 15/15 |
| DBRCGA chuang noiseless | 18 (5) | 24 (4) | 28 (5) | 30 (7) | 31 (4) | 30 (3) | 30 (4) | 15/15 |
| DE-AUTO voglis noiseless | 2.4 (1) | 2.4 (0.7) | 2.3 (0.6) | 2.2 (0.6) | 2.2 (0.6) | 4.0 (3) | 6.3 (6) | 15/15 |
| DE-BFGS voglis noiseless | 2.2 (2) | 2.0 (1.0) | 2.1 (2) | 2.4 (2) | 5.3 (4) | 16 (13) | 84 (53) | 12/15 |
| DE-ROLL voglis noiseless | 16 (20) | 22 (9) | 26 (17) | 27 (24) | 41 (52) | 55 (46) | 185 (332) | 10/15 |
| DE-SIMPLEX voglis noiseless | 25 (13) | 43 (19) | 55 (16) | 58 (24) | 76 (21) | 145 (82) | ∞1e6 | 0/15 |
| DEAE posik noiseless | 8.3 (2) | 10 (1) | 11 (1) | 11 (0.6) | 10 (0.6) | 10 (0.5) | 10 (0.6) | 15/15 |
| DE posik noiseless | 17 (2) | 20 (2) | 23 (3) | 24 (5) | 24 (7) | 24 (4) | 24 (3) | 15/15 |
| DEb posik noiseless | 17 (4) | 20 (3) | 23 (3) | 24 (8) | 24 (3) | 24 (6) | 24 (6) | 15/15 |
| DEctpb posik noiseless | 12 (2) | 14 (1) | 15 (1) | 15 (2) | 15 (2) | 14 (2) | 14 (0.9) | 15/15 |
| IPOPsaACM loshchilov noiseless | 1.7 (0.2) | 1.8 (0.6) | 1.9 (0.4) | 1.9 (0.4) | 1.8 (0.4) | 1.8 (0.9) | 1.8 (0.6) | 15/15 |
| JADE posik noiseless | 6.6 (1) | 7.5 (1) | 7.9 (2) | 8.4 (1) | 8.3 (2) | 8.2 (2) | 8.1 (2) | 15/15 |
| JADEb posik noiseless | 5.7 (3) | 8.8 (2) | 12 (2) | 21 (6) | 46 (41) | 382 (454) | 451 (546) | 2/15 |
| JADEctpb posik noiseless | 6.6 (2) | 7.5 (1) | 7.9 (0.6) | 8.4 (1) | 8.3 (1) | 8.2 (2) | 8.1 (1) | 15/15 |
| MVDE melo noiseless | 19 (6) | 27 (4) | 33 (6) | 38 (6) | 41 (7) | 48 (14) | 57 (13) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 1.8 (0.6) | 1.9 (0.5) | 1.9 (0.3) | 1.8 (0.3) | 1.8 (0.2) | 1.6 (0.1) | 1.6 (0.2) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 1.8 (0.9) | 1.8 (0.6) | 1.8 (0.2) | 1.8 (0.3) | 1.8 (0.3) | 1.6 (0.2) | 1.6 (0.2) | 15/15 |
| PSO-BFGS voglis noiseless | 4.0 (7) | 3.2 (2) | 2.8 (0.9) | 3.8 (2) | 9.4 (8) | 23 (12) | 220 (146) | 4/15 |
| SNES schaul noiseless | 1.6 (0.2) | 1.7 (0.3) | 1.9 (0.6) | 2.1 (0.8) | 3.2 (0.2) | 155 (33) | 269 (619) | 13/15 |
| xNES schaul noiseless | 2.5 (0.3) | 3.3 (0.2) | 3.9 (0.2) | 4.1 (0.2) | 4.1 (0.1) | 4.1 (0.1) | 4.1 (0.1) | 15/15 |
| xNESas schaul noiseless | 2.2 (0.3) | 3.1 (0.3) | 3.6 (0.3) | 3.8 (0.2) | 3.9 (0.2) | 3.8 (0.2) | 3.8 (0.1) | 15/15 |
| Δ fopt f7, 10-D |
1e1 172 |
1e0 1611 |
1e-1 4195 |
1e-2 5099 |
1e-3 5141 |
1e-5 5141 |
1e-7 5389 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 5.7 (3) | 21 (38) | 275 (997) | 236 (244) | 235 (123) | 235 (215) | 225 (105) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 2.0 (0.5) | 1.1 (0.6) | 0.88 (0.3) | 0.80 (0.4) | 0.85 (0.3) | 0.85 (0.4) | 0.82 (0.3) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.5 (0.4) | 0.81 (0.6) | 0.72 (0.4) | 0.68 (0.3) | 0.69 (0.1) | 0.69 (0.3) | 0.70 (0.3) | 15/15 |
| CMAES posik noiseless | 2.9 (2) | 2.2 (3) | 6.0 (14) | 24 (12) | 27 (30) | 27 (37) | 36 (35) | 14/15 |
| CMA brockhoff noiseless | 3.0 (2) | 1.5 (1.0) | 1.1 (0.6) | 1.4 (0.7) | 1.4 (0.8) | 1.4 (1.0) | 1.3 (0.9) | 15/15 |
| CMAa brockhoff noiseless | 2.1 (0.7) | 1.2 (0.7) | 0.91 (0.6) | 0.89 (0.4) | 0.93 (0.4) | 0.93 (0.5) | 0.90 (0.4) | 15/15 |
| CMAm brockhoff noiseless | 2.4 (0.7) | 2.0 (2) | 1.3 (0.7) | 1.2 (0.4) | 1.2 (0.1) | 1.2 (0.6) | 1.1 (0.7) | 15/15 |
| CMAma brockhoff noiseless | 2.2 (2) | 1.3 (0.6) | 0.83 (0.6) | 0.76 (0.4) | 0.79 (0.5) | 0.79 (0.3) | 0.80 (0.3) | 15/15 |
| CMAmah brockhoff noiseless | 2.7 (4) | 2.1 (0.9) | 0.99 (0.4) | 0.89 (0.2) | 0.90 (0.3) | 0.90 (0.3) | 0.87 (0.3) | 15/15 |
| CMAmh brockhoff noiseless | 4.7 (8) | 2.2 (1) | 1.4 (0.4) | 1.3 (0.3) | 1.3 (0.5) | 1.3 (0.5) | 1.2 (0.2) | 15/15 |
| DBRCGA chuang noiseless | 20 (3) | 15 (2) | 58 (78) | 128 (99) | 152 (187) | 152 (159) | 146 (136) | 11/15 |
| DE-AUTO voglis noiseless | 38 (19) | 19 (14) | 62 (14) | 57 (109) | 58 (27) | 58 (85) | 58 (24) | 14/15 |
| DE-BFGS voglis noiseless | 22 (18) | 151 (179) | 386 (432) | 436 (583) | 434 (525) | 434 (295) | 635 (731) | 2/15 |
| DE-ROLL voglis noiseless | 15 (10) | 17 (27) | 26 (39) | 31 (33) | 32 (33) | 32 (40) | 33 (36) | 15/15 |
| DE-SIMPLEX voglis noiseless | 23 (36) | 19 (15) | 31 (23) | 30 (24) | 30 (37) | 30 (23) | 30 (20) | 15/15 |
| DEAE posik noiseless | 6.6 (1) | 1.6 (0.4) | 0.94 (0.2) | 1.1 (0.1) | 1.2 (0.1) | 1.2 (0.2) | 1.2 (0.1) | 15/15 |
| DE posik noiseless | 19 (9) | 6.7 (2) | 22 (1) | 20 (2) | 20 (26) | 20 (49) | 19 (46) | 13/15 |
| DEb posik noiseless | 19 (12) | 6.7 (2) | 22 (61) | 20 (25) | 20 (25) | 20 (25) | 19 (24) | 13/15 |
| DEctpb posik noiseless | 16 (6) | 6.2 (1) | 5.0 (2) | 6.1 (1) | 6.3 (3) | 6.3 (0.8) | 6.3 (3) | 15/15 |
| IPOPsaACM loshchilov noiseless | 1.8 (0.4) | 1.00 (0.6) | 0.70 (0.4) | 0.68 (0.3) | 0.69 (0.4) | 0.69 (0.3) | 0.72 (0.3) | 15/15 |
| JADE posik noiseless | 8.0 (2) | 2.3 (0.4) | 20 (60) | 17 (49) | 17 (0.3) | 17 (98) | 16 (46) | 13/15 |
| JADEb posik noiseless | 6.6 (2) | 157 (156) | 180 (268) | 271 (735) | 269 (316) | 269 (462) | 256 (209) | 4/15 |
| JADEctpb posik noiseless | 8.0 (1) | 2.3 (0.6) | 20 (60) | 17 (0.4) | 17 (25) | 17 (0.4) | 16 (0.4) | 13/15 |
| MVDE melo noiseless | 24 (6) | 11 (3) | 12 (6) | 26 (10) | 31 (47) | 31 (10) | 33 (44) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 2.0 (0.6) | 1.4 (0.5) | 1.0 (0.7) | 1.2 (2) | 1.3 (1) | 1.3 (1) | 1.2 (0.6) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.0 (0.6) | 1.2 (0.7) | 1.0 (0.4) | 0.96 (0.6) | 0.96 (0.1) | 0.96 (0.3) | 0.93 (0.3) | 15/15 |
| PSO-BFGS voglis noiseless | 2441 (5342) | 8889 (1e4) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| SNES schaul noiseless | 1.9 (1) | 87 (83) | 245 (165) | 823 (813) | 1145 (1574) | 1145 (764) | 1092 (936) | 6/15 |
| xNES schaul noiseless | 2.4 (0.6) | 0.78 (0.1) | 0.48 (0.0) | 0.58 (0.1) | 0.58 (0.1) | 0.58 (0.1) | 0.64 (0.1) | 15/15 |
| xNESas schaul noiseless | 2.4 (1.0) | 0.76 (0.1) | 0.45 (0.0) | 0.56 (0.1) | 0.58 (0.1) | 0.58 (0.1) | 0.59 (0.0) | 15/15 |
| Δ fopt f8, 10-D |
1e1 326 |
1e0 921 |
1e-1 1114 |
1e-2 1217 |
1e-3 1267 |
1e-5 1315 |
1e-7 1343 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 4.3 (1) | 28 (2) | 41 (2) | 58 (3) | 76 (3) | 112 (3) | 149 (3) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 2.1 (1.0) | 3.5 (0.8) | 3.6 (0.5) | 3.6 (0.5) | 3.7 (0.5) | 3.8 (0.4) | 4.0 (0.3) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.2 (0.3) | 1.8 (0.9) | 1.7 (0.2) | 1.7 (0.6) | 1.7 (1) | 1.7 (1) | 1.7 (0.2) | 15/15 |
| CMAES posik noiseless | 2.2 (0.6) | 4.6 (3) | 4.6 (3) | 4.6 (2) | 4.6 (0.4) | 4.8 (2) | 4.9 (3) | 15/15 |
| CMA brockhoff noiseless | 2.5 (2) | 6.2 (6) | 6.0 (5) | 5.9 (4) | 5.9 (1.0) | 6.0 (4) | 6.1 (4) | 15/15 |
| CMAa brockhoff noiseless | 2.1 (0.8) | 3.6 (0.6) | 3.7 (0.8) | 3.7 (0.8) | 3.8 (0.5) | 3.9 (0.6) | 4.0 (0.3) | 15/15 |
| CMAm brockhoff noiseless | 3.7 (3) | 4.6 (1) | 4.7 (2) | 4.7 (1) | 4.7 (0.6) | 4.8 (1) | 4.9 (1) | 15/15 |
| CMAma brockhoff noiseless | 2.1 (0.7) | 3.7 (1) | 3.8 (0.5) | 3.8 (1) | 3.8 (2) | 3.9 (0.2) | 4.0 (1) | 15/15 |
| CMAmah brockhoff noiseless | 1.5 (0.2) | 3.8 (4) | 3.7 (2) | 3.7 (1) | 3.7 (2) | 3.7 (2) | 3.8 (3) | 15/15 |
| CMAmh brockhoff noiseless | 2.0 (0.5) | 4.6 (3) | 4.6 (3) | 4.5 (1) | 4.5 (0.5) | 4.6 (2) | 4.7 (2) | 15/15 |
| DBRCGA chuang noiseless | 29 (6) | 107 (169) | 109 (216) | 116 (189) | 127 (187) | 148 (176) | 180 (99) | 15/15 |
| DE-AUTO voglis noiseless | 0.94 (0.2) | 2.0 (3) | 1.8 (0.1) | 1.7 (2) | 1.7 (0.2) | 1.6 (0.1) | 1.6 (4) | 15/15 |
| DE-BFGS voglis noiseless | 1.2 (0.4) | 1.4 (0.6) | 1.3 (0.5) | 1.2 (0.4) | 1.2 (0.5) | 1.2 (0.5) | 1.2 (0.7) | 15/15 |
| DE-ROLL voglis noiseless | 4.2 (3) | 8.7 (6) | 20 (16) | 27 (25) | 35 (16) | 55 (12) | 257 (129) | 8/15 |
| DE-SIMPLEX voglis noiseless | 5.5 (7) | 11 (15) | 11 (7) | 13 (4) | 13 (2) | 14 (13) | 17 (3) | 15/15 |
| DEAE posik noiseless | 11 (1) | 13 (7) | 12 (1) | 12 (1) | 12 (0.7) | 13 (5) | 14 (1) | 15/15 |
| DE posik noiseless | 14 (4) | 64 (48) | 70 (3) | 73 (3) | 77 (5) | 88 (38) | 98 (67) | 15/15 |
| DEb posik noiseless | 14 (4) | 64 (93) | 70 (43) | 73 (38) | 77 (36) | 88 (32) | 98 (68) | 15/15 |
| DEctpb posik noiseless | 15 (2) | 41 (2) | 49 (4) | 55 (3) | 60 (3) | 73 (5) | 87 (5) | 15/15 |
| IPOPsaACM loshchilov noiseless | 1.3 (0.6) | 2.0 (1) | 1.9 (1) | 1.9 (1) | 1.8 (0.7) | 1.8 (1) | 1.9 (0.2) | 15/15 |
| JADE posik noiseless | 10 (1) | 16 (1) | 15 (2) | 15 (2) | 15 (1) | 16 (3) | 16 (2) | 15/15 |
| JADEb posik noiseless | 6.6 (1.0) | 15 (14) | 16 (14) | 28 (9) | 34 (0.9) | 42 (100) | 42 (9) | 14/15 |
| JADEctpb posik noiseless | 10 (2) | 16 (1) | 15 (2) | 15 (2) | 15 (2) | 16 (2) | 16 (2) | 15/15 |
| MVDE melo noiseless | 29 (6) | 631 (435) | 6126 (7410) | 5816 (5308) | 1.1e4 (5726) | 1.1e4 (9321) | 1.1e4 (1e4) | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 2.6 (2) | 4.9 (0.4) | 4.8 (3) | 4.7 (2) | 4.7 (3) | 4.8 (3) | 4.9 (0.5) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.1 (0.9) | 5.0 (4) | 4.9 (2) | 4.8 (2) | 4.8 (2) | 4.9 (3) | 5.0 (3) | 15/15 |
| PSO-BFGS voglis noiseless | 1.4 (0.4) | 1.1 (0.5) | 1.0 (0.3) | 0.96 (0.4) | 0.94 (0.3) | 0.93 (0.4) | 0.92 (0.4) | 15/15 |
| SNES schaul noiseless | 1.9 (0.2) | 90 (27) | 287 (105) | 529 (582) | 961 (873) | 3800 (1769) | ∞3e6 | 0/15 |
| xNES schaul noiseless | 5.3 (0.6) | 5.7 (0.6) | 6.1 (0.9) | 6.2 (0.6) | 6.2 (1) | 6.7 (1) | 7.5 (1) | 15/15 |
| xNESas schaul noiseless | 4.5 (0.8) | 8.0 (6) | 8.3 (5) | 8.2 (5) | 8.2 (5) | 8.4 (1) | 8.8 (5) | 15/15 |
| Δ fopt f9, 10-D |
1e1 200 |
1e0 648 |
1e-1 857 |
1e-2 993 |
1e-3 1065 |
1e-5 1138 |
1e-7 1185 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 9.1 (2) | 326 (1068) | 303 (814) | 365 (35) | 457 (664) | 664 (92) | 868 (160) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 3.4 (0.9) | 5.1 (2) | 4.8 (0.8) | 4.5 (0.7) | 4.4 (0.8) | 4.5 (1) | 4.5 (1) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.6 (0.4) | 2.2 (0.4) | 2.0 (0.3) | 1.8 (0.7) | 1.8 (0.2) | 1.7 (1) | 1.7 (0.2) | 15/15 |
| CMAES posik noiseless | 3.6 (2) | 8.1 (3) | 7.3 (7) | 6.7 (4) | 6.6 (0.6) | 6.5 (7) | 6.5 (4) | 15/15 |
| CMA brockhoff noiseless | 5.0 (1) | 6.7 (0.8) | 6.2 (2) | 5.8 (0.9) | 5.7 (1) | 5.6 (2) | 5.7 (0.6) | 15/15 |
| CMAa brockhoff noiseless | 3.0 (0.3) | 5.3 (0.7) | 4.9 (0.4) | 4.6 (0.6) | 4.6 (0.6) | 4.5 (0.7) | 4.6 (0.4) | 15/15 |
| CMAm brockhoff noiseless | 3.5 (0.9) | 6.5 (2) | 6.0 (3) | 5.6 (3) | 5.5 (2) | 5.4 (2) | 5.5 (2) | 15/15 |
| CMAma brockhoff noiseless | 3.1 (3) | 7.7 (6) | 6.8 (5) | 6.2 (4) | 6.0 (4) | 5.9 (4) | 5.9 (3) | 15/15 |
| CMAmah brockhoff noiseless | 1.9 (0.9) | 4.0 (0.7) | 3.9 (0.5) | 3.7 (0.7) | 3.6 (0.9) | 3.5 (0.4) | 3.6 (0.8) | 15/15 |
| CMAmh brockhoff noiseless | 3.1 (6) | 5.9 (6) | 5.5 (4) | 5.1 (4) | 5.0 (3) | 4.9 (2) | 4.9 (3) | 15/15 |
| DBRCGA chuang noiseless | 38 (10) | 694 (1560) | 627 (1172) | 712 (779) | 882 (502) | 4259 (3954) | 1.3e4 (2e4) | 0/15 |
| DE-AUTO voglis noiseless | 1.7 (0.4) | 4.1 (3) | 3.3 (5) | 3.0 (4) | 2.8 (3) | 2.6 (3) | 2.6 (3) | 15/15 |
| DE-BFGS voglis noiseless | 2.0 (0.8) | 2.3 (2) | 1.9 (0.7) | 1.7 (1) | 1.6 (2) | 1.5 (0.8) | 1.4 (0.5) | 15/15 |
| DE-ROLL voglis noiseless | 5.1 (5) | 64 (19) | 86 (108) | 101 (19) | 107 (72) | 129 (20) | 418 (655) | 6/15 |
| DE-SIMPLEX voglis noiseless | 10 (10) | 28 (43) | 26 (29) | 23 (25) | 22 (12) | 22 (24) | 22 (4) | 15/15 |
| DEAE posik noiseless | 15 (3) | 17 (12) | 16 (3) | 15 (7) | 15 (7) | 15 (10) | 16 (2) | 15/15 |
| DE posik noiseless | 23 (5) | 130 (90) | 186 (68) | 226 (36) | 273 (54) | 584 (227) | 3086 (3043) | 1/15 |
| DEb posik noiseless | 23 (5) | 130 (44) | 186 (61) | 226 (63) | 273 (46) | 584 (264) | 3086 (2004) | 1/15 |
| DEctpb posik noiseless | 25 (4) | 133 (57) | 193 (52) | 246 (41) | 292 (39) | 677 (339) | 3119 (3692) | 1/15 |
| IPOPsaACM loshchilov noiseless | 1.6 (0.5) | 2.0 (1) | 1.8 (0.8) | 1.7 (0.2) | 1.6 (0.9) | 1.6 (0.4) | 1.6 (0.3) | 15/15 |
| JADE posik noiseless | 15 (3) | 25 (3) | 22 (3) | 20 (2) | 20 (3) | 20 (1) | 20 (2) | 15/15 |
| JADEb posik noiseless | 15 (2) | 24 (23) | 21 (16) | 19 (15) | 19 (13) | 19 (2) | 19 (12) | 15/15 |
| JADEctpb posik noiseless | 15 (2) | 25 (3) | 22 (3) | 20 (3) | 20 (2) | 20 (3) | 20 (2) | 15/15 |
| MVDE melo noiseless | 48 (14) | 2.2e4 (3e4) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 3.4 (0.4) | 7.3 (6) | 6.4 (5) | 5.9 (4) | 5.8 (4) | 5.7 (4) | 5.8 (3) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.1 (0.4) | 5.7 (0.6) | 5.3 (0.5) | 5.0 (2) | 4.9 (2) | 4.9 (2) | 4.9 (0.3) | 15/15 |
| PSO-BFGS voglis noiseless | 1.6 (0.6) | 1.1 (0.3)★ | 0.98 (0.3)★ | 0.90 (0.2)★ | 0.86 (0.2)★ | 0.83 (0.1)★ | 0.81 (0.2)★ | 15/15 |
| SNES schaul noiseless | 3.6 (0.5) | 289 (223) | 620 (272) | 2444 (2497) | 4.0e4 (4e4) | ∞ | ∞3e6 | 0/15 |
| xNES schaul noiseless | 8.8 (0.7) | 8.0 (0.7) | 7.7 (2) | 7.3 (0.7) | 7.1 (1.0) | 7.5 (0.7) | 8.4 (0.6) | 15/15 |
| xNESas schaul noiseless | 7.1 (2) | 8.7 (2) | 9.1 (7) | 8.6 (2) | 8.5 (5) | 8.6 (2) | 8.8 (4) | 15/15 |
| Δ fopt f10, 10-D |
1e1 1835 |
1e0 2172 |
1e-1 2455 |
1e-2 2728 |
1e-3 2802 |
1e-5 4543 |
1e-7 4739 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1180 (1251) | 3560 (2279) | 8763 (8893) | 1.3e4 (1e4) | 5.3e4 (6e4) | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 1.4 (0.3) | 1.5 (0.1) | 1.4 (0.2) | 1.3 (0.1) | 1.3 (0.1) | 0.90 (0.0) | 0.92 (0.1) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 0.41 (0.1) | 0.39 (0.1) | 0.37 (0.0) | 0.35 (0.1) | 0.36 (0.0) | 0.24 (0.0) | 0.25 (0.0) | 15/15 |
| CMAES posik noiseless | 2.2 (0.3) | 2.1 (0.2) | 2.0 (0.2) | 1.9 (0.1) | 1.9 (0.2) | 1.2 (0.1) | 1.2 (0.1) | 15/15 |
| CMA brockhoff noiseless | 2.3 (0.1) | 2.3 (0.3) | 2.1 (0.1) | 2.0 (0.1) | 2.0 (0.1) | 1.3 (0.1) | 1.3 (0.1) | 15/15 |
| CMAa brockhoff noiseless | 1.4 (0.1) | 1.5 (0.1) | 1.4 (0.2) | 1.3 (0.2) | 1.3 (0.1) | 0.89 (0.1) | 0.92 (0.1) | 15/15 |
| CMAm brockhoff noiseless | 2.1 (0.6) | 2.1 (0.3) | 2.0 (0.2) | 1.9 (0.1) | 1.9 (0.1) | 1.2 (0.1) | 1.2 (0.0) | 15/15 |
| CMAma brockhoff noiseless | 1.3 (0.5) | 1.4 (0.2) | 1.3 (0.2) | 1.2 (0.1) | 1.3 (0.1) | 0.83 (0.0) | 0.84 (0.0) | 15/15 |
| CMAmah brockhoff noiseless | 1.8 (0.3) | 1.7 (0.2) | 1.6 (0.1) | 1.4 (0.1) | 1.4 (0.1) | 0.92 (0.0) | 0.92 (0.0) | 15/15 |
| CMAmh brockhoff noiseless | 2.3 (0.5) | 2.2 (0.2) | 2.0 (0.2) | 1.9 (0.1) | 1.9 (0.1) | 1.2 (0.1) | 1.2 (0.1) | 15/15 |
| DBRCGA chuang noiseless | 437 (374) | 3291 (2762) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE-AUTO voglis noiseless | 2.4 (3) | 2.0 (2) | 1.8 (2) | 1.6 (2) | 1.6 (2) | 1.0 (1) | 0.99 (0.9) | 15/15 |
| DE-BFGS voglis noiseless | 1.7 (1) | 1.5 (2) | 1.3 (1) | 1.2 (1) | 1.2 (0.6) | 0.73 (0.4) | 0.72 (0.7) | 15/15 |
| DE-ROLL voglis noiseless | 111 (28) | 142 (58) | 165 (52) | 172 (68) | 197 (40) | 148 (76) | 1524 (1056) | 0/15 |
| DE-SIMPLEX voglis noiseless | 20 (11) | 25 (8) | 33 (10) | 38 (13) | 46 (6) | 42 (10) | 221 (271) | 3/15 |
| DEAE posik noiseless | 2.2 (0.2) | 2.2 (0.2) | 2.3 (0.2) | 2.4 (0.2) | 2.6 (0.1) | 2.0 (0.1) | 2.3 (0.2) | 15/15 |
| DE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DEb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DEctpb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| IPOPsaACM loshchilov noiseless | 0.41 (0.1) | 0.40 (0.1) | 0.38 (0.1) | 0.36 (0.0) | 0.36 (0.1) | 0.25 (0.0) | 0.25 (0.0) | 15/15 |
| JADE posik noiseless | 4.4 (0.3) | 4.4 (1) | 4.6 (1) | 4.5 (1) | 4.7 (1) | 3.4 (0.7) | 3.6 (0.3) | 15/15 |
| JADEb posik noiseless | 13 (7) | 15 (5) | 16 (7) | 17 (9) | 19 (10) | 14 (6) | 16 (7) | 15/15 |
| JADEctpb posik noiseless | 4.4 (2) | 4.4 (1) | 4.6 (1) | 4.5 (1) | 4.7 (1) | 3.4 (0.5) | 3.6 (0.6) | 15/15 |
| MVDE melo noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 1.3 (0.3) | 1.4 (0.3) | 1.3 (0.1) | 1.3 (0.1) | 1.3 (0.1) | 0.89 (0.1) | 0.92 (0.1) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 1.4 (0.3) | 1.4 (0.2) | 1.4 (0.2) | 1.3 (0.1) | 1.3 (0.1) | 0.89 (0.1) | 0.92 (0.1) | 15/15 |
| PSO-BFGS voglis noiseless | 3.9 (4) | 3.3 (6) | 2.9 (4) | 2.6 (5) | 2.6 (5) | 1.6 (2) | 1.6 (0.9) | 15/15 |
| SNES schaul noiseless | 2.3e4 (3e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| xNES schaul noiseless | 1.5 (0.1) | 1.5 (0.1) | 1.6 (0.1) | 1.7 (0.1) | 1.9 (0.1) | 1.5 (0.0) | 1.8 (0.0) | 15/15 |
| xNESas schaul noiseless | 1.4 (0.1) | 1.4 (0.3) | 1.4 (0.1) | 1.4 (0.3) | 1.5 (0.2) | 1.0 (0.1) | 1.1 (0.1) | 15/15 |
| Δ fopt f11, 10-D |
1e1 266 |
1e0 1041 |
1e-1 2602 |
1e-2 2954 |
1e-3 3338 |
1e-5 4092 |
1e-7 4843 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 357 (89) | 160 (27) | 92 (13) | 105 (12) | 115 (20) | 132 (23) | 140 (19) | 14/15 |
| BIPOPaCMA loshchilov noiseless | 6.6 (0.7) | 2.0 (0.2) | 0.87 (0.0) | 0.83 (0.0) | 0.78 (0.1) | 0.72 (0.0) | 0.67 (0.0) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.9 (0.2) | 0.79 (0.1) | 0.33 (0.0) | 0.31 (0.0) | 0.29 (0.0) | 0.25 (0.0) | 0.23 (0.0) | 15/15 |
| CMAES posik noiseless | 14 (1) | 4.1 (0.5) | 1.8 (0.1) | 1.6 (0.1) | 1.5 (0.1) | 1.3 (0.0) | 1.2 (0.1) | 15/15 |
| CMA brockhoff noiseless | 14 (3) | 4.2 (0.6) | 1.8 (0.2) | 1.7 (0.2) | 1.6 (0.2) | 1.4 (0.2) | 1.2 (0.1) | 15/15 |
| CMAa brockhoff noiseless | 6.9 (0.8) | 2.1 (0.2) | 0.90 (0.0) | 0.85 (0.1) | 0.80 (0.0) | 0.73 (0.1) | 0.67 (0.0) | 15/15 |
| CMAm brockhoff noiseless | 14 (2) | 4.1 (0.2) | 1.8 (0.1) | 1.7 (0.1) | 1.5 (0.1) | 1.3 (0.1) | 1.2 (0.1) | 15/15 |
| CMAma brockhoff noiseless | 6.8 (0.6) | 2.0 (0.2) | 0.88 (0.1) | 0.82 (0.1) | 0.77 (0.1) | 0.69 (0.0) | 0.63 (0.0) | 15/15 |
| CMAmah brockhoff noiseless | 9.1 (0.7) | 2.6 (0.3) | 1.1 (0.1) | 1.0 (0.1) | 0.97 (0.1) | 0.84 (0.1) | 0.75 (0.0) | 15/15 |
| CMAmh brockhoff noiseless | 17 (3) | 5.1 (0.7) | 2.2 (0.2) | 2.0 (0.1) | 1.9 (0.1) | 1.6 (0.1) | 1.4 (0.1) | 15/15 |
| DBRCGA chuang noiseless | 153 (183) | 233 (162) | 149 (49) | 191 (30) | 216 (33) | 235 (12) | 1542 (1756) | 0/15 |
| DE-AUTO voglis noiseless | 0.43 (0.0) | 0.20 (0.0) | 0.09 (6e-3) | 0.09 (0.2) | 0.08 (8e-3) | 0.08 (0.1) | 0.37 (0.7) | 15/15 |
| DE-BFGS voglis noiseless | 0.52 (0.3) | 0.16 (0.1) | 0.07 (0.0) | 0.07 (0.0) | 0.07 (0.0) | 0.07 (0.0) | 0.07 (0.0) | 15/15 |
| DE-ROLL voglis noiseless | 293 (167) | 170 (66) | 106 (24) | 126 (72) | 138 (74) | 156 (57) | ∞1e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 49 (24) | 42 (18) | 28 (9) | 35 (6) | 41 (7) | 49 (6) | 966 (685) | 0/15 |
| DEAE posik noiseless | 12 (3) | 4.0 (1) | 1.9 (0.4) | 2.0 (0.4) | 2.0 (0.5) | 2.1 (0.4) | 2.1 (0.4) | 15/15 |
| DE posik noiseless | 516 (166) | 284 (59) | 210 (65) | 1236 (1269) | 2234 (3071) | ∞ | ∞5e5 | 0/15 |
| DEb posik noiseless | 516 (141) | 284 (68) | 210 (153) | 1236 (943) | 2234 (3071) | ∞ | ∞5e5 | 0/15 |
| DEctpb posik noiseless | 668 (150) | 327 (54) | 392 (315) | 2522 (3131) | ∞ | ∞ | ∞5e5 | 0/15 |
| IPOPsaACM loshchilov noiseless | 2.8 (0.3) | 0.76 (0.1) | 0.33 (0.0) | 0.30 (0.0) | 0.28 (0.0) | 0.25 (0.0) | 0.23 (0.0) | 15/15 |
| JADE posik noiseless | 21 (8) | 6.5 (2) | 3.1 (1) | 3.0 (0.4) | 3.0 (0.9) | 2.9 (0.7) | 2.9 (0.2) | 15/15 |
| JADEb posik noiseless | 22 (9) | 11 (4) | 7.3 (2) | 10 (5) | 11 (2) | 13 (4) | 13 (2) | 15/15 |
| JADEctpb posik noiseless | 21 (6) | 6.5 (2) | 3.1 (0.6) | 3.0 (0.7) | 3.0 (0.8) | 2.9 (0.8) | 2.9 (0.7) | 15/15 |
| MVDE melo noiseless | 508 (268) | 7038 (7980) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 6.9 (1) | 2.0 (0.2) | 0.90 (0.1) | 0.85 (0.1) | 0.81 (0.0) | 0.73 (0.0) | 0.68 (0.0) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 7.1 (0.6) | 2.1 (0.2) | 0.92 (0.1) | 0.88 (0.1) | 0.83 (0.0) | 0.75 (0.0) | 0.70 (0.0) | 15/15 |
| PSO-BFGS voglis noiseless | 0.44 (0.2) | 0.14 (0.0) | 0.06 (0.0) | 0.06 (0.0) | 0.06 (0.0) | 0.06 (0.0) | 0.99 (3) | 15/15 |
| SNES schaul noiseless | 5.1e4 (3e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| xNES schaul noiseless | 6.5 (0.8) | 2.1 (0.2) | 1.1 (0.1) | 1.2 (0.1) | 1.2 (0.1) | 1.4 (0.1) | 1.5 (0.1) | 15/15 |
| xNESas schaul noiseless | 6.7 (0.9) | 2.1 (0.2) | 1.0 (0.1) | 1.0 (0.1) | 1.0 (0.1) | 0.94 (0.1) | 0.88 (0.1) | 15/15 |
| Δ fopt f12, 10-D |
1e1 515 |
1e0 896 |
1e-1 1240 |
1e-2 1390 |
1e-3 1569 |
1e-5 3660 |
1e-7 5154 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1391 (0.6) | 6350 (8371) | 2.2e4 (2e4) | 1.0e5 (7e4) | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 3.2 (3) | 4.4 (3) | 4.8 (2) | 4.9 (3) | 4.9 (2) | 2.6 (1) | 2.1 (0.6) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.0 (0.3) | 1.1 (1) | 1.1 (1) | 1.3 (0.8) | 1.4 (1.0) | 0.94 (0.9) | 0.91 (0.7) | 15/15 |
| CMAES posik noiseless | 4.0 (3) | 4.4 (5) | 4.8 (3) | 5.1 (4) | 5.3 (2) | 2.9 (1) | 2.4 (1.0) | 15/15 |
| CMA brockhoff noiseless | 3.7 (1) | 4.3 (3) | 5.1 (3) | 5.5 (3) | 5.7 (2) | 3.1 (2) | 2.5 (1) | 15/15 |
| CMAa brockhoff noiseless | 2.8 (2) | 3.1 (3) | 3.7 (2) | 4.0 (1) | 4.1 (3) | 2.3 (1) | 1.8 (0.6) | 15/15 |
| CMAm brockhoff noiseless | 2.6 (6) | 4.2 (3) | 5.1 (2) | 5.5 (3) | 5.6 (1) | 3.0 (2) | 2.5 (0.5) | 15/15 |
| CMAma brockhoff noiseless | 2.6 (2) | 3.3 (3) | 3.9 (3) | 4.3 (3) | 4.4 (2) | 2.4 (0.9) | 2.0 (0.8) | 15/15 |
| CMAmah brockhoff noiseless | 4.1 (4) | 5.0 (3) | 5.3 (4) | 5.6 (4) | 5.5 (3) | 2.9 (2) | 2.3 (1.0) | 15/15 |
| CMAmh brockhoff noiseless | 2.5 (4) | 3.3 (5) | 3.8 (4) | 4.4 (4) | 4.6 (3) | 2.6 (1) | 2.2 (0.7) | 15/15 |
| DBRCGA chuang noiseless | 334 (488) | 1000 (1117) | 3245 (6856) | 1.0e4 (2e4) | ∞ | ∞ | ∞1e6 | 0/15 |
| DE-AUTO voglis noiseless | 2.7 (4) | 2.1 (3) | 2.0 (1) | 1.9 (1) | 1.8 (2) | 0.96 (0.9) | 1.6 (3) | 15/15 |
| DE-BFGS voglis noiseless | 1.3 (0.3) | 0.98 (0.8) | 0.97 (0.6) | 0.96 (0.9) | 0.94 (0.9) | 0.53 (0.3) | 0.59 (0.2) | 15/15 |
| DE-ROLL voglis noiseless | 41 (70) | 40 (67) | 47 (49) | 52 (77) | 59 (89) | 59 (42) | 344 (535) | 4/15 |
| DE-SIMPLEX voglis noiseless | 10 (8) | 13 (7) | 16 (8) | 18 (8) | 22 (4) | 15 (3) | 55 (58) | 7/15 |
| DEAE posik noiseless | 11 (1) | 9.1 (1) | 8.8 (4) | 10 (4) | 10 (4) | 5.7 (1) | 4.8 (1) | 15/15 |
| DE posik noiseless | 337 (966) | 749 (317) | 1345 (1387) | 5388 (8183) | ∞ | ∞ | ∞5e5 | 0/15 |
| DEb posik noiseless | 337 (422) | 749 (800) | 1345 (1531) | 5388 (7464) | ∞ | ∞ | ∞5e5 | 0/15 |
| DEctpb posik noiseless | 224 (246) | 435 (183) | 1345 (1342) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| IPOPsaACM loshchilov noiseless | 0.97 (0.7) | 1.0 (1) | 1.1 (1) | 1.3 (1.0) | 1.4 (0.9) | 0.82 (0.4) | 0.69 (0.3) | 15/15 |
| JADE posik noiseless | 18 (3) | 13 (2) | 13 (6) | 14 (3) | 15 (5) | 9.0 (4) | 7.8 (2) | 15/15 |
| JADEb posik noiseless | 10 (5) | 17 (15) | 20 (10) | 23 (10) | 24 (10) | 13 (4) | 11 (5) | 15/15 |
| JADEctpb posik noiseless | 18 (2) | 13 (6) | 13 (6) | 14 (6) | 15 (3) | 9.0 (3) | 7.8 (3) | 15/15 |
| MVDE melo noiseless | 416 (429) | 1081 (1739) | 5738 (4640) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 3.2 (2) | 4.6 (4) | 5.1 (4) | 5.3 (3) | 5.4 (3) | 2.9 (1) | 2.3 (0.7) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.6 (2) | 3.5 (2) | 3.9 (3) | 4.3 (2) | 4.4 (3) | 2.5 (1) | 2.0 (0.8) | 15/15 |
| PSO-BFGS voglis noiseless | 1.9 (1) | 1.8 (1) | 1.7 (1.0) | 1.6 (1) | 1.5 (1) | 1.0 (0.4) | 3.5 (0.6) | 15/15 |
| SNES schaul noiseless | 14 (0.1) | 64 (191) | 411 (692) | 881 (902) | 3005 (3772) | ∞ | ∞3e6 | 0/15 |
| xNES schaul noiseless | 7.9 (1) | 7.0 (3) | 9.2 (26) | 10 (4) | 10 (24) | 5.6 (7) | 5.5 (18) | 15/15 |
| xNESas schaul noiseless | 4.1 (0.7) | 3.5 (1.0) | 5.8 (12) | 9.0 (19) | 14 (3) | 8.0 (12) | 6.4 (4) | 15/15 |
| Δ fopt f13, 10-D |
1e1 387 |
1e0 596 |
1e-1 797 |
1e-2 1014 |
1e-3 4587 |
1e-5 6208 |
1e-7 7779 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1068 (295) | 1.9e4 (4e4) | 3.6e4 (6e4) | 4.1e4 (5e4) | 1.5e4 (2e4) | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 2.5 (2) | 3.6 (1) | 3.3 (1) | 3.4 (0.8) | 0.97 (0.4) | 0.97 (0.3) | 1.2 (0.6) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 0.75 (0.2) | 1.0 (0.6) | 1.2 (0.7) | 1.0 (0.8) | 0.27 (0.2) | 0.30 (0.1) | 0.32 (0.2) | 15/15 |
| CMAES posik noiseless | 2.9 (0.3) | 4.2 (2) | 4.7 (3) | 5.4 (3) | 1.4 (0.9) | 1.9 (0.7) | 2.6 (1) | 15/15 |
| CMA brockhoff noiseless | 2.7 (2) | 5.9 (5) | 6.1 (3) | 5.2 (2) | 1.5 (0.3) | 1.4 (0.3) | 1.4 (0.5) | 15/15 |
| CMAa brockhoff noiseless | 2.3 (0.6) | 3.7 (2) | 3.6 (1) | 3.8 (3) | 0.98 (0.6) | 1.0 (0.1) | 0.99 (0.4) | 15/15 |
| CMAm brockhoff noiseless | 1.9 (0.1) | 5.1 (5) | 6.1 (4) | 6.6 (3) | 1.7 (0.4) | 1.7 (0.6) | 1.8 (1.0) | 15/15 |
| CMAma brockhoff noiseless | 1.7 (0.7) | 3.7 (2) | 5.0 (2) | 4.8 (2) | 1.1 (0.4) | 1.3 (0.4) | 1.4 (0.4) | 15/15 |
| CMAmah brockhoff noiseless | 2.4 (3) | 5.4 (4) | 5.6 (1) | 4.8 (2) | 1.4 (0.4) | 1.6 (0.7) | 1.6 (0.9) | 15/15 |
| CMAmh brockhoff noiseless | 2.9 (3) | 6.1 (6) | 8.9 (3) | 7.9 (3) | 2.0 (0.4) | 2.1 (0.7) | 2.2 (0.9) | 15/15 |
| DBRCGA chuang noiseless | 201 (171) | 552 (1006) | 2132 (3251) | 4473 (3165) | 1487 (1908) | ∞ | ∞1e6 | 0/15 |
| DE-AUTO voglis noiseless | 1.5 (3) | 1.1 (2) | 1.00 (0.0) | 0.99 (1) | 0.52 (0.2) | 1.6 (2) | 32 (49) | 10/15 |
| DE-BFGS voglis noiseless | 0.84 (0.1) | 0.74 (0.0) | 0.70 (0.2) | 0.66 (0.0) | 0.17 (0.0) | 2.5 (0.2) | ∞1e6 | 0/15 |
| DE-ROLL voglis noiseless | 16 (12) | 17 (10) | 31 (17) | 34 (31) | 10 (8) | 13 (5) | 65 (169) | 8/15 |
| DE-SIMPLEX voglis noiseless | 11 (12) | 13 (13) | 16 (13) | 19 (8) | 4.7 (1) | 4.6 (1) | 14 (5) | 7/15 |
| DEAE posik noiseless | 8.2 (1) | 7.9 (0.6) | 7.9 (0.5) | 7.8 (0.3) | 2.1 (0.1) | 2.0 (0.0) | 2.0 (0.1) | 15/15 |
| DE posik noiseless | 21 (8) | 52 (36) | 188 (50) | 417 (144) | ∞ | ∞ | ∞5e5 | 0/15 |
| DEb posik noiseless | 21 (8) | 52 (28) | 188 (19) | 417 (90) | ∞ | ∞ | ∞5e5 | 0/15 |
| DEctpb posik noiseless | 25 (7) | 78 (36) | 225 (130) | 729 (295) | ∞ | ∞ | ∞5e5 | 0/15 |
| IPOPsaACM loshchilov noiseless | 0.96 (0.4) | 1.4 (1) | 1.3 (0.7) | 1.3 (0.6) | 0.32 (0.1) | 0.31 (0.1) | 0.31 (0.1) | 15/15 |
| JADE posik noiseless | 11 (1) | 14 (2) | 13 (2) | 12 (0.9) | 3.1 (0.5) | 3.2 (0.7) | 3.1 (0.6) | 15/15 |
| JADEb posik noiseless | 11 (7) | 19 (29) | 25 (20) | 25 (13) | 6.7 (3) | 8.7 (3) | 14 (6) | 15/15 |
| JADEctpb posik noiseless | 11 (2) | 14 (2) | 13 (1) | 12 (2) | 3.1 (0.5) | 3.2 (0.7) | 3.1 (0.5) | 15/15 |
| MVDE melo noiseless | 42 (11) | 141 (66) | 3336 (3682) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 2.8 (2) | 3.6 (2) | 3.9 (2) | 3.5 (2) | 0.90 (0.3) | 1.0 (0.3) | 1.4 (0.6) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.4 (1) | 3.7 (2) | 3.6 (2) | 4.3 (2) | 1.1 (0.2) | 1.1 (0.5) | 1.2 (0.6) | 15/15 |
| PSO-BFGS voglis noiseless | 0.92 (0.5) | 0.80 (0.0) | 0.75 (0.0) | 0.70 (0.1) | 0.18 (0.0) | 357 (323) | ∞1e6 | 0/15 |
| SNES schaul noiseless | 23 (39) | 97 (192) | 370 (411) | 782 (892) | 492 (476) | 1651 (3264) | 5379 (3592) | 0/15 |
| xNES schaul noiseless | 5.5 (0.2) | 6.0 (0.1) | 6.1 (0.1) | 6.2 (0.3) | 1.7 (0.0) | 1.7 (0.0) | 1.7 (0.0) | 15/15 |
| xNESas schaul noiseless | 3.6 (0.6) | 3.5 (2) | 16 (43) | 18 (38) | 8.0 (9) | 9.5 (7) | 10 (14) | 15/15 |
| Δ fopt f14, 10-D |
1e1 37 |
1e0 98 |
1e-1 133 |
1e-2 205 |
1e-3 392 |
1e-5 687 |
1e-7 4305 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 4.3 (3) | 6.5 (1) | 7.6 (1) | 8.9 (2) | 13 (4) | 662 (459) | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 2.2 (1) | 3.0 (0.8) | 3.7 (0.9) | 3.8 (0.4) | 3.3 (0.2) | 3.5 (0.2) | 0.86 (0.1) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.7 (1) | 2.2 (0.4) | 2.4 (0.4) | 2.2 (0.4) | 1.6 (0.1) | 1.4 (0.1) | 0.31 (0.0) | 15/15 |
| CMAES posik noiseless | 2.3 (1) | 3.1 (0.9) | 3.9 (0.7) | 4.3 (0.3) | 4.0 (0.5) | 5.2 (0.5) | 1.3 (0.1) | 15/15 |
| CMA brockhoff noiseless | 2.5 (1.0) | 3.1 (0.8) | 3.8 (0.4) | 4.2 (0.8) | 3.9 (0.7) | 5.3 (0.6) | 1.4 (0.1) | 15/15 |
| CMAa brockhoff noiseless | 2.9 (3) | 3.3 (0.8) | 4.1 (0.5) | 3.9 (0.7) | 3.2 (0.6) | 3.5 (0.4) | 0.84 (0.1) | 15/15 |
| CMAm brockhoff noiseless | 2.5 (2) | 2.9 (0.5) | 3.2 (0.6) | 3.7 (0.7) | 3.8 (0.7) | 5.2 (0.5) | 1.5 (0.2) | 15/15 |
| CMAma brockhoff noiseless | 1.9 (1) | 2.5 (0.7) | 3.1 (0.5) | 3.3 (0.4) | 2.8 (0.2) | 3.5 (0.3) | 0.86 (0.1) | 15/15 |
| CMAmah brockhoff noiseless | 1.6 (1) | 1.9 (0.5) | 2.2 (0.4) | 2.3 (0.5) | 2.3 (0.6) | 3.4 (0.5) | 0.97 (0.1) | 15/15 |
| CMAmh brockhoff noiseless | 1.4 (0.9) | 1.8 (0.7) | 2.1 (0.4) | 2.5 (0.6) | 2.9 (0.3) | 5.3 (1.0) | 1.5 (0.2) | 15/15 |
| DBRCGA chuang noiseless | 18 (15) | 38 (7) | 54 (13) | 59 (13) | 60 (13) | 374 (232) | ∞1e6 | 0/15 |
| DE-AUTO voglis noiseless | 1.9 (0.9) | 1.2 (0.3) | 1.1 (0.2) | 0.97 (0.1) | 0.63 (0.1) | 0.53 (0.1) | 11 (26) | 2/15 |
| DE-BFGS voglis noiseless | 1.9 (0.2) | 1.1 (0.2) | 1.1 (0.1) | 0.93 (0.1) | 0.64 (0.1) | 0.55 (0.1) | 19 (30) | 0/15 |
| DE-ROLL voglis noiseless | 2.1 (0.4) | 19 (35) | 21 (22) | 14 (13) | 16 (12) | 111 (61) | ∞1e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 4.4 (3) | 16 (8) | 34 (22) | 29 (12) | 20 (10) | 24 (12) | 19 (19) | 8/15 |
| DEAE posik noiseless | 6.9 (3) | 13 (4) | 17 (4) | 18 (2) | 12 (1) | 10 (0.7) | 2.1 (0.2) | 15/15 |
| DE posik noiseless | 8.7 (12) | 19 (3) | 23 (5) | 28 (6) | 46 (16) | 1101 (766) | ∞5e5 | 0/15 |
| DEb posik noiseless | 8.7 (9) | 19 (4) | 23 (5) | 28 (5) | 46 (16) | 1101 (746) | ∞5e5 | 0/15 |
| DEctpb posik noiseless | 7.0 (6) | 20 (5) | 25 (4) | 29 (4) | 46 (11) | 2048 (1135) | ∞5e5 | 0/15 |
| IPOPsaACM loshchilov noiseless | 2.2 (1) | 2.3 (0.5) | 2.4 (0.5) | 2.2 (0.3) | 1.6 (0.1) | 1.5 (0.1) | 0.31 (0.0) | 15/15 |
| JADE posik noiseless | 4.8 (3) | 11 (2) | 15 (2) | 16 (3) | 16 (1) | 16 (2) | 3.4 (0.7) | 15/15 |
| JADEb posik noiseless | 3.8 (2) | 7.9 (2) | 11 (1) | 12 (2) | 14 (2) | 20 (9) | 20 (13) | 7/15 |
| JADEctpb posik noiseless | 4.8 (3) | 11 (1) | 15 (2) | 16 (2) | 16 (2) | 16 (3) | 3.4 (0.6) | 15/15 |
| MVDE melo noiseless | 12 (11) | 35 (3) | 46 (4) | 51 (9) | 87 (33) | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 2.1 (2) | 3.0 (0.6) | 3.7 (0.3) | 3.9 (0.8) | 3.3 (0.7) | 3.7 (0.3) | 0.88 (0.1) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.0 (1) | 3.2 (0.7) | 4.0 (0.5) | 4.0 (0.8) | 3.3 (0.3) | 3.7 (0.4) | 0.87 (0.1) | 15/15 |
| PSO-BFGS voglis noiseless | 1.9 (0.3) | 1.2 (0.2) | 1.1 (0.2) | 0.96 (0.2) | 0.66 (0.1) | 0.55 (0.1) | 259 (245) | 0/15 |
| SNES schaul noiseless | 1.8 (0.7) | 2.1 (0.9) | 3.4 (0.5) | 4.4 (0.4) | 6.2 (3) | ∞ | ∞3e6 | 0/15 |
| xNES schaul noiseless | 2.0 (1.0) | 3.1 (0.9) | 8.8 (1) | 10 (1) | 7.7 (0.2) | 7.1 (0.2) | 1.5 (0.0) | 15/15 |
| xNESas schaul noiseless | 2.0 (2) | 3.3 (0.5) | 7.1 (1) | 7.8 (1) | 5.9 (0.8) | 5.5 (0.7) | 1.2 (0.1) | 15/15 |
| Δ fopt f15, 10-D |
1e1 4774 |
1e0 39246 |
1e-1 73643 |
1e-2 74669 |
1e-3 75790 |
1e-5 77814 |
1e-7 79834 |
#succ 12/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 41 (40) | 220 (392) | 436 (584) | 430 (440) | 424 (231) | 413 (461) | 402 (560) | 4/15 |
| BIPOPaCMA loshchilov noiseless | 1.1 (0.9) | 1.5 (1) | 1.2 (0.7) | 1.2 (0.9) | 1.2 (0.8) | 1.2 (0.7) | 1.2 (0.4) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.0 (1) | 1.1 (0.9) | 0.89 (0.6) | 0.88 (0.5) | 0.87 (0.9) | 0.92 (0.4) | 0.91 (0.7) | 15/15 |
| CMAES posik noiseless | 2.0 (2) | 190 (137) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CMA brockhoff noiseless | 0.89 (1) | 1.2 (0.6) | 0.79 (0.3) | 0.80 (0.3) | 0.80 (0.3) | 0.81 (0.3) | 0.82 (0.6) | 15/15 |
| CMAa brockhoff noiseless | 1.1 (0.5) | 1.0 (0.5) | 0.76 (0.5) | 0.77 (0.5) | 0.77 (0.5) | 0.78 (0.2) | 0.79 (0.4) | 15/15 |
| CMAm brockhoff noiseless | 0.74 (0.5) | 1.0 (0.7) | 1.0 (0.6) | 1.0 (0.6) | 1.0 (0.7) | 1.1 (0.3) | 1.1 (0.5) | 15/15 |
| CMAma brockhoff noiseless | 0.91 (1) | 0.89 (0.6) | 0.93 (0.5) | 0.93 (0.7) | 0.94 (0.4) | 0.95 (0.5) | 0.96 (0.7) | 15/15 |
| CMAmah brockhoff noiseless | 1.4 (1.0) | 0.96 (0.4) | 0.78 (0.4) | 0.78 (0.4) | 0.79 (0.3) | 0.80 (0.3) | 0.80 (0.3) | 15/15 |
| CMAmh brockhoff noiseless | 1.3 (0.8) | 0.97 (0.6) | 0.95 (0.8) | 0.95 (0.4) | 0.95 (0.5) | 0.96 (0.8) | 0.97 (0.4) | 15/15 |
| DBRCGA chuang noiseless | 126 (214) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE-AUTO voglis noiseless | 24 (11) | 68 (73) | 203 (180) | 200 (211) | 197 (218) | 192 (206) | 187 (157) | 1/15 |
| DE-BFGS voglis noiseless | 4.5 (2) | 6.5 (5) | 8.8 (4) | 8.7 (3) | 8.5 (11) | 8.3 (8) | 8.1 (7) | 12/15 |
| DE-ROLL voglis noiseless | 24 (12) | 38 (34) | 199 (286) | 197 (215) | 194 (205) | 189 (344) | 184 (194) | 1/15 |
| DE-SIMPLEX voglis noiseless | 18 (9) | 16 (7) | 29 (31) | 29 (16) | 28 (33) | 28 (61) | 27 (61) | 6/15 |
| DEAE posik noiseless | 56 (61) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DE posik noiseless | 108 (63) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DEb posik noiseless | 108 (183) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DEctpb posik noiseless | 84 (19) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| IPOPsaACM loshchilov noiseless | 0.90 (0.6) | 0.72 (0.5) | 0.76 (0.9) | 0.75 (0.7) | 0.74 (0.2) | 0.73 (0.6) | 0.73 (0.5) | 15/15 |
| JADE posik noiseless | 3.9 (0.9) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| JADEb posik noiseless | 14 (15) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| JADEctpb posik noiseless | 3.9 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| MVDE melo noiseless | 37 (31) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 0.77 (0.5) | 1.9 (1) | 1.3 (0.6) | 1.3 (0.8) | 1.3 (0.8) | 1.3 (0.8) | 1.3 (0.8) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 0.71 (0.8) | 0.78 (0.5) | 0.75 (0.6) | 0.76 (0.8) | 0.76 (0.4) | 0.77 (0.4) | 0.78 (0.4) | 15/15 |
| PSO-BFGS voglis noiseless | 43 (46) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| SNES schaul noiseless | 5.0 (5) | 503 (694) | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| xNES schaul noiseless | 2.4 (0.4) | 190 (233) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| xNESas schaul noiseless | 3.7 (0.2) | 168 (152) | 407 (364) | 401 (572) | 395 (336) | 385 (591) | 375 (692) | 2/15 |
| Δ fopt f16, 10-D |
1e1 425 |
1e0 7029 |
1e-1 15779 |
1e-2 45669 |
1e-3 51151 |
1e-5 65798 |
1e-7 71570 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 169 (210) | 981 (1172) | 489 (503) | 328 (423) | 364 (374) | 683 (699) | 2005 (1362) | 1/15 |
| BIPOPaCMA loshchilov noiseless | 2.6 (1) | 0.71 (0.6) | 0.84 (0.9) | 0.50 (0.3) | 0.75 (0.6) | 0.78 (0.7) | 0.76 (0.8) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.4 (1) | 0.67 (0.7) | 0.82 (0.6) | 0.58 (0.2) | 0.69 (0.4) | 0.63 (0.4) | 0.61 (0.9) | 15/15 |
| CMAES posik noiseless | 2.7 (0.9) | 2.0 (2) | 8.3 (10) | 10 (10) | 41 (45) | 107 (108) | 98 (215) | 0/15 |
| CMA brockhoff noiseless | 2.2 (0.8) | 1.2 (0.8) | 1.8 (2) | 0.93 (0.8) | 1.0 (1) | 0.84 (0.5) | 0.80 (0.7) | 15/15 |
| CMAa brockhoff noiseless | 2.4 (2) | 0.78 (0.5) | 0.90 (0.8) | 0.69 (0.9) | 1.0 (0.6) | 0.84 (0.9) | 0.80 (0.6) | 15/15 |
| CMAm brockhoff noiseless | 1.6 (0.9) | 0.95 (1) | 1.3 (1) | 0.66 (0.5) | 0.77 (0.5) | 0.76 (0.7) | 0.73 (0.7) | 15/15 |
| CMAma brockhoff noiseless | 1.4 (0.5) | 1.2 (2) | 1.2 (0.7) | 0.67 (0.5) | 0.67 (0.6) | 0.56 (0.5) | 0.53 (0.5) | 15/15 |
| CMAmah brockhoff noiseless | 3.2 (2) | 0.85 (0.5) | 1.0 (0.8) | 0.52 (0.2) | 0.62 (0.2) | 0.52 (0.1) | 0.49 (0.4) | 15/15 |
| CMAmh brockhoff noiseless | 2.6 (4) | 1.1 (0.5) | 1.3 (1) | 0.65 (0.3) | 0.88 (2) | 0.74 (0.9) | 0.70 (0.1) | 15/15 |
| DBRCGA chuang noiseless | 8.6 (3) | 56 (59) | 283 (276) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE-AUTO voglis noiseless | 18 (8) | 45 (31) | 90 (119) | 103 (247) | 293 (358) | ∞ | ∞1e6 | 0/15 |
| DE-BFGS voglis noiseless | 26 (23) | 15 (19) | 39 (32) | 91 (54) | 279 (299) | ∞ | ∞1e6 | 0/15 |
| DE-ROLL voglis noiseless | 13 (22) | 49 (81) | 148 (124) | 316 (318) | ∞ | ∞ | ∞1e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 6.0 (12) | 13 (4) | 94 (49) | 150 (132) | 134 (174) | 107 (99) | ∞1e6 | 0/15 |
| DEAE posik noiseless | 70 (51) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DE posik noiseless | 106 (101) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DEb posik noiseless | 106 (54) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DEctpb posik noiseless | 114 (130) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| IPOPsaACM loshchilov noiseless | 2.5 (1) | 0.67 (0.8) | 0.72 (0.4) | 0.39 (0.2) | 0.44 (0.4) | 0.36 (0.1) | 0.34 (0.3) | 15/15 |
| JADE posik noiseless | 17 (8) | 82 (128) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| JADEb posik noiseless | 20 (13) | 112 (165) | 207 (325) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| JADEctpb posik noiseless | 17 (7) | 82 (75) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| MVDE melo noiseless | 20 (16) | 193 (164) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 3.3 (2) | 0.67 (0.6) | 1.1 (0.9) | 0.49 (0.4) | 0.48 (0.3) | 0.40 (0.2) | 0.38 (0.2) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.8 (4) | 0.63 (0.8) | 0.68 (0.6) | 0.41 (0.2) | 0.44 (0.5) | 0.37 (0.3) | 0.36 (0.2) | 15/15 |
| PSO-BFGS voglis noiseless | 42 (11) | 245 (340) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| SNES schaul noiseless | 2.6 (1.0) | 1.4 (2) | 14 (23) | 26 (37) | 65 (42) | 322 (418) | ∞3e6 | 0/15 |
| xNES schaul noiseless | 8.2 (4) | 2.2 (4) | 3.9 (4) | 2.6 (2) | 3.2 (3) | 2.6 (2) | 2.4 (2) | 15/15 |
| xNESas schaul noiseless | 7.1 (6) | 1.8 (1) | 3.2 (3) | 2.0 (2) | 2.2 (2) | 1.8 (1) | 1.7 (2) | 15/15 |
| Δ fopt f17, 10-D |
1e1 26 |
1e0 429 |
1e-1 2203 |
1e-2 6329 |
1e-3 9851 |
1e-5 20190 |
1e-7 26503 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 5.5 (3) | 2.6 (0.5) | 1.1 (0.3) | 11 (18) | 24 (42) | 239 (261) | 278 (82) | 11/15 |
| BIPOPaCMA loshchilov noiseless | 2.2 (1) | 1.1 (0.4) | 0.81 (0.9) | 1.4 (1) | 1.3 (2) | 0.90 (0.3) | 1.2 (0.6) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.0 (2) | 2.6 (1) | 1.5 (1) | 1.2 (0.6) | 1.1 (0.4) | 1.1 (1) | 2.1 (2) | 15/15 |
| CMAES posik noiseless | 2.1 (1) | 1.1 (0.5) | 0.43 (0.1) | 1.2 (1) | 2.6 (1) | ∞ | ∞5e5 | 0/15 |
| CMA brockhoff noiseless | 2.0 (2) | 1.1 (0.3) | 0.66 (0.1) | 0.74 (0.9) | 1.1 (0.9) | 0.81 (0.3) | 1.1 (0.4) | 15/15 |
| CMAa brockhoff noiseless | 2.4 (2) | 1.0 (0.2) | 0.61 (0.1) | 0.87 (0.5) | 0.80 (0.4) | 0.75 (0.3) | 0.86 (0.5) | 15/15 |
| CMAm brockhoff noiseless | 1.8 (2) | 1.1 (0.3) | 1.1 (1) | 0.68 (0.3) | 0.80 (0.5) | 0.80 (0.2) | 0.92 (0.4) | 15/15 |
| CMAma brockhoff noiseless | 1.5 (0.5) | 3.0 (0.4) | 1.2 (1) | 0.86 (0.4) | 0.84 (0.5) | 0.75 (0.1) | 0.79 (0.2) | 15/15 |
| CMAmah brockhoff noiseless | 1.4 (0.5) | 4.2 (5) | 1.6 (1) | 1.1 (0.8) | 1.3 (0.5) | 1.1 (0.5) | 1.1 (0.3) | 15/15 |
| CMAmh brockhoff noiseless | 1.5 (2) | 6.6 (11) | 2.4 (2) | 1.1 (0.5) | 1.1 (0.4) | 0.99 (0.3) | 1.1 (0.4) | 15/15 |
| DBRCGA chuang noiseless | 3.7 (5) | 16 (6) | 77 (176) | 364 (555) | 1426 (711) | ∞ | ∞1e6 | 0/15 |
| DE-AUTO voglis noiseless | 37 (85) | 207 (178) | 150 (134) | 153 (125) | 108 (80) | 69 (26) | 169 (106) | 1/15 |
| DE-BFGS voglis noiseless | 7.0 (8) | 38 (20) | 144 (117) | 90 (207) | 115 (169) | 83 (163) | ∞1e6 | 0/15 |
| DE-ROLL voglis noiseless | 14 (8) | 99 (50) | 118 (124) | 135 (93) | 454 (381) | ∞ | ∞1e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 18 (59) | 114 (45) | 467 (494) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEAE posik noiseless | 3.4 (4) | 6.3 (0.8) | 2.7 (0.3) | 1.6 (0.2) | 1.4 (0.1) | 1.3 (0.1) | 1.5 (0.9) | 15/15 |
| DE posik noiseless | 3.5 (4) | 7.4 (3) | 3.8 (1.0) | 2.4 (0.4) | 2.6 (1) | 12 (15) | 45 (46) | 5/15 |
| DEb posik noiseless | 3.5 (4) | 7.4 (3) | 3.8 (1.0) | 2.4 (0.6) | 2.6 (0.6) | 12 (15) | 45 (66) | 5/15 |
| DEctpb posik noiseless | 4.0 (5) | 8.1 (1) | 4.6 (0.6) | 3.2 (0.4) | 3.4 (0.5) | 5.1 (2) | 14 (13) | 13/15 |
| IPOPsaACM loshchilov noiseless | 2.4 (2) | 1.1 (0.6) | 1.1 (1) | 1.0 (0.9) | 1.2 (0.5) | 1.2 (0.6) | 1.4 (0.6) | 15/15 |
| JADE posik noiseless | 3.3 (4) | 5.2 (0.9) | 2.8 (0.5) | 1.8 (0.3) | 1.9 (1) | 5.2 (13) | 6.8 (9) | 12/15 |
| JADEb posik noiseless | 2.8 (4) | 4.1 (2) | 2.7 (2) | 4.6 (9) | 14 (26) | 75 (110) | ∞5e5 | 0/15 |
| JADEctpb posik noiseless | 3.3 (3) | 5.2 (1) | 2.8 (0.5) | 1.8 (0.5) | 1.9 (1.0) | 5.2 (19) | 6.8 (11) | 12/15 |
| MVDE melo noiseless | 4.8 (7) | 16 (3) | 13 (1) | 24 (44) | 42 (55) | 158 (119) | 566 (1067) | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 3.0 (3) | 3.2 (8) | 1.5 (2) | 1.0 (0.6) | 1.3 (0.8) | 1.0 (0.4) | 1.3 (0.5) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.2 (1) | 1.1 (0.2) | 0.84 (0.1) | 0.79 (0.5) | 1.1 (0.6) | 0.81 (0.3) | 0.94 (0.4) | 15/15 |
| PSO-BFGS voglis noiseless | 7.8 (17) | 108 (104) | 201 (246) | 141 (114) | 125 (92) | 170 (138) | ∞1e6 | 0/15 |
| SNES schaul noiseless | 1.6 (0.8) | 1.1 (0.6) | 4.2 (7) | 4.1 (0.0) | 6.4 (10) | 28 (29) | 517 (458) | 2/15 |
| xNES schaul noiseless | 2.6 (3) | 1.8 (0.6) | 1.2 (0.2) | 0.74 (0.0) | 0.69 (0.0) | 1.5 (1) | 6.1 (8) | 15/15 |
| xNESas schaul noiseless | 1.5 (2) | 1.7 (0.4) | 1.1 (0.2) | 0.69 (0.1) | 0.63 (0.0) | 1.2 (2) | 2.8 (2) | 15/15 |
| Δ fopt f18, 10-D |
1e1 238 |
1e0 836 |
1e-1 7012 |
1e-2 15928 |
1e-3 27536 |
1e-5 37234 |
1e-7 42708 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 2.8 (0.6) | 2.9 (2) | 118 (374) | 207 (191) | 747 (1190) | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 1.0 (0.6) | 2.2 (2) | 0.84 (0.5) | 0.98 (0.5) | 0.72 (0.5) | 0.85 (0.5) | 0.96 (0.4) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.5 (3) | 2.2 (0.2) | 0.81 (0.6) | 0.61 (0.1) | 0.63 (0.4) | 0.91 (0.5) | 0.91 (0.7) | 15/15 |
| CMAES posik noiseless | 1.2 (0.4) | 2.0 (4) | 1.4 (2) | 6.3 (7) | 45 (60) | ∞ | ∞5e5 | 0/15 |
| CMA brockhoff noiseless | 1.0 (0.4) | 1.7 (5) | 1.0 (0.9) | 1.1 (0.7) | 0.83 (0.3) | 0.92 (0.3) | 0.93 (0.5) | 15/15 |
| CMAa brockhoff noiseless | 1.1 (0.5) | 2.9 (2) | 0.85 (0.8) | 0.84 (0.5) | 0.74 (0.3) | 0.74 (0.3) | 0.84 (0.4) | 15/15 |
| CMAm brockhoff noiseless | 0.94 (0.3) | 0.91 (0.4) | 0.66 (0.5) | 0.88 (0.8) | 0.82 (0.5) | 0.82 (0.1) | 0.85 (0.1) | 15/15 |
| CMAma brockhoff noiseless | 1.0 (0.4) | 1.6 (3) | 0.78 (0.4) | 0.67 (0.5) | 0.63 (0.5) | 0.70 (0.2) | 0.69 (0.2) | 15/15 |
| CMAmah brockhoff noiseless | 1.8 (0.6) | 8.4 (5) | 2.2 (4) | 1.4 (2) | 0.97 (0.5) | 0.92 (0.7) | 0.88 (0.6) | 15/15 |
| CMAmh brockhoff noiseless | 1.2 (1) | 6.3 (14) | 2.0 (1) | 1.3 (0.8) | 1.1 (0.6) | 1.0 (0.3) | 1.0 (0.4) | 15/15 |
| DBRCGA chuang noiseless | 12 (2) | 25 (5) | 108 (179) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE-AUTO voglis noiseless | 106 (146) | 250 (444) | 108 (108) | 70 (59) | 82 (83) | 399 (363) | ∞1e6 | 0/15 |
| DE-BFGS voglis noiseless | 25 (17) | 51 (26) | 71 (145) | 91 (64) | 115 (137) | 191 (202) | ∞1e6 | 0/15 |
| DE-ROLL voglis noiseless | 78 (96) | 315 (71) | 421 (430) | 904 (1273) | ∞ | ∞ | ∞1e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 135 (134) | 1303 (1381) | 972 (1333) | 918 (676) | 532 (909) | ∞ | ∞1e6 | 0/15 |
| DEAE posik noiseless | 5.1 (1) | 5.0 (0.8) | 1.1 (0.3) | 0.94 (0.8) | 0.88 (0.8) | 0.84 (0.7) | 0.92 (0.3) | 15/15 |
| DE posik noiseless | 5.9 (2) | 12 (8) | 10 (4) | 12 (13) | 19 (11) | 96 (137) | ∞5e5 | 0/15 |
| DEb posik noiseless | 5.9 (2) | 12 (8) | 10 (36) | 12 (5) | 19 (15) | 96 (101) | ∞5e5 | 0/15 |
| DEctpb posik noiseless | 6.1 (1.0) | 13 (5) | 6.0 (3) | 10 (6) | 18 (7) | 197 (201) | ∞5e5 | 0/15 |
| IPOPsaACM loshchilov noiseless | 1.3 (0.7) | 1.2 (0.4) | 1.6 (0.9) | 0.92 (0.4) | 0.75 (0.5) | 1.0 (0.4) | 1.3 (0.4) | 15/15 |
| JADE posik noiseless | 4.1 (1) | 6.4 (0.7) | 1.6 (0.3) | 0.96 (0.2) | 1.9 (2) | 4.9 (7) | 16 (20) | 7/15 |
| JADEb posik noiseless | 3.2 (2) | 5.6 (1) | 4.6 (2) | 49 (46) | ∞ | ∞ | ∞5e5 | 0/15 |
| JADEctpb posik noiseless | 4.1 (2) | 6.4 (1) | 1.6 (0.3) | 0.96 (0.1) | 1.9 (0.5) | 4.9 (8) | 16 (15) | 7/15 |
| MVDE melo noiseless | 10 (3) | 32 (25) | 53 (45) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 1.2 (0.7) | 2.1 (3) | 0.67 (0.6) | 0.84 (1) | 0.81 (0.6) | 1.1 (0.4) | 1.1 (0.2) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 1.2 (0.3) | 1.0 (0.2) | 0.87 (1.0) | 1.1 (0.8) | 0.81 (0.5) | 0.85 (0.3) | 0.86 (0.3) | 15/15 |
| PSO-BFGS voglis noiseless | 74 (24) | 188 (221) | 133 (56) | 292 (456) | 538 (619) | ∞ | ∞1e6 | 0/15 |
| SNES schaul noiseless | 1.3 (0.7) | 6.2 (0.6) | 5.9 (4) | 15 (12) | 35 (29) | ∞ | ∞3e6 | 0/15 |
| xNES schaul noiseless | 1.1 (0.5) | 2.2 (0.2) | 0.54 (0.0) | 0.37 (0.0) | 0.29 (0.0) | 1.1 (0.6) | 4.1 (8) | 15/15 |
| xNESas schaul noiseless | 1.1 (0.5) | 2.2 (0.3) | 0.72 (0.8) | 0.44 (0.3) | 0.32 (0.0) | 0.75 (0.5) | 1.3 (0.7) | 15/15 |
| Δ fopt f19, 10-D |
1e1 1 |
1e0 1 |
1e-1 10609 |
1e-2 9.8e5 |
1e-3 1.4e6 |
1e-5 1.4e6 |
1e-7 1.4e6 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 187 (49) | 1.8e6 (3e6) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 63 (32) | 1.0e4 (5914) | 11 (7) | 0.86 (0.3) | 0.77 (0.6) | 0.77 (0.6) | 0.77 (0.4) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 44 (31) | 1.1e4 (7304) | 5.9 (7) | 0.68 (0.6) | 0.78 (0.4) | 0.78 (0.4) | 0.78 (0.4) | 15/15 |
| CMAES posik noiseless | 67 (66) | 1.3e4 (7863) | 144 (172) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CMA brockhoff noiseless | 56 (37) | 8548 (3101) | 37 (45) | 1.1 (0.5) | 1.1 (0.4) | 1.1 (0.8) | 1.2 (0.4) | 13/15 |
| CMAa brockhoff noiseless | 63 (30) | 7971 (3572) | 35 (22) | 1.1 (0.6) | 0.95 (0.6) | 0.95 (0.6) | 0.94 (1) | 12/15 |
| CMAm brockhoff noiseless | 52 (52) | 8856 (4076) | 32 (29) | 1.0 (0.7) | 0.80 (0.3) | 0.80 (0.5) | 0.80 (0.8) | 14/15 |
| CMAma brockhoff noiseless | 56 (40) | 5.7e4 (2e5) | 31 (42) | 1.2 (0.8) | 1.1 (1) | 1.1 (2) | 1.1 (2) | 12/15 |
| CMAmah brockhoff noiseless | 43 (28) | 6.3e4 (2e5) | 27 (31) | 0.86 (0.5) | 0.77 (0.3) | 0.77 (0.2) | 0.77 (0.3) | 15/15 |
| CMAmh brockhoff noiseless | 42 (23) | 7109 (7500) | 55 (43) | 1.2 (0.8) | 1.2 (1.0) | 1.2 (1) | 1.2 (1) | 12/15 |
| DBRCGA chuang noiseless | 379 (328) | 1.3e5 (3e4) | 1396 (2145) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE-AUTO voglis noiseless | 1579 (3386) | 4.7e4 (3e4) | 96 (130) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE-BFGS voglis noiseless | 665 (476) | 6773 (6914) | 10 (6) | 15 (23) | ∞ | ∞ | ∞1e6 | 0/15 |
| DE-ROLL voglis noiseless | 801 (566) | 2.7e4 (2e4) | 105 (121) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 1048 (1023) | 2.6e4 (1e4) | 42 (57) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEAE posik noiseless | 219 (91) | 2.3e6 (1e6) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DE posik noiseless | 387 (234) | 7.5e6 (3e6) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DEb posik noiseless | 387 (261) | 7.5e6 (1e7) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DEctpb posik noiseless | 305 (268) | 3.5e6 (3e6) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| IPOPsaACM loshchilov noiseless | 60 (32) | 1.8e4 (7e4) | 9.3 (7) | 0.55 (0.3) | 0.49 (0.2) | 0.49 (0.4) | 0.49 (0.4) | 15/15 |
| JADE posik noiseless | 165 (103) | 7.8e4 (8e4) | 679 (542) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| JADEb posik noiseless | 174 (130) | 2.0e5 (1e5) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| JADEctpb posik noiseless | 165 (92) | 7.8e4 (4e4) | 679 (848) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| MVDE melo noiseless | 473 (140) | 4.8e5 (2e5) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 73 (28) | 8153 (6627) | 13 (11) | 0.84 (1) | 0.82 (0.5) | 0.82 (0.4) | 0.82 (0.4) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 55 (35) | 8205 (6801) | 29 (69) | 1.5 (1) | 1.5 (1) | 1.5 (1) | 1.5 (0.7) | 15/15 |
| PSO-BFGS voglis noiseless | 766 (1497) | 1.3e4 (5724) | 16 (2) | 4.8 (5) | ∞ | ∞ | ∞1e6 | 0/15 |
| SNES schaul noiseless | 47 (24) | 3.5e4 (8e4) | 4148 (8343) | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| xNES schaul noiseless | 40 (31) | 2.6e5 (3e5) | 3159 (3615) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| xNESas schaul noiseless | 38 (22) | 4.0e5 (6e5) | 1440 (1352) | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Δ fopt f20, 10-D |
1e1 32 |
1e0 15426 |
1e-1 5.5e5 |
1e-2 5.7e5 |
1e-3 5.7e5 |
1e-5 5.8e5 |
1e-7 5.9e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 11 (4) | 1.6 (2) | 1.3 (1) | 1.2 (1) | 1.2 (1) | 1.2 (0.4) | 1.2 (1) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 4.6 (0.8) | 3.2 (3) | 1.2 (0.2) | 1.2 (0.3) | 1.2 (0.3) | 1.2 (0.4) | 1.2 (0.6) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 4.4 (0.6) | 1.4 (1) | 1.1 (0.6) | 1.1 (0.6) | 1.1 (0.5) | 1.0 (0.8) | 1.0 (0.5) | 15/15 |
| CMAES posik noiseless | 5.6 (2) | 22 (24) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CMA brockhoff noiseless | 4.9 (2) | 2.8 (0.8) | 0.89 (0.4) | 0.90 (0.3) | 0.90 (0.4) | 0.91 (0.4) | 0.92 (0.4) | 15/15 |
| CMAa brockhoff noiseless | 4.8 (2) | 1.8 (1) | 0.86 (0.4) | 0.87 (0.4) | 0.88 (0.4) | 0.88 (0.4) | 0.89 (0.4) | 15/15 |
| CMAm brockhoff noiseless | 3.9 (1) | 3.2 (0.6) | 0.88 (0.4) | 0.89 (0.4) | 0.90 (0.4) | 0.90 (0.4) | 0.91 (0.4) | 15/15 |
| CMAma brockhoff noiseless | 4.2 (1) | 2.1 (0.8) | 0.77 (0.3) | 0.78 (0.0) | 0.78 (0.4) | 0.79 (0.4) | 0.79 (0.4) | 15/15 |
| CMAmah brockhoff noiseless | 3.0 (0.5) | 2.5 (1) | 0.83 (0.4) | 0.84 (0.4) | 0.85 (0.0) | 0.85 (0.4) | 0.86 (0.3) | 15/15 |
| CMAmh brockhoff noiseless | 3.0 (0.3) | 3.3 (2) | 0.75 (0.4) | 0.77 (0.4) | 0.77 (0.2) | 0.78 (0.2) | 0.78 (0.2) | 15/15 |
| DBRCGA chuang noiseless | 48 (7) | 5.8 (7) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE-AUTO voglis noiseless | 3.2 (0.6) | 1.6 (2) | 13 (16) | 12 (17) | 12 (10) | 12 (21) | 12 (14) | 2/15 |
| DE-BFGS voglis noiseless | 4.6 (2) | 0.43 (0.3) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE-ROLL voglis noiseless | 49 (77) | 0.57 (0.5) | 3.0 (3) | 2.9 (3) | 2.9 (4) | 2.8 (2) | 2.8 (2) | 7/15 |
| DE-SIMPLEX voglis noiseless | 11 (19) | 3.1 (2) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEAE posik noiseless | 22 (6) | 7.0 (10) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DE posik noiseless | 26 (12) | 0.77 (0.2) | 0.48 (0.4) | 0.47 (0.7) | 0.47 (0.3) | 0.46 (0.6) | 0.46 (0.5) | 13/15 |
| DEb posik noiseless | 26 (8) | 0.77 (0.2) | 0.48 (0.6) | 0.47 (0.6) | 0.47 (0.3) | 0.46 (0.2) | 0.46 (0.4) | 13/15 |
| DEctpb posik noiseless | 25 (3) | 1.9 (0.8) | 0.14 (0.0) | 0.14 (0.1) | 0.15 (0.1) | 0.15 (0.0) | 0.15 (0.0) | 15/15 |
| IPOPsaACM loshchilov noiseless | 4.3 (0.6) | 0.86 (0.4) | 0.74 (0.3) | 0.76 (0.4) | 0.75 (0.4) | 0.75 (0.2) | 0.74 (0.4) | 15/15 |
| JADE posik noiseless | 14 (6) | 0.73 (0.2) | 0.16 (0.2) | 0.18 (0.2) | 0.21 (0.2) | 0.29 (0.1) | 0.34 (0.2) | 15/15 |
| JADEb posik noiseless | 11 (3) | 0.27 (0.1) | 3.0 (2) | 2.9 (4) | 2.9 (4) | 2.9 (2) | 2.8 (4) | 3/15 |
| JADEctpb posik noiseless | 14 (5) | 0.73 (0.1) | 0.16 (0.2) | 0.18 (0.1) | 0.21 (0.1) | 0.29 (0.2) | 0.34 (0.1) | 15/15 |
| MVDE melo noiseless | 50 (12) | 0.98 (0.5) | 0.22 (0.0) | 0.22 (0.0) | 0.23 (0.0) | 0.24 (0.0) | 0.25 (0.5) | 14/15 |
| NBIPOPaCMA loshchilov noiseless | 4.9 (0.9) | 3.1 (2) | 1.3 (0.5) | 1.3 (0.7) | 1.3 (0.5) | 1.3 (0.7) | 1.3 (0.5) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 4.5 (1) | 2.6 (2) | 0.77 (0.4) | 0.78 (0.3) | 0.78 (0.6) | 0.79 (0.4) | 0.80 (0.4) | 15/15 |
| PSO-BFGS voglis noiseless | 4.2 (2) | 1.0 (0.6) | 26 (13) | 25 (13) | 25 (21) | 25 (11) | 24 (37) | 1/15 |
| SNES schaul noiseless | 3.1 (0.8) | 7.2 (12) | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| xNES schaul noiseless | 3.6 (2) | 1.1 (1.0) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| xNESas schaul noiseless | 3.4 (2) | 2.1 (3) | 106 (73) | 102 (131) | 102 (96) | 100 (83) | 99 (106) | 1/15 |
| Δ fopt f21, 10-D |
1e1 130 |
1e0 2236 |
1e-1 4392 |
1e-2 4487 |
1e-3 4618 |
1e-5 5074 |
1e-7 11329 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 36 (3) | 1457 (5619) | 1746 (2280) | 1709 (1708) | 1661 (1881) | 1512 (2924) | 677 (959) | 10/15 |
| BIPOPaCMA loshchilov noiseless | 2.7 (5) | 5.9 (8) | 14 (42) | 13 (38) | 13 (3) | 12 (33) | 5.4 (1) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.5 (2) | 2.3 (4) | 1.5 (1) | 1.5 (4) | 1.5 (1) | 1.4 (2) | 0.61 (0.2) | 15/15 |
| CMAES posik noiseless | 7.0 (21) | 6.4 (11) | 6.0 (12) | 5.9 (9) | 5.7 (11) | 5.2 (7) | 2.4 (3) | 15/15 |
| CMA brockhoff noiseless | 6.8 (7) | 21 (55) | 11 (13) | 11 (13) | 11 (7) | 11 (5) | 4.9 (5) | 15/15 |
| CMAa brockhoff noiseless | 2.8 (10) | 53 (79) | 30 (42) | 29 (6) | 29 (3) | 26 (74) | 12 (18) | 13/15 |
| CMAm brockhoff noiseless | 2.5 (0.7) | 50 (140) | 46 (78) | 45 (76) | 44 (22) | 40 (33) | 18 (44) | 12/15 |
| CMAma brockhoff noiseless | 5.7 (9) | 89 (115) | 47 (59) | 46 (37) | 45 (128) | 41 (112) | 19 (41) | 12/15 |
| CMAmah brockhoff noiseless | 2.4 (3) | 71 (85) | 63 (42) | 62 (47) | 60 (114) | 55 (101) | 25 (58) | 11/15 |
| CMAmh brockhoff noiseless | 2.3 (5) | 108 (145) | 67 (75) | 66 (79) | 65 (71) | 59 (98) | 27 (46) | 11/15 |
| DBRCGA chuang noiseless | 18 (15) | 40 (76) | 47 (130) | 46 (117) | 46 (183) | 42 (31) | 20 (49) | 14/15 |
| DE-AUTO voglis noiseless | 4.4 (6) | 28 (50) | 32 (38) | 32 (30) | 31 (24) | 28 (31) | 13 (12) | 15/15 |
| DE-BFGS voglis noiseless | 2.6 (2) | 7.6 (10) | 8.8 (5) | 8.7 (4) | 8.4 (20) | 7.7 (13) | 32 (115) | 4/15 |
| DE-ROLL voglis noiseless | 22 (40) | 53 (18) | 48 (106) | 47 (34) | 45 (21) | 41 (58) | 18 (22) | 15/15 |
| DE-SIMPLEX voglis noiseless | 16 (19) | 83 (120) | 83 (92) | 81 (149) | 79 (134) | 72 (82) | 32 (39) | 14/15 |
| DEAE posik noiseless | 14 (7) | 13 (11) | 10 (11) | 10 (10) | 10 (11) | 9.3 (9) | 4.2 (4) | 15/15 |
| DE posik noiseless | 24 (27) | 17 (18) | 10 (13) | 10 (9) | 10 (8) | 10 (6) | 4.6 (4) | 15/15 |
| DEb posik noiseless | 24 (27) | 17 (10) | 10 (10) | 10 (11) | 10 (13) | 10 (9) | 4.6 (4) | 15/15 |
| DEctpb posik noiseless | 21 (4) | 43 (173) | 23 (15) | 23 (36) | 22 (4) | 21 (75) | 10 (14) | 13/15 |
| IPOPsaACM loshchilov noiseless | 2.5 (3) | 15 (23) | 48 (93) | 47 (59) | 46 (43) | 42 (97) | 19 (37) | 15/15 |
| JADE posik noiseless | 7.7 (1) | 6.0 (4) | 3.6 (0.6) | 4.5 (4) | 5.0 (4) | 6.3 (8) | 3.7 (3) | 15/15 |
| JADEb posik noiseless | 23 (8) | 25 (25) | 18 (13) | 18 (18) | 18 (19) | 16 (15) | 7.4 (8) | 15/15 |
| JADEctpb posik noiseless | 7.7 (3) | 6.0 (4) | 3.6 (3) | 4.5 (2) | 5.0 (9) | 6.3 (8) | 3.7 (3) | 15/15 |
| MVDE melo noiseless | 21 (7) | 8.9 (5) | 6.5 (3) | 10 (7) | 13 (6) | 19 (14) | 12 (11) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 5.6 (10) | 11 (13) | 10 (8) | 10 (18) | 9.3 (7) | 8.5 (8) | 3.8 (1) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 6.1 (24) | 99 (114) | 71 (73) | 70 (71) | 68 (69) | 62 (43) | 28 (16) | 15/15 |
| PSO-BFGS voglis noiseless | 2.6 (3) | 2.2 (3) | 2.1 (3) | 2.1 (2) | 2.1 (5) | 1.9 (3) | 26 (34) | 7/15 |
| SNES schaul noiseless | 116 (287) | 82 (84) | 77 (65) | 75 (169) | 73 (139) | 67 (35) | 30 (45) | 15/15 |
| xNES schaul noiseless | 125 (230) | 66 (61) | 94 (143) | 92 (28) | 89 (85) | 81 (117) | 37 (12) | 14/15 |
| xNESas schaul noiseless | 84 (116) | 69 (89) | 58 (67) | 56 (58) | 55 (44) | 50 (44) | 22 (22) | 15/15 |
| Δ fopt f22, 10-D |
1e1 98 |
1e0 2839 |
1e-1 6353 |
1e-2 6620 |
1e-3 6798 |
1e-5 8296 |
1e-7 10351 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 9749 (4e4) | 5191 (6505) | 1.1e4 (1e4) | 1.0e4 (1e4) | 1.0e4 (1e4) | 8352 (6383) | 6694 (8497) | 2/15 |
| BIPOPaCMA loshchilov noiseless | 29 (46) | 6.4 (11) | 143 (202) | 137 (119) | 133 (116) | 109 (32) | 88 (46) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 13 (17) | 3.7 (3) | 32 (18) | 31 (14) | 30 (10) | 25 (128) | 20 (6) | 15/15 |
| CMAES posik noiseless | 21 (27) | 12 (20) | 56 (114) | 54 (57) | 53 (36) | 43 (38) | 35 (83) | 11/15 |
| CMA brockhoff noiseless | 6.4 (15) | 157 (187) | 1357 (2264) | 1302 (1562) | 1268 (955) | 1039 (725) | 833 (541) | 1/15 |
| CMAa brockhoff noiseless | 10 (0.7) | 127 (272) | 1359 (1098) | 1304 (1659) | 1270 (939) | 1041 (483) | 834 (687) | 1/15 |
| CMAm brockhoff noiseless | 14 (67) | 210 (381) | ∞ | ∞ | ∞ | ∞ | ∞6e5 | 0/15 |
| CMAma brockhoff noiseless | 26 (57) | 153 (115) | 1365 (1535) | 1310 (1508) | 1276 (1515) | 1045 (1167) | 838 (541) | 1/15 |
| CMAmah brockhoff noiseless | 6.8 (18) | 246 (220) | ∞ | ∞ | ∞ | ∞ | ∞6e5 | 0/15 |
| CMAmh brockhoff noiseless | 17 (13) | 194 (111) | ∞ | ∞ | ∞ | ∞ | ∞6e5 | 0/15 |
| DBRCGA chuang noiseless | 27 (6) | 38 (40) | 62 (35) | 61 (23) | 60 (63) | 52 (74) | 43 (55) | 13/15 |
| DE-AUTO voglis noiseless | 143 (357) | 81 (92) | 206 (151) | 198 (172) | 193 (193) | 158 (316) | 127 (188) | 5/15 |
| DE-BFGS voglis noiseless | 4.2 (7) | 12 (14) | 26 (39) | 25 (23) | 24 (22) | 20 (21) | 121 (319) | 0/15 |
| DE-ROLL voglis noiseless | 34 (18) | 44 (59) | 140 (127) | 134 (157) | 132 (222) | 109 (113) | 127 (76) | 5/15 |
| DE-SIMPLEX voglis noiseless | 95 (318) | 65 (108) | 90 (91) | 87 (87) | 85 (106) | 70 (139) | 69 (95) | 10/15 |
| DEAE posik noiseless | 35 (5) | 19 (34) | 29 (66) | 28 (16) | 27 (29) | 23 (21) | 18 (21) | 13/15 |
| DE posik noiseless | 68 (10) | 45 (36) | 50 (57) | 54 (77) | 53 (76) | 46 (57) | 39 (28) | 11/15 |
| DEb posik noiseless | 68 (9) | 45 (67) | 50 (43) | 54 (81) | 53 (60) | 46 (56) | 39 (33) | 11/15 |
| DEctpb posik noiseless | 30 (21) | 128 (135) | 235 (280) | 229 (208) | 225 (283) | 187 (251) | 152 (153) | 4/15 |
| IPOPsaACM loshchilov noiseless | 119 (10) | 175 (532) | 1652 (1630) | 1585 (697) | 1544 (786) | 1265 (1794) | 1014 (1402) | 9/15 |
| JADE posik noiseless | 22 (39) | 68 (151) | 111 (148) | 115 (179) | 117 (267) | 144 (187) | 147 (143) | 4/15 |
| JADEb posik noiseless | 66 (74) | 11 (9) | 33 (62) | 32 (26) | 32 (34) | 26 (31) | 21 (29) | 13/15 |
| JADEctpb posik noiseless | 22 (78) | 68 (109) | 111 (116) | 115 (110) | 117 (83) | 144 (212) | 147 (236) | 4/15 |
| MVDE melo noiseless | 33 (14) | 141 (358) | 253 (396) | 259 (376) | 270 (270) | 869 (965) | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 38 (33) | 17 (26) | 34 (12) | 32 (74) | 31 (15) | 26 (113) | 21 (89) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 81 (139) | 61 (148) | 131 (130) | 126 (182) | 123 (175) | 101 (145) | 81 (95) | 15/15 |
| PSO-BFGS voglis noiseless | 5.2 (5) | 1.8 (2) | 3.0 (2) | 2.9 (4) | 2.8 (5) | 2.3 (3) | 93 (130) | 0/15 |
| SNES schaul noiseless | 307 (456) | 87 (113) | 93 (70) | 90 (132) | 89 (72) | 96 (153) | 105 (66) | 14/15 |
| xNES schaul noiseless | 125 (230) | 105 (232) | 131 (136) | 126 (117) | 123 (187) | 101 (129) | 81 (108) | 13/15 |
| xNESas schaul noiseless | 70 (306) | 53 (56) | 84 (142) | 81 (91) | 79 (160) | 65 (38) | 52 (60) | 15/15 |
| Δ fopt f23, 10-D |
1e1 3.0 |
1e0 915 |
1e-1 16425 |
1e-2 1.8e5 |
1e-3 2.0e5 |
1e-5 2.1e5 |
1e-7 2.1e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 2.3 (2) | 1656 (2838) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 2.5 (3) | 20 (12) | 1.8 (1) | 1.4 (0.4) | 1.4 (1) | 1.4 (1) | 1.4 (2) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 4.6 (3) | 19 (15) | 1.8 (1) | 0.45 (0.3) | 0.55 (0.2) | 0.65 (0.4) | 0.92 (0.7) | 15/15 |
| CMAES posik noiseless | 2.7 (9) | 44 (36) | 22 (16) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CMA brockhoff noiseless | 1.7 (2) | 548 (498) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMAa brockhoff noiseless | 2.6 (4) | 277 (322) | 727 (302) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMAm brockhoff noiseless | 1.1 (1) | 243 (189) | 734 (692) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMAma brockhoff noiseless | 2.7 (3) | 67 (52) | 224 (252) | 137 (160) | 124 (131) | 120 (67) | 118 (235) | 1/15 |
| CMAmah brockhoff noiseless | 3.7 (1) | 136 (289) | 459 (884) | 142 (135) | 129 (210) | 125 (302) | 123 (185) | 1/15 |
| CMAmh brockhoff noiseless | 3.0 (5) | 423 (761) | 1455 (1402) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DBRCGA chuang noiseless | 1.7 (0.6) | 105 (77) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE-AUTO voglis noiseless | 1.1 (0.9) | 2.4 (4) | 12 (10) | 38 (23) | ∞ | ∞ | ∞1e6 | 0/15 |
| DE-BFGS voglis noiseless | 1.7 (2) | 3.6 (4) | 52 (15) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE-ROLL voglis noiseless | 1.4 (1) | 5.7 (11) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 1.7 (1) | 0.57 (0.7) | 7.0 (6) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEAE posik noiseless | 1.9 (2) | 529 (332) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DE posik noiseless | 2.3 (0.9) | 1384 (2252) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DEb posik noiseless | 2.3 (1) | 1384 (631) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DEctpb posik noiseless | 1.2 (1) | 473 (449) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| IPOPsaACM loshchilov noiseless | 2.3 (1) | 199 (286) | 429 (858) | 126 (164) | 114 (161) | 111 (51) | 108 (84) | 5/15 |
| JADE posik noiseless | 1.4 (1) | 89 (55) | 137 (119) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| JADEb posik noiseless | 1.8 (1) | 169 (99) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| JADEctpb posik noiseless | 1.4 (1) | 89 (73) | 137 (129) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| MVDE melo noiseless | 1.9 (1) | 163 (102) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 2.2 (2) | 18 (18) | 2.9 (1) | 1.2 (1.0) | 1.5 (0.8) | 1.5 (1) | 1.5 (0.6) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.6 (2) | 88 (48) | 8.4 (7) | 1.2 (0.3) | 1.1 (1) | 1.2 (0.4) | 1.2 (0.9) | 15/15 |
| PSO-BFGS voglis noiseless | 1.6 (2) | 3.0 (4) | 22 (13) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| SNES schaul noiseless | 1.2 (0.9) | 60 (26) | 113 (103) | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| xNES schaul noiseless | 1.6 (2) | 933 (1361) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| xNESas schaul noiseless | 1.3 (1) | 594 (606) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Δ fopt f24, 10-D |
1e1 98761 |
1e0 1.0e6 |
1e-1 7.5e7 |
1e-2 7.5e7 |
1e-3 7.5e7 |
1e-5 7.5e7 |
1e-7 7.5e7 |
#succ 1/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 0.98 (1) | 2.2 (2) | 0.93 (2) | 0.93 (0.8) | 0.93 (2) | 0.93 (1) | 0.93 (0.7) | 2/15 |
| BIPOPsaACM loshchilov noiseless | 1.3 (3) | 1.6 (2) | 0.61 (0.5) | 2.0 (2) | 2.0 (0.8) | 2.0 (3) | 2.0 (2) | 1/15 |
| CMAES posik noiseless | 0.95 (0.7) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CMA brockhoff noiseless | 41 (41) | 27 (31) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMAa brockhoff noiseless | 18 (36) | 13 (29) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMAm brockhoff noiseless | 18 (21) | 5.5 (5) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMAma brockhoff noiseless | 27 (21) | 5.8 (4) | 0.39 (0.3) | 0.39 (0.3) | 0.39 (0.7) | 0.39 (0.3) | 0.39 (0.4) | 1/15 |
| CMAmah brockhoff noiseless | 56 (35) | 27 (23) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMAmh brockhoff noiseless | 82 (112) | 13 (26) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DBRCGA chuang noiseless | 32 (24) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE-AUTO voglis noiseless | 143 (218) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE-BFGS voglis noiseless | 142 (91) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE-ROLL voglis noiseless | 41 (96) | 6.9 (11) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 21 (18) | 6.8 (7) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEAE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DEb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DEctpb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| IPOPsaACM loshchilov noiseless | 72 (163) | 17 (18) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| JADE posik noiseless | 34 (56) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| JADEb posik noiseless | 21 (35) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| JADEctpb posik noiseless | 34 (30) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| MVDE melo noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 0.90 (0.8) | 1.2 (0.6) | 0.58 (0.7) | 0.59 (0.3) | 0.59 (0.6) | 0.59 (0.9) | 0.59 (1.0) | 3/15 |
| NIPOPaCMA loshchilov noiseless | 6.8 (16) | 1.0 (3) | 0.23 (0.4) | 0.31 (0.2) | 0.31 (0.4) | 0.31 (0.4) | 0.31 (0.5) | 5/15 |
| PSO-BFGS voglis noiseless | 8.4 (8) | 7.0 (8) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| SNES schaul noiseless | 1.4 (0.4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| xNES schaul noiseless | 336 (412) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| xNESas schaul noiseless | 731 (759) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
Previous dimension | Dimension = 20 | Next dimension
| Δ fopt f1, 20-D |
1e1 43 |
1e0 43 |
1e-1 43 |
1e-2 43 |
1e-3 43 |
1e-5 43 |
1e-7 43 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 24 (8) | 43 (6) | 60 (6) | 77 (7) | 95 (8) | 129 (7) | 164 (7) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 7.5 (0.9) | 14 (1) | 20 (2) | 27 (2) | 33 (3) | 46 (2) | 59 (3) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 4.0 (0.2) | 5.1 (0.6) | 6.6 (0.7) | 7.9 (0.5) | 10 (0.6) | 13 (1.0) | 16 (0.9) | 15/15 |
| CMAES posik noiseless | 7.5 (2) | 13 (1) | 20 (3) | 26 (2) | 33 (2) | 45 (1) | 58 (3) | 15/15 |
| CMA brockhoff noiseless | 7.3 (0.7) | 13 (1) | 19 (0.8) | 25 (2) | 32 (2) | 43 (1) | 56 (3) | 15/15 |
| CMAa brockhoff noiseless | 7.8 (1) | 14 (2) | 20 (2) | 26 (2) | 32 (2) | 45 (3) | 58 (3) | 15/15 |
| CMAm brockhoff noiseless | 6.1 (0.7) | 10 (1) | 14 (2) | 19 (1) | 23 (1) | 32 (0.5) | 41 (1) | 15/15 |
| CMAma brockhoff noiseless | 5.8 (1) | 10 (0.9) | 14 (1) | 19 (1) | 23 (0.9) | 32 (1) | 41 (3) | 15/15 |
| CMAmah brockhoff noiseless | 3.8 (0.6) | 6.6 (1) | 10 (1) | 13 (0.5) | 15 (1) | 21 (0.8) | 27 (1) | 15/15 |
| CMAmh brockhoff noiseless | 3.8 (0.3) | 6.7 (0.6) | 10 (0.5) | 13 (1.0) | 15 (0.7) | 22 (1) | 28 (1) | 15/15 |
| DBRCGA chuang noiseless | 142 (46) | 304 (35) | 485 (73) | 634 (126) | 799 (88) | 1119 (173) | 1449 (138) | 15/15 |
| DE-AUTO voglis noiseless | 3.1 (0.1) | 3.1 (0.1) | 3.1 (0.1) | 3.1 (0.1) | 3.1 (0.1) | 3.1 (0.1) | 3.1 (0.1) | 15/15 |
| DE-BFGS voglis noiseless | 2.0 (0.2) | 2.2 (0) | 2.2 (0) | 2.2 (0) | 2.2 (0) | 2.2 (0) | 2.2 (0) | 15/15 |
| DE-ROLL voglis noiseless | 6.4 (6) | 36 (35) | 37 (35) | 38 (35) | 38 (35) | 38 (36) | 38 (36) | 15/15 |
| DE-SIMPLEX voglis noiseless | 71 (24) | 181 (76) | 237 (96) | 312 (96) | 389 (117) | 461 (66) | 840 (544) | 15/15 |
| DEAE posik noiseless | 75 (20) | 144 (25) | 214 (21) | 278 (25) | 352 (27) | 492 (40) | 635 (52) | 15/15 |
| DE posik noiseless | 89 (22) | 162 (33) | 241 (28) | 321 (33) | 400 (26) | 558 (42) | 717 (50) | 15/15 |
| DEb posik noiseless | 89 (16) | 162 (27) | 241 (27) | 321 (23) | 400 (30) | 558 (37) | 717 (44) | 15/15 |
| DEctpb posik noiseless | 91 (9) | 181 (9) | 269 (18) | 354 (16) | 440 (18) | 615 (40) | 803 (30) | 15/15 |
| IPOPsaACM loshchilov noiseless | 3.9 (0.2) | 5.0 (0.4) | 6.5 (0.5) | 7.8 (0.6) | 9.5 (0.6) | 13 (0.4) | 16 (0.8) | 15/15 |
| JADE posik noiseless | 47 (7) | 94 (7) | 143 (10) | 191 (10) | 240 (9) | 340 (10) | 437 (13) | 15/15 |
| JADEb posik noiseless | 35 (4) | 67 (5) | 102 (10) | 141 (16) | 179 (12) | 260 (18) | 346 (10) | 15/15 |
| JADEctpb posik noiseless | 47 (7) | 94 (9) | 143 (8) | 191 (6) | 240 (6) | 340 (9) | 437 (12) | 15/15 |
| MVDE melo noiseless | 144 (13) | 299 (11) | 445 (15) | 601 (9) | 743 (8) | 1048 (20) | 1355 (20) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 7.9 (1) | 14 (2) | 20 (1) | 27 (2) | 33 (3) | 46 (2) | 59 (2) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 7.7 (2) | 14 (2) | 20 (3) | 26 (3) | 33 (2) | 45 (2) | 58 (3) | 15/15 |
| PSO-BFGS voglis noiseless | 1.9 (0.2) | 2.2 (0) | 2.2 (0) | 2.2 (0) | 2.2 (0) | 2.2 (0) | 2.2 (0) | 15/15 |
| SNES schaul noiseless | 5.4 (0.8) | 14 (1) | 25 (4) | 36 (3) | 45 (3) | 66 (2) | 86 (2) | 15/15 |
| xNES schaul noiseless | 5.8 (4) | 70 (6) | 137 (16) | 203 (6) | 274 (5) | 410 (8) | 546 (7) | 15/15 |
| xNESas schaul noiseless | 7.3 (3) | 41 (5) | 61 (8) | 74 (18) | 88 (24) | 110 (40) | 128 (42) | 15/15 |
| Δ fopt f2, 20-D |
1e1 385 |
1e0 386 |
1e-1 387 |
1e-2 388 |
1e-3 390 |
1e-5 391 |
1e-7 393 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 10 (0.7) | 12 (0.3) | 14 (0.4) | 15 (0.7) | 17 (1) | 21 (0.9) | 25 (0.7) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 23 (6) | 27 (2) | 29 (2) | 30 (2) | 31 (1) | 33 (1) | 34 (1) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 6.8 (1) | 8.0 (2) | 8.9 (2) | 9.2 (0.9) | 10 (2) | 10 (2) | 10 (1) | 15/15 |
| CMAES posik noiseless | 36 (4) | 43 (3) | 45 (2) | 47 (1) | 47 (2) | 48 (2) | 50 (2) | 15/15 |
| CMA brockhoff noiseless | 34 (6) | 40 (5) | 43 (2) | 44 (4) | 45 (3) | 47 (1) | 48 (2) | 15/15 |
| CMAa brockhoff noiseless | 23 (3) | 27 (3) | 29 (2) | 30 (1) | 31 (2) | 33 (2) | 34 (2) | 15/15 |
| CMAm brockhoff noiseless | 34 (5) | 39 (4) | 42 (5) | 45 (3) | 45 (2) | 47 (2) | 48 (2) | 15/15 |
| CMAma brockhoff noiseless | 22 (5) | 25 (3) | 27 (2) | 29 (2) | 29 (2) | 31 (0.6) | 32 (1) | 15/15 |
| CMAmah brockhoff noiseless | 23 (2) | 26 (4) | 28 (2) | 29 (2) | 30 (1) | 31 (1) | 32 (1) | 15/15 |
| CMAmh brockhoff noiseless | 32 (4) | 36 (3) | 38 (2) | 39 (2) | 40 (2) | 41 (2) | 41 (2) | 15/15 |
| DBRCGA chuang noiseless | 75 (3) | 93 (7) | 113 (6) | 130 (6) | 147 (9) | 183 (9) | 220 (6) | 15/15 |
| DE-AUTO voglis noiseless | 3.5 (2) | 3.9 (2) | 4.3 (3) | 4.4 (2) | 4.7 (4) | 5.1 (4) | 5.7 (2) | 15/15 |
| DE-BFGS voglis noiseless | 5.7 (4) | 6.1 (3) | 6.2 (3) | 6.4 (4) | 6.5 (4) | 7.1 (4) | 10 (5) | 15/15 |
| DE-ROLL voglis noiseless | 15 (10) | 16 (23) | 16 (24) | 16 (11) | 16 (26) | 17 (23) | 17 (13) | 15/15 |
| DE-SIMPLEX voglis noiseless | 90 (19) | 104 (19) | 120 (22) | 126 (39) | 135 (22) | 149 (17) | 287 (172) | 15/15 |
| DEAE posik noiseless | 52 (5) | 61 (5) | 69 (6) | 77 (6) | 84 (6) | 101 (8) | 116 (5) | 15/15 |
| DE posik noiseless | 41 (2) | 50 (3) | 59 (4) | 67 (3) | 76 (5) | 93 (5) | 110 (4) | 15/15 |
| DEb posik noiseless | 41 (3) | 50 (3) | 59 (3) | 67 (4) | 76 (5) | 93 (5) | 110 (3) | 15/15 |
| DEctpb posik noiseless | 47 (1) | 56 (3) | 66 (3) | 76 (2) | 85 (5) | 105 (4) | 125 (4) | 15/15 |
| IPOPsaACM loshchilov noiseless | 7.3 (0.8) | 8.3 (0.5) | 8.9 (2) | 9.2 (0.4) | 9.5 (2) | 10 (1) | 10 (2) | 15/15 |
| JADE posik noiseless | 28 (1.0) | 34 (1) | 39 (2) | 44 (1) | 50 (1) | 61 (2) | 71 (4) | 15/15 |
| JADEb posik noiseless | 20 (2) | 25 (2) | 29 (2) | 34 (2) | 39 (3) | 48 (3) | 57 (4) | 15/15 |
| JADEctpb posik noiseless | 28 (0.8) | 34 (1) | 39 (2) | 44 (1) | 50 (2) | 61 (2) | 71 (4) | 15/15 |
| MVDE melo noiseless | 76 (2) | 92 (2) | 108 (2) | 125 (3) | 141 (2) | 174 (3) | 206 (4) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 23 (4) | 27 (3) | 29 (2) | 31 (1) | 32 (1.0) | 33 (2) | 34 (1) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 23 (3) | 26 (4) | 29 (2) | 30 (1) | 31 (2) | 33 (2) | 34 (2) | 15/15 |
| PSO-BFGS voglis noiseless | 5.2 (1) | 5.4 (3) | 5.6 (3) | 6.3 (5) | 6.7 (5) | 7.6 (5) | 12 (13) | 15/15 |
| SNES schaul noiseless | 4.8 (0.5) | 5.9 (0.3) | 7.0 (0.3) | 8.1 (0.2) | 9.2 (0.2) | 11 (0.3) | 14 (0.3) | 15/15 |
| xNES schaul noiseless | 29 (0.7) | 36 (0.8) | 43 (0.6) | 51 (0.9) | 58 (0.9) | 72 (1) | 87 (0.9) | 15/15 |
| xNESas schaul noiseless | 26 (1) | 31 (2) | 34 (3) | 36 (5) | 38 (4) | 41 (2) | 43 (5) | 15/15 |
| Δ fopt f3, 20-D |
1e1 5066 |
1e0 7626 |
1e-1 7635 |
1e-2 7637 |
1e-3 7643 |
1e-5 7646 |
1e-7 7651 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1018 (1726) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 9.0 (8) | 1.7e4 (3e4) | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| BIPOPsaACM loshchilov noiseless | 10 (7) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/5 |
| CMAES posik noiseless | 638 (565) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| CMA brockhoff noiseless | 13 (8) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| CMAa brockhoff noiseless | 8.7 (7) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| CMAm brockhoff noiseless | 8.5 (3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| CMAma brockhoff noiseless | 7.1 (5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| CMAmah brockhoff noiseless | 13 (7) | 4956 (6633) | 4950 (6035) | 4949 (6214) | 4945 (1e4) | 4943 (4220) | 4940 (4621) | 1/15 |
| CMAmh brockhoff noiseless | 13 (16) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| DBRCGA chuang noiseless | 144 (87) | 450 (789) | 1181 (1703) | 1181 (826) | 1180 (2087) | 1181 (875) | 1182 (1267) | 3/15 |
| DE-AUTO voglis noiseless | 47 (55) | 224 (339) | 401 (212) | 401 (371) | 401 (588) | 401 (148) | 401 (298) | 8/15 |
| DE-BFGS voglis noiseless | 56 (20) | 132 (66) | 181 (28) | 181 (176) | 181 (81) | 181 (204) | 191 (234) | 13/15 |
| DE-ROLL voglis noiseless | 15 (13) | 55 (42) | 82 (49) | 82 (51) | 82 (37) | 82 (51) | 82 (74) | 15/15 |
| DE-SIMPLEX voglis noiseless | 119 (41) | 212 (121) | 355 (213) | 355 (36) | 355 (207) | 355 (415) | 484 (628) | 4/15 |
| DEAE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE posik noiseless | 39 (12) | 67 (48) | 167 (240) | 167 (113) | 168 (160) | 168 (95) | 169 (171) | 9/15 |
| DEb posik noiseless | 39 (9) | 67 (46) | 167 (253) | 167 (175) | 168 (136) | 168 (119) | 169 (153) | 9/15 |
| DEctpb posik noiseless | 114 (9) | 94 (8) | 95 (6) | 96 (7) | 96 (7) | 97 (6) | 98 (7) | 15/15 |
| IPOPsaACM loshchilov noiseless | 11 (8) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/5 |
| JADE posik noiseless | 6.4 (0.2) | 6.0 (0.2) | 6.8 (0.3) | 7.6 (0.1) | 8.3 (0.2) | 10 (0.2) | 11 (0.1) | 15/15 |
| JADEb posik noiseless | 6.3 (9) | 13 (10) | 17 (20) | 17 (10) | 18 (17) | 19 (20) | 20 (20) | 15/15 |
| JADEctpb posik noiseless | 6.4 (0.3) | 6.0 (0.2) | 6.8 (0.2) | 7.6 (0.2) | 8.3 (0.2) | 10 (0.2) | 11 (0.1) | 15/15 |
| MVDE melo noiseless | 28 (3) | 23 (2) | 33 (35) | 34 (2) | 35 (1) | 36 (34) | 38 (3) | 14/15 |
| NBIPOPaCMA loshchilov noiseless | 12 (8) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| NIPOPaCMA loshchilov noiseless | 9.4 (7) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| PSO-BFGS voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SNES schaul noiseless | 550 (846) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞7e6 | 0/15 |
| xNES schaul noiseless | 629 (427) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞7e6 | 0/15 |
| xNESas schaul noiseless | 1055 (1554) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Δ fopt f4, 20-D |
1e1 4722 |
1e0 7628 |
1e-1 7666 |
1e-2 7686 |
1e-3 7700 |
1e-5 7758 |
1e-7 1.4e5 |
#succ 9/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1.5e4 (2e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 3.0e4 (3e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| BIPOPsaACM loshchilov noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/5 |
| CMAES posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| CMA brockhoff noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| CMAa brockhoff noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| CMAm brockhoff noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| CMAma brockhoff noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| CMAmah brockhoff noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMAmh brockhoff noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DBRCGA chuang noiseless | 236 (124) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-AUTO voglis noiseless | 67 (49) | 1265 (666) | 3887 (1698) | 3877 (6252) | 3870 (3120) | 3841 (1549) | 211 (252) | 1/15 |
| DE-BFGS voglis noiseless | 143 (115) | 589 (547) | 3893 (1829) | 3883 (3322) | 3876 (3251) | 3848 (1549) | 212 (564) | 1/15 |
| DE-ROLL voglis noiseless | 26 (29) | 165 (49) | 407 (226) | 406 (289) | 406 (357) | 403 (408) | 22 (27) | 8/15 |
| DE-SIMPLEX voglis noiseless | 172 (74) | 388 (223) | 3910 (1110) | 3900 (4558) | 3893 (5590) | 3867 (5032) | ∞2e6 | 0/15 |
| DEAE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE posik noiseless | 30 (12) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEb posik noiseless | 30 (12) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEctpb posik noiseless | 144 (21) | 119 (38) | 311 (296) | 311 (323) | 311 (328) | 310 (323) | 17 (23) | 6/15 |
| IPOPsaACM loshchilov noiseless | 1.9e4 (2e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/5 |
| JADE posik noiseless | 8.0 (0.3) | 7.0 (0.3) | 8.0 (0.2) | 8.8 (0.2) | 10 (0.2) | 11 (0.3) | 0.71 (0.0) | 15/15 |
| JADEb posik noiseless | 17 (26) | 102 (66) | 265 (268) | 265 (255) | 265 (434) | 264 (312) | 15 (7) | 6/15 |
| JADEctpb posik noiseless | 8.0 (0.3) | 7.0 (0.2) | 8.0 (0.2) | 8.8 (0.2) | 10 (0.2) | 11 (0.2) | 0.71 (0.0) | 15/15 |
| MVDE melo noiseless | 28 (4) | 71 (130) | 869 (784) | 867 (1139) | 867 (1008) | 862 (1225) | 48 (71) | 2/15 |
| NBIPOPaCMA loshchilov noiseless | 6.1e4 (7e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| NIPOPaCMA loshchilov noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| PSO-BFGS voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SNES schaul noiseless | 4049 (1199) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞7e6 | 0/15 |
| xNES schaul noiseless | 6323 (3746) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞7e6 | 0/15 |
| xNESas schaul noiseless | 4192 (7021) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Δ fopt f5, 20-D |
1e1 41 |
1e0 41 |
1e-1 41 |
1e-2 41 |
1e-3 41 |
1e-5 41 |
1e-7 41 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 10 (3) | 12 (4) | 12 (4) | 12 (4) | 12 (3) | 12 (3) | 12 (5) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 5.5 (1.0) | 6.5 (0.7) | 6.6 (0.8) | 6.7 (0.6) | 6.7 (0.6) | 6.7 (0.9) | 6.7 (0.9) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 4.6 (0.6) | 5.3 (0.8) | 5.4 (0.6) | 5.4 (0.4) | 5.4 (1.0) | 5.4 (0.8) | 5.4 (0.8) | 15/15 |
| CMAES posik noiseless | 5.1 (1) | 6.1 (0.8) | 6.1 (0.9) | 6.1 (0.8) | 6.1 (0.8) | 6.1 (0.7) | 6.1 (1) | 15/15 |
| CMA brockhoff noiseless | 4.9 (1.0) | 5.6 (2) | 5.8 (1) | 5.8 (2) | 5.8 (1) | 5.8 (2) | 5.8 (2) | 15/15 |
| CMAa brockhoff noiseless | 5.4 (2) | 6.4 (2) | 6.6 (1) | 6.6 (1) | 6.6 (0.5) | 6.6 (1.0) | 6.6 (0.8) | 15/15 |
| CMAm brockhoff noiseless | 4.4 (0.5) | 5.3 (1) | 5.4 (0.8) | 5.5 (0.7) | 5.5 (0.9) | 5.5 (1) | 5.5 (1) | 15/15 |
| CMAma brockhoff noiseless | 4.6 (2) | 5.2 (2) | 5.3 (1) | 5.3 (1) | 5.3 (1) | 5.3 (1) | 5.3 (1) | 15/15 |
| CMAmah brockhoff noiseless | 3.0 (0.4) | 4.0 (1) | 4.0 (1) | 4.0 (0.7) | 4.0 (1) | 4.0 (0.9) | 4.0 (0.7) | 15/15 |
| CMAmh brockhoff noiseless | 3.2 (1) | 3.7 (0.7) | 3.7 (2) | 3.7 (1) | 3.7 (1) | 3.7 (1) | 3.7 (0.7) | 15/15 |
| DBRCGA chuang noiseless | 150 (35) | 211 (87) | 226 (115) | 230 (56) | 231 (124) | 231 (140) | 231 (188) | 15/15 |
| DE-AUTO voglis noiseless | 3.1 (0.1) | 3.1 (0.1) | 3.1 (0.1) | 3.1 (0.1) | 3.1 (0.1) | 3.1 (0.1) | 3.1 (0.1) | 15/15 |
| DE-BFGS voglis noiseless | 14 (8) | 22 (13) | 23 (12) | 24 (15) | 24 (20) | 25 (16) | 26 (13) | 15/15 |
| DE-ROLL voglis noiseless | 3.7 (0.6) | 3.9 (0.7) | 3.9 (0.9) | 3.9 (0.7) | 3.9 (3) | 3.9 (3) | 3.9 (3) | 15/15 |
| DE-SIMPLEX voglis noiseless | 572 (123) | 860 (81) | 1423 (367) | 1832 (482) | 2124 (349) | 2727 (911) | 2.9e4 (3e4) | 8/15 |
| DEAE posik noiseless | 28 (5) | 32 (5) | 33 (7) | 33 (6) | 33 (4) | 33 (7) | 33 (6) | 15/15 |
| DE posik noiseless | 27 (5) | 35 (4) | 36 (5) | 36 (4) | 36 (6) | 36 (4) | 36 (5) | 15/15 |
| DEb posik noiseless | 27 (7) | 35 (4) | 36 (5) | 36 (6) | 36 (6) | 36 (3) | 36 (5) | 15/15 |
| DEctpb posik noiseless | 37 (8) | 43 (4) | 46 (7) | 46 (8) | 46 (10) | 46 (12) | 46 (11) | 15/15 |
| IPOPsaACM loshchilov noiseless | 4.5 (0.6) | 5.0 (1.0) | 5.2 (1) | 5.2 (0.6) | 5.2 (0.6) | 5.2 (1) | 5.2 (2) | 15/15 |
| JADE posik noiseless | 43 (6) | 52 (6) | 53 (10) | 53 (8) | 53 (10) | 53 (8) | 53 (4) | 15/15 |
| JADEb posik noiseless | 27 (6) | 35 (7) | 36 (9) | 36 (7) | 36 (7) | 36 (8) | 36 (6) | 15/15 |
| JADEctpb posik noiseless | 43 (9) | 52 (5) | 53 (6) | 53 (7) | 53 (6) | 53 (8) | 53 (10) | 15/15 |
| MVDE melo noiseless | 210 (18) | 304 (18) | 375 (27) | 422 (47) | 445 (89) | 457 (66) | 458 (109) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 5.1 (1) | 6.0 (1) | 6.2 (1) | 6.2 (1) | 6.2 (1) | 6.2 (2) | 6.2 (1) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 5.5 (0.7) | 6.3 (1) | 6.5 (0.9) | 6.5 (1) | 6.5 (0.8) | 6.5 (1) | 6.5 (1.0) | 15/15 |
| PSO-BFGS voglis noiseless | 22 (16) | 30 (46) | 31 (14) | 31 (18) | 32 (34) | 32 (34) | 32 (35) | 15/15 |
| SNES schaul noiseless | 9.3 (2) | 12 (2) | 12 (3) | 12 (2) | 12 (3) | 12 (3) | 12 (3) | 15/15 |
| xNES schaul noiseless | 10 (0.7) | 11 (1) | 12 (2) | 12 (2) | 12 (1) | 12 (2) | 12 (2) | 15/15 |
| xNESas schaul noiseless | 8.5 (1) | 10 (1) | 11 (2) | 11 (2) | 11 (1) | 11 (2) | 11 (2) | 15/15 |
| Δ fopt f6, 20-D |
1e1 1296 |
1e0 2343 |
1e-1 3413 |
1e-2 4255 |
1e-3 5220 |
1e-5 6728 |
1e-7 8409 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 6.5 (2) | 5.3 (1) | 4.8 (0.6) | 4.8 (0.7) | 4.7 (0.6) | 4.8 (0.5) | 4.9 (0.6) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 1.5 (0.2) | 1.2 (0.1) | 1.1 (0.1) | 1.1 (0.2) | 1.1 (0.2) | 1.1 (0.1) | 1.1 (0.1) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.4 (0.2) | 1.2 (0.2) | 1.1 (0.1) | 1.1 (0.1) | 1.1 (0.1) | 1.3 (0.2) | 1.4 (0.2) | 15/15 |
| CMAES posik noiseless | 1.7 (0.2) | 1.3 (0.2) | 1.2 (0.3) | 1.2 (0.2) | 1.2 (0.1) | 1.2 (0.2) | 1.2 (0.1) | 15/15 |
| CMA brockhoff noiseless | 1.7 (0.2) | 1.3 (0.2) | 1.2 (0.1) | 1.2 (0.1) | 1.2 (0.1) | 1.2 (0.2) | 1.2 (0.1) | 15/15 |
| CMAa brockhoff noiseless | 1.6 (0.3) | 1.3 (0.2) | 1.1 (0.1) | 1.1 (0.1) | 1.1 (0.1) | 1.1 (0.1) | 1.1 (0.1) | 15/15 |
| CMAm brockhoff noiseless | 1.7 (0.3) | 1.3 (0.2) | 1.2 (0.2) | 1.2 (0.1) | 1.2 (0.1) | 1.2 (0.1) | 1.3 (0.1) | 15/15 |
| CMAma brockhoff noiseless | 1.5 (0.3) | 1.2 (0.1) | 1.0 (0.2) | 1.0 (0.1) | 1.0 (0.1) | 1.1 (0.1) | 1.1 (0.1) | 15/15 |
| CMAmah brockhoff noiseless | 1.2 (0.3) | 1.1 (0.3) | 1.0 (0.3) | 1.1 (0.3) | 1.1 (0.2) | 1.2 (0.3) | 1.3 (0.4) | 15/15 |
| CMAmh brockhoff noiseless | 1.2 (0.3) | 1.1 (0.2) | 1.1 (0.3) | 1.2 (0.3) | 1.3 (0.3) | 1.8 (0.3) | 2.3 (0.5) | 15/15 |
| DBRCGA chuang noiseless | 26 (11) | 55 (226) | 46 (161) | 45 (68) | 43 (4) | 43 (8) | 43 (7) | 15/15 |
| DE-AUTO voglis noiseless | 1.9 (0.8) | 2.2 (2) | 4.3 (3) | 8.0 (4) | 12 (3) | 16 (3) | 71 (18) | 10/15 |
| DE-BFGS voglis noiseless | 6.8 (6) | 8.5 (5) | 17 (13) | 25 (6) | 32 (35) | 96 (155) | 295 (246) | 2/15 |
| DE-ROLL voglis noiseless | 21 (43) | 23 (26) | 23 (6) | 34 (15) | 69 (111) | 209 (532) | 1025 (1257) | 1/15 |
| DE-SIMPLEX voglis noiseless | 34 (16) | 34 (11) | 42 (14) | 58 (62) | 102 (51) | 329 (34) | ∞2e6 | 0/15 |
| DEAE posik noiseless | 21 (4) | 18 (3) | 16 (2) | 17 (2) | 16 (2) | 17 (0.9) | 17 (1) | 15/15 |
| DE posik noiseless | 53 (6) | 46 (7) | 46 (6) | 49 (9) | 51 (6) | 57 (8) | 61 (10) | 15/15 |
| DEb posik noiseless | 53 (11) | 46 (7) | 46 (6) | 49 (11) | 51 (6) | 57 (10) | 61 (13) | 15/15 |
| DEctpb posik noiseless | 29 (3) | 23 (1) | 21 (2) | 21 (3) | 21 (0.9) | 21 (1) | 21 (0.9) | 15/15 |
| IPOPsaACM loshchilov noiseless | 1.5 (0.4) | 1.2 (0.3) | 1.1 (0.2) | 1.1 (0.2) | 1.1 (0.1) | 1.2 (0.1) | 1.3 (0.2) | 15/15 |
| JADE posik noiseless | 9.4 (0.5) | 7.8 (0.8) | 7.3 (1.0) | 7.4 (0.9) | 7.2 (0.8) | 7.4 (0.8) | 7.4 (0.7) | 15/15 |
| JADEb posik noiseless | 25 (11) | 72 (54) | 361 (385) | 3465 (3937) | ∞ | ∞ | ∞1e6 | 0/15 |
| JADEctpb posik noiseless | 9.4 (0.5) | 7.8 (0.6) | 7.3 (0.6) | 7.4 (0.9) | 7.2 (0.7) | 7.4 (0.9) | 7.4 (0.7) | 15/15 |
| MVDE melo noiseless | 37 (8) | 35 (7) | 35 (11) | 36 (9) | 37 (8) | 40 (7) | 43 (6) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 1.5 (0.3) | 1.2 (0.1) | 1.1 (0.1) | 1.1 (0.1) | 1.1 (0.1) | 1.1 (0.1) | 1.1 (0.1) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 1.5 (0.1) | 1.2 (0.2) | 1.1 (0.2) | 1.1 (0.1) | 1.1 (0.1) | 1.1 (0.0) | 1.1 (0.1) | 15/15 |
| PSO-BFGS voglis noiseless | 9.4 (6) | 20 (19) | 40 (45) | 117 (236) | 148 (294) | 198 (460) | 352 (246) | 0/15 |
| SNES schaul noiseless | 1.3 (0.2) | 1.2 (0.2) | 1.2 (0.1) | 1.4 (0.4) | 35 (29) | 137 (198) | 445 (428) | 11/15 |
| xNES schaul noiseless | 4.9 (0.5) | 4.8 (0.2) | 4.7 (0.2) | 4.9 (0.1) | 5.0 (0.1) | 5.3 (0.1) | 5.4 (0.1) | 15/15 |
| xNESas schaul noiseless | 4.7 (0.3) | 4.6 (0.2) | 4.5 (0.1) | 4.8 (0.2) | 4.8 (0.1) | 5.2 (0.1) | 5.3 (0.1) | 15/15 |
| Δ fopt f7, 20-D |
1e1 1351 |
1e0 4274 |
1e-1 9503 |
1e-2 16523 |
1e-3 16524 |
1e-5 16524 |
1e-7 16969 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 76 (252) | 3.5e4 (4e4) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 1.3 (1) | 2.9 (2) | 2.3 (0.7) | 1.5 (0.6) | 1.5 (0.6) | 1.5 (0.6) | 1.4 (0.3) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.0 (0.9) | 1.6 (0.5) | 0.84 (0.1) | 0.61 (0.1) | 0.61 (0.1) | 0.61 (0.3) | 0.60 (0.1) | 15/15 |
| CMAES posik noiseless | 1.5 (2) | 191 (226) | 754 (843) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| CMA brockhoff noiseless | 1.7 (1) | 3.9 (1) | 2.7 (1) | 1.7 (1.0) | 1.7 (0.7) | 1.7 (0.9) | 1.6 (0.9) | 15/15 |
| CMAa brockhoff noiseless | 1.0 (0.2) | 2.3 (1) | 1.7 (0.6) | 1.1 (0.4) | 1.1 (0.4) | 1.1 (0.4) | 1.0 (0.4) | 15/15 |
| CMAm brockhoff noiseless | 1.7 (1) | 4.2 (2) | 2.7 (0.4) | 1.7 (0.5) | 1.7 (0.3) | 1.7 (0.7) | 1.6 (0.7) | 15/15 |
| CMAma brockhoff noiseless | 1.6 (1) | 2.7 (0.7) | 1.8 (0.6) | 1.1 (0.9) | 1.1 (0.6) | 1.1 (0.6) | 1.1 (0.6) | 15/15 |
| CMAmah brockhoff noiseless | 1.7 (0.9) | 2.4 (0.9) | 1.5 (0.2) | 0.95 (0.2) | 0.95 (0.4) | 0.95 (0.3) | 0.93 (0.2) | 15/15 |
| CMAmh brockhoff noiseless | 2.9 (2) | 4.4 (2) | 2.6 (0.1) | 1.6 (0.1) | 1.6 (0.3) | 1.6 (0.7) | 1.6 (0.2) | 15/15 |
| DBRCGA chuang noiseless | 80 (97) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-AUTO voglis noiseless | 28 (12) | 577 (845) | 522 (503) | 439 (321) | 439 (262) | 439 (213) | 427 (437) | 4/15 |
| DE-BFGS voglis noiseless | 502 (1525) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-ROLL voglis noiseless | 26 (31) | 259 (251) | 548 (557) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 125 (118) | 1277 (1671) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEAE posik noiseless | 4.7 (0.3) | 3.5 (0.9) | 2.2 (0.2) | 1.9 (0.4) | 1.9 (0.2) | 1.9 (0.4) | 1.9 (0.3) | 15/15 |
| DE posik noiseless | 24 (4) | 94 (69) | 235 (380) | 256 (152) | 256 (498) | 256 (335) | 249 (193) | 3/15 |
| DEb posik noiseless | 24 (5) | 94 (76) | 235 (554) | 256 (318) | 256 (499) | 256 (257) | 249 (426) | 3/15 |
| DEctpb posik noiseless | 29 (6) | 32 (10) | 28 (4) | 20 (5) | 20 (17) | 20 (2) | 20 (31) | 14/15 |
| IPOPsaACM loshchilov noiseless | 1.0 (0.9) | 1.6 (0.7) | 0.92 (0.5) | 0.66 (0.2) | 0.66 (0.3) | 0.66 (0.3) | 0.65 (0.4) | 15/15 |
| JADE posik noiseless | 4.8 (1) | 272 (643) | 686 (1131) | 402 (605) | 402 (439) | 402 (424) | 391 (267) | 2/15 |
| JADEb posik noiseless | 119 (371) | 3279 (7019) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| JADEctpb posik noiseless | 4.8 (0.9) | 272 (645) | 686 (1184) | 402 (514) | 402 (437) | 402 (482) | 391 (913) | 2/15 |
| MVDE melo noiseless | 25 (7) | 106 (124) | 470 (418) | 882 (1528) | 882 (741) | 882 (757) | 860 (1311) | 1/15 |
| NBIPOPaCMA loshchilov noiseless | 1.1 (0.3) | 3.9 (0.4) | 2.6 (0.6) | 1.6 (0.6) | 1.6 (0.7) | 1.6 (0.9) | 1.6 (0.8) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 0.99 (0.4) | 2.8 (1) | 1.7 (0.8) | 1.2 (0.3) | 1.2 (0.3) | 1.2 (0.4) | 1.2 (0.4) | 15/15 |
| PSO-BFGS voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SNES schaul noiseless | 32 (117) | 2715 (2637) | ∞ | ∞ | ∞ | ∞ | ∞7e6 | 0/15 |
| xNES schaul noiseless | 1.8 (0.3) | 1.6 (0.1) | 1.1 (0.1) | 0.93 (0.1) | 0.94 (0.0) | 0.94 (0.0) | 0.96 (0.1) | 15/15 |
| xNESas schaul noiseless | 1.9 (0.1) | 1.5 (0.1) | 1.0 (0.1) | 0.88 (0.1) | 0.89 (0.1) | 0.89 (0.0) | 0.91 (0.1) | 15/15 |
| Δ fopt f8, 20-D |
1e1 2039 |
1e0 3871 |
1e-1 4040 |
1e-2 4148 |
1e-3 4219 |
1e-5 4371 |
1e-7 4484 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 24 (6) | 66 (108) | 72 (99) | 80 (5) | 89 (44) | 107 (43) | 125 (3) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 3.3 (0.5) | 4.0 (2) | 4.3 (3) | 4.4 (3) | 4.4 (0.3) | 4.4 (3) | 4.5 (3) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.3 (0.3) | 1.5 (0.9) | 1.5 (0.5) | 1.6 (0.6) | 1.6 (0.1) | 1.6 (0.9) | 1.6 (0.1) | 15/15 |
| CMAES posik noiseless | 3.9 (1) | 4.3 (0.6) | 4.7 (0.5) | 4.8 (0.5) | 4.8 (3) | 4.9 (0.4) | 4.9 (2) | 15/15 |
| CMA brockhoff noiseless | 3.7 (0.7) | 4.4 (2) | 4.7 (0.3) | 4.8 (0.4) | 4.9 (2) | 4.9 (2) | 5.0 (0.2) | 15/15 |
| CMAa brockhoff noiseless | 3.6 (0.5) | 3.5 (3) | 3.8 (2) | 3.9 (0.6) | 4.0 (0.7) | 4.0 (0.3) | 4.0 (0.8) | 15/15 |
| CMAm brockhoff noiseless | 3.9 (0.6) | 5.0 (0.3) | 5.3 (2) | 5.4 (2) | 5.4 (4) | 5.4 (2) | 5.4 (0.3) | 15/15 |
| CMAma brockhoff noiseless | 3.1 (0.5) | 4.2 (3) | 4.4 (2) | 4.4 (3) | 4.5 (3) | 4.5 (2) | 4.5 (2) | 15/15 |
| CMAmah brockhoff noiseless | 2.6 (0.9) | 3.4 (0.2) | 3.6 (0.7) | 3.6 (1.0) | 3.7 (2) | 3.6 (2) | 3.6 (2) | 15/15 |
| CMAmh brockhoff noiseless | 3.2 (1) | 4.5 (2) | 4.7 (3) | 4.8 (3) | 4.8 (3) | 4.8 (0.6) | 4.8 (2) | 15/15 |
| DBRCGA chuang noiseless | 50 (65) | 150 (110) | 159 (112) | 171 (471) | 184 (346) | 213 (103) | 257 (119) | 12/15 |
| DE-AUTO voglis noiseless | 1.5 (0.4) | 4.2 (3) | 5.2 (3) | 6.2 (5) | 8.2 (5) | 9.3 (5) | 12 (3) | 15/15 |
| DE-BFGS voglis noiseless | 1.5 (1) | 2.8 (3) | 2.8 (3) | 2.9 (4) | 3.2 (5) | 3.2 (4) | 3.2 (3) | 15/15 |
| DE-ROLL voglis noiseless | 6.4 (16) | 15 (21) | 20 (17) | 25 (23) | 28 (21) | 33 (17) | 129 (155) | 13/15 |
| DE-SIMPLEX voglis noiseless | 12 (10) | 13 (7) | 15 (6) | 17 (10) | 19 (9) | 24 (9) | 81 (86) | 14/15 |
| DEAE posik noiseless | 19 (3) | 21 (15) | 22 (15) | 22 (1) | 23 (14) | 23 (7) | 24 (13) | 15/15 |
| DE posik noiseless | 53 (17) | 95 (5) | 106 (134) | 114 (7) | 120 (12) | 130 (64) | 138 (8) | 14/15 |
| DEb posik noiseless | 53 (15) | 95 (5) | 106 (63) | 114 (63) | 120 (9) | 130 (9) | 138 (65) | 14/15 |
| DEctpb posik noiseless | 52 (2) | 66 (2) | 76 (2) | 82 (4) | 89 (4) | 100 (5) | 111 (5) | 15/15 |
| IPOPsaACM loshchilov noiseless | 1.4 (0.2) | 1.3 (0.1) | 1.4 (0.2) | 1.4 (0.1) | 1.4 (0.1) | 1.4 (0.1) | 1.4 (0.1) | 15/15 |
| JADE posik noiseless | 18 (1) | 16 (0.3) | 16 (0.5) | 17 (0.6) | 17 (0.6) | 17 (0.5) | 18 (0.6) | 15/15 |
| JADEb posik noiseless | 12 (4) | 14 (12) | 14 (7) | 15 (6) | 15 (9) | 16 (6) | 17 (6) | 15/15 |
| JADEctpb posik noiseless | 18 (1) | 16 (0.7) | 16 (0.6) | 17 (0.5) | 17 (0.6) | 17 (0.6) | 18 (0.4) | 15/15 |
| MVDE melo noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 3.2 (0.8) | 3.4 (2) | 3.6 (2) | 3.7 (0.9) | 3.8 (0.6) | 3.8 (0.9) | 3.8 (2) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.3 (1) | 3.9 (3) | 4.1 (3) | 4.2 (1) | 4.2 (0.1) | 4.3 (1) | 4.3 (0.1) | 15/15 |
| PSO-BFGS voglis noiseless | 1.6 (1) | 4.1 (4) | 4.7 (4) | 5.4 (4) | 6.0 (4) | 6.3 (4) | 9.0 (4) | 15/15 |
| SNES schaul noiseless | 37 (7) | 145 (59) | 299 (265) | 483 (259) | 1107 (1264) | 1.3e4 (2e4) | 2.6e4 (3e4) | 0/15 |
| xNES schaul noiseless | 7.5 (0.5) | 6.9 (1) | 7.5 (1) | 7.6 (0.9) | 7.7 (1) | 8.4 (0.4) | 9.5 (1.0) | 15/15 |
| xNESas schaul noiseless | 7.2 (1) | 7.9 (3) | 9.1 (1) | 9.3 (4) | 9.4 (4) | 10 (3) | 10 (3) | 15/15 |
| Δ fopt f9, 20-D |
1e1 1716 |
1e0 3102 |
1e-1 3277 |
1e-2 3379 |
1e-3 3455 |
1e-5 3594 |
1e-7 3727 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 45 (7) | 78 (6) | 119 (11) | 195 (18) | 286 (22) | 473 (51) | 651 (65) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 3.8 (1) | 4.4 (2) | 4.7 (4) | 4.8 (0.5) | 4.8 (0.4) | 4.8 (3) | 4.8 (2) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.5 (0.3) | 1.7 (0.1) | 1.7 (0.7) | 1.8 (0.7) | 1.8 (0.6) | 1.8 (0.6) | 1.7 (0.6) | 15/15 |
| CMAES posik noiseless | 4.5 (0.9) | 5.0 (0.7) | 5.4 (0.4) | 5.5 (0.6) | 5.5 (0.4) | 5.5 (0.6) | 5.5 (0.5) | 15/15 |
| CMA brockhoff noiseless | 4.7 (1.0) | 5.1 (0.8) | 5.4 (0.9) | 5.5 (0.9) | 5.6 (0.3) | 5.6 (0.7) | 5.6 (0.4) | 15/15 |
| CMAa brockhoff noiseless | 3.9 (0.9) | 4.1 (0.4) | 4.4 (0.4) | 4.5 (0.4) | 4.5 (0.4) | 4.5 (0.3) | 4.5 (0.5) | 15/15 |
| CMAm brockhoff noiseless | 4.1 (2) | 5.4 (1) | 5.7 (0.5) | 5.8 (0.3) | 5.8 (1) | 5.8 (2) | 5.8 (0.4) | 15/15 |
| CMAma brockhoff noiseless | 3.4 (0.6) | 4.1 (0.2) | 4.3 (0.4) | 4.4 (0.4) | 4.4 (0.4) | 4.4 (2) | 4.4 (2) | 15/15 |
| CMAmah brockhoff noiseless | 2.9 (0.7) | 4.8 (3) | 4.9 (3) | 5.0 (3) | 5.0 (3) | 4.9 (2) | 4.9 (0.3) | 15/15 |
| CMAmh brockhoff noiseless | 3.1 (2) | 4.2 (5) | 4.5 (1) | 4.6 (0.5) | 4.6 (2) | 4.6 (1) | 4.6 (3) | 15/15 |
| DBRCGA chuang noiseless | 353 (82) | 1855 (2801) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-AUTO voglis noiseless | 2.0 (0.9) | 6.9 (5) | 8.8 (4) | 10 (7) | 11 (4) | 11 (3) | 20 (17) | 15/15 |
| DE-BFGS voglis noiseless | 1.8 (0.8) | 2.6 (1) | 2.8 (4) | 2.7 (1) | 2.7 (2) | 2.7 (1) | 2.7 (1) | 15/15 |
| DE-ROLL voglis noiseless | 25 (14) | 44 (16) | 54 (23) | 59 (25) | 63 (21) | 83 (39) | 1299 (1118) | 1/15 |
| DE-SIMPLEX voglis noiseless | 24 (8) | 149 (113) | 144 (108) | 143 (198) | 140 (129) | 142 (448) | 207 (205) | 13/15 |
| DEAE posik noiseless | 21 (2) | 25 (18) | 26 (18) | 27 (9) | 27 (8) | 28 (8) | 29 (8) | 15/15 |
| DE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEctpb posik noiseless | 417 (71) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| IPOPsaACM loshchilov noiseless | 1.6 (0.4) | 1.8 (1) | 1.9 (0.2) | 1.9 (0.1) | 1.9 (1) | 1.9 (1.0) | 1.9 (0.1) | 15/15 |
| JADE posik noiseless | 36 (4) | 30 (3) | 32 (2) | 32 (2) | 33 (2) | 33 (2) | 33 (2) | 15/15 |
| JADEb posik noiseless | 24 (4) | 32 (13) | 33 (2) | 34 (23) | 35 (12) | 35 (21) | 36 (12) | 15/15 |
| JADEctpb posik noiseless | 36 (3) | 30 (3) | 32 (3) | 32 (2) | 33 (2) | 33 (2) | 33 (3) | 15/15 |
| MVDE melo noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 3.8 (0.6) | 4.0 (0.3) | 4.3 (0.3) | 4.4 (0.2) | 4.5 (0.3) | 4.5 (0.3) | 4.5 (0.3) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.9 (0.6) | 4.5 (4) | 4.8 (2) | 4.9 (2) | 4.9 (2) | 4.9 (0.3) | 4.9 (0.2) | 15/15 |
| PSO-BFGS voglis noiseless | 1.7 (2) | 4.9 (4) | 5.7 (4) | 6.8 (4) | 7.1 (4) | 6.9 (5) | 6.9 (2) | 15/15 |
| SNES schaul noiseless | 520 (290) | 1.8e4 (2e4) | 3.5e4 (7e4) | ∞ | ∞ | ∞ | ∞8e6 | 0/15 |
| xNES schaul noiseless | 8.9 (1) | 8.5 (1) | 9.3 (2) | 9.4 (1) | 9.4 (2) | 10 (0.9) | 11 (0.7) | 15/15 |
| xNESas schaul noiseless | 8.1 (1) | 8.9 (2) | 10 (2) | 10 (2) | 10 (2) | 11 (2) | 11 (5) | 15/15 |
| Δ fopt f10, 20-D |
1e1 7413 |
1e0 8661 |
1e-1 10735 |
1e-2 13641 |
1e-3 14920 |
1e-5 17073 |
1e-7 17476 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 2.0e4 (2e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 1.2 (0.2) | 1.2 (0.2) | 1.1 (0.1) | 0.88 (0.1) | 0.83 (0.0) | 0.76 (0.0) | 0.77 (0.0) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 0.36 (0.1) | 0.35 (0.0) | 0.31 (0.0) | 0.26 (0.0) | 0.24 (0.0) | 0.23 (0.0) | 0.23 (0.0) | 15/15 |
| CMAES posik noiseless | 1.7 (0.2) | 1.7 (0.2) | 1.6 (0.2) | 1.3 (0.1) | 1.2 (0.0) | 1.1 (0.1) | 1.1 (0.0) | 15/15 |
| CMA brockhoff noiseless | 1.8 (0.3) | 1.8 (0.1) | 1.6 (0.1) | 1.3 (0.0) | 1.2 (0.0) | 1.1 (0.0) | 1.1 (0.0) | 15/15 |
| CMAa brockhoff noiseless | 1.2 (0.2) | 1.2 (0.1) | 1.0 (0.1) | 0.87 (0.1) | 0.82 (0.0) | 0.75 (0.0) | 0.76 (0.0) | 15/15 |
| CMAm brockhoff noiseless | 1.8 (0.2) | 1.8 (0.2) | 1.6 (0.1) | 1.3 (0.0) | 1.2 (0.0) | 1.1 (0.0) | 1.1 (0.0) | 15/15 |
| CMAma brockhoff noiseless | 1.1 (0.1) | 1.1 (0.1) | 0.98 (0.1) | 0.81 (0.0) | 0.76 (0.0) | 0.70 (0.0) | 0.71 (0.0) | 15/15 |
| CMAmah brockhoff noiseless | 1.2 (0.1) | 1.2 (0.2) | 1.0 (0.1) | 0.83 (0.0) | 0.79 (0.1) | 0.71 (0.0) | 0.71 (0.0) | 15/15 |
| CMAmh brockhoff noiseless | 1.6 (0.1) | 1.6 (0.2) | 1.4 (0.1) | 1.1 (0.0) | 1.1 (0.0) | 0.95 (0.0) | 0.94 (0.0) | 15/15 |
| DBRCGA chuang noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-AUTO voglis noiseless | 1.5 (2) | 1.5 (1) | 1.8 (2) | 1.8 (0.9) | 2.5 (2) | 4.6 (2) | 17 (8) | 9/15 |
| DE-BFGS voglis noiseless | 6.1 (6) | 5.3 (8) | 4.3 (2) | 3.4 (7) | 3.1 (3) | 2.7 (2) | 2.6 (2) | 15/15 |
| DE-ROLL voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 138 (96) | 817 (778) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEAE posik noiseless | 2.6 (0.3) | 2.6 (0.4) | 2.3 (0.2) | 2.1 (0.2) | 2.1 (0.2) | 2.2 (0.2) | 2.5 (0.2) | 15/15 |
| DE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEctpb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| IPOPsaACM loshchilov noiseless | 0.35 (0.1) | 0.36 (0.1) | 0.31 (0.0) | 0.26 (0.0) | 0.24 (0.0) | 0.22 (0.0) | 0.23 (0.0) | 15/15 |
| JADE posik noiseless | 12 (4) | 15 (6) | 15 (3) | 14 (3) | 15 (2) | 15 (2) | 18 (4) | 15/15 |
| JADEb posik noiseless | 39 (18) | 54 (30) | 64 (11) | 62 (11) | 116 (23) | 862 (1245) | ∞1e6 | 0/15 |
| JADEctpb posik noiseless | 12 (7) | 15 (3) | 15 (4) | 14 (2) | 15 (3) | 15 (4) | 18 (4) | 15/15 |
| MVDE melo noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 1.1 (0.1) | 1.1 (0.1) | 1.0 (0.1) | 0.85 (0.0) | 0.80 (0.0) | 0.73 (0.0) | 0.75 (0.0) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 1.2 (0.2) | 1.2 (0.2) | 1.0 (0.1) | 0.86 (0.0) | 0.81 (0.0) | 0.74 (0.0) | 0.76 (0.0) | 15/15 |
| PSO-BFGS voglis noiseless | 29 (12) | 24 (6) | 20 (10) | 16 (7) | 14 (38) | 12 (5) | 12 (5) | 14/15 |
| SNES schaul noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e6 | 0/15 |
| xNES schaul noiseless | 1.5 (0.0) | 1.6 (0.0) | 1.6 (0.0) | 1.4 (0.0) | 1.5 (0.0) | 1.7 (0.0) | 2.0 (0.0) | 15/15 |
| xNESas schaul noiseless | 1.3 (0.1) | 1.4 (0.1) | 1.3 (0.1) | 1.1 (0.1) | 1.0 (0.1) | 0.99 (0.1) | 1.0 (0.1) | 15/15 |
| Δ fopt f11, 20-D |
1e1 1002 |
1e0 2228 |
1e-1 6278 |
1e-2 8586 |
1e-3 9762 |
1e-5 12285 |
1e-7 14831 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1002 (83) | 1328 (1166) | 679 (1599) | 869 (1762) | 995 (1032) | 1037 (1025) | 1462 (2533) | 2/15 |
| BIPOPaCMA loshchilov noiseless | 4.5 (0.4) | 2.3 (0.2) | 0.87 (0.0) | 0.68 (0.0) | 0.64 (0.0) | 0.56 (0.0) | 0.51 (0.0) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.5 (0.5) | 1.2 (0.2) | 0.44 (0.1) | 0.34 (0.0) | 0.30 (0.0) | 0.26 (0.0) | 0.23 (0.0) | 15/15 |
| CMAES posik noiseless | 11 (0.7) | 5.3 (0.2) | 2.0 (0.1) | 1.5 (0.0) | 1.4 (0.0) | 1.2 (0.0) | 1.0 (0.0) | 15/15 |
| CMA brockhoff noiseless | 10 (0.7) | 5.1 (0.2) | 1.9 (0.1) | 1.5 (0.0) | 1.4 (0.1) | 1.2 (0.0) | 1.0 (0.0) | 15/15 |
| CMAa brockhoff noiseless | 4.5 (0.3) | 2.2 (0.1) | 0.86 (0.0) | 0.68 (0.0) | 0.63 (0.0) | 0.55 (0.0) | 0.50 (0.0) | 15/15 |
| CMAm brockhoff noiseless | 11 (1) | 5.4 (0.2) | 2.0 (0.2) | 1.6 (0.2) | 1.4 (0.1) | 1.2 (0.1) | 1.1 (0.1) | 15/15 |
| CMAma brockhoff noiseless | 4.3 (0.3) | 2.1 (0.2) | 0.82 (0.1) | 0.64 (0.0) | 0.59 (0.0) | 0.51 (0.0) | 0.45 (0.0) | 15/15 |
| CMAmah brockhoff noiseless | 4.8 (0.4) | 2.4 (0.2) | 0.92 (0.1) | 0.71 (0.1) | 0.66 (0.0) | 0.56 (0.0) | 0.49 (0.0) | 15/15 |
| CMAmh brockhoff noiseless | 11 (1) | 5.6 (0.3) | 2.1 (0.2) | 1.7 (0.1) | 1.5 (0.1) | 1.3 (0.0) | 1.1 (0.0) | 15/15 |
| DBRCGA chuang noiseless | 431 (145) | 396 (63) | 189 (20) | 169 (9) | 165 (10) | 154 (5) | ∞2e6 | 0/15 |
| DE-AUTO voglis noiseless | 0.38 (0.5) | 0.19 (0.2) | 0.07 (0.0) | 0.06 (5e-3) | 0.06 (4e-3) | 0.05 (0.0) | 0.10 (0.2) | 15/15 |
| DE-BFGS voglis noiseless | 0.20 (0.1) | 0.11 (0.0) | 0.05 (0.0) | 0.04 (1e-2) | 0.04 (0.0) | 0.04 (9e-3) | 0.05 (0.0) | 15/15 |
| DE-ROLL voglis noiseless | 510 (244) | 6544 (6541) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 90 (39) | 162 (75) | 142 (51) | 245 (53) | 1512 (2707) | ∞ | ∞2e6 | 0/15 |
| DEAE posik noiseless | 13 (4) | 7.4 (7) | 3.2 (0.6) | 2.7 (0.2) | 2.7 (3) | 2.6 (1) | 2.6 (0.2) | 15/15 |
| DE posik noiseless | 7377 (6480) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEb posik noiseless | 7377 (1e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEctpb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| IPOPsaACM loshchilov noiseless | 2.5 (0.6) | 1.2 (0.3) | 0.45 (0.1) | 0.34 (0.1) | 0.31 (0.1) | 0.26 (0.1) | 0.23 (0.0) | 15/15 |
| JADE posik noiseless | 92 (507) | 46 (4) | 18 (3) | 15 (2) | 15 (28) | 15 (2) | 15 (3) | 14/15 |
| JADEb posik noiseless | 281 (756) | 140 (123) | 54 (83) | 43 (88) | 41 (102) | 37 (2) | 35 (34) | 12/15 |
| JADEctpb posik noiseless | 92 (8) | 46 (5) | 18 (42) | 15 (3) | 15 (53) | 15 (21) | 15 (19) | 14/15 |
| MVDE melo noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 4.6 (0.2) | 2.3 (0.2) | 0.89 (0.0) | 0.69 (0.0) | 0.64 (0.0) | 0.56 (0.0) | 0.51 (0.0) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 4.5 (0.2) | 2.3 (0.1) | 0.87 (0.0) | 0.69 (0.0) | 0.64 (0.0) | 0.56 (0.0) | 0.50 (7e-3) | 15/15 |
| PSO-BFGS voglis noiseless | 0.25 (0.2) | 0.14 (0.1) | 0.05 (0.0) | 0.04 (0.0) | 0.04 (0.0) | 0.04 (0.0) | 0.05 (0.0) | 15/15 |
| SNES schaul noiseless | 1.2e5 (1e5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e6 | 0/15 |
| xNES schaul noiseless | 4.9 (0.3) | 3.3 (0.1) | 1.6 (0.0) | 1.5 (0.0) | 1.6 (0.0) | 1.8 (0.0) | 1.9 (0.0) | 15/15 |
| xNESas schaul noiseless | 4.8 (0.4) | 3.1 (0.2) | 1.4 (0.1) | 1.2 (0.2) | 1.1 (0.2) | 1.00 (0.2) | 0.91 (0.2) | 15/15 |
| Δ fopt f12, 20-D |
1e1 1042 |
1e0 1938 |
1e-1 2740 |
1e-2 3156 |
1e-3 4140 |
1e-5 12407 |
1e-7 13827 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 3664 (5261) | 1.0e4 (2e4) | 2.4e4 (4e4) | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 3.3 (4) | 3.5 (2) | 4.0 (3) | 4.2 (2) | 3.7 (1.0) | 1.5 (0.4) | 1.5 (0.3) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 0.99 (0.5) | 1.1 (1.0) | 1.2 (1) | 1.3 (0.9) | 1.2 (0.7) | 0.55 (0.2) | 0.59 (0.3) | 15/15 |
| CMAES posik noiseless | 2.2 (0.1) | 3.2 (2) | 4.0 (3) | 4.4 (3) | 4.0 (3) | 1.8 (0.7) | 1.9 (0.6) | 15/15 |
| CMA brockhoff noiseless | 3.4 (0.2) | 5.4 (4) | 5.6 (4) | 5.8 (3) | 5.1 (3) | 2.1 (0.7) | 2.2 (0.3) | 15/15 |
| CMAa brockhoff noiseless | 2.4 (2) | 3.4 (4) | 3.4 (3) | 3.8 (3) | 3.4 (2) | 1.4 (0.3) | 1.5 (0.5) | 15/15 |
| CMAm brockhoff noiseless | 3.2 (2) | 4.1 (4) | 4.8 (3) | 5.2 (4) | 4.6 (2) | 2.0 (0.7) | 2.1 (0.6) | 15/15 |
| CMAma brockhoff noiseless | 2.3 (2) | 3.1 (3) | 3.2 (2) | 3.4 (2) | 3.1 (2) | 1.3 (0.6) | 1.4 (0.6) | 15/15 |
| CMAmah brockhoff noiseless | 1.2 (0.6) | 2.1 (1) | 2.6 (2) | 2.8 (1) | 2.5 (1.0) | 1.1 (0.2) | 1.1 (0.3) | 15/15 |
| CMAmh brockhoff noiseless | 4.5 (3) | 6.1 (6) | 6.4 (2) | 6.5 (5) | 5.6 (3) | 2.4 (1) | 2.4 (1) | 15/15 |
| DBRCGA chuang noiseless | 185 (16) | 1209 (1549) | 1.0e4 (1e4) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-AUTO voglis noiseless | 2.2 (2) | 2.3 (3) | 2.9 (4) | 3.6 (6) | 4.4 (4) | 4.5 (5) | 39 (68) | 7/15 |
| DE-BFGS voglis noiseless | 1.4 (0.6) | 1.4 (0.5) | 1.6 (0.9) | 1.6 (1) | 1.7 (1) | 1.1 (0.4) | 4.6 (4) | 15/15 |
| DE-ROLL voglis noiseless | 21 (36) | 18 (19) | 18 (16) | 24 (13) | 27 (18) | 25 (16) | 100 (117) | 6/15 |
| DE-SIMPLEX voglis noiseless | 34 (30) | 30 (19) | 28 (16) | 30 (20) | 31 (21) | 21 (11) | 621 (1457) | 0/15 |
| DEAE posik noiseless | 22 (1) | 14 (3) | 14 (4) | 15 (4) | 14 (2) | 6.1 (0.8) | 6.4 (0.7) | 15/15 |
| DE posik noiseless | 99 (481) | 478 (519) | 1496 (1642) | 4481 (6337) | ∞ | ∞ | ∞1e6 | 0/15 |
| DEb posik noiseless | 99 (481) | 478 (400) | 1496 (3452) | 4481 (3406) | ∞ | ∞ | ∞1e6 | 0/15 |
| DEctpb posik noiseless | 194 (45) | 406 (198) | 1276 (1761) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| IPOPsaACM loshchilov noiseless | 0.67 (0.1) | 0.88 (0.8) | 1.1 (0.9) | 1.2 (0.8) | 1.2 (0.4) | 0.56 (0.2) | 0.60 (0.1) | 15/15 |
| JADE posik noiseless | 19 (4) | 20 (14) | 28 (14) | 30 (12) | 28 (7) | 13 (4) | 14 (3) | 15/15 |
| JADEb posik noiseless | 23 (25) | 34 (29) | 40 (32) | 42 (24) | 39 (27) | 17 (4) | 18 (6) | 15/15 |
| JADEctpb posik noiseless | 19 (4) | 20 (12) | 28 (16) | 30 (14) | 28 (8) | 13 (3) | 14 (3) | 15/15 |
| MVDE melo noiseless | 108 (19) | 272 (262) | 528 (599) | 4612 (4120) | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 2.3 (1) | 2.7 (2) | 3.2 (2) | 3.4 (2) | 3.2 (1) | 1.3 (0.2) | 1.4 (0.3) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.5 (0.1) | 3.6 (3) | 3.5 (1) | 3.8 (2) | 3.4 (1) | 1.4 (0.3) | 1.4 (0.3) | 15/15 |
| PSO-BFGS voglis noiseless | 2.2 (2) | 2.3 (2) | 2.3 (2) | 3.1 (2) | 3.7 (2) | 5.0 (4) | 21 (10) | 13/15 |
| SNES schaul noiseless | 23 (0.3) | 37 (81) | 122 (57) | 651 (1137) | 3134 (3513) | ∞ | ∞8e6 | 0/15 |
| xNES schaul noiseless | 16 (0.5) | 11 (0.5) | 9.3 (0.9) | 9.4 (0.6) | 8.3 (0.6) | 3.5 (0.2) | 3.6 (0.4) | 15/15 |
| xNESas schaul noiseless | 6.6 (3) | 16 (42) | 18 (30) | 30 (30) | 35 (40) | 21 (17) | 22 (15) | 15/15 |
| Δ fopt f13, 20-D |
1e1 652 |
1e0 2021 |
1e-1 2751 |
1e-2 3507 |
1e-3 18749 |
1e-5 24455 |
1e-7 30201 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1.8e4 (1e4) | 3.2e4 (5e4) | 5.1e4 (5e4) | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 4.1 (4) | 3.3 (3) | 3.7 (2) | 3.4 (2) | 0.85 (0.4) | 1.1 (0.9) | 1.4 (0.7) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.1 (0.8) | 0.89 (0.9) | 1.4 (1) | 1.4 (1) | 0.38 (0.1) | 0.42 (0.2) | 0.40 (0.3) | 15/15 |
| CMAES posik noiseless | 6.3 (6) | 5.1 (2) | 4.5 (3) | 4.4 (4) | 1.9 (2) | 4.6 (6) | 8.4 (7) | 12/15 |
| CMA brockhoff noiseless | 2.5 (0.3) | 5.1 (4) | 7.5 (6) | 8.4 (7) | 1.7 (1) | 1.9 (1) | 2.0 (0.8) | 15/15 |
| CMAa brockhoff noiseless | 2.4 (0.3) | 3.5 (4) | 4.5 (3) | 4.5 (3) | 1.1 (0.8) | 1.2 (0.5) | 1.5 (1.0) | 15/15 |
| CMAm brockhoff noiseless | 3.1 (2) | 3.2 (3) | 6.2 (4) | 6.3 (5) | 1.7 (1) | 2.4 (0.5) | 2.4 (0.6) | 15/15 |
| CMAma brockhoff noiseless | 2.9 (2) | 3.5 (2) | 4.4 (2) | 4.0 (3) | 0.94 (0.4) | 1.1 (0.3) | 1.5 (0.8) | 15/15 |
| CMAmah brockhoff noiseless | 3.6 (3) | 3.3 (4) | 4.2 (3) | 4.8 (3) | 1.3 (0.3) | 1.4 (0.6) | 1.8 (0.8) | 15/15 |
| CMAmh brockhoff noiseless | 3.7 (3) | 5.1 (5) | 6.4 (5) | 6.8 (5) | 1.8 (0.7) | 2.4 (1) | 2.7 (0.9) | 15/15 |
| DBRCGA chuang noiseless | 183 (280) | 398 (590) | 2063 (3336) | 3740 (3993) | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-AUTO voglis noiseless | 1.8 (0.3) | 0.91 (0.3) | 0.95 (0.3) | 1.4 (0.4) | 0.70 (0.7) | 4.5 (4) | 32 (32) | 7/15 |
| DE-BFGS voglis noiseless | 1.3 (0.3) | 0.59 (0.1) | 0.53 (0.0) | 0.50 (0.1) | 0.18 (0.1) | 92 (29) | ∞2e6 | 0/15 |
| DE-ROLL voglis noiseless | 24 (56) | 18 (32) | 17 (14) | 19 (16) | 5.8 (4) | 24 (16) | 289 (436) | 1/15 |
| DE-SIMPLEX voglis noiseless | 28 (13) | 15 (2) | 16 (5) | 24 (11) | 9.0 (9) | 195 (266) | ∞2e6 | 0/15 |
| DEAE posik noiseless | 22 (2) | 10 (0.6) | 10 (0.5) | 9.2 (0.4) | 2.1 (0.1) | 2.1 (0.1) | 2.1 (0.0) | 15/15 |
| DE posik noiseless | 41 (7) | 214 (205) | 702 (1030) | 4009 (1996) | ∞ | ∞ | ∞1e6 | 0/15 |
| DEb posik noiseless | 41 (10) | 214 (163) | 702 (546) | 4009 (5133) | ∞ | ∞ | ∞1e6 | 0/15 |
| DEctpb posik noiseless | 50 (5) | 103 (268) | 607 (562) | 4254 (6273) | ∞ | ∞ | ∞1e6 | 0/15 |
| IPOPsaACM loshchilov noiseless | 1.7 (1) | 1.7 (1) | 1.5 (0.6) | 1.5 (0.6) | 0.34 (0.2) | 0.37 (0.1) | 0.41 (0.2) | 15/15 |
| JADE posik noiseless | 17 (2) | 14 (5) | 15 (1) | 14 (4) | 3.6 (0.2) | 4.8 (0.8) | 9.0 (2) | 15/15 |
| JADEb posik noiseless | 61 (52) | 91 (219) | 175 (166) | 721 (730) | 795 (707) | ∞ | ∞1e6 | 0/15 |
| JADEctpb posik noiseless | 17 (1) | 14 (5) | 15 (3) | 14 (4) | 3.6 (0.9) | 4.8 (0.7) | 9.0 (3) | 15/15 |
| MVDE melo noiseless | 68 (6) | 297 (373) | 2522 (1980) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 3.3 (2) | 2.6 (2) | 3.7 (3) | 4.6 (2) | 1.1 (0.6) | 1.2 (0.5) | 1.3 (0.9) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 3.3 (3) | 3.7 (3) | 4.1 (2) | 4.0 (3) | 0.95 (0.4) | 1.1 (0.3) | 1.5 (0.5) | 15/15 |
| PSO-BFGS voglis noiseless | 1.2 (0.1) | 0.56 (0.0) | 0.51 (0.0) | 0.49 (0.0) | 0.21 (0.1) | 133 (104) | ∞2e6 | 0/15 |
| SNES schaul noiseless | 11 (31) | 54 (59) | 153 (215) | 384 (398) | 140 (158) | 796 (852) | ∞7e6 | 0/15 |
| xNES schaul noiseless | 16 (0.4) | 7.8 (0.1) | 7.9 (0.2) | 7.8 (0.1) | 1.8 (0.0) | 1.8 (0.0) | 1.9 (0.0) | 15/15 |
| xNESas schaul noiseless | 7.0 (3) | 4.6 (3) | 19 (27) | 46 (34) | 17 (18) | 40 (47) | 81 (94) | 0/15 |
| Δ fopt f14, 20-D |
1e1 75 |
1e0 239 |
1e-1 304 |
1e-2 451 |
1e-3 932 |
1e-5 1648 |
1e-7 15661 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 15 (4) | 9.5 (0.9) | 11 (1) | 13 (1) | 30 (9) | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 3.2 (1) | 2.6 (0.4) | 3.3 (0.4) | 3.9 (0.3) | 3.2 (0.2) | 3.8 (0.2) | 0.68 (0.0) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 3.2 (1) | 1.8 (0.3) | 1.9 (0.4) | 2.0 (0.2) | 1.5 (0.3) | 1.4 (0.1) | 0.23 (0.0) | 15/15 |
| CMAES posik noiseless | 4.2 (0.4) | 3.0 (0.4) | 3.7 (0.3) | 4.3 (0.5) | 4.2 (0.4) | 6.2 (0.6) | 1.2 (0.1) | 15/15 |
| CMA brockhoff noiseless | 4.5 (1) | 3.0 (0.5) | 3.7 (0.4) | 4.2 (0.4) | 4.1 (0.5) | 6.1 (0.5) | 1.2 (0.1) | 15/15 |
| CMAa brockhoff noiseless | 3.8 (2) | 2.7 (0.3) | 3.5 (0.6) | 3.9 (0.4) | 3.1 (0.3) | 3.9 (0.2) | 0.69 (0.0) | 15/15 |
| CMAm brockhoff noiseless | 2.9 (1) | 2.3 (0.4) | 2.8 (0.4) | 3.5 (0.3) | 3.7 (0.5) | 6.3 (0.7) | 1.2 (0.1) | 15/15 |
| CMAma brockhoff noiseless | 3.3 (1) | 2.3 (0.3) | 2.8 (0.5) | 3.3 (0.1) | 2.9 (0.3) | 3.7 (0.3) | 0.65 (0.0) | 15/15 |
| CMAmah brockhoff noiseless | 2.0 (0.6) | 1.5 (0.2) | 1.9 (0.2) | 2.3 (0.3) | 2.3 (0.3) | 3.4 (0.3) | 0.66 (0.0) | 15/15 |
| CMAmh brockhoff noiseless | 2.3 (1) | 1.6 (0.4) | 1.9 (0.3) | 2.4 (0.5) | 2.8 (0.3) | 5.7 (0.3) | 1.2 (0.1) | 15/15 |
| DBRCGA chuang noiseless | 32 (10) | 45 (10) | 67 (7) | 81 (10) | 93 (23) | 1640 (744) | ∞2e6 | 0/15 |
| DE-AUTO voglis noiseless | 2.0 (0.4) | 0.93 (0.0) | 0.93 (0.1) | 0.88 (0.1) | 0.58 (0.0) | 0.91 (0.0) | 62 (75) | 0/15 |
| DE-BFGS voglis noiseless | 1.7 (0.5) | 0.84 (0.2) | 0.90 (0.2) | 0.93 (0.1) | 0.62 (0.1) | 0.56 (0.0) | 125 (132) | 0/15 |
| DE-ROLL voglis noiseless | 7.4 (14) | 18 (25) | 17 (24) | 12 (2) | 33 (6) | 3480 (3718) | ∞2e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 12 (13) | 40 (24) | 53 (10) | 42 (7) | 30 (11) | 122 (62) | ∞2e6 | 0/15 |
| DEAE posik noiseless | 30 (4) | 27 (3) | 37 (3) | 38 (3) | 24 (1) | 19 (2) | 2.7 (0.2) | 15/15 |
| DE posik noiseless | 55 (20) | 46 (6) | 53 (4) | 90 (15) | 502 (266) | ∞ | ∞1e6 | 0/15 |
| DEb posik noiseless | 55 (21) | 46 (4) | 53 (4) | 90 (10) | 502 (144) | ∞ | ∞1e6 | 0/15 |
| DEctpb posik noiseless | 57 (24) | 47 (9) | 57 (7) | 92 (23) | 814 (460) | ∞ | ∞1e6 | 0/15 |
| IPOPsaACM loshchilov noiseless | 3.0 (0.6) | 1.8 (0.4) | 1.9 (0.3) | 2.0 (0.2) | 1.4 (0.1) | 1.4 (0.1) | 0.23 (0.0) | 15/15 |
| JADE posik noiseless | 18 (7) | 18 (1) | 23 (2) | 25 (2) | 20 (1) | 38 (23) | 62 (43) | 5/15 |
| JADEb posik noiseless | 14 (6) | 13 (1) | 18 (2) | 22 (4) | 21 (3) | 77 (29) | ∞1e6 | 0/15 |
| JADEctpb posik noiseless | 18 (6) | 18 (2) | 23 (2) | 25 (2) | 20 (1) | 38 (10) | 62 (39) | 5/15 |
| MVDE melo noiseless | 57 (12) | 60 (3) | 78 (4) | 108 (11) | 1465 (1406) | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 4.3 (1) | 3.0 (0.4) | 3.7 (0.5) | 4.0 (0.7) | 3.2 (0.3) | 3.9 (0.2) | 0.67 (0.1) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 4.3 (1) | 2.8 (0.6) | 3.5 (0.6) | 4.0 (0.7) | 3.3 (0.3) | 3.9 (0.3) | 0.69 (0.0) | 15/15 |
| PSO-BFGS voglis noiseless | 1.7 (0.5) | 0.85 (0.2) | 0.98 (0.2) | 0.97 (0.1) | 0.63 (0.1) | 0.57 (0.1) | 892 (1715) | 0/15 |
| SNES schaul noiseless | 2.6 (0.7) | 2.4 (0.5) | 3.9 (0.4) | 5.3 (0.6) | 8.5 (3) | ∞ | ∞8e6 | 0/15 |
| xNES schaul noiseless | 2.4 (0.6) | 7.9 (1) | 19 (0.9) | 21 (0.8) | 14 (0.4) | 12 (0.2) | 1.7 (0.0) | 15/15 |
| xNESas schaul noiseless | 2.6 (0.9) | 7.6 (1) | 14 (4) | 17 (2) | 12 (1) | 10 (0.3) | 1.5 (0.1) | 15/15 |
| Δ fopt f15, 20-D |
1e1 30378 |
1e0 1.5e5 |
1e-1 3.1e5 |
1e-2 3.2e5 |
1e-3 3.2e5 |
1e-5 4.5e5 |
1e-7 4.6e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 919 (581) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 0.88 (0.9) | 1.6 (0.7) | 1.2 (0.6) | 1.2 (0.5) | 1.2 (0.6) | 0.89 (0.4) | 0.89 (0.4) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 0.65 (0.3) | 1.3 (1) | 0.91 (0.6) | 0.90 (0.4) | 0.89 (0.6) | 0.66 (0.5) | 0.65 (0.4) | 15/15 |
| CMAES posik noiseless | 37 (51) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| CMA brockhoff noiseless | 0.98 (0.6) | 0.98 (0.4) | 0.76 (0.2) | 0.77 (0.2) | 0.77 (0.3) | 0.57 (0.2) | 0.58 (0.2) | 15/15 |
| CMAa brockhoff noiseless | 0.90 (0.2) | 1.0 (0.4) | 0.60 (0.2) | 0.61 (0.4) | 0.61 (0.2) | 0.45 (0.3) | 0.46 (0.2) | 15/15 |
| CMAm brockhoff noiseless | 0.81 (0.7) | 1.1 (0.3) | 0.69 (0.5) | 0.69 (0.4) | 0.70 (0.5) | 0.52 (0.3) | 0.53 (0.1) | 15/15 |
| CMAma brockhoff noiseless | 0.62 (0.2) | 0.98 (0.3) | 0.65 (0.3) | 0.66 (0.3) | 0.67 (0.3) | 0.49 (0.2) | 0.50 (0.2) | 15/15 |
| CMAmah brockhoff noiseless | 0.92 (0.7) | 1.2 (0.6) | 0.64 (0.4) | 0.65 (0.3) | 0.65 (0.2) | 0.48 (0.2) | 0.49 (0.2) | 15/15 |
| CMAmh brockhoff noiseless | 0.98 (0.6) | 1.1 (0.3) | 0.66 (0.4) | 0.67 (0.2) | 0.67 (0.2) | 0.50 (0.2) | 0.50 (0.3) | 15/15 |
| DBRCGA chuang noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-AUTO voglis noiseless | 59 (58) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-BFGS voglis noiseless | 28 (18) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-ROLL voglis noiseless | 32 (17) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 25 (14) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEAE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEctpb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| IPOPsaACM loshchilov noiseless | 0.60 (0.3) | 0.92 (0.6) | 0.53 (0.1) | 0.53 (0.4) | 0.52 (0.3) | 0.37 (0.3) | 0.37 (0.2) | 15/15 |
| JADE posik noiseless | 39 (56) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| JADEb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| JADEctpb posik noiseless | 39 (55) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| MVDE melo noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 1.2 (0.7) | 1.2 (0.4) | 0.79 (0.1) | 0.79 (0.5) | 0.79 (0.5) | 0.58 (0.4) | 0.59 (0.3) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 0.81 (0.5) | 0.99 (0.7) | 0.67 (0.3) | 0.67 (0.4) | 0.68 (0.4) | 0.50 (0.2) | 0.51 (0.2) | 15/15 |
| PSO-BFGS voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SNES schaul noiseless | 49 (62) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e6 | 0/15 |
| xNES schaul noiseless | 43 (44) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞7e6 | 0/15 |
| xNESas schaul noiseless | 44 (14) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Δ fopt f16, 20-D |
1e1 1384 |
1e0 27265 |
1e-1 77015 |
1e-2 1.4e5 |
1e-3 1.9e5 |
1e-5 2.0e5 |
1e-7 2.2e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1.0e5 (1e5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 1.7 (0.2) | 0.87 (0.5) | 0.78 (0.6) | 0.85 (0.5) | 0.92 (0.4) | 1.2 (1) | 1.1 (1) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.9 (0.6) | 0.74 (0.7) | 0.51 (0.6) | 0.64 (0.2) | 0.60 (0.6) | 0.84 (0.5) | 0.83 (0.4) | 15/15 |
| CMAES posik noiseless | 1.9 (2) | 2.7 (1) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| CMA brockhoff noiseless | 1.8 (1) | 1.1 (0.9) | 0.82 (0.7) | 0.93 (0.9) | 1.1 (0.7) | 1.2 (1) | 1.1 (0.8) | 15/15 |
| CMAa brockhoff noiseless | 1.9 (4) | 0.76 (0.4) | 0.83 (0.8) | 0.56 (0.2) | 0.81 (0.5) | 1.00 (0.4) | 0.95 (0.6) | 15/15 |
| CMAm brockhoff noiseless | 1.3 (0.3) | 0.85 (1.0) | 1.3 (1) | 1.2 (0.6) | 1.4 (2) | 1.4 (2) | 1.3 (1) | 15/15 |
| CMAma brockhoff noiseless | 2.2 (5) | 0.63 (0.7) | 0.84 (0.6) | 0.64 (0.5) | 0.76 (0.8) | 0.85 (0.5) | 0.79 (0.9) | 15/15 |
| CMAmah brockhoff noiseless | 2.3 (0.2) | 0.91 (0.4) | 0.90 (0.7) | 0.69 (0.3) | 0.92 (0.6) | 1.3 (0.8) | 1.2 (1) | 15/15 |
| CMAmh brockhoff noiseless | 3.0 (4) | 1.1 (1) | 1.1 (0.6) | 0.99 (0.7) | 1.0 (0.8) | 1.1 (0.7) | 1.0 (0.4) | 15/15 |
| DBRCGA chuang noiseless | 118 (319) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-AUTO voglis noiseless | 40 (30) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-BFGS voglis noiseless | 595 (451) | 242 (139) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-ROLL voglis noiseless | 20 (18) | 1093 (1505) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 54 (45) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEAE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEctpb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| IPOPsaACM loshchilov noiseless | 1.8 (0.6) | 0.55 (0.8) | 0.77 (0.8) | 0.63 (0.4) | 0.52 (0.3) | 0.55 (0.4) | 0.50 (0.3) | 15/15 |
| JADE posik noiseless | 24 (7) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| JADEb posik noiseless | 60 (40) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| JADEctpb posik noiseless | 24 (7) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| MVDE melo noiseless | 1353 (2424) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 2.6 (3) | 0.80 (0.4) | 0.51 (0.2) | 0.51 (0.3) | 0.42 (0.2) | 0.43 (0.2) | 0.41 (0.2) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.0 (3) | 0.57 (0.3) | 0.41 (0.1) | 0.41 (0.2) | 0.38 (0.2) | 0.39 (0.4) | 0.37 (0.1) | 15/15 |
| PSO-BFGS voglis noiseless | 542 (397) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SNES schaul noiseless | 2.7 (1) | 11 (4) | 157 (234) | 861 (704) | ∞ | ∞ | ∞8e6 | 0/15 |
| xNES schaul noiseless | 17 (7) | 2.3 (3) | 15 (11) | 35 (64) | 48 (51) | 56 (60) | 50 (35) | 7/15 |
| xNESas schaul noiseless | 20 (13) | 4.2 (4) | 9.2 (6) | 22 (21) | 108 (189) | 133 (191) | 119 (257) | 6/15 |
| Δ fopt f17, 20-D |
1e1 63 |
1e0 1030 |
1e-1 4005 |
1e-2 12242 |
1e-3 30677 |
1e-5 56288 |
1e-7 80472 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 12 (8) | 4.5 (1) | 269 (710) | 677 (641) | 4564 (5216) | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 3.0 (1) | 1.1 (0.4) | 1.7 (1) | 1.4 (1) | 1.0 (0.3) | 0.90 (0.3) | 1.1 (0.4) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 3.2 (1) | 1.2 (0.4) | 2.7 (3) | 1.6 (0.7) | 1.2 (0.9) | 1.2 (0.5) | 1.4 (0.7) | 15/15 |
| CMAES posik noiseless | 2.8 (2) | 0.96 (0.2) | 1.5 (0.1) | 3.7 (5) | 8.1 (6) | ∞ | ∞1e6 | 0/15 |
| CMA brockhoff noiseless | 2.2 (1) | 1.00 (0.7) | 1.5 (2) | 1.1 (0.7) | 0.81 (0.4) | 0.93 (0.2) | 0.91 (0.5) | 15/15 |
| CMAa brockhoff noiseless | 2.3 (1) | 0.87 (0.2) | 0.52 (0.2) | 0.73 (0.6) | 0.70 (0.3) | 0.80 (0.3) | 0.92 (0.3) | 15/15 |
| CMAm brockhoff noiseless | 2.2 (0.6) | 0.82 (0.3) | 1.4 (1) | 0.76 (0.5) | 0.59 (0.3) | 0.82 (0.5) | 0.92 (0.1) | 15/15 |
| CMAma brockhoff noiseless | 2.2 (1) | 0.86 (0.1) | 1.4 (2) | 1.2 (0.7) | 0.70 (0.3) | 0.79 (0.3) | 0.82 (0.2) | 15/15 |
| CMAmah brockhoff noiseless | 2.0 (0.5) | 8.8 (11) | 4.0 (2) | 1.7 (0.7) | 0.92 (0.3) | 0.96 (0.1) | 0.94 (0.5) | 15/15 |
| CMAmh brockhoff noiseless | 1.8 (0.7) | 22 (19) | 7.7 (4) | 3.1 (4) | 1.4 (1) | 1.3 (0.5) | 1.3 (0.7) | 15/15 |
| DBRCGA chuang noiseless | 18 (7) | 2347 (1572) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-AUTO voglis noiseless | 48 (52) | 335 (172) | 529 (571) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-BFGS voglis noiseless | 17 (21) | 117 (54) | 327 (47) | 1140 (1265) | 952 (1060) | ∞ | ∞2e6 | 0/15 |
| DE-ROLL voglis noiseless | 15 (49) | 358 (603) | 535 (632) | 1105 (610) | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 34 (52) | 381 (964) | 2127 (3768) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEAE posik noiseless | 19 (13) | 13 (2) | 8.4 (0.7) | 4.4 (0.4) | 2.3 (0.3) | 37 (45) | 90 (102) | 2/15 |
| DE posik noiseless | 26 (20) | 16 (4) | 13 (3) | 8.0 (1) | 8.8 (9) | ∞ | ∞1e6 | 0/15 |
| DEb posik noiseless | 26 (9) | 16 (4) | 13 (10) | 8.0 (4) | 8.8 (9) | ∞ | ∞1e6 | 0/15 |
| DEctpb posik noiseless | 16 (14) | 17 (1) | 11 (1) | 6.8 (0.7) | 4.3 (0.6) | 63 (75) | 183 (65) | 1/15 |
| IPOPsaACM loshchilov noiseless | 2.5 (2) | 0.91 (0.3) | 0.98 (1) | 1.7 (1) | 1.2 (0.3) | 1.2 (0.3) | 1.1 (0.1) | 15/15 |
| JADE posik noiseless | 7.8 (6) | 7.4 (2) | 4.4 (0.6) | 2.4 (0.3) | 1.7 (1) | 7.2 (10) | 23 (29) | 2/15 |
| JADEb posik noiseless | 9.3 (7) | 14 (12) | 85 (125) | 90 (90) | 466 (310) | ∞ | ∞1e6 | 0/15 |
| JADEctpb posik noiseless | 7.8 (5) | 7.4 (2) | 4.4 (0.6) | 2.4 (0.2) | 1.7 (0.6) | 7.2 (3) | 23 (25) | 2/15 |
| MVDE melo noiseless | 19 (14) | 29 (4) | 24 (8) | 30 (23) | 34 (51) | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 2.6 (2) | 1.00 (0.2) | 0.77 (0.3) | 1.3 (0.7) | 1.2 (2) | 1.4 (0.6) | 1.2 (0.7) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.5 (2) | 1.1 (0.3) | 1.9 (2) | 1.2 (0.6) | 0.79 (0.4) | 0.88 (0.4) | 0.81 (0.3) | 15/15 |
| PSO-BFGS voglis noiseless | 19 (11) | 1652 (1600) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SNES schaul noiseless | 2.0 (1) | 1.0 (0.2) | 5.9 (5) | 4.2 (3) | 3.9 (3) | 239 (204) | ∞8e6 | 0/15 |
| xNES schaul noiseless | 1.9 (0.9) | 3.6 (0.6) | 3.0 (0.1) | 1.7 (0.0) | 0.94 (0.0) | 2.7 (3) | 12 (14) | 15/15 |
| xNESas schaul noiseless | 2.1 (1.0) | 3.5 (0.8) | 2.9 (0.3) | 1.6 (0.1) | 0.92 (0.0) | 1.4 (0.4) | 12 (12) | 15/15 |
| Δ fopt f18, 20-D |
1e1 621 |
1e0 3972 |
1e-1 19561 |
1e-2 28555 |
1e-3 67569 |
1e-5 1.3e5 |
1e-7 1.5e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 4.7 (2) | 3.5 (2) | 493 (768) | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 0.94 (0.2) | 0.77 (1) | 1.5 (0.9) | 1.6 (1) | 1.4 (1) | 1.2 (0.8) | 1.5 (0.6) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 1.0 (0.3) | 1.5 (1) | 0.92 (0.4) | 1.3 (0.4) | 0.96 (0.5) | 1.6 (3) | 1.6 (2) | 15/15 |
| CMAES posik noiseless | 1.1 (0.4) | 2.0 (3) | 4.2 (5) | 493 (552) | ∞ | ∞ | ∞1e6 | 0/15 |
| CMA brockhoff noiseless | 0.96 (0.2) | 0.70 (0.1) | 0.89 (0.7) | 1.3 (0.2) | 0.98 (0.3) | 1.1 (0.8) | 1.1 (0.4) | 15/15 |
| CMAa brockhoff noiseless | 0.96 (0.4) | 0.96 (2) | 0.96 (0.4) | 1.2 (0.9) | 0.79 (0.3) | 0.85 (0.3) | 0.87 (0.3) | 15/15 |
| CMAm brockhoff noiseless | 0.81 (0.4) | 1.0 (1) | 0.61 (0.7) | 0.93 (0.6) | 0.89 (0.6) | 0.97 (0.9) | 0.95 (0.3) | 15/15 |
| CMAma brockhoff noiseless | 0.85 (0.1) | 0.57 (0.1) | 0.78 (0.6) | 0.99 (0.3) | 0.68 (0.3) | 0.77 (0.3) | 0.74 (0.3) | 15/15 |
| CMAmah brockhoff noiseless | 0.95 (0.5) | 2.5 (2) | 1.2 (0.7) | 1.1 (0.3) | 0.79 (0.3) | 0.88 (0.2) | 0.91 (0.2) | 15/15 |
| CMAmh brockhoff noiseless | 3.3 (9) | 3.4 (2) | 1.2 (0.8) | 1.5 (0.1) | 1.1 (0.6) | 1.1 (0.2) | 1.1 (0.3) | 15/15 |
| DBRCGA chuang noiseless | 13 (5) | 7527 (1e4) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-AUTO voglis noiseless | 131 (86) | 416 (863) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-BFGS voglis noiseless | 69 (53) | 350 (431) | 1503 (1280) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-ROLL voglis noiseless | 87 (37) | 518 (388) | 1470 (1970) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 115 (82) | 1124 (1164) | 1462 (691) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEAE posik noiseless | 12 (3) | 6.3 (1) | 2.3 (0.3) | 2.7 (0.6) | 2.5 (2) | 6.7 (7) | 14 (21) | 4/15 |
| DE posik noiseless | 17 (2) | 16 (7) | 15 (7) | 56 (47) | ∞ | ∞ | ∞1e6 | 0/15 |
| DEb posik noiseless | 17 (8) | 16 (9) | 15 (7) | 56 (115) | ∞ | ∞ | ∞1e6 | 0/15 |
| DEctpb posik noiseless | 17 (6) | 14 (3) | 7.8 (2) | 21 (18) | 50 (37) | ∞ | ∞1e6 | 0/15 |
| IPOPsaACM loshchilov noiseless | 0.96 (0.4) | 1.4 (1) | 0.91 (0.6) | 1.3 (0.6) | 0.78 (0.4) | 0.88 (0.6) | 1.3 (2) | 15/15 |
| JADE posik noiseless | 7.2 (2) | 4.4 (0.9) | 1.5 (0.2) | 8.2 (6) | 19 (44) | ∞ | ∞1e6 | 0/15 |
| JADEb posik noiseless | 6.3 (1) | 13 (22) | 127 (81) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| JADEctpb posik noiseless | 7.2 (0.9) | 4.4 (1) | 1.5 (0.5) | 8.2 (11) | 19 (23) | ∞ | ∞1e6 | 0/15 |
| MVDE melo noiseless | 23 (5) | 37 (21) | 133 (108) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 1.0 (0.2) | 1.4 (2) | 1.4 (0.6) | 1.5 (0.8) | 1.2 (0.7) | 0.97 (0.3) | 0.92 (0.4) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 1.0 (0.3) | 0.76 (1) | 0.79 (0.2) | 1.1 (0.4) | 0.88 (0.2) | 0.85 (0.3) | 0.84 (0.3) | 15/15 |
| PSO-BFGS voglis noiseless | 210 (87) | 7504 (5671) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SNES schaul noiseless | 1.0 (0.7) | 2.0 (10) | 6.3 (4) | 28 (40) | 547 (807) | ∞ | ∞8e6 | 0/15 |
| xNES schaul noiseless | 1.3 (0.5) | 2.0 (0.2) | 0.84 (0.0) | 0.88 (0.0) | 0.50 (0.0) | 1.3 (1) | 11 (4) | 15/15 |
| xNESas schaul noiseless | 1.2 (0.5) | 1.9 (0.2) | 0.81 (0.0) | 0.84 (0.0) | 0.48 (0.0) | 0.58 (0.3) | 5.6 (5) | 15/15 |
| Δ fopt f19, 20-D |
1e1 1 |
1e0 1 |
1e-1 3.4e5 |
1e-2 4.7e6 |
1e-3 6.2e6 |
1e-5 6.7e6 |
1e-7 6.7e6 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 686 (257) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 184 (75) | 2.9e4 (2e4) | 1.4 (1) | 1.0 (0.2) | 1.0 (0.4) | 1.0 (0.3) | 1.0 (0.4) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 143 (50) | 2.5e4 (2e4) | 0.42 (0.5) | 0.76 (0.2) | 0.72 (0.3) | 0.73 (0.3) | 0.73 (0.4) | 15/15 |
| CMAES posik noiseless | 162 (70) | 4.8e4 (5e4) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| CMA brockhoff noiseless | 170 (60) | 3.1e4 (2e4) | 2.0 (0.3) | 0.84 (0.4) | 0.94 (0.6) | 1.7 (2) | 1.7 (2) | 5/15 |
| CMAa brockhoff noiseless | 156 (63) | 7.7e4 (1e4) | 2.5 (0.7) | 0.85 (1) | 0.73 (0.4) | 0.88 (2) | 0.88 (0.4) | 8/15 |
| CMAm brockhoff noiseless | 134 (53) | 1.8e4 (7370) | 1.1 (0.7) | 0.95 (1) | 2.3 (3) | 2.9 (6) | 2.8 (4) | 3/15 |
| CMAma brockhoff noiseless | 135 (46) | 4.2e4 (2e4) | 3.2 (4) | 1.3 (0.9) | 1.0 (1.0) | 1.6 (1) | 2.1 (2) | 4/15 |
| CMAmah brockhoff noiseless | 95 (50) | 8.5e4 (2e4) | 2.5 (4) | 0.80 (0.3) | 0.91 (2) | 1.3 (1) | 1.3 (0.8) | 6/15 |
| CMAmh brockhoff noiseless | 82 (49) | 2.4e4 (2e4) | 3.3 (7) | 1.3 (0.6) | 1.8 (1) | 2.9 (5) | 2.8 (3) | 3/15 |
| DBRCGA chuang noiseless | 975 (160) | 6.9e5 (7e5) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-AUTO voglis noiseless | 2751 (2481) | 1.1e5 (8e4) | 87 (51) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-BFGS voglis noiseless | 3206 (2240) | 3.8e4 (1e4) | 5.4 (8) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-ROLL voglis noiseless | 3941 (5192) | 2.2e5 (2e5) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 8348 (6168) | 1.5e5 (8e4) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEAE posik noiseless | 1434 (477) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE posik noiseless | 2739 (602) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEb posik noiseless | 2739 (483) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEctpb posik noiseless | 2148 (964) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| IPOPsaACM loshchilov noiseless | 154 (49) | 3.0e4 (3e4) | 0.61 (0.2) | 0.40 (0.1) | 0.33 (0.2) | 0.32 (0.1) | 0.32 (0.3) | 14/15 |
| JADE posik noiseless | 856 (178) | 7.0e5 (6e5) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| JADEb posik noiseless | 826 (348) | 3.1e6 (2e6) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| JADEctpb posik noiseless | 856 (227) | 7.0e5 (6e5) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| MVDE melo noiseless | 2928 (802) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 180 (53) | 2.9e4 (3e4) | 0.98 (0.6) | 0.75 (0.5) | 0.69 (0.3) | 0.64 (0.3) | 0.65 (0.3) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 169 (53) | 2.8e4 (2e4) | 1.7 (0.4) | 0.71 (0.5) | 0.59 (0.3) | 0.56 (0.3) | 0.56 (0.3) | 15/15 |
| PSO-BFGS voglis noiseless | 3614 (6485) | 3.5e4 (2e4) | 1.4 (1) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SNES schaul noiseless | 118 (46) | 1.3e5 (1e5) | ∞ | ∞ | ∞ | ∞ | ∞8e6 | 0/15 |
| xNES schaul noiseless | 105 (51) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6e6 | 0/15 |
| xNESas schaul noiseless | 108 (18) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Δ fopt f20, 20-D |
1e1 82 |
1e0 46150 |
1e-1 3.1e6 |
1e-2 5.5e6 |
1e-3 5.5e6 |
1e-5 5.6e6 |
1e-7 5.6e6 |
#succ 14/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 16 (4) | 1.6 (0.9) | 24 (28) | 27 (31) | 27 (32) | 26 (20) | 26 (42) | 1/15 |
| BIPOPaCMA loshchilov noiseless | 4.9 (1) | 4.8 (2) | 1.4 (0.6) | 0.95 (0.3) | 0.95 (0.4) | 0.95 (0.4) | 0.95 (0.3) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.9 (0.2) | 2.1 (0.9) | 0.97 (0.5) | 0.87 (0.3) | 0.87 (0.3) | 0.86 (0.7) | 0.85 (0.4) | 15/15 |
| CMAES posik noiseless | 5.1 (1) | 156 (158) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| CMA brockhoff noiseless | 4.8 (1) | 5.4 (2) | 0.79 (0.2) | 1.2 (2) | 1.2 (0.6) | 1.2 (0.7) | 1.2 (2) | 6/15 |
| CMAa brockhoff noiseless | 4.8 (1) | 3.2 (1) | 0.90 (0.7) | 1.1 (1) | 1.1 (0.6) | 1.1 (0.8) | 1.7 (2) | 5/15 |
| CMAm brockhoff noiseless | 3.4 (0.6) | 5.4 (2) | 1.1 (0.8) | 1.4 (1) | 1.4 (0.8) | 2.0 (2) | 3.3 (3) | 3/15 |
| CMAma brockhoff noiseless | 3.9 (0.6) | 3.0 (1) | 1.1 (0.8) | 5.0 (7) | 5.0 (6) | 5.0 (4) | 4.9 (6) | 2/15 |
| CMAmah brockhoff noiseless | 2.5 (0.8) | 3.4 (1) | 0.87 (0.8) | 2.4 (2) | 2.4 (4) | 3.2 (4) | 3.2 (3) | 3/15 |
| CMAmh brockhoff noiseless | 2.6 (0.9) | 6.1 (3) | 1.3 (1) | 10 (20) | 10 (12) | 10 (24) | 10 (10) | 1/15 |
| DBRCGA chuang noiseless | 34 (4) | 148 (274) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-AUTO voglis noiseless | 2.1 (0.5) | 3.4 (2) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-BFGS voglis noiseless | 6.3 (3) | 1.0 (0.7) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-ROLL voglis noiseless | 21 (5) | 0.84 (0.8) | 4.4 (4) | 5.3 (4) | 5.3 (4) | 5.3 (6) | 5.2 (5) | 1/15 |
| DE-SIMPLEX voglis noiseless | 21 (39) | 3.6 (3) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEAE posik noiseless | 39 (7) | 56 (49) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE posik noiseless | 51 (12) | 2.4 (0.9) | 0.79 (2) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEb posik noiseless | 51 (10) | 2.4 (1.0) | 0.79 (1) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEctpb posik noiseless | 55 (6) | 104 (49) | 4.8 (4) | 2.7 (2) | 2.7 (3) | 2.7 (2) | 2.7 (4) | 1/15 |
| IPOPsaACM loshchilov noiseless | 2.8 (0.5) | 1.7 (3) | 0.49 (0.2) | 0.46 (0.2) | 0.45 (0.2) | 0.45 (0.2) | 0.45 (0.2) | 15/15 |
| JADE posik noiseless | 24 (3) | 1.2 (0.2) | 0.46 (0.6) | 0.62 (0.7) | 0.85 (1) | 2.7 (2) | ∞1e6 | 0/15 |
| JADEb posik noiseless | 19 (4) | 0.56 (0.7) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| JADEctpb posik noiseless | 24 (3) | 1.2 (0.2) | 0.46 (0.1) | 0.62 (0.2) | 0.85 (0.9) | 2.7 (3) | ∞1e6 | 0/15 |
| MVDE melo noiseless | 83 (10) | 4.3 (0.9) | 0.26 (0.3) | 0.30 (0.3) | 0.31 (0.3) | 0.36 (0.3) | 0.36 (0.3) | 6/15 |
| NBIPOPaCMA loshchilov noiseless | 4.3 (1.0) | 4.6 (2) | 1.1 (0.5) | 0.98 (0.8) | 0.98 (0.1) | 0.98 (0.6) | 0.98 (0.3) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 4.5 (1) | 3.1 (1) | 0.73 (0.5) | 0.59 (0.2) | 0.59 (0.2) | 0.60 (0.2) | 0.60 (0.2) | 15/15 |
| PSO-BFGS voglis noiseless | 7.1 (2) | 0.87 (0.6) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SNES schaul noiseless | 3.1 (0.8) | 18 (31) | ∞ | ∞ | ∞ | ∞ | ∞7e6 | 0/15 |
| xNES schaul noiseless | 5.6 (2) | 1.1 (3) | ∞ | ∞ | ∞ | ∞ | ∞6e6 | 0/15 |
| xNESas schaul noiseless | 5.4 (1) | 1.1 (0.6) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Δ fopt f21, 20-D |
1e1 561 |
1e0 6541 |
1e-1 14103 |
1e-2 14318 |
1e-3 14643 |
1e-5 15567 |
1e-7 17589 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 2745 (2e4) | 9938 (8409) | 9927 (1e4) | 9778 (2e4) | 9561 (2e4) | 8994 (7869) | 7960 (6822) | 1/15 |
| BIPOPaCMA loshchilov noiseless | 7.8 (12) | 110 (8) | 72 (47) | 71 (331) | 69 (25) | 65 (81) | 58 (60) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 2.6 (6) | 1.5 (1) | 6.0 (13) | 5.9 (9) | 5.8 (14) | 5.5 (8) | 4.8 (9) | 15/15 |
| CMAES posik noiseless | 5.4 (4) | 9.4 (10) | 5.5 (7) | 5.4 (6) | 5.3 (9) | 5.0 (8) | 4.5 (3) | 15/15 |
| CMA brockhoff noiseless | 5.0 (14) | 122 (222) | 57 (86) | 56 (42) | 55 (141) | 52 (57) | 46 (66) | 9/15 |
| CMAa brockhoff noiseless | 3.2 (4) | 95 (89) | 77 (85) | 76 (119) | 74 (104) | 70 (74) | 62 (110) | 8/15 |
| CMAm brockhoff noiseless | 3.5 (7) | 109 (46) | 80 (139) | 79 (116) | 77 (196) | 73 (95) | 65 (128) | 8/15 |
| CMAma brockhoff noiseless | 3.0 (7) | 92 (174) | 95 (103) | 94 (120) | 92 (81) | 86 (110) | 76 (98) | 7/15 |
| CMAmah brockhoff noiseless | 25 (12) | 124 (234) | 76 (46) | 75 (82) | 73 (100) | 69 (173) | 61 (102) | 8/15 |
| CMAmh brockhoff noiseless | 8.7 (47) | 102 (133) | 75 (105) | 74 (148) | 73 (105) | 69 (75) | 61 (150) | 8/15 |
| DBRCGA chuang noiseless | 103 (343) | 162 (437) | 97 (71) | 96 (95) | 95 (114) | 90 (45) | 81 (114) | 10/15 |
| DE-AUTO voglis noiseless | 50 (56) | 52 (104) | 37 (85) | 37 (48) | 36 (39) | 34 (51) | 30 (60) | 14/15 |
| DE-BFGS voglis noiseless | 10 (35) | 33 (56) | 17 (20) | 16 (18) | 16 (20) | 15 (21) | 205 (136) | 1/15 |
| DE-ROLL voglis noiseless | 84 (223) | 66 (81) | 66 (32) | 65 (92) | 64 (80) | 60 (62) | 53 (91) | 12/15 |
| DE-SIMPLEX voglis noiseless | 89 (79) | 208 (139) | 159 (188) | 157 (192) | 154 (218) | 145 (235) | 196 (119) | 5/15 |
| DEAE posik noiseless | 28 (28) | 26 (27) | 19 (24) | 19 (23) | 18 (52) | 17 (43) | 16 (31) | 13/15 |
| DE posik noiseless | 33 (5) | 45 (120) | 30 (53) | 30 (37) | 29 (30) | 28 (32) | 25 (25) | 13/15 |
| DEb posik noiseless | 33 (6) | 45 (47) | 30 (60) | 30 (44) | 29 (64) | 28 (37) | 25 (28) | 13/15 |
| DEctpb posik noiseless | 22 (12) | 139 (268) | 65 (37) | 64 (70) | 63 (69) | 61 (208) | 55 (101) | 8/15 |
| IPOPsaACM loshchilov noiseless | 2.6 (2) | 53 (110) | 157 (208) | 155 (303) | 151 (505) | 142 (75) | 126 (333) | 15/15 |
| JADE posik noiseless | 7.2 (2) | 33 (43) | 21 (48) | 20 (29) | 20 (28) | 19 (58) | 18 (31) | 13/15 |
| JADEb posik noiseless | 20 (30) | 24 (36) | 19 (34) | 18 (16) | 18 (23) | 17 (24) | 15 (5) | 14/15 |
| JADEctpb posik noiseless | 7.2 (2) | 33 (93) | 21 (29) | 20 (21) | 20 (21) | 19 (32) | 18 (22) | 13/15 |
| MVDE melo noiseless | 29 (17) | 64 (52) | 36 (35) | 44 (84) | 62 (126) | 73 (130) | 81 (104) | 7/15 |
| NBIPOPaCMA loshchilov noiseless | 1.9 (4) | 1.5 (2) | 13 (29) | 13 (13) | 12 (3) | 12 (12) | 10 (13) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.5 (3) | 129 (270) | 135 (155) | 133 (216) | 130 (171) | 123 (103) | 109 (106) | 15/15 |
| PSO-BFGS voglis noiseless | 1.7 (0.8) | 0.64 (0.4) | 0.56 (1) | 0.56 (0.6) | 0.55 (0.9) | 0.57 (0.9) | 96 (77) | 1/15 |
| SNES schaul noiseless | 76 (71) | 93 (110) | 70 (43) | 69 (111) | 67 (48) | 63 (110) | 56 (99) | 15/15 |
| xNES schaul noiseless | 142 (350) | 112 (30) | 54 (88) | 54 (68) | 53 (18) | 50 (71) | 44 (65) | 15/15 |
| xNESas schaul noiseless | 45 (125) | 66 (191) | 37 (75) | 36 (21) | 35 (45) | 33 (17) | 30 (36) | 30/30 |
| Δ fopt f22, 20-D |
1e1 467 |
1e0 5580 |
1e-1 23491 |
1e-2 24163 |
1e-3 24948 |
1e-5 26847 |
1e-7 1.3e5 |
#succ 12/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1.4e4 (2e4) | 3585 (8961) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 37 (37) | 260 (204) | 273 (351) | 266 (418) | 257 (176) | 239 (473) | 48 (95) | 13/15 |
| BIPOPsaACM loshchilov noiseless | 7.7 (7) | 100 (327) | 178 (147) | 179 (329) | 173 (313) | 168 (177) | 35 (17) | 15/15 |
| CMAES posik noiseless | 3.8 (11) | 42 (56) | 142 (122) | 138 (71) | 133 (189) | 124 (149) | 25 (25) | 4/15 |
| CMA brockhoff noiseless | 12 (6) | 433 (355) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| CMAa brockhoff noiseless | 10 (26) | 232 (248) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| CMAm brockhoff noiseless | 7.0 (12) | 188 (260) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| CMAma brockhoff noiseless | 6.7 (12) | 235 (567) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| CMAmah brockhoff noiseless | 187 (29) | 185 (350) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| CMAmh brockhoff noiseless | 6.9 (5) | 314 (408) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DBRCGA chuang noiseless | 100 (184) | 259 (447) | 392 (399) | 383 (739) | 372 (219) | 350 (290) | 70 (146) | 3/15 |
| DE-AUTO voglis noiseless | 128 (0.0) | 234 (491) | 281 (150) | 274 (408) | 265 (341) | 246 (217) | 216 (256) | 0/15 |
| DE-BFGS voglis noiseless | 5.7 (13) | 135 (233) | 151 (195) | 146 (38) | 142 (51) | 132 (131) | ∞2e6 | 0/15 |
| DE-ROLL voglis noiseless | 68 (156) | 199 (179) | 396 (149) | 385 (274) | 374 (373) | 348 (429) | 221 (186) | 0/15 |
| DE-SIMPLEX voglis noiseless | 38 (44) | 338 (294) | 1194 (1236) | 1161 (2403) | 1125 (963) | 1046 (1752) | 208 (264) | 0/15 |
| DEAE posik noiseless | 50 (62) | 123 (184) | 616 (468) | 599 (879) | 580 (631) | 539 (1043) | 107 (93) | 1/15 |
| DE posik noiseless | 23 (68) | 92 (76) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEb posik noiseless | 23 (35) | 92 (92) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEctpb posik noiseless | 98 (7) | 282 (228) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| IPOPsaACM loshchilov noiseless | 175 (591) | 978 (2689) | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| JADE posik noiseless | 25 (44) | 261 (432) | 638 (479) | 620 (414) | 601 (1102) | 559 (801) | ∞1e6 | 0/15 |
| JADEb posik noiseless | 46 (80) | 75 (48) | 143 (169) | 139 (176) | 135 (87) | 126 (137) | 25 (12) | 4/15 |
| JADEctpb posik noiseless | 25 (44) | 261 (362) | 638 (745) | 620 (455) | 601 (1092) | 559 (559) | ∞1e6 | 0/15 |
| MVDE melo noiseless | 40 (10) | 397 (482) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 32 (72) | 17 (14) | 51 (90) | 49 (79) | 48 (52) | 44 (69) | 8.8 (16) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 42 (26) | 319 (511) | 861 (879) | 837 (760) | 811 (1152) | 754 (636) | 150 (203) | 9/15 |
| PSO-BFGS voglis noiseless | 1.7 (2) | 3.0 (3) | 10 (19) | 9.3 (25) | 9.0 (5) | 8.6 (9) | 209 (301) | 0/15 |
| SNES schaul noiseless | 205 (254) | 227 (495) | 312 (364) | 303 (237) | 294 (262) | 317 (474) | 111 (51) | 4/15 |
| xNES schaul noiseless | 104 (86) | 231 (308) | 168 (120) | 163 (131) | 158 (153) | 147 (201) | 29 (34) | 12/15 |
| xNESas schaul noiseless | 50 (64) | 132 (185) | 226 (173) | 220 (269) | 213 (156) | 198 (256) | 39 (25) | 22/30 |
| Δ fopt f23, 20-D |
1e1 3.0 |
1e0 1614 |
1e-1 67457 |
1e-2 3.7e5 |
1e-3 4.9e5 |
1e-5 8.1e5 |
1e-7 8.4e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1.9 (1) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 5.0 (6) | 43 (27) | 1.2 (1) | 1.2 (2) | 1.4 (0.5) | 0.85 (1.0) | 0.90 (0.9) | 15/15 |
| BIPOPsaACM loshchilov noiseless | 3.2 (6) | 21 (11) | 0.61 (0.4) | 1.1 (0.3) | 1.4 (0.4) | 1.3 (1) | 1.3 (1) | 15/15 |
| CMAES posik noiseless | 3.1 (4) | 571 (464) | 63 (52) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| CMA brockhoff noiseless | 3.6 (3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| CMAa brockhoff noiseless | 6.9 (4) | 1.1e4 (2e4) | 556 (510) | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| CMAm brockhoff noiseless | 4.2 (7) | 1.1e4 (1e4) | 577 (580) | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| CMAma brockhoff noiseless | 2.6 (3) | 1.1e4 (7788) | 255 (305) | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| CMAmah brockhoff noiseless | 3.1 (4) | 4163 (4899) | 515 (702) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMAmh brockhoff noiseless | 3.0 (3) | 4205 (5048) | 519 (539) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DBRCGA chuang noiseless | 1.9 (3) | 415 (520) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-AUTO voglis noiseless | 2.4 (3) | 3.8 (2) | 36 (32) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-BFGS voglis noiseless | 2.3 (4) | 7.0 (7) | 54 (41) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-ROLL voglis noiseless | 2.0 (0.9) | 15 (12) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 1.8 (1) | 1.3 (0.8)★2 | 36 (73) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEAE posik noiseless | 1.9 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE posik noiseless | 2.5 (3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEb posik noiseless | 2.5 (0.8) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEctpb posik noiseless | 1.2 (0.6) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| IPOPsaACM loshchilov noiseless | 4.6 (4) | 2.9e4 (6e4) | 906 (1334) | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| JADE posik noiseless | 2.2 (2) | 131 (60) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| JADEb posik noiseless | 1.5 (1) | 673 (125) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| JADEctpb posik noiseless | 2.2 (2) | 131 (44) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| MVDE melo noiseless | 2.4 (3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 3.3 (2) | 28 (22) | 0.86 (0.6) | 1.7 (0.4) | 1.4 (0.8) | 0.89 (0.3) | 0.90 (0.4) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 4.0 (3) | 142 (31) | 3.9 (2) | 0.85 (0.4) | 0.72 (0.2) | 0.48 (0.3) | 0.50 (0.3) | 15/15 |
| PSO-BFGS voglis noiseless | 1.7 (3) | 4.7 (6) | 66 (89) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SNES schaul noiseless | 1.6 (0.8) | 102 (98) | 261 (198) | ∞ | ∞ | ∞ | ∞7e6 | 0/15 |
| xNES schaul noiseless | 2.1 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6e6 | 0/15 |
| xNESas schaul noiseless | 1.6 (1) | 9.9e4 (2e5) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/30 |
| Δ fopt f24, 20-D |
1e1 1.3e6 |
1e0 7.5e6 |
1e-1 5.2e7 |
1e-2 5.2e7 |
1e-3 5.2e7 |
1e-5 5.2e7 |
1e-7 5.2e7 |
#succ 3/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 1.00 (1) | 0.94 (0.9) | 2.8 (2) | 2.8 (4) | 2.8 (4) | 2.8 (3) | 2.8 (3) | 2/15 |
| BIPOPsaACM loshchilov noiseless | 0.99 (2) | 0.88 (0.4) | 0.80 (1.0) | 0.80 (0.6) | 0.80 (0.6) | 0.80 (1) | 0.79 (0.6) | 6/15 |
| CMAES posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| CMA brockhoff noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| CMAa brockhoff noiseless | 42 (22) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| CMAm brockhoff noiseless | 12 (22) | 3.6 (3) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| CMAma brockhoff noiseless | 19 (20) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| CMAmah brockhoff noiseless | 42 (35) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| CMAmh brockhoff noiseless | 42 (85) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DBRCGA chuang noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-AUTO voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-BFGS voglis noiseless | 4.3 (5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-ROLL voglis noiseless | 4.7 (7) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 22 (18) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEAE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DEctpb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| IPOPsaACM loshchilov noiseless | 28 (22) | 38 (42) | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| JADE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| JADEb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| JADEctpb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| MVDE melo noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 1.3 (0.8) | 0.35 (0.2) | 0.61 (0.5) | 0.61 (0.3) | 0.61 (1.0) | 0.61 (0.6) | 0.61 (0.8) | 7/15 |
| NIPOPaCMA loshchilov noiseless | 1.6 (2) | 0.42 (0.3) | 0.35 (0.3) | 0.35 (0.5) | 0.35 (0.6) | 0.35 (0.3) | 0.35 (0.3) | 11/15 |
| PSO-BFGS voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SNES schaul noiseless | 12 (15) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e6 | 0/15 |
| xNES schaul noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6e6 | 0/15 |
| xNESas schaul noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/30 |
Previous dimension | Dimension = 40 | First dimension
| Δ fopt f1, 40-D |
1e1 83 |
1e0 83 |
1e-1 83 |
1e-2 83 |
1e-3 83 |
1e-5 83 |
1e-7 83 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 53 (12) | 83 (12) | 114 (19) | 146 (23) | 177 (12) | 235 (33) | 296 (28) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 9.4 (2) | 15 (1) | 21 (0.6) | 27 (2) | 33 (2) | 45 (3) | 58 (2) | 15/15 |
| CMAES posik noiseless | 9.4 (0.7) | 15 (1.0) | 21 (0.9) | 27 (1) | 33 (2) | 45 (0.9) | 57 (0.9) | 15/15 |
| CMA brockhoff noiseless | 10 (1) | 15 (1) | 21 (1) | 27 (1) | 33 (2) | 45 (1) | 57 (2) | 15/15 |
| CMAa brockhoff noiseless | 9.3 (0.6) | 15 (1) | 21 (1.0) | 27 (1) | 34 (1) | 46 (0.7) | 58 (2) | 15/15 |
| CMAm brockhoff noiseless | 7.1 (0.7) | 11 (0.8) | 16 (0.8) | 20 (1) | 24 (0.5) | 32 (1) | 41 (2) | 15/15 |
| CMAma brockhoff noiseless | 7.3 (0.7) | 11 (0.5) | 16 (0.9) | 20 (1) | 24 (1) | 33 (1) | 41 (0.9) | 15/15 |
| CMAmah brockhoff noiseless | 4.6 (0.5) | 7.3 (0.3) | 10 (0.6) | 13 (0.6) | 16 (0.7) | 21 (0.9) | 27 (1) | 15/15 |
| CMAmh brockhoff noiseless | 4.5 (0.4) | 7.4 (0.8) | 10 (0.4) | 13 (0.9) | 16 (0.5) | 21 (1) | 27 (1) | 15/15 |
| DBRCGA chuang noiseless | 229 (75) | 420 (36) | 625 (75) | 842 (67) | 1006 (44) | 1386 (33) | 1798 (143) | 15/15 |
| DE-AUTO voglis noiseless | 2.6 (0.1) | 2.6 (0.1) | 2.6 (0.1) | 2.6 (0.1) | 2.6 (0.1) | 2.6 (0.1) | 2.6 (0.1) | 15/15 |
| DE-BFGS voglis noiseless | 1.5 (0.1) | 1.6 (0) | 1.6 (0) | 1.6 (0) | 1.6 (0) | 1.6 (0) | 1.6 (0.1) | 15/15 |
| DE-ROLL voglis noiseless | 18 (14) | 53 (54) | 54 (61) | 54 (63) | 54 (54) | 54 (46) | 54 (64) | 15/15 |
| DE-SIMPLEX voglis noiseless | 152 (46) | 242 (73) | 319 (108) | 371 (97) | 431 (97) | 547 (90) | 1381 (597) | 15/15 |
| DEAE posik noiseless | 228 (19) | 378 (52) | 525 (36) | 686 (59) | 848 (61) | 1167 (90) | 1490 (59) | 15/15 |
| DE posik noiseless | 253 (27) | 425 (37) | 600 (55) | 775 (55) | 946 (54) | 1282 (79) | 1623 (96) | 15/15 |
| DEb posik noiseless | 253 (17) | 425 (24) | 600 (59) | 775 (64) | 946 (55) | 1282 (81) | 1623 (89) | 15/15 |
| DEctpb posik noiseless | 259 (20) | 448 (31) | 632 (30) | 825 (59) | 1013 (39) | 1401 (82) | 1777 (68) | 15/15 |
| JADE posik noiseless | 94 (5) | 152 (9) | 211 (7) | 267 (6) | 326 (6) | 439 (10) | 553 (5) | 15/15 |
| JADEb posik noiseless | 72 (9) | 127 (6) | 182 (9) | 239 (17) | 295 (7) | 410 (17) | 524 (10) | 15/15 |
| JADEctpb posik noiseless | 94 (5) | 152 (8) | 211 (7) | 267 (7) | 326 (9) | 439 (8) | 553 (20) | 15/15 |
| MVDE melo noiseless | 329 (20) | 568 (23) | 815 (11) | 1058 (10) | 1301 (13) | 1792 (15) | 2277 (30) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 9.5 (0.8) | 15 (0.7) | 22 (0.8) | 28 (0.8) | 34 (0.5) | 46 (1) | 58 (1) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 10 (0.9) | 15 (1) | 21 (0.7) | 28 (0.9) | 34 (2) | 46 (1) | 58 (2) | 15/15 |
| PSO-BFGS voglis noiseless | 1.4 (0.2) | 1.6 (0) | 1.6 (0) | 1.6 (0) | 1.6 (0) | 1.6 (0) | 1.6 (0) | 15/15 |
| SNES schaul noiseless | 8.9 (0.9) | 20 (1) | 32 (2) | 43 (1) | 55 (2) | 78 (2) | 101 (2) | 15/15 |
| xNES schaul noiseless | 63 (7) | 215 (7) | 370 (10) | 522 (14) | 672 (7) | 979 (5) | 1282 (16) | 15/15 |
| xNESas schaul noiseless | 43 (18) | 83 (46) | 106 (75) | 125 (29) | 140 (32) | 161 (100) | 182 (121) | 30/30 |
| Δ fopt f2, 40-D |
1e1 796 |
1e0 797 |
1e-1 799 |
1e-2 799 |
1e-3 800 |
1e-5 802 |
1e-7 804 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 17 (2) | 20 (3) | 23 (3) | 26 (3) | 30 (3) | 36 (4) | 43 (3) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 38 (5) | 45 (5) | 49 (3) | 52 (4) | 55 (3) | 57 (2) | 59 (1) | 15/15 |
| CMAES posik noiseless | 59 (3) | 69 (4) | 77 (3) | 82 (5) | 86 (2) | 89 (0.8) | 90 (1) | 15/15 |
| CMA brockhoff noiseless | 59 (3) | 69 (8) | 76 (7) | 81 (5) | 85 (5) | 89 (1) | 90 (3) | 15/15 |
| CMAa brockhoff noiseless | 38 (2) | 44 (3) | 48 (4) | 53 (4) | 55 (2) | 57 (2) | 59 (2) | 15/15 |
| CMAm brockhoff noiseless | 59 (4) | 69 (3) | 74 (3) | 79 (4) | 83 (4) | 85 (4) | 88 (1) | 15/15 |
| CMAma brockhoff noiseless | 36 (5) | 41 (4) | 46 (4) | 49 (4) | 51 (3) | 54 (3) | 55 (2) | 15/15 |
| CMAmah brockhoff noiseless | 35 (3) | 42 (5) | 47 (4) | 51 (5) | 52 (3) | 55 (4) | 56 (1.0) | 15/15 |
| CMAmh brockhoff noiseless | 49 (8) | 58 (5) | 64 (4) | 68 (4) | 71 (3) | 73 (1) | 74 (1) | 15/15 |
| DBRCGA chuang noiseless | 95 (13) | 113 (8) | 138 (16) | 153 (3) | 179 (8) | 216 (10) | 264 (15) | 15/15 |
| DE-AUTO voglis noiseless | 1.9 (0.7)★3 | 2.1 (0.8)★3 | 2.3 (0.1)★2 | 2.4 (0.8)★2 | 2.5 (0.8)★2 | 3.3 (0.6)★2 | 3.8 (0.4)★3 | 15/15 |
| DE-BFGS voglis noiseless | 35 (7) | 46 (12) | 55 (14) | 63 (15) | 71 (16) | 90 (17) | 1295 (4058) | 3/15 |
| DE-ROLL voglis noiseless | 20 (32) | 21 (45) | 21 (15) | 21 (14) | 21 (17) | 22 (15) | 26 (28) | 15/15 |
| DE-SIMPLEX voglis noiseless | 91 (14) | 102 (13) | 109 (18) | 115 (23) | 122 (15) | 134 (22) | 7.4e4 (7e4) | 0/15 |
| DEAE posik noiseless | 191 (13) | 218 (17) | 236 (13) | 253 (11) | 270 (12) | 303 (17) | 336 (16) | 15/15 |
| DE posik noiseless | 92 (8) | 110 (5) | 129 (8) | 147 (9) | 166 (10) | 201 (11) | 237 (9) | 15/15 |
| DEb posik noiseless | 92 (11) | 110 (8) | 129 (9) | 147 (10) | 166 (7) | 201 (11) | 237 (12) | 15/15 |
| DEctpb posik noiseless | 104 (4) | 124 (4) | 143 (5) | 163 (12) | 182 (17) | 221 (10) | 259 (7) | 15/15 |
| JADE posik noiseless | 37 (1) | 43 (1) | 49 (2) | 55 (2) | 61 (2) | 73 (3) | 84 (2) | 15/15 |
| JADEb posik noiseless | 32 (2) | 38 (2) | 44 (2) | 50 (2) | 56 (2) | 68 (2) | 80 (3) | 15/15 |
| JADEctpb posik noiseless | 37 (1) | 43 (1) | 49 (2) | 55 (2) | 61 (2) | 73 (2) | 84 (2) | 15/15 |
| MVDE melo noiseless | 124 (2) | 149 (1) | 174 (2) | 199 (3) | 225 (4) | 275 (3) | 325 (3) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 37 (3) | 43 (4) | 47 (4) | 51 (3) | 53 (4) | 57 (2) | 59 (2) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 37 (3) | 43 (4) | 48 (4) | 51 (3) | 53 (2) | 57 (2) | 58 (0.9) | 15/15 |
| PSO-BFGS voglis noiseless | 86 (12) | 101 (11) | 115 (19) | 132 (20) | 156 (29) | 188 (18) | 2187 (1086) | 3/15 |
| SNES schaul noiseless | 5.3 (0.2) | 6.4 (0.1) | 7.6 (0.3) | 8.8 (0.3) | 10 (0.3) | 12 (0.2) | 15 (0.2) | 15/15 |
| xNES schaul noiseless | 64 (1) | 80 (0.7) | 96 (1) | 112 (1) | 127 (0.7) | 159 (0.9) | 191 (1) | 15/15 |
| xNESas schaul noiseless | 60 (1) | 71 (10) | 79 (11) | 85 (14) | 90 (16) | 97 (19) | 100 (19) | 30/30 |
| Δ fopt f3, 40-D |
1e1 15526 |
1e0 15602 |
1e-1 15612 |
1e-2 15641 |
1e-3 15646 |
1e-5 15651 |
1e-7 15656 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 2395 (3576) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| CMAES posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA brockhoff noiseless | 5301 (3065) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6e6 | 0/15 |
| CMAa brockhoff noiseless | 5158 (6786) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6e6 | 0/15 |
| CMAm brockhoff noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6e6 | 0/15 |
| CMAma brockhoff noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6e6 | 0/15 |
| CMAmah brockhoff noiseless | 4723 (4971) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| CMAmh brockhoff noiseless | 2268 (1383) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| DBRCGA chuang noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-AUTO voglis noiseless | 886 (467) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-BFGS voglis noiseless | 486 (540) | 3823 (6992) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-ROLL voglis noiseless | 110 (52) | 1847 (2181) | 3774 (5449) | 3767 (2815) | 3766 (1e4) | 3764 (3006) | 3763 (6968) | 1/15 |
| DE-SIMPLEX voglis noiseless | 282 (38) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DEAE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEctpb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADE posik noiseless | 10 (0.5) | 13 (0.2) | 15 (0.2) | 16 (0.1) | 17 (0.2) | 20 (0.1) | 22 (0.2) | 15/15 |
| JADEb posik noiseless | 13 (26) | 44 (46) | 114 (97) | 115 (173) | 116 (199) | 119 (70) | 121 (122) | 10/15 |
| JADEctpb posik noiseless | 10 (0.4) | 13 (0.2) | 15 (0.2) | 16 (0.2) | 17 (0.2) | 20 (0.2) | 22 (0.2) | 15/15 |
| MVDE melo noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 8178 (1e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| NIPOPaCMA loshchilov noiseless | 4615 (2e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| PSO-BFGS voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| SNES schaul noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| xNES schaul noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| xNESas schaul noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/20 |
| Δ fopt f4, 40-D |
1e1 15536 |
1e0 15601 |
1e-1 15659 |
1e-2 15678 |
1e-3 15703 |
1e-5 15733 |
1e-7 2.8e5 |
#succ 6/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| CMAES posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA brockhoff noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6e6 | 0/15 |
| CMAa brockhoff noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| CMAm brockhoff noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6e6 | 0/15 |
| CMAma brockhoff noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6e6 | 0/15 |
| CMAmah brockhoff noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| CMAmh brockhoff noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| DBRCGA chuang noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-AUTO voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-BFGS voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-ROLL voglis noiseless | 464 (272) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DEAE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEctpb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADE posik noiseless | 12 (0.5) | 16 (0.1) | 18 (0.3) | 19 (0.2) | 21 (0.3) | 24 (0.2) | 1.5 (0.0) | 15/15 |
| JADEb posik noiseless | 605 (569) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADEctpb posik noiseless | 12 (0.2) | 16 (0.4) | 18 (0.2) | 19 (0.1) | 21 (0.2) | 24 (0.2) | 1.5 (8e-3) | 15/15 |
| MVDE melo noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| NIPOPaCMA loshchilov noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| PSO-BFGS voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| SNES schaul noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| xNES schaul noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| xNESas schaul noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Δ fopt f5, 40-D |
1e1 98 |
1e0 116 |
1e-1 120 |
1e-2 121 |
1e-3 121 |
1e-5 121 |
1e-7 121 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 11 (1) | 12 (2) | 12 (2) | 12 (2) | 12 (2) | 12 (3) | 12 (3) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 4.7 (0.7) | 4.4 (0.8) | 4.4 (0.7) | 4.4 (0.6) | 4.4 (0.5) | 4.4 (0.5) | 4.4 (0.3) | 15/15 |
| CMAES posik noiseless | 4.5 (1) | 4.5 (0.5) | 4.5 (0.4) | 4.5 (0.4) | 4.5 (0.6) | 4.5 (0.5) | 4.5 (0.5) | 15/15 |
| CMA brockhoff noiseless | 4.5 (0.4) | 4.3 (0.6) | 4.3 (0.4) | 4.2 (0.5) | 4.2 (0.6) | 4.2 (0.5) | 4.2 (0.5) | 15/15 |
| CMAa brockhoff noiseless | 4.7 (1) | 4.6 (0.5) | 4.5 (1.0) | 4.5 (0.9) | 4.5 (0.8) | 4.5 (0.6) | 4.5 (0.8) | 15/15 |
| CMAm brockhoff noiseless | 4.3 (0.5) | 4.2 (0.4) | 4.0 (0.3) | 4.0 (0.2) | 4.0 (0.3) | 4.0 (0.3) | 4.0 (0.3) | 15/15 |
| CMAma brockhoff noiseless | 4.0 (0.8) | 4.1 (0.5) | 4.0 (0.5) | 4.0 (0.6) | 4.0 (0.4) | 4.0 (0.5) | 4.0 (0.5) | 15/15 |
| CMAmah brockhoff noiseless | 2.7 (0.4) | 2.7 (0.4) | 2.7 (0.6) | 2.7 (0.5) | 2.7 (0.5) | 2.7 (0.5) | 2.7 (0.3) | 15/15 |
| CMAmh brockhoff noiseless | 2.8 (0.5) | 2.8 (0.6) | 2.7 (0.6) | 2.7 (0.4) | 2.7 (0.5) | 2.7 (0.6) | 2.7 (0.6) | 15/15 |
| DBRCGA chuang noiseless | 184 (45) | 208 (69) | 244 (85) | 273 (138) | 299 (195) | 342 (249) | 378 (298) | 15/15 |
| DE-AUTO voglis noiseless | 2.1 (0.1) | 1.8 (0.1) | 1.7 (0.1) | 1.7 (0.1) | 1.7 (0.1) | 1.7 (0.0) | 1.7 (0.0) | 15/15 |
| DE-BFGS voglis noiseless | 49 (46) | 52 (36) | 53 (38) | 53 (19) | 53 (43) | 56 (27) | 56 (38) | 15/15 |
| DE-ROLL voglis noiseless | 8.3 (13) | 7.1 (6) | 7.0 (7) | 7.1 (5) | 7.5 (6) | 8.1 (8) | 8.8 (10) | 15/15 |
| DE-SIMPLEX voglis noiseless | 841 (196) | 1330 (788) | 4385 (1579) | 4878 (2135) | 5458 (1953) | 6146 (1153) | 1.1e5 (8e4) | 2/15 |
| DEAE posik noiseless | 50 (26) | 47 (20) | 45 (15) | 45 (19) | 45 (17) | 45 (24) | 45 (13) | 15/15 |
| DE posik noiseless | 43 (7) | 46 (9) | 45 (3) | 45 (13) | 45 (5) | 45 (13) | 45 (8) | 15/15 |
| DEb posik noiseless | 43 (7) | 46 (9) | 45 (13) | 45 (9) | 45 (8) | 45 (13) | 45 (6) | 15/15 |
| DEctpb posik noiseless | 59 (9) | 57 (5) | 56 (8) | 56 (10) | 56 (9) | 56 (10) | 56 (8) | 15/15 |
| JADE posik noiseless | 62 (6) | 62 (6) | 62 (3) | 62 (3) | 62 (4) | 62 (5) | 62 (6) | 15/15 |
| JADEb posik noiseless | 39 (3) | 39 (6) | 40 (4) | 40 (5) | 40 (6) | 40 (5) | 40 (4) | 15/15 |
| JADEctpb posik noiseless | 62 (6) | 62 (9) | 62 (7) | 62 (4) | 62 (4) | 62 (6) | 62 (8) | 15/15 |
| MVDE melo noiseless | 336 (12) | 415 (21) | 524 (24) | 635 (34) | 750 (27) | 977 (39) | 1202 (55) | 15/15 |
| NBIPOPaCMA loshchilov noiseless | 4.6 (0.9) | 4.5 (0.7) | 4.4 (0.7) | 4.4 (1) | 4.4 (1) | 4.4 (0.7) | 4.4 (0.9) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 4.9 (0.8) | 4.6 (0.6) | 4.5 (0.8) | 4.4 (0.4) | 4.4 (0.5) | 4.4 (0.7) | 4.4 (0.8) | 15/15 |
| PSO-BFGS voglis noiseless | 77 (91) | 94 (98) | 93 (67) | 102 (88) | 103 (48) | 103 (74) | 106 (65) | 15/15 |
| SNES schaul noiseless | 8.0 (1) | 7.7 (1) | 7.6 (0.9) | 7.6 (1) | 7.6 (1) | 7.6 (1) | 7.6 (0.7) | 15/15 |
| xNES schaul noiseless | 7.5 (0.7) | 7.2 (1) | 7.1 (0.2) | 7.1 (0.6) | 7.1 (0.2) | 7.1 (0.5) | 7.1 (0.8) | 15/15 |
| xNESas schaul noiseless | 7.3 (1) | 7.0 (0.7) | 6.9 (1.0) | 6.9 (0.6) | 6.9 (0.6) | 6.9 (1) | 6.9 (0.8) | 15/15 |
| Δ fopt f6, 40-D |
1e1 3507 |
1e0 5523 |
1e-1 7168 |
1e-2 9470 |
1e-3 11538 |
1e-5 15007 |
1e-7 19222 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 14 (2) | 13 (2) | 13 (2) | 12 (1) | 12 (2) | 12 (2) | 12 (1) | 15/15 |
| BIPOPaCMA loshchilov noiseless | 1.6 (0.3) | 1.5 (0.2) | 1.4 (0.2) | 1.3 (0.2) | 1.3 (0.2) | 1.3 (0.2) | 1.3 (0.1) | 15/15 |
| CMAES posik noiseless | 1.6 (0.2) | 1.5 (0.2) | 1.5 (0.2) | 1.4 (0.1) | 1.3 (0.1) | 1.4 (0.1) | 1.4 (0.1) | 15/15 |
| CMA brockhoff noiseless | 1.6 (0.3) | 1.4 (0.2) | 1.4 (0.2) | 1.3 (0.1) | 1.3 (0.1) | 1.4 (0.1) | 1.3 (0.1) | 15/15 |
| CMAa brockhoff noiseless | 1.6 (0.2) | 1.4 (0.1) | 1.4 (0.1) | 1.3 (0.2) | 1.3 (0.1) | 1.3 (0.1) | 1.3 (0.1) | 15/15 |
| CMAm brockhoff noiseless | 1.5 (0.2) | 1.3 (0.2) | 1.3 (0.1) | 1.3 (0.2) | 1.3 (0.2) | 1.3 (0.1) | 1.3 (0.1) | 15/15 |
| CMAma brockhoff noiseless | 1.5 (0.2) | 1.3 (0.2) | 1.3 (0.1) | 1.2 (0.1) | 1.2 (0.1) | 1.2 (0.1) | 1.2 (0.0) | 15/15 |
| CMAmah brockhoff noiseless | 1.2 (0.3) | 1.2 (0.2) | 1.3 (0.3) | 1.3 (0.2) | 1.3 (0.3) | 1.5 (0.3) | 1.6 (0.1) | 15/15 |
| CMAmh brockhoff noiseless | 1.4 (0.2) | 1.4 (0.2) | 1.5 (0.3) | 1.5 (0.1) | 1.6 (0.2) | 1.9 (0.3) | 2.2 (0.6) | 15/15 |
| DBRCGA chuang noiseless | 44 (18) | 55 (26) | 63 (28) | 67 (39) | 72 (12) | 79 (24) | 79 (9) | 15/15 |
| DE-AUTO voglis noiseless | 6.5 (3) | 8.9 (2) | 13 (3) | 14 (4) | 22 (5) | 37 (19) | 479 (580) | 0/15 |
| DE-BFGS voglis noiseless | 62 (56) | 84 (108) | 316 (267) | 404 (214) | 341 (608) | 278 (537) | ∞4e6 | 0/15 |
| DE-ROLL voglis noiseless | 17 (9) | 25 (8) | 51 (21) | 136 (206) | 348 (222) | ∞ | ∞4e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 36 (8) | 43 (8) | 52 (22) | 143 (40) | 424 (382) | ∞ | ∞4e6 | 0/15 |
| DEAE posik noiseless | 75 (9) | 67 (6) | 67 (4) | 62 (5) | 61 (4) | 61 (2) | 75 (56) | 10/15 |
| DE posik noiseless | 264 (55) | 258 (51) | 433 (282) | 3153 (3960) | ∞ | ∞ | ∞2e6 | 0/15 |
| DEb posik noiseless | 264 (49) | 258 (32) | 433 (558) | 3153 (3010) | ∞ | ∞ | ∞2e6 | 0/15 |
| DEctpb posik noiseless | 80 (5) | 70 (4) | 68 (4) | 63 (2) | 61 (2) | 61 (2) | 178 (208) | 5/15 |
| JADE posik noiseless | 13 (0.5) | 13 (0.5) | 13 (0.6) | 13 (2) | 12 (0.7) | 12 (1) | 12 (1) | 15/15 |
| JADEb posik noiseless | 456 (250) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADEctpb posik noiseless | 13 (0.6) | 13 (0.8) | 13 (0.5) | 13 (1) | 12 (1) | 12 (0.8) | 12 (0.9) | 15/15 |
| MVDE melo noiseless | 70 (6) | 67 (11) | 70 (6) | 68 (7) | 69 (5) | 498 (385) | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 1.5 (0.2) | 1.4 (0.2) | 1.3 (0.2) | 1.2 (0.1) | 1.2 (0.1) | 1.2 (0.1) | 1.2 (0.1) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 1.6 (0.2) | 1.4 (0.2) | 1.4 (0.1) | 1.3 (0.2) | 1.3 (0.2) | 1.3 (0.1) | 1.2 (0.1) | 15/15 |
| PSO-BFGS voglis noiseless | 406 (492) | 297 (544) | 234 (502) | 393 (318) | 330 (186) | 274 (341) | ∞4e6 | 0/15 |
| SNES schaul noiseless | 1.4 (0.3) | 1.4 (0.4) | 1.7 (0.2) | 34 (0.4) | 94 (2) | 218 (364) | 890 (1464) | 6/15 |
| xNES schaul noiseless | 12 (0.3) | 12 (0.1) | 12 (0.2) | 12 (0.2) | 12 (0.2) | 13 (0.1) | 12 (0.1) | 15/15 |
| xNESas schaul noiseless | 12 (0.5) | 12 (0.2) | 13 (0.2) | 12 (0.1) | 12 (0.2) | 12 (0.1) | 12 (0.1) | 15/15 |
| Δ fopt f7, 40-D |
1e1 10698 |
1e0 17839 |
1e-1 41037 |
1e-2 66294 |
1e-3 66294 |
1e-5 66294 |
1e-7 68145 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1204 (783) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 1.2 (0.9) | 4.5 (2) | 2.4 (1) | 1.5 (0.7) | 1.5 (0.5) | 1.5 (0.6) | 1.5 (0.6) | 15/15 |
| CMAES posik noiseless | 8.5 (10) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA brockhoff noiseless | 1.6 (0.8) | 4.7 (2) | 2.6 (1) | 1.7 (0.7) | 1.7 (0.4) | 1.7 (0.5) | 1.6 (1.0) | 15/15 |
| CMAa brockhoff noiseless | 1.2 (0.6) | 3.2 (1) | 1.6 (0.6) | 1.0 (0.4) | 1.0 (0.4) | 1.0 (0.3) | 1.0 (0.3) | 15/15 |
| CMAm brockhoff noiseless | 1.5 (0.7) | 4.8 (0.8) | 2.4 (0.1) | 1.6 (0.1) | 1.6 (0.1) | 1.6 (0.1) | 1.5 (0.1) | 15/15 |
| CMAma brockhoff noiseless | 1.1 (0.6) | 2.8 (0.7) | 1.5 (0.1) | 0.95 (0.3) | 0.95 (0.3) | 0.95 (0.3) | 0.93 (0.3) | 15/15 |
| CMAmah brockhoff noiseless | 1.7 (0.8) | 3.3 (1) | 1.7 (0.5) | 1.1 (0.4) | 1.1 (0.4) | 1.1 (0.3) | 1.1 (0.3) | 15/15 |
| CMAmh brockhoff noiseless | 2.0 (0.3) | 5.2 (0.3) | 2.5 (0.5) | 1.6 (0.1) | 1.6 (0.1) | 1.6 (0.3) | 1.6 (0.5) | 15/15 |
| DBRCGA chuang noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-AUTO voglis noiseless | 211 (192) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-BFGS voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-ROLL voglis noiseless | 287 (345) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DEAE posik noiseless | 4.5 (0.6) | 104 (86) | 137 (62) | 87 (61) | 87 (68) | 87 (76) | 84 (146) | 4/15 |
| DE posik noiseless | 37 (15) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEb posik noiseless | 37 (15) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEctpb posik noiseless | 30 (6) | 198 (233) | 341 (461) | 215 (167) | 215 (154) | 215 (300) | 210 (147) | 2/15 |
| JADE posik noiseless | 219 (285) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADEb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADEctpb posik noiseless | 219 (331) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| MVDE melo noiseless | 29 (6) | 825 (870) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 1.2 (1.0) | 3.2 (0.7) | 1.8 (0.5) | 1.2 (0.3) | 1.2 (0.3) | 1.2 (0.1) | 1.1 (0.3) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 0.89 (0.9) | 3.2 (1.0) | 1.9 (0.5) | 1.2 (0.3) | 1.2 (0.2) | 1.2 (0.2) | 1.2 (0.3) | 15/15 |
| PSO-BFGS voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| SNES schaul noiseless | 43 (22) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| xNES schaul noiseless | 1.7 (0.1) | 2.0 (0.0) | 1.3 (0.1) | 1.1 (0.0) | 1.1 (0.0) | 1.1 (0.0) | 1.1 (0.1) | 15/15 |
| xNESas schaul noiseless | 1.7 (0.1) | 2.0 (0.0) | 1.3 (0.1) | 1.2 (0.0) | 1.2 (0.1) | 1.2 (0.0) | 1.1 (0.1) | 15/15 |
| Δ fopt f8, 40-D |
1e1 7080 |
1e0 10655 |
1e-1 11012 |
1e-2 11265 |
1e-3 11430 |
1e-5 11701 |
1e-7 11969 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 48 (28) | 382 (483) | 375 (681) | 375 (662) | 379 (887) | 389 (650) | 399 (438) | 11/15 |
| BIPOPaCMA loshchilov noiseless | 5.5 (0.7) | 6.1 (2) | 6.3 (4) | 6.3 (2) | 6.3 (0.2) | 6.2 (2) | 6.2 (3) | 15/15 |
| CMAES posik noiseless | 7.3 (1) | 6.6 (0.4) | 6.8 (0.2) | 6.8 (0.2) | 6.8 (0.5) | 6.8 (0.8) | 6.8 (0.5) | 15/15 |
| CMA brockhoff noiseless | 7.0 (0.6) | 6.4 (0.2) | 6.6 (0.3) | 6.6 (0.3) | 6.6 (0.2) | 6.6 (0.2) | 6.6 (0.3) | 15/15 |
| CMAa brockhoff noiseless | 5.4 (0.2) | 4.6 (0.2) | 4.8 (0.3) | 4.8 (0.8) | 4.8 (0.3) | 4.8 (0.2) | 4.8 (0.1) | 15/15 |
| CMAm brockhoff noiseless | 7.1 (0.9) | 7.5 (5) | 7.6 (5) | 7.6 (3) | 7.6 (2) | 7.6 (5) | 7.6 (1) | 15/15 |
| CMAma brockhoff noiseless | 5.1 (0.2) | 4.9 (0.2) | 5.0 (0.4) | 5.0 (0.2) | 5.0 (0.2) | 5.0 (0.2) | 5.0 (0.3) | 15/15 |
| CMAmah brockhoff noiseless | 4.2 (0.4)★ | 4.3 (3) | 4.4 (2) | 4.4 (2) | 4.4 (0.5) | 4.4 (2) | 4.4 (3) | 15/15 |
| CMAmh brockhoff noiseless | 5.2 (1) | 5.2 (2) | 5.3 (3) | 5.3 (2) | 5.4 (2) | 5.4 (0.4) | 5.4 (2) | 15/15 |
| DBRCGA chuang noiseless | 73 (42) | 175 (32) | 181 (393) | 190 (158) | 199 (123) | 219 (196) | 280 (121) | 10/15 |
| DE-AUTO voglis noiseless | 11 (3) | 11 (2) | 11 (2) | 11 (3) | 12 (3) | 12 (2) | 37 (42) | 14/15 |
| DE-BFGS voglis noiseless | 10 (3) | 31 (64) | 30 (47) | 30 (0.9) | 30 (47) | 30 (36) | 31 (69) | 14/15 |
| DE-ROLL voglis noiseless | 31 (19) | 40 (46) | 43 (54) | 44 (13) | 45 (46) | 46 (15) | 159 (111) | 11/15 |
| DE-SIMPLEX voglis noiseless | 23 (15) | 65 (154) | 66 (24) | 66 (183) | 67 (176) | 69 (89) | ∞4e6 | 0/15 |
| DEAE posik noiseless | 57 (2) | 52 (2) | 53 (33) | 54 (17) | 54 (2) | 55 (17) | 56 (2) | 15/15 |
| DE posik noiseless | 172 (15) | 174 (5) | 200 (6) | 661 (799) | ∞ | ∞ | ∞2e6 | 0/15 |
| DEb posik noiseless | 172 (7) | 174 (52) | 200 (52) | 661 (710) | ∞ | ∞ | ∞2e6 | 0/15 |
| DEctpb posik noiseless | 148 (3) | 136 (3) | 143 (5) | 152 (5) | 160 (6) | 1277 (1367) | ∞2e6 | 0/15 |
| JADE posik noiseless | 32 (0.9) | 27 (0.8) | 28 (0.8) | 28 (0.7) | 28 (0.3) | 29 (1) | 30 (0.5) | 15/15 |
| JADEb posik noiseless | 22 (8) | 31 (21) | 31 (19) | 32 (20) | 32 (15) | 33 (20) | 35 (20) | 15/15 |
| JADEctpb posik noiseless | 32 (0.8) | 27 (1) | 28 (0.8) | 28 (1.0) | 28 (0.8) | 29 (0.9) | 30 (1) | 15/15 |
| MVDE melo noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 5.5 (0.3) | 6.5 (4) | 6.6 (2) | 6.6 (0.3) | 6.6 (3) | 6.6 (3) | 6.6 (3) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 5.5 (0.6) | 7.8 (9) | 7.9 (4) | 7.9 (8) | 7.8 (8) | 7.8 (8) | 7.8 (3) | 15/15 |
| PSO-BFGS voglis noiseless | 13 (2) | 42 (4) | 41 (5) | 41 (5) | 41 (263) | 41 (6) | 41 (8) | 14/15 |
| SNES schaul noiseless | 152 (109) | 202 (91) | 228 (102) | 360 (245) | 546 (407) | 3009 (3422) | 2.8e4 (3e4) | 0/15 |
| xNES schaul noiseless | 14 (1) | 12 (0.5) | 12 (0.8) | 13 (0.8) | 13 (0.6) | 14 (0.9) | 16 (0.6) | 15/15 |
| xNESas schaul noiseless | 14 (0.7) | 13 (1) | 13 (0.9) | 13 (2) | 14 (1) | 14 (0.9) | 15 (1) | 15/15 |
| Δ fopt f9, 40-D |
1e1 6122 |
1e0 12982 |
1e-1 13300 |
1e-2 13496 |
1e-3 13651 |
1e-5 13909 |
1e-7 14142 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 187 (22) | 254 (387) | 295 (212) | 359 (191) | 433 (79) | 589 (51) | 798 (22) | 5/15 |
| BIPOPaCMA loshchilov noiseless | 6.0 (0.7) | 4.5 (2) | 4.6 (2) | 4.7 (2) | 4.7 (1) | 4.7 (2) | 4.7 (2) | 15/15 |
| CMAES posik noiseless | 8.5 (0.9) | 5.8 (2) | 6.0 (0.4) | 6.0 (0.3) | 6.1 (0.3) | 6.1 (2) | 6.1 (2) | 15/15 |
| CMA brockhoff noiseless | 8.2 (1.0) | 6.2 (0.2) | 6.4 (0.2) | 6.5 (0.2) | 6.5 (4) | 6.5 (4) | 6.5 (4) | 15/15 |
| CMAa brockhoff noiseless | 6.3 (0.6) | 4.8 (0.2) | 5.0 (4) | 5.0 (0.1) | 5.0 (0.3) | 5.0 (0.2) | 5.0 (3) | 15/15 |
| CMAm brockhoff noiseless | 8.2 (0.8) | 6.3 (4) | 6.4 (4) | 6.5 (0.2) | 6.5 (2) | 6.5 (4) | 6.5 (4) | 15/15 |
| CMAma brockhoff noiseless | 5.8 (0.4) | 4.3 (3) | 4.4 (3) | 4.5 (3) | 4.5 (1) | 4.5 (3) | 4.5 (0.3) | 15/15 |
| CMAmah brockhoff noiseless | 4.7 (0.9) | 4.0 (2) | 4.2 (2) | 4.2 (2) | 4.2 (2) | 4.2 (2) | 4.2 (2) | 15/15 |
| CMAmh brockhoff noiseless | 6.1 (2) | 5.4 (4) | 5.5 (2) | 5.6 (4) | 5.6 (4) | 5.6 (4) | 5.6 (3) | 15/15 |
| DBRCGA chuang noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-AUTO voglis noiseless | 14 (4) | 11 (6) | 11 (2) | 12 (6) | 12 (3) | 13 (3) | 37 (25) | 11/15 |
| DE-BFGS voglis noiseless | 16 (6) | 19 (31) | 19 (30) | 20 (28) | 20 (27) | 20 (4) | 41 (75) | 13/15 |
| DE-ROLL voglis noiseless | 58 (11) | 43 (6) | 48 (7) | 50 (10) | 51 (9) | 68 (24) | 1255 (1396) | 0/15 |
| DE-SIMPLEX voglis noiseless | 78 (31) | 164 (165) | 166 (176) | 168 (245) | 170 (85) | 177 (164) | ∞4e6 | 0/15 |
| DEAE posik noiseless | 66 (4) | 43 (15) | 44 (1) | 45 (14) | 46 (1) | 47 (14) | 48 (14) | 15/15 |
| DE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEctpb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADE posik noiseless | 100 (6) | 60 (3) | 62 (2) | 63 (3) | 63 (2) | 64 (2) | 64 (3) | 15/15 |
| JADEb posik noiseless | 123 (10) | 146 (86) | 163 (87) | 250 (124) | 291 (154) | 525 (899) | 2114 (1838) | 0/15 |
| JADEctpb posik noiseless | 100 (6) | 60 (3) | 62 (3) | 63 (3) | 63 (3) | 64 (3) | 64 (3) | 15/15 |
| MVDE melo noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 6.3 (0.5) | 4.6 (3) | 4.8 (0.2) | 4.8 (2) | 4.8 (3) | 4.9 (1) | 4.9 (0.2) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 6.3 (0.8) | 5.0 (3) | 5.1 (3) | 5.2 (3) | 5.2 (2) | 5.2 (3) | 5.2 (3) | 15/15 |
| PSO-BFGS voglis noiseless | 19 (17) | 20 (26) | 21 (19) | 21 (23) | 22 (9) | 22 (10) | 43 (150) | 14/15 |
| SNES schaul noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| xNES schaul noiseless | 16 (0.4) | 10 (0.3) | 10 (0.4) | 10 (0.8) | 10 (0.4) | 12 (0.4) | 13 (0.3) | 15/15 |
| xNESas schaul noiseless | 16 (3) | 11 (3) | 11 (1) | 11 (1) | 11 (3) | 12 (4) | 13 (2) | 15/15 |
| Δ fopt f10, 40-D |
1e1 25536 |
1e0 29762 |
1e-1 35676 |
1e-2 51579 |
1e-3 56007 |
1e-5 65128 |
1e-7 70824 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 1.2 (0.1) | 1.2 (0.2) | 1.1 (0.1) | 0.78 (0.0) | 0.77 (0.0) | 0.70 (0.0) | 0.66 (0.0) | 15/15 |
| CMAES posik noiseless | 1.9 (0.1) | 1.9 (0.1) | 1.7 (0.1) | 1.2 (0.1) | 1.2 (0.0) | 1.1 (0.0) | 1.0 (0.0) | 15/15 |
| CMA brockhoff noiseless | 1.9 (0.2) | 1.9 (0.2) | 1.7 (0.1) | 1.2 (0.1) | 1.2 (0.1) | 1.1 (0.0) | 1.0 (9e-3) | 15/15 |
| CMAa brockhoff noiseless | 1.2 (0.1) | 1.2 (0.1) | 1.1 (0.1) | 0.81 (0.1) | 0.79 (0.0) | 0.71 (0.0) | 0.67 (0.0) | 15/15 |
| CMAm brockhoff noiseless | 1.8 (0.2) | 1.8 (0.2) | 1.7 (0.1) | 1.2 (0.0) | 1.2 (0.0) | 1.1 (0.0) | 0.99 (0.0) | 15/15 |
| CMAma brockhoff noiseless | 1.1 (0.1) | 1.1 (0.1) | 1.0 (0.0) | 0.75 (0.0) | 0.73 (0.0) | 0.66 (0.0) | 0.62 (0.0) | 15/15 |
| CMAmah brockhoff noiseless | 1.1 (0.1) | 1.2 (0.1) | 1.1 (0.1) | 0.79 (0.0) | 0.76 (0.0) | 0.67 (0.0) | 0.63 (8e-3) | 15/15 |
| CMAmh brockhoff noiseless | 1.5 (0.1) | 1.6 (0.2) | 1.5 (0.1) | 1.1 (0.1) | 1.0 (9e-3) | 0.91 (9e-3) | 0.84 (0.0) | 15/15 |
| DBRCGA chuang noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-AUTO voglis noiseless | 137 (60) | 2002 (2321) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-BFGS voglis noiseless | 33 (86) | 40 (47) | 64 (56) | 58 (76) | 65 (128) | 57 (46) | 187 (153) | 0/15 |
| DE-ROLL voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DEAE posik noiseless | 6.1 (1) | 5.8 (0.4) | 5.3 (0.3) | 3.9 (0.4) | 3.8 (0.3) | 3.7 (0.2) | 3.8 (0.3) | 15/15 |
| DE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEctpb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADE posik noiseless | 47 (9) | 99 (85) | 275 (113) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADEb posik noiseless | 65 (12) | 159 (122) | 839 (995) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADEctpb posik noiseless | 47 (10) | 99 (118) | 275 (266) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| MVDE melo noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 1.1 (0.1) | 1.1 (0.1) | 1.1 (0.1) | 0.79 (0.0) | 0.77 (0.1) | 0.71 (0.0) | 0.67 (0.0) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 1.2 (0.0) | 1.2 (0.1) | 1.1 (0.1) | 0.79 (0.0) | 0.77 (0.0) | 0.70 (0.0) | 0.67 (0.0) | 15/15 |
| PSO-BFGS voglis noiseless | 114 (123) | 192 (421) | 160 (234) | 111 (203) | 103 (233) | 89 (59) | 837 (820) | 0/15 |
| SNES schaul noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| xNES schaul noiseless | 2.0 (0.0) | 2.1 (0.0) | 2.1 (0.0) | 1.7 (0.0) | 1.8 (9e-3) | 2.0 (0.0) | 2.2 (9e-3) | 15/15 |
| xNESas schaul noiseless | 1.9 (0.0) | 1.9 (0.1) | 1.8 (0.2) | 1.3 (0.2) | 1.3 (0.3) | 1.2 (0.4) | 1.1 (0.5) | 15/15 |
| Δ fopt f11, 40-D |
1e1 2368 |
1e0 4855 |
1e-1 11681 |
1e-2 25315 |
1e-3 29749 |
1e-5 38949 |
1e-7 48211 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 7811 (7227) | 2.9e4 (2e4) | 1.2e4 (8133) | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 5.0 (0.2) | 2.6 (0.1) | 1.2 (0.0) | 0.57 (0.0) | 0.51 (0.0) | 0.42 (0.0) | 0.37 (9e-3) | 15/15 |
| CMAES posik noiseless | 16 (1) | 8.2 (0.6) | 3.6 (0.2) | 1.7 (0.4) | 1.5 (0.4) | 1.2 (0.2) | 1.0 (0.3) | 15/15 |
| CMA brockhoff noiseless | 15 (0.8) | 7.8 (2) | 3.4 (0.3) | 1.7 (0.1) | 1.5 (0.2) | 1.2 (0.1) | 1.00 (0.1) | 15/15 |
| CMAa brockhoff noiseless | 5.0 (0.2) | 2.7 (0.1) | 1.2 (0.0) | 0.57 (0.0) | 0.51 (0.0) | 0.42 (8e-3) | 0.37 (5e-3) | 15/15 |
| CMAm brockhoff noiseless | 16 (4) | 8.6 (2) | 3.7 (0.7) | 1.8 (0.4) | 1.6 (0.4) | 1.3 (0.3) | 1.1 (0.2) | 15/15 |
| CMAma brockhoff noiseless | 4.6 (0.3) | 2.4 (0.1) | 1.1 (0.1) | 0.52 (0.0) | 0.46 (0.0) | 0.38 (0.0) | 0.33 (0.0) | 15/15 |
| CMAmah brockhoff noiseless | 5.4 (0.4) | 2.8 (0.1) | 1.2 (0.0) | 0.59 (0.0) | 0.52 (0.0) | 0.43 (0.0) | 0.36 (0.0) | 15/15 |
| CMAmh brockhoff noiseless | 17 (2) | 8.9 (1) | 3.9 (0.1) | 1.9 (0.2) | 1.7 (0.0) | 1.3 (0.2) | 1.1 (0.2) | 15/15 |
| DBRCGA chuang noiseless | 597 (163) | 443 (25) | 228 (11) | 122 (2) | 112 (2) | 96 (1) | ∞4e6 | 0/15 |
| DE-AUTO voglis noiseless | 0.17 (0.1) | 0.10 (9e-3) | 0.05 (3e-3) | 0.03 (3e-3) | 0.04 (0.0) | 0.04 (4e-3) | 0.07 (0.1) | 15/15 |
| DE-BFGS voglis noiseless | 0.19 (0.2) | 0.11 (0.0) | 0.05 (0.0) | 0.03 (0.0) | 0.03 (5e-3) | 0.03 (7e-3) | 0.03 (9e-3) | 13/15 |
| DE-ROLL voglis noiseless | 8090 (1e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 914 (862) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DEAE posik noiseless | 19 (6) | 13 (3) | 6.4 (1.0) | 3.5 (0.6) | 3.4 (0.4) | 3.3 (0.4) | 3.2 (0.4) | 15/15 |
| DE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEctpb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADE posik noiseless | 247 (232) | 131 (110) | 59 (90) | 30 (41) | 27 (52) | 24 (26) | 22 (1) | 12/15 |
| JADEb posik noiseless | 470 (626) | 243 (522) | 107 (130) | 53 (178) | 47 (68) | 40 (51) | 35 (42) | 10/15 |
| JADEctpb posik noiseless | 247 (650) | 131 (105) | 59 (88) | 30 (61) | 27 (35) | 24 (26) | 22 (43) | 12/15 |
| MVDE melo noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 5.0 (0.1) | 2.7 (0.1) | 1.2 (0.0) | 0.58 (0.0) | 0.51 (0.0) | 0.43 (8e-3) | 0.37 (7e-3) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 5.0 (0.2) | 2.7 (0.1) | 1.2 (0.0) | 0.57 (1e-2) | 0.51 (4e-3) | 0.42 (8e-3) | 0.37 (7e-3) | 15/15 |
| PSO-BFGS voglis noiseless | 0.35 (0.3) | 0.19 (0.2) | 0.09 (0.1) | 0.04 (0.0) | 0.04 (0.0) | 0.04 (0.0) | 0.04 (0.0) | 12/15 |
| SNES schaul noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/11 |
| xNES schaul noiseless | 7.6 (0.2) | 6.3 (0.2) | 3.7 (0.1) | 2.2 (0.0) | 2.3 (0.0) | 2.4 (0.0) | 2.5 (0.0) | 15/15 |
| xNESas schaul noiseless | 7.5 (0.3) | 5.8 (0.4) | 3.1 (0.3) | 1.7 (0.3) | 1.6 (0.5) | 1.4 (0.6) | 1.2 (0.7) | 15/15 |
| Δ fopt f12, 40-D |
1e1 4169 |
1e0 7452 |
1e-1 9174 |
1e-2 10751 |
1e-3 13146 |
1e-5 22758 |
1e-7 25192 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 2104 (1200) | 8726 (2e4) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 1.9 (0.7) | 1.9 (1) | 2.2 (1) | 2.2 (0.8) | 2.1 (0.6) | 1.5 (0.4) | 1.5 (0.4) | 15/15 |
| CMAES posik noiseless | 2.0 (2) | 2.3 (2) | 2.6 (2) | 2.6 (2) | 2.6 (1) | 1.9 (0.7) | 2.0 (0.7) | 15/15 |
| CMA brockhoff noiseless | 1.4 (0.6) | 1.7 (2) | 2.4 (1.0) | 2.4 (2) | 2.4 (2) | 1.8 (0.9) | 1.9 (0.6) | 15/15 |
| CMAa brockhoff noiseless | 2.3 (1) | 2.0 (2) | 2.2 (0.8) | 2.2 (2) | 2.1 (0.9) | 1.5 (0.7) | 1.5 (0.3) | 15/15 |
| CMAm brockhoff noiseless | 1.8 (1) | 2.2 (2) | 2.5 (2) | 2.6 (2) | 2.5 (1) | 1.9 (1) | 2.0 (0.7) | 15/15 |
| CMAma brockhoff noiseless | 1.3 (1.0) | 1.9 (0.7) | 2.1 (0.6) | 2.1 (0.7) | 1.9 (0.4) | 1.4 (0.3) | 1.4 (0.3) | 15/15 |
| CMAmah brockhoff noiseless | 0.94 (0.9) | 1.2 (0.8) | 1.4 (0.9) | 1.5 (0.3) | 1.4 (0.4) | 1.0 (0.3)★ | 1.1 (0.2)★ | 15/15 |
| CMAmh brockhoff noiseless | 1.4 (2) | 1.8 (2) | 2.3 (3) | 2.4 (1) | 2.4 (0.8) | 1.9 (1) | 2.0 (0.8) | 15/15 |
| DBRCGA chuang noiseless | 271 (481) | 1093 (136) | 890 (2180) | 5224 (4837) | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-AUTO voglis noiseless | 1.3 (2) | 1.2 (2) | 1.3 (1) | 1.8 (2) | 4.3 (4) | 7.1 (9) | 54 (150) | 7/15 |
| DE-BFGS voglis noiseless | 3.6 (3) | 2.6 (1) | 2.8 (1) | 3.4 (1) | 8.4 (7) | 107 (81) | ∞4e6 | 0/15 |
| DE-ROLL voglis noiseless | 21 (48) | 13 (27) | 13 (16) | 13 (15) | 12 (16) | 22 (17) | 132 (208) | 6/15 |
| DE-SIMPLEX voglis noiseless | 26 (36) | 41 (47) | 51 (38) | 57 (33) | 114 (141) | ∞ | ∞4e6 | 0/15 |
| DEAE posik noiseless | 25 (1) | 18 (5) | 19 (5) | 19 (6) | 18 (4) | 13 (2) | 14 (1) | 15/15 |
| DE posik noiseless | 227 (600) | 233 (390) | 250 (227) | 391 (488) | 715 (635) | ∞ | ∞2e6 | 0/15 |
| DEb posik noiseless | 227 (393) | 233 (321) | 250 (270) | 391 (389) | 715 (394) | ∞ | ∞2e6 | 0/15 |
| DEctpb posik noiseless | 209 (601) | 238 (177) | 508 (517) | 554 (349) | ∞ | ∞ | ∞2e6 | 0/15 |
| JADE posik noiseless | 29 (52) | 44 (36) | 56 (14) | 56 (13) | 51 (10) | 35 (5) | 35 (5) | 15/15 |
| JADEb posik noiseless | 49 (19) | 101 (78) | 102 (183) | 95 (36) | 93 (162) | 62 (64) | 61 (41) | 12/15 |
| JADEctpb posik noiseless | 29 (59) | 44 (35) | 56 (22) | 56 (15) | 51 (10) | 35 (5) | 35 (4) | 15/15 |
| MVDE melo noiseless | 100 (181) | 395 (571) | 733 (1201) | 1327 (932) | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 2.3 (1) | 2.2 (1.0) | 2.4 (1) | 2.3 (1) | 2.2 (0.5) | 1.5 (0.3) | 1.5 (0.4) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 1.9 (2) | 2.0 (1) | 2.2 (1) | 2.2 (0.5) | 2.1 (0.3) | 1.5 (0.4) | 1.5 (0.5) | 15/15 |
| PSO-BFGS voglis noiseless | 12 (8) | 11 (10) | 14 (12) | 14 (12) | 30 (57) | 406 (568) | ∞4e6 | 0/15 |
| xNES schaul noiseless | 19 (0.2) | 13 (0.1) | 12 (0.3) | 11 (0.3) | 11 (0.3) | 7.5 (0.3) | 7.7 (0.2) | 15/15 |
| xNESas schaul noiseless | 7.4 (4) | 4.5 (4) | 7.8 (4) | 12 (13) | 17 (51) | 14 (26) | 15 (1) | 15/15 |
| Δ fopt f13, 40-D |
1e1 2029 |
1e0 6916 |
1e-1 8734 |
1e-2 11861 |
1e-3 71936 |
1e-5 98467 |
1e-7 1.2e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1802 (3697) | 2896 (2169) | 7446 (8587) | 1.2e4 (6323) | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 2.0 (2) | 3.8 (3) | 5.3 (5) | 6.5 (4) | 1.3 (1) | 1.6 (1) | 2.0 (1) | 15/15 |
| CMAES posik noiseless | 2.7 (0.2) | 3.8 (6) | 7.2 (7) | 16 (19) | 5.9 (5) | 66 (72) | ∞2e6 | 0/15 |
| CMA brockhoff noiseless | 2.1 (2) | 3.6 (4) | 8.6 (10) | 9.3 (5) | 2.5 (3) | 3.0 (1) | 3.8 (2) | 15/15 |
| CMAa brockhoff noiseless | 2.1 (2) | 2.8 (2) | 4.0 (2) | 5.5 (3) | 1.2 (1) | 1.6 (0.7) | 1.8 (1.0) | 15/15 |
| CMAm brockhoff noiseless | 1.7 (2) | 3.3 (2) | 7.2 (8) | 9.0 (6) | 3.3 (3) | 4.3 (0.7) | 4.1 (1) | 15/15 |
| CMAma brockhoff noiseless | 2.0 (3) | 2.2 (2) | 3.6 (2) | 4.2 (3) | 0.93 (1) | 1.8 (0.6) | 1.9 (0.6) | 15/15 |
| CMAmah brockhoff noiseless | 1.1 (1) | 2.7 (2) | 5.9 (8) | 5.4 (3) | 1.4 (1) | 1.5 (0.6) | 1.9 (0.7) | 15/15 |
| CMAmh brockhoff noiseless | 1.1 (2) | 1.9 (3) | 5.6 (4) | 11 (9) | 3.3 (3) | 3.0 (1) | 2.8 (1) | 15/15 |
| DBRCGA chuang noiseless | 459 (1484) | 408 (510) | 841 (572) | 4840 (7251) | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-AUTO voglis noiseless | 1.1 (0.2) | 1.3 (0.8) | 2.2 (1) | 4.5 (6) | 1.3 (1.0) | 12 (9) | 153 (104) | 1/15 |
| DE-BFGS voglis noiseless | 9.4 (2) | 4.3 (0.4) | 6.5 (0.6) | 7.8 (4) | 12 (2) | 120 (92) | ∞4e6 | 0/15 |
| DE-ROLL voglis noiseless | 15 (27) | 6.0 (6) | 7.1 (5) | 7.0 (3) | 2.3 (2) | 31 (16) | 470 (645) | 0/15 |
| DE-SIMPLEX voglis noiseless | 30 (20) | 21 (17) | 28 (15) | 97 (144) | ∞ | ∞ | ∞4e6 | 0/15 |
| DEAE posik noiseless | 33 (2) | 14 (1) | 14 (0.8) | 12 (0.5) | 2.4 (0.1) | 2.3 (0.1) | 2.3 (0.1) | 15/15 |
| DE posik noiseless | 54 (11) | 77 (103) | 386 (286) | 573 (704) | ∞ | ∞ | ∞2e6 | 0/15 |
| DEb posik noiseless | 54 (13) | 77 (76) | 386 (519) | 573 (1054) | ∞ | ∞ | ∞2e6 | 0/15 |
| DEctpb posik noiseless | 60 (3) | 27 (2) | 145 (211) | 245 (158) | 201 (271) | ∞ | ∞2e6 | 0/15 |
| JADE posik noiseless | 74 (64) | 77 (217) | 283 (182) | 354 (412) | 73 (53) | ∞ | ∞2e6 | 0/15 |
| JADEb posik noiseless | 29 (27) | 80 (65) | 258 (337) | 1224 (1067) | 406 (667) | ∞ | ∞2e6 | 0/15 |
| JADEctpb posik noiseless | 74 (1) | 77 (53) | 283 (202) | 354 (563) | 73 (51) | ∞ | ∞2e6 | 0/15 |
| MVDE melo noiseless | 67 (3) | 156 (218) | 487 (975) | 574 (612) | 96 (164) | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 2.5 (2) | 3.2 (3) | 5.0 (4) | 5.1 (3) | 1.2 (1) | 2.0 (2) | 2.8 (2) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.4 (0.1) | 2.4 (3) | 4.1 (3) | 5.6 (5) | 1.4 (1) | 1.6 (0.8) | 1.7 (0.6) | 15/15 |
| PSO-BFGS voglis noiseless | 26 (2) | 8.0 (0.4) | 9.1 (3) | 13 (6) | 95 (80) | 574 (508) | ∞4e6 | 0/15 |
| xNES schaul noiseless | 24 (0.3) | 11 (0.1) | 11 (0.1) | 11 (0.1) | 2.1 (0.0) | 2.0 (0.0) | 2.1 (6e-3) | 15/15 |
| xNESas schaul noiseless | 13 (5) | 4.2 (2) | 9.0 (2) | 40 (67) | 23 (52) | 64 (68) | 84 (74) | 0/15 |
| Δ fopt f14, 40-D |
1e1 304 |
1e0 616 |
1e-1 777 |
1e-2 1105 |
1e-3 2207 |
1e-5 4825 |
1e-7 57711 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 21 (7) | 16 (3) | 18 (2) | 24 (3) | 107 (29) | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 2.5 (0.2) | 2.3 (0.3) | 2.9 (0.2) | 3.7 (0.3) | 3.5 (0.2) | 3.9 (0.3) | 0.59 (0.0) | 15/15 |
| CMAES posik noiseless | 2.4 (0.2) | 2.4 (0.2) | 2.9 (0.3) | 3.8 (0.3) | 4.3 (0.2) | 6.7 (0.4) | 1.1 (0.1) | 15/15 |
| CMA brockhoff noiseless | 2.5 (0.5) | 2.4 (0.3) | 3.0 (0.2) | 3.9 (0.5) | 4.4 (0.3) | 6.8 (0.3) | 1.1 (0.1) | 15/15 |
| CMAa brockhoff noiseless | 2.5 (0.5) | 2.4 (0.3) | 3.0 (0.2) | 3.6 (0.3) | 3.4 (0.3) | 3.9 (0.1) | 0.58 (0.0) | 15/15 |
| CMAm brockhoff noiseless | 2.0 (0.5) | 1.9 (0.4) | 2.3 (0.1) | 3.0 (0.3) | 3.9 (0.2) | 6.6 (0.3) | 1.1 (0.1) | 15/15 |
| CMAma brockhoff noiseless | 1.9 (0.3) | 1.9 (0.2) | 2.3 (0.1) | 3.0 (0.2) | 3.0 (0.2) | 3.6 (0.2) | 0.56 (0.0) | 15/15 |
| CMAmah brockhoff noiseless | 1.5 (0.5) | 1.4 (0.3) | 1.6 (0.2) | 2.0 (0.3) | 2.3 (0.2) | 3.5 (0.2) | 0.61 (0.0) | 15/15 |
| CMAmh brockhoff noiseless | 1.5 (0.2) | 1.3 (0.2) | 1.6 (0.1) | 2.1 (0.1) | 2.8 (0.2) | 5.9 (0.6) | 1.1 (0.1) | 15/15 |
| DBRCGA chuang noiseless | 34 (12) | 57 (10) | 81 (19) | 110 (18) | 154 (26) | ∞ | ∞4e6 | 0/15 |
| DE-AUTO voglis noiseless | 0.92 (0.1) | 0.70 (0.1) | 0.77 (0.1) | 1.3 (0.1) | 1.1 (0.2) | 13 (3) | ∞4e6 | 0/15 |
| DE-BFGS voglis noiseless | 0.91 (0.2) | 0.70 (0.1) | 0.83 (0.1) | 0.91 (0.1) | 0.64 (0.0) | 2.0 (1)★2 | ∞4e6 | 0/15 |
| DE-ROLL voglis noiseless | 4.1 (2) | 11 (8) | 12 (12) | 12 (7) | 24 (5) | ∞ | ∞4e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 27 (8) | 31 (8) | 34 (7) | 35 (8) | 31 (12) | ∞ | ∞4e6 | 0/15 |
| DEAE posik noiseless | 49 (11) | 53 (7) | 73 (10) | 81 (9) | 54 (5) | 40 (2) | 4.5 (0.3) | 15/15 |
| DE posik noiseless | 123 (30) | 100 (7) | 115 (12) | 329 (119) | ∞ | ∞ | ∞2e6 | 0/15 |
| DEb posik noiseless | 123 (11) | 100 (10) | 115 (18) | 329 (88) | ∞ | ∞ | ∞2e6 | 0/15 |
| DEctpb posik noiseless | 114 (23) | 100 (4) | 120 (10) | 446 (23) | ∞ | ∞ | ∞2e6 | 0/15 |
| JADE posik noiseless | 23 (1) | 23 (2) | 27 (2) | 29 (1.0) | 30 (2) | 166 (53) | ∞2e6 | 0/15 |
| JADEb posik noiseless | 20 (2) | 20 (0.9) | 25 (2) | 32 (2) | 30 (1) | 153 (21) | ∞2e6 | 0/15 |
| JADEctpb posik noiseless | 23 (2) | 23 (1.0) | 27 (2) | 29 (0.9) | 30 (2) | 166 (53) | ∞2e6 | 0/15 |
| MVDE melo noiseless | 79 (9) | 89 (4) | 114 (4) | 277 (48) | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 2.5 (0.5) | 2.4 (0.2) | 3.0 (0.2) | 3.6 (0.3) | 3.5 (0.2) | 3.9 (0.1) | 0.59 (0.0) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 2.5 (0.3) | 2.3 (0.2) | 3.0 (0.3) | 3.6 (0.2) | 3.4 (0.1) | 3.8 (0.3) | 0.60 (0.0) | 15/15 |
| PSO-BFGS voglis noiseless | 0.93 (0.3) | 0.72 (0.1) | 0.85 (0.2) | 0.94 (0.1) | 0.66 (0.1) | 6.4 (3) | ∞4e6 | 0/15 |
| xNES schaul noiseless | 1.8 (0.6) | 21 (2) | 37 (1) | 41 (1) | 27 (0.3) | 19 (0.2) | 2.1 (0.0) | 15/15 |
| xNESas schaul noiseless | 1.8 (0.7) | 20 (2) | 35 (1) | 38 (1) | 26 (0.5) | 18 (0.2) | 2.0 (0.0) | 15/15 |
| Δ fopt f15, 40-D |
1e1 1.9e5 |
1e0 7.9e5 |
1e-1 1.0e6 |
1e-2 1.1e6 |
1e-3 1.1e6 |
1e-5 1.1e6 |
1e-7 1.1e6 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 1.2 (2) | 1.1 (0.7) | 1.1 (0.4) | 1.1 (0.6) | 1.1 (0.5) | 1.1 (0.3) | 1.1 (0.3) | 15/15 |
| CMAES posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA brockhoff noiseless | 0.97 (0.3) | 0.78 (0.3) | 0.71 (0.2) | 0.72 (0.3) | 0.72 (0.3) | 0.74 (0.2) | 0.75 (0.3) | 15/15 |
| CMAa brockhoff noiseless | 0.75 (0.3) | 0.67 (0.3) | 0.66 (0.2) | 0.66 (0.1) | 0.67 (0.3) | 0.68 (0.2) | 0.69 (0.5) | 15/15 |
| CMAm brockhoff noiseless | 0.71 (0.3) | 0.64 (0.2) | 0.68 (0.5) | 0.68 (0.5) | 0.69 (0.5) | 0.70 (0.4) | 0.71 (0.5) | 15/15 |
| CMAma brockhoff noiseless | 0.72 (0.3) | 0.58 (0.1) | 0.60 (0.2) | 0.60 (0.2) | 0.61 (0.2) | 0.62 (0.2) | 0.63 (0.3) | 15/15 |
| CMAmah brockhoff noiseless | 0.79 (0.1) | 0.68 (0.2) | 0.69 (0.2) | 0.70 (0.1) | 0.70 (0.2) | 0.72 (0.3) | 0.72 (0.2) | 15/15 |
| CMAmh brockhoff noiseless | 0.86 (0.3) | 0.66 (0.0) | 0.71 (0.4) | 0.72 (0.3) | 0.72 (0.2) | 0.74 (0.2) | 0.75 (0.2) | 15/15 |
| DBRCGA chuang noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-AUTO voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-BFGS voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-ROLL voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DEAE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEctpb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADEb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADEctpb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| MVDE melo noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 1.0 (0.4) | 0.71 (0.2) | 0.75 (0.2) | 0.76 (0.5) | 0.76 (0.2) | 0.77 (0.6) | 0.77 (0.4) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 0.92 (0.3) | 0.61 (0.2) | 0.55 (0.2) | 0.56 (0.2) | 0.56 (0.2) | 0.57 (0.2) | 0.58 (0.2) | 15/15 |
| PSO-BFGS voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| xNES schaul noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/2 |
| xNESas schaul noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/9 |
| Δ fopt f16, 40-D |
1e1 5244 |
1e0 72122 |
1e-1 3.2e5 |
1e-2 7.1e5 |
1e-3 1.4e6 |
1e-5 2.0e6 |
1e-7 2.0e6 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 8740 (8969) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 1.3 (3) | 0.96 (0.3) | 0.80 (0.3) | 0.61 (0.3) | 0.54 (0.2) | 0.50 (0.3) | 0.51 (0.3) | 15/15 |
| CMAES posik noiseless | 1.1 (0.5) | 47 (62) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA brockhoff noiseless | 1.8 (0.4) | 1.2 (1) | 0.92 (0.8) | 0.99 (0.8) | 0.64 (0.7) | 0.57 (0.3) | 0.58 (0.2) | 15/15 |
| CMAa brockhoff noiseless | 0.88 (0.3) | 0.94 (0.3) | 0.65 (0.5) | 0.66 (0.8) | 0.59 (0.7) | 0.44 (0.1) | 0.45 (0.5) | 15/15 |
| CMAm brockhoff noiseless | 0.72 (0.2) | 1.2 (0.1) | 1.2 (0.9) | 0.91 (1) | 0.62 (0.3) | 0.61 (0.1) | 0.63 (0.3) | 15/15 |
| CMAma brockhoff noiseless | 0.65 (0.3) | 0.72 (0.4) | 0.55 (0.3) | 0.81 (0.5) | 0.52 (0.4) | 0.52 (0.5) | 0.56 (0.6) | 15/15 |
| CMAmah brockhoff noiseless | 2.4 (2) | 1.00 (0.6) | 0.75 (0.7) | 0.55 (0.3) | 0.55 (0.5) | 0.47 (0.5) | 0.48 (0.3) | 15/15 |
| CMAmh brockhoff noiseless | 2.8 (2) | 1.9 (0.2) | 0.79 (0.4) | 0.99 (0.8) | 0.73 (0.6) | 0.58 (0.3) | 0.60 (0.3) | 15/15 |
| DBRCGA chuang noiseless | 657 (1235) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-AUTO voglis noiseless | 329 (189) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-BFGS voglis noiseless | 2351 (6290) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-ROLL voglis noiseless | 415 (351) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 1082 (1399) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DEAE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEctpb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADE posik noiseless | 219 (233) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADEb posik noiseless | 1211 (504) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADEctpb posik noiseless | 219 (214) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| MVDE melo noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 0.97 (0.3) | 0.78 (0.4) | 0.34 (0.2) | 0.28 (0.2) | 0.38 (0.6) | 0.46 (0.3) | 0.74 (2) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 1.2 (0.4) | 0.65 (0.2) | 0.23 (0.0)★ | 0.27 (0.2) | 0.21 (0.2) | 0.16 (0.0)★ | 0.18 (0.2) | 15/15 |
| PSO-BFGS voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| Δ fopt f17, 40-D |
1e1 399 |
1e0 4220 |
1e-1 14158 |
1e-2 34948 |
1e-3 51958 |
1e-5 1.3e5 |
1e-7 2.7e5 |
#succ 14/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 37 (19) | 9.3 (5) | 1064 (1236) | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 1.1 (0.3) | 0.64 (0.3) | 1.6 (1) | 1.0 (0.3) | 1.1 (0.4) | 1.4 (0.4) | 0.87 (0.4) | 15/15 |
| CMAES posik noiseless | 1.0 (0.3) | 1.0 (4) | 1.1 (0.1) | 15 (12) | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA brockhoff noiseless | 0.98 (0.3) | 1.2 (5) | 1.1 (1) | 0.94 (0.3) | 0.94 (0.3) | 0.98 (0.4) | 0.73 (0.2) | 15/15 |
| CMAa brockhoff noiseless | 0.88 (0.6) | 0.53 (0.1) | 1.0 (1) | 0.95 (0.1) | 1.0 (0.4) | 1.00 (0.6) | 0.69 (0.2) | 15/15 |
| CMAm brockhoff noiseless | 0.79 (0.3) | 0.42 (0.1) | 1.1 (2) | 0.79 (0.1) | 0.96 (0.3) | 0.93 (0.6) | 0.80 (0.3) | 15/15 |
| CMAma brockhoff noiseless | 0.89 (0.3) | 0.46 (0.1) | 0.96 (0.7) | 0.68 (0.1) | 0.77 (0.3) | 0.77 (0.4) | 0.60 (0.2) | 15/15 |
| CMAmah brockhoff noiseless | 0.82 (0.3) | 11 (5) | 4.3 (2) | 2.4 (0.8) | 1.9 (0.7) | 1.1 (0.5) | 0.82 (0.3) | 15/15 |
| CMAmh brockhoff noiseless | 1.0 (0.6) | 7.6 (6) | 3.9 (0.8) | 1.8 (0.2) | 1.5 (0.8) | 1.2 (0.5) | 0.90 (0.2) | 15/15 |
| DBRCGA chuang noiseless | 5.6 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-AUTO voglis noiseless | 15 (26) | 636 (701) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-BFGS voglis noiseless | 13 (13) | 422 (990) | 4118 (3958) | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-ROLL voglis noiseless | 19 (17) | 1039 (1259) | 1986 (2403) | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 25 (30) | 1894 (1679) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DEAE posik noiseless | 30 (15) | 19 (4) | 13 (2) | 9.2 (2) | 28 (40) | ∞ | ∞2e6 | 0/15 |
| DE posik noiseless | 35 (9) | 24 (4) | 17 (2) | 13 (2) | 26 (31) | ∞ | ∞2e6 | 0/15 |
| DEb posik noiseless | 35 (14) | 24 (4) | 17 (2) | 13 (2) | 26 (22) | ∞ | ∞2e6 | 0/15 |
| DEctpb posik noiseless | 28 (11) | 21 (2) | 15 (1) | 10 (0.3) | 10 (0.6) | ∞ | ∞2e6 | 0/15 |
| JADE posik noiseless | 7.0 (0.9) | 5.4 (0.7) | 3.2 (0.4) | 5.2 (7) | 13 (13) | ∞ | ∞2e6 | 0/15 |
| JADEb posik noiseless | 6.7 (3) | 115 (163) | 924 (1095) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADEctpb posik noiseless | 7.0 (1) | 5.4 (0.6) | 3.2 (0.6) | 5.2 (10) | 13 (12) | ∞ | ∞2e6 | 0/15 |
| MVDE melo noiseless | 17 (3) | 27 (2) | 21 (4) | 17 (6) | 29 (15) | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 1.0 (0.3) | 0.57 (0.2) | 1.2 (0.9) | 1.2 (0.5) | 1.2 (0.5) | 1.0 (0.3) | 0.81 (0.3) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 0.98 (0.3) | 0.52 (0.1) | 0.97 (1) | 1.1 (0.3) | 1.00 (0.3) | 1.1 (0.2) | 0.70 (0.2) | 15/15 |
| PSO-BFGS voglis noiseless | 24 (26) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| Δ fopt f18, 40-D |
1e1 1442 |
1e0 16998 |
1e-1 47068 |
1e-2 1.3e5 |
1e-3 1.9e5 |
1e-5 6.7e5 |
1e-7 9.5e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 16 (5) | 397 (1031) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 0.94 (0.1) | 0.51 (0.0) | 1.0 (0.2) | 0.72 (0.2) | 0.98 (0.6) | 0.88 (0.7) | 0.67 (0.5) | 15/15 |
| CMAES posik noiseless | 0.97 (0.2) | 1.2 (1) | 68 (122) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA brockhoff noiseless | 0.94 (0.2) | 0.58 (0.4) | 1.1 (0.4) | 0.72 (0.3) | 0.77 (0.3) | 0.53 (0.1) | 0.58 (0.4) | 15/15 |
| CMAa brockhoff noiseless | 0.95 (0.3) | 0.50 (0.8) | 1.2 (0.7) | 0.75 (0.3) | 0.83 (0.2) | 0.54 (0.3) | 0.43 (0.2) | 15/15 |
| CMAm brockhoff noiseless | 0.78 (0.2) | 0.62 (0.7) | 0.90 (0.3) | 0.65 (0.5) | 0.68 (0.3) | 0.85 (0.5) | 0.67 (0.4) | 15/15 |
| CMAma brockhoff noiseless | 0.77 (0.1) | 0.72 (0.6) | 0.93 (0.3) | 0.62 (0.3) | 0.61 (0.1) | 0.46 (0.3) | 0.47 (0.6) | 15/15 |
| CMAmah brockhoff noiseless | 9.3 (7) | 3.5 (2) | 1.7 (3) | 0.99 (0.3) | 0.96 (0.3) | 0.58 (0.2) | 0.47 (0.2) | 15/15 |
| CMAmh brockhoff noiseless | 24 (33) | 3.4 (3) | 2.0 (0.9) | 1.1 (0.8) | 1.1 (0.5) | 0.68 (0.2) | 0.58 (0.2) | 15/15 |
| DBRCGA chuang noiseless | 1183 (1432) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-AUTO voglis noiseless | 291 (264) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-BFGS voglis noiseless | 230 (143) | 3492 (4710) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-ROLL voglis noiseless | 442 (157) | 3530 (5829) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 638 (832) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DEAE posik noiseless | 32 (6) | 11 (2) | 10 (5) | 38 (79) | ∞ | ∞ | ∞2e6 | 0/15 |
| DE posik noiseless | 46 (7) | 24 (4) | 38 (67) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEb posik noiseless | 46 (7) | 24 (9) | 38 (19) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEctpb posik noiseless | 40 (8) | 14 (4) | 12 (3) | 7.8 (2) | 10 (6) | ∞ | ∞2e6 | 0/15 |
| JADE posik noiseless | 10 (1) | 2.8 (0.6) | 16 (13) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADEb posik noiseless | 16 (4) | 794 (1000) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADEctpb posik noiseless | 10 (0.8) | 2.8 (0.9) | 16 (23) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| MVDE melo noiseless | 49 (10) | 29 (14) | 316 (362) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 1.0 (0.2) | 0.97 (1) | 1.1 (0.6) | 0.94 (0.6) | 0.93 (0.6) | 0.57 (0.4) | 0.53 (0.2) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 0.95 (0.2) | 0.58 (0.9) | 0.75 (0.2) | 0.66 (0.2) | 0.71 (0.0) | 0.50 (0.3) | 0.42 (0.2) | 15/15 |
| PSO-BFGS voglis noiseless | 1465 (1835) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| xNES schaul noiseless | 2.1 (0) | 2.2 (0) | 1.6 (0) | 0.89 (0) | 0.80 (0) | 0.39 (0) | ∞1e7 | 0/1 |
| xNESas schaul noiseless | 4.3 (0) | 2.2 (0) | 1.6 (0) | 0.90 (0) | 0.80 (0) | 0.36 (0) | 0.37 (0) | 0/1 |
| Δ fopt f19, 40-D |
1e1 1 |
1e0 1 |
1e-1 1.4e6 |
1e-2 1.7e7 |
1e-3 2.6e7 |
1e-5 4.5e7 |
1e-7 4.5e7 |
#succ 8/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 4435 (1401) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 396 (89) | 6.7e4 (3e4) | 0.87 (0.8) | 1.2 (0.6) | 1.2 (2) | 1.0 (1.0) | 1.0 (0.7) | 9/15 |
| CMAES posik noiseless | 407 (151) | 2.5e5 (3e5) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA brockhoff noiseless | 421 (75) | 6.9e5 (2e6) | 1.5 (3) | 1.7 (1) | ∞ | ∞ | ∞8e6 | 0/15 |
| CMAa brockhoff noiseless | 443 (130) | 4.8e4 (1e4) | 1.8 (3) | 2.3 (1) | ∞ | ∞ | ∞8e6 | 0/15 |
| CMAm brockhoff noiseless | 293 (98) | 5.5e4 (5e4) | 2.5 (3) | 1.6 (2) | 4.5 (7) | 2.5 (4) | 2.5 (3) | 1/15 |
| CMAma brockhoff noiseless | 323 (42) | 3.9e4 (4e4) | 2.3 (5) | 1.2 (1) | ∞ | ∞ | ∞8e6 | 0/15 |
| CMAmah brockhoff noiseless | 338 (141) | 1.6e6 (3e6) | 7.1 (11) | 6.9 (7) | ∞ | ∞ | ∞8e6 | 0/15 |
| CMAmh brockhoff noiseless | 305 (112) | 1.2e6 (1e6) | 2.3 (4) | 6.9 (16) | ∞ | ∞ | ∞8e6 | 0/15 |
| DBRCGA chuang noiseless | 1270 (122) | 2.5e6 (3e6) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-AUTO voglis noiseless | 2.1e4 (1e4) | 2.1e6 (2e6) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-BFGS voglis noiseless | 1.6e4 (6098) | 1.9e6 (9e5) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-ROLL voglis noiseless | 2.1e4 (1e4) | 2.8e7 (2e7) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 2.7e4 (1e4) | 5.8e7 (6e7) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DEAE posik noiseless | 9417 (1745) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE posik noiseless | 1.4e4 (1920) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEb posik noiseless | 1.4e4 (4011) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEctpb posik noiseless | 1.2e4 (2950) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADE posik noiseless | 3064 (422) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADEb posik noiseless | 3765 (1096) | 8.9e6 (6e6) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADEctpb posik noiseless | 3064 (376) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| MVDE melo noiseless | 1.4e4 (925) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 424 (76) | 8.3e4 (6e4) | 0.97 (0.7) | 0.80 (0.2) | 0.81 (0.2) | 1.1 (2) | 1.1 (2) | 9/15 |
| NIPOPaCMA loshchilov noiseless | 436 (102) | 8.2e4 (4e4) | 1.9 (6) | 0.54 (0.6) | 0.48 (0.3) | 0.32 (0.2) | 0.32 (0.2) | 15/15 |
| PSO-BFGS voglis noiseless | 2.8e4 (4550) | 1.2e5 (3e4) | 41 (50) | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| Δ fopt f20, 40-D |
1e1 222 |
1e0 1.3e5 |
1e-1 1.6e8 |
1e-2 ∞ |
1e-3 ∞ |
1e-5 ∞ |
1e-7 ∞ |
#succ 0/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 26 (4) | 34 (34) | ∞ | 0/15 | ||||
| BIPOPaCMA loshchilov noiseless | 4.0 (0.5) | 9.0 (4) | 0.34 (0.3) | 0/15 | ||||
| CMAES posik noiseless | 4.0 (0.4) | ∞ | ∞ | 0/15 | ||||
| CMA brockhoff noiseless | 3.9 (0.7) | 14 (1) | ∞ | 0/15 | ||||
| CMAa brockhoff noiseless | 4.1 (0.5) | 5.6 (4) | 0.73 (0.7) | 0/15 | ||||
| CMAm brockhoff noiseless | 3.0 (0.4) | 13 (3) | ∞ | 0/15 | ||||
| CMAma brockhoff noiseless | 3.0 (0.6) | 5.5 (2) | 0.21 (0.1) | 0/15 | ||||
| CMAmah brockhoff noiseless | 2.0 (0.5) | 5.1 (2) | 0.35 (0.6) | 0/15 | ||||
| CMAmh brockhoff noiseless | 2.1 (0.5) | 12 (5) | ∞ | 0/15 | ||||
| DBRCGA chuang noiseless | 28 (6) | ∞ | ∞ | 0/15 | ||||
| DE-AUTO voglis noiseless | 1.5 (0.2)★2 | 3.9 (3) | ∞ | 0/15 | ||||
| DE-BFGS voglis noiseless | 10 (11) | 2.2 (1.0) | ∞ | 0/15 | ||||
| DE-ROLL voglis noiseless | 30 (27) | 0.94 (0.9) | ∞ | 0/15 | ||||
| DE-SIMPLEX voglis noiseless | 36 (18) | 5.5 (4) | ∞ | 0/15 | ||||
| DEAE posik noiseless | 80 (9) | ∞ | ∞ | 0/15 | ||||
| DE posik noiseless | 106 (25) | 7.2 (2) | ∞ | 0/15 | ||||
| DEb posik noiseless | 106 (12) | 7.2 (4) | ∞ | 0/15 | ||||
| DEctpb posik noiseless | 102 (22) | ∞ | ∞ | 0/15 | ||||
| JADE posik noiseless | 29 (1) | 2.7 (0.4) | ∞ | 0/15 | ||||
| JADEb posik noiseless | 27 (3) | 11 (12) | ∞ | 0/15 | ||||
| JADEctpb posik noiseless | 29 (2) | 2.7 (0.3) | ∞ | 0/15 | ||||
| MVDE melo noiseless | 121 (8) | ∞ | ∞ | 0/15 | ||||
| NBIPOPaCMA loshchilov noiseless | 4.0 (0.8) | 8.5 (3) | 0.39 (0.4) | 0/15 | ||||
| NIPOPaCMA loshchilov noiseless | 4.0 (0.5) | 6.5 (2) | 0.32 (0.3) | 0/15 | ||||
| PSO-BFGS voglis noiseless | 8.0 (1) | 209 (289) | ∞ | 0/15 |
| Δ fopt f21, 40-D |
1e1 1044 |
1e0 21144 |
1e-1 1.0e5 |
1e-2 1.0e5 |
1e-3 1.0e5 |
1e-5 1.0e5 |
1e-7 1.0e5 |
#succ 26/30 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 2674 (1e4) | 3199 (2869) | 1410 (943) | 1406 (1510) | 1402 (2245) | 1393 (1668) | 1387 (1636) | 1/15 |
| BIPOPaCMA loshchilov noiseless | 7.5 (5) | 60 (208) | 37 (55) | 37 (55) | 37 (83) | 37 (82) | 37 (69) | 15/15 |
| CMAES posik noiseless | 5.6 (9) | 2.2 (4) | 2.2 (5) | 2.2 (6) | 2.2 (0.5) | 2.1 (6) | 2.1 (0.9) | 14/15 |
| CMA brockhoff noiseless | 3.5 (8) | 63 (157) | 39 (46) | 39 (58) | 39 (39) | 39 (26) | 39 (39) | 6/15 |
| CMAa brockhoff noiseless | 2.0 (5) | 63 (90) | 38 (126) | 38 (76) | 38 (87) | 38 (37) | 37 (56) | 6/15 |
| CMAm brockhoff noiseless | 7.0 (4) | 110 (219) | 30 (33) | 30 (26) | 30 (71) | 30 (26) | 30 (52) | 7/15 |
| CMAma brockhoff noiseless | 1.6 (4) | 61 (213) | 38 (57) | 38 (57) | 38 (113) | 38 (44) | 38 (81) | 6/15 |
| CMAmah brockhoff noiseless | 1.3 (1) | 30 (86) | 17 (19) | 16 (30) | 16 (24) | 16 (13) | 16 (48) | 9/15 |
| CMAmh brockhoff noiseless | 2.3 (5) | 44 (116) | 22 (6) | 22 (19) | 22 (12) | 22 (55) | 22 (49) | 8/15 |
| DBRCGA chuang noiseless | 15 (7) | 56 (86) | 26 (24) | 26 (36) | 26 (42) | 27 (26) | 27 (39) | 11/15 |
| DE-AUTO voglis noiseless | 1.4 (2) | 162 (249) | 47 (60) | 47 (87) | 47 (86) | 47 (80) | 46 (48) | 8/15 |
| DE-BFGS voglis noiseless | 16 (0.7) | 60 (52) | 22 (20) | 22 (25) | 22 (42) | 21 (20) | ∞4e6 | 0/15 |
| DE-ROLL voglis noiseless | 176 (67) | 99 (199) | 33 (49) | 33 (27) | 33 (74) | 33 (45) | 66 (45) | 4/15 |
| DE-SIMPLEX voglis noiseless | 606 (972) | 522 (805) | 258 (199) | 258 (258) | 257 (672) | 256 (353) | 548 (440) | 0/15 |
| DEAE posik noiseless | 38 (59) | 30 (76) | 18 (22) | 18 (18) | 18 (22) | 18 (12) | 18 (32) | 9/15 |
| DE posik noiseless | 65 (128) | 30 (46) | 9.4 (1) | 10 (20) | 11 (11) | 11 (7) | 11 (10) | 11/15 |
| DEb posik noiseless | 65 (8) | 30 (70) | 9.4 (13) | 10 (34) | 11 (19) | 11 (11) | 11 (31) | 11/15 |
| DEctpb posik noiseless | 39 (16) | 112 (190) | 80 (65) | 80 (69) | 80 (124) | 80 (98) | 80 (113) | 3/15 |
| JADE posik noiseless | 30 (2) | 25 (35) | 13 (14) | 13 (14) | 13 (15) | 13 (28) | 13 (8) | 9/15 |
| JADEb posik noiseless | 16 (2) | 12 (29) | 3.3 (4) | 3.3 (6) | 3.4 (2) | 3.4 (8) | 3.5 (7) | 15/15 |
| JADEctpb posik noiseless | 30 (83) | 25 (54) | 13 (15) | 13 (17) | 13 (18) | 13 (10) | 13 (10) | 9/15 |
| MVDE melo noiseless | 40 (27) | 58 (95) | 21 (20) | 21 (32) | 21 (54) | 22 (37) | 22 (32) | 5/15 |
| NBIPOPaCMA loshchilov noiseless | 4.9 (8) | 10 (14) | 5.1 (7) | 5.1 (10) | 5.1 (7) | 5.1 (3) | 5.1 (4) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 14 (22) | 440 (548) | 173 (308) | 173 (256) | 172 (320) | 171 (156) | 171 (293) | 12/15 |
| PSO-BFGS voglis noiseless | 0.61 (0.7) | 1.7 (2) | 0.98 (2) | 0.97 (2) | 0.97 (2) | 1.1 (2) | 161 (313) | 1/15 |
| xNES schaul noiseless | 10 (8) | 72 (37) | 15 (8) | 15 (8) | 15 (8) | 15 (8) | 15 (8) | 2/3 |
| xNESas schaul noiseless | 40 (39) | 7.1 (7) | 50 (50) | 50 (161) | 50 (62) | 50 (25) | 49 (49) | 1/2 |
| Δ fopt f22, 40-D |
1e1 3090 |
1e0 35442 |
1e-1 6.5e5 |
1e-2 6.5e5 |
1e-3 6.5e5 |
1e-5 6.5e5 |
1e-7 6.5e5 |
#succ 8/30 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1184 (2428) | 1129 (2116) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 12 (20) | 343 (371) | 201 (185) | 201 (210) | 200 (363) | 200 (194) | 199 (121) | 4/15 |
| CMAES posik noiseless | 8.1 (9) | 35 (42) | 46 (41) | 46 (67) | 46 (69) | 45 (44) | 45 (54) | 1/15 |
| CMA brockhoff noiseless | 82 (226) | 149 (94) | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| CMAa brockhoff noiseless | 65 (220) | 197 (162) | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| CMAm brockhoff noiseless | 71 (431) | 147 (310) | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| CMAma brockhoff noiseless | 62 (4) | 144 (144) | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| CMAmah brockhoff noiseless | 1.2 (0.8) | 102 (85) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMAmh brockhoff noiseless | 8.6 (2) | 141 (158) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DBRCGA chuang noiseless | 167 (2) | 196 (101) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-AUTO voglis noiseless | 218 (489) | 315 (366) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-BFGS voglis noiseless | 101 (79) | 136 (121) | 87 (145) | 87 (63) | 87 (170) | 87 (57) | ∞4e6 | 0/15 |
| DE-ROLL voglis noiseless | 538 (583) | 254 (298) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 869 (972) | 1582 (1242) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DEAE posik noiseless | 84 (39) | 77 (90) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE posik noiseless | 68 (164) | 98 (50) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEb posik noiseless | 68 (325) | 98 (71) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEctpb posik noiseless | 128 (387) | 368 (988) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADE posik noiseless | 109 (486) | 119 (175) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADEb posik noiseless | 13 (0.3) | 74 (62) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADEctpb posik noiseless | 109 (486) | 119 (354) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| MVDE melo noiseless | 95 (162) | 83 (127) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 12 (6) | 112 (624) | 32 (41) | 32 (20) | 32 (19) | 32 (17) | 32 (60) | 12/15 |
| NIPOPaCMA loshchilov noiseless | 179 (15) | 583 (781) | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| PSO-BFGS voglis noiseless | 0.79 (0.4) | 22 (31) | 6.6 (13) | 6.6 (3) | 6.6 (5) | 9.4 (5) | ∞4e6 | 0/15 |
| Δ fopt f23, 40-D |
1e1 7.0 |
1e0 11925 |
1e-1 75453 |
1e-2 6.6e5 |
1e-3 1.3e6 |
1e-5 3.2e6 |
1e-7 3.4e6 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | 1.3 (0.9) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 8.5 (9) | 7.8 (3) | 1.3 (1) | 1.0 (0.3) | 1.9 (1) | 1.00 (0.8) | 0.99 (0.3) | 15/15 |
| CMAES posik noiseless | 5.0 (15) | 2478 (3019) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA brockhoff noiseless | 4.2 (4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| CMAa brockhoff noiseless | 4.9 (4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| CMAm brockhoff noiseless | 5.9 (6) | 4975 (5543) | 787 (552) | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| CMAma brockhoff noiseless | 3.3 (3) | 2196 (784) | 760 (1852) | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| CMAmah brockhoff noiseless | 7.5 (4) | 859 (791) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| CMAmh brockhoff noiseless | 7.5 (6) | 4340 (5296) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DBRCGA chuang noiseless | 1.1 (0.7) | 350 (178) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-AUTO voglis noiseless | 1.4 (3) | 6.7 (3) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-BFGS voglis noiseless | 0.99 (0.9) | 7.0 (6) | 748 (610) | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-ROLL voglis noiseless | 0.74 (0.8) | 47 (34) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | 1.3 (1) | 0.43 (0.5)★3 | 354 (371) | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DEAE posik noiseless | 0.93 (1) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE posik noiseless | 2.0 (3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEb posik noiseless | 2.0 (3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEctpb posik noiseless | 1.1 (0.7) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADE posik noiseless | 2.2 (3) | 95 (46) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADEb posik noiseless | 1.4 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADEctpb posik noiseless | 2.2 (3) | 95 (41) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| MVDE melo noiseless | 1.1 (0.8) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 8.8 (8) | 10 (8) | 1.6 (2) | 2.4 (0.8) | 1.3 (0.3) | 0.58 (0.0) | 0.59 (0.2) | 15/15 |
| NIPOPaCMA loshchilov noiseless | 6.0 (9) | 61 (20) | 11 (3) | 1.3 (0.3) | 0.72 (0.1) | 0.36 (0.1) | 0.38 (0.1) | 15/15 |
| PSO-BFGS voglis noiseless | 1.5 (1) | 4.3 (2) | 84 (55) | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| Δ fopt f24, 40-D |
1e1 5.8e6 |
1e0 9.8e7 |
1e-1 3.0e8 |
1e-2 3.0e8 |
1e-3 3.0e8 |
1e-5 3.0e8 |
1e-7 3.0e8 |
#succ 1/15 |
|---|---|---|---|---|---|---|---|---|
| ACOR liao noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BIPOPaCMA loshchilov noiseless | 3.6 (3) | 1.4 (0.9) | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| CMAES posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA brockhoff noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e6 | 0/15 |
| CMAa brockhoff noiseless | 19 (24) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e6 | 0/15 |
| CMAm brockhoff noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e6 | 0/15 |
| CMAma brockhoff noiseless | 9.0 (12) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e6 | 0/15 |
| CMAmah brockhoff noiseless | 10 (13) | 1.2 (1) | ∞ | ∞ | ∞ | ∞ | ∞8e6 | 0/15 |
| CMAmh brockhoff noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e6 | 0/15 |
| DBRCGA chuang noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-AUTO voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-BFGS voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-ROLL voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-SIMPLEX voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| DEAE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DEctpb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADE posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADEb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| JADEctpb posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| MVDE melo noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NBIPOPaCMA loshchilov noiseless | 2.1 (3) | 0.19 (0.2) | 0.97 (0.9) | 0.97 (1) | 0.97 (0.9) | 0.97 (0.9) | 0.97 (1) | 2/15 |
| NIPOPaCMA loshchilov noiseless | 1.2 (2) | 0.15 (0.1) | 0.44 (0.4) | 0.44 (0.3) | 0.44 (0.4) | 0.44 (0.4) | 0.44 (0.5) | 4/15 |
| PSO-BFGS voglis noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |