Last dimension | Dimension = 2 | Next dimension
| Δ fopt f1, 2-D |
1e1 2.0 |
1e0 6.0 |
1e-1 6.0 |
1e-2 6.0 |
1e-3 6.0 |
1e-5 6.0 |
1e-7 6.0 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 2.5 (1) | 9.2 (12) | 53 (53) | 171 (104) | 289 (124) | 635 (71) | 969 (171) | 15/15 |
| AMALGAM bosman noiseless | 1.9 (2) | 4.1 (3) | 10 (4) | 14 (6) | 23 (6) | 32 (5) | 46 (6) | 15/15 |
| BAYEDA gallagher noiseless | 1.7 (1) | 4.0 (4) | 17 (7) | 79 (168) | 106 (192) | 158 (178) | 208 (17) | 14/15 |
| BFGS ros noiseless | 3.0 (1) | 1.1 (0.1) | 1.2 (0) | 1.2 (0) | 1.2 (0) | 1.2 (0) | 1.2 (0) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 2.9 (1) | 3.6 (2) | 8.1 (7) | 13 (5) | 19 (5) | 29 (4) | 39 (6) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 3.0 (2) | 3.4 (3) | 7.2 (3) | 11 (4) | 14 (4) | 22 (5) | 29 (6) | 30/30 |
| Cauchy-EDA posik noiseless | 17 (18) | 14 (14) | 26 (15) | 39 (18) | 50 (17) | 75 (30) | 101 (24) | 15/15 |
| DASA korosec noiseless | 35 (21) | 21 (10) | 41 (17) | 52 (24) | 62 (25) | 95 (33) | 124 (59) | 15/15 |
| DE-PSO garcia-nieto noiseless | 1.9 (1) | 11 (8) | 25 (15) | 46 (19) | 51 (18) | 125 (13) | 168 (9) | 15/15 |
| DIRECT posik noiseless | 0.90 (0.4) | 1.3 (0.9) | 2.3 (2) | 9.4 (2) | 15 (2) | 32 (3) | 56 (10) | 5/5 |
| EDA-PSO el-abd noiseless | 1.7 (1) | 4.7 (3) | 19 (7) | 34 (15) | 53 (20) | 111 (30) | 212 (88) | 15/15 |
| FULLNEWUOA ros noiseless | 2.4 (2) | 1.1 (0) | 1.2 (0) | 1.2 (0) | 1.2 (0) | 1.2 (0) | 1.2 (0) | 15/15 |
| G3PCX posik noiseless | 1.7 (2) | 5.6 (3) | 16 (7) | 19 (2) | 24 (5) | 34 (5) | 46 (6) | 15/15 |
| GA nicolau noiseless | 2.5 (2) | 6.8 (3) | 59 (19) | 310 (204) | 1077 (518) | 2600 (712) | 4460 (1247) | 15/15 |
| GLOBAL pal noiseless | 1.7 (2) | 5.4 (3) | 37 (13) | 50 (9) | 54 (0.2) | 56 (0.5) | 58 (0.4) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 3.5 (3) | 5.6 (5) | 9.0 (6) | 14 (4) | 18 (4) | 28 (6) | 38 (9) | 15/15 |
| LSfminbnd posik noiseless | 7.0 (7) | 3.0 (2) | 3.4 (2) | 4.1 (2) | 4.1 (2) | 4.1 (2) | 4.1 (2) | 15/15 |
| LSstep posik noiseless | 41 (50) | 32 (33) | 59 (17) | 63 (17) | 68 (0.1) | 69 (0.2) | 69 (0.2) | 15/15 |
| MA-LS-CHAIN molina noiseless | 2.1 (0.9) | 7.0 (8) | 24 (15) | 40 (9) | 67 (15) | 92 (5) | 101 (8) | 15/15 |
| MCS huyer noiseless | 0.90 (0.5) | 1.4 (1) | 2.0 (1) | 2.6 (1) | 2.6 (1) | 2.6 (1) | 2.6 (1) | 15/15 |
| NELDERDOERR doerr noiseless | 0.93 (0.4) | 1.4 (0.8) | 2.7 (0.5) | 4.1 (0.5) | 5.3 (0.4) | 7.6 (0.7) | 10 (0.4) | 15/15 |
| NELDER hansen noiseless | 1.9 (0.6) | 1.2 (0.6) | 2.8 (0.6) | 3.9 (0.2) | 5.1 (0.6) | 7.4 (0.6) | 10 (1) | 15/15 |
| NEWUOA ros noiseless | 2.5 (1) | 0.94 (0.2) | 0.94 (0) | 1.0 (0.2)★ | 1.0 (0)★ | 1.0 (0)★ | 1.0 (0)★ | 15/15 |
| ONEFIFTH auger noiseless | 3.1 (2) | 2.6 (2) | 6.4 (4) | 10 (5) | 14 (3) | 23 (5) | 30 (4) | 15/15 |
| POEMS kubalik noiseless | 156 (113) | 75 (34) | 107 (32) | 396 (224) | 679 (72) | 1322 (255) | 2069 (483) | 15/15 |
| PSO Bounds el-abd noiseless | 2.1 (2) | 5.7 (4) | 24 (18) | 89 (84) | 271 (168) | 774 (222) | 1223 (269) | 15/15 |
| PSO el-abd noiseless | 1.9 (2) | 5.0 (7) | 19 (14) | 59 (12) | 118 (51) | 255 (76) | 472 (116) | 15/15 |
| RANDOMSEARCH auger noiseless | 1.3 (0.5) | 9.2 (12) | 46 (39) | 540 (822) | 5943 (1982) | 6.8e5 (5e5) | ∞2e6 | 0/15 |
| Rosenbrock posik noiseless | 5.0 (4) | 3.0 (0.8) | 3.7 (2) | 4.9 (2) | 6.2 (2) | 8.8 (1) | 11 (2) | 15/15 |
| VNS garcia-martinez noiseless | 2.3 (1) | 8.4 (6) | 23 (12) | 33 (4) | 37 (5) | 48 (6) | 60 (4) | 15/15 |
| iAMALGAM bosman noiseless | 2.1 (0.9) | 3.6 (3) | 6.4 (3) | 12 (4) | 14 (7) | 22 (4) | 31 (3) | 15/15 |
| Δ fopt f2, 2-D |
1e1 16 |
1e0 19 |
1e-1 25 |
1e-2 25 |
1e-3 26 |
1e-5 28 |
1e-7 29 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 59 (45) | 122 (23) | 128 (38) | 164 (31) | 203 (46) | 258 (31) | 325 (39) | 15/15 |
| AMALGAM bosman noiseless | 6.4 (3) | 7.5 (2) | 7.4 (4) | 9.2 (1) | 10 (2) | 13 (3) | 15 (3) | 15/15 |
| BAYEDA gallagher noiseless | 82 (129) | 78 (58) | 81 (164) | 89 (124) | 111 (82) | 139 (252) | 141 (67) | 9/15 |
| BFGS ros noiseless | 2.6 (1) | 4.0 (2) | 3.7 (0.8) | 4.0 (1) | 4.0 (1) | 4.1 (0.8) | 4.3 (0.8) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 13 (11) | 19 (7) | 17 (3) | 18 (4) | 19 (5) | 20 (3) | 22 (2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 10 (8) | 13 (3) | 13 (1) | 13 (3) | 14 (1) | 15 (2) | 16 (1) | 30/30 |
| Cauchy-EDA posik noiseless | 18 (16) | 18 (15) | 18 (7) | 20 (8) | 23 (9) | 25 (6) | 29 (7) | 15/15 |
| DASA korosec noiseless | 19 (8) | 21 (14) | 21 (5) | 22 (5) | 23 (4) | 26 (9) | 30 (10) | 15/15 |
| DE-PSO garcia-nieto noiseless | 18 (9) | 26 (6) | 26 (3) | 31 (6) | 35 (7) | 45 (5) | 52 (5) | 15/15 |
| DIRECT posik noiseless | 7.6 (1) | 7.9 (1) | 7.0 (1) | 8.6 (0.8) | 9.4 (0.8) | 13 (6) | 46 (52) | 5/5 |
| EDA-PSO el-abd noiseless | 14 (3) | 19 (3) | 20 (5) | 26 (7) | 38 (11) | 65 (16) | 87 (17) | 15/15 |
| FULLNEWUOA ros noiseless | 2.4 (3) | 5.8 (3) | 8.2 (7) | 11 (7) | 13 (12) | 18 (5) | 23 (8) | 15/15 |
| G3PCX posik noiseless | 14 (31) | 64 (46) | 68 (52) | 77 (46) | 82 (75) | 82 (56) | 81 (54) | 15/15 |
| GA nicolau noiseless | 136 (129) | 324 (194) | 416 (178) | 547 (196) | 776 (232) | 1260 (350) | 1868 (390) | 15/15 |
| GLOBAL pal noiseless | 19 (0.2) | 17 (0.5) | 13 (0.2) | 14 (0.3) | 13 (0.2) | 13 (0.2) | 13 (0.2) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 14 (12) | 19 (3) | 15 (6) | 17 (4) | 18 (3) | 18 (3) | 20 (3) | 15/15 |
| LSfminbnd posik noiseless | 1.0 (1.0) | 1.00 (1) | 0.99 (0.5) | 1.0 (0.4)★ | 0.99 (0.4)★ | 1 (0.5)★ | 0.99 (0.3)★ | 15/15 |
| LSstep posik noiseless | 10 (12) | 10 (11) | 7.8 (7) | 8.0 (7) | 7.7 (3) | 7.3 (6) | 7.2 (3) | 15/15 |
| MA-LS-CHAIN molina noiseless | 17 (5) | 21 (4) | 20 (7) | 25 (9) | 28 (6) | 29 (6) | 33 (10) | 15/15 |
| MCS huyer noiseless | 1.4 (0.6) | 1.8 (0.3) | 1.7 (1) | 2.6 (0.6) | 3.1 (0.4) | 3.7 (0.7) | 24 (33) | 15/15 |
| NELDERDOERR doerr noiseless | 1.7 (0.3) | 1.9 (0.2) | 1.7 (0.2) | 2.0 (0.2) | 2.1 (0.1) | 2.5 (0.2) | 3.0 (0.2) | 15/15 |
| NELDER hansen noiseless | 1.7 (0.4) | 1.8 (0.6) | 1.7 (0.5) | 2.1 (0.3) | 2.2 (0.3) | 2.6 (0.3) | 3.0 (0.4) | 15/15 |
| NEWUOA ros noiseless | 2.3 (1) | 8.8 (3) | 12 (7) | 15 (8) | 19 (8) | 26 (9) | 34 (12) | 15/15 |
| ONEFIFTH auger noiseless | 8873 (5838) | 4.6e4 (4e4) | 1.2e5 (2e5) | 3.8e5 (3e5) | ∞ | ∞ | ∞2e6 | 0/15 |
| POEMS kubalik noiseless | 385 (242) | 419 (157) | 390 (113) | 471 (189) | 510 (169) | 631 (148) | 770 (209) | 15/15 |
| PSO Bounds el-abd noiseless | 56 (35) | 173 (347) | 303 (629) | 361 (187) | 400 (315) | 531 (500) | 774 (252) | 15/15 |
| PSO el-abd noiseless | 57 (56) | 82 (52) | 82 (27) | 99 (31) | 117 (17) | 156 (24) | 193 (22) | 15/15 |
| RANDOMSEARCH auger noiseless | 250 (311) | 1212 (1814) | 5573 (7616) | 1.0e5 (1e5) | ∞ | ∞ | ∞2e6 | 0/15 |
| Rosenbrock posik noiseless | 2.6 (2) | 3.7 (3) | 4.3 (3) | 5.5 (2) | 6.2 (2) | 6.9 (2) | 7.8 (2) | 15/15 |
| VNS garcia-martinez noiseless | 22 (14) | 27 (9) | 24 (10) | 26 (3) | 26 (2) | 26 (4) | 28 (2) | 15/15 |
| iAMALGAM bosman noiseless | 5.3 (2) | 9.2 (5) | 9.0 (4) | 10 (4) | 11 (2) | 12 (4) | 14 (5) | 15/15 |
| Δ fopt f3, 2-D |
1e1 15 |
1e0 271 |
1e-1 445 |
1e-2 446 |
1e-3 450 |
1e-5 454 |
1e-7 464 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 9.0 (7) | 6.7 (4) | 6.4 (3) | 11 (5) | 12 (5) | 19 (2) | 23 (2) | 15/15 |
| AMALGAM bosman noiseless | 3.7 (3) | 4.6 (7) | 12 (8) | 12 (16) | 12 (10) | 13 (17) | 13 (23) | 15/15 |
| BAYEDA gallagher noiseless | 4.3 (4) | 4.0 (2) | 10 (8) | 18 (21) | 41 (45) | 65 (97) | 64 (41) | 1/15 |
| BFGS ros noiseless | 14 (12) | 3.1 (3) | 10 (22) | 10 (10) | 10 (10) | 10 (8) | 10 (14) | 10/15 |
| BIPOP-CMA-ES hansen noiseless | 3.4 (4) | 3.5 (3) | 5.2 (6) | 6.2 (8) | 6.4 (3) | 6.5 (12) | 6.7 (7) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 6.7 (17) | 3.8 (3) | 7.9 (3) | 7.9 (12) | 7.9 (4) | 7.9 (15) | 7.8 (16) | 30/30 |
| Cauchy-EDA posik noiseless | 9.3 (13) | 3.3 (2) | 8.4 (6) | 33 (18) | 43 (50) | 43 (43) | 43 (22) | 15/15 |
| DASA korosec noiseless | 18 (14) | 1.8 (1) | 6.9 (2) | 7.0 (15) | 7.1 (8) | 7.4 (2) | 7.6 (4) | 15/15 |
| DE-PSO garcia-nieto noiseless | 5.5 (7) | 2.3 (0.9) | 2.7 (0.9) | 4.0 (0.9) | 4.5 (1) | 5.4 (1) | 6.4 (1) | 15/15 |
| DIRECT posik noiseless | 2.6 (1.0) | 1.0 (0.5) | 2.4 (2) | 2.4 (2) | 2.5 (2) | 2.7 (2) | 3.0 (1) | 5/5 |
| EDA-PSO el-abd noiseless | 4.7 (5) | 6.4 (6) | 14 (7) | 19 (2) | 20 (1) | 21 (2) | 22 (2) | 15/15 |
| FULLNEWUOA ros noiseless | 2.3 (4) | 1.8 (3) | 2.2 (2) | 2.2 (2) | 2.2 (2) | 2.1 (2) | 2.1 (2) | 15/15 |
| G3PCX posik noiseless | 4.0 (4) | 7.8 (18) | 40 (24) | 40 (39) | 39 (36) | 39 (28) | 39 (27) | 15/15 |
| GA nicolau noiseless | 8.1 (14) | 13 (9) | 19 (6) | 27 (7) | 40 (10) | 70 (12) | 108 (14) | 15/15 |
| GLOBAL pal noiseless | 6.9 (10) | 1.8 (0.9) | 3.1 (2) | 3.1 (2) | 3.1 (5) | 3.1 (4) | 3.1 (4) | 9/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.3 (1) | 3.4 (2) | 7.6 (9) | 8.5 (7) | 9.2 (8) | 10 (10) | 10 (10) | 15/15 |
| LSfminbnd posik noiseless | 17 (10) | 32 (49) | 43 (52) | 64 (141) | 63 (94) | 63 (57) | 61 (130) | 3/15 |
| LSstep posik noiseless | 24 (6) | 1.5 (0.1) | 1 (0.0) | 1.0 (0.0) | 1.0 (0.0) | 1.0 (0.0) | 1.00 (0.1) | 15/15 |
| MA-LS-CHAIN molina noiseless | 5.5 (2) | 1.7 (0.4) | 2.5 (1) | 2.6 (2) | 2.7 (1) | 2.8 (2) | 2.9 (2) | 15/15 |
| MCS huyer noiseless | 1.5 (0.5) | 1.1 (1) | 1.5 (0.6) | 1.6 (0.5) | 1.6 (0.6) | 2.6 (0.6) | 2.6 (3) | 15/15 |
| NELDERDOERR doerr noiseless | 0.98 (0.5) | 1.00 (2) | 1.7 (2) | 1.8 (2) | 1.8 (2) | 1.8 (2) | 1.8 (2) | 15/15 |
| NELDER hansen noiseless | 1.4 (1) | 4.0 (8) | 13 (27) | 13 (11) | 13 (15) | 12 (38) | 12 (7) | 15/15 |
| NEWUOA ros noiseless | 4.7 (9) | 1.5 (2) | 4.2 (2) | 4.2 (3) | 4.2 (2) | 4.1 (12) | 4.1 (1) | 14/15 |
| ONEFIFTH auger noiseless | 11 (16) | 5.0 (6) | 15 (17) | 15 (6) | 15 (18) | 15 (10) | 14 (17) | 15/15 |
| POEMS kubalik noiseless | 41 (13) | 10 (6) | 14 (5) | 20 (4) | 24 (4) | 32 (3) | 41 (4) | 15/15 |
| PSO Bounds el-abd noiseless | 4.6 (9) | 5.3 (3) | 8.3 (5) | 14 (5) | 18 (3) | 26 (8) | 34 (15) | 15/15 |
| PSO el-abd noiseless | 5.0 (3) | 3.3 (2) | 3.4 (2) | 4.7 (4) | 6.0 (3) | 8.8 (1) | 11 (1) | 15/15 |
| RANDOMSEARCH auger noiseless | 14 (7) | 67 (101) | 464 (749) | 3101 (3498) | 2.1e4 (4e4) | ∞ | ∞2e6 | 0/15 |
| Rosenbrock posik noiseless | 44 (41) | 15 (13) | 26 (30) | 26 (23) | 26 (40) | 26 (11) | 25 (41) | 10/15 |
| VNS garcia-martinez noiseless | 8.6 (4) | 2.9 (2) | 4.1 (7) | 4.2 (4) | 4.2 (7) | 4.7 (2) | 7.7 (7) | 15/15 |
| iAMALGAM bosman noiseless | 1.7 (1) | 6.3 (7) | 17 (32) | 17 (52) | 17 (33) | 17 (52) | 17 (5) | 15/15 |
| Δ fopt f4, 2-D |
1e1 22 |
1e0 344 |
1e-1 459 |
1e-2 496 |
1e-3 523 |
1e-5 544 |
1e-7 566 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 8.9 (12) | 7.1 (3) | 8.3 (4) | 10 (5) | 12 (3) | 17 (1) | 20 (3) | 15/15 |
| AMALGAM bosman noiseless | 2.6 (1) | 5.6 (13) | 51 (56) | 48 (100) | 48 (91) | 47 (98) | 45 (90) | 15/15 |
| BAYEDA gallagher noiseless | 4.4 (6) | 13 (10) | 62 (69) | 117 (173) | 112 (239) | ∞ | ∞4000 | 0/15 |
| BFGS ros noiseless | 11 (12) | 5.7 (6) | 12 (9) | 11 (9) | 11 (8) | 10 (13) | 10 (12) | 9/15 |
| BIPOP-CMA-ES hansen noiseless | 2.6 (3) | 6.9 (6) | 55 (24) | 97 (119) | 99 (186) | 99 (74) | 106 (189) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 5.2 (32) | 5.5 (5) | 27 (27) | 25 (20) | 24 (24) | 23 (22) | 22 (19) | 19/25 |
| Cauchy-EDA posik noiseless | 6.7 (7) | 13 (15) | 75 (77) | 405 (507) | 468 (574) | 450 (866) | 433 (242) | 5/15 |
| DASA korosec noiseless | 15 (8) | 2.0 (2) | 3.6 (4) | 3.4 (6) | 3.3 (3) | 3.4 (3) | 3.4 (1) | 15/15 |
| DE-PSO garcia-nieto noiseless | 7.2 (2) | 4.2 (0.8) | 6.5 (5) | 11 (10) | 17 (12) | 17 (9) | 35 (48) | 0/15 |
| DIRECT posik noiseless | 1.8 (1) | 1.8 (2) | 6.6 (7) | 6.1 (9) | 14 (14) | 16 (17) | 16 (16) | 5/5 |
| EDA-PSO el-abd noiseless | 4.2 (2) | 10 (9) | 18 (5) | 19 (2) | 19 (2) | 19 (2) | 20 (2) | 15/15 |
| FULLNEWUOA ros noiseless | 5.3 (7) | 3.9 (4) | 15 (25) | 14 (6) | 13 (10) | 13 (11) | 12 (22) | 12/15 |
| G3PCX posik noiseless | 20 (60) | 17 (16) | 76 (74) | 70 (48) | 67 (13) | 64 (56) | 62 (58) | 14/15 |
| GA nicolau noiseless | 10 (13) | 16 (8) | 22 (7) | 28 (5) | 37 (8) | 60 (13) | 105 (21) | 15/15 |
| GLOBAL pal noiseless | 8.4 (6) | 1.2 (0.6) | 5.2 (7) | 4.8 (5) | 4.6 (3) | 4.5 (6) | 4.3 (8) | 7/15 |
| IPOP-SEP-CMA-ES ros noiseless | 3.0 (5) | 8.6 (10) | 75 (38) | 178 (156) | 267 (172) | 258 (317) | 249 (268) | 2/15 |
| LSfminbnd posik noiseless | 0.99 (0.2) | 45 (40) | 119 (148) | 226 (122) | ∞ | ∞ | ∞7124 | 0/15 |
| LSstep posik noiseless | 19 (0.2) | 1.3 (0.0) | 1.0 (0.1) | 1.0 (0.2) | 1.00 (0.2) | 1.00 (0.2) | 1.00 (0.2) | 15/15 |
| MA-LS-CHAIN molina noiseless | 5.5 (4) | 1.8 (0.8) | 4.4 (3) | 4.2 (3) | 4.1 (2) | 4.1 (2) | 4.1 (3) | 15/15 |
| MCS huyer noiseless | 2.0 (0.5) | 1.00 (0.8) | 2.9 (2) | 2.7 (2) | 2.7 (1) | 2.7 (1) | 2.6 (1) | 15/15 |
| NELDERDOERR doerr noiseless | 1.9 (2) | 1.4 (2) | 3.5 (3) | 3.2 (2) | 3.1 (2) | 3.0 (2) | 3.0 (3) | 15/15 |
| NELDER hansen noiseless | 5.0 (20) | 5.3 (7) | 27 (22) | 25 (44) | 24 (17) | 23 (37) | 22 (8) | 15/15 |
| NEWUOA ros noiseless | 5.0 (4) | 4.5 (4) | 18 (21) | 16 (25) | 16 (19) | 15 (18) | 14 (27) | 10/15 |
| ONEFIFTH auger noiseless | 4.5 (6) | 5.5 (4) | 23 (27) | 21 (24) | 20 (23) | 20 (15) | 19 (22) | 15/15 |
| POEMS kubalik noiseless | 36 (17) | 10 (5) | 22 (7) | 23 (25) | 29 (4) | 35 (3) | 41 (40) | 15/15 |
| PSO Bounds el-abd noiseless | 4.4 (4) | 6.3 (4) | 10 (5) | 17 (14) | 21 (6) | 27 (15) | 33 (6) | 15/15 |
| PSO el-abd noiseless | 4.0 (3) | 3.3 (3) | 4.6 (4) | 5.6 (3) | 6.4 (2) | 8.7 (4) | 11 (4) | 15/15 |
| RANDOMSEARCH auger noiseless | 8.6 (6) | 67 (102) | 617 (1164) | 8201 (6082) | 2.8e4 (4e4) | ∞ | ∞2e6 | 0/15 |
| Rosenbrock posik noiseless | 26 (50) | 15 (20) | 52 (55) | 48 (37) | 46 (43) | 44 (72) | 42 (44) | 7/15 |
| VNS garcia-martinez noiseless | 5.0 (3) | 4.1 (4) | 8.8 (11) | 8.2 (7) | 7.9 (10) | 8.8 (10) | 17 (14) | 15/15 |
| iAMALGAM bosman noiseless | 2.5 (2) | 9.5 (6) | 61 (81) | 57 (48) | 56 (39) | 55 (53) | 54 (27) | 15/15 |
| Δ fopt f5, 2-D |
1e1 4.0 |
1e0 4.0 |
1e-1 4.0 |
1e-2 4.0 |
1e-3 4.0 |
1e-5 4.0 |
1e-7 4.0 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 8.0 (7) | 83 (8) | 110 (8) | 114 (10) | 114 (28) | 114 (42) | 114 (26) | 15/15 |
| AMALGAM bosman noiseless | 4.9 (5) | 18 (6) | 20 (8) | 20 (7) | 20 (6) | 20 (8) | 20 (12) | 15/15 |
| BAYEDA gallagher noiseless | 3.0 (3) | 101 (25) | 112 (26) | 113 (502) | 113 (532) | 113 (44) | 113 (502) | 14/15 |
| BFGS ros noiseless | 1.4 (0.4) | 3.1 (0) | 3.1 (0) | 3.1 (0) | 3.1 (0.4) | 3.1 (0.8) | 3.1 (0.8) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 3.1 (2) | 5.9 (4) | 6.3 (3) | 6.4 (3) | 6.4 (2) | 6.4 (3) | 6.4 (4) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 1.7 (0.8) | 3.4 (2) | 3.8 (0.9) | 3.8 (1) | 3.8 (2) | 3.8 (2) | 3.8 (2) | 15/15 |
| Cauchy-EDA posik noiseless | 15 (10) | 18 (10) | 19 (11) | 19 (11) | 19 (10) | 19 (8) | 19 (10) | 15/15 |
| DASA korosec noiseless | 18 (13) | 35 (12) | 44 (13) | 51 (12) | 58 (8) | 73 (16) | 88 (15) | 15/15 |
| DE-PSO garcia-nieto noiseless | 5.6 (9) | 38 (14) | 39 (11) | 40 (11) | 40 (12) | 40 (14) | 40 (11) | 15/15 |
| DIRECT posik noiseless | 3.1 (0.1) | 3.1 (0.1) | 4.7 (0.1) | 4.7 (0.1) | 4.7 (0.1) | 4.7 (0.1) | 4.7 (0.1) | 5/5 |
| EDA-PSO el-abd noiseless | 4.6 (5) | 16 (9) | 18 (4) | 19 (5) | 19 (6) | 19 (5) | 19 (6) | 15/15 |
| FULLNEWUOA ros noiseless | 0.92 (0.4) | 1.3 (0.4) | 1.5 (0) | 1.5 (0) | 1.5 (0) | 1.5 (0) | 1.5 (0) | 15/15 |
| G3PCX posik noiseless | 3.8 (4) | 32 (15) | 34 (19) | 34 (4) | 34 (18) | 34 (10) | 34 (5) | 15/15 |
| GA nicolau noiseless | 3.9 (4) | 336 (311) | 2152 (496) | 4672 (694) | 6958 (1525) | 1.7e4 (3496) | 7.5e5 (6e5) | 0/15 |
| GLOBAL pal noiseless | 4.0 (4) | 76 (0.6) | 77 (0.6) | 77 (0.5) | 77 (0.5) | 77 (0.5) | 77 (0.5) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 3.6 (3) | 7.3 (4) | 7.8 (5) | 7.8 (7) | 7.8 (4) | 7.8 (5) | 7.8 (3) | 15/15 |
| LSfminbnd posik noiseless | 4.5 (4) | 8.0 (0.1) | 9.3 (0.1) | 10 (0) | 10 (0) | 10 (0) | 10 (0) | 15/15 |
| LSstep posik noiseless | 54 (50) | 87 (0.1) | 100 (0.1) | 100 (0.1) | 100 (0.1) | 100 (0.1) | 100 (0.1) | 15/15 |
| MA-LS-CHAIN molina noiseless | 4.3 (7) | 89 (42) | 136 (4) | 139 (8) | 139 (6) | 139 (11) | 139 (8) | 15/15 |
| MCS huyer noiseless | 1.1 (0.1) | 1.1 (0.1) | 1.1 (0.1)★ | 1.1 (0.1)★ | 1.1 (0.1)★ | 1.1 (0.1)★ | 1.1 (0.1)★ | 15/15 |
| NELDERDOERR doerr noiseless | 1.1 (0.4) | 2.1 (0.9) | 2.1 (1) | 2.1 (1) | 2.1 (0.9) | 2.1 (0.9) | 2.1 (0.8) | 15/15 |
| NELDER hansen noiseless | 1.6 (0.2) | 2.3 (0.9) | 2.4 (0.2) | 2.4 (0.9) | 2.4 (1) | 2.4 (0.9) | 2.4 (0.9) | 15/15 |
| NEWUOA ros noiseless | 1 (0.3) | 1.6 (0.2) | 1.7 (0.2) | 1.7 (0.2) | 1.7 (0.1) | 1.7 (0.2) | 1.7 (0.2) | 15/15 |
| ONEFIFTH auger noiseless | 1.8 (1) | 2.6 (2) | 2.7 (2) | 2.8 (0.8) | 2.8 (0.5) | 2.8 (1) | 2.8 (2) | 15/15 |
| POEMS kubalik noiseless | 126 (26) | 170 (57) | 190 (74) | 199 (90) | 204 (98) | 204 (27) | 204 (52) | 15/15 |
| PSO Bounds el-abd noiseless | 5.5 (5) | 14 (6) | 17 (8) | 17 (8) | 17 (5) | 17 (7) | 17 (7) | 15/15 |
| PSO el-abd noiseless | 3.8 (3) | 19 (6) | 23 (8) | 23 (9) | 23 (10) | 23 (10) | 23 (6) | 15/15 |
| RANDOMSEARCH auger noiseless | 4.0 (5) | 582 (713) | 5.4e4 (6e4) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Rosenbrock posik noiseless | 3.2 (2) | 3.7 (0.8) | 3.8 (0.7) | 3.8 (0.4) | 3.8 (0.6) | 3.8 (0.6) | 3.8 (0.8) | 15/15 |
| VNS garcia-martinez noiseless | 5.8 (6) | 29 (2) | 30 (3) | 30 (3) | 30 (3) | 30 (2) | 30 (3) | 15/15 |
| iAMALGAM bosman noiseless | 4.2 (3) | 14 (13) | 14 (3) | 14 (4) | 14 (5) | 14 (6) | 14 (5) | 15/15 |
| Δ fopt f6, 2-D |
1e1 13 |
1e0 23 |
1e-1 41 |
1e-2 54 |
1e-3 67 |
1e-5 95 |
1e-7 124 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 2.2 (2) | 12 (14) | 31 (21) | 50 (18) | 62 (15) | 79 (18) | 83 (7) | 15/15 |
| AMALGAM bosman noiseless | 2.1 (3) | 4.5 (2) | 4.9 (3) | 5.5 (1) | 6.2 (1.0) | 6.7 (0.9) | 7.1 (0.7) | 15/15 |
| BAYEDA gallagher noiseless | 1.5 (1) | 163 (313) | 640 (1463) | ∞ | ∞ | ∞ | ∞4000 | 0/15 |
| BFGS ros noiseless | 4.1 (4) | 3.3 (2) | 2.7 (1) | 2.3 (0.9) | 2.0 (0.8) | 1.7 (0.6) | 1.6 (0.5) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 2.0 (3) | 2.8 (2) | 3.6 (2) | 3.9 (1) | 4.2 (0.9) | 4.1 (0.5) | 4.3 (0.6) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 2.1 (2) | 2.9 (2) | 2.3 (0.9) | 2.2 (0.4) | 2.2 (0.8) | 2.2 (0.4) | 2.1 (0.4) | 15/15 |
| Cauchy-EDA posik noiseless | 15 (11) | 18 (15) | 17 (8) | 17 (5) | 17 (7) | 16 (7) | 16 (2) | 15/15 |
| DASA korosec noiseless | 22 (20) | 22 (20) | 18 (12) | 19 (11) | 19 (11) | 18 (8) | 18 (5) | 15/15 |
| DE-PSO garcia-nieto noiseless | 3.7 (5) | 10 (3) | 12 (1.0) | 14 (3) | 14 (2) | 16 (2) | 17 (1) | 15/15 |
| DIRECT posik noiseless | 1.3 (2) | 7.5 (10) | 5.8 (6) | 124 (118) | 801 (854) | 1226 (1786) | 975 (543) | 3/5 |
| EDA-PSO el-abd noiseless | 3.1 (2) | 12 (5) | 12 (6) | 15 (7) | 19 (8) | 29 (9) | 34 (9) | 15/15 |
| FULLNEWUOA ros noiseless | 3.3 (2) | 3.7 (4) | 3.2 (2) | 3.5 (3) | 3.7 (2) | 4.1 (1) | 4.5 (2) | 15/15 |
| G3PCX posik noiseless | 2.2 (2) | 4.4 (1) | 3.7 (0.7) | 3.9 (0.4) | 3.9 (1.0) | 3.8 (0.7) | 4.1 (1) | 15/15 |
| GA nicolau noiseless | 3.4 (4) | 13 (7) | 85 (71) | 1000 (1922) | 3073 (4512) | 3568 (5378) | 4909 (6145) | 3/15 |
| GLOBAL pal noiseless | 2.2 (1) | 8.7 (6) | 7.4 (0.2) | 6.1 (0.2) | 5.2 (0.1) | 3.9 (0.1) | 3.2 (0.1) | 12/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.7 (1) | 4.0 (4) | 3.8 (0.8) | 4.5 (1) | 4.6 (2) | 4.6 (2) | 4.4 (1) | 15/15 |
| LSfminbnd posik noiseless | 276 (388) | 371 (1869) | 289 (366) | 257 (280) | 210 (2) | 153 (266) | 121 (326) | 9/15 |
| LSstep posik noiseless | 890 (842) | 574 (693) | 375 (402) | 330 (302) | 709 (564) | ∞ | ∞2e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 2.2 (2) | 13 (10) | 14 (11) | 14 (2) | 12 (5) | 10 (6) | 10 (4) | 15/15 |
| MCS huyer noiseless | 51 (104) | 29 (10) | 19 (20) | 42 (48) | 102 (62) | 102 (320) | 117 (315) | 12/15 |
| NELDERDOERR doerr noiseless | 1.2 (0.6) | 1.3 (0.4) | 1 (0.1) | 1.00 (0.1) | 1 (0.2) | 1.00 (0.1) | 1.0 (0.1) | 15/15 |
| NELDER hansen noiseless | 0.97 (0.6) | 0.99 (0.5) | 1.1 (1) | 1.1 (0.2) | 1.1 (0.8) | 1.1 (0.2) | 1.1 (0.4) | 15/15 |
| NEWUOA ros noiseless | 4.3 (5) | 4.6 (4) | 3.9 (3) | 4.4 (2) | 4.7 (2) | 4.9 (2) | 4.9 (2) | 15/15 |
| ONEFIFTH auger noiseless | 2.5 (2) | 3.7 (5) | 3.6 (2) | 3.6 (0.6) | 3.4 (3) | 3.3 (1) | 3.2 (2) | 15/15 |
| POEMS kubalik noiseless | 96 (66) | 132 (96) | 117 (67) | 137 (76) | 134 (51) | 181 (44) | 180 (21) | 15/15 |
| PSO Bounds el-abd noiseless | 2.5 (1) | 7.0 (5) | 37 (18) | 77 (160) | 133 (239) | 135 (74) | 167 (157) | 15/15 |
| PSO el-abd noiseless | 2.1 (2) | 4.5 (4) | 7.9 (9) | 18 (9) | 23 (5) | 32 (6) | 36 (8) | 15/15 |
| RANDOMSEARCH auger noiseless | 2.7 (2) | 16 (18) | 53 (71) | 780 (699) | 1.3e4 (8614) | 1.5e5 (1e5) | ∞2e6 | 0/15 |
| Rosenbrock posik noiseless | 2.1 (0.9) | 2.1 (0.5) | 1.8 (1) | 1.8 (1) | 1.8 (1.0) | 1.7 (0.4) | 1.5 (0.4) | 15/15 |
| VNS garcia-martinez noiseless | 1.9 (2) | 7.1 (5) | 6.9 (2) | 6.6 (2) | 6.3 (1) | 6.0 (0.9) | 5.7 (0.8) | 15/15 |
| iAMALGAM bosman noiseless | 2.4 (3) | 3.6 (2) | 3.8 (2) | 4.0 (0.9) | 4.1 (1) | 4.3 (1) | 4.4 (2) | 15/15 |
| Δ fopt f7, 2-D |
1e1 3.0 |
1e0 21 |
1e-1 60 |
1e-2 193 |
1e-3 217 |
1e-5 217 |
1e-7 241 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 4.4 (6) | 4.8 (5) | 12 (11) | 9.5 (3) | 11 (3) | 11 (3) | 13 (5) | 15/15 |
| AMALGAM bosman noiseless | 3.7 (4) | 20 (1) | 8.2 (0.6) | 2.7 (0.3) | 2.5 (14) | 2.5 (0.2) | 2.4 (0.1) | 15/15 |
| BAYEDA gallagher noiseless | 4.5 (2) | 3.2 (4) | 80 (117) | 85 (98) | 76 (92) | 76 (28) | 109 (195) | 1/15 |
| BFGS ros noiseless | 11 (11) | 19 (21) | 34 (44) | ∞ | ∞ | ∞ | ∞300 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 3.5 (2) | 2.6 (5) | 3.4 (5) | 1.5 (0.4) | 1.5 (2) | 1.5 (0.7) | 1.6 (2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 2.9 (3) | 1.9 (3) | 2.8 (2) | 1.0 (0.4) | 1.00 (0.7) | 1.00 (0.4) | 1.0 (1) | 15/15 |
| Cauchy-EDA posik noiseless | 20 (11) | 7.7 (17) | 5.4 (7) | 2.0 (0.7) | 1.9 (1) | 1.9 (1) | 2.1 (1) | 15/15 |
| DASA korosec noiseless | 182 (260) | 170 (125) | 311 (153) | 243 (168) | 435 (319) | 435 (386) | 392 (361) | 15/15 |
| DE-PSO garcia-nieto noiseless | 6.9 (7) | 4.9 (5) | 5.0 (3) | 2.6 (1) | 3.1 (1) | 3.1 (2) | 3.6 (1.0) | 15/15 |
| DIRECT posik noiseless | 2.2 (4) | 1.3 (0.7) | 1.0 (0.9) | 2.7 (3) | 3.0 (3) | 3.0 (6) | 2.7 (5) | 5/5 |
| EDA-PSO el-abd noiseless | 3.9 (6) | 3.1 (4) | 6.2 (5) | 6.3 (7) | 9.0 (9) | 9.0 (7) | 14 (8) | 15/15 |
| FULLNEWUOA ros noiseless | 2.2 (1) | 3.8 (13) | 3.8 (2) | 1.7 (2) | 2.9 (2) | 2.9 (6) | 2.7 (4) | 15/15 |
| G3PCX posik noiseless | 4.8 (2) | 12 (65) | 35 (63) | 19 (44) | 21 (46) | 21 (46) | 19 (15) | 15/15 |
| GA nicolau noiseless | 5.6 (4) | 4.0 (4) | 23 (20) | 24 (18) | 47 (28) | 47 (24) | 67 (25) | 14/15 |
| GLOBAL pal noiseless | 7.3 (9) | 4.1 (4) | 7.5 (6) | 2.7 (1.0) | 4.4 (1) | 4.4 (6) | 3.9 (4) | 9/15 |
| IPOP-SEP-CMA-ES ros noiseless | 5.9 (4) | 2.7 (6) | 2.8 (2) | 1.2 (0.8) | 1.3 (0.8) | 1.3 (0.8) | 1.5 (0.6) | 15/15 |
| LSfminbnd posik noiseless | 6.7 (7) | 11 (5) | 67 (94) | 55 (49) | 495 (302) | 495 (383) | 965 (1148) | 1/15 |
| LSstep posik noiseless | 277 (267) | 249 (252) | 460 (647) | 1517 (1244) | ∞ | ∞ | ∞2e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 6.2 (6) | 3.5 (3) | 4.7 (4) | 3.6 (3) | 4.6 (2) | 4.6 (2) | 4.7 (2) | 15/15 |
| MCS huyer noiseless | 1.1 (0.8) | 4.2 (5) | 4.5 (2) | 2.2 (1) | 6.5 (9) | 6.5 (9) | 6.0 (7) | 15/15 |
| NELDERDOERR doerr noiseless | 2.8 (2) | 1.0 (0.5) | 8.6 (12) | 5.4 (6) | 5.2 (6) | 5.2 (4) | 5.4 (6) | 15/15 |
| NELDER hansen noiseless | 2.7 (5) | 26 (40) | 18 (17) | 6.6 (11) | 6.5 (4) | 6.5 (8) | 5.9 (7) | 15/15 |
| NEWUOA ros noiseless | 2.7 (2) | 9.5 (13) | 9.4 (9) | 6.0 (8) | 14 (47) | 14 (29) | 12 (15) | 13/15 |
| ONEFIFTH auger noiseless | 6.0 (2) | 4.2 (3) | 4.3 (8) | 1.8 (4) | 3.3 (7) | 3.3 (9) | 3.1 (8) | 15/15 |
| POEMS kubalik noiseless | 192 (67) | 45 (31) | 41 (33) | 21 (5) | 23 (13) | 23 (15) | 28 (6) | 15/15 |
| PSO Bounds el-abd noiseless | 6.6 (6) | 3.5 (3) | 5.8 (7) | 5.0 (3) | 6.7 (3) | 6.7 (5) | 14 (5) | 15/15 |
| PSO el-abd noiseless | 4.4 (4) | 3.5 (3) | 4.8 (4) | 3.2 (1) | 3.6 (2) | 3.6 (2) | 4.4 (2) | 15/15 |
| RANDOMSEARCH auger noiseless | 5.0 (6) | 4.6 (2) | 43 (32) | 87 (118) | 150 (151) | 150 (92) | 952 (902) | 12/15 |
| Rosenbrock posik noiseless | 165 (222) | 121 (110) | 167 (63) | 78 (73) | 189 (183) | 189 (163) | 170 (172) | 2/15 |
| VNS garcia-martinez noiseless | 4.2 (4) | 3.9 (5) | 5.2 (11) | 2.1 (2) | 2.0 (2) | 2.0 (3) | 2.0 (1) | 15/15 |
| iAMALGAM bosman noiseless | 4.2 (3) | 12 (39) | 4.7 (0.5) | 2.8 (0.2) | 2.5 (8) | 2.5 (8) | 2.4 (0.1) | 15/15 |
| Δ fopt f8, 2-D |
1e1 5.0 |
1e0 12 |
1e-1 37 |
1e-2 46 |
1e-3 86 |
1e-5 94 |
1e-7 112 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 5.1 (5) | 19 (24) | 30 (20) | 66 (14) | 54 (23) | 94 (23) | 131 (51) | 15/15 |
| AMALGAM bosman noiseless | 6.7 (6) | 10 (13) | 6.7 (10) | 7.0 (9) | 4.5 (4) | 5.1 (4) | 5.0 (3) | 15/15 |
| BAYEDA gallagher noiseless | 6.1 (5) | 11 (8) | 47 (136) | 355 (283) | ∞ | ∞ | ∞4000 | 0/15 |
| BFGS ros noiseless | 4.5 (4) | 5.1 (4) | 2.4 (2) | 2.2 (0.5) | 1.3 (0.6) | 1.3 (0.4) | 1.1 (0.4) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 3.7 (3) | 7.1 (3) | 9.1 (7) | 11 (6) | 6.5 (3) | 6.7 (2) | 6.2 (2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 4.1 (3) | 11 (12) | 6.8 (5) | 7.0 (4) | 4.2 (2) | 4.3 (1) | 4.0 (2) | 15/15 |
| Cauchy-EDA posik noiseless | 11 (10) | 24 (20) | 19 (9) | 21 (10) | 13 (6) | 14 (6) | 13 (3) | 15/15 |
| DASA korosec noiseless | 116 (51) | 520 (1221) | 478 (778) | 681 (793) | 524 (499) | 698 (575) | 822 (550) | 15/15 |
| DE-PSO garcia-nieto noiseless | 3.9 (3) | 14 (8) | 15 (7) | 25 (15) | 28 (12) | 65 (54) | ∞4040 | 0/15 |
| DIRECT posik noiseless | 1.5 (2) | 5.0 (5) | 4.4 (1) | 8.8 (10) | 10 (5) | 17 (5) | 21 (5) | 5/5 |
| EDA-PSO el-abd noiseless | 5.9 (5) | 11 (6) | 49 (52) | 99 (83) | 97 (24) | 176 (44) | 216 (52) | 15/15 |
| FULLNEWUOA ros noiseless | 7.5 (8) | 7.0 (5) | 3.1 (2) | 2.8 (1) | 1.6 (0.7) | 1.5 (0.6) | 1.3 (0.5) | 15/15 |
| G3PCX posik noiseless | 5.5 (6) | 24 (34) | 16 (21) | 18 (19) | 11 (8) | 11 (6) | 10 (6) | 15/15 |
| GA nicolau noiseless | 9.1 (9) | 34 (16) | 86 (68) | 169 (133) | 1348 (1784) | ∞ | ∞2e5 | 0/15 |
| GLOBAL pal noiseless | 15 (6) | 19 (8) | 8.1 (0.7) | 7.2 (2) | 4.1 (0.3) | 3.9 (0.2) | 3.4 (0.2) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 5.6 (4) | 19 (18) | 17 (10) | 17 (2) | 10 (1) | 10 (2) | 8.7 (1) | 15/15 |
| LSfminbnd posik noiseless | 457 (4) | 1541 (4167) | 2280 (3346) | 6331 (1e4) | ∞ | ∞ | ∞2e4 | 0/15 |
| LSstep posik noiseless | 40 (42) | 1481 (2909) | 3519 (3649) | 6096 (5326) | ∞ | ∞ | ∞2e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 7.7 (6) | 16 (15) | 10 (6) | 15 (3) | 9.0 (0.5) | 9.0 (0.8) | 8.5 (0.7) | 15/15 |
| MCS huyer noiseless | 1.1 (0.8) | 1 (0.9) | 0.99 (0.4) | 1.0 (0.7) | 1.0 (0.7) | 1 (0.8) | 1 (0.6) | 15/15 |
| NELDERDOERR doerr noiseless | 4.9 (4) | 6.2 (4) | 2.9 (1) | 2.8 (1) | 1.6 (0.5) | 1.6 (0.6) | 1.5 (0.5) | 15/15 |
| NELDER hansen noiseless | 2.3 (1) | 3.7 (2) | 2.0 (2) | 2.0 (1) | 1.1 (0.4) | 1.2 (0.6) | 1.2 (0.3) | 15/15 |
| NEWUOA ros noiseless | 4.6 (3) | 7.0 (5) | 3.5 (2) | 3.2 (1) | 1.9 (0.9) | 1.8 (0.9) | 1.6 (0.7) | 15/15 |
| ONEFIFTH auger noiseless | 51 (4) | 59 (335) | 23 (2) | 34 (18) | 35 (10) | 70 (47) | 95 (6) | 15/15 |
| POEMS kubalik noiseless | 131 (28) | 106 (83) | 75 (43) | 108 (45) | 75 (16) | 116 (14) | 129 (11) | 15/15 |
| PSO Bounds el-abd noiseless | 6.5 (10) | 19 (19) | 24 (22) | 61 (33) | 69 (27) | 148 (63) | 205 (41) | 15/15 |
| PSO el-abd noiseless | 7.1 (4) | 11 (13) | 15 (14) | 28 (14) | 26 (9) | 49 (10) | 67 (18) | 15/15 |
| RANDOMSEARCH auger noiseless | 6.3 (8) | 19 (15) | 71 (103) | 677 (991) | 2225 (2342) | 3.1e5 (1e5) | ∞2e6 | 0/15 |
| Rosenbrock posik noiseless | 5.3 (7) | 10 (10) | 5.2 (3) | 4.8 (2) | 2.8 (2) | 2.8 (1) | 2.5 (0.8) | 15/15 |
| VNS garcia-martinez noiseless | 8.8 (13) | 16 (5) | 10 (4) | 11 (5) | 6.9 (2) | 7.2 (2) | 6.7 (2) | 15/15 |
| iAMALGAM bosman noiseless | 4.7 (2) | 12 (14) | 8.0 (8) | 8.4 (4) | 5.1 (3) | 5.5 (2) | 5.2 (3) | 15/15 |
| Δ fopt f9, 2-D |
1e1 1 |
1e0 18 |
1e-1 30 |
1e-2 44 |
1e-3 68 |
1e-5 81 |
1e-7 92 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 33 (30) | 19 (17) | 41 (26) | 61 (20) | 64 (38) | 100 (28) | 144 (20) | 15/15 |
| AMALGAM bosman noiseless | 22 (10) | 6.3 (3) | 9.5 (4) | 9.5 (7) | 7.4 (3) | 7.7 (4) | 7.7 (4) | 15/15 |
| BAYEDA gallagher noiseless | 29 (38) | 10 (11) | 99 (138) | 595 (1159) | ∞ | ∞ | ∞4000 | 0/15 |
| BFGS ros noiseless | 16 (17) | 2.4 (1) | 2.3 (1) | 1.9 (0.7) | 1.3 (0.7) | 1.2 (0.6) | 1.1 (0.5) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 19 (10) | 4.6 (6) | 7.1 (5) | 7.5 (5) | 5.8 (2) | 5.8 (1.0) | 5.9 (1.0) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 26 (23) | 8.7 (9) | 8.0 (8) | 7.3 (6) | 5.4 (2) | 5.1 (3) | 4.9 (2) | 15/15 |
| Cauchy-EDA posik noiseless | 59 (66) | 14 (10) | 20 (11) | 19 (15) | 14 (8) | 14 (10) | 14 (4) | 15/15 |
| DASA korosec noiseless | 318 (668) | 243 (950) | 290 (814) | 325 (929) | 316 (628) | 551 (386) | 741 (880) | 15/15 |
| DE-PSO garcia-nieto noiseless | 58 (65) | 12 (7) | 12 (9) | 19 (12) | 19 (11) | 45 (13) | 97 (66) | 4/15 |
| DIRECT posik noiseless | 1 (0) | 2.0 (0.9) | 5.0 (2) | 5.8 (6) | 8.2 (3) | 18 (9) | 25 (20) | 5/5 |
| EDA-PSO el-abd noiseless | 47 (40) | 8.4 (4) | 27 (22) | 51 (53) | 77 (27) | 152 (57) | 205 (121) | 15/15 |
| FULLNEWUOA ros noiseless | 24 (38) | 2.6 (1) | 2.2 (2) | 1.8 (1) | 1.3 (0.5) | 1.1 (0.7) | 1.1 (0.4) | 15/15 |
| G3PCX posik noiseless | 28 (24) | 14 (12) | 20 (10) | 18 (21) | 14 (13) | 13 (9) | 12 (5) | 15/15 |
| GA nicolau noiseless | 44 (29) | 22 (33) | 90 (66) | 192 (107) | 2154 (2962) | 1.0e4 (7453) | 1.5e4 (2e4) | 2/15 |
| GLOBAL pal noiseless | 30 (37) | 9.0 (7) | 11 (0.4) | 7.9 (0.5) | 5.2 (0.5) | 4.6 (0.4) | 4.2 (0.2) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 16 (12) | 7.5 (6) | 15 (11) | 14 (5) | 10 (7) | 9.4 (4) | 9.0 (0.9) | 15/15 |
| LSfminbnd posik noiseless | 20 (33) | 210 (833) | 666 (364) | 3106 (3107) | 4119 (2647) | 3458 (2778) | ∞2e4 | 0/15 |
| LSstep posik noiseless | 747 (1200) | 225 (356) | 671 (379) | 1825 (1931) | 2075 (1544) | ∞ | ∞2e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 35 (42) | 8.5 (8) | 13 (6) | 13 (4) | 10 (2) | 11 (3) | 11 (5) | 15/15 |
| MCS huyer noiseless | 1 (0) | 0.99 (0.4) | 1 (0.5) | 1.00 (0.5) | 0.99 (0.3) | 1.0 (0.2) | 1.0 (0.5) | 15/15 |
| NELDERDOERR doerr noiseless | 11 (10) | 2.2 (1) | 2.6 (1) | 2.1 (1.0) | 1.5 (0.4) | 1.4 (0.7) | 1.4 (0.4) | 15/15 |
| NELDER hansen noiseless | 10 (6) | 1.6 (2) | 2.0 (0.8) | 1.8 (0.9) | 1.2 (0.7) | 1.2 (0.4) | 1.3 (0.7) | 15/15 |
| NEWUOA ros noiseless | 24 (34) | 3.6 (4) | 3.3 (3) | 2.7 (2) | 1.9 (1) | 1.8 (0.6) | 1.7 (0.7) | 15/15 |
| ONEFIFTH auger noiseless | 19 (19) | 81 (23) | 116 (335) | 115 (265) | 100 (147) | 134 (78) | 160 (69) | 15/15 |
| POEMS kubalik noiseless | 559 (345) | 64 (50) | 78 (63) | 114 (48) | 98 (17) | 132 (29) | 164 (13) | 15/15 |
| PSO Bounds el-abd noiseless | 48 (74) | 11 (7) | 27 (14) | 96 (71) | 121 (87) | 198 (81) | 241 (90) | 15/15 |
| PSO el-abd noiseless | 37 (28) | 8.6 (9) | 12 (4) | 24 (10) | 27 (15) | 49 (22) | 67 (24) | 15/15 |
| RANDOMSEARCH auger noiseless | 47 (68) | 16 (16) | 113 (61) | 893 (409) | 3585 (4140) | 3.7e5 (3e5) | ∞2e6 | 0/15 |
| Rosenbrock posik noiseless | 22 (30) | 2.6 (5) | 3.1 (2) | 2.9 (2) | 2.2 (2) | 2.2 (2) | 2.2 (1) | 15/15 |
| VNS garcia-martinez noiseless | 45 (30) | 14 (12) | 15 (12) | 12 (9) | 10 (6) | 10 (10) | 10 (10) | 15/15 |
| iAMALGAM bosman noiseless | 29 (18) | 5.9 (2) | 7.2 (6) | 6.9 (5) | 5.2 (3) | 5.3 (2) | 5.4 (1) | 15/15 |
| Δ fopt f10, 2-D |
1e1 30 |
1e0 46 |
1e-1 54 |
1e-2 61 |
1e-3 68 |
1e-5 82 |
1e-7 98 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 47 (19) | 68 (40) | 164 (61) | 352 (297) | 779 (777) | 2076 (1883) | 3189 (3917) | 15/15 |
| AMALGAM bosman noiseless | 3.0 (2) | 3.0 (1) | 3.7 (1) | 4.0 (2) | 4.1 (1) | 4.3 (1) | 4.4 (1.0) | 15/15 |
| BAYEDA gallagher noiseless | 59 (6) | 187 (109) | 311 (387) | ∞ | ∞ | ∞ | ∞4000 | 0/15 |
| BFGS ros noiseless | 0.99 (0.3) | 1.3 (0.7) | 1.4 (0.7) | 1.4 (0.3) | 1.4 (0.3) | 6.3 (13) | 24 (34) | 10/15 |
| BIPOP-CMA-ES hansen noiseless | 7.8 (6) | 9.0 (2) | 8.5 (3) | 7.9 (0.9) | 7.8 (2) | 7.3 (1) | 6.8 (0.9) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 7.1 (4) | 6.6 (2) | 6.3 (0.5) | 5.8 (1) | 5.6 (0.8) | 5.2 (0.7) | 4.7 (0.6) | 15/15 |
| Cauchy-EDA posik noiseless | 7.4 (4) | 6.3 (2) | 6.9 (3) | 7.0 (2) | 7.4 (2) | 7.9 (2) | 8.4 (0.9) | 15/15 |
| DASA korosec noiseless | 8860 (1e4) | 5.2e4 (1e5) | 6.1e4 (7e4) | 9.5e4 (2e5) | 1.2e5 (1e5) | 1.0e5 (2e5) | 8.5e4 (4e4) | 3/15 |
| DE-PSO garcia-nieto noiseless | 79 (118) | 111 (163) | 326 (355) | 312 (429) | ∞ | ∞ | ∞4040 | 0/15 |
| DIRECT posik noiseless | 3.8 (2) | 9.4 (8) | 20 (5) | 68 (50) | 117 (97) | 223 (186) | 454 (416) | 5/5 |
| EDA-PSO el-abd noiseless | 43 (68) | 138 (121) | 328 (365) | 643 (335) | 1118 (975) | 2996 (1420) | 8566 (7666) | 3/15 |
| FULLNEWUOA ros noiseless | 3.8 (2) | 4.5 (1) | 6.0 (3) | 6.4 (2) | 7.2 (3) | 8.1 (4) | 9.0 (2) | 15/15 |
| G3PCX posik noiseless | 25 (31) | 39 (22) | 39 (28) | 37 (27) | 34 (24) | 29 (22) | 25 (10) | 15/15 |
| GA nicolau noiseless | 76 (130) | 698 (2279) | 2814 (3840) | 4284 (5031) | 4.2e4 (6e4) | ∞ | ∞2e5 | 0/15 |
| GLOBAL pal noiseless | 11 (0.3) | 7.3 (0.2) | 6.4 (0.2) | 5.8 (0.1) | 5.3 (0.1) | 4.6 (0.0) | 4.0 (0.1) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 16 (11) | 14 (5) | 16 (1) | 15 (0.9) | 13 (2) | 12 (1) | 11 (1) | 15/15 |
| LSfminbnd posik noiseless | 762 (333) | 6271 (7717) | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| LSstep posik noiseless | 762 (333) | 2826 (2826) | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 13 (8) | 18 (12) | 19 (11) | 20 (8) | 19 (9) | 18 (5) | 17 (4) | 15/15 |
| MCS huyer noiseless | 1.7 (2) | 8.6 (9) | 47 (52) | 131 (127) | 525 (462) | 1296 (1189) | 3721 (7269) | 1/15 |
| NELDERDOERR doerr noiseless | 1.2 (0.3) | 0.99 (0.2) | 1.00 (0.1) | 1.00 (0.2) | 1.0 (0.1) | 1.00 (0.2) | 1.00 (0.1) | 15/15 |
| NELDER hansen noiseless | 1.2 (0.3) | 1.1 (0.2) | 1.0 (0.2) | 1.1 (0.1) | 1.1 (0.2) | 1.1 (0.1) | 1.0 (0.1) | 15/15 |
| NEWUOA ros noiseless | 3.1 (3) | 4.2 (3) | 6.5 (4) | 7.3 (3) | 8.5 (4) | 10 (5) | 11 (5) | 15/15 |
| ONEFIFTH auger noiseless | 8620 (1e4) | 2.4e4 (2e4) | 7.6e4 (2e5) | 1.5e5 (1e5) | 4.4e5 (3e5) | ∞ | ∞2e6 | 0/15 |
| POEMS kubalik noiseless | 301 (419) | 539 (544) | 1435 (1146) | 2063 (1402) | 2371 (1809) | 3723 (3514) | 6410 (4318) | 4/15 |
| PSO Bounds el-abd noiseless | 531 (1730) | 764 (3304) | 740 (90) | 832 (1783) | 1539 (1709) | 1935 (1237) | 2087 (3161) | 10/15 |
| PSO el-abd noiseless | 181 (251) | 283 (234) | 475 (413) | 653 (589) | 859 (805) | 1108 (929) | 1907 (2443) | 8/15 |
| RANDOMSEARCH auger noiseless | 112 (153) | 683 (478) | 3887 (2449) | 4.4e4 (8e4) | 1.3e5 (1e5) | ∞ | ∞2e6 | 0/15 |
| Rosenbrock posik noiseless | 3.1 (2) | 3.4 (2) | 3.2 (0.5) | 3.0 (1) | 2.9 (1) | 3.2 (2) | 3.0 (2) | 15/15 |
| VNS garcia-martinez noiseless | 16 (5) | 12 (3) | 11 (2) | 11 (1) | 10 (0.8) | 9.1 (1) | 8.3 (0.6) | 15/15 |
| iAMALGAM bosman noiseless | 3.2 (2) | 3.7 (2) | 4.1 (1) | 4.1 (2) | 4.1 (2) | 4.2 (2) | 4.1 (2) | 15/15 |
| Δ fopt f11, 2-D |
1e1 35 |
1e0 45 |
1e-1 50 |
1e-2 62 |
1e-3 67 |
1e-5 81 |
1e-7 97 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 35 (19) | 80 (42) | 204 (108) | 410 (149) | 887 (520) | 1743 (1114) | 3394 (2074) | 15/15 |
| AMALGAM bosman noiseless | 3.0 (2) | 3.5 (0.9) | 4.2 (2) | 3.9 (0.4) | 4.2 (2) | 4.4 (0.9) | 4.6 (1.0) | 15/15 |
| BAYEDA gallagher noiseless | 31 (35) | 148 (225) | 1131 (1020) | ∞ | ∞ | ∞ | ∞4000 | 0/15 |
| BFGS ros noiseless | 1.2 (0.9) | 1.6 (0.9) | 2.0 (0.5) | 1.7 (0.3) | 1.9 (0.4) | 5.7 (3) | 36 (35) | 10/15 |
| BIPOP-CMA-ES hansen noiseless | 7.9 (3) | 8.8 (3) | 9.3 (2) | 8.1 (0.8) | 8.0 (1) | 7.5 (0.7) | 6.8 (0.6) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 5.8 (3) | 6.4 (2) | 6.7 (0.5) | 5.7 (0.7) | 5.6 (0.6) | 5.1 (0.5) | 4.7 (0.4) | 15/15 |
| Cauchy-EDA posik noiseless | 6.8 (4) | 7.4 (1) | 8.2 (2) | 8.0 (1) | 8.3 (1) | 8.9 (2) | 9.0 (0.9) | 15/15 |
| DASA korosec noiseless | 9112 (4e4) | 4.0e4 (5e4) | 5.4e4 (4e4) | 5.6e4 (5e4) | 5.4e4 (7e4) | 4.8e4 (7e4) | 4.2e4 (2e4) | 6/15 |
| DE-PSO garcia-nieto noiseless | 35 (21) | 105 (146) | ∞ | ∞ | ∞ | ∞ | ∞4040 | 0/15 |
| DIRECT posik noiseless | 2.6 (1) | 5.2 (4) | 28 (24) | 49 (10) | 59 (28) | 275 (132) | 459 (307) | 5/5 |
| EDA-PSO el-abd noiseless | 97 (43) | 264 (190) | 465 (547) | 985 (1393) | 1921 (2396) | 6574 (6794) | ∞2e5 | 0/15 |
| FULLNEWUOA ros noiseless | 2.7 (3) | 4.4 (3) | 6.3 (6) | 6.1 (4) | 7.1 (3) | 8.1 (4) | 8.6 (4) | 15/15 |
| G3PCX posik noiseless | 10 (15) | 25 (24) | 29 (17) | 36 (100) | 35 (15) | 32 (17) | 27 (41) | 15/15 |
| GA nicolau noiseless | 54 (49) | 218 (164) | 5086 (3200) | 4.6e4 (7e4) | ∞ | ∞ | ∞2e5 | 0/15 |
| GLOBAL pal noiseless | 9.2 (0.7) | 7.5 (0.3) | 7.0 (0.2) | 5.7 (0.1) | 5.4 (0.2) | 4.7 (0.1) | 4.0 (0.1) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 13 (12) | 17 (1) | 17 (1) | 14 (1) | 13 (2) | 12 (0.9) | 11 (0.8) | 15/15 |
| LSfminbnd posik noiseless | 501 (429) | 2889 (4222) | 5600 (7300) | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| LSstep posik noiseless | 381 (1000) | 1778 (1889) | 2600 (1900) | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 11 (10) | 18 (10) | 24 (9) | 21 (5) | 20 (4) | 20 (0.8) | 17 (0.6) | 15/15 |
| MCS huyer noiseless | 87 (73) | 124 (127) | 168 (180) | 295 (207) | 926 (1061) | 2052 (1621) | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 1.0 (0.2) | 1 (0.4) | 1.0 (0.3) | 0.99 (0.1) | 1.0 (0.3) | 1.0 (0.1) | 1.0 (0.1) | 15/15 |
| NELDER hansen noiseless | 1.0 (0.3) | 1.1 (0.3) | 1.2 (0.3) | 1.0 (0.2) | 1.1 (0.2) | 1.1 (0.2) | 1.0 (0.1) | 15/15 |
| NEWUOA ros noiseless | 1.6 (2) | 3.2 (2) | 5.6 (5) | 6.0 (3) | 7.0 (4) | 8.5 (4) | 11 (7) | 15/15 |
| ONEFIFTH auger noiseless | 7746 (1e4) | 2.1e4 (1e4) | 6.1e4 (7e4) | 2.2e5 (1e5) | 4.4e5 (1e6) | ∞ | ∞2e6 | 0/15 |
| POEMS kubalik noiseless | 1045 (704) | 1399 (1094) | 2132 (1675) | 2790 (4425) | 4018 (1505) | 7987 (6782) | 7127 (9144) | 3/15 |
| PSO Bounds el-abd noiseless | 3253 (4317) | 5208 (4502) | 6339 (8950) | 5434 (6488) | 6775 (8305) | 6112 (7458) | 5478 (3545) | 4/15 |
| PSO el-abd noiseless | 482 (141) | 531 (257) | 670 (325) | 669 (1006) | 861 (1175) | 1294 (430) | 1877 (1098) | 9/15 |
| RANDOMSEARCH auger noiseless | 95 (82) | 872 (230) | 6358 (7174) | 4.3e4 (6e4) | 2.1e5 (1e5) | ∞ | ∞2e6 | 0/15 |
| Rosenbrock posik noiseless | 2.4 (2) | 2.7 (0.9) | 3.1 (1) | 2.6 (0.4) | 2.6 (0.4) | 2.6 (0.8) | 2.5 (0.8) | 15/15 |
| VNS garcia-martinez noiseless | 12 (5) | 12 (2) | 12 (3) | 10 (2) | 10 (0.9) | 9.4 (0.7) | 8.6 (0.7) | 15/15 |
| iAMALGAM bosman noiseless | 2.8 (1) | 3.3 (1) | 4.0 (2) | 3.8 (0.8) | 4.0 (2) | 4.0 (2) | 4.0 (1) | 15/15 |
| Δ fopt f12, 2-D |
1e1 35 |
1e0 46 |
1e-1 75 |
1e-2 94 |
1e-3 105 |
1e-5 153 |
1e-7 195 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 39 (18) | 51 (16) | 77 (77) | 94 (91) | 130 (165) | 226 (383) | 374 (762) | 15/15 |
| AMALGAM bosman noiseless | 5.6 (1) | 13 (25) | 17 (25) | 17 (14) | 17 (23) | 16 (25) | 15 (21) | 15/15 |
| BAYEDA gallagher noiseless | 67 (146) | 87 (220) | ∞ | ∞ | ∞ | ∞ | ∞4000 | 0/15 |
| BFGS ros noiseless | 1.2 (0.8) | 3.2 (3) | 3.1 (3) | 2.9 (3) | 2.8 (2) | 2.4 (3) | 4.2 (2) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 7.6 (6) | 12 (11) | 10 (13) | 9.1 (0.7) | 9.0 (0.7) | 10 (7) | 8.2 (16) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 9.1 (16) | 13 (29) | 10 (14) | 8.9 (3) | 8.7 (11) | 6.5 (10) | 5.6 (2) | 15/15 |
| Cauchy-EDA posik noiseless | 13 (5) | 24 (67) | 19 (44) | 18 (4) | 18 (17) | 15 (15) | 14 (22) | 15/15 |
| DASA korosec noiseless | 2617 (1363) | 6780 (1e4) | 6095 (1e4) | 8773 (2e4) | 1.4e4 (3e4) | 9719 (423) | 7885 (1e4) | 9/15 |
| DE-PSO garcia-nieto noiseless | 40 (41) | 55 (41) | 52 (83) | 48 (43) | 45 (38) | 35 (51) | 45 (82) | 6/15 |
| DIRECT posik noiseless | 6.0 (4) | 35 (70) | 80 (180) | 70 (7) | 164 (180) | 248 (180) | 287 (172) | 5/5 |
| EDA-PSO el-abd noiseless | 39 (41) | 98 (156) | 160 (170) | 305 (539) | 793 (1264) | 1009 (3037) | 820 (855) | 9/15 |
| FULLNEWUOA ros noiseless | 4.5 (5) | 5.2 (12) | 3.8 (6) | 3.4 (7) | 3.3 (5) | 2.7 (6) | 2.4 (5) | 15/15 |
| G3PCX posik noiseless | 12 (21) | 29 (27) | 34 (17) | 34 (53) | 32 (37) | 29 (39) | 28 (25) | 15/15 |
| GA nicolau noiseless | 90 (54) | 171 (72) | 576 (724) | 1010 (1074) | 2403 (2406) | 2220 (1998) | 1870 (1845) | 6/15 |
| GLOBAL pal noiseless | 7.9 (5) | 8.3 (3) | 7.2 (9) | 6.3 (4) | 6.4 (8) | 5.0 (4) | 4.4 (4) | 12/15 |
| IPOP-SEP-CMA-ES ros noiseless | 7.3 (4) | 10 (6) | 10 (6) | 8.8 (2) | 8.5 (7) | 7.0 (7) | 6.3 (8) | 15/15 |
| LSfminbnd posik noiseless | 570 (1008) | 1230 (1833) | 773 (1405) | 628 (784) | 573 (826) | 409 (245) | 332 (231) | 1/15 |
| LSstep posik noiseless | 291 (289) | 231 (227) | 235 (356) | 349 (563) | 721 (1196) | 815 (1215) | 640 (661) | 2/15 |
| MA-LS-CHAIN molina noiseless | 11 (6) | 15 (10) | 13 (9) | 12 (3) | 13 (4) | 11 (5) | 10 (5) | 15/15 |
| MCS huyer noiseless | 60 (144) | 49 (61) | 32 (11) | 26 (53) | 24 (48) | 39 (46) | 30 (36) | 15/15 |
| NELDERDOERR doerr noiseless | 1.1 (0.6) | 1.6 (2) | 1.6 (2) | 1.7 (1) | 1.7 (2) | 1.4 (1) | 1.3 (0.7) | 15/15 |
| NELDER hansen noiseless | 1.0 (0.3) | 1.0 (0.1) | 1.0 (0.3) | 1.0 (0.1) | 1.00 (1) | 1.00 (2) | 1.00 (0.5) | 15/15 |
| NEWUOA ros noiseless | 1.9 (4) | 2.9 (5) | 2.3 (6) | 2.1 (0.1) | 2.0 (2) | 1.6 (4) | 1.4 (2) | 15/15 |
| ONEFIFTH auger noiseless | 6570 (1e4) | 1.7e4 (2e4) | 2.3e4 (1e4) | 5.5e4 (5e4) | 1.3e5 (3e5) | 1.9e5 (1e5) | ∞2e6 | 0/15 |
| POEMS kubalik noiseless | 81 (97) | 653 (1537) | 1053 (1533) | 1203 (1575) | 1604 (2045) | 2902 (2946) | 1.5e4 (1e4) | 0/15 |
| PSO Bounds el-abd noiseless | 222 (42) | 442 (174) | 391 (713) | 507 (738) | 684 (1484) | 558 (472) | 559 (851) | 11/15 |
| PSO el-abd noiseless | 18 (16) | 57 (101) | 112 (71) | 132 (109) | 161 (420) | 215 (14) | 299 (795) | 14/15 |
| RANDOMSEARCH auger noiseless | 93 (72) | 586 (831) | 3209 (4521) | 1.6e4 (2e4) | 1.4e5 (3e5) | ∞ | ∞2e6 | 0/15 |
| Rosenbrock posik noiseless | 2.4 (2) | 3.6 (5) | 3.0 (2) | 5.4 (2) | 5.1 (2) | 3.8 (0.9) | 3.3 (1) | 15/15 |
| VNS garcia-martinez noiseless | 14 (6) | 13 (4) | 8.8 (3) | 7.5 (1.0) | 7.1 (0.8) | 5.6 (0.6) | 4.9 (0.6) | 15/15 |
| iAMALGAM bosman noiseless | 4.4 (7) | 7.0 (1) | 6.4 (0.1) | 6.4 (5) | 6.4 (1) | 5.8 (11) | 5.4 (5) | 15/15 |
| Δ fopt f13, 2-D |
1e1 23 |
1e0 35 |
1e-1 46 |
1e-2 60 |
1e-3 71 |
1e-5 95 |
1e-7 122 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 13 (9) | 47 (13) | 104 (39) | 171 (49) | 299 (261) | 3737 (2287) | 2.9e4 (3e4) | 7/15 |
| AMALGAM bosman noiseless | 2.6 (1) | 3.2 (0.4) | 3.7 (0.5) | 3.7 (0.8) | 3.9 (0.6) | 3.9 (0.7) | 4.1 (0.5) | 15/15 |
| BAYEDA gallagher noiseless | 51 (89) | 139 (229) | 577 (630) | 949 (1233) | ∞ | ∞ | ∞4000 | 0/15 |
| BFGS ros noiseless | 6.7 (6) | 15 (20) | 45 (55) | 74 (121) | 164 (108) | 580 (524) | ∞1e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 3.2 (2) | 5.4 (4) | 5.7 (0.6) | 5.9 (1) | 6.4 (3) | 6.6 (2) | 7.0 (2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 5.1 (6) | 7.3 (5) | 7.0 (3) | 7.3 (2) | 8.0 (4) | 7.9 (3) | 7.6 (4) | 15/15 |
| Cauchy-EDA posik noiseless | 7.2 (7) | 7.7 (4) | 7.7 (2) | 8.2 (2) | 8.5 (2) | 8.5 (1) | 8.5 (2) | 15/15 |
| DASA korosec noiseless | 527 (222) | 858 (1030) | 2580 (2950) | 4866 (2917) | 1.6e4 (2e4) | 1.4e5 (3e5) | ∞2e6 | 0/15 |
| DE-PSO garcia-nieto noiseless | 8.2 (4) | 25 (13) | 63 (95) | 125 (91) | ∞ | ∞ | ∞4040 | 0/15 |
| DIRECT posik noiseless | 2.5 (0.7) | 4.2 (1) | 5.1 (2) | 8.7 (3) | 24 (17) | 74 (23) | 121 (28) | 4/5 |
| EDA-PSO el-abd noiseless | 6.3 (5) | 42 (40) | 181 (72) | 274 (129) | 707 (2151) | 3.1e4 (2e4) | ∞2e5 | 0/15 |
| FULLNEWUOA ros noiseless | 8.3 (10) | 12 (18) | 31 (34) | 76 (189) | 139 (155) | 756 (1510) | 1847 (2254) | 0/15 |
| G3PCX posik noiseless | 13 (15) | 30 (19) | 36 (46) | 47 (40) | 50 (69) | 70 (122) | 61 (26) | 15/15 |
| GA nicolau noiseless | 24 (21) | 174 (137) | 1098 (1234) | 2.2e4 (3e4) | ∞ | ∞ | ∞2e5 | 0/15 |
| GLOBAL pal noiseless | 9.0 (5) | 9.3 (0.3) | 7.4 (0.1) | 6.0 (0.1) | 13 (13) | ∞ | ∞887 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 12 (18) | 20 (9) | 18 (2) | 15 (5) | 14 (0.9) | 13 (2) | 11 (1) | 15/15 |
| LSfminbnd posik noiseless | 51 (120) | 112 (227) | 168 (144) | 474 (377) | 846 (1120) | ∞ | ∞2e4 | 0/15 |
| LSstep posik noiseless | 279 (191) | 575 (874) | 1048 (1347) | 1508 (1436) | ∞ | ∞ | ∞2e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 8.5 (10) | 17 (7) | 18 (10) | 21 (8) | 23 (5) | 19 (4) | 22 (4) | 15/15 |
| MCS huyer noiseless | 23 (14) | 20 (10) | 167 (142) | 958 (1547) | 2152 (4402) | ∞ | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 1.1 (0.6) | 1.1 (0.6) | 1.1 (0.2) | 1.0 (0.4) | 1.0 (0.2) | 1.1 (0.2) | 1.0 (0.2) | 15/15 |
| NELDER hansen noiseless | 0.98 (0.8) | 1.0 (0.2) | 1.0 (0.1) | 1 (0.1) | 1.00 (0.1) | 1.00 (0.1) | 1.0 (0.1) | 15/15 |
| NEWUOA ros noiseless | 6.2 (15) | 10 (3) | 22 (49) | 25 (37) | 72 (213) | 91 (97) | 147 (109) | 5/15 |
| ONEFIFTH auger noiseless | 37 (40) | 94 (82) | 209 (298) | 371 (438) | 792 (605) | 8090 (1e4) | 3.7e4 (6e4) | 2/15 |
| POEMS kubalik noiseless | 47 (33) | 93 (28) | 143 (28) | 330 (399) | 1096 (1044) | 6243 (4224) | 2.4e4 (2e4) | 0/15 |
| PSO Bounds el-abd noiseless | 9.0 (8) | 43 (28) | 122 (91) | 260 (86) | 619 (119) | 2983 (3935) | ∞2e5 | 0/15 |
| PSO el-abd noiseless | 8.8 (7) | 27 (16) | 77 (85) | 142 (109) | 326 (127) | 2895 (2431) | 1.1e4 (7358) | 2/15 |
| RANDOMSEARCH auger noiseless | 18 (20) | 280 (435) | 1.2e4 (1e4) | 1.1e5 (2e5) | ∞ | ∞ | ∞2e6 | 0/15 |
| Rosenbrock posik noiseless | 5.5 (7) | 7.1 (6) | 7.5 (7) | 18 (31) | 28 (60) | 70 (62) | 168 (144) | 4/15 |
| VNS garcia-martinez noiseless | 8.6 (3) | 10 (4) | 10 (5) | 8.8 (3) | 9.2 (3) | 8.6 (1) | 8.4 (1) | 15/15 |
| iAMALGAM bosman noiseless | 2.5 (1) | 3.1 (2) | 3.7 (0.4) | 3.3 (1) | 3.5 (0.6) | 3.6 (2) | 3.7 (1) | 15/15 |
| Δ fopt f14, 2-D |
1e1 1 |
1e0 7.0 |
1e-1 16 |
1e-2 24 |
1e-3 38 |
1e-5 67 |
1e-7 90 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 2.2 (1) | 2.6 (4) | 15 (13) | 61 (21) | 75 (22) | 132 (69) | 529 (917) | 15/15 |
| AMALGAM bosman noiseless | 2.2 (1) | 3.4 (4) | 4.0 (2) | 4.8 (2) | 4.2 (2) | 3.9 (1) | 4.2 (1) | 15/15 |
| BAYEDA gallagher noiseless | 2.6 (1) | 1.9 (1) | 10 (9) | 26 (9) | 67 (79) | 182 (258) | ∞4000 | 0/15 |
| BFGS ros noiseless | 3.0 (2) | 2.9 (2) | 1.8 (1) | 1.7 (1) | 1.4 (0.5) | 1.0 (0.4) | 6.0 (9) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 2.6 (1) | 2.7 (4) | 3.0 (2) | 4.2 (1) | 4.6 (3) | 5.6 (2) | 7.1 (1) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 2.4 (2) | 3.3 (3) | 3.5 (2) | 3.6 (1) | 4.0 (1) | 4.5 (0.5) | 4.7 (1) | 15/15 |
| Cauchy-EDA posik noiseless | 18 (34) | 14 (8) | 12 (4) | 11 (4) | 10 (3) | 8.9 (1) | 8.5 (1) | 15/15 |
| DASA korosec noiseless | 30 (42) | 24 (16) | 16 (13) | 18 (9) | 33 (15) | 9325 (1e4) | 3.1e5 (3e5) | 0/15 |
| DE-PSO garcia-nieto noiseless | 2.0 (1) | 5.5 (3) | 11 (4) | 17 (5) | 17 (8) | 55 (30) | ∞4040 | 0/15 |
| DIRECT posik noiseless | 1.4 (0.5) | 1.4 (2) | 2.2 (1) | 2.9 (1) | 6.0 (3) | 13 (8) | 32 (22) | 5/5 |
| EDA-PSO el-abd noiseless | 2.0 (0.5) | 3.1 (3) | 8.3 (5) | 12 (3) | 15 (12) | 158 (27) | 1079 (1164) | 5/15 |
| FULLNEWUOA ros noiseless | 4.5 (3) | 1.5 (0.5) | 1.0 (0.3) | 1.0 (0.1) | 0.99 (0.3) | 1.5 (0.7) | 3.7 (2) | 11/15 |
| G3PCX posik noiseless | 2.5 (2) | 6.6 (5) | 6.4 (2) | 6.0 (1) | 6.6 (3) | 9.2 (4) | 11 (1) | 15/15 |
| GA nicolau noiseless | 1.5 (0.5) | 4.2 (3) | 41 (62) | 202 (103) | 274 (72) | 3183 (2981) | ∞2e5 | 0/15 |
| GLOBAL pal noiseless | 2.4 (4) | 5.8 (5) | 13 (9) | 13 (1.0) | 8.7 (0.1) | 8.2 (11) | ∞693 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.3 (4) | 1.9 (2) | 4.5 (3) | 5.0 (2) | 7.3 (4) | 10 (2) | 11 (0.8) | 15/15 |
| LSfminbnd posik noiseless | 6.6 (19) | 5.7 (3) | 3.0 (1) | 6.3 (3) | 76 (74) | ∞ | ∞2e4 | 0/15 |
| LSstep posik noiseless | 56 (101) | 77 (86) | 50 (19) | 126 (75) | 1553 (2000) | ∞ | ∞2e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 2.4 (3) | 3.3 (3) | 10 (8) | 15 (3) | 13 (2) | 12 (2) | 17 (0.6) | 15/15 |
| MCS huyer noiseless | 1.4 (0) | 1.1 (0.5) | 1.4 (0.6) | 1.7 (1.0) | 2.8 (2) | 23 (38) | 8186 (7647) | 0/15 |
| NELDERDOERR doerr noiseless | 1.8 (1) | 1.4 (0.6) | 1.3 (0.6) | 1.3 (0.3) | 1.1 (0.2) | 1.0 (0.1) | 1.0 (0.1) | 15/15 |
| NELDER hansen noiseless | 3.0 (2) | 1.5 (0.9) | 1.4 (0.3) | 1.4 (0.3) | 1.2 (0.3) | 1.0 (0.3) | 1.1 (0.3) | 15/15 |
| NEWUOA ros noiseless | 5.1 (5) | 2.5 (1) | 1.6 (0.5) | 1.5 (0.4) | 1.6 (0.3) | 2.1 (0.4) | 5.4 (2) | 6/15 |
| ONEFIFTH auger noiseless | 3.3 (7) | 2.6 (2) | 2.5 (2) | 3.5 (2) | 9.2 (8) | 3429 (832) | ∞2e6 | 0/15 |
| POEMS kubalik noiseless | 269 (186) | 91 (20) | 74 (56) | 158 (72) | 177 (39) | 337 (443) | 3284 (4854) | 2/15 |
| PSO Bounds el-abd noiseless | 2.1 (2) | 2.9 (2) | 14 (14) | 45 (31) | 72 (19) | 183 (73) | 1180 (2403) | 8/15 |
| PSO el-abd noiseless | 1.9 (2) | 5.1 (2) | 13 (7) | 26 (12) | 36 (10) | 85 (49) | 1734 (1331) | 3/15 |
| RANDOMSEARCH auger noiseless | 2.5 (2) | 2.8 (2) | 31 (22) | 565 (959) | 7208 (6917) | 4.2e5 (3e5) | ∞2e6 | 0/15 |
| Rosenbrock posik noiseless | 5.7 (6) | 2.0 (1) | 1.6 (0.4) | 1.7 (0.3) | 1.9 (0.7) | 2.4 (2) | 3.0 (2) | 15/15 |
| VNS garcia-martinez noiseless | 3.0 (2) | 6.5 (5) | 10 (4) | 10 (4) | 8.9 (2) | 8.7 (2) | 9.3 (2) | 15/15 |
| iAMALGAM bosman noiseless | 2.3 (3) | 3.9 (3) | 3.9 (2) | 4.1 (2) | 3.9 (2) | 3.5 (1) | 3.6 (1) | 15/15 |
| Δ fopt f15, 2-D |
1e1 37 |
1e0 291 |
1e-1 1033 |
1e-2 1066 |
1e-3 1113 |
1e-5 1231 |
1e-7 1412 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 2.7 (2) | 6.8 (3) | 3.4 (1) | 4.8 (1) | 5.7 (3) | 7.9 (2) | 9.1 (1) | 15/15 |
| AMALGAM bosman noiseless | 1.2 (1.0) | 4.3 (8) | 2.7 (3) | 2.8 (4) | 2.8 (2) | 2.6 (4) | 2.3 (3) | 15/15 |
| BAYEDA gallagher noiseless | 2.1 (2) | 8.2 (5) | 7.6 (6) | 26 (25) | ∞ | ∞ | ∞4000 | 0/15 |
| BFGS ros noiseless | 4.2 (3) | 4.6 (5) | 7.9 (5) | 7.7 (11) | 7.3 (17) | 6.6 (4) | 5.8 (5) | 7/15 |
| BIPOP-CMA-ES hansen noiseless | 1.1 (0.8) | 1.8 (2) | 2.1 (3) | 2.2 (3) | 2.2 (3) | 2.1 (3) | 1.9 (2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 22 (40) | 7.7 (10) | 7.7 (15) | 7.4 (5) | 7.1 (10) | 6.5 (11) | 5.7 (11) | 13/15 |
| Cauchy-EDA posik noiseless | 4.9 (3) | 3.0 (4) | 3.2 (3) | 11 (10) | 14 (16) | 13 (9) | 12 (11) | 15/15 |
| DASA korosec noiseless | 64 (62) | 85 (91) | 64 (56) | 62 (55) | 60 (32) | 54 (22) | 48 (45) | 15/15 |
| DE-PSO garcia-nieto noiseless | 2.9 (2) | 3.8 (3) | 1.7 (1) | 2.2 (0.9) | 2.5 (2) | 3.0 (0.5) | 6.3 (7) | 6/15 |
| DIRECT posik noiseless | 1.0 (0.5) | 1.0 (0.5) | 1.0 (0.3) | 1 (0.4) | 1 (0.4) | 1.0 (0.3) | 1.00 (0.3) | 5/5 |
| EDA-PSO el-abd noiseless | 2.0 (2) | 9.3 (9) | 6.1 (2) | 8.3 (3) | 8.3 (1) | 8.4 (2) | 8.1 (2) | 15/15 |
| FULLNEWUOA ros noiseless | 1.5 (0.8) | 1.4 (2) | 3.5 (3) | 3.4 (2) | 3.3 (2) | 3.0 (2) | 2.6 (2) | 14/15 |
| G3PCX posik noiseless | 7.8 (1) | 13 (24) | 22 (26) | 21 (31) | 20 (38) | 18 (30) | 16 (30) | 15/15 |
| GA nicolau noiseless | 4.2 (4) | 18 (17) | 13 (5) | 34 (99) | 96 (139) | 102 (85) | 123 (110) | 10/15 |
| GLOBAL pal noiseless | 3.0 (2) | 1.6 (1) | 2.6 (3) | 2.5 (4) | 2.4 (5) | 2.2 (2) | 1.9 (1) | 5/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.5 (0.7) | 2.9 (3) | 2.1 (2) | 2.2 (2) | 2.2 (1) | 2.1 (1) | 1.9 (2) | 15/15 |
| LSfminbnd posik noiseless | 3.7 (2) | 20 (20) | 36 (50) | 51 (45) | 66 (53) | ∞ | ∞2e4 | 0/15 |
| LSstep posik noiseless | 172 (406) | 196 (327) | 80 (120) | 79 (104) | 77 (117) | 71 (59) | 63 (43) | 2/15 |
| MA-LS-CHAIN molina noiseless | 1.7 (1) | 1.9 (0.1) | 1.6 (1) | 1.5 (0.7) | 1.5 (0.7) | 1.4 (0.8) | 1.3 (0.5) | 15/15 |
| MCS huyer noiseless | 2.1 (3) | 3.5 (4) | 1.4 (2) | 1.4 (2) | 1.3 (1) | 1.2 (1) | 1.1 (1) | 15/15 |
| NELDERDOERR doerr noiseless | 1.1 (1) | 1.3 (1) | 1.4 (1) | 1.3 (1.0) | 1.3 (0.9) | 1.2 (1) | 1.0 (1.0) | 15/15 |
| NELDER hansen noiseless | 8.5 (18) | 7.3 (5) | 10 (8) | 9.4 (6) | 9.0 (8) | 8.2 (10) | 7.1 (7) | 15/15 |
| NEWUOA ros noiseless | 4.1 (6) | 3.4 (5) | 3.3 (2) | 3.2 (2) | 3.0 (2) | 2.7 (2) | 2.4 (2) | 15/15 |
| ONEFIFTH auger noiseless | 1.1 (0.8) | 5.3 (7) | 8.4 (10) | 8.2 (9) | 7.9 (3) | 7.1 (9) | 6.3 (4) | 15/15 |
| POEMS kubalik noiseless | 17 (6) | 19 (10) | 18 (24) | 20 (23) | 21 (22) | 22 (20) | 22 (19) | 15/15 |
| PSO Bounds el-abd noiseless | 1.7 (1) | 6.6 (4) | 3.9 (3) | 7.3 (3) | 9.2 (3) | 11 (2) | 12 (1) | 15/15 |
| PSO el-abd noiseless | 1.9 (2) | 4.1 (2) | 16 (1) | 16 (4) | 16 (45) | 16 (3) | 15 (36) | 14/15 |
| RANDOMSEARCH auger noiseless | 2.4 (2) | 64 (40) | 148 (228) | 1467 (1020) | 5753 (6154) | ∞ | ∞2e6 | 0/15 |
| Rosenbrock posik noiseless | 15 (19) | 10 (13) | 10 (13) | 9.2 (7) | 8.9 (9) | 8.0 (16) | 7.0 (6) | 11/15 |
| VNS garcia-martinez noiseless | 3.4 (1) | 1.9 (2) | 2.4 (1) | 2.4 (3) | 2.3 (3) | 2.7 (3) | 3.7 (3) | 15/15 |
| iAMALGAM bosman noiseless | 1.0 (0.5) | 4.3 (7) | 5.2 (4) | 5.1 (2) | 5.0 (5) | 4.6 (4) | 4.1 (5) | 15/15 |
| Δ fopt f16, 2-D |
1e1 9.0 |
1e0 50 |
1e-1 174 |
1e-2 326 |
1e-3 358 |
1e-5 409 |
1e-7 538 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 2.8 (2) | 5.6 (8) | 9.2 (5) | 14 (14) | 19 (9) | 34 (10) | 37 (16) | 15/15 |
| AMALGAM bosman noiseless | 3.3 (3) | 3.4 (3) | 5.1 (13) | 4.6 (7) | 4.5 (13) | 4.1 (9) | 3.3 (0.4) | 15/15 |
| BAYEDA gallagher noiseless | 1.5 (2) | 10 (9) | 24 (11) | 39 (48) | 76 (126) | 68 (83) | 108 (162) | 1/15 |
| BFGS ros noiseless | 41 (45) | 147 (26) | 173 (184) | 269 (229) | ∞ | ∞ | ∞1e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 3.2 (4) | 3.5 (2) | 3.5 (3) | 2.5 (2) | 2.4 (2) | 2.3 (2) | 1.9 (1) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 6.1 (30) | 2.3 (3) | 2.4 (2) | 5.2 (12) | 8.8 (5) | 11 (12) | 12 (16) | 14/15 |
| Cauchy-EDA posik noiseless | 4.6 (7) | 4.4 (6) | 6.2 (4) | 15 (14) | 29 (31) | 35 (38) | 27 (26) | 15/15 |
| DASA korosec noiseless | 30 (40) | 152 (371) | 184 (136) | 131 (238) | 205 (271) | 335 (435) | 529 (741) | 15/15 |
| DE-PSO garcia-nieto noiseless | 4.0 (7) | 10 (6) | 10 (11) | 10 (11) | 26 (20) | 73 (86) | ∞4040 | 0/15 |
| DIRECT posik noiseless | 1.6 (2) | 1 (0.5) | 1.0 (0.7) | 1.0 (0.6) | 1.00 (0.6) | 2.0 (1) | 1.9 (1.0) | 5/5 |
| EDA-PSO el-abd noiseless | 2.7 (2) | 4.8 (7) | 15 (17) | 195 (182) | 290 (425) | 408 (250) | 315 (476) | 8/15 |
| FULLNEWUOA ros noiseless | 8.2 (7) | 5.9 (10) | 3.9 (6) | 3.2 (5) | 5.5 (9) | 10 (9) | 16 (27) | 9/15 |
| G3PCX posik noiseless | 2.9 (4) | 8.9 (13) | 3.2 (8) | 4.5 (7) | 4.8 (2) | 5.3 (7) | 11 (15) | 15/15 |
| GA nicolau noiseless | 2.1 (2) | 4.1 (4) | 16 (16) | 42 (30) | 178 (411) | 687 (743) | 692 (889) | 5/15 |
| GLOBAL pal noiseless | 3.9 (2) | 5.1 (3) | 2.4 (2) | 1.4 (0.7) | 1.5 (0.7) | 1.7 (1) | 1.5 (2) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 3.2 (3) | 4.1 (1) | 2.4 (2) | 2.9 (2) | 4.0 (1) | 3.9 (3) | 3.3 (1) | 15/15 |
| LSfminbnd posik noiseless | 5.6 (2) | 5.7 (7) | 5.4 (4) | 8.3 (9) | 14 (5) | 38 (46) | 107 (169) | 3/15 |
| LSstep posik noiseless | 1.6 (1) | 11 (18) | 23 (10) | 63 (73) | 70 (73) | 199 (294) | 152 (195) | 3/15 |
| MA-LS-CHAIN molina noiseless | 1.3 (0.8) | 3.6 (3) | 4.2 (3) | 6.4 (6) | 10 (13) | 10 (10) | 8.3 (10) | 15/15 |
| MCS huyer noiseless | 5.2 (6) | 6.7 (10) | 2.7 (2) | 4.3 (4) | 6.8 (8) | 29 (41) | 115 (62) | 6/15 |
| NELDERDOERR doerr noiseless | 1.7 (1) | 3.5 (3) | 1.8 (2) | 1.1 (1) | 1.1 (1.0) | 1.0 (0.8) | 1.00 (1) | 15/15 |
| NELDER hansen noiseless | 1.2 (0.8) | 7.6 (12) | 4.4 (1) | 4.7 (9) | 4.3 (3) | 3.8 (8) | 2.9 (9) | 15/15 |
| NEWUOA ros noiseless | 9.1 (17) | 10 (11) | 6.8 (8) | 6.9 (12) | 22 (26) | 44 (66) | 77 (41) | 4/15 |
| ONEFIFTH auger noiseless | 35 (3) | 38 (29) | 35 (38) | 33 (43) | 56 (35) | 84 (54) | 121 (199) | 15/15 |
| POEMS kubalik noiseless | 72 (29) | 648 (26) | 202 (1437) | 114 (2) | 111 (419) | 107 (124) | 88 (280) | 13/15 |
| PSO Bounds el-abd noiseless | 2.9 (2) | 6.4 (7) | 11 (3) | 113 (315) | 123 (426) | 121 (255) | 103 (195) | 13/15 |
| PSO el-abd noiseless | 2.5 (2) | 3.8 (4) | 6.1 (5) | 101 (2) | 94 (423) | 86 (128) | 69 (95) | 13/15 |
| RANDOMSEARCH auger noiseless | 2.3 (2) | 5.0 (7) | 20 (12) | 137 (120) | 1201 (2466) | 7.2e4 (1e5) | ∞2e6 | 0/15 |
| Rosenbrock posik noiseless | 33 (59) | 36 (34) | 33 (24) | 27 (20) | 79 (143) | ∞ | ∞2e4 | 0/15 |
| VNS garcia-martinez noiseless | 4.7 (6) | 5.0 (2) | 4.8 (6) | 4.9 (6) | 4.7 (6) | 5.6 (8) | 6.8 (9) | 15/15 |
| iAMALGAM bosman noiseless | 1.0 (0.8) | 6.9 (21) | 7.4 (7) | 9.1 (6) | 9.2 (12) | 8.3 (5) | 7.0 (8) | 15/15 |
| Δ fopt f17, 2-D |
1e1 3.0 |
1e0 61 |
1e-1 133 |
1e-2 275 |
1e-3 396 |
1e-5 1086 |
1e-7 1657 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 1.3 (1) | 2.8 (4) | 16 (3) | 15 (3) | 17 (2) | 12 (1) | 11 (0.4) | 15/15 |
| AMALGAM bosman noiseless | 1.3 (1) | 1.3 (1) | 4.8 (0.4) | 2.7 (0.5) | 4.5 (9) | 2.9 (3) | 2.1 (3) | 15/15 |
| BAYEDA gallagher noiseless | 0.89 (1) | 2.0 (2) | 8.0 (17) | 7.0 (5) | 8.7 (7) | 27 (21) | ∞4000 | 0/15 |
| BFGS ros noiseless | 13 (16) | 16 (16) | 90 (101) | ∞ | ∞ | ∞ | ∞3786 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 3.6 (2) | 1.8 (0.6) | 1.5 (0.5) | 1.0 (0.8) | 1.00 (0.2) | 1.3 (0.9) | 1.1 (0.8) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 11 (5) | 3.0 (3) | 5.9 (12) | 14 (31) | 14 (16) | 16 (14) | 10 (6) | 10/15 |
| Cauchy-EDA posik noiseless | 16 (24) | 120 (2) | 56 (377) | 28 (91) | 20 (64) | 16 (0.4) | 13 (47) | 9/15 |
| DASA korosec noiseless | 19 (21) | 29 (67) | 37 (71) | 52 (58) | 93 (116) | 337 (223) | 221 (280) | 15/15 |
| DE-PSO garcia-nieto noiseless | 2.4 (3) | 1.1 (0.9) | 4.3 (0.8) | 3.7 (0.7) | 3.7 (0.5) | 2.4 (0.3) | 2.8 (0.7) | 4/15 |
| DIRECT posik noiseless | 1.3 (0.9) | 1.00 (0.9) | 1 (0.5) | 1.0 (0.7) | 1.4 (0.4) | 1.00 (0.3) | 1 (0.4) | 5/5 |
| EDA-PSO el-abd noiseless | 2.3 (1) | 2.0 (1) | 3.9 (1) | 7.4 (4) | 10 (4) | 8.0 (3) | 7.1 (2) | 15/15 |
| FULLNEWUOA ros noiseless | 7.2 (19) | 4.4 (4) | 14 (34) | 21 (31) | 53 (58) | ∞ | ∞1e4 | 0/15 |
| G3PCX posik noiseless | 2.2 (2) | 4.5 (1) | 6.2 (10) | 3.9 (5) | 3.2 (2) | 4.4 (5) | 3.0 (4) | 15/15 |
| GA nicolau noiseless | 1.8 (4) | 5.0 (8) | 47 (27) | 61 (34) | 91 (15) | 151 (249) | ∞2e5 | 0/15 |
| GLOBAL pal noiseless | 2.3 (2) | 4.0 (3) | 4.1 (2) | 3.9 (3) | 4.4 (3) | ∞ | ∞1044 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 3.6 (4) | 2.2 (0.8) | 2.8 (5) | 2.3 (4) | 1.8 (1) | 1.5 (0.8) | 1.4 (0.3) | 15/15 |
| LSfminbnd posik noiseless | 4.8 (9) | 1.2 (1) | 7.3 (8) | 55 (71) | ∞ | ∞ | ∞9182 | 0/15 |
| LSstep posik noiseless | 37 (68) | 40 (90) | 35 (51) | 44 (34) | 82 (68) | ∞ | ∞2e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 1.2 (0.8) | 2.2 (2) | 5.3 (2) | 4.3 (2) | 4.8 (1) | 3.1 (1) | 2.9 (1) | 15/15 |
| MCS huyer noiseless | 1.1 (0.8) | 4.3 (4) | 4.8 (4) | 5.4 (4) | 9.2 (9) | 142 (136) | 125 (257) | 0/15 |
| NELDERDOERR doerr noiseless | 1.2 (1) | 1.5 (0.9) | 3.3 (8) | 3.0 (4) | 3.1 (3) | 5.9 (11) | 4.0 (4) | 14/15 |
| NELDER hansen noiseless | 120 (188) | 27 (20) | 20 (26) | 14 (15) | 11 (11) | 10 (20) | 6.3 (14) | 15/15 |
| NEWUOA ros noiseless | 6.8 (1) | 6.8 (8) | 18 (14) | 33 (15) | 115 (90) | ∞ | ∞1e4 | 0/15 |
| ONEFIFTH auger noiseless | 2.4 (2) | 5.9 (7) | 6.7 (9) | 4.8 (5) | 8.5 (20) | 23 (25) | 15 (14) | 15/15 |
| POEMS kubalik noiseless | 97 (93) | 17 (9) | 35 (9) | 31 (3) | 32 (7) | 24 (13) | 21 (8) | 15/15 |
| PSO Bounds el-abd noiseless | 1.7 (3) | 1.3 (0.7) | 13 (5) | 15 (8) | 22 (7) | 21 (9) | 30 (4) | 15/15 |
| PSO el-abd noiseless | 1.7 (1) | 1.6 (0.7) | 5.0 (2) | 6.2 (1) | 8.1 (1) | 5.5 (0.9) | 5.5 (1.0) | 15/15 |
| RANDOMSEARCH auger noiseless | 1.5 (2) | 5.2 (7) | 215 (179) | 4886 (7230) | 7.4e4 (1e5) | ∞ | ∞2e6 | 0/15 |
| Rosenbrock posik noiseless | 40 (33) | 83 (17) | 141 (98) | 502 (719) | 349 (311) | ∞ | ∞9344 | 0/15 |
| VNS garcia-martinez noiseless | 2.2 (3) | 5.6 (9) | 4.7 (5) | 2.7 (3) | 2.9 (2) | 6.7 (7) | 32 (27) | 15/15 |
| iAMALGAM bosman noiseless | 1.1 (2) | 8.8 (0.2) | 6.2 (7) | 4.2 (3) | 5.1 (10) | 4.0 (3) | 2.8 (1) | 15/15 |
| Δ fopt f18, 2-D |
1e1 19 |
1e0 134 |
1e-1 666 |
1e-2 1249 |
1e-3 1708 |
1e-5 2438 |
1e-7 2858 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 1.6 (1) | 6.6 (5) | 5.5 (3) | 5.4 (2) | 6.7 (2) | 10 (5) | 13 (5) | 15/15 |
| AMALGAM bosman noiseless | 1.3 (0.6) | 4.1 (0.3) | 1.0 (0.1) | 1.0 (0.0) | 1.1 (1) | 1.1 (2) | 1.1 (1) | 15/15 |
| BAYEDA gallagher noiseless | 2.3 (5) | 18 (23) | 19 (15) | 48 (55) | ∞ | ∞ | ∞4000 | 0/15 |
| BFGS ros noiseless | 14 (17) | 29 (20) | 108 (182) | ∞ | ∞ | ∞ | ∞4899 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 2.2 (1) | 6.5 (7) | 1.9 (2) | 1.1 (0.7) | 1.00 (0.6) | 1.0 (0.4) | 1.00 (0.3) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 6.6 (10) | 13 (24) | 17 (30) | 38 (54) | 82 (94) | ∞ | ∞2e4 | 0/15 |
| Cauchy-EDA posik noiseless | 380 (3) | 55 (187) | 11 (0.2) | 6.4 (20) | 5.0 (0.3) | 7.4 (13) | 6.7 (11) | 13/15 |
| DASA korosec noiseless | 26 (42) | 91 (117) | 86 (127) | 739 (442) | 1784 (2271) | 5876 (4076) | 5013 (1e4) | 2/15 |
| DE-PSO garcia-nieto noiseless | 2.7 (4) | 3.1 (1) | 2.1 (2) | 3.3 (2) | 11 (10) | 8.3 (10) | ∞4040 | 0/15 |
| DIRECT posik noiseless | 1 (0.7) | 1.00 (0.6) | 1.1 (0.8) | 1.2 (0.5) | 3.4 (3) | 4.9 (2) | 11 (5) | 5/5 |
| EDA-PSO el-abd noiseless | 2.4 (2) | 5.4 (6) | 7.1 (6) | 9.1 (4) | 11 (4) | 13 (6) | 15 (6) | 15/15 |
| FULLNEWUOA ros noiseless | 3.0 (5) | 16 (12) | 19 (15) | 71 (67) | ∞ | ∞ | ∞1e4 | 0/15 |
| G3PCX posik noiseless | 2.0 (3) | 10 (31) | 21 (17) | 41 (37) | 48 (81) | 99 (229) | 85 (49) | 5/15 |
| GA nicolau noiseless | 4.3 (6) | 15 (11) | 23 (9) | 107 (126) | 275 (267) | 1237 (2414) | ∞2e5 | 0/15 |
| GLOBAL pal noiseless | 2.0 (1.0) | 3.1 (1) | 2.2 (2) | 4.8 (9) | 7.6 (9) | ∞ | ∞1972 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.1 (0.6) | 6.2 (7) | 2.1 (2) | 1.3 (0.9) | 1.1 (0.5) | 1.1 (0.6) | 1.1 (0.5) | 15/15 |
| LSfminbnd posik noiseless | 1.3 (0.2) | 2.1 (2) | 7.0 (11) | 33 (56) | ∞ | ∞ | ∞8984 | 0/15 |
| LSstep posik noiseless | 12 (21) | 79 (224) | 60 (62) | 115 (48) | ∞ | ∞ | ∞2e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 1.6 (2) | 3.2 (2) | 2.5 (2) | 3.2 (1) | 4.0 (3) | 5.8 (4) | 7.0 (5) | 10/15 |
| MCS huyer noiseless | 1.3 (1) | 2.8 (5) | 1.7 (2) | 8.4 (3) | 135 (126) | ∞ | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 1.2 (2) | 3.1 (2) | 2.4 (3) | 4.3 (8) | 5.8 (5) | 25 (25) | 21 (23) | 6/15 |
| NELDER hansen noiseless | 21 (63) | 44 (7) | 18 (25) | 20 (11) | 38 (44) | 40 (67) | 34 (39) | 12/15 |
| NEWUOA ros noiseless | 5.6 (3) | 12 (14) | 14 (16) | 62 (78) | ∞ | ∞ | ∞1e4 | 0/15 |
| ONEFIFTH auger noiseless | 63 (462) | 232 (577) | 618 (1173) | 1493 (2514) | 4934 (9765) | ∞ | ∞2e6 | 0/15 |
| POEMS kubalik noiseless | 28 (23) | 118 (93) | 29 (19) | 28 (50) | 23 (8) | 45 (36) | 42 (66) | 12/15 |
| PSO Bounds el-abd noiseless | 1.5 (1) | 5.3 (4) | 6.7 (3) | 8.8 (5) | 10 (4) | 17 (2) | 23 (5) | 15/15 |
| PSO el-abd noiseless | 1.7 (1) | 3.3 (1) | 2.8 (1) | 3.2 (1) | 3.5 (2) | 6.5 (5) | 7.2 (3) | 15/15 |
| RANDOMSEARCH auger noiseless | 2.2 (3) | 21 (15) | 273 (526) | 1.1e4 (2e4) | ∞ | ∞ | ∞2e6 | 0/15 |
| Rosenbrock posik noiseless | 61 (92) | 56 (52) | 201 (166) | ∞ | ∞ | ∞ | ∞9536 | 0/15 |
| VNS garcia-martinez noiseless | 3.8 (0.9) | 16 (15) | 5.4 (5) | 3.6 (2) | 4.8 (3) | 18 (17) | 151 (168) | 15/15 |
| iAMALGAM bosman noiseless | 1.4 (1) | 12 (15) | 2.9 (3) | 1.8 (2) | 2.3 (1) | 2.0 (0.9) | 1.8 (0.1) | 15/15 |
| Δ fopt f19, 2-D |
1e1 1 |
1e0 1 |
1e-1 26 |
1e-2 216 |
1e-3 227 |
1e-5 252 |
1e-7 276 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 5.5 (4) | 55 (30) | 18 (17) | 12 (5) | 22 (19) | 41 (26) | 54 (31) | 15/15 |
| AMALGAM bosman noiseless | 6.3 (8) | 40 (30) | 6.3 (6) | 18 (18) | 18 (10) | 17 (32) | 16 (29) | 15/15 |
| BAYEDA gallagher noiseless | 3.9 (3) | 44 (31) | 10 (11) | 13 (8) | 57 (74) | ∞ | ∞4000 | 0/15 |
| BFGS ros noiseless | 37 (8) | 311 (510) | 62 (83) | 30 (25) | 29 (23) | 26 (15) | 24 (21) | 11/15 |
| BIPOP-CMA-ES hansen noiseless | 6.0 (7) | 31 (42) | 10 (22) | 12 (18) | 12 (11) | 14 (16) | 14 (16) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 5.6 (6) | 87 (227) | 33 (44) | 32 (39) | 31 (34) | 28 (39) | 26 (56) | 13/15 |
| Cauchy-EDA posik noiseless | 16 (2) | 115 (141) | 52 (35) | 170 (297) | 857 (943) | 2835 (5854) | ∞1e5 | 0/15 |
| DASA korosec noiseless | 42 (37) | 756 (1018) | 98 (201) | 252 (294) | 251 (333) | 257 (307) | 269 (303) | 15/15 |
| DE-PSO garcia-nieto noiseless | 4.4 (2) | 59 (48) | 17 (9) | 18 (12) | 35 (89) | 69 (80) | 67 (139) | 3/15 |
| DIRECT posik noiseless | 1 (0) | 1 (0) | 4.7 (4) | 10 (6) | 10 (5) | 8.9 (6) | 59 (79) | 5/5 |
| EDA-PSO el-abd noiseless | 5.2 (4) | 37 (23) | 14 (7) | 17 (20) | 30 (13) | 62 (60) | 72 (66) | 15/15 |
| FULLNEWUOA ros noiseless | 6.7 (6) | 88 (87) | 17 (22) | 17 (25) | 17 (16) | 15 (15) | 14 (19) | 13/15 |
| G3PCX posik noiseless | 5.3 (5) | 52 (55) | 37 (79) | 49 (73) | 47 (35) | 43 (21) | 40 (69) | 15/15 |
| GA nicolau noiseless | 4.5 (4) | 51 (43) | 20 (16) | 21 (15) | 108 (275) | 643 (849) | 4855 (7995) | 1/15 |
| GLOBAL pal noiseless | 4.3 (3) | 50 (16) | 10 (7) | 11 (6) | 10 (9) | 10 (6) | 8.8 (10) | 13/15 |
| IPOP-SEP-CMA-ES ros noiseless | 4.3 (6) | 29 (31) | 6.9 (6) | 19 (44) | 20 (32) | 19 (14) | 18 (14) | 14/15 |
| LSfminbnd posik noiseless | 9.4 (14) | 49 (50) | 10 (12) | 29 (36) | 70 (52) | 307 (204) | ∞1e4 | 0/15 |
| LSstep posik noiseless | 139 (204) | 442 (618) | 28 (29) | 63 (58) | 137 (109) | ∞ | ∞2e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 6.7 (10) | 60 (54) | 7.3 (11) | 15 (29) | 15 (6) | 14 (5) | 13 (7) | 14/15 |
| MCS huyer noiseless | 1 (0) | 1 (0) | 1.0 (0.3) | 1 (0.9) | 1 (1) | 1.0 (1) | 1.00 (0.3) | 15/15 |
| NELDERDOERR doerr noiseless | 4.6 (4) | 52 (44) | 11 (6) | 8.1 (9) | 7.8 (8) | 7.1 (11) | 6.5 (8) | 15/15 |
| NELDER hansen noiseless | 3.1 (4) | 383 (838) | 65 (116) | 32 (28) | 30 (49) | 28 (23) | 25 (42) | 15/15 |
| NEWUOA ros noiseless | 6.2 (6) | 126 (200) | 16 (15) | 27 (41) | 26 (17) | 24 (12) | 22 (19) | 13/15 |
| ONEFIFTH auger noiseless | 6.2 (4) | 103 (206) | 22 (12) | 23 (22) | 25 (20) | 30 (16) | 38 (21) | 15/15 |
| POEMS kubalik noiseless | 343 (241) | 555 (275) | 57 (37) | 207 (224) | 204 (216) | 194 (2) | 187 (260) | 14/15 |
| PSO Bounds el-abd noiseless | 5.1 (6) | 40 (50) | 7.9 (9) | 11 (17) | 20 (19) | 48 (19) | 71 (22) | 15/15 |
| PSO el-abd noiseless | 5.3 (4) | 34 (33) | 9.2 (4) | 4.7 (4) | 6.0 (5) | 10 (8) | 16 (5) | 15/15 |
| RANDOMSEARCH auger noiseless | 4.5 (4) | 64 (78) | 16 (13) | 36 (27) | 114 (249) | 725 (665) | 3.2e4 (6e4) | 0/15 |
| Rosenbrock posik noiseless | 42 (42) | 164 (235) | 35 (52) | 30 (33) | 29 (25) | 26 (20) | 24 (21) | 12/15 |
| VNS garcia-martinez noiseless | 2.2 (0.5) | 43 (68) | 12 (14) | 19 (17) | 19 (18) | 20 (6) | 21 (12) | 15/15 |
| iAMALGAM bosman noiseless | 5.5 (2) | 25 (19) | 64 (74) | 50 (28) | 48 (99) | 46 (22) | 42 (87) | 15/15 |
| Δ fopt f20, 2-D |
1e1 4.0 |
1e0 61 |
1e-1 365 |
1e-2 366 |
1e-3 366 |
1e-5 370 |
1e-7 375 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 2.9 (3) | 13 (10) | 6.2 (2) | 9.2 (3) | 12 (3) | 20 (5) | 26 (4) | 15/15 |
| AMALGAM bosman noiseless | 2.5 (2) | 26 (58) | 37 (38) | 38 (31) | 38 (49) | 38 (98) | 38 (79) | 15/15 |
| BAYEDA gallagher noiseless | 3.4 (4) | 9.2 (35) | 32 (50) | ∞ | ∞ | ∞ | ∞4000 | 0/15 |
| BFGS ros noiseless | 1.9 (2) | 6.0 (8) | 2.7 (3) | 2.7 (2) | 2.7 (2) | 2.7 (3) | 2.6 (4) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 2.5 (2) | 12 (16) | 10 (13) | 10 (13) | 11 (18) | 11 (18) | 11 (9) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 1.9 (1) | 7.4 (8) | 8.5 (19) | 8.6 (7) | 8.6 (23) | 8.6 (9) | 8.6 (18) | 14/15 |
| Cauchy-EDA posik noiseless | 17 (17) | 10 (16) | 31 (20) | 153 (89) | 1264 (2596) | 1971 (2263) | 1945 (1550) | 2/15 |
| DASA korosec noiseless | 46 (61) | 80 (32) | 44 (121) | 45 (41) | 45 (81) | 45 (39) | 45 (127) | 15/15 |
| DE-PSO garcia-nieto noiseless | 0.93 (0.8) | 10 (7) | 4.9 (4) | 5.6 (3) | 6.4 (6) | 8.0 (13) | 9.2 (6) | 13/15 |
| DIRECT posik noiseless | 5.7 (0.1) | 0.99 (8e-3) | 2.9 (0.0) | 3.0 (0.0) | 3.1 (0.0) | 3.7 (0.0) | 3.9 (0.0) | 5/5 |
| EDA-PSO el-abd noiseless | 3.0 (2) | 9.0 (5) | 13 (14) | 21 (3) | 25 (17) | 26 (2) | 27 (3) | 15/15 |
| FULLNEWUOA ros noiseless | 1.7 (0.1) | 18 (27) | 8.3 (21) | 8.3 (9) | 8.3 (12) | 8.2 (7) | 8.1 (12) | 14/15 |
| G3PCX posik noiseless | 2.7 (3) | 38 (48) | 7.8 (13) | 7.9 (5) | 8.0 (13) | 8.1 (9) | 8.2 (12) | 15/15 |
| GA nicolau noiseless | 2.6 (3) | 14 (13) | 15 (8) | 27 (14) | 45 (18) | 85 (20) | 126 (30) | 15/15 |
| GLOBAL pal noiseless | 2.2 (2) | 11 (10) | 4.5 (5) | 4.5 (5) | 4.5 (3) | 4.5 (2) | 4.5 (5) | 10/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.7 (1) | 9.4 (13) | 15 (15) | 16 (14) | 17 (15) | 18 (15) | 18 (10) | 15/15 |
| LSfminbnd posik noiseless | 6.1 (6) | 153 (141) | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| LSstep posik noiseless | 166 (350) | 119 (115) | 25 (16) | 27 (22) | 30 (37) | 40 (26) | 50 (39) | 11/15 |
| MA-LS-CHAIN molina noiseless | 2.2 (2) | 4.2 (2) | 1.8 (0.9) | 2.0 (0.3) | 2.1 (1) | 2.3 (1) | 2.4 (0.1) | 15/15 |
| MCS huyer noiseless | 5.3 (2) | 2.2 (2) | 1.00 (0.5) | 1.0 (0.0) | 1.0 (1) | 1.0 (1) | 1.0 (1) | 15/15 |
| NELDERDOERR doerr noiseless | 1.4 (0.9) | 3.9 (4) | 2.8 (3) | 2.8 (2) | 2.9 (3) | 2.9 (4) | 2.9 (3) | 15/15 |
| NELDER hansen noiseless | 1.2 (1) | 36 (118) | 28 (36) | 28 (41) | 28 (40) | 28 (33) | 27 (30) | 15/15 |
| NEWUOA ros noiseless | 1.9 (1) | 6.9 (8) | 5.9 (8) | 5.9 (8) | 5.9 (8) | 5.8 (4) | 5.8 (5) | 15/15 |
| ONEFIFTH auger noiseless | 3.1 (1) | 13 (18) | 9.0 (10) | 9.1 (6) | 9.2 (10) | 9.2 (8) | 9.2 (10) | 15/15 |
| POEMS kubalik noiseless | 117 (24) | 25 (19) | 30 (66) | 35 (36) | 42 (4) | 52 (35) | 61 (4) | 15/15 |
| PSO Bounds el-abd noiseless | 3.5 (2) | 11 (4) | 6.0 (4) | 13 (5) | 20 (3) | 30 (8) | 36 (12) | 15/15 |
| PSO el-abd noiseless | 2.3 (2) | 8.2 (7) | 5.0 (9) | 6.3 (7) | 8.7 (11) | 12 (7) | 15 (14) | 15/15 |
| RANDOMSEARCH auger noiseless | 3.4 (4) | 21 (20) | 67 (57) | 682 (670) | 5774 (2599) | ∞ | ∞2e6 | 0/15 |
| Rosenbrock posik noiseless | 3.7 (1) | 6.8 (11) | 4.1 (5) | 4.2 (5) | 4.2 (4) | 4.2 (2) | 4.2 (4) | 15/15 |
| VNS garcia-martinez noiseless | 4.0 (2) | 17 (19) | 9.3 (8) | 10 (12) | 10 (13) | 10 (9) | 13 (8) | 15/15 |
| iAMALGAM bosman noiseless | 2.1 (2) | 51 (75) | 26 (39) | 26 (26) | 27 (14) | 27 (36) | 27 (30) | 15/15 |
| Δ fopt f21, 2-D |
1e1 2.0 |
1e0 51 |
1e-1 174 |
1e-2 276 |
1e-3 290 |
1e-5 324 |
1e-7 330 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 0.97 (0.5) | 2.2 (3) | 1.8 (1) | 2.6 (2) | 4.9 (3) | 7.8 (2) | 12 (1) | 15/15 |
| AMALGAM bosman noiseless | 1.1 (1) | 28 (36) | 17 (20) | 11 (19) | 11 (24) | 10 (6) | 10 (14) | 15/15 |
| BAYEDA gallagher noiseless | 1.4 (0.8) | 1.6 (2) | 9.4 (6) | 14 (18) | 39 (83) | 86 (135) | 85 (51) | 1/15 |
| BFGS ros noiseless | 2.2 (2) | 4.8 (5) | 3.1 (2) | 2.0 (2) | 1.9 (1) | 1.7 (2) | 1.8 (2) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 1.1 (1) | 11 (14) | 10 (5) | 8.2 (24) | 10 (13) | 8.9 (9) | 8.9 (15) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 1.0 (2) | 12 (5) | 10 (9) | 6.1 (8) | 5.9 (9) | 5.3 (10) | 5.3 (6) | 15/15 |
| Cauchy-EDA posik noiseless | 5.0 (12) | 309 (980) | 93 (288) | 62 (98) | 65 (98) | 81 (157) | 80 (152) | 13/15 |
| DASA korosec noiseless | 11 (20) | 153 (406) | 139 (338) | 88 (161) | 84 (253) | 77 (137) | 76 (129) | 15/15 |
| DE-PSO garcia-nieto noiseless | 1.7 (2) | 2.4 (5) | 1.5 (2) | 1.8 (2) | 2.4 (2) | 2.9 (3) | 5.6 (3) | 15/15 |
| DIRECT posik noiseless | 1.1 (0.8) | 0.99 (0.9) | 1.0 (1) | 1 (0.5) | 1 (0.7) | 2.0 (3) | 2.3 (2) | 5/5 |
| EDA-PSO el-abd noiseless | 0.83 (0.5) | 1.8 (2) | 84 (288) | 54 (3) | 53 (174) | 51 (159) | 52 (155) | 14/15 |
| FULLNEWUOA ros noiseless | 1.8 (2) | 3.5 (5) | 3.0 (4) | 1.9 (2) | 1.8 (3) | 1.7 (2) | 1.7 (1) | 15/15 |
| G3PCX posik noiseless | 1.2 (1) | 2.7 (13) | 2.9 (4) | 1.9 (1) | 1.9 (2) | 1.8 (0.2) | 1.8 (4) | 15/15 |
| GA nicolau noiseless | 1.2 (0.9) | 1.0 (0.8) | 1.7 (2) | 4.1 (5) | 7.7 (9) | 117 (313) | 271 (462) | 10/15 |
| GLOBAL pal noiseless | 1.2 (2) | 1.1 (0.8) | 1.1 (0.7) | 1.0 (0.1) | 1.0 (0.1) | 1.00 (0.0) | 1.0 (0.0) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.1 (0.4) | 10 (7) | 6.4 (6) | 6.3 (10) | 8.5 (8) | 8.5 (12) | 9.2 (22) | 15/15 |
| LSfminbnd posik noiseless | 1.7 (0.4) | 39 (97) | 20 (48) | 26 (28) | 46 (100) | 73 (111) | 169 (159) | 3/15 |
| LSstep posik noiseless | 15 (1) | 372 (781) | 149 (386) | 100 (82) | 101 (101) | 121 (127) | 190 (374) | 3/15 |
| MA-LS-CHAIN molina noiseless | 1.2 (1) | 1.1 (1) | 1.5 (1) | 1.5 (0.4) | 1.7 (1) | 1.9 (0.4) | 2.0 (0.3) | 15/15 |
| MCS huyer noiseless | 1.3 (0.8) | 22 (1) | 14 (16) | 8.8 (10) | 8.4 (5) | 7.6 (9) | 7.5 (9) | 15/15 |
| NELDERDOERR doerr noiseless | 1.2 (1) | 2.6 (4) | 2.6 (4) | 1.7 (2) | 1.6 (2) | 1.5 (4) | 1.5 (3) | 15/15 |
| NELDER hansen noiseless | 1.5 (2) | 19 (42) | 20 (35) | 13 (13) | 12 (20) | 11 (26) | 11 (10) | 15/15 |
| NEWUOA ros noiseless | 2.9 (1) | 3.8 (3) | 4.0 (3) | 2.5 (1) | 2.4 (6) | 2.2 (5) | 2.3 (0.8) | 15/15 |
| ONEFIFTH auger noiseless | 2.3 (1) | 14 (22) | 19 (18) | 12 (12) | 11 (14) | 10 (17) | 10 (20) | 15/15 |
| POEMS kubalik noiseless | 107 (96) | 92 (254) | 892 (932) | 564 (1312) | 543 (1424) | 492 (617) | 487 (606) | 9/15 |
| PSO Bounds el-abd noiseless | 1.3 (1) | 33 (2) | 300 (862) | 189 (544) | 181 (193) | 167 (310) | 168 (607) | 12/15 |
| PSO el-abd noiseless | 0.97 (0.5) | 1.4 (2) | 83 (0.3) | 53 (0.7) | 51 (1) | 46 (156) | 47 (305) | 14/15 |
| RANDOMSEARCH auger noiseless | 1.7 (1) | 1.8 (3) | 1.2 (1) | 3.5 (2) | 8.8 (13) | 42 (28) | 641 (602) | 14/15 |
| Rosenbrock posik noiseless | 1.9 (2) | 5.4 (5) | 3.9 (5) | 2.5 (5) | 2.4 (3) | 2.2 (3) | 2.1 (2) | 15/15 |
| VNS garcia-martinez noiseless | 0.90 (0.5) | 6.1 (9) | 14 (21) | 9.1 (13) | 8.8 (12) | 8.4 (7) | 8.4 (8) | 15/15 |
| iAMALGAM bosman noiseless | 1.3 (0.9) | 21 (36) | 12 (11) | 7.9 (7) | 7.8 (7) | 7.2 (6) | 7.1 (7) | 15/15 |
| Δ fopt f22, 2-D |
1e1 5.0 |
1e0 27 |
1e-1 168 |
1e-2 218 |
1e-3 249 |
1e-5 289 |
1e-7 306 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 1.2 (1) | 1.3 (1.0) | 1.0 (2) | 3.0 (1) | 5.2 (5) | 9.2 (4) | 15 (5) | 15/15 |
| AMALGAM bosman noiseless | 1.4 (1) | 51 (121) | 18 (60) | 19 (19) | 17 (43) | 15 (35) | 15 (13) | 15/15 |
| BAYEDA gallagher noiseless | 1.3 (1) | 3.3 (1) | 7.6 (12) | 10 (19) | 34 (33) | 197 (651) | ∞4000 | 0/15 |
| BFGS ros noiseless | 5.4 (9) | 5.0 (5) | 1.5 (0.9) | 1.2 (2) | 1.1 (2) | 1 (0.6) | 1.00 (1) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 1.1 (0.4) | 7.2 (34) | 11 (26) | 8.7 (20) | 10 (27) | 9.1 (23) | 8.7 (38) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 14 (3) | 25 (25) | 7.2 (6) | 5.7 (7) | 5.0 (7) | 4.4 (6) | 4.3 (4) | 15/15 |
| Cauchy-EDA posik noiseless | 27 (89) | 603 (951) | 191 (375) | 269 (688) | 394 (409) | 538 (612) | 508 (432) | 6/15 |
| DASA korosec noiseless | 12 (8) | 79 (201) | 22 (61) | 21 (37) | 22 (16) | 40 (43) | 63 (57) | 15/15 |
| DE-PSO garcia-nieto noiseless | 2.4 (4) | 4.7 (7) | 2.4 (1) | 4.0 (4) | 4.6 (2) | 6.6 (3) | 10 (5) | 14/15 |
| DIRECT posik noiseless | 1.5 (1) | 2.1 (1) | 1.3 (0.5) | 1.3 (0.9) | 1.4 (0.9) | 4.8 (5) | 5.1 (6) | 5/5 |
| EDA-PSO el-abd noiseless | 1.1 (1) | 3.9 (6) | 1.7 (2) | 4.2 (4) | 4.9 (4) | 11 (9) | 25 (10) | 15/15 |
| FULLNEWUOA ros noiseless | 6.6 (2) | 6.7 (5) | 1.5 (3) | 1.2 (0.9) | 1.1 (0.7) | 1.1 (2) | 1.2 (1) | 15/15 |
| G3PCX posik noiseless | 2.1 (1) | 2.2 (2) | 1.1 (2) | 1.1 (0.7) | 1.1 (1) | 1.4 (0.5) | 1.6 (1.0) | 15/15 |
| GA nicolau noiseless | 1.2 (1) | 3.0 (4) | 1.3 (1) | 3.3 (4) | 7.1 (12) | 281 (538) | 1852 (834) | 2/15 |
| GLOBAL pal noiseless | 1.7 (2) | 2.8 (3) | 1.3 (1) | 1.5 (1) | 1.5 (0.6) | 1.4 (0.6) | 1.3 (0.3) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.0 (1) | 7.6 (6) | 4.4 (4) | 4.1 (5) | 3.9 (2) | 3.8 (4) | 3.8 (5) | 15/15 |
| LSfminbnd posik noiseless | 1.4 (2) | 4.7 (13) | 5.1 (8) | 53 (177) | 49 (76) | 69 (86) | 464 (663) | 1/15 |
| LSstep posik noiseless | 1.0 (0.3) | 79 (127) | 137 (149) | 138 (252) | 148 (256) | 969 (692) | 915 (670) | 1/15 |
| MA-LS-CHAIN molina noiseless | 1.1 (0.9) | 2.8 (4) | 1.6 (2) | 1.8 (1) | 2.2 (0.5) | 2.4 (0.8) | 2.4 (0.6) | 15/15 |
| MCS huyer noiseless | 2.4 (2) | 40 (93) | 7.4 (15) | 6.0 (12) | 5.3 (10) | 4.8 (5) | 5.2 (5) | 15/15 |
| NELDERDOERR doerr noiseless | 1.3 (1) | 8.0 (10) | 1.8 (2) | 1.4 (2) | 1.2 (2) | 1.1 (1) | 1.1 (0.9) | 15/15 |
| NELDER hansen noiseless | 7.8 (26) | 39 (15) | 10 (16) | 7.6 (7) | 6.6 (4) | 5.8 (8) | 5.5 (8) | 15/15 |
| NEWUOA ros noiseless | 2.0 (2) | 6.3 (5) | 1.2 (2) | 1.00 (2) | 1.0 (0.4) | 1.0 (0.2) | 1.1 (0.3) | 15/15 |
| ONEFIFTH auger noiseless | 1.6 (2) | 46 (50) | 11 (16) | 10 (19) | 9.4 (12) | 10 (14) | 12 (19) | 15/15 |
| POEMS kubalik noiseless | 65 (49) | 928 (2642) | 233 (573) | 186 (234) | 165 (5) | 149 (341) | 145 (3) | 14/15 |
| PSO Bounds el-abd noiseless | 1.2 (2) | 532 (1857) | 86 (595) | 67 (459) | 60 (3) | 58 (175) | 64 (332) | 14/15 |
| PSO el-abd noiseless | 1.5 (2) | 2.6 (2) | 1.00 (0.9) | 1.8 (2) | 1.9 (2) | 3.8 (2) | 6.5 (3) | 15/15 |
| RANDOMSEARCH auger noiseless | 1.3 (0.5) | 2.7 (3) | 1.5 (5) | 3.1 (10) | 7.2 (9) | 93 (120) | 757 (1011) | 15/15 |
| Rosenbrock posik noiseless | 13 (20) | 17 (12) | 4.5 (8) | 3.5 (3) | 3.1 (5) | 2.7 (5) | 2.6 (2) | 15/15 |
| VNS garcia-martinez noiseless | 2.0 (1) | 0.99 (0.9) | 2.8 (3) | 3.8 (3) | 4.8 (6) | 5.0 (6) | 5.3 (8) | 15/15 |
| iAMALGAM bosman noiseless | 1.5 (2) | 14 (36) | 10 (22) | 8.9 (32) | 8.0 (18) | 7.1 (7) | 7.3 (17) | 15/15 |
| Δ fopt f23, 2-D |
1e1 8.0 |
1e0 193 |
1e-1 234 |
1e-2 263 |
1e-3 299 |
1e-5 348 |
1e-7 379 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 1.4 (0.8) | 14 (11) | 86 (29) | 136 (74) | 197 (133) | 4058 (7214) | 2.8e4 (4e4) | 1/15 |
| AMALGAM bosman noiseless | 1.3 (0.9) | 7.5 (4) | 10 (2) | 10 (11) | 9.0 (10) | 8.4 (8) | 8.1 (7) | 15/15 |
| BAYEDA gallagher noiseless | 1.9 (1) | 11 (17) | ∞ | ∞ | ∞ | ∞ | ∞4000 | 0/15 |
| BFGS ros noiseless | 4.7 (8) | 4.9 (7) | 28 (25) | 121 (93) | 477 (470) | 410 (502) | ∞9744 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.7 (2) | 8.3 (9) | 15 (15) | 14 (15) | 13 (13) | 12 (15) | 12 (4) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 2.0 (2) | 5.1 (5) | 8.4 (12) | 8.6 (14) | 7.7 (8) | 6.9 (10) | 6.6 (5) | 15/15 |
| Cauchy-EDA posik noiseless | 1.7 (2) | 16 (14) | 861 (675) | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| DASA korosec noiseless | 5.5 (4) | 17 (20) | 174 (705) | 1778 (3707) | 8577 (5023) | 8654 (5766) | 7950 (2e4) | 6/15 |
| DE-PSO garcia-nieto noiseless | 2.2 (3) | 24 (22) | ∞ | ∞ | ∞ | ∞ | ∞4040 | 0/15 |
| DIRECT posik noiseless | 1.4 (1) | 4.2 (2) | 294 (213) | 266 (287) | 239 (585) | 210 (285) | 198 (859) | 3/5 |
| EDA-PSO el-abd noiseless | 2.3 (2) | 18 (9) | 1421 (1471) | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| FULLNEWUOA ros noiseless | 5.9 (10) | 1.5 (1) | 24 (44) | 46 (78) | 81 (94) | 71 (68) | 65 (90) | 6/15 |
| G3PCX posik noiseless | 1.9 (1) | 1.6 (0.8) | 6.1 (14) | 6.0 (9) | 5.8 (0.9) | 5.4 (9) | 7.4 (9) | 15/15 |
| GA nicolau noiseless | 1.4 (2) | 6.6 (6) | 328 (65) | 842 (806) | 3312 (2854) | ∞ | ∞2e5 | 0/15 |
| GLOBAL pal noiseless | 0.97 (0.9) | 2.6 (1) | 97 (38) | ∞ | ∞ | ∞ | ∞3273 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.5 (3) | 8.1 (6) | 14 (11) | 16 (12) | 14 (25) | 13 (12) | 12 (11) | 15/15 |
| LSfminbnd posik noiseless | 1.2 (0.8) | 2.1 (0.4) | 30 (21) | 118 (124) | 197 (210) | ∞ | ∞1e4 | 0/15 |
| LSstep posik noiseless | 2.5 (2) | 18 (48) | 1281 (1261) | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 1.8 (2) | 5.5 (7) | 7.4 (7) | 7.1 (2) | 6.6 (6) | 6.4 (4) | 7.0 (2) | 15/15 |
| MCS huyer noiseless | 3.3 (0.9) | 2.8 (2) | 6.3 (5) | 23 (21) | 213 (394) | 1012 (443) | 1902 (2811) | 1/15 |
| NELDERDOERR doerr noiseless | 4.6 (9) | 1.00 (0.9) | 1.00 (0.8) | 1.00 (1) | 1.0 (0.7) | 1.00 (1) | 1.0 (0.5) | 15/15 |
| NELDER hansen noiseless | 1.3 (2) | 1.6 (3) | 2.2 (4) | 2.2 (3) | 2.0 (2) | 1.8 (2) | 1.7 (2) | 15/15 |
| NEWUOA ros noiseless | 7.6 (16) | 3.2 (3) | 32 (23) | 89 (34) | 130 (97) | 500 (482) | 459 (465) | 0/15 |
| ONEFIFTH auger noiseless | 2.5 (4) | 3.7 (3) | 19 (54) | 55 (107) | 237 (186) | 2092 (3917) | 6678 (9236) | 6/15 |
| POEMS kubalik noiseless | 13 (17) | 28 (26) | 187 (430) | 185 (387) | 181 (6) | 180 (146) | 189 (136) | 13/15 |
| PSO Bounds el-abd noiseless | 1.6 (1) | 9.4 (8) | 258 (267) | 462 (482) | 501 (346) | 659 (474) | 865 (1188) | 5/15 |
| PSO el-abd noiseless | 1.2 (1) | 9.0 (13) | 42 (36) | 59 (36) | 73 (27) | 87 (91) | 95 (17) | 15/15 |
| RANDOMSEARCH auger noiseless | 1.5 (2) | 8.0 (18) | 1918 (1568) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Rosenbrock posik noiseless | 1.9 (0.6) | 2.2 (2) | 10 (15) | 15 (12) | 17 (15) | 29 (44) | ∞9376 | 0/15 |
| VNS garcia-martinez noiseless | 1.8 (2) | 8.3 (8) | 38 (57) | 67 (44) | 65 (61) | 56 (98) | 52 (54) | 15/15 |
| iAMALGAM bosman noiseless | 1.2 (0.6) | 5.3 (13) | 5.5 (13) | 5.3 (1) | 4.9 (5) | 4.7 (5) | 4.6 (4) | 15/15 |
| Δ fopt f24, 2-D |
1e1 18 |
1e0 857 |
1e-1 8515 |
1e-2 23399 |
1e-3 24113 |
1e-5 24721 |
1e-7 24721 |
#succ 5/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 1.0 (0.6) | 6.5 (2) | 4.0 (4) | 2.8 (3) | 2.9 (2) | 3.0 (4) | 3.2 (1) | 15/15 |
| AMALGAM bosman noiseless | 1.2 (1) | 35 (64) | 11 (13) | 6.7 (5) | 6.7 (5) | 6.6 (6) | 6.7 (5) | 15/15 |
| BAYEDA gallagher noiseless | 2.0 (2) | 68 (89) | ∞ | ∞ | ∞ | ∞ | ∞4000 | 0/15 |
| BFGS ros noiseless | 3.4 (7) | 5.1 (8) | 2.9 (3) | ∞ | ∞ | ∞ | ∞5313 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 4.7 (13) | 19 (21) | 17 (9) | 13 (13) | 22 (19) | 22 (18) | 22 (16) | 14/15 |
| CMA-ESPLUSSEL auger noiseless | 2.7 (7) | 6.1 (7) | 4.8 (3) | 2.9 (5) | 2.8 (2) | 2.7 (2) | 3.6 (4) | 3/15 |
| Cauchy-EDA posik noiseless | 4.0 (4) | 33 (30) | 175 (176) | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| DASA korosec noiseless | 10 (4) | 138 (144) | 110 (128) | 61 (51) | 59 (48) | 58 (97) | 58 (49) | 12/15 |
| DE-PSO garcia-nieto noiseless | 3.4 (2) | 67 (154) | ∞ | ∞ | ∞ | ∞ | ∞4040 | 0/15 |
| DIRECT posik noiseless | 1.9 (2) | 79 (146) | 8.7 (21) | 5.0 (10) | 4.9 (10) | 4.7 (7) | 4.8 (4) | 3/5 |
| EDA-PSO el-abd noiseless | 1.6 (0.7) | 100 (16) | 12 (7) | 9.0 (15) | 9.0 (9) | 8.8 (5) | 8.9 (11) | 8/15 |
| FULLNEWUOA ros noiseless | 2.9 (7) | 1.0 (0.9) | 1.00 (1) | 1.1 (2) | 1.0 (1.0) | 1 (2) | 1 (1) | 5/15 |
| G3PCX posik noiseless | 1.3 (1) | 37 (30) | 20 (30) | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| GA nicolau noiseless | 1.6 (2) | 67 (120) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| GLOBAL pal noiseless | 2.8 (4) | 3.3 (2) | 7.0 (14) | ∞ | ∞ | ∞ | ∞4760 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.7 (1) | 7.2 (7) | 3.9 (3) | 3.7 (5) | 3.7 (9) | 3.6 (5) | 3.6 (3) | 3/15 |
| LSfminbnd posik noiseless | 2.9 (2) | 8.3 (10) | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| LSstep posik noiseless | 4.9 (11) | 29 (15) | 33 (33) | 12 (12) | 12 (11) | ∞ | ∞2e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 2.6 (3) | 31 (19) | 34 (33) | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| MCS huyer noiseless | 2.6 (3) | 5.7 (3) | 1.6 (1) | 2.7 (2) | 2.7 (1) | 2.6 (3) | 2.6 (2) | 8/15 |
| NELDERDOERR doerr noiseless | 1.6 (3) | 1.9 (3) | 1.5 (2) | 3.2 (3) | 3.1 (8) | 3.0 (4) | 3.0 (3) | 6/15 |
| NELDER hansen noiseless | 17 (32) | 7.4 (11) | 5.0 (7) | 6.6 (12) | 6.4 (6) | 6.2 (12) | 6.2 (7) | 10/15 |
| NEWUOA ros noiseless | 3.2 (4) | 2.8 (3) | 1.9 (2) | 2.0 (2) | 1.9 (3) | 1.9 (4) | 1.9 (2) | 3/15 |
| ONEFIFTH auger noiseless | 8.1 (25) | 12 (14) | 11 (7) | 21 (14) | 20 (15) | 19 (21) | 19 (14) | 15/15 |
| POEMS kubalik noiseless | 28 (18) | 1521 (2917) | 173 (272) | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| PSO Bounds el-abd noiseless | 1.3 (1.0) | 1524 (1923) | 155 (188) | 57 (92) | 55 (60) | 54 (55) | 54 (59) | 2/15 |
| PSO el-abd noiseless | 2.4 (2) | 470 (875) | 49 (111) | 18 (17) | 17 (31) | 17 (24) | 17 (29) | 5/15 |
| RANDOMSEARCH auger noiseless | 2.5 (3) | 14 (23) | 149 (157) | 572 (684) | ∞ | ∞ | ∞2e6 | 0/15 |
| Rosenbrock posik noiseless | 19 (22) | 35 (29) | 15 (23) | 11 (11) | 11 (16) | 11 (17) | 11 (12) | 1/15 |
| VNS garcia-martinez noiseless | 1.2 (0.0) | 5.3 (4) | 1.7 (3) | 1.0 (1) | 1.00 (1) | 1.9 (1) | 4.7 (2) | 15/15 |
| iAMALGAM bosman noiseless | 1.5 (2) | 28 (29) | 9.1 (6) | 5.4 (3) | 5.3 (3) | 5.3 (4) | 5.3 (3) | 15/15 |
Previous dimension | Dimension = 3 | Next dimension
| Δ fopt f1, 3-D |
1e1 4.0 |
1e0 8.0 |
1e-1 8.0 |
1e-2 8.0 |
1e-3 8.0 |
1e-5 8.0 |
1e-7 8.0 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 2.4 (2) | 31 (44) | 156 (38) | 280 (81) | 447 (80) | 862 (68) | 1221 (61) | 15/15 |
| AMALGAM bosman noiseless | 2.8 (2) | 7.4 (3) | 16 (4) | 26 (12) | 37 (17) | 54 (13) | 73 (24) | 15/15 |
| BAYEDA gallagher noiseless | 2.1 (1) | 9.2 (13) | 96 (12) | 123 (205) | 157 (376) | 282 (387) | 423 (396) | 12/15 |
| BFGS ros noiseless | 2.1 (0.5) | 1.1 (0) | 1.1 (0) | 1.1 (0) | 1.1 (0) | 1.1 (0) | 1.1 (0) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 2.5 (0.8) | 5.1 (4) | 11 (3) | 18 (10) | 23 (6) | 34 (5) | 47 (7) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 1.6 (2) | 5.2 (2) | 8.8 (3) | 12 (3) | 15 (3) | 23 (2) | 30 (3) | 15/15 |
| Cauchy-EDA posik noiseless | 36 (20) | 36 (15) | 58 (28) | 91 (17) | 114 (42) | 163 (30) | 211 (47) | 15/15 |
| DASA korosec noiseless | 33 (24) | 37 (22) | 49 (36) | 63 (16) | 76 (44) | 101 (22) | 129 (25) | 15/15 |
| DE-PSO garcia-nieto noiseless | 2.6 (3) | 15 (8) | 36 (20) | 65 (14) | 96 (15) | 147 (8) | 201 (9) | 15/15 |
| DIRECT posik noiseless | 1.1 (0.9) | 2.0 (1) | 5.7 (3) | 15 (3) | 27 (2) | 52 (11) | 95 (11) | 5/5 |
| EDA-PSO el-abd noiseless | 2.5 (3) | 10 (4) | 28 (6) | 56 (17) | 121 (61) | 394 (116) | 694 (154) | 15/15 |
| FULLNEWUOA ros noiseless | 2.6 (0) | 1.4 (0) | 1.4 (0) | 1.4 (0) | 1.4 (0) | 1.4 (0) | 1.4 (0) | 15/15 |
| G3PCX posik noiseless | 1.7 (2) | 12 (5) | 15 (2) | 19 (3) | 24 (5) | 34 (5) | 47 (8) | 15/15 |
| GA nicolau noiseless | 2.8 (3) | 26 (32) | 440 (292) | 1196 (320) | 2124 (343) | 4184 (557) | 6760 (942) | 15/15 |
| GLOBAL pal noiseless | 2.8 (2) | 22 (18) | 38 (2) | 41 (0.8) | 42 (0.4) | 45 (0.7) | 48 (0.9) | 14/15 |
| IPOP-SEP-CMA-ES ros noiseless | 3.2 (2) | 5.3 (3) | 10 (2) | 14 (2) | 20 (4) | 31 (4) | 41 (5) | 15/15 |
| LSfminbnd posik noiseless | 4.9 (7) | 4.1 (3) | 5.3 (2) | 5.6 (2) | 5.6 (2) | 5.9 (3) | 5.9 (1) | 15/15 |
| LSstep posik noiseless | 114 (100) | 94 (12) | 101 (0.2) | 101 (0.1) | 101 (0.1) | 102 (0.1) | 102 (0.0) | 15/15 |
| MA-LS-CHAIN molina noiseless | 2.2 (2) | 14 (7) | 36 (11) | 57 (13) | 70 (4) | 82 (7) | 96 (5) | 15/15 |
| MCS huyer noiseless | 0.90 (0.6) | 1.6 (0.9) | 2.0 (1.0) | 2.4 (1) | 2.4 (0.9) | 2.4 (1) | 2.4 (1.0) | 15/15 |
| NELDERDOERR doerr noiseless | 1.8 (1) | 2.4 (0.6) | 3.9 (0.8) | 5.4 (0.8) | 6.9 (0.8) | 10 (0.9) | 14 (0.9) | 15/15 |
| NELDER hansen noiseless | 1.7 (0.9) | 1.8 (0.8) | 3.4 (1) | 5.3 (0.9) | 6.7 (0.8) | 10 (0.7) | 13 (2) | 15/15 |
| NEWUOA ros noiseless | 1.6 (0.8) | 1 (0) | 1 (0)★ | 1 (0)★ | 1 (0)★ | 1 (0)★ | 1 (0)★ | 15/15 |
| ONEFIFTH auger noiseless | 3.1 (2) | 4.1 (3) | 7.0 (2) | 11 (2) | 14 (1) | 22 (4) | 29 (2) | 15/15 |
| POEMS kubalik noiseless | 155 (30) | 107 (30) | 175 (71) | 393 (301) | 1016 (172) | 1736 (213) | 2447 (183) | 15/15 |
| PSO Bounds el-abd noiseless | 2.8 (3) | 13 (9) | 58 (40) | 229 (112) | 433 (66) | 854 (84) | 1464 (185) | 15/15 |
| PSO el-abd noiseless | 2.9 (3) | 10 (7) | 44 (15) | 86 (33) | 158 (45) | 307 (55) | 502 (69) | 15/15 |
| RANDOMSEARCH auger noiseless | 3.4 (7) | 35 (49) | 1372 (1531) | 3.3e4 (5e4) | 1.3e6 (1e6) | ∞ | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 4.0 (3) | 3.3 (2) | 4.8 (1) | 5.9 (1) | 7.5 (1) | 10 (2) | 13 (3) | 15/15 |
| VNS garcia-martinez noiseless | 2.4 (2) | 13 (10) | 24 (4) | 31 (6) | 37 (3) | 50 (7) | 62 (4) | 15/15 |
| iAMALGAM bosman noiseless | 2.2 (2) | 5.5 (2) | 12 (3) | 18 (8) | 24 (7) | 36 (10) | 49 (13) | 15/15 |
| Δ fopt f2, 3-D |
1e1 38 |
1e0 42 |
1e-1 43 |
1e-2 44 |
1e-3 45 |
1e-5 47 |
1e-7 48 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 66 (19) | 102 (19) | 136 (17) | 163 (17) | 188 (25) | 245 (19) | 306 (14) | 15/15 |
| AMALGAM bosman noiseless | 6.0 (2) | 8.0 (2) | 10 (5) | 12 (3) | 14 (5) | 17 (5) | 20 (4) | 15/15 |
| BAYEDA gallagher noiseless | 20 (6) | 25 (8) | 30 (5) | 46 (4) | 48 (35) | 69 (68) | 93 (68) | 12/15 |
| BFGS ros noiseless | 3.1 (1) | 3.9 (2) | 4.7 (1) | 4.9 (2) | 4.9 (1) | 5.1 (0.8) | 5.2 (0.6) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 13 (4) | 17 (7) | 20 (2) | 21 (3) | 21 (4) | 23 (2) | 24 (3) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 8.4 (4) | 11 (4) | 12 (1) | 13 (1) | 13 (2) | 14 (2) | 14 (1) | 15/15 |
| Cauchy-EDA posik noiseless | 18 (4) | 21 (3) | 25 (4) | 29 (4) | 34 (4) | 40 (3) | 48 (7) | 15/15 |
| DASA korosec noiseless | 11 (4) | 13 (4) | 16 (7) | 18 (6) | 19 (5) | 23 (3) | 28 (8) | 15/15 |
| DE-PSO garcia-nieto noiseless | 15 (2) | 18 (3) | 24 (2) | 28 (2) | 32 (4) | 39 (2) | 47 (5) | 15/15 |
| DIRECT posik noiseless | 4.5 (3) | 7.2 (0.4) | 9.0 (1) | 10 (1) | 12 (2) | 32 (37) | 38 (36) | 5/5 |
| EDA-PSO el-abd noiseless | 13 (5) | 31 (12) | 58 (18) | 84 (18) | 106 (9) | 153 (28) | 201 (21) | 15/15 |
| FULLNEWUOA ros noiseless | 1.7 (1) | 4.2 (2) | 8.2 (6) | 12 (5) | 16 (6) | 22 (10) | 29 (13) | 15/15 |
| G3PCX posik noiseless | 43 (38) | 86 (102) | 117 (124) | 133 (118) | 165 (138) | 195 (114) | 232 (144) | 15/15 |
| GA nicolau noiseless | 282 (75) | 404 (51) | 577 (195) | 774 (87) | 944 (134) | 1365 (142) | 1940 (193) | 15/15 |
| GLOBAL pal noiseless | 9.0 (0.3) | 8.8 (0.7) | 9.0 (1) | 9.3 (0.7) | 9.3 (0.6) | 9.4 (0.6) | 10 (0.4) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 10 (3) | 12 (2) | 13 (1) | 14 (1) | 14 (2) | 15 (2) | 17 (1) | 15/15 |
| LSfminbnd posik noiseless | 1.0 (0.4) | 0.99 (0.3)★ | 1.0 (0.2)★ | 1.00 (0.2)★ | 0.99 (0.2)★ | 0.99 (0.2)★ | 1 (0.1)★ | 15/15 |
| LSstep posik noiseless | 15 (5) | 14 (4) | 14 (4) | 14 (2) | 13 (4) | 13 (2) | 13 (3) | 15/15 |
| MA-LS-CHAIN molina noiseless | 14 (4) | 19 (4) | 22 (6) | 25 (9) | 30 (15) | 37 (19) | 44 (19) | 15/15 |
| MCS huyer noiseless | 1.8 (1) | 1.9 (0.9) | 2.3 (0.8) | 3.7 (2) | 4.4 (1) | 5.2 (1) | 6.9 (2) | 15/15 |
| NELDERDOERR doerr noiseless | 2.3 (2) | 2.8 (1) | 3.2 (0.6) | 3.6 (1) | 3.7 (1) | 4.2 (1) | 4.6 (1) | 15/15 |
| NELDER hansen noiseless | 2.2 (1) | 3.3 (1) | 4.3 (1) | 4.6 (2) | 4.8 (0.7) | 5.1 (1) | 5.4 (2) | 15/15 |
| NEWUOA ros noiseless | 3.4 (4) | 14 (22) | 26 (29) | 33 (25) | 42 (36) | 56 (43) | 72 (32) | 15/15 |
| ONEFIFTH auger noiseless | 5859 (1209) | 2.0e4 (2e4) | 4.2e4 (3e4) | 6.6e4 (3e4) | 3.1e5 (5e5) | ∞ | ∞3e6 | 0/15 |
| POEMS kubalik noiseless | 286 (83) | 312 (54) | 367 (86) | 447 (116) | 496 (68) | 618 (77) | 720 (94) | 15/15 |
| PSO Bounds el-abd noiseless | 148 (166) | 294 (123) | 346 (193) | 505 (352) | 553 (600) | 638 (391) | 920 (207) | 15/15 |
| PSO el-abd noiseless | 46 (12) | 55 (12) | 66 (7) | 82 (9) | 94 (9) | 121 (9) | 144 (26) | 15/15 |
| RANDOMSEARCH auger noiseless | 6076 (7758) | 1.7e5 (2e5) | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 4.9 (0.8) | 16 (9) | 20 (11) | 22 (9) | 24 (6) | 24 (5) | 26 (7) | 15/15 |
| VNS garcia-martinez noiseless | 21 (7) | 26 (4) | 27 (16) | 27 (16) | 28 (2) | 29 (13) | 30 (3) | 15/15 |
| iAMALGAM bosman noiseless | 4.5 (1) | 6.0 (0.9) | 7.7 (2) | 8.8 (2) | 10 (2) | 12 (2) | 14 (4) | 15/15 |
| Δ fopt f3, 3-D |
1e1 38 |
1e0 822 |
1e-1 830 |
1e-2 835 |
1e-3 842 |
1e-5 847 |
1e-7 853 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 25 (17) | 6.2 (2) | 8.9 (3) | 11 (3) | 13 (2) | 17 (2) | 21 (3) | 15/15 |
| AMALGAM bosman noiseless | 3.6 (1) | 4.2 (6) | 14 (45) | 15 (45) | 15 (8) | 15 (44) | 15 (18) | 15/15 |
| BAYEDA gallagher noiseless | 32 (80) | 10 (7) | ∞ | ∞ | ∞ | ∞ | ∞6000 | 0/15 |
| BFGS ros noiseless | 41 (53) | 25 (23) | 155 (242) | 154 (159) | 153 (162) | 152 (132) | 151 (185) | 1/15 |
| BIPOP-CMA-ES hansen noiseless | 3.2 (4) | 4.7 (3) | 25 (29) | 25 (12) | 26 (19) | 26 (5) | 26 (89) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 8.1 (11) | 4.0 (5) | 38 (16) | 38 (55) | 37 (78) | 37 (44) | 37 (37) | 9/15 |
| Cauchy-EDA posik noiseless | 14 (4) | 7.6 (7) | 250 (287) | 2560 (5031) | ∞ | ∞ | ∞2e5 | 0/15 |
| DASA korosec noiseless | 14 (4) | 1.4 (1.0) | 12 (9) | 12 (23) | 12 (8) | 12 (12) | 12 (16) | 15/15 |
| DE-PSO garcia-nieto noiseless | 11 (8) | 2.7 (1) | 4.1 (5) | 4.8 (1) | 5.6 (1) | 7.3 (4) | 8.6 (2) | 6/15 |
| DIRECT posik noiseless | 4.8 (0.4) | 4.1 (3) | 17 (18) | 17 (18) | 17 (17) | 17 (18) | 17 (17) | 5/5 |
| EDA-PSO el-abd noiseless | 5.6 (3) | 13 (3) | 42 (94) | 44 (4) | 44 (92) | 46 (4) | 49 (4) | 14/15 |
| FULLNEWUOA ros noiseless | 4.9 (3) | 3.3 (2) | 15 (12) | 15 (37) | 15 (10) | 15 (16) | 15 (14) | 11/15 |
| G3PCX posik noiseless | 73 (72) | 58 (111) | 333 (525) | 331 (379) | 328 (446) | 326 (335) | 324 (768) | 6/15 |
| GA nicolau noiseless | 52 (24) | 15 (3) | 23 (3) | 31 (4) | 41 (7) | 69 (8) | 104 (17) | 15/15 |
| GLOBAL pal noiseless | 8.2 (3) | 3.6 (3) | 12 (17) | 12 (7) | 12 (9) | 12 (6) | 12 (10) | 3/15 |
| IPOP-SEP-CMA-ES ros noiseless | 3.4 (2) | 3.7 (2) | 14 (9) | 17 (36) | 17 (27) | 17 (20) | 17 (4) | 13/15 |
| LSfminbnd posik noiseless | 1.00 (0.2) | 38 (36) | 54 (34) | 54 (47) | 53 (108) | 53 (56) | 52 (90) | 3/15 |
| LSstep posik noiseless | 21 (3) | 1.00 (9e-3) | 1.00 (6e-3) | 1.00 (0.0) | 1.0 (0.0) | 1.0 (0.0) | 1.00 (0.0) | 15/15 |
| MA-LS-CHAIN molina noiseless | 6.7 (1) | 2.3 (4) | 8.3 (31) | 8.4 (8) | 8.4 (18) | 8.4 (8) | 8.5 (7) | 14/15 |
| MCS huyer noiseless | 6.7 (15) | 1.2 (3) | 10 (13) | 11 (18) | 11 (11) | 12 (10) | 12 (9) | 15/15 |
| NELDERDOERR doerr noiseless | 3.0 (4) | 1.5 (1) | 8.4 (7) | 8.3 (7) | 8.3 (4) | 8.3 (12) | 8.3 (12) | 15/15 |
| NELDER hansen noiseless | 25 (39) | 17 (10) | 103 (80) | 103 (103) | 102 (86) | 101 (95) | 101 (72) | 15/15 |
| NEWUOA ros noiseless | 5.7 (8) | 5.0 (11) | 55 (34) | 54 (46) | 54 (22) | 54 (60) | 53 (62) | 4/15 |
| ONEFIFTH auger noiseless | 14 (16) | 12 (8) | 69 (45) | 68 (65) | 68 (47) | 67 (41) | 67 (57) | 15/15 |
| POEMS kubalik noiseless | 26 (4) | 8.2 (7) | 23 (39) | 27 (44) | 31 (2) | 37 (44) | 45 (24) | 15/15 |
| PSO Bounds el-abd noiseless | 15 (6) | 8.6 (5) | 18 (5) | 22 (3) | 25 (16) | 29 (9) | 41 (9) | 15/15 |
| PSO el-abd noiseless | 7.3 (6) | 3.5 (1) | 6.1 (4) | 7.0 (8) | 7.9 (3) | 10 (3) | 11 (7) | 15/15 |
| RANDOMSEARCH auger noiseless | 115 (91) | 5524 (3525) | 5.1e4 (4e4) | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 41 (31) | 27 (24) | 409 (378) | 407 (589) | 403 (176) | 401 (579) | 398 (287) | 1/15 |
| VNS garcia-martinez noiseless | 8.4 (3) | 3.8 (4) | 7.4 (4) | 7.4 (5) | 7.6 (6) | 11 (6) | 17 (6) | 15/15 |
| iAMALGAM bosman noiseless | 12 (35) | 12 (16) | 39 (30) | 39 (27) | 39 (29) | 39 (15) | 39 (25) | 15/15 |
| Δ fopt f4, 3-D |
1e1 40 |
1e0 808 |
1e-1 866 |
1e-2 921 |
1e-3 952 |
1e-5 1015 |
1e-7 1044 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 38 (18) | 10 (2) | 16 (15) | 18 (2) | 19 (4) | 23 (11) | 27 (6) | 15/15 |
| AMALGAM bosman noiseless | 23 (3) | 105 (138) | 974 (730) | 949 (756) | 926 (670) | 883 (165) | 873 (623) | 15/15 |
| BAYEDA gallagher noiseless | 33 (6) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6000 | 0/15 |
| BFGS ros noiseless | 48 (56) | 54 (41) | ∞ | ∞ | ∞ | ∞ | ∞9836 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 10 (16) | 263 (1062) | 3269 (3183) | 4051 (3344) | 3919 (5507) | 3676 (3829) | 3574 (3503) | 4/15 |
| CMA-ESPLUSSEL auger noiseless | 13 (15) | 21 (30) | 151 (158) | 142 (147) | 137 (136) | 129 (172) | 125 (74) | 3/15 |
| Cauchy-EDA posik noiseless | 24 (14) | 1323 (888) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| DASA korosec noiseless | 12 (5) | 1.2 (0.6) | 2.0 (3) | 2.0 (1) | 2.0 (1) | 2.1 (3) | 2.3 (1) | 15/15 |
| DE-PSO garcia-nieto noiseless | 13 (5) | 6.8 (4) | 18 (23) | 47 (52) | 46 (70) | 44 (54) | 43 (52) | 2/15 |
| DIRECT posik noiseless | 4.9 (4) | 20 (29) | 26 (20) | 44 (80) | 83 (159) | 182 (138) | 184 (216) | 2/5 |
| EDA-PSO el-abd noiseless | 16 (21) | 24 (11) | 112 (174) | 107 (161) | 104 (85) | 100 (300) | 100 (145) | 12/15 |
| FULLNEWUOA ros noiseless | 11 (10) | 25 (23) | 165 (135) | 155 (175) | 150 (251) | 141 (144) | 137 (129) | 2/15 |
| G3PCX posik noiseless | 128 (487) | 62 (70) | 430 (305) | 405 (503) | 392 (326) | 367 (514) | 357 (383) | 5/15 |
| GA nicolau noiseless | 91 (58) | 19 (6) | 24 (5) | 34 (7) | 42 (8) | 63 (6) | 114 (80) | 14/15 |
| GLOBAL pal noiseless | 12 (3) | 7.9 (9) | 51 (49) | 48 (36) | 46 (95) | 43 (17) | 42 (29) | 1/15 |
| IPOP-SEP-CMA-ES ros noiseless | 6.4 (16) | 83 (47) | ∞ | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| LSfminbnd posik noiseless | 1.0 (0.2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| LSstep posik noiseless | 17 (10) | 1.00 (0.1) | 1.0 (0.0) | 1.0 (0.1) | 1.0 (0.1) | 1.00 (0.1)★ | 1.00 (0.2)★ | 12/15 |
| MA-LS-CHAIN molina noiseless | 10 (3) | 5.6 (4) | 60 (57) | 57 (111) | 55 (109) | 52 (91) | 51 (52) | 8/15 |
| MCS huyer noiseless | 6.0 (9) | 10 (3) | 67 (143) | 63 (70) | 61 (41) | 57 (35) | 56 (54) | 6/15 |
| NELDERDOERR doerr noiseless | 4.6 (4) | 7.8 (8) | 43 (61) | 40 (67) | 39 (45) | 37 (69) | 36 (32) | 12/15 |
| NELDER hansen noiseless | 34 (51) | 72 (50) | 322 (550) | 302 (240) | 293 (491) | 274 (234) | 267 (440) | 10/15 |
| NEWUOA ros noiseless | 25 (24) | 21 (19) | 302 (212) | 284 (460) | 275 (333) | 258 (260) | 251 (554) | 1/15 |
| ONEFIFTH auger noiseless | 32 (25) | 33 (40) | 228 (312) | 214 (222) | 207 (170) | 195 (270) | 189 (251) | 15/15 |
| POEMS kubalik noiseless | 49 (20) | 13 (9) | 46 (45) | 47 (40) | 48 (37) | 53 (34) | 57 (33) | 15/15 |
| PSO Bounds el-abd noiseless | 28 (6) | 21 (27) | 28 (10) | 36 (34) | 36 (38) | 39 (36) | 51 (9) | 15/15 |
| PSO el-abd noiseless | 15 (5) | 6.0 (0.8) | 98 (360) | 93 (95) | 91 (316) | 87 (149) | 87 (83) | 12/15 |
| RANDOMSEARCH auger noiseless | 225 (217) | 1.6e4 (2e4) | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 43 (61) | 44 (55) | 139 (141) | 130 (160) | 126 (122) | 118 (126) | 115 (150) | 3/15 |
| VNS garcia-martinez noiseless | 19 (19) | 7.6 (6) | 20 (15) | 19 (17) | 19 (15) | 22 (17) | 50 (43) | 15/15 |
| iAMALGAM bosman noiseless | 12 (3) | 126 (173) | 860 (1822) | 820 (2269) | 797 (1256) | 756 (738) | 743 (785) | 14/15 |
| Δ fopt f5, 3-D |
1e1 7.0 |
1e0 7.0 |
1e-1 7.0 |
1e-2 7.0 |
1e-3 7.0 |
1e-5 7.0 |
1e-7 7.0 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 26 (22) | 84 (36) | 93 (20) | 98 (33) | 103 (25) | 106 (38) | 106 (34) | 15/15 |
| AMALGAM bosman noiseless | 11 (13) | 19 (25) | 20 (6) | 20 (19) | 20 (18) | 20 (18) | 20 (9) | 15/15 |
| BAYEDA gallagher noiseless | 21 (28) | 344 (429) | 347 (856) | 347 (650) | 347 (244) | 347 (1725) | 347 (1504) | 11/15 |
| BFGS ros noiseless | 1.5 (0.3) | 2.3 (0.9) | 2.4 (0.7) | 2.4 (0.9) | 2.4 (1) | 2.4 (0.7) | 2.4 (0.7) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 3.4 (2) | 5.1 (2) | 5.4 (2) | 5.4 (2) | 5.4 (2) | 5.4 (0.9) | 5.4 (0.9) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 2.0 (0.9) | 2.5 (1) | 2.6 (1) | 2.7 (1) | 2.7 (0.9) | 2.7 (1) | 2.7 (0.9) | 15/15 |
| Cauchy-EDA posik noiseless | 19 (6) | 21 (4) | 22 (15) | 22 (10) | 22 (6) | 22 (13) | 22 (14) | 15/15 |
| DASA korosec noiseless | 18 (7) | 29 (10) | 34 (13) | 38 (12) | 42 (12) | 50 (15) | 58 (12) | 15/15 |
| DE-PSO garcia-nieto noiseless | 15 (4) | 33 (11) | 36 (9) | 36 (9) | 36 (6) | 36 (9) | 36 (9) | 15/15 |
| DIRECT posik noiseless | 3.5 (0.1) | 4.3 (0.1) | 5.8 (0.1) | 5.8 (0.1) | 5.8 (0.1) | 5.8 (0.1) | 5.8 (0.1) | 5/5 |
| EDA-PSO el-abd noiseless | 8.0 (3) | 15 (6) | 16 (5) | 16 (5) | 16 (4) | 16 (5) | 16 (5) | 15/15 |
| FULLNEWUOA ros noiseless | 1.1 (0.2) | 1.6 (0.2) | 1.7 (0.1) | 1.7 (0.1) | 1.7 (0.1) | 1.7 (0.1) | 1.7 (0.1) | 15/15 |
| G3PCX posik noiseless | 8.8 (7) | 21 (4) | 23 (7) | 24 (15) | 24 (12) | 24 (14) | 24 (4) | 15/15 |
| GA nicolau noiseless | 13 (18) | 1017 (229) | 2859 (212) | 4566 (618) | 7086 (962) | 1.5e4 (2540) | ∞3e5 | 0/15 |
| GLOBAL pal noiseless | 29 (15) | 44 (1) | 45 (1) | 45 (0.7) | 45 (1) | 45 (0.9) | 45 (0.8) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 3.9 (3) | 6.3 (4) | 6.6 (3) | 6.7 (3) | 6.7 (5) | 6.7 (4) | 6.7 (4) | 15/15 |
| LSfminbnd posik noiseless | 7.0 (1) | 10 (0.1) | 11 (0.1) | 11 (0) | 11 (0) | 11 (0) | 11 (0) | 15/15 |
| LSstep posik noiseless | 88 (29) | 114 (0.1) | 114 (0.1) | 114 (0.1) | 114 (0.1) | 114 (0.1) | 114 (0.0) | 15/15 |
| MA-LS-CHAIN molina noiseless | 24 (13) | 83 (7) | 87 (4) | 87 (4) | 87 (6) | 87 (6) | 87 (5) | 15/15 |
| MCS huyer noiseless | 0.94 (0.1) | 0.94 (0.1)★ | 0.94 (0.1)★ | 0.94 (0)★ | 0.94 (0.1)★ | 0.94 (0.1)★ | 0.94 (0.1)★ | 15/15 |
| NELDERDOERR doerr noiseless | 1.3 (0.6) | 2.3 (0.9) | 2.3 (0.9) | 2.3 (1) | 2.3 (1.0) | 2.3 (1) | 2.3 (1.0) | 15/15 |
| NELDER hansen noiseless | 1.5 (0.7) | 2.3 (2) | 2.4 (2) | 2.4 (2) | 2.4 (2) | 2.4 (2) | 2.4 (2) | 15/15 |
| NEWUOA ros noiseless | 1.1 (0.1) | 1.3 (0.2) | 1.4 (0.3) | 1.4 (0.3) | 1.4 (0.3) | 1.4 (0.2) | 1.4 (0.4) | 15/15 |
| ONEFIFTH auger noiseless | 2.1 (1) | 2.8 (0.7) | 2.9 (2) | 2.9 (2) | 2.9 (2) | 2.9 (2) | 2.9 (2) | 15/15 |
| POEMS kubalik noiseless | 110 (17) | 146 (31) | 164 (10) | 171 (3) | 171 (23) | 171 (23) | 171 (2) | 15/15 |
| PSO Bounds el-abd noiseless | 5.9 (4) | 13 (3) | 14 (6) | 14 (3) | 14 (4) | 14 (6) | 14 (2) | 15/15 |
| PSO el-abd noiseless | 7.7 (2) | 15 (3) | 17 (6) | 17 (9) | 17 (5) | 17 (4) | 17 (7) | 15/15 |
| RANDOMSEARCH auger noiseless | 32 (28) | 1.7e4 (3e4) | 6.1e6 (6e6) | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 3.1 (0.7) | 3.4 (0.4) | 3.4 (0.5) | 3.4 (0.7) | 3.4 (0.5) | 3.4 (0.6) | 3.4 (0.4) | 15/15 |
| VNS garcia-martinez noiseless | 17 (2) | 19 (2) | 19 (3) | 19 (2) | 19 (2) | 19 (2) | 19 (3) | 15/15 |
| iAMALGAM bosman noiseless | 3.3 (3) | 7.8 (4) | 8.3 (2) | 8.3 (2) | 8.3 (6) | 8.3 (5) | 8.3 (5) | 15/15 |
| Δ fopt f6, 3-D |
1e1 34 |
1e0 56 |
1e-1 90 |
1e-2 117 |
1e-3 149 |
1e-5 215 |
1e-7 265 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 9.1 (7) | 35 (19) | 46 (9) | 52 (13) | 58 (9) | 64 (10) | 72 (7) | 15/15 |
| AMALGAM bosman noiseless | 3.6 (2) | 5.5 (2) | 5.5 (3) | 6.3 (3) | 6.4 (2) | 6.8 (2) | 7.5 (2) | 15/15 |
| BAYEDA gallagher noiseless | 127 (263) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6000 | 0/15 |
| BFGS ros noiseless | 3.5 (3) | 3.4 (2) | 2.9 (0.6) | 2.4 (0.8) | 2.0 (0.6) | 1.9 (1) | 3.1 (2) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 2.4 (2) | 3.2 (1) | 3.2 (0.6) | 3.2 (0.8) | 3.2 (0.9) | 3.0 (0.5) | 3.2 (0.4) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 1.3 (0.9) | 1.6 (1) | 1.8 (0.5) | 1.7 (0.6) | 1.6 (0.6) | 1.6 (0.3) | 1.6 (0.5) | 15/15 |
| Cauchy-EDA posik noiseless | 27 (25) | 31 (6) | 28 (6) | 27 (6) | 26 (5) | 24 (4) | 25 (3) | 15/15 |
| DASA korosec noiseless | 30 (40) | 32 (34) | 30 (39) | 36 (51) | 55 (105) | 54 (138) | 66 (12) | 15/15 |
| DE-PSO garcia-nieto noiseless | 5.9 (6) | 11 (3) | 11 (2) | 13 (3) | 14 (3) | 13 (2) | 14 (3) | 15/15 |
| DIRECT posik noiseless | 2.9 (2) | 33 (16) | 437 (939) | 1336 (3420) | 2714 (1678) | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 2.6 (2) | 13 (4) | 28 (20) | 42 (30) | 59 (14) | 66 (20) | 76 (14) | 15/15 |
| FULLNEWUOA ros noiseless | 4.0 (8) | 5.1 (9) | 5.1 (9) | 5.4 (4) | 5.7 (6) | 6.1 (5) | 6.8 (5) | 15/15 |
| G3PCX posik noiseless | 3.5 (1) | 3.3 (1) | 2.9 (0.6) | 3.1 (1) | 3.2 (2) | 4.3 (2) | 4.8 (2) | 15/15 |
| GA nicolau noiseless | 8.9 (13) | 102 (25) | 272 (143) | 4167 (7161) | 4364 (4043) | 4387 (4722) | 1.6e4 (2e4) | 0/15 |
| GLOBAL pal noiseless | 5.1 (4) | 5.5 (3) | 4.0 (0.3) | 3.3 (0.1) | 2.8 (0.3) | 2.3 (0.2) | 2.3 (0.4) | 12/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.7 (2) | 3.7 (2) | 3.3 (1) | 3.5 (1) | 3.6 (1) | 3.6 (1) | 3.6 (0.7) | 15/15 |
| LSfminbnd posik noiseless | 487 (1103) | 810 (1877) | 507 (834) | 394 (321) | 313 (503) | 224 (454) | 187 (237) | 6/15 |
| LSstep posik noiseless | 1143 (2433) | 988 (865) | 1005 (508) | 817 (599) | 675 (907) | 668 (358) | 1685 (2094) | 0/15 |
| MA-LS-CHAIN molina noiseless | 4.3 (4) | 10 (4) | 10 (6) | 10 (4) | 9.1 (3) | 8.2 (3) | 8.1 (1) | 15/15 |
| MCS huyer noiseless | 3.0 (2) | 164 (672) | 118 (54) | 141 (187) | 144 (121) | 153 (214) | 213 (197) | 2/15 |
| NELDERDOERR doerr noiseless | 0.99 (0.8) | 1 (1) | 1.0 (0.2) | 1.00 (0.1) | 1.0 (0.2) | 1.00 (0.1) | 1.00 (0.1) | 15/15 |
| NELDER hansen noiseless | 1.7 (1) | 1.5 (0.6) | 1.3 (0.7) | 1.3 (0.9) | 1.2 (0.7) | 1.2 (0.4) | 1.3 (0.4) | 15/15 |
| NEWUOA ros noiseless | 2.1 (0.7) | 3.4 (2) | 3.8 (4) | 4.0 (2) | 4.1 (2) | 4.1 (3) | 4.8 (2) | 15/15 |
| ONEFIFTH auger noiseless | 1.6 (0.8) | 2.0 (1) | 1.8 (0.8) | 1.8 (0.9) | 2.0 (2) | 2.1 (1) | 3.0 (0.4) | 15/15 |
| POEMS kubalik noiseless | 31 (17) | 74 (25) | 83 (14) | 92 (18) | 101 (4) | 99 (7) | 110 (4) | 15/15 |
| PSO Bounds el-abd noiseless | 2.8 (1) | 12 (12) | 26 (9) | 104 (123) | 117 (42) | 123 (130) | 121 (103) | 15/15 |
| PSO el-abd noiseless | 2.8 (2) | 8.0 (7) | 13 (5) | 16 (4) | 18 (4) | 25 (4) | 28 (3) | 15/15 |
| RANDOMSEARCH auger noiseless | 7.6 (6) | 200 (291) | 8764 (8183) | 1.1e5 (1e5) | ∞ | ∞ | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 2.1 (2) | 1.8 (2) | 1.7 (0.9) | 1.7 (1.0) | 1.6 (0.8) | 1.7 (0.8) | 1.6 (0.7) | 15/15 |
| VNS garcia-martinez noiseless | 5.5 (4) | 5.9 (1) | 4.8 (0.7) | 4.6 (0.6) | 4.3 (0.6) | 3.9 (0.3) | 3.8 (0.6) | 15/15 |
| iAMALGAM bosman noiseless | 2.1 (1) | 2.9 (0.7) | 3.1 (0.6) | 3.7 (1) | 4.1 (1) | 4.3 (2) | 4.8 (2) | 15/15 |
| Δ fopt f7, 3-D |
1e1 11 |
1e0 65 |
1e-1 342 |
1e-2 464 |
1e-3 482 |
1e-5 482 |
1e-7 535 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 6.5 (5) | 10 (9) | 7.0 (2) | 8.7 (2) | 9.3 (3) | 9.3 (2) | 11 (2) | 15/15 |
| AMALGAM bosman noiseless | 2.7 (2) | 1.6 (0.9) | 2.1 (12) | 3.1 (10) | 3.0 (0.2) | 3.0 (5) | 2.9 (4) | 15/15 |
| BAYEDA gallagher noiseless | 3.7 (5) | 52 (93) | 72 (105) | 85 (71) | ∞ | ∞ | ∞6000 | 0/15 |
| BFGS ros noiseless | 17 (26) | 86 (97) | ∞ | ∞ | ∞ | ∞ | ∞400 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 3.4 (4) | 2.8 (1.0) | 1.1 (1) | 1 (0.9) | 1.00 (0.8) | 1.00 (0.7) | 1.0 (0.8) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 2.8 (1) | 2.1 (2) | 1 (0.8) | 1.4 (0.6) | 1.4 (0.4) | 1.4 (2) | 1.3 (0.4) | 15/15 |
| Cauchy-EDA posik noiseless | 15 (12) | 6.1 (2) | 1.9 (0.4) | 1.8 (0.3) | 1.9 (0.4) | 1.9 (0.3) | 2.0 (0.4) | 15/15 |
| DASA korosec noiseless | 88 (120) | 264 (382) | 123 (136) | 1268 (2995) | 1618 (1688) | 1618 (2423) | 1458 (2483) | 13/15 |
| DE-PSO garcia-nieto noiseless | 5.3 (4) | 6.1 (2) | 5.9 (5) | 5.1 (0.3) | 5.1 (6) | 5.1 (3) | 5.3 (0.5) | 12/15 |
| DIRECT posik noiseless | 3.0 (5) | 2.8 (3) | 2.1 (1) | 31 (72) | 34 (70) | 34 (70) | 30 (8) | 5/5 |
| EDA-PSO el-abd noiseless | 3.4 (4) | 3.7 (2) | 8.8 (6) | 17 (8) | 20 (8) | 20 (8) | 22 (3) | 15/15 |
| FULLNEWUOA ros noiseless | 1.1 (0.2) | 1.00 (1) | 1.4 (0.7) | 2.2 (2) | 6.8 (15) | 6.8 (6) | 6.2 (24) | 14/15 |
| G3PCX posik noiseless | 6.4 (6) | 8.2 (19) | 12 (18) | 16 (18) | 54 (125) | 54 (84) | 48 (28) | 13/15 |
| GA nicolau noiseless | 3.5 (6) | 24 (29) | 27 (7) | 134 (341) | 196 (318) | 196 (321) | 252 (429) | 10/15 |
| GLOBAL pal noiseless | 6.4 (6) | 5.4 (0.0) | 4.6 (8) | 8.8 (10) | 51 (82) | 51 (66) | 46 (42) | 1/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.8 (1) | 2.9 (3) | 1.4 (1) | 1.3 (0.7) | 1.3 (0.6) | 1.3 (1.0) | 1.4 (0.6) | 15/15 |
| LSfminbnd posik noiseless | 48 (87) | 67 (135) | 33 (96) | 101 (77) | 289 (243) | 289 (344) | 263 (232) | 3/15 |
| LSstep posik noiseless | 313 (318) | 323 (422) | 392 (132) | 934 (1180) | ∞ | ∞ | ∞3e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 6.3 (6) | 4.3 (4) | 2.2 (2) | 3.1 (2) | 3.9 (2) | 3.9 (5) | 3.9 (5) | 15/15 |
| MCS huyer noiseless | 1.0 (0.5) | 5.7 (6) | 2.4 (3) | 4.2 (3) | 4.1 (2) | 4.1 (1) | 8.8 (9) | 15/15 |
| NELDERDOERR doerr noiseless | 7.8 (25) | 4.2 (9) | 4.3 (3) | 4.2 (4) | 8.8 (23) | 8.8 (25) | 8.8 (5) | 15/15 |
| NELDER hansen noiseless | 8.3 (0.6) | 28 (76) | 20 (19) | 23 (15) | 30 (28) | 30 (29) | 27 (38) | 15/15 |
| NEWUOA ros noiseless | 12 (39) | 12 (33) | 10 (6) | 14 (9) | 39 (62) | 39 (33) | 35 (28) | 9/15 |
| ONEFIFTH auger noiseless | 2.0 (1) | 3.6 (5) | 3.9 (6) | 7.7 (24) | 9.3 (8) | 9.3 (23) | 8.4 (10) | 15/15 |
| POEMS kubalik noiseless | 84 (26) | 29 (14) | 12 (6) | 18 (6) | 21 (6) | 21 (4) | 20 (2) | 15/15 |
| PSO Bounds el-abd noiseless | 4.3 (3) | 7.3 (7) | 4.8 (2) | 9.3 (4) | 12 (6) | 12 (6) | 13 (4) | 15/15 |
| PSO el-abd noiseless | 3.6 (3) | 5.3 (3) | 3.1 (4) | 4.4 (3) | 5.1 (3) | 5.1 (2) | 5.1 (2) | 15/15 |
| RANDOMSEARCH auger noiseless | 5.2 (10) | 30 (44) | 134 (121) | 3851 (2571) | 1.6e4 (1e4) | 1.6e4 (9050) | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 101 (106) | 153 (163) | 369 (545) | ∞ | ∞ | ∞ | ∞8926 | 0/15 |
| VNS garcia-martinez noiseless | 7.8 (10) | 4.2 (1) | 2.6 (2) | 3.0 (5) | 4.1 (4) | 4.1 (4) | 3.9 (5) | 15/15 |
| iAMALGAM bosman noiseless | 2.7 (1) | 15 (50) | 8.1 (13) | 6.1 (5) | 5.9 (9) | 5.9 (10) | 5.4 (13) | 15/15 |
| Δ fopt f8, 3-D |
1e1 27 |
1e0 45 |
1e-1 152 |
1e-2 179 |
1e-3 188 |
1e-5 198 |
1e-7 208 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 23 (18) | 46 (21) | 33 (23) | 64 (36) | 91 (31) | 148 (46) | 212 (85) | 15/15 |
| AMALGAM bosman noiseless | 3.8 (1) | 10 (7) | 5.8 (6) | 6.2 (2) | 6.9 (3) | 7.8 (2) | 8.3 (1) | 15/15 |
| BAYEDA gallagher noiseless | 11 (5) | 105 (134) | 561 (582) | ∞ | ∞ | ∞ | ∞6000 | 0/15 |
| BFGS ros noiseless | 1.4 (0.9) | 2.7 (2) | 1.1 (0.3) | 1.0 (0.5) | 1.0 (0.2) | 1.0 (0.5) | 1.0 (0.3) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 3.5 (2) | 8.0 (10) | 4.5 (3) | 4.8 (2) | 5.1 (2) | 5.4 (2) | 5.6 (2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 1.9 (1.0) | 6.2 (9) | 2.8 (3) | 2.8 (2) | 3.0 (2) | 3.2 (1) | 3.4 (2) | 15/15 |
| Cauchy-EDA posik noiseless | 21 (11) | 27 (11) | 13 (5) | 14 (6) | 15 (6) | 16 (4) | 17 (6) | 15/15 |
| DASA korosec noiseless | 15 (7) | 470 (458) | 468 (206) | 739 (757) | 1155 (683) | 1980 (663) | 2849 (974) | 15/15 |
| DE-PSO garcia-nieto noiseless | 7.7 (5) | 14 (8) | 11 (3) | 24 (21) | 63 (75) | ∞ | ∞6040 | 0/15 |
| DIRECT posik noiseless | 2.0 (1) | 4.9 (5) | 3.5 (2) | 9.0 (6) | 15 (3) | 29 (11) | 43 (27) | 5/5 |
| EDA-PSO el-abd noiseless | 6.9 (5) | 74 (34) | 70 (22) | 110 (37) | 153 (25) | 263 (63) | 371 (83) | 15/15 |
| FULLNEWUOA ros noiseless | 1.4 (0.8) | 2.8 (1) | 1.0 (0.5) | 1.0 (0.4) | 1.00 (0.4) | 1.00 (0.3) | 1.0 (0.3) | 15/15 |
| G3PCX posik noiseless | 4.3 (0.6) | 16 (18) | 9.0 (10) | 9.2 (5) | 9.1 (3) | 9.1 (3) | 9.0 (4) | 15/15 |
| GA nicolau noiseless | 47 (55) | 164 (64) | 403 (535) | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| GLOBAL pal noiseless | 11 (4) | 8.2 (1) | 2.8 (0.3) | 2.6 (0.1) | 2.5 (0.3) | 2.5 (0.2) | 2.5 (0.3) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 3.0 (1) | 8.2 (3) | 6.2 (2) | 6.6 (1.0) | 6.9 (2) | 7.1 (0.8) | 7.3 (0.8) | 15/15 |
| LSfminbnd posik noiseless | 24 (80) | 808 (1448) | 2763 (2763) | 2347 (2263) | 2234 (4827) | ∞ | ∞3e4 | 0/15 |
| LSstep posik noiseless | 51 (17) | 678 (998) | 2792 (4293) | 2371 (1969) | 2258 (2713) | 2144 (2765) | ∞3e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 6.6 (3) | 13 (9) | 7.7 (4) | 10 (5) | 11 (12) | 12 (5) | 12 (3) | 15/15 |
| MCS huyer noiseless | 1.0 (0.3) | 1.00 (0.7) | 7.1 (17) | 6.2 (14) | 6.1 (0.4) | 5.9 (0.3) | 5.7 (12) | 15/15 |
| NELDERDOERR doerr noiseless | 1.6 (1) | 4.0 (3) | 1.5 (1) | 1.4 (0.7) | 1.4 (0.6) | 1.5 (0.6) | 1.5 (0.7) | 15/15 |
| NELDER hansen noiseless | 1.0 (0.4) | 2.1 (2) | 1.00 (0.5) | 1.00 (0.7) | 1.0 (0.2) | 1.1 (0.1) | 1.2 (0.5) | 15/15 |
| NEWUOA ros noiseless | 1.4 (0.3) | 2.8 (2) | 1.2 (0.9) | 1.1 (0.8) | 1.2 (0.6) | 1.2 (0.5) | 1.2 (0.6) | 15/15 |
| ONEFIFTH auger noiseless | 2.8 (2) | 44 (128) | 20 (4) | 38 (15) | 64 (12) | 119 (7) | 171 (13) | 15/15 |
| POEMS kubalik noiseless | 37 (19) | 94 (11) | 48 (19) | 68 (35) | 168 (104) | 325 (274) | 409 (507) | 15/15 |
| PSO Bounds el-abd noiseless | 18 (11) | 60 (22) | 156 (358) | 581 (1372) | 730 (536) | 916 (1226) | 998 (783) | 13/15 |
| PSO el-abd noiseless | 10 (6) | 46 (12) | 51 (34) | 91 (29) | 147 (44) | 263 (38) | 382 (103) | 15/15 |
| RANDOMSEARCH auger noiseless | 43 (72) | 1033 (1133) | 1.0e4 (8190) | 1.2e5 (2e5) | ∞ | ∞ | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 1.7 (2) | 6.8 (3) | 3.0 (2) | 3.0 (1) | 3.0 (1) | 3.1 (1) | 3.1 (1) | 15/15 |
| VNS garcia-martinez noiseless | 7.8 (2) | 9.4 (6) | 5.1 (2) | 5.3 (2) | 5.6 (2) | 5.9 (2) | 6.1 (1.0) | 15/15 |
| iAMALGAM bosman noiseless | 2.2 (2) | 8.1 (9) | 4.5 (2) | 4.9 (2) | 5.0 (2) | 5.6 (2) | 5.9 (2) | 15/15 |
| Δ fopt f9, 3-D |
1e1 21 |
1e0 65 |
1e-1 127 |
1e-2 149 |
1e-3 159 |
1e-5 169 |
1e-7 178 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 29 (15) | 31 (16) | 48 (28) | 83 (37) | 105 (40) | 166 (59) | 222 (113) | 15/15 |
| AMALGAM bosman noiseless | 5.3 (1) | 6.2 (5) | 6.0 (3) | 6.5 (3) | 7.1 (3) | 8.1 (4) | 8.6 (2) | 15/15 |
| BAYEDA gallagher noiseless | 12 (9) | 114 (142) | ∞ | ∞ | ∞ | ∞ | ∞6000 | 0/15 |
| BFGS ros noiseless | 1.5 (0.9) | 1.5 (0.5) | 1.1 (0.3) | 1.1 (0.4) | 1.1 (0.3) | 1.1 (0.4) | 1.0 (0.2) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 3.9 (2) | 4.6 (1) | 4.4 (3) | 4.7 (2) | 4.9 (3) | 5.3 (1) | 5.6 (2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 2.7 (0.7) | 4.5 (5) | 3.6 (3) | 3.6 (3) | 3.7 (2) | 3.9 (1) | 4.1 (1) | 15/15 |
| Cauchy-EDA posik noiseless | 24 (26) | 17 (7) | 16 (6) | 17 (5) | 17 (3) | 19 (3) | 20 (5) | 15/15 |
| DASA korosec noiseless | 23 (16) | 795 (2669) | 716 (137) | 982 (239) | 1442 (497) | 2495 (943) | 3611 (3369) | 15/15 |
| DE-PSO garcia-nieto noiseless | 15 (4) | 19 (14) | 27 (25) | 55 (77) | 567 (978) | ∞ | ∞6040 | 0/15 |
| DIRECT posik noiseless | 1.5 (0.2) | 1.7 (1) | 6.3 (4) | 9.1 (5) | 18 (11) | 29 (13) | 38 (17) | 5/5 |
| EDA-PSO el-abd noiseless | 7.4 (4) | 49 (43) | 69 (35) | 119 (48) | 186 (101) | 345 (177) | 495 (327) | 15/15 |
| FULLNEWUOA ros noiseless | 1.6 (0.5) | 1.4 (1) | 1.0 (1.0) | 1 (0.8) | 1.0 (0.7) | 1.00 (0.6) | 1.0 (0.4) | 15/15 |
| G3PCX posik noiseless | 5.3 (1) | 15 (11) | 12 (10) | 12 (9) | 12 (6) | 12 (8) | 12 (9) | 15/15 |
| GA nicolau noiseless | 49 (60) | 104 (42) | 3768 (1e4) | 2.8e4 (5e4) | ∞ | ∞ | ∞3e5 | 0/15 |
| GLOBAL pal noiseless | 13 (3) | 6.2 (2) | 3.6 (1) | 3.2 (0.8) | 3.1 (0.8) | 3.1 (0.8) | 3.1 (0.8) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 3.6 (1) | 5.6 (2) | 7.4 (5) | 8.2 (2) | 8.2 (2) | 8.3 (2) | 8.4 (1) | 15/15 |
| LSfminbnd posik noiseless | 4.7 (6) | 186 (544) | 306 (497) | 875 (551) | 1294 (2500) | 2631 (3550) | ∞3e4 | 0/15 |
| LSstep posik noiseless | 173 (43) | 404 (349) | 3320 (2598) | 2843 (4128) | ∞ | ∞ | ∞3e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 11 (7) | 10 (5) | 8.7 (4) | 10 (5) | 11 (2) | 12 (4) | 13 (3) | 15/15 |
| MCS huyer noiseless | 0.99 (0.3) | 1.0 (0.8) | 1.0 (0.7) | 1.1 (0.6) | 1.1 (0.5) | 1.2 (0.6) | 1.2 (0.5) | 15/15 |
| NELDERDOERR doerr noiseless | 1.5 (1.0) | 1.4 (1) | 1.1 (0.5) | 1.1 (0.5) | 1.1 (0.5) | 1.2 (0.4) | 1.3 (0.6) | 15/15 |
| NELDER hansen noiseless | 1.2 (0.3) | 1.2 (1) | 1.0 (0.4) | 1.0 (0.3) | 1.1 (0.3) | 1.2 (0.4) | 1.3 (0.4) | 15/15 |
| NEWUOA ros noiseless | 1.7 (1) | 1.7 (1) | 1.2 (0.5) | 1.2 (0.5) | 1.2 (0.4) | 1.3 (0.6) | 1.3 (0.7) | 15/15 |
| ONEFIFTH auger noiseless | 2.6 (0.7) | 80 (88) | 71 (270) | 88 (155) | 116 (138) | 179 (24) | 237 (143) | 15/15 |
| POEMS kubalik noiseless | 65 (32) | 69 (21) | 68 (42) | 147 (152) | 248 (364) | 499 (333) | 911 (732) | 9/15 |
| PSO Bounds el-abd noiseless | 13 (17) | 78 (68) | 375 (734) | 527 (1169) | 672 (330) | 882 (699) | 1031 (860) | 12/15 |
| PSO el-abd noiseless | 11 (9) | 17 (6) | 34 (39) | 66 (57) | 126 (93) | 274 (221) | 443 (261) | 15/15 |
| RANDOMSEARCH auger noiseless | 43 (92) | 679 (1147) | 1.0e4 (2e4) | 2.9e5 (3e5) | ∞ | ∞ | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 1.6 (0.9) | 2.6 (3) | 2.7 (3) | 2.6 (1.0) | 2.7 (1) | 2.9 (2) | 2.9 (1) | 15/15 |
| VNS garcia-martinez noiseless | 11 (2) | 6.8 (3) | 6.0 (2) | 6.2 (2) | 6.3 (2) | 6.7 (1) | 7.0 (2) | 15/15 |
| iAMALGAM bosman noiseless | 3.2 (0.8) | 5.0 (4) | 4.9 (2) | 5.0 (2) | 5.5 (2) | 6.0 (2) | 6.4 (1) | 15/15 |
| Δ fopt f10, 3-D |
1e1 114 |
1e0 152 |
1e-1 168 |
1e-2 180 |
1e-3 194 |
1e-5 218 |
1e-7 242 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 50 (25) | 120 (67) | 363 (341) | 706 (462) | 1281 (938) | 2629 (2707) | 7051 (5009) | 9/15 |
| AMALGAM bosman noiseless | 2.0 (1) | 2.3 (0.8) | 2.7 (0.4) | 2.9 (1) | 3.2 (1) | 3.6 (1) | 3.8 (0.7) | 15/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6000 | 0/15 |
| BFGS ros noiseless | 1.0 (0.6) | 1.2 (0.5) | 1.2 (0.3) | 1.2 (0.2) | 1.4 (0.5) | 5.9 (6) | 76 (99) | 3/15 |
| BIPOP-CMA-ES hansen noiseless | 4.1 (2) | 4.1 (2) | 4.6 (0.7) | 4.9 (0.6) | 4.9 (0.4) | 4.9 (0.4) | 4.8 (0.5) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 2.7 (2) | 2.7 (1) | 2.7 (1) | 3.0 (0.3) | 3.1 (0.4) | 3.0 (0.5) | 3.0 (0.4) | 15/15 |
| Cauchy-EDA posik noiseless | 6.3 (3) | 6.2 (2) | 6.7 (1) | 7.3 (2) | 7.8 (2) | 8.7 (2) | 10 (2) | 15/15 |
| DASA korosec noiseless | 1.1e4 (1e4) | 4.4e4 (5e4) | 2.5e5 (3e5) | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| DE-PSO garcia-nieto noiseless | 67 (59) | 112 (169) | ∞ | ∞ | ∞ | ∞ | ∞6040 | 0/15 |
| DIRECT posik noiseless | 7.6 (5) | 49 (27) | 118 (142) | 162 (174) | 494 (404) | 1000 (1147) | 1968 (2067) | 0/5 |
| EDA-PSO el-abd noiseless | 213 (137) | 2446 (2144) | 4214 (1e4) | 7050 (1e4) | 1.1e4 (1e4) | ∞ | ∞3e5 | 0/15 |
| FULLNEWUOA ros noiseless | 1.6 (1) | 2.6 (2) | 3.8 (2) | 4.4 (3) | 4.9 (1) | 6.0 (3) | 7.1 (3) | 15/15 |
| G3PCX posik noiseless | 14 (12) | 21 (16) | 28 (21) | 30 (16) | 36 (19) | 41 (15) | 42 (14) | 15/15 |
| GA nicolau noiseless | 202 (124) | 2001 (2011) | 1.2e4 (9396) | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| GLOBAL pal noiseless | 3.3 (0.2) | 2.8 (0.3) | 2.7 (0.5) | 2.6 (0.3) | 2.5 (0.2) | 2.3 (0.3) | 2.2 (0.3) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 11 (5) | 10 (2) | 10 (1) | 9.3 (0.4) | 8.8 (0.8) | 8.3 (0.9) | 7.8 (1) | 15/15 |
| LSfminbnd posik noiseless | 1746 (2180) | 2784 (2911) | 2530 (3080) | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| LSstep posik noiseless | 1711 (2566) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 10 (9) | 11 (7) | 12 (6) | 12 (4) | 13 (3) | 12 (3) | 12 (2) | 15/15 |
| MCS huyer noiseless | 67 (77) | 168 (84) | 824 (1069) | 4119 (5702) | 3822 (4193) | ∞ | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 1.1 (0.9) | 1.1 (0.3) | 1.1 (0.5) | 1.1 (0.2) | 1.1 (0.4) | 1.0 (0.1) | 1.0 (0.3) | 15/15 |
| NELDER hansen noiseless | 1.00 (0.5) | 1.0 (0.3) | 1.00 (0.3) | 1.0 (0.3) | 1.00 (0.2) | 1.0 (0.2) | 1.00 (0.2) | 15/15 |
| NEWUOA ros noiseless | 2.8 (2) | 5.2 (4) | 8.3 (3) | 10 (5) | 12 (6) | 14 (7) | 16 (8) | 15/15 |
| ONEFIFTH auger noiseless | 2115 (4174) | 6187 (4529) | 1.2e4 (1e4) | 2.3e4 (8730) | 7.6e4 (8e4) | ∞ | ∞3e6 | 0/15 |
| POEMS kubalik noiseless | 412 (317) | 1628 (2568) | 5312 (5544) | 1.2e4 (1e4) | ∞ | ∞ | ∞3e5 | 0/15 |
| PSO Bounds el-abd noiseless | 2083 (3341) | 8028 (7423) | 1.2e4 (2e4) | 1.1e4 (2e4) | 2.2e4 (2e4) | 2.0e4 (1e4) | 1.8e4 (3e4) | 1/15 |
| PSO el-abd noiseless | 59 (34) | 1053 (1061) | 2446 (1693) | 3650 (7526) | 4760 (7047) | 6498 (6504) | 1.8e4 (2e4) | 1/15 |
| RANDOMSEARCH auger noiseless | 2052 (3134) | 6.0e4 (6e4) | 2.5e5 (4e5) | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 8.5 (15) | 7.8 (11) | 7.2 (11) | 6.8 (2) | 6.5 (10) | 6.9 (6) | 6.5 (13) | 15/15 |
| VNS garcia-martinez noiseless | 5.9 (2) | 6.0 (0.9) | 5.9 (0.3) | 5.8 (0.3) | 5.7 (0.4) | 5.5 (0.6) | 5.3 (0.4) | 15/15 |
| iAMALGAM bosman noiseless | 1.8 (0.2) | 2.1 (0.8) | 2.6 (1) | 2.9 (0.6) | 3.0 (1) | 3.2 (0.9) | 3.3 (1) | 15/15 |
| Δ fopt f11, 3-D |
1e1 67 |
1e0 105 |
1e-1 227 |
1e-2 263 |
1e-3 277 |
1e-5 302 |
1e-7 327 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 31 (18) | 123 (52) | 248 (214) | 515 (353) | 1089 (375) | 2566 (1040) | 4965 (3397) | 11/15 |
| AMALGAM bosman noiseless | 3.1 (1) | 3.0 (1) | 1.7 (0.8) | 1.9 (0.9) | 2.1 (0.5) | 2.5 (1) | 2.8 (1) | 15/15 |
| BAYEDA gallagher noiseless | 91 (48) | 815 (414) | ∞ | ∞ | ∞ | ∞ | ∞6000 | 0/15 |
| BFGS ros noiseless | 1.0 (0.7) | 1.0 (0.3)★ | 1.0 (0.8) | 1.4 (1) | 3.7 (2) | 41 (105) | ∞2e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 10 (2) | 7.5 (2) | 4.0 (0.7) | 3.6 (0.5) | 3.7 (0.3) | 3.7 (0.4) | 3.6 (0.2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 5.8 (3) | 4.6 (1) | 2.7 (0.2) | 2.5 (0.2) | 2.5 (0.2) | 2.5 (0.2) | 2.5 (0.2) | 15/15 |
| Cauchy-EDA posik noiseless | 7.8 (5) | 6.5 (2) | 4.1 (0.7) | 4.3 (0.9) | 5.0 (1) | 5.6 (1) | 6.4 (1) | 15/15 |
| DASA korosec noiseless | 4636 (4247) | 9363 (2e4) | 1.4e4 (2e4) | 2.2e4 (3e4) | 3.3e4 (6e4) | 4.2e4 (5e4) | 3.9e4 (6e4) | 3/15 |
| DE-PSO garcia-nieto noiseless | 127 (118) | 267 (158) | ∞ | ∞ | ∞ | ∞ | ∞6040 | 0/15 |
| DIRECT posik noiseless | 13 (9) | 28 (19) | 153 (190) | 387 (300) | 772 (903) | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 75 (66) | 293 (146) | 495 (329) | 1139 (1283) | 5115 (8089) | ∞ | ∞3e5 | 0/15 |
| FULLNEWUOA ros noiseless | 3.2 (3) | 3.6 (2) | 2.5 (0.7) | 2.6 (0.5) | 3.1 (2) | 3.9 (1) | 4.7 (1) | 15/15 |
| G3PCX posik noiseless | 30 (24) | 93 (103) | 100 (75) | 140 (94) | 183 (104) | 256 (114) | 316 (246) | 8/15 |
| GA nicolau noiseless | 74 (53) | 2073 (4363) | 5577 (5622) | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| GLOBAL pal noiseless | 5.4 (0.5) | 3.9 (0.6) | 2.0 (0.4) | 1.8 (0.3) | 1.8 (0.3) | 1.7 (0.1) | 1.7 (0.3) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 17 (4) | 15 (3) | 7.4 (0.8) | 6.6 (0.8) | 6.6 (0.5) | 6.4 (0.4) | 6.1 (0.3) | 15/15 |
| LSfminbnd posik noiseless | 1791 (2575) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| LSstep posik noiseless | 2911 (2799) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 21 (9) | 22 (9) | 11 (6) | 10 (5) | 10 (3) | 10 (3) | 10 (2) | 15/15 |
| MCS huyer noiseless | 49 (30) | 83 (115) | 101 (117) | 512 (492) | ∞ | ∞ | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 2.3 (2) | 2.0 (0.7) | 1.1 (0.2) | 1 (0.2) | 1.0 (0.2) | 1 (0.2) | 1.0 (0.2) | 15/15 |
| NELDER hansen noiseless | 2.2 (1) | 2.2 (0.8) | 1.3 (0.5) | 1.2 (0.4) | 1.2 (0.4) | 1.2 (0.2) | 1.1 (0.4) | 15/15 |
| NEWUOA ros noiseless | 3.1 (2) | 3.4 (2) | 2.5 (1.0) | 2.6 (0.7) | 3.2 (1.0) | 4.0 (1) | 5.1 (2) | 15/15 |
| ONEFIFTH auger noiseless | 8373 (6701) | 1.5e4 (6072) | 1.7e4 (2e4) | 1.7e5 (1e5) | ∞ | ∞ | ∞3e6 | 0/15 |
| POEMS kubalik noiseless | 367 (562) | 1010 (358) | 831 (482) | 1486 (1481) | 1741 (2775) | 2078 (664) | 3155 (2350) | 3/15 |
| PSO Bounds el-abd noiseless | 245 (817) | 743 (1509) | 606 (1125) | 1040 (1378) | 1568 (1397) | 1635 (2204) | 1682 (2683) | 4/15 |
| PSO el-abd noiseless | 60 (128) | 154 (171) | 164 (112) | 275 (162) | 360 (201) | 534 (236) | 995 (615) | 7/15 |
| RANDOMSEARCH auger noiseless | 133 (245) | 2176 (2332) | 6.1e4 (5e4) | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 17 (50) | 12 (31) | 5.9 (2) | 5.3 (4) | 5.1 (9) | 4.9 (3) | 4.7 (15) | 14/15 |
| VNS garcia-martinez noiseless | 14 (3) | 10 (1.0) | 4.8 (0.9) | 4.5 (0.7) | 4.4 (0.6) | 4.4 (0.6) | 4.3 (0.6) | 15/15 |
| iAMALGAM bosman noiseless | 3.1 (3) | 3.1 (2) | 1.9 (0.6) | 1.9 (1) | 2.0 (0.7) | 2.2 (0.9) | 2.4 (0.9) | 15/15 |
| Δ fopt f12, 3-D |
1e1 65 |
1e0 168 |
1e-1 338 |
1e-2 401 |
1e-3 445 |
1e-5 696 |
1e-7 790 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 94 (18) | 102 (34) | 169 (165) | 462 (704) | 1577 (2721) | 1.4e4 (9913) | 9.3e4 (9e4) | 0/15 |
| AMALGAM bosman noiseless | 4.7 (1) | 4.2 (4) | 4.8 (4) | 5.2 (4) | 5.6 (4) | 4.9 (2) | 5.2 (4) | 15/15 |
| BAYEDA gallagher noiseless | 66 (47) | 82 (135) | 121 (111) | 216 (232) | ∞ | ∞ | ∞6000 | 0/15 |
| BFGS ros noiseless | 1.7 (2) | 1.4 (1) | 1.00 (0.7) | 1.00 (0.7) | 1.00 (0.6) | 2.3 (2) | 43 (34) | 9/15 |
| BIPOP-CMA-ES hansen noiseless | 7.8 (9) | 5.7 (4) | 4.5 (3) | 4.7 (3) | 4.8 (3) | 4.0 (2) | 4.1 (1) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 8.5 (5) | 6.1 (4) | 4.3 (4) | 4.2 (4) | 4.2 (3) | 3.6 (4) | 3.5 (6) | 15/15 |
| Cauchy-EDA posik noiseless | 34 (9) | 26 (42) | 17 (29) | 16 (28) | 16 (10) | 13 (7) | 13 (13) | 15/15 |
| DASA korosec noiseless | 3.1e4 (1e5) | 3.6e4 (4e4) | 3.6e4 (4e4) | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| DE-PSO garcia-nieto noiseless | 80 (130) | 161 (211) | 263 (402) | ∞ | ∞ | ∞ | ∞6040 | 0/15 |
| DIRECT posik noiseless | 7.0 (7) | 6.5 (7) | 5.7 (5) | 10 (4) | 58 (57) | 49 (6) | 244 (414) | 1/5 |
| EDA-PSO el-abd noiseless | 957 (2312) | 1746 (3599) | 5852 (6657) | 1.1e4 (5424) | 9515 (2e4) | ∞ | ∞3e5 | 0/15 |
| FULLNEWUOA ros noiseless | 2.9 (7) | 2.2 (2) | 1.6 (3) | 1.7 (2) | 1.7 (2) | 1.5 (2) | 1.6 (2) | 15/15 |
| G3PCX posik noiseless | 6.0 (20) | 11 (13) | 8.9 (7) | 9.5 (7) | 10 (6) | 7.9 (4) | 8.1 (4) | 15/15 |
| GA nicolau noiseless | 425 (163) | 2373 (1846) | 1.3e4 (2e4) | 1.1e4 (8262) | ∞ | ∞ | ∞3e5 | 0/15 |
| GLOBAL pal noiseless | 5.9 (1.0) | 3.0 (1) | 2.0 (1) | 2.4 (2) | 2.4 (0.6) | 2.8 (5) | 4.0 (4) | 6/15 |
| IPOP-SEP-CMA-ES ros noiseless | 10 (8) | 10 (8) | 8.4 (4) | 9.1 (9) | 8.7 (8) | 7.0 (7) | 6.8 (5) | 15/15 |
| LSfminbnd posik noiseless | 695 (462) | 1162 (759) | ∞ | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| LSstep posik noiseless | 1372 (2075) | 789 (1035) | 400 (222) | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 25 (79) | 15 (16) | 10 (6) | 11 (10) | 11 (4) | 9.1 (6) | 8.9 (5) | 15/15 |
| MCS huyer noiseless | 1.00 (0.8) | 1.00 (0.9) | 1.2 (1) | 1.2 (1) | 2.7 (3) | 4.5 (7) | 18 (14) | 9/15 |
| NELDERDOERR doerr noiseless | 1.7 (1) | 1.6 (1) | 1.3 (1) | 1.2 (0.9) | 1.3 (0.5) | 1.00 (0.4) | 1.0 (0.4) | 15/15 |
| NELDER hansen noiseless | 2.0 (3) | 1.7 (2) | 1.3 (0.8) | 1.3 (1) | 1.3 (1.0) | 1.0 (0.9) | 1.1 (0.6) | 15/15 |
| NEWUOA ros noiseless | 2.0 (2) | 1.6 (2) | 1.2 (0.7) | 1.2 (1) | 1.3 (1) | 1.1 (1) | 1.2 (1) | 15/15 |
| ONEFIFTH auger noiseless | 2.8e4 (2e4) | 2.7e4 (4e4) | 3.9e4 (4e4) | 1.1e5 (8e4) | ∞ | ∞ | ∞3e6 | 0/15 |
| POEMS kubalik noiseless | 1818 (1189) | 1646 (2019) | 3810 (4946) | 5003 (2477) | ∞ | ∞ | ∞3e5 | 0/15 |
| PSO Bounds el-abd noiseless | 2008 (2503) | 2204 (2733) | 2537 (2219) | 1.1e4 (2e4) | 9531 (2e4) | ∞ | ∞3e5 | 0/15 |
| PSO el-abd noiseless | 2346 (2318) | 2703 (3133) | 5780 (4659) | 1.0e4 (7668) | ∞ | ∞ | ∞3e5 | 0/15 |
| RANDOMSEARCH auger noiseless | 1.6e5 (1e5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 38 (120) | 19 (8) | 10 (25) | 9.4 (2) | 8.9 (4) | 7.4 (2) | 11 (19) | 12/15 |
| VNS garcia-martinez noiseless | 13 (12) | 9.5 (2) | 6.0 (4) | 5.6 (3) | 5.6 (4) | 4.4 (3) | 4.4 (2) | 15/15 |
| iAMALGAM bosman noiseless | 10 (9) | 7.9 (7) | 6.1 (6) | 6.0 (5) | 5.9 (5) | 4.7 (3) | 4.6 (3) | 15/15 |
| Δ fopt f13, 3-D |
1e1 49 |
1e0 85 |
1e-1 108 |
1e-2 136 |
1e-3 215 |
1e-5 281 |
1e-7 365 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 48 (10) | 66 (15) | 100 (45) | 204 (207) | 414 (266) | 5374 (6152) | 2.2e4 (2e4) | 4/15 |
| AMALGAM bosman noiseless | 3.7 (0.6) | 3.9 (2) | 4.2 (0.3) | 4.2 (1) | 3.4 (0.3) | 3.5 (0.9) | 3.4 (0.3) | 15/15 |
| BAYEDA gallagher noiseless | 46 (31) | 124 (73) | ∞ | ∞ | ∞ | ∞ | ∞6000 | 0/15 |
| BFGS ros noiseless | 1.1 (0.2) | 1 (0.1) | 1.0 (0.3) | 1.00 (0.3) | 2.1 (3) | 409 (396) | ∞3e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 3.8 (1) | 3.8 (2) | 5.0 (2) | 6.1 (2) | 4.5 (2) | 4.8 (0.9) | 4.6 (1) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 4.1 (5) | 4.5 (3) | 5.9 (3) | 6.9 (9) | 5.9 (5) | 6.1 (2) | 6.0 (4) | 15/15 |
| Cauchy-EDA posik noiseless | 14 (4) | 12 (3) | 12 (3) | 12 (2) | 9.4 (0.8) | 10 (1) | 9.3 (0.5) | 15/15 |
| DASA korosec noiseless | 317 (462) | 1052 (1719) | 1633 (2045) | 6075 (5284) | 2.0e4 (1e4) | 1.5e5 (1e5) | ∞3e6 | 0/15 |
| DE-PSO garcia-nieto noiseless | 14 (11) | 60 (57) | 100 (155) | 206 (200) | ∞ | ∞ | ∞6040 | 0/15 |
| DIRECT posik noiseless | 2.9 (1) | 6.8 (3) | 6.8 (3) | 16 (8) | 29 (2) | 61 (41) | 155 (189) | 1/5 |
| EDA-PSO el-abd noiseless | 49 (45) | 144 (48) | 398 (746) | 1412 (3309) | 5780 (4581) | ∞ | ∞3e5 | 0/15 |
| FULLNEWUOA ros noiseless | 3.0 (6) | 10 (7) | 39 (47) | 78 (84) | 117 (197) | 677 (862) | ∞3e4 | 0/15 |
| G3PCX posik noiseless | 20 (33) | 73 (44) | 97 (62) | 111 (126) | 159 (120) | 227 (297) | 210 (474) | 13/15 |
| GA nicolau noiseless | 152 (77) | 252 (53) | 3660 (4918) | 1.5e4 (2e4) | 2.0e4 (2e4) | ∞ | ∞3e5 | 0/15 |
| GLOBAL pal noiseless | 6.6 (0.2) | 4.5 (0.6) | 6.3 (7) | 8.4 (4) | 88 (87) | ∞ | ∞1172 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 8.7 (16) | 15 (8) | 16 (3) | 13 (2) | 9.0 (1) | 8.3 (1) | 7.0 (0.9) | 15/15 |
| LSfminbnd posik noiseless | 124 (158) | 225 (168) | 618 (725) | 1472 (1585) | ∞ | ∞ | ∞3e4 | 0/15 |
| LSstep posik noiseless | 518 (427) | 1492 (1098) | ∞ | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 10 (2) | 13 (7) | 17 (11) | 17 (5) | 13 (3) | 12 (3) | 12 (3) | 15/15 |
| MCS huyer noiseless | 14 (23) | 127 (162) | 374 (639) | 367 (358) | 711 (837) | ∞ | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 1.0 (0.5) | 1.1 (0.5) | 1.2 (0.5) | 1.3 (0.7) | 1.2 (0.6) | 1.2 (0.9) | 1.1 (0.6) | 15/15 |
| NELDER hansen noiseless | 1.0 (0.4) | 1.1 (0.9) | 1.3 (0.9) | 1.3 (0.8) | 1.0 (0.5) | 1.0 (0.5) | 1.00 (0.3) | 15/15 |
| NEWUOA ros noiseless | 4.6 (8) | 9.0 (12) | 43 (97) | 62 (86) | 200 (123) | ∞ | ∞2e4 | 0/15 |
| ONEFIFTH auger noiseless | 16 (22) | 65 (38) | 125 (196) | 289 (278) | 1032 (717) | 3311 (3883) | 5.7e4 (9e4) | 1/15 |
| POEMS kubalik noiseless | 74 (28) | 667 (964) | 1728 (2428) | 4885 (2580) | ∞ | ∞ | ∞3e5 | 0/15 |
| PSO Bounds el-abd noiseless | 988 (4585) | 1358 (4412) | 1202 (2802) | 8967 (2e4) | 9206 (1e4) | ∞ | ∞3e5 | 0/15 |
| PSO el-abd noiseless | 19 (9) | 221 (108) | 2249 (3577) | 5000 (1e4) | 2.0e4 (2e4) | 1.5e4 (2e4) | ∞3e5 | 0/15 |
| RANDOMSEARCH auger noiseless | 1331 (1372) | 1.6e5 (2e5) | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 5.0 (3) | 8.6 (7) | 9.2 (7) | 20 (31) | 31 (41) | 127 (77) | 322 (248) | 0/15 |
| VNS garcia-martinez noiseless | 7.2 (1) | 6.0 (3) | 7.8 (2) | 12 (3) | 8.5 (12) | 7.5 (0.6) | 7.2 (0.6) | 15/15 |
| iAMALGAM bosman noiseless | 2.9 (3) | 2.7 (0.1) | 3.1 (1) | 3.0 (0.5) | 2.4 (0.8) | 2.6 (0.4) | 2.5 (0.6) | 15/15 |
| Δ fopt f14, 3-D |
1e1 2.0 |
1e0 17 |
1e-1 28 |
1e-2 43 |
1e-3 71 |
1e-5 110 |
1e-7 194 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 2.5 (2) | 10 (7) | 56 (14) | 72 (19) | 69 (19) | 203 (270) | 2463 (1831) | 15/15 |
| AMALGAM bosman noiseless | 2.3 (3) | 2.8 (2) | 4.6 (1) | 5.0 (2) | 4.5 (0.8) | 4.7 (0.8) | 3.6 (1.0) | 15/15 |
| BAYEDA gallagher noiseless | 1.8 (3) | 59 (6) | 126 (221) | 110 (176) | 249 (276) | 784 (750) | ∞6000 | 0/15 |
| BFGS ros noiseless | 4.1 (3) | 1.5 (1) | 1.5 (1) | 1.3 (0.5) | 1.1 (0.3) | 1.0 (0.3)★ | 29 (9) | 4/15 |
| BIPOP-CMA-ES hansen noiseless | 3.4 (4) | 2.9 (2) | 3.6 (2) | 4.2 (2) | 4.4 (2) | 7.1 (0.8) | 6.0 (0.4) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 2.3 (2) | 1.4 (2) | 2.2 (0.6) | 2.6 (1) | 2.9 (2) | 4.2 (1) | 3.6 (0.6) | 15/15 |
| Cauchy-EDA posik noiseless | 22 (45) | 16 (16) | 17 (8) | 19 (6) | 14 (5) | 14 (3) | 11 (0.8) | 15/15 |
| DASA korosec noiseless | 47 (46) | 24 (16) | 21 (11) | 23 (8) | 51 (41) | 2890 (2839) | 4.9e4 (5e4) | 0/15 |
| DE-PSO garcia-nieto noiseless | 1.7 (0.8) | 4.9 (4) | 12 (2) | 16 (2) | 17 (0.9) | 132 (84) | ∞6040 | 0/15 |
| DIRECT posik noiseless | 2.0 (2) | 1.7 (1) | 2.8 (0.7) | 5.5 (2) | 17 (12) | 107 (50) | 484 (520) | 2/5 |
| EDA-PSO el-abd noiseless | 2.0 (2) | 4.2 (2) | 11 (2) | 21 (16) | 76 (46) | 191 (39) | 6536 (1e4) | 2/15 |
| FULLNEWUOA ros noiseless | 6.8 (5) | 1.5 (0.7) | 1.2 (0.4) | 1.0 (0.2) | 1.0 (0.3) | 2.3 (0.7) | 4.4 (2) | 2/15 |
| G3PCX posik noiseless | 2.2 (2) | 4.1 (3) | 4.7 (0.6) | 4.3 (1) | 4.9 (3) | 45 (43) | 285 (496) | 11/15 |
| GA nicolau noiseless | 2.1 (2) | 11 (15) | 158 (144) | 283 (20) | 320 (64) | 6041 (5406) | ∞3e5 | 0/15 |
| GLOBAL pal noiseless | 2.7 (3) | 8.5 (7) | 11 (0.3) | 7.5 (0.2) | 5.1 (0.1) | 12 (12) | ∞753 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 3.1 (1) | 2.6 (2) | 3.6 (0.8) | 4.2 (0.7) | 4.8 (1) | 11 (3) | 8.3 (0.9) | 15/15 |
| LSfminbnd posik noiseless | 7.9 (6) | 4.4 (4) | 3.6 (3) | 6.1 (2) | 67 (35) | ∞ | ∞3e4 | 0/15 |
| LSstep posik noiseless | 228 (500) | 85 (47) | 71 (39) | 162 (121) | 929 (560) | ∞ | ∞3e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 1.9 (3) | 6.8 (3) | 11 (5) | 12 (2) | 10 (4) | 15 (6) | 13 (2) | 15/15 |
| MCS huyer noiseless | 2.7 (4) | 12 (27) | 11 (11) | 7.9 (8) | 5.7 (4) | 50 (46) | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 2.9 (2) | 1.1 (0.6) | 1.4 (0.5) | 1.8 (0.7) | 1.5 (0.3) | 1.6 (0.3) | 1.2 (0.2) | 15/15 |
| NELDER hansen noiseless | 2.1 (2) | 1.0 (0.5) | 1.2 (0.4) | 1.3 (0.2) | 1.2 (0.2) | 1.3 (0.2) | 1.0 (0.3) | 15/15 |
| NEWUOA ros noiseless | 4.5 (2) | 1.1 (0.8) | 1.0 (0.3) | 1.0 (0.3) | 1.2 (0.1) | 3.1 (0.9) | 17 (13) | 9/15 |
| ONEFIFTH auger noiseless | 2.4 (2) | 1.8 (1.0) | 1.9 (1.0) | 2.5 (0.4) | 5.8 (4) | 2367 (269) | ∞3e6 | 0/15 |
| POEMS kubalik noiseless | 276 (56) | 55 (22) | 92 (46) | 113 (62) | 147 (24) | 224 (43) | 1.0e4 (2e4) | 0/15 |
| PSO Bounds el-abd noiseless | 2.9 (2) | 4.0 (4) | 33 (16) | 62 (25) | 87 (33) | 277 (212) | 1129 (415) | 3/15 |
| PSO el-abd noiseless | 1.1 (1) | 3.2 (1) | 14 (5) | 24 (10) | 30 (13) | 76 (34) | 2010 (1312) | 2/15 |
| RANDOMSEARCH auger noiseless | 2.3 (2) | 18 (14) | 431 (453) | 1.9e4 (1e4) | 6.1e5 (1e6) | ∞ | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 6.1 (5) | 1.4 (0.5) | 1.3 (0.4) | 1.5 (0.2) | 2.0 (1) | 3.1 (2) | 14 (2) | 14/15 |
| VNS garcia-martinez noiseless | 1.1 (0.8) | 7.2 (5) | 8.9 (2) | 8.3 (2) | 7.5 (2) | 8.4 (1) | 7.2 (0.8) | 15/15 |
| iAMALGAM bosman noiseless | 3.0 (3) | 2.4 (0.8) | 3.3 (1) | 3.7 (0.8) | 3.2 (0.5) | 3.7 (0.8) | 3.2 (0.9) | 15/15 |
| Δ fopt f15, 3-D |
1e1 121 |
1e0 1372 |
1e-1 6285 |
1e-2 8282 |
1e-3 8429 |
1e-5 8787 |
1e-7 9041 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 7.7 (4) | 5.3 (2) | 3.9 (3) | 4.2 (4) | 4.4 (7) | 4.8 (7) | 5.1 (4) | 15/15 |
| AMALGAM bosman noiseless | 1.2 (0.4) | 5.0 (8) | 3.7 (6) | 3.1 (2) | 3.0 (1) | 3.0 (8) | 2.9 (6) | 15/15 |
| BAYEDA gallagher noiseless | 3.2 (2) | 11 (8) | 14 (16) | ∞ | ∞ | ∞ | ∞6000 | 0/15 |
| BFGS ros noiseless | 7.3 (6) | 17 (21) | 22 (24) | 17 (24) | 16 (20) | 16 (19) | 15 (12) | 1/15 |
| BIPOP-CMA-ES hansen noiseless | 2.0 (0.6) | 1.3 (1) | 1.7 (1) | 1.3 (1) | 1.3 (1) | 1.3 (0.9) | 1.3 (0.7) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 1.0 (0.2) | 5.8 (5) | 9.5 (11) | 7.2 (3) | 7.1 (4) | 6.8 (13) | 6.6 (4) | 6/15 |
| Cauchy-EDA posik noiseless | 3.9 (2) | 5.4 (4) | 27 (18) | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| DASA korosec noiseless | 57 (95) | 202 (461) | 197 (150) | 149 (151) | 147 (112) | 141 (180) | 137 (111) | 14/15 |
| DE-PSO garcia-nieto noiseless | 3.4 (2) | 6.6 (7) | 3.3 (4) | 2.6 (3) | 2.6 (5) | ∞ | ∞6040 | 0/15 |
| DIRECT posik noiseless | 1.0 (0.3) | 1.5 (0.6) | 1.0 (1.0) | 1.7 (1) | 1.7 (2) | 1.7 (2) | 1.7 (2) | 5/5 |
| EDA-PSO el-abd noiseless | 3.8 (5) | 7.4 (3) | 9.5 (24) | 7.4 (18) | 7.3 (18) | 7.4 (17) | 7.5 (9) | 13/15 |
| FULLNEWUOA ros noiseless | 2.2 (2) | 2.8 (3) | 8.8 (13) | 6.7 (6) | 6.5 (6) | 6.3 (6) | 6.1 (9) | 4/15 |
| G3PCX posik noiseless | 40 (183) | 28 (48) | 39 (43) | 30 (37) | 29 (53) | 28 (27) | 27 (27) | 7/15 |
| GA nicolau noiseless | 14 (10) | 20 (12) | 62 (108) | 62 (74) | 62 (72) | 83 (104) | 150 (124) | 3/15 |
| GLOBAL pal noiseless | 2.7 (0.5) | 3.2 (11) | 3.9 (4) | 3.0 (3) | 2.9 (3) | 2.8 (3) | 2.7 (5) | 1/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.3 (6) | 2.2 (2) | 1.3 (1) | 1.00 (1) | 1.00 (0.8) | 1.00 (1) | 1.0 (1.0) | 15/15 |
| LSfminbnd posik noiseless | 4.8 (4) | 21 (30) | 20 (12) | 15 (15) | 15 (10) | 15 (5) | 14 (22) | 3/15 |
| LSstep posik noiseless | 385 (564) | 144 (316) | 67 (122) | 51 (41) | 50 (68) | 49 (55) | 48 (34) | 1/15 |
| MA-LS-CHAIN molina noiseless | 2.6 (1) | 1.6 (1) | 3.3 (9) | 2.5 (4) | 2.5 (7) | 2.4 (3) | 2.4 (4) | 11/15 |
| MCS huyer noiseless | 1.8 (3) | 1 (0.3) | 1.8 (2) | 1.4 (2) | 1.3 (0.8) | 1.6 (2) | 1.5 (0.9) | 15/15 |
| NELDERDOERR doerr noiseless | 1.4 (0.9) | 1.0 (0.7) | 2.5 (3) | 1.9 (6) | 1.9 (3) | 1.8 (3) | 1.8 (0.8) | 13/15 |
| NELDER hansen noiseless | 2.3 (4) | 4.6 (7) | 9.4 (3) | 7.1 (7) | 7.0 (5) | 6.7 (3) | 6.5 (6) | 14/15 |
| NEWUOA ros noiseless | 3.5 (8) | 3.4 (4) | 4.5 (4) | 3.4 (7) | 3.3 (5) | 3.2 (4) | 3.1 (2) | 6/15 |
| ONEFIFTH auger noiseless | 3.4 (5) | 6.2 (5) | 13 (17) | 10 (8) | 10 (9) | 10 (14) | 9.3 (13) | 15/15 |
| POEMS kubalik noiseless | 14 (5) | 32 (84) | 77 (93) | 59 (81) | 58 (45) | 57 (62) | 56 (135) | 6/15 |
| PSO Bounds el-abd noiseless | 2.8 (2) | 27 (60) | 27 (60) | 21 (19) | 22 (63) | 21 (26) | 22 (26) | 10/15 |
| PSO el-abd noiseless | 2.7 (2) | 4.0 (1) | 58 (74) | 44 (91) | 44 (71) | 42 (61) | 41 (26) | 7/15 |
| RANDOMSEARCH auger noiseless | 29 (22) | 1548 (1182) | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 11 (14) | 11 (5) | 19 (14) | 15 (13) | 14 (28) | 14 (8) | 13 (13) | 3/15 |
| VNS garcia-martinez noiseless | 3.0 (4) | 3.0 (6) | 3.7 (4) | 2.8 (5) | 2.8 (4) | 2.9 (2) | 4.5 (3) | 15/15 |
| iAMALGAM bosman noiseless | 6.2 (20) | 5.6 (10) | 4.6 (7) | 3.6 (5) | 3.6 (4) | 3.5 (2) | 3.4 (3) | 15/15 |
| Δ fopt f16, 3-D |
1e1 41 |
1e0 319 |
1e-1 582 |
1e-2 789 |
1e-3 1864 |
1e-5 3204 |
1e-7 3361 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 1.1 (0.8) | 5.9 (3) | 9.1 (3) | 13 (5) | 9.0 (3) | 10 (10) | 16 (11) | 15/15 |
| AMALGAM bosman noiseless | 1.8 (2) | 5.2 (0.7) | 10 (20) | 11 (23) | 6.0 (9) | 3.9 (5) | 3.7 (4) | 15/15 |
| BAYEDA gallagher noiseless | 1.6 (1) | 25 (36) | ∞ | ∞ | ∞ | ∞ | ∞6000 | 0/15 |
| BFGS ros noiseless | 71 (95) | 154 (152) | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 2.1 (2) | 3.5 (3) | 4.3 (4) | 3.3 (2) | 1.7 (1) | 1.1 (0.8) | 1.1 (0.6) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 4.3 (9) | 4.8 (4) | 7.9 (7) | 10 (11) | 10 (9) | 10 (8) | 18 (20) | 4/15 |
| Cauchy-EDA posik noiseless | 5.2 (10) | 28 (31) | 1111 (1418) | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| DASA korosec noiseless | 37 (18) | 135 (179) | 303 (437) | 507 (480) | 1000 (756) | 2901 (2809) | 2862 (2678) | 2/15 |
| DE-PSO garcia-nieto noiseless | 3.8 (5) | 5.9 (5) | 29 (44) | ∞ | ∞ | ∞ | ∞6040 | 0/15 |
| DIRECT posik noiseless | 1.2 (0.7) | 1.00 (0.6) | 1.00 (0.5) | 1.00 (0.3) | 1.00 (0.7) | 1.2 (1) | 1.9 (1) | 5/5 |
| EDA-PSO el-abd noiseless | 1.4 (1) | 19 (21) | 106 (184) | 163 (275) | 97 (161) | 73 (117) | 72 (112) | 9/15 |
| FULLNEWUOA ros noiseless | 3.3 (0.3) | 4.2 (4) | 9.0 (4) | 17 (25) | 13 (22) | 99 (78) | ∞2e4 | 0/15 |
| G3PCX posik noiseless | 0.99 (2) | 3.2 (5) | 11 (9) | 18 (14) | 13 (12) | 58 (39) | 103 (62) | 5/15 |
| GA nicolau noiseless | 0.99 (0.9) | 6.0 (7) | 61 (23) | 339 (579) | 490 (1052) | 654 (679) | 1288 (986) | 1/15 |
| GLOBAL pal noiseless | 1.6 (3) | 1.1 (0.2) | 1.3 (0.7) | 1.5 (1) | 1.6 (1.0) | 1.3 (2) | 3.4 (3) | 4/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.1 (2) | 3.5 (3) | 4.0 (4) | 3.5 (2) | 1.6 (2) | 1.00 (1.0) | 1.00 (0.1) | 15/15 |
| LSfminbnd posik noiseless | 1.6 (1) | 3.5 (3) | 19 (25) | 50 (73) | 101 (83) | ∞ | ∞3e4 | 0/15 |
| LSstep posik noiseless | 4.0 (8) | 8.7 (12) | 94 (119) | 172 (246) | 239 (294) | 139 (169) | 133 (58) | 1/15 |
| MA-LS-CHAIN molina noiseless | 1.6 (1) | 1.6 (0.3) | 4.8 (3) | 5.6 (4) | 5.7 (15) | 6.0 (7) | 6.2 (7) | 12/15 |
| MCS huyer noiseless | 4.1 (8) | 2.1 (4) | 11 (15) | 33 (16) | 127 (70) | ∞ | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 1.2 (2) | 2.8 (3) | 3.4 (2) | 3.9 (5) | 3.2 (4) | 2.6 (4) | 6.3 (6) | 14/15 |
| NELDER hansen noiseless | 3.6 (16) | 7.0 (9) | 21 (16) | 29 (22) | 13 (8) | 14 (18) | 14 (11) | 15/15 |
| NEWUOA ros noiseless | 4.4 (1) | 6.6 (7) | 12 (7) | 58 (81) | 149 (307) | ∞ | ∞2e4 | 0/15 |
| ONEFIFTH auger noiseless | 8.6 (28) | 18 (6) | 40 (41) | 57 (15) | 120 (209) | 231 (253) | 3980 (7141) | 3/15 |
| POEMS kubalik noiseless | 16 (6) | 24 (61) | 71 (291) | 214 (476) | 95 (131) | 57 (47) | 57 (72) | 10/15 |
| PSO Bounds el-abd noiseless | 1.8 (2) | 6.4 (9) | 58 (137) | 173 (233) | 125 (200) | 95 (191) | 93 (70) | 8/15 |
| PSO el-abd noiseless | 1.5 (3) | 3.0 (4) | 41 (4) | 77 (287) | 72 (121) | 45 (64) | 59 (69) | 10/15 |
| RANDOMSEARCH auger noiseless | 1.8 (0.8) | 7.9 (6) | 181 (231) | 4360 (5011) | 2.3e4 (2e4) | ∞ | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 21 (25) | 31 (27) | 93 (171) | 267 (253) | 230 (280) | ∞ | ∞3e4 | 0/15 |
| VNS garcia-martinez noiseless | 2.3 (3) | 6.7 (6) | 5.9 (8) | 9.5 (8) | 4.4 (4) | 3.0 (2) | 8.4 (9) | 15/15 |
| iAMALGAM bosman noiseless | 1.9 (2) | 1.9 (0.4) | 10 (15) | 9.2 (11) | 6.0 (4) | 3.5 (6) | 3.6 (6) | 15/15 |
| Δ fopt f17, 3-D |
1e1 4.0 |
1e0 78 |
1e-1 282 |
1e-2 491 |
1e-3 1134 |
1e-5 2347 |
1e-7 3469 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 2.2 (1) | 11 (6) | 13 (3) | 15 (2) | 9.2 (1) | 8.5 (1) | 8.8 (3) | 15/15 |
| AMALGAM bosman noiseless | 3.0 (1) | 1.5 (0.3) | 1.00 (0.2) | 1 (0.2) | 2.6 (5) | 3.9 (3) | 3.0 (2) | 15/15 |
| BAYEDA gallagher noiseless | 2.1 (2) | 6.8 (5) | 7.5 (8) | 17 (13) | 10 (12) | ∞ | ∞6000 | 0/15 |
| BFGS ros noiseless | 43 (45) | 45 (44) | ∞ | ∞ | ∞ | ∞ | ∞7336 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 4.8 (9) | 4.0 (10) | 2.4 (4) | 2.3 (3) | 1.5 (1.0) | 1.4 (1) | 1.1 (0.7) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 29 (34) | 7.7 (11) | 7.9 (8) | 32 (34) | 37 (36) | 58 (88) | ∞3e4 | 0/15 |
| Cauchy-EDA posik noiseless | 22 (28) | 7.3 (2) | 4.1 (2) | 3.6 (0.9) | 2.2 (0.5) | 1.8 (0.2) | 1.6 (0.2) | 15/15 |
| DASA korosec noiseless | 59 (58) | 49 (78) | 105 (178) | 484 (675) | 896 (209) | 3936 (6169) | 1.2e4 (2e4) | 1/15 |
| DE-PSO garcia-nieto noiseless | 4.6 (6) | 4.1 (2) | 3.5 (0.8) | 3.5 (0.9) | 2.3 (0.5) | 2.3 (2) | 5.0 (2) | 2/15 |
| DIRECT posik noiseless | 1.1 (2) | 1.1 (0.5) | 1.2 (0.6) | 1.5 (0.7) | 1.00 (0.1) | 1.0 (0.1) | 1.2 (0.4) | 4/5 |
| EDA-PSO el-abd noiseless | 2.0 (2) | 4.0 (5) | 17 (8) | 29 (12) | 20 (4) | 17 (4) | 16 (3) | 15/15 |
| FULLNEWUOA ros noiseless | 3.5 (1) | 5.6 (3) | 7.3 (6) | 31 (29) | 53 (63) | ∞ | ∞2e4 | 0/15 |
| G3PCX posik noiseless | 2.4 (2) | 33 (5) | 39 (36) | 48 (80) | 47 (46) | 291 (240) | 636 (476) | 1/15 |
| GA nicolau noiseless | 1.2 (2) | 30 (22) | 57 (11) | 72 (8) | 72 (72) | 115 (171) | ∞3e5 | 0/15 |
| GLOBAL pal noiseless | 2.7 (2) | 4.3 (1) | 7.3 (11) | 21 (12) | ∞ | ∞ | ∞1294 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.5 (3) | 1.8 (6) | 2.1 (2) | 1.8 (1) | 1.4 (1.0) | 1.1 (0.3) | 1.00 (0.5) | 15/15 |
| LSfminbnd posik noiseless | 12 (5) | 8.2 (8) | 30 (32) | 143 (276) | ∞ | ∞ | ∞3e4 | 0/15 |
| LSstep posik noiseless | 64 (76) | 202 (224) | 104 (104) | 880 (657) | ∞ | ∞ | ∞3e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 1.9 (1) | 3.5 (2) | 4.0 (2) | 4.9 (2) | 3.1 (0.5) | 2.3 (1) | 2.0 (1.0) | 15/15 |
| MCS huyer noiseless | 0.90 (1) | 2.6 (2) | 5.6 (5) | 16 (13) | 181 (298) | ∞ | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 1.7 (0.6) | 3.8 (3) | 8.5 (6) | 36 (82) | 69 (94) | ∞ | ∞5e4 | 0/15 |
| NELDER hansen noiseless | 56 (142) | 22 (31) | 44 (48) | 95 (110) | 95 (138) | 253 (238) | 405 (237) | 3/15 |
| NEWUOA ros noiseless | 2.4 (2) | 9.1 (9) | 19 (26) | 143 (79) | ∞ | ∞ | ∞2e4 | 0/15 |
| ONEFIFTH auger noiseless | 22 (70) | 33 (97) | 865 (2750) | 2294 (3691) | 4122 (6301) | ∞ | ∞3e6 | 0/15 |
| POEMS kubalik noiseless | 130 (91) | 20 (13) | 23 (4) | 28 (4) | 17 (3) | 16 (15) | 15 (0.3) | 15/15 |
| PSO Bounds el-abd noiseless | 2.2 (2) | 4.7 (3) | 14 (6) | 21 (7) | 14 (5) | 25 (7) | 28 (6) | 15/15 |
| PSO el-abd noiseless | 2.5 (2) | 4.4 (4) | 80 (267) | 55 (154) | 26 (132) | 15 (69) | 14 (26) | 14/15 |
| RANDOMSEARCH auger noiseless | 2.1 (2) | 30 (17) | 7195 (1e4) | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 73 (75) | 2236 (2964) | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| VNS garcia-martinez noiseless | 2.6 (2) | 2.9 (0.6) | 1.2 (0.3) | 1.7 (3) | 1.3 (0.1) | 4.8 (10) | 18 (26) | 15/15 |
| iAMALGAM bosman noiseless | 2.2 (3) | 1.0 (0.6) | 3.1 (9) | 2.7 (5) | 3.1 (2) | 3.6 (2) | 3.0 (3) | 15/15 |
| Δ fopt f18, 3-D |
1e1 40 |
1e0 145 |
1e-1 1289 |
1e-2 3084 |
1e-3 3523 |
1e-5 4738 |
1e-7 5527 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 5.0 (2) | 17 (3) | 5.5 (2) | 5.2 (2) | 7.2 (4) | 18 (6) | 136 (93) | 13/15 |
| AMALGAM bosman noiseless | 1.6 (0.8) | 6.1 (17) | 3.5 (6) | 3.2 (3) | 3.1 (2) | 2.5 (2) | 2.5 (1) | 15/15 |
| BAYEDA gallagher noiseless | 4.5 (8) | 10 (4) | 67 (59) | ∞ | ∞ | ∞ | ∞6000 | 0/15 |
| BFGS ros noiseless | 33 (21) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8488 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.4 (1.0) | 3.4 (0.5) | 1.8 (2) | 1.1 (0.9) | 1.00 (0.8) | 1.1 (0.6) | 1.3 (0.8) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 2.8 (0.3) | 5.0 (5) | 8.3 (20) | 22 (17) | 40 (35) | ∞ | ∞3e4 | 0/15 |
| Cauchy-EDA posik noiseless | 277 (1877) | 80 (778) | 9.4 (0.6) | 4.3 (12) | 4.0 (0.2) | 7.3 (25) | 6.6 (31) | 12/15 |
| DASA korosec noiseless | 92 (216) | 975 (468) | 458 (577) | 1553 (1705) | ∞ | ∞ | ∞3e6 | 0/15 |
| DE-PSO garcia-nieto noiseless | 3.8 (2) | 12 (33) | 3.4 (0.3) | 5.1 (4) | 12 (3) | ∞ | ∞6040 | 0/15 |
| DIRECT posik noiseless | 1.1 (0.8) | 2.7 (2) | 1.00 (0.5) | 1.0 (0.6) | 2.0 (0.6) | 5.0 (2) | 8.3 (4) | 5/5 |
| EDA-PSO el-abd noiseless | 2.4 (2) | 28 (21) | 13 (3) | 9.3 (2) | 12 (1) | 14 (1) | 16 (2) | 15/15 |
| FULLNEWUOA ros noiseless | 4.2 (9) | 16 (27) | 13 (25) | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| G3PCX posik noiseless | 2.5 (1) | 11 (21) | 18 (20) | 63 (137) | ∞ | ∞ | ∞2e5 | 0/15 |
| GA nicolau noiseless | 6.3 (7) | 63 (18) | 42 (3) | 423 (609) | 1228 (1197) | ∞ | ∞3e5 | 0/15 |
| GLOBAL pal noiseless | 3.9 (3) | 5.7 (13) | 4.6 (2) | ∞ | ∞ | ∞ | ∞1640 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.3 (1) | 1.8 (2) | 2.1 (2) | 1.0 (0.5) | 1.1 (0.8) | 1.00 (0.6) | 1.0 (0.3) | 15/15 |
| LSfminbnd posik noiseless | 8.8 (12) | 35 (21) | 33 (36) | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| LSstep posik noiseless | 42 (88) | 362 (436) | 328 (297) | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 3.1 (3) | 4.8 (4) | 5.3 (18) | 12 (8) | 11 (20) | 12 (22) | 11 (22) | 8/15 |
| MCS huyer noiseless | 4.0 (4) | 2.9 (0.4) | 20 (13) | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 1.9 (2) | 5.4 (5) | 7.0 (14) | 16 (18) | 72 (94) | 169 (145) | ∞6e4 | 0/15 |
| NELDER hansen noiseless | 25 (25) | 27 (31) | 30 (49) | 45 (118) | 120 (140) | ∞ | ∞3e5 | 0/15 |
| NEWUOA ros noiseless | 7.3 (7) | 17 (17) | 34 (38) | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| ONEFIFTH auger noiseless | 340 (1188) | 296 (367) | 2752 (1860) | 1.4e4 (1e4) | 1.2e4 (3e4) | ∞ | ∞3e6 | 0/15 |
| POEMS kubalik noiseless | 25 (6) | 175 (6) | 25 (59) | 24 (12) | 50 (86) | 103 (159) | 171 (413) | 4/15 |
| PSO Bounds el-abd noiseless | 2.0 (2) | 169 (1042) | 65 (60) | 57 (74) | 67 (44) | 69 (170) | 780 (706) | 1/15 |
| PSO el-abd noiseless | 2.0 (0.9) | 15 (59) | 57 (137) | 77 (171) | 99 (251) | 113 (119) | 180 (168) | 3/15 |
| RANDOMSEARCH auger noiseless | 4.7 (8) | 445 (387) | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 219 (291) | 2317 (2545) | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| VNS garcia-martinez noiseless | 3.2 (2) | 2.3 (0.9) | 4.3 (4) | 5.3 (4) | 6.6 (6) | 45 (22) | 128 (98) | 15/15 |
| iAMALGAM bosman noiseless | 1.0 (0.5) | 1.00 (0.3) | 1.6 (3) | 3.3 (2) | 3.7 (7) | 3.4 (5) | 3.8 (4) | 15/15 |
| Δ fopt f19, 3-D |
1e1 1 |
1e0 1 |
1e-1 109 |
1e-2 6764 |
1e-3 7367 |
1e-5 7399 |
1e-7 7441 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 11 (10) | 469 (352) | 46 (40) | 3.0 (2) | 4.6 (5) | 5.5 (6) | 7.1 (2) | 15/15 |
| AMALGAM bosman noiseless | 13 (9) | 120 (120) | 37 (7) | 3.8 (7) | 5.9 (6) | 6.0 (6) | 6.0 (7) | 15/15 |
| BAYEDA gallagher noiseless | 10 (8) | 132 (148) | 43 (36) | ∞ | ∞ | ∞ | ∞6000 | 0/15 |
| BFGS ros noiseless | 113 (169) | 872 (1304) | 162 (168) | 33 (32) | ∞ | ∞ | ∞1e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 13 (8) | 101 (53) | 49 (41) | 2.9 (2) | 3.2 (2) | 3.2 (2) | 3.3 (0.9) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 6.1 (5) | 970 (5584) | 157 (302) | 8.8 (9) | 17 (11) | 17 (16) | 17 (12) | 3/15 |
| Cauchy-EDA posik noiseless | 57 (54) | 544 (207) | 314 (316) | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| DASA korosec noiseless | 60 (68) | 5067 (7286) | 520 (461) | 233 (138) | 460 (235) | 461 (215) | 476 (504) | 8/15 |
| DE-PSO garcia-nieto noiseless | 5.4 (2) | 238 (162) | 41 (28) | ∞ | ∞ | ∞ | ∞6040 | 0/15 |
| DIRECT posik noiseless | 1 (0) | 1 (0) | 1.0 (0.3) | 29 (34) | 60 (85) | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 9.1 (10) | 373 (418) | 83 (29) | 5.8 (3) | 11 (13) | 13 (2) | 16 (3) | 13/15 |
| FULLNEWUOA ros noiseless | 25 (3) | 374 (722) | 56 (140) | 11 (12) | 17 (23) | 17 (24) | 17 (16) | 3/15 |
| G3PCX posik noiseless | 7.6 (4) | 925 (865) | 639 (1103) | 103 (100) | 95 (117) | 95 (213) | 94 (76) | 3/15 |
| GA nicolau noiseless | 7.1 (4) | 928 (962) | 101 (43) | 19 (25) | 39 (37) | 81 (94) | ∞3e5 | 0/15 |
| GLOBAL pal noiseless | 14 (20) | 290 (411) | 47 (33) | 3.9 (2) | ∞ | ∞ | ∞4040 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 9.1 (9) | 186 (169) | 54 (64) | 2.6 (2) | 2.4 (2) | 2.5 (1) | 2.5 (3) | 13/15 |
| LSfminbnd posik noiseless | 26 (26) | 274 (261) | 54 (56) | 46 (43) | ∞ | ∞ | ∞2e4 | 0/15 |
| LSstep posik noiseless | 8.9 (9) | 647 (803) | 26 (28) | 63 (70) | ∞ | ∞ | ∞3e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 7.6 (10) | 193 (175) | 20 (20) | 1.6 (2) | 2.2 (1) | 2.2 (3) | 2.3 (3) | 15/15 |
| MCS huyer noiseless | 1 (0) | 1 (0) | 11 (0.4) | 1.0 (0.3) | 1.0 (0.5) | 1 (0.2) | 1.00 (0.3) | 15/15 |
| NELDERDOERR doerr noiseless | 7.6 (8) | 146 (165) | 20 (13) | 5.4 (8) | 11 (7) | 11 (39) | 11 (10) | 7/15 |
| NELDER hansen noiseless | 4.1 (4) | 1453 (1917) | 119 (118) | 17 (19) | 40 (30) | 40 (64) | 40 (27) | 10/15 |
| NEWUOA ros noiseless | 20 (88) | 1275 (282) | 280 (329) | 25 (24) | 54 (49) | 54 (107) | 53 (79) | 4/15 |
| ONEFIFTH auger noiseless | 10 (10) | 2.1e5 (2e6) | 3.2e4 (3e4) | 1776 (4546) | 2649 (2137) | 2638 (1723) | 2624 (5040) | 2/15 |
| POEMS kubalik noiseless | 628 (372) | 1366 (386) | 168 (383) | 40 (55) | 57 (73) | 58 (98) | 59 (120) | 7/15 |
| PSO Bounds el-abd noiseless | 6.7 (5) | 245 (140) | 92 (56) | 13 (13) | 26 (53) | 30 (2) | 35 (20) | 10/15 |
| PSO el-abd noiseless | 10 (7) | 242 (182) | 24 (19) | 14 (4) | 24 (26) | 25 (27) | 28 (50) | 10/15 |
| RANDOMSEARCH auger noiseless | 11 (8) | 1030 (674) | 817 (1147) | 488 (493) | 2939 (1624) | 6073 (8008) | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 253 (395) | 3056 (1140) | 851 (481) | 32 (25) | ∞ | ∞ | ∞3e4 | 0/15 |
| VNS garcia-martinez noiseless | 23 (17) | 216 (118) | 36 (34) | 4.8 (6) | 6.0 (5) | 6.3 (4) | 10 (8) | 15/15 |
| iAMALGAM bosman noiseless | 10 (14) | 156 (138) | 73 (178) | 7.6 (4) | 7.7 (6) | 7.7 (8) | 7.7 (4) | 15/15 |
| Δ fopt f20, 3-D |
1e1 8.0 |
1e0 385 |
1e-1 2291 |
1e-2 2398 |
1e-3 2481 |
1e-5 2573 |
1e-7 2776 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 5.3 (4) | 5.0 (0.8) | 3.9 (3) | 4.6 (4) | 5.3 (2) | 7.2 (4) | 8.2 (3) | 15/15 |
| AMALGAM bosman noiseless | 2.8 (2) | 20 (26) | 26 (17) | 25 (31) | 25 (20) | 24 (16) | 23 (37) | 15/15 |
| BAYEDA gallagher noiseless | 3.3 (3) | 71 (110) | ∞ | ∞ | ∞ | ∞ | ∞6000 | 0/15 |
| BFGS ros noiseless | 1.9 (1) | 1.7 (0.8) | 5.5 (4) | 5.3 (8) | 5.1 (8) | 4.9 (5) | 4.6 (5) | 8/15 |
| BIPOP-CMA-ES hansen noiseless | 2.4 (3) | 8.2 (9) | 10 (6) | 10 (4) | 10 (6) | 10 (6) | 9.5 (6) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 2.8 (2) | 5.6 (7) | 9.5 (17) | 9.1 (7) | 8.8 (7) | 8.5 (13) | 7.9 (7) | 11/15 |
| Cauchy-EDA posik noiseless | 21 (18) | 10 (9) | 458 (715) | 934 (782) | ∞ | ∞ | ∞2e5 | 0/15 |
| DASA korosec noiseless | 38 (32) | 21 (49) | 43 (59) | 41 (34) | 40 (26) | 38 (42) | 36 (20) | 15/15 |
| DE-PSO garcia-nieto noiseless | 6.1 (5) | 2.4 (1) | 4.9 (9) | 4.8 (8) | 4.8 (5) | 4.8 (7) | 4.7 (5) | 6/15 |
| DIRECT posik noiseless | 6.0 (0.1) | 1.00 (1e-3) | 9.0 (0.8) | 8.7 (0.5) | 8.6 (0.7) | 8.5 (0.7) | 8.1 (0.6) | 5/5 |
| EDA-PSO el-abd noiseless | 3.7 (2) | 6.7 (6) | 4.5 (1) | 4.9 (0.6) | 5.1 (0.9) | 5.6 (1) | 6.1 (0.8) | 15/15 |
| FULLNEWUOA ros noiseless | 1.3 (0.3) | 5.2 (3) | 9.1 (8) | 8.7 (8) | 8.4 (8) | 8.1 (8) | 7.5 (18) | 8/15 |
| G3PCX posik noiseless | 3.6 (3) | 17 (18) | 22 (39) | 21 (25) | 21 (26) | 20 (32) | 19 (36) | 13/15 |
| GA nicolau noiseless | 5.2 (5) | 14 (10) | 7.1 (2) | 10 (2) | 14 (2) | 21 (3) | 29 (6) | 15/15 |
| GLOBAL pal noiseless | 3.5 (3) | 6.0 (6) | 18 (18) | 17 (22) | 17 (16) | 16 (13) | 15 (7) | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.9 (4) | 7.9 (8) | 5.5 (3) | 5.5 (2) | 5.4 (3) | 5.4 (3) | 5.2 (1) | 15/15 |
| LSfminbnd posik noiseless | 7.1 (6) | 10 (9) | ∞ | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| LSstep posik noiseless | 224 (289) | 28 (42) | 184 (79) | 177 (185) | 171 (57) | 166 (157) | 155 (208) | 1/15 |
| MA-LS-CHAIN molina noiseless | 2.9 (4) | 2.5 (2) | 1.00 (0.3) | 1.00 (1.0) | 1.00 (0.9) | 1.00 (0.9) | 1 (0.8) | 15/15 |
| MCS huyer noiseless | 2.4 (2) | 3.2 (0.9) | 3.5 (2) | 3.4 (2) | 3.2 (1) | 3.1 (2) | 2.9 (2) | 15/15 |
| NELDERDOERR doerr noiseless | 1.8 (1) | 3.6 (4) | 10 (8) | 10 (20) | 10 (10) | 9.4 (7) | 8.7 (12) | 13/15 |
| NELDER hansen noiseless | 1.0 (0.7) | 19 (21) | 25 (22) | 24 (21) | 23 (25) | 23 (17) | 21 (21) | 15/15 |
| NEWUOA ros noiseless | 1.4 (0.2) | 1.1 (0.9) | 3.9 (4) | 3.7 (6) | 3.6 (4) | 3.4 (3) | 3.2 (4) | 12/15 |
| ONEFIFTH auger noiseless | 3.2 (2) | 4.7 (4) | 10 (7) | 9.1 (9) | 8.8 (7) | 8.5 (10) | 7.9 (7) | 15/15 |
| POEMS kubalik noiseless | 86 (11) | 7.4 (3) | 65 (106) | 63 (94) | 63 (90) | 69 (117) | 66 (108) | 10/15 |
| PSO Bounds el-abd noiseless | 3.3 (3) | 5.2 (5) | 52 (67) | 78 (248) | 76 (90) | 84 (31) | 80 (57) | 9/15 |
| PSO el-abd noiseless | 3.8 (2) | 2.6 (2) | 22 (33) | 22 (35) | 21 (61) | 21 (62) | 20 (3) | 13/15 |
| RANDOMSEARCH auger noiseless | 3.2 (4) | 56 (53) | 1553 (915) | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 2.6 (1) | 1.5 (1) | 10 (15) | 10 (6) | 9.2 (26) | 8.9 (15) | 8.3 (9) | 10/15 |
| VNS garcia-martinez noiseless | 3.0 (3) | 4.4 (3) | 5.5 (7) | 5.3 (4) | 5.1 (5) | 5.2 (5) | 5.8 (5) | 15/15 |
| iAMALGAM bosman noiseless | 3.8 (11) | 16 (28) | 19 (29) | 18 (12) | 18 (12) | 17 (21) | 16 (11) | 15/15 |
| Δ fopt f21, 3-D |
1e1 6.0 |
1e0 184 |
1e-1 425 |
1e-2 439 |
1e-3 458 |
1e-5 469 |
1e-7 482 |
#succ 14/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 1.3 (0.7) | 2.3 (1) | 3.7 (4) | 5.8 (2) | 7.4 (2) | 11 (3) | 15 (3) | 15/15 |
| AMALGAM bosman noiseless | 2.2 (3) | 17 (49) | 41 (27) | 41 (115) | 40 (34) | 40 (66) | 39 (33) | 15/15 |
| BAYEDA gallagher noiseless | 2.0 (1) | 7.5 (3) | 94 (67) | ∞ | ∞ | ∞ | ∞6000 | 0/15 |
| BFGS ros noiseless | 2.1 (3) | 3.3 (4) | 3.5 (2) | 3.4 (4) | 3.3 (4) | 3.3 (3) | 3.2 (3) | 14/15 |
| BIPOP-CMA-ES hansen noiseless | 1.7 (2) | 6.8 (5) | 6.0 (8) | 6.0 (12) | 6.0 (14) | 6.1 (8) | 6.1 (14) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 1.9 (3) | 4.5 (5) | 8.1 (20) | 7.9 (17) | 7.7 (16) | 7.6 (19) | 7.4 (16) | 15/15 |
| Cauchy-EDA posik noiseless | 16 (14) | 11 (14) | 244 (358) | 238 (519) | 499 (1317) | 887 (2563) | 864 (701) | 4/15 |
| DASA korosec noiseless | 12 (11) | 93 (116) | 66 (43) | 65 (63) | 62 (33) | 62 (99) | 61 (86) | 15/15 |
| DE-PSO garcia-nieto noiseless | 1.2 (0.3) | 4.1 (5) | 3.5 (3) | 4.6 (8) | 5.3 (3) | 7.1 (4) | 7.5 (5) | 13/15 |
| DIRECT posik noiseless | 1.8 (1) | 1.00 (0.7) | 1.4 (1) | 1.4 (1) | 1.4 (1) | 4.2 (6) | 5.8 (6) | 5/5 |
| EDA-PSO el-abd noiseless | 1.4 (1) | 3.1 (7) | 54 (179) | 55 (6) | 58 (166) | 62 (5) | 65 (158) | 14/15 |
| FULLNEWUOA ros noiseless | 2.3 (2) | 3.3 (3) | 2.8 (4) | 2.7 (1) | 2.6 (2) | 2.6 (2) | 2.5 (5) | 15/15 |
| G3PCX posik noiseless | 1.6 (3) | 8.5 (8) | 5.7 (15) | 5.6 (10) | 5.4 (9) | 5.4 (9) | 5.4 (8) | 15/15 |
| GA nicolau noiseless | 1.5 (3) | 2.5 (3) | 5.3 (3) | 18 (7) | 29 (15) | 99 (185) | 229 (326) | 12/15 |
| GLOBAL pal noiseless | 1.7 (3) | 1.4 (0.5) | 1.0 (0.7) | 1.00 (0.3) | 1.0 (0.6) | 1.0 (0.5) | 1.00 (0.3) | 14/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.0 (1) | 4.6 (7) | 15 (25) | 17 (46) | 17 (18) | 17 (12) | 17 (20) | 14/15 |
| LSfminbnd posik noiseless | 6.0 (32) | 21 (15) | 27 (32) | 26 (35) | 31 (41) | 39 (29) | 46 (56) | 11/15 |
| LSstep posik noiseless | 15 (17) | 210 (114) | 196 (194) | 193 (223) | 191 (121) | 203 (340) | 216 (265) | 2/15 |
| MA-LS-CHAIN molina noiseless | 1.7 (2) | 1.7 (1) | 10 (0.7) | 10 (2) | 10 (2) | 10 (2) | 10 (24) | 14/15 |
| MCS huyer noiseless | 6.2 (10) | 2.1 (2) | 4.4 (4) | 4.3 (7) | 4.1 (7) | 4.1 (7) | 4.2 (7) | 15/15 |
| NELDERDOERR doerr noiseless | 2.0 (3) | 2.8 (3) | 2.9 (3) | 2.8 (2) | 2.7 (3) | 2.7 (3) | 2.6 (3) | 15/15 |
| NELDER hansen noiseless | 1.6 (2) | 16 (20) | 26 (26) | 25 (16) | 24 (48) | 23 (50) | 23 (45) | 15/15 |
| NEWUOA ros noiseless | 1.6 (1) | 2.7 (7) | 3.5 (2) | 3.5 (1) | 3.4 (4) | 3.4 (4) | 3.4 (3) | 15/15 |
| ONEFIFTH auger noiseless | 2.0 (3) | 15 (42) | 17 (39) | 17 (6) | 16 (26) | 16 (23) | 16 (8) | 15/15 |
| POEMS kubalik noiseless | 94 (17) | 675 (1415) | 551 (1279) | 536 (673) | 514 (734) | 511 (1001) | 504 (621) | 9/15 |
| PSO Bounds el-abd noiseless | 0.99 (2) | 120 (413) | 178 (354) | 174 (343) | 169 (167) | 170 (5) | 170 (160) | 12/15 |
| PSO el-abd noiseless | 1.1 (0.6) | 120 (408) | 111 (179) | 108 (0.3) | 104 (4) | 103 (321) | 102 (2) | 13/15 |
| RANDOMSEARCH auger noiseless | 1.5 (1) | 2.9 (2) | 8.3 (8) | 34 (19) | 120 (97) | 4468 (7354) | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 17 (52) | 8.1 (7) | 12 (12) | 11 (14) | 11 (15) | 11 (15) | 11 (15) | 15/15 |
| VNS garcia-martinez noiseless | 2.1 (3) | 9.2 (12) | 11 (18) | 11 (8) | 11 (11) | 11 (6) | 11 (7) | 15/15 |
| iAMALGAM bosman noiseless | 1.6 (0.9) | 28 (77) | 20 (17) | 19 (60) | 19 (37) | 18 (16) | 18 (15) | 15/15 |
| Δ fopt f22, 3-D |
1e1 18 |
1e0 170 |
1e-1 354 |
1e-2 362 |
1e-3 384 |
1e-5 401 |
1e-7 414 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 1.8 (1) | 2.1 (0.7) | 4.0 (2) | 8.5 (3) | 12 (6) | 21 (8) | 28 (15) | 15/15 |
| AMALGAM bosman noiseless | 1.1 (0.8) | 21 (35) | 56 (38) | 61 (36) | 59 (121) | 57 (44) | 57 (92) | 15/15 |
| BAYEDA gallagher noiseless | 2.0 (1) | 11 (28) | 48 (72) | ∞ | ∞ | ∞ | ∞6000 | 0/15 |
| BFGS ros noiseless | 3.3 (5) | 2.6 (3) | 2.1 (2) | 2.1 (3) | 2.0 (2) | 2.0 (2) | 2.0 (2) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 1.1 (1) | 6.4 (7) | 13 (12) | 14 (18) | 13 (12) | 13 (5) | 13 (14) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 3.5 (14) | 6.8 (8) | 11 (14) | 10 (4) | 10 (22) | 10 (21) | 9.4 (6) | 15/15 |
| Cauchy-EDA posik noiseless | 12 (11) | 229 (664) | 645 (640) | 1145 (1657) | 2543 (3516) | 2435 (2337) | 2359 (1905) | 2/15 |
| DASA korosec noiseless | 20 (20) | 100 (114) | 69 (69) | 75 (139) | 79 (114) | 98 (95) | 117 (110) | 15/15 |
| DE-PSO garcia-nieto noiseless | 4.9 (3) | 4.7 (3) | 13 (10) | 14 (22) | 14 (10) | 26 (25) | 34 (40) | 4/15 |
| DIRECT posik noiseless | 1.5 (1) | 1 (0.6) | 6.3 (11) | 6.2 (6) | 7.4 (7) | 15 (16) | 18 (17) | 5/5 |
| EDA-PSO el-abd noiseless | 1.2 (0.8) | 3.9 (4) | 5.4 (4) | 11 (7) | 16 (8) | 29 (8) | 42 (6) | 15/15 |
| FULLNEWUOA ros noiseless | 2.3 (10) | 2.0 (2) | 1.8 (1) | 1.9 (3) | 1.9 (2) | 1.9 (1) | 2.1 (2) | 15/15 |
| G3PCX posik noiseless | 1.4 (1) | 4.1 (20) | 10 (8) | 10 (12) | 10 (15) | 10 (16) | 10 (15) | 15/15 |
| GA nicolau noiseless | 1.0 (2) | 3.5 (4) | 6.5 (6) | 27 (24) | 273 (307) | 1592 (2439) | 3084 (7145) | 3/15 |
| GLOBAL pal noiseless | 1.7 (0.6) | 1.6 (0.3) | 1.0 (0.4) | 1.0 (0.3) | 1 (0.1) | 1.0 (0.7) | 1.0 (0.4) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.7 (1) | 3.9 (20) | 13 (14) | 31 (67) | 30 (41) | 29 (45) | 29 (16) | 12/15 |
| LSfminbnd posik noiseless | 14 (27) | 13 (13) | 19 (38) | 66 (91) | 62 (83) | 77 (88) | 150 (125) | 4/15 |
| LSstep posik noiseless | 64 (116) | 48 (89) | 155 (190) | 240 (297) | 321 (450) | ∞ | ∞3e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 1.4 (1) | 3.7 (1) | 2.7 (0.9) | 3.3 (2) | 3.4 (3) | 3.9 (4) | 4.3 (2) | 15/15 |
| MCS huyer noiseless | 3.3 (7) | 1.6 (2) | 1.2 (2) | 1.2 (2) | 4.6 (9) | 4.5 (5) | 4.6 (8) | 15/15 |
| NELDERDOERR doerr noiseless | 4.1 (10) | 2.0 (5) | 2.2 (1) | 2.2 (1) | 2.1 (3) | 2.0 (3) | 2.0 (3) | 15/15 |
| NELDER hansen noiseless | 5.5 (17) | 10 (9) | 13 (4) | 13 (10) | 12 (11) | 12 (9) | 12 (10) | 15/15 |
| NEWUOA ros noiseless | 2.8 (5) | 2.5 (2) | 5.8 (2) | 5.8 (13) | 5.6 (11) | 5.5 (3) | 5.7 (2) | 14/15 |
| ONEFIFTH auger noiseless | 23 (3) | 17 (17) | 17 (27) | 17 (22) | 17 (17) | 19 (30) | 20 (23) | 15/15 |
| POEMS kubalik noiseless | 42 (18) | 167 (885) | 453 (1062) | 447 (832) | 424 (1368) | 412 (377) | 405 (727) | 10/15 |
| PSO Bounds el-abd noiseless | 1.5 (1) | 2.2 (3) | 64 (213) | 66 (3) | 67 (8) | 76 (15) | 89 (370) | 14/15 |
| PSO el-abd noiseless | 1.1 (1) | 127 (1) | 132 (1) | 130 (416) | 124 (393) | 122 (376) | 123 (544) | 13/15 |
| RANDOMSEARCH auger noiseless | 1.7 (3) | 3.0 (4) | 4.8 (5) | 40 (26) | 202 (207) | 7149 (4241) | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 1.7 (3) | 5.6 (24) | 5.2 (8) | 5.3 (10) | 5.1 (11) | 5.1 (10) | 5.0 (8) | 15/15 |
| VNS garcia-martinez noiseless | 1.4 (2) | 10 (12) | 12 (10) | 13 (11) | 13 (10) | 14 (11) | 15 (9) | 15/15 |
| iAMALGAM bosman noiseless | 1.6 (1) | 21 (33) | 43 (44) | 44 (20) | 43 (27) | 43 (57) | 42 (18) | 15/15 |
| Δ fopt f23, 3-D |
1e1 3.0 |
1e0 407 |
1e-1 906 |
1e-2 1215 |
1e-3 2214 |
1e-5 2293 |
1e-7 2393 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 3.2 (2) | 12 (10) | 54 (51) | 205 (333) | 374 (817) | 6272 (8829) | 3.0e4 (2e4) | 0/15 |
| AMALGAM bosman noiseless | 3.4 (2) | 6.3 (10) | 10 (23) | 8.9 (8) | 5.1 (3) | 5.1 (4) | 5.1 (9) | 15/15 |
| BAYEDA gallagher noiseless | 2.8 (3) | 34 (30) | ∞ | ∞ | ∞ | ∞ | ∞6000 | 0/15 |
| BFGS ros noiseless | 15 (36) | 8.7 (9) | 112 (82) | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 4.2 (2) | 6.4 (7) | 9.3 (7) | 7.1 (9) | 4.2 (6) | 4.2 (4) | 4.2 (4) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 3.2 (2) | 2.0 (2) | 11 (21) | 17 (21) | 12 (12) | 13 (10) | 12 (10) | 10/15 |
| Cauchy-EDA posik noiseless | 3.6 (3) | 52 (53) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| DASA korosec noiseless | 13 (9) | 71 (209) | 885 (2207) | 1735 (2872) | 1852 (4899) | 5269 (4910) | 5052 (5328) | 3/15 |
| DE-PSO garcia-nieto noiseless | 1.6 (2) | 40 (36) | ∞ | ∞ | ∞ | ∞ | ∞6040 | 0/15 |
| DIRECT posik noiseless | 4.1 (6) | 1.5 (1) | 31 (30) | 25 (62) | 15 (34) | 18 (11) | 22 (6) | 4/5 |
| EDA-PSO el-abd noiseless | 2.5 (2) | 23 (35) | 4943 (2980) | 3690 (5185) | 2030 (1626) | ∞ | ∞3e5 | 0/15 |
| FULLNEWUOA ros noiseless | 5.8 (2) | 2.4 (2) | 15 (45) | 40 (38) | 37 (36) | 166 (140) | 159 (251) | 1/15 |
| G3PCX posik noiseless | 4.2 (6) | 2.1 (1) | 14 (14) | 29 (99) | 17 (21) | 43 (38) | 42 (65) | 10/15 |
| GA nicolau noiseless | 3.7 (4) | 16 (9) | 522 (256) | 3702 (7251) | ∞ | ∞ | ∞3e5 | 0/15 |
| GLOBAL pal noiseless | 2.7 (4) | 1.6 (2) | 3.1 (4) | ∞ | ∞ | ∞ | ∞4029 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 4.0 (4) | 7.1 (3) | 13 (10) | 11 (7) | 5.9 (3) | 5.9 (4) | 5.8 (4) | 15/15 |
| LSfminbnd posik noiseless | 2.8 (2) | 7.1 (7) | 419 (811) | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| LSstep posik noiseless | 4.8 (4) | 4.9 (9) | 488 (397) | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 3.6 (3) | 2.1 (0.8) | 6.7 (9) | 5.2 (3) | 2.9 (4) | 3.1 (3) | 3.1 (2) | 15/15 |
| MCS huyer noiseless | 0.87 (0.8) | 2.7 (2) | 12 (19) | 39 (71) | 326 (442) | ∞ | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 5.8 (2) | 1.00 (2) | 1.0 (0.5) | 1.0 (0.9) | 1.1 (2) | 1.4 (2) | 1.4 (0.8) | 15/15 |
| NELDER hansen noiseless | 2.7 (2) | 1.4 (3) | 2.3 (3) | 1.8 (3) | 1.00 (2) | 1.0 (0.6) | 1.0 (0.9) | 15/15 |
| NEWUOA ros noiseless | 10 (4) | 2.7 (4) | 24 (24) | 109 (91) | ∞ | ∞ | ∞2e4 | 0/15 |
| ONEFIFTH auger noiseless | 19 (4) | 2.9 (3) | 13 (1) | 238 (505) | 506 (1075) | 1771 (3658) | 3541 (4039) | 4/15 |
| POEMS kubalik noiseless | 15 (24) | 22 (12) | 126 (116) | 128 (124) | 73 (126) | 76 (0.6) | 79 (125) | 11/15 |
| PSO Bounds el-abd noiseless | 1.7 (2) | 15 (18) | 462 (505) | 570 (487) | 445 (578) | 927 (926) | 890 (846) | 2/15 |
| PSO el-abd noiseless | 2.7 (3) | 11 (7) | 168 (174) | 363 (579) | 201 (177) | 200 (179) | 194 (244) | 7/15 |
| RANDOMSEARCH auger noiseless | 2.3 (2) | 13 (8) | 2.3e4 (3e4) | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 2.1 (2) | 1.9 (2) | 10 (10) | 88 (52) | 48 (29) | ∞ | ∞2e4 | 0/15 |
| VNS garcia-martinez noiseless | 4.0 (3) | 6.7 (5) | 27 (21) | 41 (71) | 23 (34) | 24 (25) | 23 (35) | 15/15 |
| iAMALGAM bosman noiseless | 3.8 (4) | 8.4 (12) | 10 (8) | 7.5 (9) | 4.3 (4) | 4.3 (2) | 4.3 (3) | 15/15 |
| Δ fopt f24, 3-D |
1e1 97 |
1e0 10391 |
1e-1 1.0e5 |
1e-2 3.6e5 |
1e-3 3.6e5 |
1e-5 3.6e5 |
1e-7 3.6e5 |
#succ 2/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 7.9 (7) | 3.5 (2) | 6.2 (4) | 2.9 (2) | 2.9 (2) | 3.0 (2) | 3.1 (2) | 14/15 |
| AMALGAM bosman noiseless | 1.5 (2) | 10 (7) | 10 (7) | 4.5 (3) | 4.6 (3) | 4.7 (4) | 5.1 (5) | 14/15 |
| BAYEDA gallagher noiseless | 4.3 (4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6000 | 0/15 |
| BFGS ros noiseless | 9.3 (8) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8600 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.3 (0.8) | 7.6 (8) | 7.9 (7) | 3.0 (6) | 4.1 (7) | 4.9 (2) | 4.9 (10) | 11/15 |
| CMA-ESPLUSSEL auger noiseless | 9.2 (11) | 3.3 (2) | ∞ | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| Cauchy-EDA posik noiseless | 4.2 (4) | 104 (123) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| DASA korosec noiseless | 69 (33) | 85 (212) | 419 (891) | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| DE-PSO garcia-nieto noiseless | 5.8 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6040 | 0/15 |
| DIRECT posik noiseless | 2.5 (0.7) | 39 (34) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 6.4 (8) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| FULLNEWUOA ros noiseless | 2.8 (4) | 1.2 (1) | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| G3PCX posik noiseless | 19 (101) | 22 (25) | 10 (15) | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| GA nicolau noiseless | 18 (15) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| GLOBAL pal noiseless | 3.4 (0.6) | 1.1 (0.8) | ∞ | ∞ | ∞ | ∞ | ∞5249 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.00 (0.8) | 5.0 (4) | ∞ | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| LSfminbnd posik noiseless | 1.9 (3) | 6.4 (14) | ∞ | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| LSstep posik noiseless | 6.4 (2) | 41 (28) | ∞ | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 3.7 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| MCS huyer noiseless | 17 (19) | 2.0 (0.8) | 1.0 (0.7) | 1 (1) | 1 (2) | 1 (2) | 1 (1) | 2/15 |
| NELDERDOERR doerr noiseless | 2.3 (4) | 1.5 (1) | 3.9 (6) | 2.4 (2) | 2.4 (2) | 2.4 (2) | 2.4 (2) | 1/15 |
| NELDER hansen noiseless | 20 (24) | 5.2 (9) | 10 (10) | 6.3 (7) | 6.3 (11) | 6.3 (7) | 6.3 (7) | 2/15 |
| NEWUOA ros noiseless | 2.5 (3) | 1.0 (1.0) | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| ONEFIFTH auger noiseless | 23 (39) | 13 (9) | 40 (43) | 124 (96) | 124 (281) | 124 (126) | 124 (182) | 1/15 |
| POEMS kubalik noiseless | 16 (9) | 86 (142) | 42 (46) | 12 (12) | 12 (12) | 12 (9) | 12 (13) | 1/15 |
| PSO Bounds el-abd noiseless | 9.0 (6) | 411 (318) | 42 (49) | 12 (12) | 12 (13) | 12 (10) | 12 (18) | 1/15 |
| PSO el-abd noiseless | 4.7 (4) | 405 (325) | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| RANDOMSEARCH auger noiseless | 10 (9) | 450 (363) | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| Rosenbrock posik noiseless | 53 (43) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| VNS garcia-martinez noiseless | 2.9 (2) | 1.6 (2) | 106 (107) | 64 (154) | 64 (57) | 65 (57) | 114 (253) | 12/15 |
| iAMALGAM bosman noiseless | 5.2 (14) | 5.8 (3) | 10 (6) | 8.7 (15) | 8.7 (7) | 8.7 (13) | 8.8 (12) | 9/15 |
Previous dimension | Dimension = 5 | Next dimension
| Δ fopt f1, 5-D |
1e1 11 |
1e0 12 |
1e-1 12 |
1e-2 12 |
1e-3 12 |
1e-5 12 |
1e-7 12 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 9.2 (6) | 140 (24) | 304 (40) | 499 (49) | 693 (62) | 1050 (71) | 1436 (106) | 15/15 |
| AMALGAM bosman noiseless | 5.5 (3) | 16 (4) | 29 (6) | 44 (14) | 59 (8) | 89 (21) | 121 (28) | 15/15 |
| BAYEDA gallagher noiseless | 5.2 (4) | 47 (9) | 94 (23) | 130 (24) | 176 (22) | 400 (844) | 570 (427) | 11/15 |
| BFGS ros noiseless | 1.2 (0) | 1.1 (0) | 1.1 (0) | 1.1 (0) | 1.1 (0) | 1.1 (0) | 1.1 (0) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 3.2 (3) | 9.1 (4) | 15 (3) | 21 (4) | 28 (5) | 41 (3) | 54 (4) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 2.3 (2) | 6.0 (2) | 10 (2) | 14 (4) | 17 (3) | 25 (4) | 32 (4) | 15/15 |
| Cauchy-EDA posik noiseless | 41 (14) | 92 (32) | 174 (50) | 247 (33) | 320 (47) | 471 (47) | 615 (61) | 15/15 |
| DASA korosec noiseless | 23 (20) | 45 (19) | 60 (19) | 72 (14) | 89 (32) | 122 (16) | 152 (27) | 15/15 |
| DE-PSO garcia-nieto noiseless | 8.1 (8) | 27 (5) | 48 (10) | 78 (16) | 112 (9) | 169 (10) | 226 (16) | 15/15 |
| DIRECT posik noiseless | 2.0 (1) | 7.2 (4) | 19 (2) | 32 (5) | 45 (11) | 86 (23) | 155 (20) | 5/5 |
| EDA-PSO el-abd noiseless | 3.2 (3) | 20 (9) | 324 (138) | 901 (345) | 1524 (366) | 2733 (431) | 3899 (406) | 15/15 |
| FULLNEWUOA ros noiseless | 1.9 (0.3) | 1.8 (0) | 1.8 (0) | 1.8 (0) | 1.8 (0) | 1.8 (0) | 1.8 (0) | 15/15 |
| G3PCX posik noiseless | 5.2 (5) | 12 (2) | 15 (3) | 20 (2) | 25 (5) | 36 (4) | 46 (2) | 15/15 |
| GA nicolau noiseless | 8.7 (4) | 369 (149) | 1202 (191) | 2130 (203) | 2989 (387) | 5474 (338) | 8468 (417) | 13/15 |
| GLOBAL pal noiseless | 6.8 (9) | 26 (0.4) | 28 (0.8) | 30 (1) | 32 (1) | 36 (1) | 40 (2) | 13/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.8 (3) | 7.1 (3) | 14 (2) | 18 (5) | 24 (3) | 35 (3) | 45 (4) | 15/15 |
| LSfminbnd posik noiseless | 6.0 (2) | 6.4 (1) | 6.8 (2) | 6.9 (3) | 6.9 (2) | 6.9 (2) | 6.9 (3) | 15/15 |
| LSstep posik noiseless | 92 (54) | 123 (33) | 132 (8) | 134 (0.0) | 134 (0.0) | 134 (0.0) | 135 (0.0) | 15/15 |
| MA-LS-CHAIN molina noiseless | 7.8 (4) | 26 (5) | 48 (4) | 61 (5) | 76 (18) | 121 (32) | 146 (8) | 15/15 |
| MCS huyer noiseless | 1 (0.1) | 1.9 (0.0) | 2.5 (2) | 2.6 (2) | 2.6 (2) | 2.6 (2) | 2.6 (2) | 15/15 |
| NELDERDOERR doerr noiseless | 1.5 (1) | 3.5 (2) | 5.6 (1) | 7.6 (2) | 10 (3) | 14 (2) | 18 (2) | 15/15 |
| NELDER hansen noiseless | 1.5 (1.0) | 3.4 (2) | 5.5 (2) | 7.3 (1) | 9.4 (1) | 14 (2) | 18 (2) | 15/15 |
| NEWUOA ros noiseless | 1.1 (0) | 1.0 (0)★ | 1.0 (0.1)★ | 1.0 (0.1)★ | 1.0 (0)★ | 1.0 (0)★ | 1.0 (0)★ | 15/15 |
| ONEFIFTH auger noiseless | 2.3 (1) | 5.1 (2) | 8.6 (2) | 11 (2) | 15 (2) | 22 (2) | 29 (3) | 15/15 |
| POEMS kubalik noiseless | 106 (26) | 130 (29) | 383 (171) | 769 (237) | 1170 (149) | 2117 (223) | 2956 (168) | 15/15 |
| PSO Bounds el-abd noiseless | 3.8 (2) | 42 (36) | 217 (129) | 440 (72) | 745 (204) | 1340 (497) | 1980 (358) | 15/15 |
| PSO el-abd noiseless | 3.7 (3) | 22 (5) | 56 (17) | 117 (17) | 185 (30) | 322 (22) | 458 (50) | 15/15 |
| RANDOMSEARCH auger noiseless | 7.5 (11) | 1698 (1781) | 6.9e5 (1e6) | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 2.9 (0.7) | 4.2 (2) | 5.6 (2) | 6.9 (1) | 8.8 (3) | 12 (2) | 15 (2) | 15/15 |
| VNS garcia-martinez noiseless | 7.4 (5) | 19 (2) | 26 (4) | 32 (3) | 39 (3) | 51 (3) | 65 (3) | 15/15 |
| iAMALGAM bosman noiseless | 2.5 (2) | 10 (3) | 19 (3) | 28 (6) | 37 (6) | 57 (7) | 74 (8) | 15/15 |
| Δ fopt f2, 5-D |
1e1 83 |
1e0 87 |
1e-1 88 |
1e-2 89 |
1e-3 90 |
1e-5 92 |
1e-7 94 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 74 (10) | 95 (15) | 121 (11) | 147 (5) | 165 (17) | 213 (16) | 257 (24) | 15/15 |
| AMALGAM bosman noiseless | 7.1 (2) | 10 (4) | 13 (3) | 15 (5) | 17 (3) | 21 (5) | 24 (2) | 15/15 |
| BAYEDA gallagher noiseless | 41 (122) | 47 (58) | 52 (30) | 58 (32) | 64 (4) | 84 (30) | 95 (31) | 12/15 |
| BFGS ros noiseless | 3.9 (3) | 5.7 (2) | 6.3 (2) | 6.5 (2) | 6.6 (1) | 6.9 (2) | 7.1 (2) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 13 (4) | 16 (2) | 18 (2) | 19 (2) | 20 (2) | 21 (3) | 22 (2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 9.5 (4) | 11 (4) | 12 (3) | 13 (2) | 14 (1) | 14 (1) | 15 (2) | 15/15 |
| Cauchy-EDA posik noiseless | 42 (13) | 49 (8) | 58 (13) | 71 (14) | 80 (17) | 101 (11) | 120 (14) | 15/15 |
| DASA korosec noiseless | 10 (3) | 12 (5) | 13 (3) | 15 (4) | 17 (3) | 21 (4) | 26 (3) | 15/15 |
| DE-PSO garcia-nieto noiseless | 13 (2) | 16 (3) | 21 (2) | 24 (2) | 28 (3) | 37 (5) | 44 (4) | 15/15 |
| DIRECT posik noiseless | 5.8 (2) | 7.2 (4) | 8.4 (5) | 10 (4) | 14 (4) | 22 (12) | 382 (567) | 4/5 |
| EDA-PSO el-abd noiseless | 137 (22) | 206 (17) | 288 (41) | 359 (31) | 420 (41) | 554 (53) | 695 (41) | 15/15 |
| FULLNEWUOA ros noiseless | 7.0 (4) | 19 (13) | 36 (19) | 50 (23) | 69 (35) | 103 (32) | 134 (45) | 14/15 |
| G3PCX posik noiseless | 69 (47) | 155 (78) | 223 (99) | 276 (137) | 339 (144) | 470 (166) | 625 (362) | 15/15 |
| GA nicolau noiseless | 334 (51) | 459 (50) | 609 (65) | 772 (82) | 1301 (2827) | 2156 (2798) | 2535 (133) | 13/15 |
| GLOBAL pal noiseless | 6.3 (2) | 6.9 (2) | 7.3 (2) | 7.5 (2) | 7.7 (3) | 8.2 (1) | 8.6 (1) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 7.2 (3) | 8.5 (2) | 9.4 (2) | 10 (1) | 11 (1) | 12 (1) | 13 (1.0) | 15/15 |
| LSfminbnd posik noiseless | 1.0 (0.2) | 1.0 (0.1) | 1.0 (0.1)★ | 1.0 (0.1)★ | 1.00 (0.1)★ | 1.00 (0.1)★ | 1.0 (0.2)★ | 15/15 |
| LSstep posik noiseless | 16 (2) | 16 (2) | 16 (2) | 16 (2) | 15 (2) | 15 (2) | 15 (2) | 15/15 |
| MA-LS-CHAIN molina noiseless | 13 (5) | 16 (2) | 22 (9) | 27 (8) | 32 (10) | 41 (13) | 49 (14) | 15/15 |
| MCS huyer noiseless | 1.1 (0.7) | 1.6 (0.0) | 2.2 (1.0) | 3.3 (1) | 4.7 (1) | 6.5 (2) | 29 (2) | 14/15 |
| NELDERDOERR doerr noiseless | 4.9 (3) | 8.2 (3) | 9.0 (4) | 9.3 (5) | 10 (6) | 10 (6) | 10 (4) | 15/15 |
| NELDER hansen noiseless | 5.0 (3) | 6.8 (6) | 7.5 (2) | 7.7 (4) | 7.9 (2) | 8.3 (4) | 8.6 (4) | 15/15 |
| NEWUOA ros noiseless | 5.7 (8) | 22 (13) | 46 (30) | 60 (30) | 85 (29) | 129 (27) | 166 (60) | 15/15 |
| ONEFIFTH auger noiseless | 5577 (8672) | 1.6e4 (2e4) | 3.1e4 (1e4) | 4.6e4 (3e4) | 1.9e5 (3e5) | 8.0e5 (1e6) | ∞5e6 | 0/15 |
| POEMS kubalik noiseless | 216 (48) | 275 (37) | 333 (52) | 382 (66) | 437 (55) | 519 (91) | 629 (60) | 15/15 |
| PSO Bounds el-abd noiseless | 156 (86) | 195 (79) | 258 (111) | 304 (65) | 396 (123) | 860 (167) | 1182 (239) | 15/15 |
| PSO el-abd noiseless | 32 (4) | 41 (8) | 49 (8) | 60 (8) | 68 (11) | 89 (18) | 106 (9) | 15/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 13 (14) | 103 (288) | 137 (159) | 138 (278) | 152 (55) | 188 (273) | 242 (209) | 12/15 |
| VNS garcia-martinez noiseless | 18 (5) | 20 (3) | 24 (2) | 25 (17) | 25 (1) | 26 (2) | 27 (9) | 15/15 |
| iAMALGAM bosman noiseless | 6.3 (2) | 8.1 (2) | 10 (2) | 12 (2) | 13 (2) | 15 (4) | 17 (3) | 15/15 |
| Δ fopt f3, 5-D |
1e1 716 |
1e0 1622 |
1e-1 1637 |
1e-2 1642 |
1e-3 1646 |
1e-5 1650 |
1e-7 1654 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 5.7 (2) | 12 (7) | 22 (10) | 24 (23) | 26 (18) | 29 (20) | 33 (20) | 15/15 |
| AMALGAM bosman noiseless | 4.5 (7) | 65 (65) | 484 (614) | 505 (536) | 514 (726) | 520 (765) | 524 (755) | 15/15 |
| BAYEDA gallagher noiseless | 2.7 (0.9) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| BFGS ros noiseless | 107 (172) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.4 (1) | 16 (19) | 139 (534) | 139 (781) | 139 (88) | 139 (305) | 140 (315) | 14/15 |
| CMA-ESPLUSSEL auger noiseless | 9.1 (9) | 440 (617) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| Cauchy-EDA posik noiseless | 6.7 (3) | 2243 (2158) | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| DASA korosec noiseless | 1.2 (0.5) | 1.6 (2) | 10 (8) | 10 (8) | 10 (12) | 10 (11) | 11 (14) | 15/15 |
| DE-PSO garcia-nieto noiseless | 3.7 (1) | 29 (42) | 30 (35) | 30 (26) | 30 (14) | ∞ | ∞1e4 | 0/15 |
| DIRECT posik noiseless | 45 (72) | 304 (463) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 12 (5) | 170 (159) | 856 (993) | 857 (839) | 860 (1064) | 866 (381) | 870 (907) | 4/15 |
| FULLNEWUOA ros noiseless | 4.2 (3) | 164 (251) | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| G3PCX posik noiseless | 84 (99) | 2052 (2329) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| GA nicolau noiseless | 19 (1) | 18 (2) | 25 (2) | 34 (4) | 43 (5) | 112 (81) | 200 (84) | 11/15 |
| GLOBAL pal noiseless | 3.3 (4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2613 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.2 (2) | 12 (18) | 96 (157) | 96 (155) | 96 (132) | 97 (57) | 97 (118) | 4/15 |
| LSfminbnd posik noiseless | 1.00 (4) | 52 (83) | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| LSstep posik noiseless | 2.2 (0.3) | 1.00 (8e-3) | 1.0 (0.0) | 1.00 (0.0) | 1.00 (0.0) | 1.0 (0.0) | 1.00 (0.0) | 15/15 |
| MA-LS-CHAIN molina noiseless | 1.0 (0.6) | 6.4 (12) | 32 (30) | 32 (36) | 32 (67) | 32 (33) | 32 (46) | 14/15 |
| MCS huyer noiseless | 1.2 (1) | 24 (32) | 216 (192) | 215 (353) | 215 (370) | 214 (247) | 214 (333) | 2/15 |
| NELDERDOERR doerr noiseless | 1.5 (0.2) | 33 (60) | 268 (497) | 268 (362) | 267 (449) | 266 (208) | 266 (253) | 3/15 |
| NELDER hansen noiseless | 5.4 (5) | 282 (362) | 1464 (1795) | 1460 (1813) | 1456 (1012) | 1453 (2070) | 1449 (1073) | 3/15 |
| NEWUOA ros noiseless | 6.1 (7) | 229 (395) | ∞ | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| ONEFIFTH auger noiseless | 16 (13) | 308 (294) | 3860 (5194) | 3848 (7653) | 3839 (1059) | 3830 (1515) | 3820 (3375) | 8/15 |
| POEMS kubalik noiseless | 3.8 (1.0) | 10 (4) | 35 (37) | 39 (36) | 42 (72) | 47 (35) | 54 (52) | 15/15 |
| PSO Bounds el-abd noiseless | 7.6 (4) | 26 (7) | 38 (33) | 63 (12) | 64 (16) | 70 (12) | 95 (26) | 14/15 |
| PSO el-abd noiseless | 52 (1) | 55 (234) | 275 (458) | 275 (457) | 275 (458) | 276 (229) | 276 (77) | 8/15 |
| RANDOMSEARCH auger noiseless | 6760 (4918) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 24 (40) | 394 (615) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| VNS garcia-martinez noiseless | 2.5 (5) | 5.2 (3) | 11 (7) | 11 (6) | 12 (9) | 22 (26) | 40 (22) | 15/15 |
| iAMALGAM bosman noiseless | 1.4 (3) | 33 (50) | 178 (114) | 182 (358) | 184 (613) | 187 (107) | 189 (168) | 15/15 |
| Δ fopt f4, 5-D |
1e1 809 |
1e0 1633 |
1e-1 1688 |
1e-2 1758 |
1e-3 1817 |
1e-5 1886 |
1e-7 1903 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 7.1 (0.6) | 28 (22) | 59 (30) | 58 (41) | 58 (34) | 59 (40) | 63 (35) | 15/15 |
| AMALGAM bosman noiseless | 5.8 (6) | 2.0e4 (5e4) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| BAYEDA gallagher noiseless | 5.8 (3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| BFGS ros noiseless | 169 (181) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 2.7 (3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA-ESPLUSSEL auger noiseless | 15 (19) | 458 (406) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| Cauchy-EDA posik noiseless | 85 (38) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| DASA korosec noiseless | 1.0 (0.5) | 1.8 (2) | 5.9 (4) | 5.7 (6) | 5.6 (7) | 5.7 (7) | 5.9 (7) | 15/15 |
| DE-PSO garcia-nieto noiseless | 3.3 (1) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| DIRECT posik noiseless | 192 (190) | 105 (123) | 249 (282) | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 15 (3) | 2012 (2755) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| FULLNEWUOA ros noiseless | 12 (6) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| G3PCX posik noiseless | 76 (156) | 2151 (1510) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| GA nicolau noiseless | 18 (3) | 20 (2) | 26 (2) | 33 (6) | 41 (7) | 58 (9) | 185 (208) | 9/15 |
| GLOBAL pal noiseless | 8.3 (11) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3167 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.0 (0.6) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| LSfminbnd posik noiseless | 7.8 (21) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| LSstep posik noiseless | 2.0 (5e-3) | 1.0 (9e-3) | 1 (0.0) | 1.00 (0.0) | 1.0 (0.1) | 1.00 (0.0) | 1.0 (0.1) | 12/15 |
| MA-LS-CHAIN molina noiseless | 1.7 (1) | 35 (39) | 176 (426) | 169 (242) | 163 (243) | 158 (123) | 157 (131) | 5/15 |
| MCS huyer noiseless | 4.1 (5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 7.1 (7) | 898 (1087) | 870 (992) | 835 (597) | 808 (523) | 779 (583) | 772 (814) | 1/15 |
| NELDER hansen noiseless | 26 (35) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| NEWUOA ros noiseless | 27 (23) | 305 (360) | ∞ | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| ONEFIFTH auger noiseless | 25 (28) | 3741 (6177) | 2.0e4 (4e4) | 1.9e4 (2e4) | 1.9e4 (3e4) | 1.8e4 (3e4) | 1.8e4 (1e4) | 2/15 |
| POEMS kubalik noiseless | 4.5 (1) | 17 (5) | 45 (68) | 47 (51) | 47 (33) | 52 (15) | 57 (47) | 15/15 |
| PSO Bounds el-abd noiseless | 8.0 (6) | 30 (21) | 64 (26) | 115 (23) | 113 (81) | 113 (156) | 135 (129) | 12/15 |
| PSO el-abd noiseless | 3.0 (1) | 141 (2) | 4152 (3703) | 3988 (4195) | 3859 (6811) | 3719 (5965) | 3687 (4926) | 1/15 |
| RANDOMSEARCH auger noiseless | 1.6e4 (2e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 57 (31) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| VNS garcia-martinez noiseless | 2.5 (3) | 16 (12) | 39 (43) | 38 (39) | 39 (40) | 54 (38) | 128 (46) | 15/15 |
| iAMALGAM bosman noiseless | 3.9 (3) | 2.1e4 (2e4) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Δ fopt f5, 5-D |
1e1 10 |
1e0 10 |
1e-1 10 |
1e-2 10 |
1e-3 10 |
1e-5 10 |
1e-7 10 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 64 (32) | 132 (27) | 159 (83) | 162 (70) | 165 (72) | 165 (92) | 165 (75) | 15/15 |
| AMALGAM bosman noiseless | 19 (4) | 28 (9) | 29 (8) | 29 (5) | 29 (5) | 29 (6) | 29 (10) | 15/15 |
| BAYEDA gallagher noiseless | 38 (24) | 76 (32) | 321 (758) | 321 (764) | 323 (518) | 323 (1012) | 323 (506) | 12/15 |
| BFGS ros noiseless | 1.9 (0.6) | 3.0 (0.6) | 3.1 (0.5) | 3.1 (0.6) | 3.1 (0.8) | 3.1 (0.9) | 3.1 (1) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 4.5 (3) | 6.5 (2) | 6.6 (2) | 6.6 (2) | 6.6 (2) | 6.6 (2) | 6.6 (2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 2.3 (1) | 3.1 (1) | 3.2 (0.8) | 3.2 (1) | 3.2 (0.9) | 3.2 (2) | 3.2 (0.7) | 15/15 |
| Cauchy-EDA posik noiseless | 39 (19) | 41 (31) | 41 (21) | 41 (30) | 41 (31) | 41 (38) | 41 (43) | 15/15 |
| DASA korosec noiseless | 28 (11) | 36 (11) | 40 (17) | 43 (12) | 49 (9) | 55 (11) | 63 (8) | 15/15 |
| DE-PSO garcia-nieto noiseless | 22 (8) | 37 (7) | 41 (5) | 41 (8) | 41 (8) | 41 (7) | 41 (5) | 15/15 |
| DIRECT posik noiseless | 9.2 (0.1) | 12 (0.1) | 13 (0.1) | 13 (0.1) | 13 (0.1) | 13 (0.1) | 13 (0.1) | 5/5 |
| EDA-PSO el-abd noiseless | 10 (3) | 16 (4) | 16 (6) | 16 (5) | 16 (5) | 17 (4) | 17 (5) | 15/15 |
| FULLNEWUOA ros noiseless | 2.2 (0) | 2.4 (0.2) | 2.4 (0.3) | 2.4 (0.4) | 2.4 (0.4) | 2.4 (0.3) | 2.4 (0.1) | 15/15 |
| G3PCX posik noiseless | 14 (5) | 25 (7) | 27 (15) | 28 (14) | 28 (16) | 28 (14) | 28 (7) | 15/15 |
| GA nicolau noiseless | 481 (260) | 2072 (354) | 3983 (381) | 6349 (712) | 9220 (461) | 1.7e4 (2034) | 3.4e4 (3782) | 0/15 |
| GLOBAL pal noiseless | 32 (0.9) | 33 (2) | 34 (1) | 34 (2) | 34 (2) | 34 (3) | 34 (2) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 4.8 (1) | 6.6 (3) | 6.8 (3) | 6.9 (1) | 6.9 (2) | 6.9 (3) | 6.9 (3) | 15/15 |
| LSfminbnd posik noiseless | 13 (2) | 14 (0) | 14 (0) | 14 (0) | 14 (0) | 14 (0) | 14 (0) | 15/15 |
| LSstep posik noiseless | 141 (40) | 160 (0.1) | 160 (0.1) | 160 (0.1) | 160 (0.1) | 160 (0.1) | 160 (0.1) | 15/15 |
| MA-LS-CHAIN molina noiseless | 53 (7) | 69 (9) | 70 (5) | 71 (7) | 71 (6) | 71 (7) | 71 (6) | 15/15 |
| MCS huyer noiseless | 1 (0)★ | 1 (0)★ | 1 (0)★ | 1 (0)★ | 1 (0)★ | 1 (0)★ | 1 (0)★ | 15/15 |
| NELDERDOERR doerr noiseless | 1.9 (0.7) | 2.4 (0.9) | 2.5 (0.8) | 2.5 (0.8) | 2.5 (1) | 2.5 (0.9) | 2.5 (0.6) | 15/15 |
| NELDER hansen noiseless | 2.5 (0.8) | 4.1 (4) | 4.2 (5) | 4.2 (1) | 4.2 (4) | 4.2 (1) | 4.2 (6) | 15/15 |
| NEWUOA ros noiseless | 1.3 (0.1) | 1.5 (0.2) | 1.5 (0.3) | 1.5 (0.2) | 1.5 (0.3) | 1.5 (0.3) | 1.5 (0.2) | 15/15 |
| ONEFIFTH auger noiseless | 2.0 (0.7) | 2.4 (0.6) | 2.5 (0.9) | 2.6 (0.5) | 2.6 (1) | 2.6 (0.9) | 2.6 (1) | 15/15 |
| POEMS kubalik noiseless | 155 (49) | 197 (24) | 213 (34) | 221 (25) | 222 (50) | 223 (29) | 223 (46) | 15/15 |
| PSO Bounds el-abd noiseless | 9.2 (1) | 15 (6) | 16 (6) | 16 (7) | 16 (6) | 16 (7) | 16 (7) | 15/15 |
| PSO el-abd noiseless | 10 (3) | 14 (4) | 16 (7) | 16 (4) | 16 (8) | 16 (7) | 16 (5) | 15/15 |
| RANDOMSEARCH auger noiseless | 4349 (8019) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 4.0 (0.7) | 4.2 (0.5) | 4.2 (0.4) | 4.2 (0.4) | 4.2 (0.6) | 4.2 (0.5) | 4.2 (0.5) | 15/15 |
| VNS garcia-martinez noiseless | 13 (2) | 15 (2) | 15 (2) | 15 (1) | 15 (3) | 15 (1) | 15 (2) | 15/15 |
| iAMALGAM bosman noiseless | 7.1 (3) | 11 (7) | 12 (6) | 12 (6) | 12 (3) | 12 (7) | 12 (6) | 15/15 |
| Δ fopt f6, 5-D |
1e1 114 |
1e0 214 |
1e-1 281 |
1e-2 404 |
1e-3 580 |
1e-5 1038 |
1e-7 1332 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 20 (7) | 28 (4) | 40 (4) | 41 (7) | 39 (8) | 34 (4) | 37 (6) | 15/15 |
| AMALGAM bosman noiseless | 3.2 (1) | 4.3 (0.9) | 5.7 (1) | 5.7 (2) | 5.2 (2) | 4.3 (0.8) | 4.5 (0.8) | 15/15 |
| BAYEDA gallagher noiseless | 248 (351) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| BFGS ros noiseless | 3.0 (3) | 3.3 (0.4) | 3.4 (1) | 3.0 (1) | 2.5 (0.6) | 2.0 (0.9) | 7.8 (7) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 2.3 (1) | 2.1 (0.7) | 2.2 (0.5) | 1.9 (0.3) | 1.7 (0.2) | 1.3 (0.3) | 1.3 (0.1) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 1.4 (1) | 1.4 (0.4) | 1.6 (1) | 1.7 (2) | 1.6 (1.0) | 1.6 (0.9) | 1.8 (1) | 15/15 |
| Cauchy-EDA posik noiseless | 92 (49) | 69 (24) | 68 (15) | 58 (11) | 47 (9) | 35 (4) | 34 (7) | 15/15 |
| DASA korosec noiseless | 7.8 (5) | 9.0 (3) | 50 (151) | 99 (329) | 108 (5) | 81 (257) | 150 (162) | 15/15 |
| DE-PSO garcia-nieto noiseless | 5.5 (2) | 6.4 (2) | 8.1 (2) | 8.0 (2) | 7.1 (1) | 6.3 (1) | 10 (4) | 7/15 |
| DIRECT posik noiseless | 2.3 (2) | 28 (21) | 789 (623) | 1219 (1300) | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 11 (12) | 51 (8) | 81 (11) | 85 (12) | 79 (4) | 65 (2) | 68 (2) | 15/15 |
| FULLNEWUOA ros noiseless | 1.2 (0.6) | 1.00 (0.7) | 1.0 (0.7) | 1.00 (0.5) | 1.0 (0.6) | 1.00 (1) | 1.4 (1.0) | 15/15 |
| G3PCX posik noiseless | 2.4 (0.7) | 3.0 (2) | 4.8 (6) | 5.1 (5) | 4.7 (4) | 5.1 (4) | 5.5 (3) | 15/15 |
| GA nicolau noiseless | 66 (63) | 148 (68) | 382 (80) | 3680 (6218) | 1.2e4 (2e4) | ∞ | ∞5e5 | 0/15 |
| GLOBAL pal noiseless | 2.9 (0.6) | 2.1 (0.4) | 2.0 (0.2) | 2.9 (3) | 2.2 (2) | 3.6 (4) | 35 (42) | 1/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.8 (0.6) | 2.5 (0.6) | 2.7 (1) | 2.4 (1) | 2.2 (0.6) | 1.6 (0.2) | 1.5 (0.2) | 15/15 |
| LSfminbnd posik noiseless | 96 (366) | 115 (176) | 135 (199) | 155 (280) | 110 (87) | 82 (88) | 65 (55) | 6/15 |
| LSstep posik noiseless | 408 (551) | 292 (292) | 296 (392) | 418 (449) | 605 (756) | ∞ | ∞5e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 4.8 (3) | 6.7 (3) | 7.9 (3) | 7.4 (1) | 5.8 (1) | 4.1 (0.3) | 3.7 (0.7) | 15/15 |
| MCS huyer noiseless | 2.7 (2) | 47 (17) | 41 (90) | 61 (59) | 71 (51) | 46 (53) | 54 (66) | 4/15 |
| NELDERDOERR doerr noiseless | 5.1 (6) | 5.6 (6) | 5.6 (4) | 4.9 (3) | 5.3 (7) | 5.6 (5) | 8.5 (5) | 14/15 |
| NELDER hansen noiseless | 1.0 (0.5) | 1.9 (2) | 2.8 (3) | 2.5 (2) | 2.3 (1) | 2.0 (1) | 2.6 (1.0) | 15/15 |
| NEWUOA ros noiseless | 1.7 (2) | 2.4 (1) | 3.6 (2) | 3.6 (3) | 3.3 (2) | 2.7 (0.9) | 2.9 (1) | 15/15 |
| ONEFIFTH auger noiseless | 1.6 (0.8) | 1.5 (0.8) | 1.7 (1) | 1.5 (1.0) | 1.3 (0.5) | 1.0 (0.7) | 1.00 (0.5) | 15/15 |
| POEMS kubalik noiseless | 27 (14) | 46 (8) | 53 (9) | 50 (5) | 46 (3) | 37 (1) | 37 (1) | 15/15 |
| PSO Bounds el-abd noiseless | 14 (5) | 49 (20) | 85 (66) | 105 (80) | 98 (58) | 78 (44) | 92 (25) | 15/15 |
| PSO el-abd noiseless | 4.7 (5) | 9.0 (7) | 11 (4) | 12 (3) | 11 (2) | 10 (1) | 11 (2) | 15/15 |
| RANDOMSEARCH auger noiseless | 303 (334) | 5.7e4 (4e4) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 2.2 (0.4) | 2.8 (0.7) | 2.4 (5) | 2.2 (3) | 4.3 (11) | 2.8 (6) | 2.4 (5) | 15/15 |
| VNS garcia-martinez noiseless | 3.7 (0.7) | 2.7 (0.6) | 2.9 (0.2) | 2.5 (0.2) | 2.0 (0.2) | 1.5 (0.1) | 1.4 (0.1) | 15/15 |
| iAMALGAM bosman noiseless | 2.1 (1) | 2.3 (0.8) | 3.2 (1.0) | 3.1 (0.7) | 2.7 (0.8) | 2.2 (0.5) | 2.3 (0.5) | 15/15 |
| Δ fopt f7, 5-D |
1e1 24 |
1e0 324 |
1e-1 1171 |
1e-2 1451 |
1e-3 1572 |
1e-5 1572 |
1e-7 1597 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 33 (20) | 10 (4) | 5.7 (0.9) | 7.7 (2) | 9.0 (2) | 9.0 (4) | 10 (3) | 15/15 |
| AMALGAM bosman noiseless | 5.5 (3) | 1.00 (0.3) | 1.2 (3) | 1.8 (5) | 2.3 (4) | 2.3 (4) | 2.4 (4) | 15/15 |
| BAYEDA gallagher noiseless | 20 (19) | 31 (39) | 121 (98) | 98 (150) | ∞ | ∞ | ∞1e4 | 0/15 |
| BFGS ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞600 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 4.9 (6) | 1.5 (1) | 1.0 (1) | 1.00 (0.5) | 1.0 (0.6) | 1.0 (0.8) | 1.00 (0.6) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 3.4 (2) | 5.3 (6) | 2.0 (3) | 2.1 (0.9) | 3.1 (2) | 3.1 (4) | 3.1 (0.6) | 15/15 |
| Cauchy-EDA posik noiseless | 33 (9) | 4.9 (1) | 2.4 (0.8) | 2.9 (1) | 2.9 (1) | 2.9 (0.9) | 3.4 (1) | 15/15 |
| DASA korosec noiseless | 222 (170) | 281 (333) | 1108 (1145) | 2.0e4 (2e4) | ∞ | ∞ | ∞4e6 | 0/15 |
| DE-PSO garcia-nieto noiseless | 14 (4) | 3.0 (1) | 5.0 (6) | 7.2 (8) | 8.3 (8) | 8.3 (13) | 8.5 (7) | 8/15 |
| DIRECT posik noiseless | 2.7 (1) | 1.7 (1) | 115 (193) | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 22 (59) | 24 (8) | 13 (3) | 17 (2) | 18 (2) | 18 (2) | 19 (2) | 15/15 |
| FULLNEWUOA ros noiseless | 0.98 (0.2) | 1.2 (2) | 4.0 (2) | 14 (26) | 24 (28) | 24 (16) | 23 (45) | 11/15 |
| G3PCX posik noiseless | 19 (34) | 18 (27) | 45 (62) | 152 (153) | 415 (433) | 415 (430) | 409 (293) | 2/15 |
| GA nicolau noiseless | 49 (58) | 35 (15) | 57 (217) | 245 (428) | 524 (479) | 524 (639) | 523 (192) | 5/15 |
| GLOBAL pal noiseless | 11 (7) | 5.7 (7) | 10 (17) | ∞ | ∞ | ∞ | ∞1880 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 5.9 (3) | 1.8 (0.6) | 1.2 (0.8) | 1.2 (0.6) | 1.2 (0.6) | 1.2 (0.8) | 1.2 (0.6) | 15/15 |
| LSfminbnd posik noiseless | 48 (50) | 64 (132) | 100 (97) | 511 (534) | ∞ | ∞ | ∞5e4 | 0/15 |
| LSstep posik noiseless | 368 (183) | 696 (1124) | 640 (512) | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 8.2 (3) | 3.2 (1) | 13 (11) | 13 (2) | 24 (33) | 24 (20) | 24 (38) | 14/15 |
| MCS huyer noiseless | 2.8 (1) | 5.9 (4) | 13 (25) | 141 (207) | ∞ | ∞ | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 1.3 (0.4) | 7.5 (3) | 15 (9) | 39 (34) | 71 (82) | 71 (80) | 71 (56) | 9/15 |
| NELDER hansen noiseless | 26 (23) | 33 (25) | 56 (42) | 119 (94) | 307 (306) | 307 (572) | 302 (320) | 9/15 |
| NEWUOA ros noiseless | 10 (15) | 13 (18) | 60 (58) | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| ONEFIFTH auger noiseless | 5.5 (9) | 6.8 (4) | 100 (109) | 372 (569) | 807 (930) | 807 (663) | 794 (1189) | 15/15 |
| POEMS kubalik noiseless | 72 (14) | 15 (7) | 9.2 (1) | 11 (1) | 21 (39) | 21 (39) | 22 (19) | 15/15 |
| PSO Bounds el-abd noiseless | 9.2 (4) | 13 (13) | 165 (111) | 140 (177) | 131 (83) | 131 (163) | 129 (237) | 11/15 |
| PSO el-abd noiseless | 11 (16) | 9.5 (14) | 587 (816) | 475 (651) | 541 (630) | 541 (731) | 533 (1081) | 6/15 |
| RANDOMSEARCH auger noiseless | 38 (34) | 1206 (1006) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 1180 (1470) | 668 (796) | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| VNS garcia-martinez noiseless | 11 (3) | 1.6 (2) | 6.8 (13) | 6.6 (7) | 7.8 (8) | 7.8 (6) | 7.8 (7) | 15/15 |
| iAMALGAM bosman noiseless | 3.7 (2) | 1.9 (0.2) | 3.0 (3) | 2.9 (2) | 3.7 (4) | 3.7 (2) | 3.7 (3) | 15/15 |
| Δ fopt f8, 5-D |
1e1 73 |
1e0 273 |
1e-1 336 |
1e-2 372 |
1e-3 391 |
1e-5 410 |
1e-7 422 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 51 (12) | 49 (27) | 104 (55) | 146 (76) | 177 (45) | 253 (111) | 341 (140) | 15/15 |
| AMALGAM bosman noiseless | 5.2 (2) | 6.1 (2) | 7.8 (3) | 8.1 (3) | 8.5 (2) | 9.1 (3) | 10 (3) | 15/15 |
| BAYEDA gallagher noiseless | 136 (104) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| BFGS ros noiseless | 2.1 (0.6) | 1.8 (0.8) | 1.6 (2) | 1.5 (1) | 1.5 (0.1) | 1.5 (1) | 1.5 (0.5) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 3.2 (4) | 3.7 (2) | 4.5 (1) | 4.7 (1) | 4.8 (4) | 5.1 (4) | 5.4 (0.5) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 2.1 (2) | 5.1 (9) | 5.0 (7) | 4.9 (4) | 4.9 (6) | 4.9 (6) | 5.0 (0.7) | 15/15 |
| Cauchy-EDA posik noiseless | 50 (31) | 31 (10) | 33 (8) | 33 (6) | 34 (7) | 37 (5) | 40 (9) | 15/15 |
| DASA korosec noiseless | 19 (24) | 162 (413) | 387 (596) | 700 (616) | 1046 (670) | 1995 (813) | 3323 (899) | 15/15 |
| DE-PSO garcia-nieto noiseless | 12 (2) | 18 (5) | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| DIRECT posik noiseless | 4.1 (3) | 5.7 (4) | 22 (15) | 56 (37) | 100 (35) | 195 (181) | 294 (533) | 3/5 |
| EDA-PSO el-abd noiseless | 72 (58) | 103 (11) | 195 (22) | 296 (16) | 404 (21) | 625 (19) | 839 (21) | 15/15 |
| FULLNEWUOA ros noiseless | 1.6 (0.9) | 1.0 (0.3) | 1.0 (0.3) | 1.0 (0.3) | 1.0 (0.9) | 1.0 (0.9) | 1.0 (0.9) | 15/15 |
| G3PCX posik noiseless | 4.6 (4) | 20 (22) | 18 (9) | 17 (13) | 17 (27) | 16 (20) | 16 (9) | 15/15 |
| GA nicolau noiseless | 187 (34) | 837 (490) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| GLOBAL pal noiseless | 5.0 (0.3) | 2.1 (1) | 2.1 (0.9) | 2.1 (1) | 2.1 (0.4) | 2.1 (0.4) | 2.2 (1) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 3.5 (1) | 5.8 (3) | 6.8 (2) | 6.7 (0.5) | 6.8 (2) | 6.9 (2) | 7.1 (0.4) | 15/15 |
| LSfminbnd posik noiseless | 10 (18) | 287 (595) | 453 (396) | 1905 (2655) | ∞ | ∞ | ∞5e4 | 0/15 |
| LSstep posik noiseless | 64 (8) | 96 (193) | 329 (338) | 912 (1479) | 1826 (2270) | ∞ | ∞5e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 8.8 (0.8) | 7.2 (4) | 10 (3) | 10 (3) | 11 (2) | 11 (3) | 12 (1) | 15/15 |
| MCS huyer noiseless | 1.5 (0.9) | 1.0 (0.8) | 1.0 (0.5) | 1.0 (0.6) | 1.1 (0.9) | 1.1 (0.8) | 1.1 (0.8) | 15/15 |
| NELDERDOERR doerr noiseless | 2.1 (0.9) | 2.4 (2) | 2.4 (1) | 2.3 (2) | 2.3 (2) | 2.4 (1) | 2.4 (1) | 15/15 |
| NELDER hansen noiseless | 1.6 (1) | 3.7 (3) | 3.3 (4) | 3.2 (2) | 3.1 (5) | 3.1 (4) | 3.2 (6) | 15/15 |
| NEWUOA ros noiseless | 1.0 (0.7) | 1.1 (1) | 1.2 (1) | 1.2 (0.3) | 1.2 (0.8) | 1.2 (0.3) | 1.2 (0.4) | 15/15 |
| ONEFIFTH auger noiseless | 15 (43) | 242 (616) | 227 (371) | 236 (151) | 258 (488) | 317 (146) | 382 (160) | 15/15 |
| POEMS kubalik noiseless | 69 (18) | 181 (15) | 200 (466) | 387 (190) | 745 (309) | 5486 (3503) | 1.8e4 (4e4) | 0/15 |
| PSO Bounds el-abd noiseless | 30 (18) | 468 (193) | 922 (343) | 1176 (383) | 1409 (1021) | ∞ | ∞5e5 | 0/15 |
| PSO el-abd noiseless | 13 (4) | 153 (465) | 201 (425) | 313 (32) | 467 (130) | 781 (652) | 1104 (92) | 7/15 |
| RANDOMSEARCH auger noiseless | 2.0e4 (3e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 33 (115) | 23 (36) | 22 (56) | 23 (29) | 25 (18) | 30 (23) | 36 (60) | 13/15 |
| VNS garcia-martinez noiseless | 5.1 (1) | 6.6 (12) | 7.7 (8) | 21 (34) | 46 (204) | 47 (5) | 46 (5) | 15/15 |
| iAMALGAM bosman noiseless | 3.4 (1.0) | 7.5 (15) | 7.7 (8) | 7.7 (7) | 7.7 (6) | 8.1 (11) | 8.4 (6) | 15/15 |
| Δ fopt f9, 5-D |
1e1 35 |
1e0 127 |
1e-1 214 |
1e-2 263 |
1e-3 300 |
1e-5 335 |
1e-7 369 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 89 (12) | 92 (53) | 134 (71) | 197 (107) | 259 (130) | 374 (127) | 561 (395) | 15/15 |
| AMALGAM bosman noiseless | 9.0 (3) | 23 (5) | 18 (2) | 17 (4) | 16 (18) | 16 (4) | 15 (16) | 15/15 |
| BAYEDA gallagher noiseless | 37 (26) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| BFGS ros noiseless | 3.6 (3) | 3.0 (2) | 2.0 (1) | 1.8 (0.8) | 1.6 (0.7) | 1.5 (0.3) | 1.4 (0.7) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 5.8 (2) | 8.7 (9) | 7.2 (5) | 6.7 (8) | 6.4 (4) | 6.3 (1) | 6.2 (0.9) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 4.2 (7) | 7.7 (4) | 5.9 (1) | 5.3 (5) | 5.0 (0.9) | 4.9 (4) | 4.7 (0.7) | 15/15 |
| Cauchy-EDA posik noiseless | 71 (40) | 54 (18) | 45 (11) | 42 (8) | 41 (5) | 42 (11) | 43 (10) | 15/15 |
| DASA korosec noiseless | 223 (684) | 6694 (1e4) | 4781 (6721) | 4583 (2e4) | 4797 (1e4) | 6578 (8050) | 8879 (6789) | 12/15 |
| DE-PSO garcia-nieto noiseless | 21 (7) | 146 (215) | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| DIRECT posik noiseless | 3.1 (2) | 4.2 (2) | 48 (38) | 56 (29) | 134 (87) | 151 (46) | 306 (435) | 3/5 |
| EDA-PSO el-abd noiseless | 243 (84) | 208 (35) | 268 (85) | 469 (282) | 701 (343) | 1337 (503) | 2849 (2536) | 5/15 |
| FULLNEWUOA ros noiseless | 2.6 (0.7) | 2.7 (3) | 1.9 (2) | 1.7 (0.6) | 1.5 (0.8) | 1.4 (0.6) | 1.3 (1) | 15/15 |
| G3PCX posik noiseless | 14 (15) | 18 (22) | 14 (10) | 12 (9) | 11 (2) | 10 (4) | 10 (7) | 15/15 |
| GA nicolau noiseless | 418 (70) | 5.6e4 (5e4) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| GLOBAL pal noiseless | 11 (0.9) | 4.6 (2) | 3.2 (1) | 3.0 (2) | 2.8 (1.0) | 2.7 (1.0) | 2.7 (0.4) | 13/15 |
| IPOP-SEP-CMA-ES ros noiseless | 10 (2) | 11 (6) | 10 (0.5) | 8.8 (2) | 8.3 (2) | 8.0 (3) | 7.7 (3) | 15/15 |
| LSfminbnd posik noiseless | 13 (30) | 131 (199) | 183 (301) | 445 (393) | ∞ | ∞ | ∞5e4 | 0/15 |
| LSstep posik noiseless | 513 (851) | 5594 (6004) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 17 (4) | 20 (4) | 17 (3) | 17 (4) | 17 (7) | 16 (7) | 16 (5) | 15/15 |
| MCS huyer noiseless | 0.99 (0.5) | 1 (0.2)★ | 1 (0.1) | 1.0 (0.2) | 1.0 (0.1) | 1.0 (0.2) | 1 (0.1) | 15/15 |
| NELDERDOERR doerr noiseless | 2.3 (0.7) | 3.1 (0.8) | 2.5 (1) | 2.3 (1) | 2.1 (1) | 2.1 (0.8) | 2.0 (0.5) | 15/15 |
| NELDER hansen noiseless | 3.1 (4) | 13 (26) | 8.2 (14) | 6.9 (7) | 6.2 (10) | 5.8 (6) | 5.4 (9) | 15/15 |
| NEWUOA ros noiseless | 1.8 (0.7) | 3.6 (4) | 2.5 (2) | 2.1 (2) | 1.9 (0.3) | 1.9 (0.9) | 1.7 (0.9) | 15/15 |
| ONEFIFTH auger noiseless | 2.8 (1) | 103 (359) | 80 (5) | 99 (38) | 128 (23) | 201 (151) | 266 (70) | 15/15 |
| POEMS kubalik noiseless | 134 (36) | 131 (19) | 290 (295) | 596 (246) | 1054 (490) | 1.1e4 (1e4) | ∞5e5 | 0/15 |
| PSO Bounds el-abd noiseless | 217 (129) | 1460 (1358) | 1608 (213) | 1841 (243) | 3967 (4854) | 2.2e4 (4e4) | 2.0e4 (5e4) | 1/15 |
| PSO el-abd noiseless | 24 (10) | 938 (1975) | 678 (1182) | 794 (1469) | 1131 (2085) | 2363 (4053) | 2753 (2566) | 5/15 |
| RANDOMSEARCH auger noiseless | 4.1e4 (7e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 5.3 (4) | 10 (4) | 10 (6) | 15 (19) | 14 (14) | 14 (6) | 14 (7) | 15/15 |
| VNS garcia-martinez noiseless | 11 (3) | 18 (20) | 14 (12) | 12 (4) | 11 (9) | 11 (3) | 10 (13) | 15/15 |
| iAMALGAM bosman noiseless | 7.0 (1) | 22 (32) | 15 (22) | 14 (21) | 13 (14) | 12 (14) | 12 (6) | 15/15 |
| Δ fopt f10, 5-D |
1e1 349 |
1e0 500 |
1e-1 574 |
1e-2 607 |
1e-3 626 |
1e-5 829 |
1e-7 880 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 88 (68) | 316 (429) | 888 (717) | 1980 (1241) | 5261 (3461) | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 1.9 (0.4) | 1.8 (0.7) | 2.0 (1) | 2.3 (0.8) | 2.5 (0.8) | 2.3 (0.6) | 2.6 (0.4) | 15/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| BFGS ros noiseless | 1.0 (0.3) | 1.00 (0.3) | 1.0 (0.2) | 1 (0.3) | 1.00 (0.3) | 1.1 (0.2) | 23 (49) | 5/15 |
| BIPOP-CMA-ES hansen noiseless | 3.5 (0.4) | 2.9 (0.4) | 2.7 (0.4) | 2.7 (0.2) | 2.8 (0.2) | 2.3 (0.1) | 2.4 (0.2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 2.5 (0.9) | 2.2 (0.3) | 2.0 (0.2) | 2.1 (0.2) | 2.1 (0.3) | 1.7 (0.2) | 1.7 (0.2) | 15/15 |
| Cauchy-EDA posik noiseless | 11 (2) | 9.0 (1) | 9.4 (2) | 11 (2) | 12 (2) | 11 (1) | 13 (2) | 15/15 |
| DASA korosec noiseless | 6920 (4909) | 1.8e4 (1e4) | 3.9e4 (5e4) | 5.9e4 (4e4) | 1.2e5 (9e4) | 9.0e4 (1e5) | ∞5e6 | 0/15 |
| DE-PSO garcia-nieto noiseless | 213 (467) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| DIRECT posik noiseless | 110 (170) | 141 (141) | 281 (270) | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 887 (1527) | 1392 (1535) | 3930 (3974) | 1.2e4 (2e4) | ∞ | ∞ | ∞5e5 | 0/15 |
| FULLNEWUOA ros noiseless | 3.6 (2) | 6.2 (2) | 8.7 (2) | 10 (3) | 13 (3) | 13 (3) | 17 (3) | 12/15 |
| G3PCX posik noiseless | 22 (16) | 27 (18) | 36 (27) | 41 (18) | 49 (25) | 51 (11) | 64 (21) | 15/15 |
| GA nicolau noiseless | 2375 (1807) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| GLOBAL pal noiseless | 1.9 (0.7) | 1.6 (0.4) | 1.8 (1) | 1.9 (1) | 2.0 (0.5) | 1.7 (0.9) | 1.7 (1) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 7.4 (1) | 5.6 (0.8) | 5.1 (0.6) | 5.0 (0.5) | 5.0 (0.3) | 4.0 (0.2) | 3.9 (0.2) | 15/15 |
| LSfminbnd posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| LSstep posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 9.0 (4) | 9.3 (4) | 8.6 (4) | 8.6 (3) | 8.8 (2) | 6.9 (2) | 6.9 (2) | 15/15 |
| MCS huyer noiseless | 277 (224) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 1.2 (0.5) | 1.3 (0.4) | 1.2 (0.5) | 1.2 (0.4) | 1.2 (0.4) | 1.0 (0.2) | 1.00 (0.3) | 15/15 |
| NELDER hansen noiseless | 1.4 (0.4) | 1.3 (0.6) | 1.4 (0.5) | 1.4 (0.6) | 1.5 (0.8) | 1.2 (0.6) | 1.2 (0.3) | 15/15 |
| NEWUOA ros noiseless | 3.1 (3) | 5.5 (7) | 8.1 (5) | 11 (8) | 14 (7) | 16 (6) | 21 (6) | 15/15 |
| ONEFIFTH auger noiseless | 699 (979) | 2505 (710) | 4463 (1189) | 5853 (1264) | 1.4e4 (2e4) | ∞ | ∞5e6 | 0/15 |
| POEMS kubalik noiseless | 792 (894) | 2483 (1057) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| PSO Bounds el-abd noiseless | 3786 (4412) | 1.5e4 (9500) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| PSO el-abd noiseless | 1741 (2888) | 3259 (2061) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 24 (60) | 44 (82) | 40 (109) | 38 (47) | 37 (40) | 29 (31) | 37 (17) | 10/15 |
| VNS garcia-martinez noiseless | 4.5 (1) | 3.5 (0.8) | 3.4 (0.9) | 3.4 (0.5) | 3.5 (0.3) | 2.8 (0.3) | 2.8 (1) | 15/15 |
| iAMALGAM bosman noiseless | 1.8 (0.6) | 1.6 (0.8) | 1.7 (0.7) | 1.9 (0.7) | 2.0 (0.5) | 1.8 (0.4) | 2.0 (0.4) | 15/15 |
| Δ fopt f11, 5-D |
1e1 143 |
1e0 202 |
1e-1 763 |
1e-2 977 |
1e-3 1177 |
1e-5 1467 |
1e-7 1673 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 54 (22) | 339 (270) | 299 (172) | 536 (169) | 806 (551) | 1807 (667) | 2.2e4 (2e4) | 0/15 |
| AMALGAM bosman noiseless | 2.1 (0.8) | 2.7 (0.7) | 1.00 (0.4) | 1.00 (0.3) | 1.00 (0.4) | 1.0 (0.2) | 1.1 (0.3) | 15/15 |
| BAYEDA gallagher noiseless | 158 (190) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| BFGS ros noiseless | 1.00 (0.2)★ | 1.00 (0.4)★ | 1.1 (1) | 1.9 (3) | 8.2 (16) | 199 (160) | ∞4e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 8.3 (2) | 7.1 (2) | 2.2 (0.4) | 1.8 (0.3) | 1.6 (0.2) | 1.4 (0.1) | 1.3 (0.2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 6.5 (1) | 6.6 (1) | 2.1 (0.2) | 1.8 (0.2) | 1.5 (0.2) | 1.3 (0.1) | 1.2 (0.1) | 15/15 |
| Cauchy-EDA posik noiseless | 18 (6) | 17 (4) | 6.0 (1) | 5.5 (1) | 5.3 (0.9) | 5.6 (1) | 5.9 (0.8) | 15/15 |
| DASA korosec noiseless | 1921 (1136) | 5198 (4316) | 2339 (1211) | 2814 (3375) | 3217 (2199) | 9681 (2e4) | 4.5e4 (6e4) | 0/15 |
| DE-PSO garcia-nieto noiseless | 137 (109) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| DIRECT posik noiseless | 87 (92) | 2226 (1362) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 106 (68) | 645 (1124) | 973 (875) | 2424 (3946) | 6217 (5841) | ∞ | ∞5e5 | 0/15 |
| FULLNEWUOA ros noiseless | 11 (4) | 14 (7) | 5.4 (1) | 4.9 (0.7) | 5.3 (2) | 5.9 (1) | 6.5 (0.8) | 13/15 |
| G3PCX posik noiseless | 55 (93) | 110 (48) | 45 (33) | 44 (9) | 49 (11) | 56 (13) | 61 (19) | 14/15 |
| GA nicolau noiseless | 338 (19) | 7124 (1e4) | 9351 (5758) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| GLOBAL pal noiseless | 3.9 (2) | 5.4 (3) | 3.5 (4) | 5.1 (8) | 5.0 (7) | 5.0 (11) | 8.5 (4) | 8/15 |
| IPOP-SEP-CMA-ES ros noiseless | 16 (6) | 14 (1) | 4.2 (0.4) | 3.4 (0.3) | 2.9 (0.2) | 2.5 (0.1) | 2.2 (0.1) | 15/15 |
| LSfminbnd posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| LSstep posik noiseless | 4896 (5508) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 15 (9) | 19 (7) | 6.7 (2) | 5.6 (1) | 4.9 (0.9) | 4.2 (1) | 3.8 (1) | 15/15 |
| MCS huyer noiseless | 82 (81) | 461 (258) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 4.5 (4) | 4.7 (2) | 1.5 (0.9) | 1.4 (0.5) | 1.2 (0.2) | 1.1 (0.4) | 1.2 (0.3) | 15/15 |
| NELDER hansen noiseless | 3.2 (3) | 5.0 (2) | 1.7 (0.3) | 1.6 (0.8) | 1.5 (0.5) | 1.5 (0.6) | 1.6 (0.2) | 15/15 |
| NEWUOA ros noiseless | 3.5 (2) | 4.7 (2) | 1.8 (0.6) | 1.7 (0.2) | 1.8 (0.4) | 2.0 (0.4) | 2.2 (0.4) | 15/15 |
| ONEFIFTH auger noiseless | 6381 (2258) | 9277 (1429) | 3729 (392) | 3788 (696) | 6671 (3217) | ∞ | ∞5e6 | 0/15 |
| POEMS kubalik noiseless | 227 (418) | 508 (306) | 267 (111) | 349 (153) | 627 (1187) | 936 (1448) | 2184 (2167) | 2/15 |
| PSO Bounds el-abd noiseless | 428 (315) | 1441 (1124) | 1008 (1908) | 1009 (1967) | 1076 (1159) | 1521 (1870) | 1371 (1204) | 3/15 |
| PSO el-abd noiseless | 91 (134) | 235 (171) | 123 (52) | 140 (57) | 164 (74) | 243 (50) | 391 (172) | 8/15 |
| RANDOMSEARCH auger noiseless | 725 (588) | 1.1e5 (7e4) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 117 (176) | 88 (109) | 26 (45) | 21 (48) | 18 (22) | 14 (10) | 13 (5) | 12/15 |
| VNS garcia-martinez noiseless | 11 (2) | 8.7 (2) | 2.5 (0.4) | 2.1 (0.3) | 1.8 (0.3) | 1.6 (0.4) | 1.5 (0.2) | 15/15 |
| iAMALGAM bosman noiseless | 3.4 (1.0) | 3.8 (2) | 1.2 (0.4) | 1.1 (0.3) | 1.0 (0.4) | 1.00 (0.3) | 1.00 (0.1) | 15/15 |
| Δ fopt f12, 5-D |
1e1 108 |
1e0 268 |
1e-1 371 |
1e-2 413 |
1e-3 461 |
1e-5 1303 |
1e-7 1494 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 127 (5) | 167 (171) | 538 (264) | 1439 (1337) | 4216 (2249) | 2.7e4 (2e4) | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 10 (1) | 6.7 (3) | 8.6 (8) | 10 (7) | 11 (4) | 5.1 (5) | 5.2 (2) | 15/15 |
| BAYEDA gallagher noiseless | 96 (163) | 258 (121) | 390 (667) | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| BFGS ros noiseless | 1.1 (0.9) | 1.00 (0.6) | 1.00 (0.6) | 1 (0.4) | 1.0 (0.7) | 2.0 (3) | 49 (92) | 5/15 |
| BIPOP-CMA-ES hansen noiseless | 11 (10) | 7.4 (8) | 7.4 (3) | 7.5 (3) | 7.7 (3) | 3.3 (2) | 3.3 (2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 4.0 (4) | 2.9 (2) | 3.5 (2) | 3.9 (2) | 4.1 (3) | 1.9 (1) | 1.9 (1) | 15/15 |
| Cauchy-EDA posik noiseless | 79 (17) | 41 (15) | 35 (14) | 37 (15) | 38 (12) | 17 (4) | 17 (5) | 15/15 |
| DASA korosec noiseless | 1.2e4 (2e4) | 5.4e4 (6e4) | 5.9e4 (6e4) | 1.8e5 (6e4) | ∞ | ∞ | ∞5e6 | 0/15 |
| DE-PSO garcia-nieto noiseless | 55 (46) | 47 (25) | 120 (108) | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| DIRECT posik noiseless | 8.5 (0.6) | 8.7 (6) | 19 (17) | 39 (14) | 108 (62) | 377 (403) | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 1077 (61) | 2970 (3736) | 8919 (9097) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| FULLNEWUOA ros noiseless | 3.7 (8) | 2.6 (4) | 2.7 (5) | 3.0 (4) | 3.3 (4) | 1.6 (2) | 1.7 (2) | 15/15 |
| G3PCX posik noiseless | 14 (13) | 11 (8) | 13 (7) | 13 (4) | 12 (4) | 5.2 (2) | 5.1 (3) | 15/15 |
| GA nicolau noiseless | 933 (1242) | 2447 (3315) | 1.9e4 (1e4) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| GLOBAL pal noiseless | 4.6 (1) | 2.7 (4) | 2.4 (0.7) | 3.0 (1) | 5.0 (5) | 3.1 (4) | 3.4 (3) | 6/15 |
| IPOP-SEP-CMA-ES ros noiseless | 12 (13) | 11 (5) | 9.1 (4) | 8.7 (5) | 8.6 (4) | 3.5 (2) | 3.3 (0.6) | 15/15 |
| LSfminbnd posik noiseless | 311 (1158) | 1214 (1399) | 1888 (2123) | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| LSstep posik noiseless | 463 (407) | 1236 (1773) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 11 (4) | 13 (12) | 16 (9) | 15 (5) | 16 (7) | 6.7 (4) | 6.5 (2) | 15/15 |
| MCS huyer noiseless | 1.0 (0.2) | 18 (28) | 17 (37) | 15 (24) | 22 (32) | 26 (29) | 56 (68) | 6/15 |
| NELDERDOERR doerr noiseless | 4.4 (4) | 2.9 (4) | 2.7 (1) | 2.7 (2) | 2.7 (3) | 1.1 (1) | 1.2 (0.6) | 15/15 |
| NELDER hansen noiseless | 2.3 (1) | 2.2 (2) | 2.2 (2) | 2.2 (2) | 2.3 (2) | 1.00 (0.8) | 1.00 (0.8) | 15/15 |
| NEWUOA ros noiseless | 3.5 (6) | 2.6 (3) | 2.5 (2) | 2.5 (3) | 2.6 (3) | 1.1 (0.9) | 1.1 (0.5) | 15/15 |
| ONEFIFTH auger noiseless | 2.1e4 (4e4) | 6.1e4 (5e4) | 1.9e5 (2e5) | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| POEMS kubalik noiseless | 1903 (2326) | 2910 (2339) | 8850 (1e4) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| PSO Bounds el-abd noiseless | 1870 (3479) | 2455 (3204) | 5487 (6077) | 1.7e4 (3e4) | ∞ | ∞ | ∞5e5 | 0/15 |
| PSO el-abd noiseless | 748 (2318) | 3747 (7463) | 5406 (6065) | 7886 (8475) | 1.5e4 (7592) | ∞ | ∞5e5 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 99 (124) | 63 (154) | 91 (99) | 103 (424) | 95 (176) | 42 (45) | 48 (105) | 6/15 |
| VNS garcia-martinez noiseless | 19 (15) | 12 (7) | 10 (8) | 10 (9) | 9.4 (8) | 3.8 (3) | 3.6 (2) | 15/15 |
| iAMALGAM bosman noiseless | 6.9 (5) | 4.3 (2) | 4.0 (1) | 4.3 (2) | 4.7 (2) | 2.1 (0.3) | 2.3 (0.9) | 15/15 |
| Δ fopt f13, 5-D |
1e1 132 |
1e0 195 |
1e-1 250 |
1e-2 319 |
1e-3 1310 |
1e-5 1752 |
1e-7 2255 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 50 (10) | 83 (27) | 281 (175) | 442 (328) | 566 (862) | 3899 (3595) | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 4.2 (2) | 4.6 (1) | 4.9 (0.8) | 4.9 (1) | 1.5 (0.3) | 1.4 (0.2) | 1.4 (0.2) | 15/15 |
| BAYEDA gallagher noiseless | 174 (137) | 353 (423) | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| BFGS ros noiseless | 1.0 (0.2) | 1.00 (0.1) | 1.00 (0.0)★ | 1.0 (0.1)★ | 4.8 (6) | 136 (158) | ∞5e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 3.9 (3) | 5.4 (4) | 5.9 (2) | 5.4 (2) | 1.6 (0.3) | 1.5 (0.1) | 1.7 (0.5) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 4.5 (4) | 6.3 (4) | 6.1 (3) | 6.3 (6) | 1.9 (0.8) | 3.2 (4) | 3.1 (3) | 15/15 |
| Cauchy-EDA posik noiseless | 21 (4) | 24 (4) | 25 (3) | 25 (5) | 7.4 (0.9) | 7.3 (0.7) | 7.3 (1) | 15/15 |
| DASA korosec noiseless | 201 (316) | 643 (290) | 2452 (1630) | 7825 (9348) | 5038 (9467) | ∞ | ∞5e6 | 0/15 |
| DE-PSO garcia-nieto noiseless | 11 (5) | 348 (167) | 276 (462) | 236 (244) | ∞ | ∞ | ∞1e4 | 0/15 |
| DIRECT posik noiseless | 7.0 (3) | 21 (14) | 34 (15) | 144 (176) | 42 (48) | 119 (114) | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 150 (31) | 389 (665) | 1985 (1510) | 1.0e4 (1e4) | ∞ | ∞ | ∞5e5 | 0/15 |
| FULLNEWUOA ros noiseless | 1.9 (2) | 6.7 (6) | 23 (24) | 85 (66) | 97 (176) | ∞ | ∞5e4 | 0/15 |
| G3PCX posik noiseless | 14 (17) | 60 (70) | 151 (274) | 341 (246) | 124 (178) | 592 (435) | ∞2e5 | 0/15 |
| GA nicolau noiseless | 243 (43) | 726 (677) | 4390 (8547) | 2.3e4 (2e4) | ∞ | ∞ | ∞5e5 | 0/15 |
| GLOBAL pal noiseless | 4.2 (3) | 6.1 (5) | 11 (8) | ∞ | ∞ | ∞ | ∞1262 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 9.1 (8) | 11 (4) | 12 (0.5) | 11 (0.5) | 2.8 (0.1) | 2.5 (0.3) | 2.3 (0.2) | 15/15 |
| LSfminbnd posik noiseless | 33 (28) | 148 (169) | 543 (395) | 1095 (880) | ∞ | ∞ | ∞5e4 | 0/15 |
| LSstep posik noiseless | 547 (495) | 1120 (1586) | 2871 (2050) | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 8.3 (7) | 21 (12) | 24 (9) | 20 (12) | 5.1 (3) | 5.3 (3) | 4.9 (2) | 15/15 |
| MCS huyer noiseless | 41 (45) | 214 (224) | 462 (450) | 2259 (1254) | 550 (506) | ∞ | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 2.4 (2) | 2.4 (3) | 5.2 (9) | 6.1 (6) | 1.9 (2) | 3.9 (6) | 5.0 (7) | 15/15 |
| NELDER hansen noiseless | 2.0 (3) | 3.8 (3) | 5.3 (7) | 5.0 (1) | 1.3 (0.9) | 1.2 (0.8) | 1.3 (0.4) | 15/15 |
| NEWUOA ros noiseless | 3.2 (2) | 9.3 (13) | 35 (32) | 55 (86) | 54 (23) | 335 (692) | ∞4e4 | 0/15 |
| ONEFIFTH auger noiseless | 20 (22) | 30 (34) | 110 (97) | 246 (252) | 156 (181) | 1518 (2629) | 7247 (6652) | 1/15 |
| POEMS kubalik noiseless | 88 (17) | 657 (648) | 5642 (7013) | 1.0e4 (1e4) | ∞ | ∞ | ∞5e5 | 0/15 |
| PSO Bounds el-abd noiseless | 348 (89) | 2372 (6420) | 5653 (8007) | 1.0e4 (4277) | 5434 (3340) | ∞ | ∞5e5 | 0/15 |
| PSO el-abd noiseless | 1582 (3362) | 1.0e4 (8333) | 2.8e4 (4e4) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 7.6 (4) | 13 (10) | 26 (22) | 49 (76) | 40 (52) | 63 (88) | 290 (334) | 1/15 |
| VNS garcia-martinez noiseless | 4.8 (3) | 5.6 (3) | 6.6 (3) | 6.2 (1) | 1.9 (0.4) | 1.9 (0.3) | 2.1 (0.3) | 15/15 |
| iAMALGAM bosman noiseless | 2.6 (0.5) | 2.9 (0.1) | 3.2 (0.2) | 3.3 (0.5) | 1.0 (0.2) | 1.00 (0.2) | 1.00 (0.2) | 15/15 |
| Δ fopt f14, 5-D |
1e1 10 |
1e0 41 |
1e-1 58 |
1e-2 90 |
1e-3 139 |
1e-5 251 |
1e-7 476 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 2.4 (2) | 31 (15) | 66 (13) | 72 (12) | 75 (15) | 396 (324) | 1.0e4 (2e4) | 2/15 |
| AMALGAM bosman noiseless | 2.0 (2) | 4.5 (1) | 6.1 (2) | 6.6 (2) | 5.8 (1) | 5.2 (2) | 3.8 (1) | 15/15 |
| BAYEDA gallagher noiseless | 2.9 (5) | 104 (134) | 223 (433) | 250 (278) | 1036 (1637) | ∞ | ∞1e4 | 0/15 |
| BFGS ros noiseless | 2.2 (1) | 1.7 (1) | 1.8 (1) | 1.5 (0.8) | 1.3 (0.4) | 1.0 (0.3) | 350 (362) | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.1 (0.9) | 2.8 (1) | 3.7 (0.5) | 4.0 (0.9) | 4.5 (1) | 5.4 (0.9) | 4.5 (0.3) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 1.7 (1) | 1.9 (0.9) | 2.3 (0.4) | 2.3 (0.4) | 2.6 (0.8) | 4.0 (0.8) | 3.2 (0.4) | 15/15 |
| Cauchy-EDA posik noiseless | 23 (9) | 29 (14) | 40 (17) | 39 (12) | 33 (7) | 28 (4) | 19 (2) | 15/15 |
| DASA korosec noiseless | 19 (16) | 18 (9) | 20 (5) | 21 (3) | 48 (35) | 3482 (2216) | ∞5e6 | 0/15 |
| DE-PSO garcia-nieto noiseless | 2.6 (2) | 6.8 (0.6) | 9.0 (3) | 11 (1) | 17 (3) | ∞ | ∞1e4 | 0/15 |
| DIRECT posik noiseless | 0.98 (1) | 3.7 (3) | 4.8 (2) | 7.3 (2) | 23 (25) | 1895 (2891) | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 1.4 (2) | 7.1 (4) | 96 (46) | 192 (40) | 210 (23) | 296 (176) | ∞5e5 | 0/15 |
| FULLNEWUOA ros noiseless | 2.7 (0.9) | 1.1 (0.2) | 1.1 (0.2) | 1.00 (0.3) | 1.00 (0.2) | 3.2 (0.7) | 26 (3) | 0/15 |
| G3PCX posik noiseless | 1.6 (4) | 3.5 (0.7) | 3.5 (0.5) | 3.6 (1) | 5.0 (0.9) | 26 (14) | 388 (476) | 3/15 |
| GA nicolau noiseless | 2.1 (3) | 90 (58) | 267 (63) | 305 (40) | 349 (75) | ∞ | ∞5e5 | 0/15 |
| GLOBAL pal noiseless | 2.1 (2) | 7.7 (0.4) | 5.9 (0.1) | 4.4 (0.6) | 3.3 (0.4) | 3.6 (3) | ∞1302 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.6 (2) | 3.0 (2) | 3.6 (1) | 3.6 (1) | 5.3 (3) | 10 (0.8) | 6.4 (0.5) | 15/15 |
| LSfminbnd posik noiseless | 5.7 (7) | 4.5 (3) | 4.3 (2) | 7.4 (4) | 70 (40) | ∞ | ∞5e4 | 0/15 |
| LSstep posik noiseless | 115 (140) | 96 (68) | 97 (41) | 179 (103) | ∞ | ∞ | ∞5e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 2.0 (2) | 7.2 (5) | 11 (6) | 11 (6) | 11 (4) | 16 (7) | 12 (5) | 15/15 |
| MCS huyer noiseless | 1.4 (1) | 2.8 (3) | 2.7 (1) | 2.5 (0.2) | 2.8 (0.9) | 225 (320) | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 1.0 (0.5) | 1.1 (0.4) | 1.4 (0.6) | 1.6 (0.5) | 1.7 (0.5) | 1.6 (0.6) | 1.3 (0.1) | 15/15 |
| NELDER hansen noiseless | 1.1 (0.8) | 1.1 (0.3) | 1.5 (0.6) | 1.5 (0.4) | 1.4 (0.2) | 1.3 (0.3) | 1.00 (0.2)★ | 15/15 |
| NEWUOA ros noiseless | 1.6 (0.6) | 1.00 (0.2) | 1.0 (0.3) | 1 (0.2) | 1.2 (0.2) | 5.5 (0.8) | 2523 (2328) | 0/15 |
| ONEFIFTH auger noiseless | 2.0 (1) | 1.8 (0.7) | 2.1 (0.7) | 2.2 (0.5) | 5.5 (2) | 1120 (171) | ∞5e6 | 0/15 |
| POEMS kubalik noiseless | 106 (24) | 42 (14) | 81 (40) | 131 (27) | 138 (20) | 632 (253) | ∞5e5 | 0/15 |
| PSO Bounds el-abd noiseless | 1.9 (3) | 12 (6) | 45 (19) | 74 (23) | 138 (85) | 409 (276) | ∞5e5 | 0/15 |
| PSO el-abd noiseless | 1.8 (2) | 5.6 (3) | 15 (4) | 21 (6) | 29 (10) | 219 (70) | ∞5e5 | 0/15 |
| RANDOMSEARCH auger noiseless | 1.2 (2) | 100 (60) | 7.6e4 (9e4) | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 2.3 (2) | 1.2 (0.5) | 1.3 (0.4) | 1.5 (0.6) | 4.5 (8) | 26 (63) | 43 (33) | 10/15 |
| VNS garcia-martinez noiseless | 3.3 (3) | 5.5 (1) | 5.4 (0.7) | 5.3 (1) | 5.3 (1) | 7.0 (0.9) | 5.5 (0.6) | 15/15 |
| iAMALGAM bosman noiseless | 1.3 (2) | 2.7 (1.0) | 4.3 (2) | 4.5 (1) | 4.1 (0.7) | 3.6 (0.9) | 2.7 (0.5) | 15/15 |
| Δ fopt f15, 5-D |
1e1 511 |
1e0 9310 |
1e-1 19369 |
1e-2 19743 |
1e-3 20073 |
1e-5 20769 |
1e-7 21359 |
#succ 14/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 9.2 (3) | 9.0 (8) | 26 (17) | 26 (24) | 26 (21) | 25 (28) | 25 (15) | 15/15 |
| AMALGAM bosman noiseless | 1.7 (0.6) | 2.6 (0.5) | 5.3 (15) | 5.2 (3) | 5.2 (14) | 5.1 (2) | 5.0 (2) | 15/15 |
| BAYEDA gallagher noiseless | 4.8 (3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| BFGS ros noiseless | 87 (60) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.6 (0.4) | 1.5 (1) | 1.2 (0.5) | 1.2 (0.5) | 1.2 (0.6) | 1.2 (0.5) | 1.2 (0.7) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 10 (11) | 80 (40) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| Cauchy-EDA posik noiseless | 12 (11) | 186 (147) | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| DASA korosec noiseless | 231 (222) | 1734 (2108) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| DE-PSO garcia-nieto noiseless | 7.9 (5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| DIRECT posik noiseless | 5.4 (4) | 9.4 (17) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 20 (6) | 7.5 (27) | 24 (45) | 23 (19) | 23 (50) | 24 (18) | 24 (29) | 8/15 |
| FULLNEWUOA ros noiseless | 6.3 (7) | 55 (70) | ∞ | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| G3PCX posik noiseless | 126 (563) | 373 (326) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| GA nicolau noiseless | 35 (5) | 91 (81) | 367 (758) | 361 (470) | 355 (188) | 345 (266) | ∞5e5 | 0/15 |
| GLOBAL pal noiseless | 6.0 (4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2659 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.6 (1) | 1.0 (0.5) | 1.00 (0.5) | 1 (0.9) | 1.00 (0.6) | 1.0 (2) | 1.00 (0.3) | 14/15 |
| LSfminbnd posik noiseless | 35 (37) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| LSstep posik noiseless | 1380 (1810) | 80 (81) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 2.6 (2) | 5.3 (5) | 6.0 (8) | 5.9 (19) | 5.8 (4) | 5.6 (8) | 5.5 (6) | 10/15 |
| MCS huyer noiseless | 4.0 (4) | 25 (18) | 38 (22) | 38 (65) | 37 (33) | 36 (39) | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 4.5 (1) | 20 (10) | 73 (68) | 72 (40) | 71 (124) | 69 (175) | 67 (102) | 1/15 |
| NELDER hansen noiseless | 20 (15) | 43 (65) | 83 (134) | 81 (59) | 80 (81) | 77 (113) | 75 (74) | 4/15 |
| NEWUOA ros noiseless | 5.8 (5) | 41 (21) | ∞ | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| ONEFIFTH auger noiseless | 28 (54) | 103 (87) | 246 (237) | 241 (268) | 237 (235) | 229 (221) | 223 (302) | 10/15 |
| POEMS kubalik noiseless | 15 (7) | 130 (54) | 375 (458) | 368 (329) | 362 (691) | 350 (247) | 341 (439) | 1/15 |
| PSO Bounds el-abd noiseless | 171 (494) | 119 (147) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| PSO el-abd noiseless | 16 (6) | 221 (214) | 366 (368) | 359 (310) | 353 (685) | 342 (349) | 333 (135) | 1/15 |
| RANDOMSEARCH auger noiseless | 6853 (6569) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 311 (294) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| VNS garcia-martinez noiseless | 2.4 (3) | 5.9 (5) | 684 (1588) | 689 (851) | 684 (1703) | 678 (1941) | 667 (329) | 14/15 |
| iAMALGAM bosman noiseless | 1.00 (0.5) | 7.0 (8) | 9.2 (5) | 9.1 (5) | 9.0 (5) | 8.8 (8) | 8.6 (6) | 15/15 |
| Δ fopt f16, 5-D |
1e1 120 |
1e0 612 |
1e-1 2662 |
1e-2 10163 |
1e-3 10449 |
1e-5 11644 |
1e-7 12095 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 2.6 (2) | 8.6 (5) | 6.3 (2) | 6.7 (7) | 13 (9) | 157 (106) | 826 (798) | 2/15 |
| AMALGAM bosman noiseless | 3.1 (3) | 15 (10) | 12 (13) | 5.0 (7) | 4.9 (12) | 5.5 (3) | 5.4 (10) | 15/15 |
| BAYEDA gallagher noiseless | 5.7 (5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| BFGS ros noiseless | 153 (123) | 960 (1733) | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 3.0 (3) | 3.6 (2) | 2.6 (1) | 1.1 (1) | 1.3 (0.9) | 1.4 (2) | 1.4 (2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 2.6 (5) | 10 (16) | 17 (18) | 21 (45) | 31 (33) | 60 (103) | ∞5e4 | 0/15 |
| Cauchy-EDA posik noiseless | 5.6 (9) | 1193 (2546) | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| DASA korosec noiseless | 4.8 (10) | 308 (226) | 976 (1605) | 1236 (2448) | ∞ | ∞ | ∞5e6 | 0/15 |
| DE-PSO garcia-nieto noiseless | 11 (12) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| DIRECT posik noiseless | 1.2 (0.4) | 1.6 (0.6) | 3.4 (3) | 2.1 (2) | 5.9 (6) | 19 (17) | 40 (70) | 1/5 |
| EDA-PSO el-abd noiseless | 4.6 (4) | 206 (70) | 82 (148) | 38 (58) | 53 (46) | 61 (80) | 61 (46) | 7/15 |
| FULLNEWUOA ros noiseless | 2.7 (2) | 12 (11) | 29 (34) | 32 (28) | ∞ | ∞ | ∞5e4 | 0/15 |
| G3PCX posik noiseless | 1.0 (0.3) | 22 (26) | 44 (44) | 32 (26) | 347 (425) | ∞ | ∞3e5 | 0/15 |
| GA nicolau noiseless | 2.1 (0.9) | 84 (83) | 93 (189) | 71 (124) | 148 (231) | 621 (809) | 605 (882) | 0/15 |
| GLOBAL pal noiseless | 1.4 (1) | 1.0 (0.3) | 1.0 (2) | 1.3 (1) | 3.5 (6) | 6.8 (10) | 6.6 (8) | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.1 (2) | 5.0 (4) | 3.5 (2) | 1.00 (0.4) | 1.0 (0.9) | 1.00 (0.5) | 1.0 (0.6) | 15/15 |
| LSfminbnd posik noiseless | 3.2 (3) | 28 (60) | 133 (85) | 71 (121) | ∞ | ∞ | ∞5e4 | 0/15 |
| LSstep posik noiseless | 14 (18) | 276 (222) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 2.7 (2) | 8.2 (12) | 18 (6) | 11 (9) | 26 (20) | 50 (38) | 75 (58) | 2/15 |
| MCS huyer noiseless | 1.9 (2) | 18 (23) | 131 (89) | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 1.6 (2) | 4.8 (7) | 10 (4) | 6.3 (7) | 13 (8) | 59 (77) | 119 (89) | 0/15 |
| NELDER hansen noiseless | 4.4 (14) | 28 (45) | 23 (22) | 25 (24) | 95 (128) | 302 (685) | 597 (858) | 1/15 |
| NEWUOA ros noiseless | 2.1 (2) | 29 (30) | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| ONEFIFTH auger noiseless | 37 (123) | 88 (85) | 344 (336) | 591 (1121) | 2156 (2053) | ∞ | ∞5e6 | 0/15 |
| POEMS kubalik noiseless | 12 (2) | 74 (207) | 76 (96) | 58 (86) | 57 (84) | 52 (86) | 54 (114) | 7/15 |
| PSO Bounds el-abd noiseless | 2.4 (3) | 36 (25) | 140 (238) | 140 (332) | 317 (203) | ∞ | ∞5e5 | 0/15 |
| PSO el-abd noiseless | 2.4 (1) | 6.2 (9) | 59 (106) | 55 (41) | 89 (122) | 300 (236) | 580 (940) | 0/15 |
| RANDOMSEARCH auger noiseless | 3.6 (5) | 510 (498) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 40 (65) | 1191 (878) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| VNS garcia-martinez noiseless | 2.8 (2) | 12 (16) | 12 (7) | 9.1 (27) | 12 (9) | 34 (131) | 45 (14) | 15/15 |
| iAMALGAM bosman noiseless | 1.9 (2) | 8.6 (17) | 5.5 (6) | 4.4 (5) | 5.9 (6) | 6.4 (8) | 6.8 (7) | 15/15 |
| Δ fopt f17, 5-D |
1e1 5.0 |
1e0 215 |
1e-1 899 |
1e-2 2861 |
1e-3 3669 |
1e-5 6351 |
1e-7 7934 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 2.5 (2) | 12 (5) | 8.0 (1.0) | 4.8 (0.5) | 7.1 (5) | 21 (15) | 68 (97) | 8/15 |
| AMALGAM bosman noiseless | 4.0 (2) | 1.5 (0.4) | 2.7 (0.2) | 2.6 (7) | 2.7 (4) | 3.4 (3) | 3.5 (1.0) | 15/15 |
| BAYEDA gallagher noiseless | 2.3 (4) | 6.7 (1) | 5.4 (4) | 4.1 (4) | 7.5 (7) | ∞ | ∞1e4 | 0/15 |
| BFGS ros noiseless | 125 (226) | 645 (446) | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 3.5 (4) | 1.00 (0.2) | 1.0 (0.1) | 1.00 (1.0) | 1.00 (0.8) | 1.00 (0.4) | 1.2 (0.3) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 4.7 (4) | 27 (60) | 108 (202) | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| Cauchy-EDA posik noiseless | 46 (89) | 13 (5) | 7.0 (2) | 3.8 (0.6) | 4.3 (0.8) | 5.3 (2) | 13 (28) | 14/15 |
| DASA korosec noiseless | 175 (62) | 383 (1174) | 730 (690) | 1844 (2507) | 1.9e4 (3e4) | ∞ | ∞5e6 | 0/15 |
| DE-PSO garcia-nieto noiseless | 7.9 (17) | 3.5 (1) | 2.8 (1) | 3.1 (3) | 4.5 (9) | 12 (13) | ∞1e4 | 0/15 |
| DIRECT posik noiseless | 1.0 (1) | 1.4 (0.8) | 1.7 (0.5) | 2.7 (2) | 4.4 (5) | 9.5 (14) | 10 (3) | 1/5 |
| EDA-PSO el-abd noiseless | 2.5 (3) | 27 (13) | 28 (4) | 16 (0.8) | 18 (1) | 17 (0.7) | 19 (0.6) | 15/15 |
| FULLNEWUOA ros noiseless | 5.1 (4) | 25 (21) | 76 (109) | 253 (360) | ∞ | ∞ | ∞5e4 | 0/15 |
| G3PCX posik noiseless | 2.3 (1) | 128 (89) | 292 (147) | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| GA nicolau noiseless | 5.6 (6) | 46 (11) | 36 (3) | 52 (44) | 189 (249) | 550 (1107) | ∞5e5 | 0/15 |
| GLOBAL pal noiseless | 3.6 (2) | 5.0 (5) | ∞ | ∞ | ∞ | ∞ | ∞3140 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 4.0 (3) | 3.4 (0.1) | 1.3 (2) | 1.0 (1) | 1.0 (0.5) | 1.1 (0.8) | 1.00 (0.4) | 15/15 |
| LSfminbnd posik noiseless | 247 (363) | 64 (148) | 175 (188) | 256 (638) | ∞ | ∞ | ∞5e4 | 0/15 |
| LSstep posik noiseless | 157 (201) | 675 (786) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 3.9 (1) | 2.8 (0.7) | 3.1 (2) | 4.1 (10) | 9.3 (16) | 7.3 (10) | 11 (21) | 8/15 |
| MCS huyer noiseless | 2.0 (2) | 24 (17) | 63 (28) | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 2.0 (2) | 10 (6) | 48 (56) | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| NELDER hansen noiseless | 57 (102) | 170 (94) | 295 (373) | 2482 (2370) | ∞ | ∞ | ∞5e5 | 0/15 |
| NEWUOA ros noiseless | 2.4 (2) | 40 (99) | 618 (392) | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| ONEFIFTH auger noiseless | 1244 (9291) | 7933 (3e4) | 3.8e4 (5e4) | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| POEMS kubalik noiseless | 174 (112) | 15 (7) | 14 (3) | 21 (44) | 19 (0.3) | 29 (40) | 41 (32) | 10/15 |
| PSO Bounds el-abd noiseless | 3.5 (3) | 7.9 (3) | 52 (282) | 35 (91) | 51 (70) | 61 (79) | 122 (77) | 0/15 |
| PSO el-abd noiseless | 3.4 (2) | 169 (582) | 142 (279) | 156 (175) | 548 (477) | 514 (197) | 420 (476) | 1/15 |
| RANDOMSEARCH auger noiseless | 4.2 (6) | 837 (1053) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 2803 (3371) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| VNS garcia-martinez noiseless | 6.9 (4) | 1.6 (0.6) | 4.8 (14) | 4.8 (8) | 7.9 (14) | 18 (12) | 82 (99) | 15/15 |
| iAMALGAM bosman noiseless | 2.8 (2) | 1.1 (0.8) | 3.8 (10) | 2.9 (5) | 4.6 (5) | 6.3 (5) | 6.8 (4) | 15/15 |
| Δ fopt f18, 5-D |
1e1 103 |
1e0 378 |
1e-1 3968 |
1e-2 8451 |
1e-3 9280 |
1e-5 10905 |
1e-7 12469 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 8.2 (5) | 14 (5) | 3.3 (0.8) | 14 (15) | 49 (46) | 421 (529) | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 1.6 (1.0) | 1.7 (0.5) | 2.0 (3) | 1.5 (2) | 2.4 (2) | 3.4 (3) | 3.1 (3) | 15/15 |
| BAYEDA gallagher noiseless | 4.4 (3) | 10 (3) | 11 (15) | 8.7 (11) | ∞ | ∞ | ∞1e4 | 0/15 |
| BFGS ros noiseless | 57 (58) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.0 (0.5) | 3.4 (13) | 1.0 (1) | 1.0 (0.4) | 1.0 (0.3) | 1.2 (0.8) | 1.3 (0.6) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 4.9 (7) | 57 (61) | 84 (87) | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| Cauchy-EDA posik noiseless | 13 (9) | 12 (1) | 2.4 (0.4) | 2.1 (0.4) | 2.7 (0.9) | 3.7 (1.0) | 8.6 (13) | 14/15 |
| DASA korosec noiseless | 275 (114) | 933 (2048) | 1634 (1105) | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| DE-PSO garcia-nieto noiseless | 2.6 (2) | 5.5 (7) | 2.2 (2) | 4.1 (4) | ∞ | ∞ | ∞1e4 | 0/15 |
| DIRECT posik noiseless | 1.4 (0.6) | 2.9 (3) | 1.9 (2) | 6.2 (10) | 6.5 (5) | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 3.6 (5) | 41 (7) | 8.8 (1) | 6.4 (0.7) | 17 (15) | 41 (103) | 58 (21) | 7/15 |
| FULLNEWUOA ros noiseless | 10 (12) | 84 (73) | 90 (50) | 88 (90) | ∞ | ∞ | ∞5e4 | 0/15 |
| G3PCX posik noiseless | 136 (38) | 800 (503) | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| GA nicolau noiseless | 22 (19) | 59 (12) | 34 (35) | 134 (165) | ∞ | ∞ | ∞5e5 | 0/15 |
| GLOBAL pal noiseless | 3.9 (1.0) | 15 (8) | 14 (13) | ∞ | ∞ | ∞ | ∞2633 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.4 (1) | 5.0 (13) | 1.6 (1) | 1.0 (0.6) | 1.0 (0.4) | 1.00 (0.5) | 1.0 (0.3) | 15/15 |
| LSfminbnd posik noiseless | 64 (93) | 71 (44) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| LSstep posik noiseless | 148 (243) | 395 (361) | 86 (66) | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 2.5 (0.8) | 4.9 (1) | 1.3 (0.5) | 23 (30) | 88 (108) | 162 (218) | 143 (241) | 0/15 |
| MCS huyer noiseless | 19 (25) | 154 (274) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 4.3 (7) | 28 (27) | 43 (55) | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| NELDER hansen noiseless | 45 (106) | 228 (298) | 321 (139) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| NEWUOA ros noiseless | 32 (24) | 1350 (2068) | ∞ | ∞ | ∞ | ∞ | ∞9e4 | 0/15 |
| ONEFIFTH auger noiseless | 3091 (7225) | 3.1e4 (2e4) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| POEMS kubalik noiseless | 18 (8) | 24 (7) | 14 (1) | 71 (148) | 153 (148) | 304 (309) | 568 (852) | 1/15 |
| PSO Bounds el-abd noiseless | 3.8 (4) | 21 (6) | 69 (64) | 72 (90) | 118 (126) | ∞ | ∞5e5 | 0/15 |
| PSO el-abd noiseless | 2.3 (0.7) | 6.6 (4) | 113 (158) | 253 (219) | ∞ | ∞ | ∞5e5 | 0/15 |
| RANDOMSEARCH auger noiseless | 18 (29) | 9.4e4 (8e4) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 3391 (4499) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| VNS garcia-martinez noiseless | 2.3 (0.4) | 4.9 (0.2) | 3.6 (9) | 8.6 (16) | 26 (18) | 296 (291) | 1186 (1228) | 15/15 |
| iAMALGAM bosman noiseless | 1.1 (0.5) | 1.00 (0.2) | 1.4 (1) | 1.6 (1) | 1.9 (1) | 3.1 (4) | 4.8 (3) | 15/15 |
| Δ fopt f19, 5-D |
1e1 1 |
1e0 1 |
1e-1 242 |
1e-2 1.0e5 |
1e-3 1.2e5 |
1e-5 1.2e5 |
1e-7 1.2e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 58 (40) | 5112 (2978) | 502 (298) | 15 (9) | 39 (52) | 40 (27) | 40 (48) | 10/15 |
| AMALGAM bosman noiseless | 38 (18) | 1148 (916) | 364 (364) | 4.5 (3) | 4.2 (4) | 4.2 (5) | 4.2 (3) | 15/15 |
| BAYEDA gallagher noiseless | 37 (21) | 2088 (1384) | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| BFGS ros noiseless | 1655 (2253) | 2.2e4 (2e4) | 1781 (1937) | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 20 (13) | 2801 (970) | 161 (186) | 1.00 (0.8) | 1.00 (1) | 1.0 (1.0) | 1.00 (0.7) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 20 (15) | 4113 (3664) | 972 (1511) | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| Cauchy-EDA posik noiseless | 296 (170) | 2.1e4 (2e4) | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| DASA korosec noiseless | 288 (617) | 6.7e4 (6e4) | 4.7e4 (4e4) | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| DE-PSO garcia-nieto noiseless | 93 (38) | 3140 (1716) | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| DIRECT posik noiseless | 1 (0) | 1 (0) | 1.1 (0.7) | 4.2 (4) | 3.7 (4) | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 37 (28) | 6712 (3691) | 1636 (950) | 71 (39) | ∞ | ∞ | ∞5e5 | 0/15 |
| FULLNEWUOA ros noiseless | 31 (24) | 1.1e4 (2e4) | 866 (1048) | 6.9 (6) | ∞ | ∞ | ∞5e4 | 0/15 |
| G3PCX posik noiseless | 39 (28) | 9.5e4 (7e4) | 1.4e4 (2e4) | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| GA nicolau noiseless | 35 (24) | 1.2e4 (6796) | 700 (133) | 68 (43) | 60 (63) | ∞ | ∞5e5 | 0/15 |
| GLOBAL pal noiseless | 46 (43) | 7329 (3619) | ∞ | ∞ | ∞ | ∞ | ∞4311 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 22 (14) | 1931 (3896) | 162 (88) | 2.2 (2) | 3.0 (2) | 3.0 (5) | 3.0 (4) | 2/15 |
| LSfminbnd posik noiseless | 54 (90) | 2950 (3575) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| LSstep posik noiseless | 914 (790) | 9487 (1e4) | 1464 (2066) | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 32 (40) | 1274 (1130) | 249 (189) | 8.4 (7) | ∞ | ∞ | ∞1e5 | 0/15 |
| MCS huyer noiseless | 1 (0) | 1 (0) | 1.0 (0.3) | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 12 (8) | 340 (236) | 107 (154) | 14 (27) | ∞ | ∞ | ∞1e5 | 0/15 |
| NELDER hansen noiseless | 12 (5) | 2885 (1584) | 591 (534) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| NEWUOA ros noiseless | 14 (2) | 2.7e4 (9e4) | 1417 (2055) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| ONEFIFTH auger noiseless | 104 (326) | 4.1e5 (1e5) | 2.9e5 (5e5) | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| POEMS kubalik noiseless | 1019 (386) | 7180 (4870) | 1.4e4 (2e4) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| PSO Bounds el-abd noiseless | 27 (34) | 1.6e4 (9638) | 2511 (1815) | 70 (64) | ∞ | ∞ | ∞5e5 | 0/15 |
| PSO el-abd noiseless | 35 (33) | 3381 (4859) | 2450 (2779) | 67 (42) | 60 (62) | 61 (74) | 61 (66) | 0/15 |
| RANDOMSEARCH auger noiseless | 38 (39) | 1.4e5 (1e5) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 1.3e4 (4062) | 7.1e5 (7e5) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| VNS garcia-martinez noiseless | 55 (71) | 7619 (2e4) | 1310 (1961) | 20 (41) | 75 (74) | 134 (172) | 261 (143) | 12/15 |
| iAMALGAM bosman noiseless | 28 (16) | 1117 (448) | 373 (543) | 10 (11) | 12 (12) | 12 (12) | 12 (12) | 15/15 |
| Δ fopt f20, 5-D |
1e1 16 |
1e0 851 |
1e-1 38111 |
1e-2 51362 |
1e-3 54470 |
1e-5 54861 |
1e-7 55313 |
#succ 14/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 18 (15) | 7.0 (1) | 1.3 (2) | 1.0 (1) | 1.0 (0.5) | 1.1 (2) | 1.3 (0.5) | 15/15 |
| AMALGAM bosman noiseless | 3.9 (2) | 29 (32) | 24 (27) | 18 (21) | 17 (25) | 17 (25) | 17 (27) | 15/15 |
| BAYEDA gallagher noiseless | 8.0 (7) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| BFGS ros noiseless | 1.8 (1) | 2.5 (2) | 10 (5) | 7.6 (8) | 7.2 (14) | 7.1 (8) | 7.1 (5) | 1/15 |
| BIPOP-CMA-ES hansen noiseless | 3.3 (2) | 8.2 (9) | 2.8 (0.9) | 2.2 (0.4) | 2.1 (1.0) | 2.2 (1) | 2.2 (0.9) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 2.4 (1) | 6.4 (10) | 5.9 (8) | 4.4 (4) | 4.1 (3) | 4.1 (3) | 4.1 (9) | 3/15 |
| Cauchy-EDA posik noiseless | 48 (35) | 464 (683) | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| DASA korosec noiseless | 32 (18) | 13 (2) | 47 (36) | 35 (70) | 33 (32) | 33 (31) | 33 (15) | 14/15 |
| DE-PSO garcia-nieto noiseless | 8.6 (6) | 3.2 (1) | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| DIRECT posik noiseless | 3.8 (0.0) | 1.5 (3e-4) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 5.7 (3) | 13 (6) | 2.5 (0.1) | 2.0 (0.1) | 2.0 (2) | 2.3 (2) | 2.5 (0.1) | 13/15 |
| FULLNEWUOA ros noiseless | 1.4 (0) | 6.4 (3) | ∞ | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| G3PCX posik noiseless | 7.4 (3) | 36 (31) | 88 (83) | 66 (80) | 62 (63) | 61 (71) | 61 (42) | 1/15 |
| GA nicolau noiseless | 47 (31) | 21 (4) | 1.00 (0.1) | 1.0 (0.1) | 1.3 (0.3) | 2.6 (2) | 5.0 (5) | 11/15 |
| GLOBAL pal noiseless | 17 (4) | 18 (19) | ∞ | ∞ | ∞ | ∞ | ∞2276 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 3.3 (2) | 6.6 (7) | 2.3 (1) | 1.7 (0.8) | 1.7 (2) | 1.7 (3) | 1.7 (1) | 7/15 |
| LSfminbnd posik noiseless | 8.2 (6) | 18 (26) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| LSstep posik noiseless | 232 (119) | 41 (75) | 18 (23) | 14 (8) | 13 (8) | 13 (11) | 13 (8) | 1/15 |
| MA-LS-CHAIN molina noiseless | 5.8 (4) | 4.0 (6) | 1.4 (1) | 1.1 (0.8) | 1.0 (0.8) | 1.00 (0.4) | 1.0 (2) | 14/15 |
| MCS huyer noiseless | 2.7 (2) | 1.00 (2) | 9.1 (11) | 6.8 (5) | 6.4 (6) | 6.4 (5) | 6.3 (11) | 2/15 |
| NELDERDOERR doerr noiseless | 2.2 (2) | 8.5 (9) | 37 (24) | 28 (39) | 26 (50) | 26 (19) | 26 (26) | 1/15 |
| NELDER hansen noiseless | 1.5 (2) | 25 (26) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| NEWUOA ros noiseless | 1 (0.2) | 3.3 (4) | ∞ | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| ONEFIFTH auger noiseless | 4.0 (2) | 16 (13) | 43 (35) | 32 (36) | 30 (34) | 30 (42) | 30 (37) | 15/15 |
| POEMS kubalik noiseless | 78 (14) | 8.5 (4) | 14 (20) | 10 (7) | 10 (5) | 10 (18) | 10 (12) | 8/15 |
| PSO Bounds el-abd noiseless | 8.1 (4) | 8.6 (5) | 21 (23) | 16 (14) | 15 (21) | 15 (9) | 16 (16) | 6/15 |
| PSO el-abd noiseless | 8.7 (3) | 3.1 (0.9) | 27 (23) | 20 (29) | 19 (18) | 19 (18) | 18 (45) | 5/15 |
| RANDOMSEARCH auger noiseless | 29 (26) | 9230 (3791) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 2.9 (1.0) | 4.6 (6) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| VNS garcia-martinez noiseless | 10 (2) | 7.8 (7) | 4.3 (4) | 3.9 (8) | 4.3 (3) | 4.6 (10) | 5.7 (4) | 15/15 |
| iAMALGAM bosman noiseless | 3.2 (2) | 30 (31) | 25 (8) | 19 (15) | 18 (12) | 18 (10) | 18 (14) | 15/15 |
| Δ fopt f21, 5-D |
1e1 41 |
1e0 1157 |
1e-1 1674 |
1e-2 1692 |
1e-3 1705 |
1e-5 1729 |
1e-7 1757 |
#succ 14/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 3.4 (4) | 2.2 (1) | 2.9 (1) | 3.9 (1) | 4.7 (1.0) | 6.4 (2) | 8.1 (3) | 15/15 |
| AMALGAM bosman noiseless | 3.0 (3) | 37 (14) | 34 (51) | 35 (77) | 36 (100) | 38 (104) | 38 (43) | 15/15 |
| BAYEDA gallagher noiseless | 4.1 (4) | 8.5 (7) | 40 (39) | 85 (120) | 84 (48) | 83 (74) | 82 (77) | 1/15 |
| BFGS ros noiseless | 3.8 (3) | 1.4 (2) | 1.9 (3) | 1.9 (2) | 1.9 (2) | 1.9 (2) | 2.0 (3) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 2.3 (2) | 14 (7) | 24 (74) | 25 (63) | 25 (64) | 25 (4) | 25 (65) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 4.2 (0.6) | 4.6 (2) | 6.6 (7) | 6.6 (9) | 6.5 (9) | 6.5 (8) | 6.4 (8) | 15/15 |
| Cauchy-EDA posik noiseless | 20 (14) | 27 (16) | 192 (267) | 428 (771) | 424 (748) | 419 (740) | 413 (1081) | 4/15 |
| DASA korosec noiseless | 10 (2) | 214 (166) | 321 (170) | 318 (150) | 316 (351) | 312 (165) | 308 (185) | 15/15 |
| DE-PSO garcia-nieto noiseless | 4.2 (4) | 5.5 (9) | 4.2 (5) | 4.7 (7) | 5.0 (6) | 6.2 (3) | 6.7 (9) | 8/15 |
| DIRECT posik noiseless | 1 (0.5) | 1.00 (1) | 1.1 (2) | 1.8 (2) | 2.1 (2) | 19 (60) | 19 (17) | 4/5 |
| EDA-PSO el-abd noiseless | 4.0 (6) | 161 (217) | 113 (151) | 114 (149) | 116 (149) | 120 (144) | 124 (145) | 11/15 |
| FULLNEWUOA ros noiseless | 2.4 (7) | 2.3 (4) | 2.8 (2) | 2.8 (2) | 2.8 (5) | 2.7 (6) | 2.7 (4) | 15/15 |
| G3PCX posik noiseless | 2.1 (1) | 4.7 (4) | 6.8 (6) | 6.7 (6) | 6.7 (8) | 6.6 (6) | 6.6 (6) | 15/15 |
| GA nicolau noiseless | 4.6 (3) | 5.5 (4) | 61 (77) | 68 (14) | 70 (15) | 139 (437) | 291 (573) | 8/15 |
| GLOBAL pal noiseless | 2.3 (2) | 1.1 (0.7) | 1.0 (1) | 1.0 (0.9) | 1.0 (0.8) | 1.00 (1) | 1.00 (0.8) | 14/15 |
| IPOP-SEP-CMA-ES ros noiseless | 3.6 (10) | 14 (45) | 10 (32) | 10 (10) | 10 (19) | 10 (5) | 10 (9) | 13/15 |
| LSfminbnd posik noiseless | 30 (82) | 38 (50) | 39 (50) | 45 (18) | 44 (28) | 44 (37) | 44 (39) | 8/15 |
| LSstep posik noiseless | 564 (859) | 122 (172) | 123 (82) | 124 (236) | 125 (132) | 130 (180) | 134 (275) | 2/15 |
| MA-LS-CHAIN molina noiseless | 3.6 (3) | 22 (0.6) | 16 (21) | 16 (74) | 16 (37) | 16 (11) | 16 (28) | 13/15 |
| MCS huyer noiseless | 1.0 (0.8) | 3.9 (8) | 5.1 (10) | 5.1 (3) | 5.0 (10) | 5.0 (11) | 5.0 (3) | 14/15 |
| NELDERDOERR doerr noiseless | 2.9 (7) | 1.5 (1) | 1.2 (1) | 1.2 (1) | 1.2 (1) | 1.2 (0.8) | 1.2 (0.6) | 15/15 |
| NELDER hansen noiseless | 12 (28) | 8.4 (8) | 10 (14) | 10 (13) | 10 (18) | 10 (1) | 10 (17) | 15/15 |
| NEWUOA ros noiseless | 1.1 (0.5) | 2.2 (4) | 1.8 (2) | 1.8 (1) | 1.8 (2) | 1.8 (4) | 1.9 (3) | 15/15 |
| ONEFIFTH auger noiseless | 45 (159) | 19 (31) | 18 (22) | 18 (17) | 18 (20) | 18 (19) | 18 (14) | 15/15 |
| POEMS kubalik noiseless | 34 (8) | 325 (592) | 291 (558) | 288 (405) | 288 (953) | 286 (307) | 285 (427) | 8/15 |
| PSO Bounds el-abd noiseless | 3.5 (6) | 380 (542) | 343 (523) | 341 (222) | 339 (294) | 337 (652) | 335 (498) | 7/15 |
| PSO el-abd noiseless | 2.0 (2) | 379 (324) | 262 (224) | 260 (517) | 258 (367) | 255 (506) | 252 (285) | 8/15 |
| RANDOMSEARCH auger noiseless | 3.2 (3) | 8.5 (10) | 272 (348) | 1.4e4 (2e4) | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 10 (5) | 7.9 (10) | 15 (16) | 15 (13) | 15 (30) | 15 (22) | 15 (32) | 12/15 |
| VNS garcia-martinez noiseless | 2.4 (2) | 7.5 (7) | 6.5 (5) | 6.6 (14) | 6.9 (13) | 8.3 (20) | 9.1 (3) | 15/15 |
| iAMALGAM bosman noiseless | 2.2 (2) | 27 (61) | 22 (15) | 22 (14) | 22 (24) | 22 (23) | 22 (42) | 15/15 |
| Δ fopt f22, 5-D |
1e1 71 |
1e0 386 |
1e-1 938 |
1e-2 980 |
1e-3 1008 |
1e-5 1040 |
1e-7 1068 |
#succ 14/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 6.6 (5) | 9.3 (3) | 8.8 (4) | 13 (5) | 17 (14) | 24 (16) | 33 (11) | 15/15 |
| AMALGAM bosman noiseless | 3.0 (1) | 19 (41) | 59 (39) | 69 (128) | 69 (134) | 68 (126) | 67 (71) | 15/15 |
| BAYEDA gallagher noiseless | 13 (2) | 75 (78) | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| BFGS ros noiseless | 3.1 (3) | 2.9 (5) | 2.1 (2) | 2.1 (1) | 2.0 (2) | 2.0 (1) | 2.6 (3) | 14/15 |
| BIPOP-CMA-ES hansen noiseless | 6.9 (13) | 20 (99) | 45 (105) | 43 (69) | 42 (73) | 41 (90) | 40 (83) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 2.8 (4) | 7.1 (12) | 4.7 (6) | 4.6 (10) | 4.5 (7) | 4.4 (2) | 4.4 (7) | 15/15 |
| Cauchy-EDA posik noiseless | 11 (9) | 281 (549) | 775 (944) | 1662 (1724) | 3474 (4650) | 3368 (3065) | 3280 (4331) | 1/15 |
| DASA korosec noiseless | 96 (269) | 269 (101) | 129 (123) | 128 (118) | 130 (122) | 140 (101) | 152 (114) | 15/15 |
| DE-PSO garcia-nieto noiseless | 6.5 (4) | 6.3 (8) | 7.5 (10) | 10 (8) | 11 (21) | 16 (18) | 32 (33) | 3/15 |
| DIRECT posik noiseless | 1 (0.3) | 1.0 (0.5) | 12 (11) | 19 (8) | 22 (6) | 128 (111) | 400 (281) | 1/5 |
| EDA-PSO el-abd noiseless | 6.7 (12) | 12 (7) | 89 (267) | 90 (134) | 92 (251) | 98 (360) | 104 (235) | 13/15 |
| FULLNEWUOA ros noiseless | 4.3 (2) | 3.7 (8) | 3.0 (4) | 2.9 (4) | 2.9 (6) | 3.0 (6) | 3.1 (1) | 15/15 |
| G3PCX posik noiseless | 12 (12) | 15 (32) | 13 (13) | 12 (14) | 12 (13) | 12 (12) | 12 (12) | 15/15 |
| GA nicolau noiseless | 6.0 (7) | 18 (8) | 387 (817) | 648 (639) | 1489 (1699) | 6832 (8087) | ∞5e5 | 0/15 |
| GLOBAL pal noiseless | 3.6 (2) | 1.3 (0.7) | 1.00 (1.0) | 1 (1) | 1.0 (0.4) | 1.0 (0.3) | 1.00 (1) | 14/15 |
| IPOP-SEP-CMA-ES ros noiseless | 7.5 (8) | 23 (72) | 60 (64) | 58 (52) | 57 (72) | 56 (69) | 55 (98) | 8/15 |
| LSfminbnd posik noiseless | 13 (28) | 47 (117) | 29 (49) | 60 (94) | 62 (102) | 122 (188) | 220 (400) | 2/15 |
| LSstep posik noiseless | 191 (534) | 178 (308) | 380 (440) | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 3.3 (3) | 15 (48) | 22 (52) | 22 (42) | 22 (18) | 22 (50) | 22 (46) | 14/15 |
| MCS huyer noiseless | 1.0 (0.6) | 1.1 (0.9) | 12 (14) | 11 (7) | 11 (10) | 11 (13) | 15 (18) | 14/15 |
| NELDERDOERR doerr noiseless | 2.5 (1) | 2.5 (3) | 2.1 (2) | 2.0 (2) | 2.0 (1) | 2.0 (4) | 2.1 (3) | 15/15 |
| NELDER hansen noiseless | 19 (33) | 13 (19) | 13 (9) | 13 (4) | 13 (26) | 12 (8) | 12 (21) | 15/15 |
| NEWUOA ros noiseless | 2.1 (3) | 2.1 (2) | 2.0 (2) | 2.0 (2) | 2.1 (0.5) | 2.3 (0.9) | 2.4 (5) | 15/15 |
| ONEFIFTH auger noiseless | 21 (63) | 37 (25) | 30 (41) | 29 (37) | 29 (11) | 29 (27) | 30 (27) | 15/15 |
| POEMS kubalik noiseless | 468 (3343) | 1059 (1527) | 1302 (931) | 1248 (1276) | 1216 (1240) | 1183 (1260) | 1157 (730) | 5/15 |
| PSO Bounds el-abd noiseless | 506 (3) | 869 (1945) | 819 (1735) | 816 (1686) | 814 (1323) | 818 (1077) | 815 (937) | 6/15 |
| PSO el-abd noiseless | 2.6 (2) | 326 (324) | 469 (402) | 450 (512) | 439 (497) | 429 (484) | 422 (587) | 8/15 |
| RANDOMSEARCH auger noiseless | 7.6 (12) | 74 (73) | 393 (798) | 7512 (8306) | 7.1e4 (7e4) | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 19 (58) | 13 (14) | 10 (15) | 10 (13) | 10 (15) | 10 (10) | 11 (12) | 15/15 |
| VNS garcia-martinez noiseless | 5.8 (1.0) | 16 (18) | 18 (8) | 18 (17) | 18 (13) | 19 (19) | 20 (19) | 15/15 |
| iAMALGAM bosman noiseless | 1.8 (0.9) | 22 (30) | 40 (20) | 41 (161) | 41 (21) | 41 (30) | 40 (20) | 15/15 |
| Δ fopt f23, 5-D |
1e1 3.0 |
1e0 518 |
1e-1 14249 |
1e-2 27890 |
1e-3 31654 |
1e-5 33030 |
1e-7 34256 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 2.3 (3) | 21 (16) | 28 (41) | 110 (266) | 2320 (2922) | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 1.7 (2) | 7.0 (3) | 1.8 (3) | 1.00 (1) | 1.00 (0.9) | 1.0 (1) | 1 (0.8) | 15/15 |
| BAYEDA gallagher noiseless | 1.8 (3) | 62 (71) | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| BFGS ros noiseless | 11 (20) | 31 (54) | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.7 (2) | 13 (19) | 3.7 (4) | 2.1 (1) | 1.8 (0.9) | 1.8 (2) | 1.8 (2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 4.2 (4) | 3.3 (4) | 7.5 (4) | 26 (41) | ∞ | ∞ | ∞5e4 | 0/15 |
| Cauchy-EDA posik noiseless | 2.2 (4) | 234 (203) | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| DASA korosec noiseless | 9.0 (8) | 20 (22) | 362 (649) | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| DE-PSO garcia-nieto noiseless | 2.0 (1) | 66 (85) | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| DIRECT posik noiseless | 1.5 (1) | 3.5 (4) | 5.7 (6) | 3.7 (6) | 6.0 (5) | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 2.4 (2) | 28 (15) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| FULLNEWUOA ros noiseless | 5.4 (7) | 2.0 (2) | 3.8 (5) | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| G3PCX posik noiseless | 2.6 (3) | 2.4 (4) | 8.6 (15) | 60 (60) | ∞ | ∞ | ∞2e5 | 0/15 |
| GA nicolau noiseless | 1.5 (0.8) | 59 (44) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| GLOBAL pal noiseless | 1.6 (2) | 1.0 (0.5) | 4.8 (7) | ∞ | ∞ | ∞ | ∞4859 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 3.1 (4) | 10 (14) | 3.7 (4) | 1.9 (3) | 1.7 (3) | 1.7 (2) | 1.6 (3) | 9/15 |
| LSfminbnd posik noiseless | 1.8 (2) | 11 (7) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| LSstep posik noiseless | 1.4 (1) | 6.6 (7) | 51 (57) | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 2.6 (3) | 2.5 (2) | 1.7 (2) | 4.0 (4) | 3.6 (4) | 3.4 (5) | 3.3 (3) | 9/15 |
| MCS huyer noiseless | 3.4 (2) | 2.4 (1) | 51 (94) | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 1.5 (2) | 1.00 (1) | 1.0 (1) | 3.6 (4) | 15 (17) | ∞ | ∞1e5 | 0/15 |
| NELDER hansen noiseless | 2.9 (2) | 3.5 (7) | 2.7 (4) | 3.2 (3) | 4.0 (3) | 4.6 (4) | 5.6 (7) | 14/15 |
| NEWUOA ros noiseless | 6.2 (4) | 2.4 (4) | 7.1 (4) | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| ONEFIFTH auger noiseless | 3.1 (3) | 4.7 (5) | 52 (100) | 594 (629) | ∞ | ∞ | ∞5e6 | 0/15 |
| POEMS kubalik noiseless | 13 (20) | 23 (11) | 26 (26) | 22 (18) | 25 (24) | 33 (30) | 32 (33) | 5/15 |
| PSO Bounds el-abd noiseless | 2.1 (2) | 58 (38) | 242 (248) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| PSO el-abd noiseless | 2.2 (1) | 20 (20) | 243 (373) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| RANDOMSEARCH auger noiseless | 2.3 (2) | 49 (44) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 1.6 (2) | 1.8 (1) | 4.6 (5) | 13 (12) | ∞ | ∞ | ∞2e4 | 0/15 |
| VNS garcia-martinez noiseless | 1 (0.5) | 10 (11) | 15 (20) | 26 (46) | 23 (17) | 25 (19) | 24 (5) | 15/15 |
| iAMALGAM bosman noiseless | 2.6 (2) | 7.8 (13) | 2.1 (1) | 1.3 (2) | 1.2 (0.5) | 1.1 (2) | 1.1 (0.8) | 15/15 |
| Δ fopt f24, 5-D |
1e1 1622 |
1e0 2.2e5 |
1e-1 6.4e6 |
1e-2 9.6e6 |
1e-3 9.6e6 |
1e-5 1.3e7 |
1e-7 1.3e7 |
#succ 3/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 8.1 (4) | 10 (10) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 3.3 (3) | 2.4 (1) | 2.1 (3) | 3.8 (4) | 3.7 (9) | 5.6 (4) | 5.6 (7) | 1/15 |
| BAYEDA gallagher noiseless | 15 (29) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| BFGS ros noiseless | 69 (89) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 2.1 (3) | 1.6 (1) | 1 (0.8) | 1.0 (0.6) | 1.0 (2) | 1 (0.5) | 1 (2) | 3/15 |
| CMA-ESPLUSSEL auger noiseless | 6.7 (9) | 1.7 (3) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| Cauchy-EDA posik noiseless | 30 (26) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| DASA korosec noiseless | 253 (413) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| DE-PSO garcia-nieto noiseless | 29 (31) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| DIRECT posik noiseless | 7.5 (8) | 1.9 (0.6) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 10 (5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| FULLNEWUOA ros noiseless | 2.5 (3) | 1.1 (2) | ∞ | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| G3PCX posik noiseless | 44 (57) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| GA nicolau noiseless | 21 (8) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| GLOBAL pal noiseless | 4.2 (8) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6417 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.8 (2) | 1 (2) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| LSfminbnd posik noiseless | 9.1 (6) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| LSstep posik noiseless | 203 (170) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| MA-LS-CHAIN molina noiseless | 2.1 (1) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| MCS huyer noiseless | 7.0 (3) | 3.5 (4) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| NELDERDOERR doerr noiseless | 1.0 (0.8) | 1.4 (1) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| NELDER hansen noiseless | 11 (7) | 5.6 (5) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| NEWUOA ros noiseless | 2.9 (2) | 2.1 (3) | ∞ | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| ONEFIFTH auger noiseless | 31 (36) | 68 (98) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| POEMS kubalik noiseless | 47 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| PSO Bounds el-abd noiseless | 10 (7) | 33 (25) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| PSO el-abd noiseless | 5.7 (3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| RANDOMSEARCH auger noiseless | 2948 (4814) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| Rosenbrock posik noiseless | 212 (167) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| VNS garcia-martinez noiseless | 3.3 (4) | 49 (17) | 13 (20) | 16 (17) | 46 (128) | ∞ | ∞1e8 | 0/15 |
| iAMALGAM bosman noiseless | 3.1 (4) | 2.2 (1) | 2.2 (1) | 7.5 (20) | 7.5 (10) | 5.6 (8) | 5.6 (5) | 1/15 |
Previous dimension | Dimension = 10 | Next dimension
| Δ fopt f1, 10-D |
1e1 22 |
1e0 23 |
1e-1 23 |
1e-2 23 |
1e-3 23 |
1e-5 23 |
1e-7 23 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 84 (17) | 229 (37) | 412 (24) | 587 (54) | 776 (42) | 1147 (63) | 1549 (52) | 15/15 |
| AMALGAM bosman noiseless | 18 (9) | 44 (9) | 72 (24) | 100 (18) | 130 (52) | 188 (41) | 237 (33) | 15/15 |
| BAYEDA gallagher noiseless | 39 (16) | 103 (27) | 233 (12) | 300 (218) | 368 (662) | 504 (433) | 641 (19) | 14/15 |
| BFGS ros noiseless | 1.0 (0) | 1 (0) | 1 (0) | 1 (0) | 1 (0) | 1 (0) | 1 (0) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 5.7 (2) | 11 (2) | 18 (3) | 25 (3) | 31 (4) | 44 (5) | 58 (3) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 3.8 (1) | 7.4 (2) | 11 (2) | 15 (2) | 18 (2) | 25 (1) | 33 (2) | 15/15 |
| Cauchy-EDA posik noiseless | 165 (70) | 343 (127) | 509 (189) | 696 (210) | 875 (262) | 1234 (242) | 1608 (153) | 15/15 |
| DASA korosec noiseless | 29 (11) | 45 (13) | 59 (21) | 77 (21) | 95 (12) | 130 (22) | 181 (20) | 15/15 |
| DE-PSO garcia-nieto noiseless | 19 (5) | 44 (8) | 83 (15) | 128 (18) | 171 (19) | 283 (26) | 391 (49) | 15/15 |
| DIRECT posik noiseless | 8.8 (6) | 31 (6) | 63 (7) | 97 (20) | 136 (12) | 243 (32) | 399 (51) | 5/5 |
| EDA-PSO el-abd noiseless | 22 (19) | 787 (91) | 1533 (299) | 2347 (170) | 3148 (232) | 4718 (207) | 6374 (180) | 15/15 |
| FULLNEWUOA ros noiseless | 3.1 (0) | 2.9 (0.0) | 2.9 (0.1) | 3.0 (0.0) | 3.0 (0.1) | 3.0 (0.1) | 3.0 (0.1) | 15/15 |
| G3PCX posik noiseless | 7.9 (0.5) | 11 (0.9) | 15 (3) | 20 (2) | 24 (2) | 33 (3) | 43 (3) | 15/15 |
| GA nicolau noiseless | 309 (187) | 1156 (113) | 2110 (261) | 3224 (373) | 4446 (421) | 1.2e4 (2e4) | 6.1e4 (1e5) | 6/15 |
| GLOBAL pal noiseless | 15 (0.2) | 14 (0) | 14 (0) | 14 (0) | 14 (0) | 14 (0) | 14 (0) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 4.8 (2) | 10 (2) | 16 (2) | 21 (3) | 26 (1) | 37 (3) | 48 (2) | 15/15 |
| LSfminbnd posik noiseless | 7.1 (2) | 8.0 (1) | 8.2 (2) | 8.3 (2) | 8.3 (2) | 8.3 (1.0) | 8.3 (2) | 15/15 |
| LSstep posik noiseless | 138 (14) | 151 (9) | 157 (0.1) | 157 (0.1) | 157 (0.1) | 157 (0.1) | 157 (0.1) | 15/15 |
| MA-LS-CHAIN molina noiseless | 12 (3) | 36 (10) | 58 (20) | 80 (13) | 108 (20) | 144 (23) | 178 (18) | 15/15 |
| MCS huyer noiseless | 1.2 (0.3) | 2.0 (1) | 2.0 (1.0) | 2.2 (0.1) | 2.9 (1.0) | 2.9 (2) | 2.9 (2) | 15/15 |
| NELDERDOERR doerr noiseless | 2.4 (2) | 5.2 (1) | 8.1 (3) | 11 (4) | 14 (5) | 21 (5) | 32 (9) | 15/15 |
| NELDER hansen noiseless | 2.5 (0.8) | 6.0 (1) | 9.4 (4) | 13 (5) | 16 (4) | 23 (6) | 31 (6) | 15/15 |
| NEWUOA ros noiseless | 1 (0)★ | 0.99 (0.0) | 0.99 (0.0) | 1.0 (0.0) | 1.0 (0.0) | 1.0 (0.0) | 1.0 (0.1) | 15/15 |
| ONEFIFTH auger noiseless | 3.9 (2) | 6.8 (2) | 10 (2) | 13 (3) | 16 (3) | 22 (5) | 28 (2) | 15/15 |
| POEMS kubalik noiseless | 135 (10) | 220 (68) | 619 (89) | 1034 (106) | 1501 (141) | 2418 (55) | 3304 (157) | 15/15 |
| PSO Bounds el-abd noiseless | 18 (11) | 179 (101) | 701 (255) | 1382 (493) | 1715 (549) | 2478 (490) | 5258 (1679) | 15/15 |
| PSO el-abd noiseless | 10 (5) | 54 (44) | 101 (17) | 151 (26) | 214 (49) | 333 (11) | 454 (63) | 15/15 |
| RANDOMSEARCH auger noiseless | 3014 (2582) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | 3.4 (0.4) | 4.9 (1) | 6.5 (1) | 8.1 (1) | 10 (1) | 13 (1) | 16 (2) | 15/15 |
| VNS garcia-martinez noiseless | 12 (2) | 18 (2) | 25 (4) | 32 (0.8) | 38 (3) | 51 (7) | 65 (6) | 15/15 |
| iAMALGAM bosman noiseless | 8.5 (4) | 24 (7) | 41 (3) | 57 (3) | 72 (9) | 104 (9) | 137 (9) | 15/15 |
| Δ fopt f2, 10-D |
1e1 187 |
1e0 190 |
1e-1 191 |
1e-2 191 |
1e-3 193 |
1e-5 194 |
1e-7 195 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 80 (6) | 102 (9) | 125 (14) | 150 (11) | 173 (9) | 222 (17) | 280 (21) | 15/15 |
| AMALGAM bosman noiseless | 15 (3) | 20 (5) | 25 (5) | 29 (4) | 32 (6) | 38 (7) | 46 (7) | 15/15 |
| BAYEDA gallagher noiseless | 42 (5) | 57 (79) | 66 (54) | 74 (28) | 81 (27) | 97 (4) | 112 (104) | 3/15 |
| BFGS ros noiseless | 10 (2) | 12 (1) | 14 (2) | 14 (2) | 14 (3) | 15 (2) | 15 (2) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 20 (4) | 24 (2) | 26 (2) | 27 (2) | 28 (1) | 29 (0.9) | 30 (2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 16 (2) | 20 (2) | 21 (4) | 22 (4) | 23 (0.9) | 24 (2) | 25 (1) | 15/15 |
| Cauchy-EDA posik noiseless | 95 (17) | 117 (16) | 140 (13) | 165 (20) | 187 (21) | 230 (23) | 272 (26) | 15/15 |
| DASA korosec noiseless | 8.6 (2) | 11 (2) | 13 (1) | 15 (2) | 18 (2) | 25 (3) | 34 (4) | 15/15 |
| DE-PSO garcia-nieto noiseless | 16 (3) | 22 (3) | 28 (5) | 34 (6) | 42 (15) | 55 (14) | 69 (10) | 14/15 |
| DIRECT posik noiseless | 15 (2) | 149 (264) | 153 (396) | 157 (396) | 166 (262) | 412 (783) | 1019 (2079) | 0/5 |
| EDA-PSO el-abd noiseless | 350 (29) | 436 (26) | 524 (27) | 618 (30) | 705 (62) | 886 (35) | 1074 (41) | 15/15 |
| FULLNEWUOA ros noiseless | 53 (23) | 150 (87) | 304 (79) | 588 (304) | 2511 (2459) | ∞ | ∞1e5 | 0/15 |
| G3PCX posik noiseless | 89 (37) | 187 (79) | 291 (166) | 369 (116) | 461 (186) | 643 (253) | 862 (310) | 14/15 |
| GA nicolau noiseless | 822 (1365) | 1394 (2669) | 2657 (5212) | 4430 (2673) | 7015 (7797) | 7.3e4 (7e4) | ∞1e6 | 0/15 |
| GLOBAL pal noiseless | 11 (2) | 13 (2) | 14 (1) | 14 (2) | 15 (1) | 15 (2) | 16 (0.7) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 6.9 (1) | 7.7 (1) | 8.5 (0.7) | 9.3 (1) | 10 (1) | 11 (1) | 13 (0.7) | 15/15 |
| LSfminbnd posik noiseless | 1.00 (0.1)★ | 1.0 (0.1)★ | 1.00 (0.1)★ | 1.0 (0.1)★ | 1.00 (0.1)★ | 1.00 (0.1)★ | 1.0 (0.1)★ | 15/15 |
| LSstep posik noiseless | 16 (1) | 16 (0.4) | 16 (0.4) | 16 (0.1) | 16 (0.4) | 16 (0.4) | 16 (0.4) | 15/15 |
| MA-LS-CHAIN molina noiseless | 14 (1) | 18 (2) | 23 (1) | 27 (5) | 32 (1) | 42 (6) | 52 (4) | 15/15 |
| MCS huyer noiseless | 3.1 (1.0) | 4.6 (2) | 6.5 (1) | 7.6 (3) | 10 (3) | 11 (3) | 107 (138) | 2/15 |
| NELDERDOERR doerr noiseless | 22 (5) | 52 (35) | 83 (49) | 102 (56) | 119 (89) | 128 (43) | 203 (248) | 14/15 |
| NELDER hansen noiseless | 6.0 (2) | 7.0 (3) | 8.1 (2) | 8.6 (2) | 9.1 (2) | 10 (2) | 11 (2) | 15/15 |
| NEWUOA ros noiseless | 13 (11) | 37 (30) | 74 (48) | 104 (53) | 147 (52) | 219 (54) | 301 (106) | 15/15 |
| ONEFIFTH auger noiseless | 5542 (2849) | 1.4e4 (6805) | 2.3e4 (1e4) | 3.2e4 (2e4) | 4.8e4 (3e4) | 2.4e5 (1e5) | 7.6e5 (6e5) | 0/15 |
| POEMS kubalik noiseless | 221 (36) | 278 (32) | 324 (10) | 384 (39) | 428 (16) | 543 (30) | 645 (11) | 15/15 |
| PSO Bounds el-abd noiseless | 290 (164) | 423 (220) | 529 (137) | 599 (141) | 891 (464) | 1479 (388) | 1768 (389) | 15/15 |
| PSO el-abd noiseless | 41 (10) | 418 (13) | 422 (2622) | 428 (9) | 432 (9) | 443 (1295) | 454 (7) | 14/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | 39 (61) | 101 (22) | 160 (262) | 211 (263) | 221 (393) | 370 (504) | 650 (757) | 6/15 |
| VNS garcia-martinez noiseless | 29 (9) | 33 (10) | 37 (29) | 39 (7) | 41 (28) | 44 (6) | 47 (41) | 15/15 |
| iAMALGAM bosman noiseless | 11 (3) | 14 (3) | 16 (2) | 18 (2) | 19 (2) | 23 (3) | 27 (2) | 15/15 |
| Δ fopt f3, 10-D |
1e1 1739 |
1e0 3600 |
1e-1 3609 |
1e-2 3636 |
1e-3 3642 |
1e-5 3646 |
1e-7 3651 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 11 (4) | 40 (18) | 59 (24) | 59 (23) | 61 (25) | 67 (18) | 81 (20) | 15/15 |
| AMALGAM bosman noiseless | 4.6 (0.5) | 1320 (1449) | 3.9e4 (5e4) | 3.9e4 (1e5) | 3.8e4 (5e4) | 3.8e4 (6e4) | 3.8e4 (4e4) | 1/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BFGS ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 3.6 (3) | 311 (722) | 5926 (1e4) | 5882 (6388) | 5873 (3786) | 5867 (4311) | 5859 (7803) | 2/15 |
| CMA-ESPLUSSEL auger noiseless | 389 (158) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| Cauchy-EDA posik noiseless | 4088 (4816) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DASA korosec noiseless | 1.00 (0.3) | 11 (9) | 19 (21) | 19 (25) | 19 (21) | 19 (11) | 20 (14) | 15/15 |
| DE-PSO garcia-nieto noiseless | 172 (216) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| DIRECT posik noiseless | 87 (72) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 18 (4) | 1825 (1663) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| FULLNEWUOA ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| G3PCX posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| GA nicolau noiseless | 26 (4) | 23 (3) | 73 (4) | 141 (141) | 463 (617) | 827 (823) | 3938 (6574) | 0/15 |
| GLOBAL pal noiseless | 142 (187) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 3.1 (2) | 62 (108) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| LSfminbnd posik noiseless | 47 (64) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| LSstep posik noiseless | 2.1 (9e-4) | 1.00 (5e-3)★ | 1.00 (0.0)★ | 1.0 (4e-3)★ | 1.00 (3e-3)★ | 1.0 (3e-3)★ | 1.0 (2e-3)★ | 15/15 |
| MA-LS-CHAIN molina noiseless | 3.9 (1) | 43 (51) | 79 (57) | 79 (54) | 79 (76) | 79 (44) | 79 (63) | 14/15 |
| MCS huyer noiseless | 11 (6) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| NELDERDOERR doerr noiseless | 179 (344) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NELDER hansen noiseless | 321 (595) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NEWUOA ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6e4 | 0/15 |
| ONEFIFTH auger noiseless | 6368 (6298) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| POEMS kubalik noiseless | 6.7 (2) | 29 (29) | 66 (62) | 68 (46) | 73 (33) | 79 (65) | 84 (47) | 15/15 |
| PSO Bounds el-abd noiseless | 50 (16) | 44 (23) | 51 (30) | 52 (24) | 54 (17) | 70 (18) | 95 (10) | 15/15 |
| PSO el-abd noiseless | 150 (575) | 1814 (1250) | 1810 (2286) | 1797 (1100) | 1794 (1510) | 1793 (3703) | 1792 (1371) | 2/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| VNS garcia-martinez noiseless | 3.2 (2) | 24 (10) | 194 (19) | 213 (20) | 226 (1517) | 260 (836) | 290 (36) | 15/15 |
| iAMALGAM bosman noiseless | 4.4 (7) | 275 (406) | 2283 (4011) | 2279 (2164) | 2287 (2363) | 2304 (1861) | 2321 (2247) | 11/15 |
| Δ fopt f4, 10-D |
1e1 2234 |
1e0 3626 |
1e-1 3660 |
1e-2 3695 |
1e-3 3707 |
1e-5 3744 |
1e-7 28767 |
#succ 12/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 14 (8) | 104 (41) | 167 (101) | 168 (83) | 171 (100) | 186 (98) | 30 (15) | 15/15 |
| AMALGAM bosman noiseless | 41 (40) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BFGS ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 6.5 (3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e6 | 0/15 |
| CMA-ESPLUSSEL auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DASA korosec noiseless | 1.0 (0.5) | 16 (14) | 52 (69) | 51 (38) | 51 (52) | 51 (63) | 6.8 (7) | 15/15 |
| DE-PSO garcia-nieto noiseless | 66 (63) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| DIRECT posik noiseless | 180 (403) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 20 (3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| FULLNEWUOA ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| G3PCX posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| GA nicolau noiseless | 22 (2) | 26 (6) | 79 (209) | 305 (205) | 1812 (2023) | ∞ | ∞1e6 | 0/15 |
| GLOBAL pal noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 6.6 (5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| LSfminbnd posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6e4 | 0/15 |
| LSstep posik noiseless | 1.6 (0.1) | 1.00 (3e-3)★ | 1.0 (0.0)★ | 1.0 (0.0)★ | 1.00 (0.0)★ | 1.0 (0.0)★ | 1.0 (2) | 12/15 |
| MA-LS-CHAIN molina noiseless | 5.1 (2) | 288 (215) | 2023 (2288) | 2004 (3078) | 1997 (2057) | 1978 (2804) | 257 (243) | 1/15 |
| MCS huyer noiseless | 27 (20) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| NELDERDOERR doerr noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NELDER hansen noiseless | 3274 (1780) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NEWUOA ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞7e4 | 0/15 |
| ONEFIFTH auger noiseless | 6.3e4 (1e5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| POEMS kubalik noiseless | 6.4 (1) | 43 (30) | 85 (99) | 89 (63) | 91 (64) | 97 (149) | 13 (6) | 14/15 |
| PSO Bounds el-abd noiseless | 37 (19) | 186 (216) | 197 (352) | 196 (545) | 197 (140) | 211 (270) | 30 (17) | 10/15 |
| PSO el-abd noiseless | 118 (224) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| VNS garcia-martinez noiseless | 7.2 (5) | 2893 (8231) | 2.5e4 (2e4) | 2.5e4 (3e4) | 2.7e4 (5e4) | 2.7e4 (3e4) | 4560 (3287) | 1/15 |
| iAMALGAM bosman noiseless | 29 (38) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Δ fopt f5, 10-D |
1e1 20 |
1e0 20 |
1e-1 20 |
1e-2 20 |
1e-3 20 |
1e-5 20 |
1e-7 20 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 126 (38) | 194 (34) | 224 (50) | 240 (65) | 251 (100) | 257 (64) | 260 (97) | 15/15 |
| AMALGAM bosman noiseless | 39 (14) | 46 (9) | 46 (10) | 46 (14) | 46 (8) | 46 (18) | 46 (16) | 15/15 |
| BAYEDA gallagher noiseless | 92 (15) | 123 (13) | 139 (33) | 139 (20) | 139 (9) | 139 (27) | 139 (33) | 15/15 |
| BFGS ros noiseless | 2.2 (0.3) | 2.8 (0.6) | 2.9 (0.3) | 2.9 (0.4) | 2.9 (0.8) | 2.9 (0.6) | 2.9 (0.6) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 4.9 (2) | 6.1 (1) | 6.2 (2) | 6.2 (1) | 6.2 (1) | 6.2 (2) | 6.2 (2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 3.2 (1) | 3.9 (1) | 4.0 (0.9) | 4.0 (0.7) | 4.0 (0.5) | 4.0 (1) | 4.0 (1) | 15/15 |
| Cauchy-EDA posik noiseless | 69 (31) | 71 (33) | 73 (53) | 73 (17) | 73 (30) | 73 (18) | 73 (49) | 15/15 |
| DASA korosec noiseless | 24 (5) | 31 (5) | 36 (6) | 41 (6) | 44 (8) | 51 (8) | 59 (8) | 15/15 |
| DE-PSO garcia-nieto noiseless | 33 (9) | 47 (8) | 50 (8) | 51 (11) | 51 (4) | 51 (9) | 51 (7) | 15/15 |
| DIRECT posik noiseless | 37 (0) | 52 (2) | 54 (0.0) | 54 (0.0) | 54 (0.0) | 54 (0.0) | 54 (0.0) | 5/5 |
| EDA-PSO el-abd noiseless | 12 (3) | 17 (5) | 20 (8) | 21 (8) | 21 (8) | 21 (10) | 21 (11) | 15/15 |
| FULLNEWUOA ros noiseless | 3.7 (0.3) | 4.0 (0.5) | 4.1 (0.4) | 4.1 (0.6) | 4.1 (0.6) | 4.1 (0.6) | 4.1 (0.5) | 15/15 |
| G3PCX posik noiseless | 17 (7) | 26 (9) | 28 (10) | 28 (6) | 28 (6) | 28 (10) | 28 (6) | 15/15 |
| GA nicolau noiseless | 1414 (117) | 3174 (209) | 5456 (502) | 8327 (619) | 1.1e4 (617) | 1.9e4 (1344) | 3.0e4 (2598) | 0/15 |
| GLOBAL pal noiseless | 17 (0.8) | 18 (0.6) | 18 (0.6) | 18 (0.6) | 18 (0.6) | 18 (0.6) | 18 (0.6) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 5.5 (2) | 7.2 (2) | 7.3 (2) | 7.4 (2) | 7.4 (2) | 7.4 (3) | 7.4 (2) | 15/15 |
| LSfminbnd posik noiseless | 14 (0.8) | 16 (0.0) | 16 (0.0) | 16 (0) | 16 (0) | 16 (0) | 16 (0) | 15/15 |
| LSstep posik noiseless | 167 (15) | 180 (0.0) | 180 (0.0) | 180 (0.0) | 180 (0.0) | 180 (0.0) | 180 (0.0) | 15/15 |
| MA-LS-CHAIN molina noiseless | 41 (3) | 45 (3) | 49 (16) | 50 (17) | 50 (10) | 50 (18) | 50 (3) | 15/15 |
| MCS huyer noiseless | 1.0 (0.0)★ | 1.0 (0.0)★ | 1.0 (0.0)★ | 1.0 (0.0)★ | 1.0 (0.0)★ | 1.0 (0.0)★ | 1.0 (0)★ | 15/15 |
| NELDERDOERR doerr noiseless | 3.1 (1) | 4.1 (1) | 4.2 (0.9) | 4.2 (0.8) | 4.2 (1) | 4.2 (1) | 4.2 (1) | 15/15 |
| NELDER hansen noiseless | 3.4 (0.6) | 4.3 (1) | 4.3 (0.5) | 4.4 (0.5) | 4.4 (2) | 4.4 (1) | 4.4 (1) | 15/15 |
| NEWUOA ros noiseless | 1.2 (0.1) | 1.4 (0.1) | 1.4 (0.2) | 1.4 (0.2) | 1.4 (0.2) | 1.4 (0.2) | 1.4 (0.3) | 15/15 |
| ONEFIFTH auger noiseless | 2.2 (0.8) | 2.6 (1) | 2.8 (0.7) | 2.8 (1.0) | 2.8 (0.6) | 2.8 (0.9) | 2.8 (1) | 15/15 |
| POEMS kubalik noiseless | 197 (19) | 234 (27) | 260 (33) | 268 (41) | 270 (39) | 271 (40) | 271 (51) | 15/15 |
| PSO Bounds el-abd noiseless | 10 (3) | 14 (7) | 15 (8) | 16 (8) | 16 (7) | 16 (9) | 16 (7) | 15/15 |
| PSO el-abd noiseless | 14 (5) | 17 (9) | 19 (8) | 20 (11) | 20 (15) | 20 (10) | 20 (10) | 15/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | 4.1 (0.4) | 4.4 (0.2) | 4.4 (0.2) | 4.4 (0.2) | 4.4 (0.2) | 4.4 (0.1) | 4.4 (0.2) | 15/15 |
| VNS garcia-martinez noiseless | 10 (1) | 11 (0.9) | 11 (0.6) | 11 (2) | 11 (2) | 11 (0.6) | 11 (2) | 15/15 |
| iAMALGAM bosman noiseless | 8.9 (2) | 11 (2) | 12 (2) | 12 (4) | 12 (2) | 12 (3) | 12 (2) | 15/15 |
| Δ fopt f6, 10-D |
1e1 412 |
1e0 623 |
1e-1 826 |
1e-2 1039 |
1e-3 1292 |
1e-5 1841 |
1e-7 2370 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 31 (4) | 42 (6) | 51 (5) | 59 (6) | 64 (15) | 68 (17) | 87 (33) | 15/15 |
| AMALGAM bosman noiseless | 7.7 (2) | 10 (2) | 11 (2) | 12 (2) | 12 (1) | 11 (1) | 11 (1) | 15/15 |
| BAYEDA gallagher noiseless | 353 (665) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BFGS ros noiseless | 3.7 (1) | 4.2 (1) | 4.5 (2) | 4.6 (2) | 4.5 (2) | 4.5 (1) | 66 (34) | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 2.0 (0.3) | 2.0 (0.3) | 2.0 (0.4) | 1.9 (0.3) | 1.9 (0.3) | 1.7 (0.2) | 1.7 (0.2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 1.1 (1) | 2.5 (2) | 20 (21) | 69 (126) | 150 (179) | ∞ | ∞1e5 | 0/15 |
| Cauchy-EDA posik noiseless | 182 (20) | 152 (21) | 139 (13) | 129 (21) | 119 (12) | 105 (9) | 99 (7) | 15/15 |
| DASA korosec noiseless | 72 (50) | 146 (86) | 346 (244) | 494 (574) | 572 (794) | 670 (1180) | 701 (1065) | 15/15 |
| DE-PSO garcia-nieto noiseless | 6.6 (0.5) | 11 (5) | 14 (4) | 24 (19) | 37 (28) | ∞ | ∞2e4 | 0/15 |
| DIRECT posik noiseless | 94 (120) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 47 (8) | 61 (10) | 68 (6) | 73 (4) | 72 (6) | 71 (4) | 71 (4) | 15/15 |
| FULLNEWUOA ros noiseless | 1.0 (0.2) | 1.00 (0.2) | 1.0 (0.2)★ | 1.00 (0.1)★ | 1.0 (0.1)★ | 1.0 (0.2)★ | 1.00 (0.1)★ | 15/15 |
| G3PCX posik noiseless | 1.6 (1) | 2.3 (2) | 3.6 (3) | 3.8 (3) | 3.9 (3) | 4.5 (2) | 5.4 (2) | 15/15 |
| GA nicolau noiseless | 136 (15) | 4647 (5616) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GLOBAL pal noiseless | 3.1 (2) | 3.3 (1) | 3.5 (1) | 3.4 (1) | 3.4 (2) | 4.0 (3) | 83 (93) | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.1 (0.5) | 2.3 (0.5) | 2.4 (0.3) | 2.4 (0.5) | 2.4 (0.4) | 2.2 (0.3) | 2.1 (0.3) | 15/15 |
| LSfminbnd posik noiseless | 215 (281) | 366 (590) | 303 (329) | 680 (832) | 1115 (716) | 787 (706) | ∞1e5 | 0/15 |
| LSstep posik noiseless | 584 (472) | 2380 (1084) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 6.4 (2) | 9.0 (3) | 10 (3) | 10 (2) | 8.6 (3) | 7.3 (2) | 6.4 (1.0) | 15/15 |
| MCS huyer noiseless | 18 (17) | 174 (104) | 169 (219) | 280 (425) | ∞ | ∞ | ∞4e4 | 0/15 |
| NELDERDOERR doerr noiseless | 3.7 (4) | 10 (7) | 15 (8) | 18 (6) | 25 (13) | 256 (292) | ∞2e5 | 0/15 |
| NELDER hansen noiseless | 4.0 (3) | 5.2 (1) | 5.5 (1) | 5.8 (2) | 5.7 (1) | 6.3 (3) | 9.0 (4) | 15/15 |
| NEWUOA ros noiseless | 2.0 (2) | 3.2 (3) | 4.0 (4) | 4.9 (6) | 5.5 (7) | 5.9 (5) | 6.2 (6) | 15/15 |
| ONEFIFTH auger noiseless | 1.7 (0.7) | 1.9 (0.7) | 2.1 (1) | 2.5 (1) | 2.4 (2) | 2.4 (1) | 2.6 (0.7) | 15/15 |
| POEMS kubalik noiseless | 29 (5) | 40 (5) | 44 (1) | 46 (2) | 46 (0.8) | 44 (0.8) | 45 (0.8) | 15/15 |
| PSO Bounds el-abd noiseless | 44 (39) | 116 (51) | 144 (23) | 151 (53) | 142 (45) | 128 (27) | 161 (14) | 15/15 |
| PSO el-abd noiseless | 383 (1222) | 413 (6) | 317 (911) | 258 (482) | 213 (582) | 159 (274) | 129 (213) | 12/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | 10 (15) | 37 (26) | 41 (108) | 37 (43) | 34 (41) | 31 (19) | 29 (21) | 11/15 |
| VNS garcia-martinez noiseless | 2.5 (0.4) | 2.4 (0.5) | 2.3 (0.3) | 2.2 (0.1) | 2.1 (0.4) | 1.9 (0.1) | 1.8 (0.1) | 15/15 |
| iAMALGAM bosman noiseless | 3.1 (1.0) | 4.1 (0.7) | 4.8 (1) | 5.1 (1) | 5.1 (1.0) | 5.0 (0.7) | 4.9 (0.8) | 15/15 |
| Δ fopt f7, 10-D |
1e1 172 |
1e0 1611 |
1e-1 4195 |
1e-2 5099 |
1e-3 5141 |
1e-5 5141 |
1e-7 5389 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 25 (11) | 10 (4) | 25 (50) | 57 (108) | 59 (87) | 59 (58) | 56 (81) | 15/15 |
| AMALGAM bosman noiseless | 3.9 (0.7) | 1.0 (0.1) | 2.3 (4) | 2.6 (3) | 2.6 (4) | 2.6 (4) | 2.5 (3) | 15/15 |
| BAYEDA gallagher noiseless | 23 (9) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BFGS ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1100 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 2.3 (1) | 1.2 (0.7) | 1.3 (2) | 1.3 (0.8) | 1.3 (0.4) | 1.3 (0.8) | 1.2 (0.8) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 7.4 (9) | 5.9 (6) | 5.0 (1) | 20 (44) | 20 (33) | 20 (42) | 19 (33) | 9/15 |
| Cauchy-EDA posik noiseless | 31 (10) | 7.2 (4) | 4.4 (2) | 4.7 (2) | 4.9 (2) | 4.9 (3) | 4.9 (1.0) | 15/15 |
| DASA korosec noiseless | 280 (477) | 8761 (7431) | ∞ | ∞ | ∞ | ∞ | ∞6e6 | 0/15 |
| DE-PSO garcia-nieto noiseless | 9.2 (4) | 21 (22) | 32 (33) | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| DIRECT posik noiseless | 16 (16) | 68 (53) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 57 (15) | 17 (1) | 128 (299) | 109 (147) | 108 (146) | 108 (97) | 104 (186) | 10/15 |
| FULLNEWUOA ros noiseless | 1.00 (0.2) | 7.6 (5) | 105 (115) | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| G3PCX posik noiseless | 20 (24) | 522 (984) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| GA nicolau noiseless | 135 (32) | 267 (935) | 676 (954) | 2857 (2010) | 2834 (2772) | 2834 (1897) | ∞1e6 | 0/15 |
| GLOBAL pal noiseless | 11 (7) | 50 (54) | ∞ | ∞ | ∞ | ∞ | ∞5096 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.5 (2) | 1.5 (0.8) | 1.1 (0.5) | 1.00 (0.6) | 1.0 (0.5) | 1.0 (0.4) | 1.00 (0.3) | 15/15 |
| LSfminbnd posik noiseless | 94 (59) | 274 (109) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| LSstep posik noiseless | 719 (138) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 7.7 (4) | 15 (10) | 110 (127) | 116 (234) | 116 (208) | 116 (94) | 111 (213) | 8/15 |
| MCS huyer noiseless | 53 (55) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| NELDERDOERR doerr noiseless | 59 (139) | 404 (560) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NELDER hansen noiseless | 69 (98) | 943 (871) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NEWUOA ros noiseless | 27 (40) | 1041 (821) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| ONEFIFTH auger noiseless | 187 (363) | 6973 (1e4) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| POEMS kubalik noiseless | 40 (11) | 12 (4) | 74 (57) | 80 (98) | 80 (146) | 80 (195) | 76 (126) | 12/15 |
| PSO Bounds el-abd noiseless | 19 (10) | 726 (1251) | 3348 (3278) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| PSO el-abd noiseless | 10 (14) | 771 (1805) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| RANDOMSEARCH auger noiseless | 6.0e4 (7e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| VNS garcia-martinez noiseless | 3.2 (0.5) | 4.1 (4) | 19 (36) | 31 (30) | 34 (33) | 34 (44) | 33 (25) | 15/15 |
| iAMALGAM bosman noiseless | 3.0 (0.6) | 1.0 (0.0) | 1.0 (1) | 2.1 (7) | 2.1 (3) | 2.1 (7) | 2.0 (0.9) | 15/15 |
| Δ fopt f8, 10-D |
1e1 326 |
1e0 921 |
1e-1 1114 |
1e-2 1217 |
1e-3 1267 |
1e-5 1315 |
1e-7 1343 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 43 (7) | 104 (98) | 143 (97) | 207 (107) | 270 (146) | 469 (191) | 2714 (2323) | 8/15 |
| AMALGAM bosman noiseless | 7.3 (2) | 11 (4) | 12 (2) | 12 (2) | 12 (2) | 13 (1) | 13 (0.6) | 15/15 |
| BAYEDA gallagher noiseless | 74 (123) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BFGS ros noiseless | 1.7 (1) | 1.5 (0.8) | 1.3 (0.7) | 1.3 (0.4) | 1.3 (0.5) | 1.2 (0.2) | 1.2 (1.0) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 1.8 (0.1) | 4.1 (0.8) | 4.2 (0.6) | 4.3 (0.5) | 4.3 (0.5) | 4.5 (0.7) | 4.6 (0.5) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 1.9 (0.8) | 6.0 (3) | 5.6 (3) | 5.4 (5) | 5.4 (2) | 5.4 (2) | 5.5 (3) | 15/15 |
| Cauchy-EDA posik noiseless | 65 (15) | 101 (14) | 95 (122) | 93 (10) | 93 (12) | 96 (200) | 100 (103) | 14/15 |
| DASA korosec noiseless | 22 (54) | 173 (246) | 351 (435) | 519 (336) | 742 (654) | 1171 (538) | 1556 (474) | 15/15 |
| DE-PSO garcia-nieto noiseless | 11 (6) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| DIRECT posik noiseless | 32 (30) | 483 (543) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 134 (18) | 188 (10) | 253 (14) | 339 (10) | 434 (13) | 623 (12) | ∞1e6 | 0/15 |
| FULLNEWUOA ros noiseless | 1.3 (0.5) | 1.0 (0.8) | 1.0 (0.5) | 1.0 (0.5) | 1.00 (0.3) | 1.0 (0.1) | 1.0 (0.3) | 15/15 |
| G3PCX posik noiseless | 2.8 (2) | 6.1 (1) | 5.7 (9) | 5.6 (2) | 5.5 (4) | 5.5 (0.9) | 5.7 (4) | 15/15 |
| GA nicolau noiseless | 204 (9) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GLOBAL pal noiseless | 2.1 (1) | 1.5 (0.4) | 1.3 (0.5) | 1.3 (0.4) | 1.2 (0.5) | 1.2 (0.3) | 1.2 (0.4) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.9 (2) | 6.6 (1) | 6.3 (2) | 6.1 (1) | 6.1 (1) | 6.2 (4) | 6.3 (3) | 15/15 |
| LSfminbnd posik noiseless | 19 (7) | 164 (326) | 150 (164) | 360 (360) | 1107 (1815) | ∞ | ∞1e5 | 0/15 |
| LSstep posik noiseless | 63 (25) | 157 (217) | 396 (541) | 1206 (740) | ∞ | ∞ | ∞1e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 7.2 (3) | 11 (4) | 12 (5) | 12 (4) | 12 (4) | 12 (4) | 12 (4) | 15/15 |
| MCS huyer noiseless | 1.0 (0.6) | 1.4 (1) | 1.3 (2) | 1.3 (0.9) | 1.3 (0.9) | 1.3 (0.9) | 1.3 (0.8) | 15/15 |
| NELDERDOERR doerr noiseless | 1.3 (4) | 2.2 (2) | 2.7 (1) | 2.9 (0.9) | 3.1 (0.7) | 3.3 (1) | 3.6 (1) | 15/15 |
| NELDER hansen noiseless | 1.9 (3) | 4.7 (5) | 4.3 (4) | 4.2 (5) | 4.1 (3) | 4.2 (3) | 4.3 (2) | 15/15 |
| NEWUOA ros noiseless | 1.0 (0.6) | 1.5 (2) | 1.3 (0.3) | 1.3 (2) | 1.3 (0.5) | 1.3 (1) | 1.3 (0.5) | 15/15 |
| ONEFIFTH auger noiseless | 21 (26) | 137 (11) | 127 (378) | 141 (259) | 165 (251) | 221 (167) | 279 (143) | 15/15 |
| POEMS kubalik noiseless | 63 (10) | 410 (133) | 705 (503) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| PSO Bounds el-abd noiseless | 65 (19) | 600 (194) | 633 (196) | 676 (195) | 1406 (1145) | 1.1e4 (8745) | ∞1e6 | 0/15 |
| PSO el-abd noiseless | 13 (6) | 240 (308) | 293 (296) | 392 (47) | 505 (579) | 1244 (1022) | 5512 (3537) | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | 12 (49) | 51 (115) | 68 (52) | 87 (49) | 139 (87) | 356 (517) | 1085 (1117) | 1/15 |
| VNS garcia-martinez noiseless | 3.5 (0.8) | 7.4 (3) | 7.3 (3) | 7.2 (1) | 7.2 (3) | 7.3 (9) | 7.4 (6) | 15/15 |
| iAMALGAM bosman noiseless | 3.9 (0.5) | 7.3 (2) | 7.4 (0.6) | 7.4 (5) | 7.5 (4) | 7.8 (0.9) | 8.2 (8) | 15/15 |
| Δ fopt f9, 10-D |
1e1 200 |
1e0 648 |
1e-1 857 |
1e-2 993 |
1e-3 1065 |
1e-5 1138 |
1e-7 1185 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 66 (11) | 319 (200) | 471 (261) | 734 (330) | 1920 (828) | 4433 (2595) | 6.1e4 (5e4) | 0/15 |
| AMALGAM bosman noiseless | 9.3 (3) | 17 (3) | 15 (2) | 15 (2) | 15 (2) | 15 (2) | 16 (2) | 15/15 |
| BAYEDA gallagher noiseless | 56 (50) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BFGS ros noiseless | 2.1 (0.6) | 1.9 (1) | 1.6 (0.2) | 1.4 (0.5) | 1.4 (0.7) | 1.3 (0.3) | 1.3 (0.7) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 3.4 (0.6) | 6.3 (2) | 5.9 (1) | 5.5 (0.6) | 5.4 (0.9) | 5.5 (0.9) | 5.5 (0.9) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 3.3 (2) | 7.7 (7) | 6.6 (5) | 6.1 (3) | 5.9 (3) | 5.8 (4) | 5.8 (2) | 15/15 |
| Cauchy-EDA posik noiseless | 104 (16) | 148 (15) | 128 (11) | 118 (139) | 114 (9) | 114 (120) | 116 (13) | 14/15 |
| DASA korosec noiseless | 161 (300) | 2187 (169) | 2017 (3910) | 2370 (3859) | 2868 (3489) | 4282 (3566) | 5775 (4624) | 12/15 |
| DE-PSO garcia-nieto noiseless | 15 (3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| DIRECT posik noiseless | 9.4 (4) | 349 (768) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 219 (21) | 338 (31) | 544 (88) | 1526 (1808) | ∞ | ∞ | ∞1e6 | 0/15 |
| FULLNEWUOA ros noiseless | 1.6 (0.9) | 2.0 (2) | 1.7 (0.8) | 1.6 (0.6) | 1.5 (0.5) | 1.5 (1) | 1.4 (1) | 15/15 |
| G3PCX posik noiseless | 4.7 (5) | 15 (16) | 12 (5) | 11 (12) | 10 (12) | 10 (9) | 10 (8) | 15/15 |
| GA nicolau noiseless | 366 (35) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GLOBAL pal noiseless | 2.9 (0.7) | 2.2 (1) | 1.8 (1) | 1.6 (0.7) | 1.5 (0.6) | 1.5 (0.4) | 1.4 (0.9) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 6.9 (11) | 10 (4) | 8.9 (5) | 8.1 (1) | 7.8 (0.4) | 7.7 (2) | 7.7 (3) | 15/15 |
| LSfminbnd posik noiseless | 51 (30) | 124 (124) | 864 (1259) | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| LSstep posik noiseless | 417 (1010) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 12 (3) | 36 (7) | 31 (3) | 28 (50) | 27 (47) | 26 (3) | 25 (4) | 15/15 |
| MCS huyer noiseless | 1.0 (0.1) | 1.0 (0.4) | 1.0 (0.4) | 1.0 (0.2) | 1.0 (0.2) | 1 (0.3) | 1.0 (0.2) | 15/15 |
| NELDERDOERR doerr noiseless | 2.7 (0.7) | 7.1 (6) | 6.5 (4) | 6.1 (4) | 6.0 (3) | 6.0 (3) | 6.0 (3) | 15/15 |
| NELDER hansen noiseless | 2.4 (4) | 3.7 (1) | 3.4 (3) | 3.1 (2) | 3.2 (0.8) | 3.2 (2) | 3.3 (0.7) | 15/15 |
| NEWUOA ros noiseless | 1.7 (1) | 1.7 (0.3) | 1.4 (0.7) | 1.3 (0.8) | 1.2 (0.5) | 1.2 (0.4) | 1.2 (0.5) | 15/15 |
| ONEFIFTH auger noiseless | 9.5 (0.5) | 229 (641) | 191 (488) | 195 (108) | 217 (390) | 275 (367) | 335 (2) | 15/15 |
| POEMS kubalik noiseless | 109 (14) | 772 (171) | 1.7e4 (2e4) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| PSO Bounds el-abd noiseless | 455 (316) | 1069 (570) | 1607 (1276) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| PSO el-abd noiseless | 24 (21) | 845 (868) | 1946 (2364) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | 27 (2) | 77 (133) | 70 (103) | 87 (74) | 126 (48) | ∞ | ∞1e5 | 0/15 |
| VNS garcia-martinez noiseless | 4.6 (0.8) | 10 (2) | 12 (43) | 13 (3) | 13 (26) | 12 (2) | 12 (2) | 15/15 |
| iAMALGAM bosman noiseless | 6.3 (0.4) | 10 (2) | 10 (0.8) | 9.0 (0.6) | 8.9 (11) | 9.1 (11) | 9.3 (5) | 15/15 |
| Δ fopt f10, 10-D |
1e1 1835 |
1e0 2172 |
1e-1 2455 |
1e-2 2728 |
1e-3 2802 |
1e-5 4543 |
1e-7 4739 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 847 (629) | 7805 (5208) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 1.8 (0.4) | 1.9 (0.4) | 2.0 (0.4) | 2.0 (0.4) | 2.2 (0.5) | 1.6 (0.5) | 1.9 (0.4) | 15/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BFGS ros noiseless | 1.0 (0.2) | 1.00 (0.2) | 1.00 (0.2) | 1.0 (0.4) | 1.0 (0.3) | 1.3 (0.9) | 924 (401) | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 2.3 (0.4) | 2.1 (0.1) | 1.9 (0.1) | 1.8 (0.1) | 1.8 (0.1) | 1.2 (0.1) | 1.2 (0.1) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 1.7 (0.3) | 1.8 (0.1) | 1.7 (0.1) | 1.6 (0.1) | 1.5 (0.1) | 1.0 (0.1) | 1.0 (0.1)★ | 15/15 |
| Cauchy-EDA posik noiseless | 10 (2) | 11 (2) | 11 (1) | 12 (2) | 13 (2) | 10 (2) | 11 (0.9) | 15/15 |
| DASA korosec noiseless | 7210 (9957) | 2.1e4 (2e4) | 6.1e4 (2e4) | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| FULLNEWUOA ros noiseless | 10 (6) | 20 (10) | 33 (27) | 54 (18) | 257 (335) | ∞ | ∞1e5 | 0/15 |
| G3PCX posik noiseless | 10 (2) | 19 (10) | 26 (8) | 30 (5) | 37 (10) | 31 (8) | 38 (9) | 15/15 |
| GA nicolau noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GLOBAL pal noiseless | 1.2 (0.3) | 1.2 (0.2) | 1.3 (0.3) | 1.2 (0.3) | 1.2 (0.6) | 1.6 (0.7) | ∞1e4 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 4.0 (0.4) | 3.7 (0.4) | 3.4 (0.3) | 3.2 (0.3) | 3.2 (0.3) | 2.0 (0.1) | 2.0 (0.1) | 15/15 |
| LSfminbnd posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| LSstep posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 11 (2) | 11 (17) | 10 (1) | 9.0 (14) | 9.0 (14) | 5.7 (8) | 5.6 (0.3) | 15/15 |
| MCS huyer noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| NELDERDOERR doerr noiseless | 9.5 (8) | 25 (21) | 34 (53) | 57 (79) | 335 (391) | ∞ | ∞2e5 | 0/15 |
| NELDER hansen noiseless | 4.1 (2) | 16 (14) | 43 (62) | 100 (44) | 237 (270) | 1555 (1189) | ∞1e6 | 0/15 |
| NEWUOA ros noiseless | 2.1 (2) | 3.8 (3) | 6.0 (4) | 7.4 (5) | 10 (4) | 9.2 (4) | 12 (5) | 15/15 |
| ONEFIFTH auger noiseless | 533 (485) | 1079 (782) | 1736 (1006) | 2388 (735) | 3667 (2282) | 1.1e4 (1e4) | ∞1e7 | 0/15 |
| POEMS kubalik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| PSO Bounds el-abd noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| PSO el-abd noiseless | 3882 (5177) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | 119 (130) | 227 (253) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| VNS garcia-martinez noiseless | 2.8 (0.8) | 2.7 (0.4) | 2.5 (0.4) | 2.3 (0.3) | 2.3 (0.3) | 1.5 (0.3) | 1.5 (0.3) | 15/15 |
| iAMALGAM bosman noiseless | 1.2 (0.5) | 1.3 (0.3) | 1.3 (0.2) | 1.3 (0.2) | 1.4 (0.2) | 1.0 (0.1) | 1.1 (0.1) | 15/15 |
| Δ fopt f11, 10-D |
1e1 266 |
1e0 1041 |
1e-1 2602 |
1e-2 2954 |
1e-3 3338 |
1e-5 4092 |
1e-7 4843 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 370 (116) | 461 (204) | 491 (121) | 990 (293) | 4306 (3873) | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 4.4 (2) | 1.9 (0.5) | 1.1 (0.4) | 1.2 (0.3) | 1.3 (0.3) | 1.4 (0.2) | 1.5 (0.2) | 15/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BFGS ros noiseless | 1.0 (0.3)★ | 1.00 (0.7) | 1.7 (1) | 6.0 (4) | 56 (66) | ∞ | ∞8e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 13 (2) | 3.8 (0.3) | 1.7 (0.0) | 1.6 (0.1) | 1.5 (0.1) | 1.3 (0.1) | 1.2 (0.0) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 10 (3) | 3.8 (0.9) | 1.9 (0.5) | 2.0 (0.3) | 1.9 (0.2) | 1.7 (0.1) | 1.5 (0.1) | 15/15 |
| Cauchy-EDA posik noiseless | 36 (10) | 13 (2) | 7.0 (0.6) | 7.5 (0.6) | 7.8 (0.5) | 8.3 (1) | 8.8 (1) | 15/15 |
| DASA korosec noiseless | 1292 (757) | 1004 (515) | 754 (375) | 1129 (347) | 1402 (530) | 2033 (458) | 3499 (2159) | 4/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 552 (151) | 994 (598) | 5674 (8167) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| FULLNEWUOA ros noiseless | 291 (182) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| G3PCX posik noiseless | 40 (27) | 22 (9) | 14 (5) | 16 (2) | 17 (5) | 19 (3) | 21 (4) | 15/15 |
| GA nicolau noiseless | 1.6e4 (2e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GLOBAL pal noiseless | 2.5 (0.9) | 1.7 (0.3) | 1.5 (2) | 8.1 (10) | ∞ | ∞ | ∞2e4 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 29 (3) | 8.4 (0.8) | 3.5 (0.3) | 3.2 (0.2) | 2.9 (0.1) | 2.4 (0.1) | 2.1 (0.1) | 15/15 |
| LSfminbnd posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| LSstep posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 39 (4) | 14 (4) | 6.0 (1) | 5.6 (1) | 5.1 (1) | 4.3 (0.5) | 3.8 (0.5) | 15/15 |
| MCS huyer noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| NELDERDOERR doerr noiseless | 13 (7) | 7.8 (4) | 5.4 (1) | 10 (10) | 17 (23) | 93 (97) | ∞2e5 | 0/15 |
| NELDER hansen noiseless | 15 (12) | 8.8 (2) | 6.9 (8) | 13 (10) | 37 (22) | 443 (1146) | ∞1e6 | 0/15 |
| NEWUOA ros noiseless | 11 (5) | 5.5 (1) | 3.1 (0.8) | 3.4 (0.5) | 4.0 (0.8) | 4.3 (0.7) | 4.6 (0.7) | 15/15 |
| ONEFIFTH auger noiseless | 5333 (1663) | 2426 (523) | 1328 (100) | 1522 (132) | 1703 (258) | 1910 (175) | 2962 (1108) | 2/15 |
| POEMS kubalik noiseless | 216 (256) | 203 (116) | 141 (48) | 160 (42) | 208 (68) | 346 (334) | 1512 (1962) | 0/15 |
| PSO Bounds el-abd noiseless | 1449 (631) | 923 (819) | 673 (343) | 1151 (1424) | 1437 (1092) | 3634 (4277) | ∞1e6 | 0/15 |
| PSO el-abd noiseless | 221 (213) | 145 (39) | 101 (30) | 130 (22) | 157 (15) | 192 (24) | 499 (464) | 1/15 |
| RANDOMSEARCH auger noiseless | 5.3e5 (8e5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | 5527 (7143) | 1416 (865) | 567 (298) | 499 (288) | 442 (644) | 361 (403) | 305 (191) | 1/15 |
| VNS garcia-martinez noiseless | 17 (4) | 4.7 (0.9) | 2.0 (0.3) | 1.9 (0.5) | 1.7 (0.1) | 1.5 (0.5) | 1.3 (0.0) | 15/15 |
| iAMALGAM bosman noiseless | 5.7 (0.9) | 2.0 (0.4) | 1.0 (0.2) | 1.0 (0.2) | 1.0 (0.2)★ | 1.00 (0.1)★ | 1.0 (0.1)★ | 15/15 |
| Δ fopt f12, 10-D |
1e1 515 |
1e0 896 |
1e-1 1240 |
1e-2 1390 |
1e-3 1569 |
1e-5 3660 |
1e-7 5154 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 57 (6) | 120 (84) | 206 (274) | 1101 (895) | 5369 (6946) | 1.9e4 (5e4) | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 8.5 (2) | 6.6 (7) | 6.6 (10) | 7.9 (6) | 9.1 (6) | 5.9 (2) | 5.3 (4) | 15/15 |
| BAYEDA gallagher noiseless | 48 (49) | 59 (45) | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BFGS ros noiseless | 1.3 (0.8) | 1.4 (0.6) | 1.4 (0.6) | 1.3 (0.5) | 1.3 (0.4) | 2.6 (4) | 23 (34) | 9/15 |
| BIPOP-CMA-ES hansen noiseless | 3.7 (4) | 4.6 (5) | 5.3 (4) | 5.6 (3) | 5.6 (4) | 3.1 (2) | 2.5 (1) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 4.2 (9) | 5.5 (6) | 6.1 (6) | 7.4 (9) | 7.2 (7) | 3.8 (2) | 3.5 (3) | 15/15 |
| Cauchy-EDA posik noiseless | 84 (10) | 69 (48) | 68 (21) | 71 (28) | 74 (40) | 42 (21) | 34 (11) | 15/15 |
| DASA korosec noiseless | 7067 (2e4) | 4.5e4 (8e4) | 1.1e5 (2e5) | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | 19 (20) | 42 (62) | 112 (45) | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| DIRECT posik noiseless | 29 (25) | 133 (98) | 171 (350) | 340 (378) | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 489 (976) | 301 (284) | 814 (1415) | 4793 (4136) | ∞ | ∞ | ∞1e6 | 0/15 |
| FULLNEWUOA ros noiseless | 2.9 (7) | 4.1 (5) | 4.6 (5) | 6.2 (4) | 6.6 (6) | 4.4 (2) | 4.7 (7) | 14/15 |
| G3PCX posik noiseless | 2.8 (1) | 3.7 (2) | 4.0 (3) | 4.4 (3) | 4.6 (2) | 2.5 (1.0) | 2.0 (1.0) | 15/15 |
| GA nicolau noiseless | 1307 (3899) | 1912 (3347) | 1.1e4 (8065) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GLOBAL pal noiseless | 1.0 (0.3) | 1.0 (0.4) | 1.0 (0.5) | 1 (0.6) | 1.00 (0.4) | 1.0 (0.4) | 2.9 (2) | 2/15 |
| IPOP-SEP-CMA-ES ros noiseless | 3.0 (5) | 4.6 (6) | 5.7 (3) | 6.3 (3) | 6.3 (2) | 3.4 (0.9) | 2.7 (1) | 15/15 |
| LSfminbnd posik noiseless | 98 (49) | 168 (363) | 1130 (605) | 1008 (1043) | 893 (1227) | ∞ | ∞1e5 | 0/15 |
| LSstep posik noiseless | 170 (191) | 731 (670) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 8.0 (3) | 7.2 (7) | 10 (4) | 16 (6) | 25 (23) | 16 (3) | 12 (14) | 15/15 |
| MCS huyer noiseless | 3.2 (5) | 3.9 (4) | 7.0 (10) | 11 (19) | 13 (10) | 76 (71) | 113 (109) | 1/15 |
| NELDERDOERR doerr noiseless | 3.0 (5) | 6.1 (6) | 7.2 (8) | 7.6 (6) | 7.7 (4) | 4.3 (4) | 6.5 (6) | 15/15 |
| NELDER hansen noiseless | 3.0 (3) | 4.7 (3) | 5.3 (4) | 5.3 (3) | 5.4 (4) | 2.8 (2) | 2.3 (2) | 15/15 |
| NEWUOA ros noiseless | 1.9 (2) | 2.0 (2) | 2.1 (2) | 2.3 (1) | 2.3 (1) | 1.2 (0.6) | 1.0 (0.4) | 15/15 |
| ONEFIFTH auger noiseless | 1.5e4 (1e4) | 4.8e4 (6e4) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| POEMS kubalik noiseless | 1077 (979) | 2305 (2788) | 3290 (1614) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| PSO Bounds el-abd noiseless | 583 (498) | 1773 (1954) | 3336 (2615) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| PSO el-abd noiseless | 313 (2) | 1684 (2511) | 5250 (8065) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | 38 (24) | 336 (406) | 1207 (786) | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| VNS garcia-martinez noiseless | 4.9 (5) | 5.6 (2) | 17 (40) | 16 (36) | 15 (19) | 6.9 (14) | 5.2 (6) | 15/15 |
| iAMALGAM bosman noiseless | 5.0 (2) | 4.8 (3) | 4.9 (4) | 5.4 (3) | 5.7 (2) | 3.4 (0.9) | 3.0 (0.9) | 15/15 |
| Δ fopt f13, 10-D |
1e1 387 |
1e0 596 |
1e-1 797 |
1e-2 1014 |
1e-3 4587 |
1e-5 6208 |
1e-7 7779 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 53 (20) | 115 (106) | 476 (252) | 830 (576) | 1150 (1759) | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 6.8 (2) | 6.9 (2) | 7.0 (1) | 6.8 (0.9) | 1.8 (0.3) | 1.8 (0.2) | 1.8 (0.2) | 15/15 |
| BAYEDA gallagher noiseless | 230 (182) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BFGS ros noiseless | 1.00 (0.1) | 1.0 (0.1) | 1.00 (0.0)★ | 1.00 (0.1)★ | 86 (125) | ∞ | ∞1e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 3.6 (2) | 4.2 (3) | 5.6 (5) | 4.8 (2) | 1.3 (0.9) | 1.5 (0.4) | 1.8 (1) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 4.7 (4) | 5.7 (7) | 6.9 (7) | 10 (8) | 3.5 (3) | 4.4 (3) | 6.9 (4) | 12/15 |
| Cauchy-EDA posik noiseless | 45 (6) | 43 (7) | 42 (3) | 41 (4) | 11 (0.8) | 11 (2) | 11 (0.6) | 15/15 |
| DASA korosec noiseless | 222 (199) | 381 (491) | 1175 (1387) | 3628 (3733) | 1786 (1146) | 1.1e4 (8936) | ∞1e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | 58 (63) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| DIRECT posik noiseless | 62 (46) | 163 (221) | 585 (533) | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 142 (7) | 155 (16) | 990 (1254) | 2880 (3459) | 3093 (3543) | ∞ | ∞1e6 | 0/15 |
| FULLNEWUOA ros noiseless | 1.8 (3) | 12 (9) | 25 (12) | 66 (77) | 40 (28) | ∞ | ∞1e5 | 0/15 |
| G3PCX posik noiseless | 13 (23) | 50 (32) | 96 (68) | 155 (112) | 72 (100) | 820 (587) | ∞3e5 | 0/15 |
| GA nicolau noiseless | 481 (720) | 1.1e4 (1e4) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GLOBAL pal noiseless | 1.7 (0.3) | 1.4 (0.2) | 1.3 (0.1) | 1.2 (0.0) | 5.3 (6) | ∞ | ∞5693 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 8.7 (6) | 10 (3) | 9.2 (1) | 8.4 (1) | 2.1 (0.2) | 1.8 (0.2) | 2.0 (0.9) | 15/15 |
| LSfminbnd posik noiseless | 28 (29) | 70 (85) | 178 (176) | 457 (852) | ∞ | ∞ | ∞1e5 | 0/15 |
| LSstep posik noiseless | 472 (363) | 751 (965) | 1828 (2102) | 1455 (1085) | ∞ | ∞ | ∞1e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 16 (15) | 33 (12) | 138 (68) | 160 (271) | 50 (109) | 43 (51) | 43 (78) | 11/15 |
| MCS huyer noiseless | 37 (62) | 44 (71) | 59 (166) | 283 (276) | ∞ | ∞ | ∞4e4 | 0/15 |
| NELDERDOERR doerr noiseless | 7.2 (11) | 16 (11) | 40 (26) | 76 (109) | 64 (121) | 479 (556) | ∞2e5 | 0/15 |
| NELDER hansen noiseless | 4.4 (4) | 9.1 (12) | 15 (18) | 21 (29) | 5.9 (5) | 9.0 (11) | 13 (12) | 15/15 |
| NEWUOA ros noiseless | 2.0 (3) | 9.0 (6) | 20 (26) | 42 (35) | 29 (27) | ∞ | ∞8e4 | 0/15 |
| ONEFIFTH auger noiseless | 11 (18) | 21 (18) | 44 (57) | 99 (183) | 125 (243) | 942 (1075) | 1.9e4 (2e4) | 0/15 |
| POEMS kubalik noiseless | 270 (13) | 2008 (3779) | 5117 (3451) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| PSO Bounds el-abd noiseless | 2333 (3883) | 6788 (9665) | 1.8e4 (3e4) | 1.4e4 (7890) | ∞ | ∞ | ∞1e6 | 0/15 |
| PSO el-abd noiseless | 952 (1292) | 1.1e4 (3e4) | 1.8e4 (2e4) | 1.4e4 (2e4) | ∞ | ∞ | ∞1e6 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | 3.4 (5) | 11 (7) | 15 (15) | 33 (19) | 15 (11) | 106 (248) | ∞1e5 | 0/15 |
| VNS garcia-martinez noiseless | 4.9 (3) | 16 (11) | 20 (5) | 17 (18) | 9.4 (17) | 14 (15) | 20 (47) | 15/15 |
| iAMALGAM bosman noiseless | 3.9 (0.3) | 3.8 (0.6) | 3.9 (0.5) | 3.8 (0.5) | 1.0 (0.1) | 1.00 (0.1) | 1.0 (0.1) | 15/15 |
| Δ fopt f14, 10-D |
1e1 37 |
1e0 98 |
1e-1 133 |
1e-2 205 |
1e-3 392 |
1e-5 687 |
1e-7 4305 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 19 (9) | 50 (9) | 73 (8) | 76 (8) | 85 (31) | 1364 (473) | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 4.6 (3) | 9.0 (2) | 13 (5) | 12 (3) | 8.5 (2) | 7.5 (1) | 1.6 (0.2) | 15/15 |
| BAYEDA gallagher noiseless | 7.8 (10) | 75 (58) | 109 (122) | 207 (348) | ∞ | ∞ | ∞2e4 | 0/15 |
| BFGS ros noiseless | 1.6 (0.5) | 1.6 (0.7) | 1.6 (0.7) | 1.4 (0.3) | 1.0 (0.2) | 1.00 (0.7)★ | ∞9e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 2.6 (2) | 3.3 (0.4) | 3.8 (0.8) | 4.1 (0.5) | 4.3 (0.7) | 5.2 (0.5) | 1.4 (0.1) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 1.9 (0.9) | 2.0 (0.6) | 2.2 (0.5) | 2.4 (0.5) | 2.5 (0.7) | 4.4 (1) | 1.1 (0.3) | 15/15 |
| Cauchy-EDA posik noiseless | 70 (62) | 85 (20) | 94 (14) | 88 (17) | 60 (11) | 50 (8) | 11 (2) | 15/15 |
| DASA korosec noiseless | 14 (9) | 13 (6) | 14 (2) | 15 (3) | 80 (41) | 3574 (1728) | ∞1e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | 6.6 (5) | 10 (3) | 15 (3) | 21 (4) | 33 (30) | ∞ | ∞2e4 | 0/15 |
| DIRECT posik noiseless | 2.5 (2) | 11 (5) | 50 (65) | 108 (139) | 497 (260) | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 4.2 (2) | 126 (37) | 244 (21) | 252 (26) | 173 (8) | 1113 (1234) | ∞1e6 | 0/15 |
| FULLNEWUOA ros noiseless | 3.1 (1) | 1.8 (0.4) | 2.0 (0.5) | 1.7 (0.2) | 1.4 (0.2) | 12 (0.8) | ∞1e5 | 0/15 |
| G3PCX posik noiseless | 3.9 (0.9) | 2.8 (0.3) | 3.0 (0.6) | 3.1 (0.3) | 2.9 (0.5) | 16 (7) | 122 (72) | 0/15 |
| GA nicolau noiseless | 18 (34) | 248 (30) | 371 (15) | 396 (61) | 4249 (8949) | ∞ | ∞1e6 | 0/15 |
| GLOBAL pal noiseless | 8.0 (2) | 3.7 (0.2) | 3.1 (0.2) | 2.3 (0.1) | 1.4 (0.1) | 1.1 (0.0) | ∞3306 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 3.0 (3) | 3.2 (1) | 3.7 (0.7) | 3.9 (0.3) | 5.2 (2) | 8.9 (0.7) | 2.0 (0.2) | 15/15 |
| LSfminbnd posik noiseless | 7.5 (4) | 5.5 (2) | 5.6 (0.8) | 8.1 (0.7) | 52 (13) | ∞ | ∞1e5 | 0/15 |
| LSstep posik noiseless | 147 (65) | 122 (24) | 115 (28) | 167 (29) | ∞ | ∞ | ∞1e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 4.3 (1) | 8.4 (0.6) | 12 (2) | 13 (3) | 13 (2) | 16 (3) | 3.6 (0.2) | 15/15 |
| MCS huyer noiseless | 1.1 (0.4) | 2.4 (0.5) | 2.9 (1) | 2.8 (1) | 2.8 (1) | ∞ | ∞4e4 | 0/15 |
| NELDERDOERR doerr noiseless | 1.1 (0.4) | 2.4 (4) | 2.8 (0.3) | 3.5 (3) | 3.7 (2) | 6.2 (3) | 43 (46) | 0/15 |
| NELDER hansen noiseless | 1.2 (1.0) | 2.1 (0.9) | 2.9 (2) | 2.9 (0.6) | 2.6 (0.4) | 4.2 (2) | 8.8 (9) | 11/15 |
| NEWUOA ros noiseless | 1.00 (0.3) | 1.0 (0.2) | 1.00 (0.2)★ | 1.00 (0.2)★ | 1.00 (0.1) | 7.3 (1.0) | 566 (707) | 0/15 |
| ONEFIFTH auger noiseless | 2.2 (1) | 2.1 (1) | 2.1 (0.7) | 2.3 (0.4) | 4.6 (0.9) | 576 (35) | ∞1e7 | 0/15 |
| POEMS kubalik noiseless | 68 (13) | 50 (20) | 105 (9) | 139 (13) | 119 (3) | 2949 (3636) | ∞1e6 | 0/15 |
| PSO Bounds el-abd noiseless | 3.7 (2) | 29 (12) | 93 (43) | 181 (57) | 226 (89) | ∞ | ∞1e6 | 0/15 |
| PSO el-abd noiseless | 3.2 (2) | 8.6 (3) | 17 (4) | 22 (5) | 28 (5) | 2052 (1457) | ∞1e6 | 0/15 |
| RANDOMSEARCH auger noiseless | 17 (9) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | 2.1 (0.7) | 1.3 (0.2) | 1.4 (0.3) | 1.7 (0.4) | 6.3 (1) | 189 (330) | ∞1e5 | 0/15 |
| VNS garcia-martinez noiseless | 7.6 (2) | 5.3 (0.7) | 5.5 (0.5) | 5.5 (0.8) | 6.1 (0.6) | 7.4 (2) | 1.8 (0.4) | 15/15 |
| iAMALGAM bosman noiseless | 2.2 (0.9) | 5.0 (1) | 7.2 (0.6) | 7.0 (0.7) | 5.0 (0.4) | 4.5 (0.4) | 1 (0.1) | 15/15 |
| Δ fopt f15, 10-D |
1e1 4774 |
1e0 39246 |
1e-1 73643 |
1e-2 74669 |
1e-3 75790 |
1e-5 77814 |
1e-7 79834 |
#succ 12/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 15 (27) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 1.0 (0.5) | 3.5 (3) | 3.7 (3) | 3.7 (3) | 3.7 (3) | 3.7 (3) | 3.6 (2) | 15/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BFGS ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.0 (1) | 1.7 (0.7) | 1.3 (0.5) | 1.3 (0.6) | 1.3 (0.4) | 1.3 (0.4) | 1.3 (0.6) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 147 (126) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DASA korosec noiseless | 2.9e4 (3e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| DIRECT posik noiseless | 84 (142) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 7.0 (2) | 167 (268) | 191 (329) | 189 (84) | 186 (343) | 182 (231) | 177 (323) | 1/15 |
| FULLNEWUOA ros noiseless | 300 (246) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| G3PCX posik noiseless | 1456 (1150) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| GA nicolau noiseless | 27 (4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GLOBAL pal noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞9182 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.2 (1) | 1.0 (0.6) | 1.0 (0.7) | 1.00 (0.9) | 1.00 (0.6) | 1.0 (1.0) | 1.0 (1) | 12/15 |
| LSfminbnd posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| LSstep posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 3.6 (3) | 23 (48) | 98 (56) | 96 (94) | 95 (145) | 92 (63) | 90 (138) | 1/15 |
| MCS huyer noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| NELDERDOERR doerr noiseless | 47 (43) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NELDER hansen noiseless | 241 (150) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NEWUOA ros noiseless | 170 (349) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6e4 | 0/15 |
| ONEFIFTH auger noiseless | 2132 (2216) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| POEMS kubalik noiseless | 320 (577) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| PSO Bounds el-abd noiseless | 359 (681) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| PSO el-abd noiseless | 840 (681) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| VNS garcia-martinez noiseless | 6.5 (5) | 4267 (6005) | 6198 (4853) | 6113 (1e4) | 6023 (6835) | 5866 (7850) | 7664 (1e4) | 1/15 |
| iAMALGAM bosman noiseless | 2.6 (5) | 9.4 (11) | 10 (4) | 10 (12) | 10 (11) | 10 (10) | 10 (7) | 15/15 |
| Δ fopt f16, 10-D |
1e1 425 |
1e0 7029 |
1e-1 15779 |
1e-2 45669 |
1e-3 51151 |
1e-5 65798 |
1e-7 71570 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 8.2 (6) | 3.0 (2) | 56 (57) | 469 (1044) | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 8.5 (3) | 4.9 (7) | 5.8 (4) | 4.5 (4) | 5.1 (6) | 4.2 (3) | 3.9 (4) | 15/15 |
| BAYEDA gallagher noiseless | 41 (48) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BFGS ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 3.0 (2) | 1.00 (0.8) | 1.0 (0.4) | 1.00 (1) | 1.00 (1) | 1 (0.5) | 1.00 (0.6) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 5.4 (16) | 49 (28) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| Cauchy-EDA posik noiseless | 400 (239) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DASA korosec noiseless | 186 (334) | 2989 (2518) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | 166 (206) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| DIRECT posik noiseless | 2.5 (3) | 1.6 (1) | 2.4 (2) | 10 (12) | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 55 (75) | 126 (224) | 190 (245) | 95 (188) | 131 (226) | 102 (160) | 95 (93) | 2/15 |
| FULLNEWUOA ros noiseless | 3.6 (6) | 16 (28) | 90 (111) | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| G3PCX posik noiseless | 4.7 (16) | 69 (71) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| GA nicolau noiseless | 28 (23) | 126 (181) | 905 (475) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GLOBAL pal noiseless | 1.0 (0.1) | 1.7 (2) | ∞ | ∞ | ∞ | ∞ | ∞7837 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.9 (5) | 1.2 (1) | 1.6 (1) | 1.2 (0.8) | 1.3 (1) | 1.3 (2) | 1.2 (0.7) | 11/15 |
| LSfminbnd posik noiseless | 7.9 (13) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| LSstep posik noiseless | 51 (32) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 2.0 (3) | 16 (21) | 462 (768) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| MCS huyer noiseless | 17 (7) | 86 (103) | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| NELDERDOERR doerr noiseless | 1.4 (4) | 23 (17) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NELDER hansen noiseless | 17 (30) | 100 (180) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NEWUOA ros noiseless | 4.7 (5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞9e4 | 0/15 |
| ONEFIFTH auger noiseless | 65 (57) | 3736 (2692) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| POEMS kubalik noiseless | 12 (7) | 4.4 (0.9) | 58 (142) | 61 (88) | 79 (39) | 62 (57) | 92 (98) | 2/15 |
| PSO Bounds el-abd noiseless | 42 (39) | 140 (181) | 264 (269) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| PSO el-abd noiseless | 5.2 (4) | 130 (142) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| RANDOMSEARCH auger noiseless | 43 (46) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | 770 (471) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| VNS garcia-martinez noiseless | 4.2 (1) | 3.7 (3) | 28 (32) | 37 (54) | 182 (212) | 671 (897) | 1613 (1573) | 3/15 |
| iAMALGAM bosman noiseless | 3.3 (0.7) | 1.8 (3) | 6.5 (11) | 8.2 (17) | 10 (18) | 8.6 (6) | 8.0 (20) | 15/15 |
| Δ fopt f17, 10-D |
1e1 26 |
1e0 429 |
1e-1 2203 |
1e-2 6329 |
1e-3 9851 |
1e-5 20190 |
1e-7 26503 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 3.6 (6) | 18 (2) | 19 (7) | 130 (118) | 1134 (1268) | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 2.8 (2) | 3.7 (2) | 1.5 (0.5) | 1.7 (3) | 2.3 (4) | 4.1 (3) | 4.0 (0.5) | 15/15 |
| BAYEDA gallagher noiseless | 4.0 (6) | 11 (4) | 6.4 (5) | 7.3 (18) | ∞ | ∞ | ∞2e4 | 0/15 |
| BFGS ros noiseless | 53 (68) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.7 (2) | 1.1 (0.3) | 1.7 (2) | 1.0 (0.7) | 1.0 (0.2) | 1.00 (0.3) | 1.0 (0.5) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 14 (4) | 621 (529) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| Cauchy-EDA posik noiseless | 68 (80) | 35 (22) | 27 (3) | 12 (2) | 9.4 (40) | 6.2 (13) | 6.6 (10) | 14/15 |
| DASA korosec noiseless | 108 (241) | 2.0e4 (4e4) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | 5.6 (3) | 6.7 (9) | 4.9 (5) | 15 (23) | ∞ | ∞ | ∞2e4 | 0/15 |
| DIRECT posik noiseless | 1.4 (0.8) | 3.7 (2) | 7.2 (7) | 23 (25) | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 2.4 (2) | 44 (5) | 22 (1) | 13 (0.8) | 11 (0.6) | 8.8 (0.2) | 9.4 (0.2) | 15/15 |
| FULLNEWUOA ros noiseless | 3.1 (2) | 294 (314) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| G3PCX posik noiseless | 3.0 (2) | 5392 (3048) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| GA nicolau noiseless | 4.9 (3) | 77 (9) | 45 (5) | 212 (395) | 1458 (1979) | ∞ | ∞1e6 | 0/15 |
| GLOBAL pal noiseless | 3.9 (3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.6 (1) | 1.00 (0.7) | 1.1 (2) | 1.3 (2) | 1.3 (1) | 1.0 (0.3) | 1.1 (0.5) | 15/15 |
| LSfminbnd posik noiseless | 35 (108) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| LSstep posik noiseless | 973 (1466) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 2.8 (2) | 5.0 (2) | 8.9 (1) | 15 (40) | 21 (30) | 26 (34) | 53 (43) | 3/15 |
| MCS huyer noiseless | 1.0 (2) | 1374 (774) | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| NELDERDOERR doerr noiseless | 1.2 (0.9) | 447 (594) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NELDER hansen noiseless | 20 (66) | 4178 (4742) | 6647 (7674) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NEWUOA ros noiseless | 1.4 (0.7) | 2143 (2061) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| ONEFIFTH auger noiseless | 3572 (1e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| POEMS kubalik noiseless | 93 (30) | 23 (6) | 15 (6) | 33 (41) | 58 (51) | 142 (161) | 251 (198) | 2/15 |
| PSO Bounds el-abd noiseless | 1.5 (1) | 29 (20) | 322 (1141) | 1036 (1896) | 1435 (2208) | ∞ | ∞1e6 | 0/15 |
| PSO el-abd noiseless | 1.6 (1) | 5.0 (3) | 231 (795) | 1030 (1699) | ∞ | ∞ | ∞1e6 | 0/15 |
| RANDOMSEARCH auger noiseless | 3.3 (3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | 8399 (2e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| VNS garcia-martinez noiseless | 5.8 (4) | 1.4 (0.5) | 1.00 (0.1) | 2.2 (2) | 7.7 (8) | 326 (393) | ∞7e7 | 0/15 |
| iAMALGAM bosman noiseless | 1.7 (1) | 1.8 (0.3) | 3.3 (0.1) | 2.2 (4) | 3.6 (4) | 8.6 (8) | 12 (11) | 15/15 |
| Δ fopt f18, 10-D |
1e1 238 |
1e0 836 |
1e-1 7012 |
1e-2 15928 |
1e-3 27536 |
1e-5 37234 |
1e-7 42708 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 13 (2) | 20 (21) | 60 (99) | 4706 (5415) | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 2.9 (0.5) | 2.8 (0.6) | 1.4 (0.1) | 1.5 (3) | 2.2 (2) | 2.7 (0.4) | 2.4 (0.3) | 15/15 |
| BAYEDA gallagher noiseless | 8.8 (3) | 13 (5) | 6.4 (4) | 19 (22) | ∞ | ∞ | ∞2e4 | 0/15 |
| BFGS ros noiseless | 4958 (3297) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.00 (0.5) | 1.00 (0.3) | 1.00 (1.0) | 1.0 (0.9) | 1.2 (0.6) | 1.1 (0.5) | 1.2 (0.4) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 109 (199) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| Cauchy-EDA posik noiseless | 31 (18) | 24 (10) | 5.2 (0.8) | 3.6 (0.7) | 2.8 (0.6) | 3.1 (0.7) | 4.1 (1.0) | 15/15 |
| DASA korosec noiseless | 1371 (2591) | 8.1e4 (9e4) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | 4.3 (2) | 10 (4) | 13 (15) | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| DIRECT posik noiseless | 2.3 (0.6) | 8.1 (3) | 4.2 (1) | 28 (33) | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 28 (15) | 42 (3) | 9.2 (0.6) | 6.0 (0.4) | 7.5 (18) | 79 (60) | ∞1e6 | 0/15 |
| FULLNEWUOA ros noiseless | 122 (154) | 1709 (1884) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| G3PCX posik noiseless | 795 (1018) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| GA nicolau noiseless | 57 (17) | 84 (10) | 124 (146) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GLOBAL pal noiseless | 84 (162) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 4.4 (0.3) | 2.8 (4) | 1.2 (0.8) | 1.1 (0.8) | 1.0 (0.5) | 1.0 (0.1) | 1.00 (0.1) | 15/15 |
| LSfminbnd posik noiseless | 211 (281) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| LSstep posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 2.5 (0.6) | 6.1 (2) | 12 (0.7) | 49 (32) | 255 (336) | ∞ | ∞5e5 | 0/15 |
| MCS huyer noiseless | 57 (73) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| NELDERDOERR doerr noiseless | 72 (112) | 3542 (4665) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NELDER hansen noiseless | 506 (209) | 8349 (9831) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NEWUOA ros noiseless | 558 (211) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| ONEFIFTH auger noiseless | 2.8e5 (3e5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| POEMS kubalik noiseless | 19 (3) | 28 (2) | 42 (107) | 130 (141) | 239 (227) | ∞ | ∞1e6 | 0/15 |
| PSO Bounds el-abd noiseless | 10 (15) | 139 (331) | 581 (1032) | 883 (1507) | ∞ | ∞ | ∞1e6 | 0/15 |
| PSO el-abd noiseless | 3.5 (2) | 2400 (1497) | 1997 (2104) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| RANDOMSEARCH auger noiseless | 3328 (6556) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| VNS garcia-martinez noiseless | 1.7 (0.3) | 1.1 (0.1) | 1.8 (4) | 22 (10) | 93 (129) | ∞ | ∞6e7 | 0/15 |
| iAMALGAM bosman noiseless | 1.6 (0.4) | 3.3 (14) | 1.4 (2) | 2.9 (5) | 3.1 (3) | 6.5 (3) | 9.1 (4) | 15/15 |
| Δ fopt f19, 10-D |
1e1 1 |
1e0 1 |
1e-1 10609 |
1e-2 9.8e5 |
1e-3 1.4e6 |
1e-5 1.4e6 |
1e-7 1.4e6 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 405 (351) | 7.7e4 (4e4) | 549 (377) | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 160 (45) | 7346 (2054) | 83 (471) | 7.7 (5) | 8.8 (5) | 8.7 (9) | 8.6 (10) | 9/15 |
| BAYEDA gallagher noiseless | 211 (148) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BFGS ros noiseless | 1.9e4 (2e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 52 (28) | 9423 (4940) | 10 (8) | 1.00 (0.3) | 1.0 (0.4) | 1.00 (0.3) | 1.0 (0.4) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 63 (42) | 8.7e4 (1e5) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| Cauchy-EDA posik noiseless | 1401 (883) | 3.4e6 (4e6) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DASA korosec noiseless | 7112 (2e4) | 1.5e7 (2e7) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | 206 (134) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| DIRECT posik noiseless | 1 (0) | 1 (0) | 16 (21) | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 129 (74) | 3.7e5 (6e5) | 1333 (3959) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| FULLNEWUOA ros noiseless | 146 (129) | 1.4e5 (2e5) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| G3PCX posik noiseless | 3.6e4 (82) | 1.5e6 (8e5) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| GA nicolau noiseless | 1004 (983) | 1.7e5 (7e4) | 293 (308) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GLOBAL pal noiseless | 372 (310) | 1.2e5 (1e5) | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 54 (16) | 1.6e4 (2e4) | 17 (9) | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| LSfminbnd posik noiseless | 200 (119) | 1.4e6 (2e6) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| LSstep posik noiseless | 2658 (729) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 123 (35) | 8607 (8876) | 87 (90) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| MCS huyer noiseless | 1 (0) | 1 (0) | 1.0 (0.0)★ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| NELDERDOERR doerr noiseless | 24 (16) | 1.2e4 (2e4) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NELDER hansen noiseless | 28 (11) | 2.8e4 (3e4) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NEWUOA ros noiseless | 27 (12) | 3.2e5 (6e5) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| ONEFIFTH auger noiseless | 6541 (173) | 2.8e7 (3e7) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| POEMS kubalik noiseless | 2513 (290) | 2.1e5 (3e5) | 1374 (2262) | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| PSO Bounds el-abd noiseless | 122 (80) | 9.2e5 (2e6) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| PSO el-abd noiseless | 113 (60) | 3.7e5 (7e5) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| RANDOMSEARCH auger noiseless | 500 (290) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | 6.5e5 (6e5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| VNS garcia-martinez noiseless | 219 (41) | 3.1e4 (5e4) | 1927 (3523) | ∞ | ∞ | ∞ | ∞5e7 | 0/15 |
| iAMALGAM bosman noiseless | 78 (62) | 2.5e5 (971) | 368 (824) | 73 (92) | 109 (97) | 108 (112) | 107 (70) | 1/15 |
| Δ fopt f20, 10-D |
1e1 32 |
1e0 15426 |
1e-1 5.5e5 |
1e-2 5.7e5 |
1e-3 5.7e5 |
1e-5 5.8e5 |
1e-7 5.9e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 61 (18) | 1.6 (4) | 10 (6) | 10 (6) | 10 (3) | 9.4 (14) | 10 (7) | 9/15 |
| AMALGAM bosman noiseless | 11 (1) | 18 (16) | 271 (428) | 263 (220) | 260 (192) | 256 (336) | 253 (335) | 1/15 |
| BAYEDA gallagher noiseless | 30 (5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BFGS ros noiseless | 2.3 (0.5) | 1.1 (0.9) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 5.5 (3) | 3.6 (3) | 1.00 (0.3) | 1.0 (0.3) | 1.00 (0.3) | 1.0 (0.3) | 1.0 (0.4) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 3.3 (2) | 3.3 (5) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| Cauchy-EDA posik noiseless | 143 (42) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DASA korosec noiseless | 30 (10) | 1.9 (1) | 268 (186) | 260 (286) | 258 (223) | 254 (194) | 250 (187) | 1/15 |
| DE-PSO garcia-nieto noiseless | 15 (3) | 1.1 (0.9) | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| DIRECT posik noiseless | 16 (0.0) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 91 (86) | 7.8 (17) | 3.8 (5) | 3.7 (8) | 3.7 (2) | 3.7 (5) | 3.7 (7) | 5/15 |
| FULLNEWUOA ros noiseless | 2.1 (0) | 10 (12) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| G3PCX posik noiseless | 6.1 (0.9) | 12 (23) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| GA nicolau noiseless | 360 (64) | 3.2 (0.3) | 1.8 (5) | 2.0 (5) | 2.6 (4) | ∞ | ∞1e6 | 0/15 |
| GLOBAL pal noiseless | 11 (0.7) | 2.6 (2) | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 4.8 (2) | 3.1 (2) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| LSfminbnd posik noiseless | 13 (6) | 3.5 (3) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| LSstep posik noiseless | 300 (97) | 8.3 (11) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 9.3 (2) | 2.2 (3) | 1.1 (1.0) | 1.1 (1) | 1.1 (2) | 1.1 (1) | 1.1 (0.6) | 8/15 |
| MCS huyer noiseless | 4.4 (0.3) | 1.0 (1) | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| NELDERDOERR doerr noiseless | 2.3 (0.7) | 5.7 (12) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NELDER hansen noiseless | 2.3 (2) | 16 (22) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NEWUOA ros noiseless | 1.00 (0.3) | 1.9 (2) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| ONEFIFTH auger noiseless | 3.0 (1) | 7.2 (9) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| POEMS kubalik noiseless | 97 (11) | 1.1 (0.2) | 12 (16) | 12 (11) | 12 (15) | 12 (9) | 12 (18) | 2/15 |
| PSO Bounds el-abd noiseless | 38 (10) | 2.0 (0.9) | 5.1 (8) | 7.1 (4) | 7.1 (12) | 7.0 (4) | 7.4 (11) | 3/15 |
| PSO el-abd noiseless | 10 (5) | 1.5 (2) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| RANDOMSEARCH auger noiseless | 8204 (6943) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | 3.1 (1) | 1.7 (2) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| VNS garcia-martinez noiseless | 11 (2) | 1.2 (1) | 52 (49) | 50 (26) | 50 (69) | 49 (67) | 51 (47) | 15/15 |
| iAMALGAM bosman noiseless | 6.2 (2) | 38 (33) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Δ fopt f21, 10-D |
1e1 130 |
1e0 2236 |
1e-1 4392 |
1e-2 4487 |
1e-3 4618 |
1e-5 5074 |
1e-7 11329 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 21 (9) | 4.5 (0.9) | 5.0 (1) | 5.8 (3) | 6.6 (5) | 8.0 (3) | 4.6 (2) | 15/15 |
| AMALGAM bosman noiseless | 27 (2) | 139 (99) | 118 (194) | 116 (335) | 113 (326) | 105 (301) | 48 (77) | 15/15 |
| BAYEDA gallagher noiseless | 48 (56) | 27 (38) | 32 (27) | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BFGS ros noiseless | 4.6 (4) | 2.9 (2) | 2.8 (5) | 2.7 (2) | 2.7 (3) | 2.5 (3) | 2.0 (2) | 6/15 |
| BIPOP-CMA-ES hansen noiseless | 5.9 (10) | 28 (51) | 16 (29) | 15 (30) | 15 (13) | 14 (25) | 6.3 (7) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 10 (11) | 6.1 (9) | 5.1 (4) | 5.0 (6) | 4.9 (6) | 4.5 (5) | 2.0 (2) | 15/15 |
| Cauchy-EDA posik noiseless | 79 (58) | 343 (559) | 316 (513) | 310 (446) | 302 (461) | 275 (345) | 124 (176) | 4/15 |
| DASA korosec noiseless | 173 (292) | 498 (636) | 430 (485) | 421 (553) | 409 (488) | 373 (381) | 167 (162) | 15/15 |
| DE-PSO garcia-nieto noiseless | 11 (3) | 26 (35) | 19 (11) | 19 (19) | 18 (17) | 17 (36) | 7.8 (4) | 3/15 |
| DIRECT posik noiseless | 2.5 (0.8) | 7.5 (12) | 17 (29) | 36 (40) | 35 (60) | 34 (20) | 17 (18) | 1/5 |
| EDA-PSO el-abd noiseless | 53 (21) | 1238 (1009) | 915 (512) | 898 (948) | 874 (1408) | 799 (887) | 359 (177) | 3/15 |
| FULLNEWUOA ros noiseless | 4.4 (4) | 7.3 (9) | 4.4 (4) | 4.3 (5) | 4.2 (4) | 3.8 (4) | 1.7 (3) | 15/15 |
| G3PCX posik noiseless | 5.0 (0.4) | 13 (7) | 9.0 (8) | 8.8 (6) | 8.6 (10) | 7.8 (5) | 3.5 (4) | 15/15 |
| GA nicolau noiseless | 91 (31) | 85 (450) | 95 (172) | 97 (59) | 126 (219) | 123 (246) | 260 (311) | 3/15 |
| GLOBAL pal noiseless | 3.6 (0.3) | 1.0 (1) | 1.00 (2) | 1.00 (0.9) | 1.00 (0.8) | 1.00 (0.7) | 1.0 (1) | 4/15 |
| IPOP-SEP-CMA-ES ros noiseless | 6.0 (10) | 14 (15) | 10 (26) | 10 (13) | 10 (2) | 9.1 (2) | 4.1 (9) | 11/15 |
| LSfminbnd posik noiseless | 99 (106) | 105 (141) | 166 (229) | 163 (219) | 158 (207) | 144 (122) | 65 (67) | 2/15 |
| LSstep posik noiseless | 689 (586) | 634 (984) | 327 (296) | 323 (602) | 317 (184) | 294 (355) | ∞1e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 7.5 (6) | 66 (97) | 43 (78) | 42 (63) | 41 (25) | 38 (31) | 17 (22) | 13/15 |
| MCS huyer noiseless | 1.0 (0.7) | 20 (54) | 10 (11) | 10 (8) | 10 (12) | 9.1 (8) | 4.9 (5) | 6/15 |
| NELDERDOERR doerr noiseless | 8.4 (9) | 6.0 (4) | 3.7 (4) | 3.6 (8) | 3.5 (6) | 3.3 (5) | 1.6 (2) | 15/15 |
| NELDER hansen noiseless | 20 (26) | 16 (18) | 16 (20) | 16 (15) | 15 (12) | 14 (15) | 6.2 (9) | 15/15 |
| NEWUOA ros noiseless | 2.1 (6) | 7.4 (14) | 4.8 (11) | 4.7 (6) | 4.6 (9) | 4.2 (8) | 1.9 (0.6) | 13/15 |
| ONEFIFTH auger noiseless | 10 (16) | 20 (18) | 18 (22) | 18 (28) | 17 (7) | 16 (26) | 7.1 (10) | 15/15 |
| POEMS kubalik noiseless | 295 (964) | 1792 (1899) | 1482 (3301) | 1452 (2507) | 1412 (2436) | 1287 (1577) | 577 (684) | 2/15 |
| PSO Bounds el-abd noiseless | 559 (3850) | 1233 (1901) | 1484 (3018) | 1454 (1396) | 1414 (2438) | 1291 (887) | 580 (574) | 2/15 |
| PSO el-abd noiseless | 1188 (3847) | 512 (783) | 342 (569) | 335 (334) | 326 (162) | 297 (690) | 133 (110) | 6/15 |
| RANDOMSEARCH auger noiseless | 573 (287) | 6.4e4 (1e5) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | 16 (12) | 18 (6) | 12 (12) | 12 (12) | 12 (17) | 11 (19) | 4.8 (6) | 12/15 |
| VNS garcia-martinez noiseless | 10 (27) | 22 (30) | 30 (66) | 46 (11) | 66 (194) | 68 (47) | 32 (28) | 15/15 |
| iAMALGAM bosman noiseless | 3.2 (1) | 49 (16) | 44 (102) | 44 (102) | 43 (70) | 40 (65) | 18 (30) | 15/15 |
| Δ fopt f22, 10-D |
1e1 98 |
1e0 2839 |
1e-1 6353 |
1e-2 6620 |
1e-3 6798 |
1e-5 8296 |
1e-7 10351 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 33 (6) | 7.0 (6) | 12 (14) | 15 (7) | 18 (6) | 24 (24) | 27 (12) | 15/15 |
| AMALGAM bosman noiseless | 8.8 (3) | 488 (366) | 4883 (4635) | 4702 (4536) | 4584 (6319) | 3759 (4900) | 3015 (3485) | 4/15 |
| BAYEDA gallagher noiseless | 62 (17) | 31 (17) | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BFGS ros noiseless | 6.6 (5) | 3.1 (3) | 4.4 (3) | 4.2 (5) | 4.2 (3) | 3.5 (3) | 5.7 (4) | 7/15 |
| BIPOP-CMA-ES hansen noiseless | 29 (49) | 58 (131) | 201 (258) | 193 (248) | 188 (210) | 154 (134) | 123 (116) | 9/15 |
| CMA-ESPLUSSEL auger noiseless | 9.3 (9) | 3.7 (4) | 3.4 (6) | 3.3 (6) | 3.2 (6) | 2.7 (3) | 2.2 (2) | 15/15 |
| Cauchy-EDA posik noiseless | 453 (56) | 359 (574) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DASA korosec noiseless | 320 (612) | 218 (152) | 192 (272) | 187 (355) | 185 (195) | 158 (189) | 136 (109) | 15/15 |
| DE-PSO garcia-nieto noiseless | 66 (157) | 47 (23) | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| DIRECT posik noiseless | 3.5 (0.6) | 5.1 (2) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 1642 (29) | 979 (1145) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| FULLNEWUOA ros noiseless | 3.6 (5) | 1.1 (2) | 1.9 (4) | 1.8 (4) | 1.8 (1) | 1.5 (2) | 1.3 (2) | 15/15 |
| G3PCX posik noiseless | 9.3 (14) | 5.6 (5) | 5.6 (11) | 5.5 (8) | 5.4 (10) | 4.5 (10) | 3.7 (5) | 15/15 |
| GA nicolau noiseless | 130 (55) | 722 (527) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GLOBAL pal noiseless | 4.5 (2) | 1 (1) | 1 (0.8) | 1.00 (1) | 1.0 (1) | 1.0 (0.7) | 1 (1.0) | 2/15 |
| IPOP-SEP-CMA-ES ros noiseless | 22 (27) | 61 (103) | 222 (261) | 213 (163) | 207 (100) | 170 (282) | 136 (192) | 1/15 |
| LSfminbnd posik noiseless | 174 (290) | 26 (33) | 48 (50) | 47 (44) | 48 (76) | 42 (26) | 72 (109) | 1/15 |
| LSstep posik noiseless | 332 (77) | 89 (122) | 234 (55) | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 55 (5) | 505 (725) | 537 (767) | 515 (666) | 502 (699) | 412 (463) | 330 (269) | 2/15 |
| MCS huyer noiseless | 1.1 (1) | 3.2 (4) | 6.4 (9) | 6.1 (5) | 6.0 (10) | 4.9 (6) | 12 (14) | 3/15 |
| NELDERDOERR doerr noiseless | 18 (14) | 2.5 (2) | 5.0 (9) | 4.9 (3) | 4.9 (2) | 4.0 (1) | 3.3 (1) | 14/15 |
| NELDER hansen noiseless | 1.00 (0.6) | 7.4 (10) | 10 (10) | 10 (11) | 9.4 (10) | 7.8 (9) | 6.2 (8) | 15/15 |
| NEWUOA ros noiseless | 6.7 (11) | 1.8 (1) | 2.5 (4) | 2.4 (1) | 2.4 (2) | 2.0 (0.3) | 1.7 (2) | 14/15 |
| ONEFIFTH auger noiseless | 47 (87) | 17 (12) | 13 (13) | 13 (14) | 13 (15) | 11 (11) | 8.9 (9) | 15/15 |
| POEMS kubalik noiseless | 4421 (1e4) | 1414 (1497) | 1026 (630) | 986 (1171) | 961 (1618) | 790 (1055) | 636 (266) | 2/15 |
| PSO Bounds el-abd noiseless | 744 (2557) | 1413 (2555) | 2206 (2282) | 2120 (1699) | 2094 (1839) | 1742 (964) | 1404 (2150) | 1/15 |
| PSO el-abd noiseless | 3720 (7660) | 1410 (2818) | 2204 (2558) | 2117 (2983) | 2064 (2905) | 1698 (3646) | 1367 (1618) | 1/15 |
| RANDOMSEARCH auger noiseless | 2467 (3076) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | 35 (62) | 5.0 (5) | 5.4 (7) | 5.3 (5) | 5.3 (3) | 4.7 (8) | 4.1 (3) | 13/15 |
| VNS garcia-martinez noiseless | 39 (71) | 158 (480) | 1054 (2359) | 1424 (2672) | 1479 (3056) | 1221 (802) | 981 (2756) | 15/15 |
| iAMALGAM bosman noiseless | 24 (1) | 167 (155) | 1197 (1069) | 1152 (1157) | 1124 (778) | 925 (1115) | 745 (809) | 11/15 |
| Δ fopt f23, 10-D |
1e1 3.0 |
1e0 915 |
1e-1 16425 |
1e-2 1.8e5 |
1e-3 2.0e5 |
1e-5 2.1e5 |
1e-7 2.1e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 1.6 (2) | 42 (22) | 1049 (2001) | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 1.5 (2) | 10 (3) | 1.0 (0.3) | 1.00 (0.2) | 1.0 (1) | 1.0 (3) | 1.0 (2) | 15/15 |
| BAYEDA gallagher noiseless | 1.2 (1) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BFGS ros noiseless | 15 (55) | 128 (179) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.9 (4) | 21 (17) | 2.7 (3) | 1.3 (1.0) | 1.2 (0.5) | 1.2 (1) | 1.2 (0.9) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 3.2 (2) | 2.9 (6) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| Cauchy-EDA posik noiseless | 2.1 (1) | 1664 (3135) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DASA korosec noiseless | 4.6 (5) | 28 (45) | 4251 (3349) | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | 1.6 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| DIRECT posik noiseless | 1.9 (2) | 2.1 (3) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 1.6 (2) | 589 (707) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| FULLNEWUOA ros noiseless | 12 (8) | 2.9 (4) | 44 (42) | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| G3PCX posik noiseless | 1.7 (2) | 4.9 (3) | 98 (176) | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| GA nicolau noiseless | 1.3 (1) | 393 (202) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GLOBAL pal noiseless | 2.0 (2) | 1 (0.8) | ∞ | ∞ | ∞ | ∞ | ∞6594 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.2 (2) | 17 (9) | 12 (13) | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| LSfminbnd posik noiseless | 2.0 (1) | 26 (14) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| LSstep posik noiseless | 1.2 (0.8) | 31 (11) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 1.9 (1) | 2.3 (1) | 17 (36) | 38 (49) | 35 (52) | ∞ | ∞5e5 | 0/15 |
| MCS huyer noiseless | 3.1 (5) | 15 (15) | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| NELDERDOERR doerr noiseless | 1.6 (0.5) | 1.4 (2) | 11 (13) | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NELDER hansen noiseless | 0.93 (0.6) | 5.7 (16) | 40 (23) | 80 (79) | ∞ | ∞ | ∞1e6 | 0/15 |
| NEWUOA ros noiseless | 7.0 (4) | 3.6 (2) | ∞ | ∞ | ∞ | ∞ | ∞7e4 | 0/15 |
| ONEFIFTH auger noiseless | 4.1 (4) | 7.6 (5) | 2873 (3285) | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| POEMS kubalik noiseless | 14 (20) | 31 (13) | 19 (16) | 36 (54) | 69 (82) | ∞ | ∞1e6 | 0/15 |
| PSO Bounds el-abd noiseless | 1.4 (2) | 131 (145) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| PSO el-abd noiseless | 1.6 (2) | 91 (150) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| RANDOMSEARCH auger noiseless | 1.5 (1) | 532 (670) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | 1.9 (2) | 2.2 (3) | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| VNS garcia-martinez noiseless | 2.5 (2) | 18 (14) | 34 (20) | 139 (144) | 423 (531) | 669 (745) | 655 (856) | 2/15 |
| iAMALGAM bosman noiseless | 1.7 (1) | 5.7 (7) | 3.6 (5) | 1.1 (1) | 1.0 (0.8) | 1.0 (0.9) | 1.0 (0.5) | 15/15 |
| Δ fopt f24, 10-D |
1e1 98761 |
1e0 1.0e6 |
1e-1 7.5e7 |
1e-2 7.5e7 |
1e-3 7.5e7 |
1e-5 7.5e7 |
1e-7 7.5e7 |
#succ 1/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 10 (11) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 18 (9) | 8.3 (6) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| BFGS ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 2.7 (11) | 1.00 (0.9) | 1 (1) | 1 (1) | 1 (1) | 1 (2) | 1 (0.7) | 1/15 |
| CMA-ESPLUSSEL auger noiseless | 14 (16) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| DASA korosec noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| FULLNEWUOA ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| G3PCX posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| GA nicolau noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GLOBAL pal noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞9880 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.00 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| LSfminbnd posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| LSstep posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| MCS huyer noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| NELDERDOERR doerr noiseless | 2.6 (3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NELDER hansen noiseless | 22 (23) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| NEWUOA ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞7e4 | 0/15 |
| ONEFIFTH auger noiseless | 745 (785) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| POEMS kubalik noiseless | 142 (84) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| PSO Bounds el-abd noiseless | 144 (177) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| PSO el-abd noiseless | 142 (192) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| VNS garcia-martinez noiseless | 3.7 (5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e7 | 0/15 |
| iAMALGAM bosman noiseless | 4.2 (4) | 4.2 (6) | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
Previous dimension | Dimension = 20 | Next dimension
| Δ fopt f1, 20-D |
1e1 43 |
1e0 43 |
1e-1 43 |
1e-2 43 |
1e-3 43 |
1e-5 43 |
1e-7 43 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 148 (26) | 318 (18) | 515 (38) | 706 (35) | 916 (127) | 1357 (97) | 1849 (88) | 15/15 |
| AMALGAM bosman noiseless | 55 (11) | 132 (48) | 199 (63) | 263 (83) | 324 (65) | 442 (72) | 547 (76) | 15/15 |
| BAYEDA gallagher noiseless | 106 (12) | 204 (14) | 307 (16) | 409 (20) | 496 (18) | 705 (14) | 1040 (31) | 0/15 |
| BFGS ros noiseless | 1 (0) | 1 (0) | 1 (0) | 1 (0) | 1 (0) | 1 (0) | 1 (0) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 7.9 (1) | 14 (3) | 20 (1) | 26 (3) | 33 (3) | 45 (3) | 57 (4) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 5.4 (0.9) | 9.2 (0.7) | 13 (1) | 17 (0.9) | 21 (2) | 29 (1) | 37 (2) | 15/15 |
| Cauchy-EDA posik noiseless | 731 (226) | 1626 (271) | 2521 (511) | 3523 (778) | 4337 (1125) | 6130 (1036) | 7800 (1500) | 15/15 |
| DASA korosec noiseless | 26 (4) | 45 (8) | 66 (6) | 86 (13) | 118 (10) | 198 (20) | 295 (28) | 15/15 |
| DE-PSO garcia-nieto noiseless | 30 (8) | 81 (15) | 188 (24) | 329 (33) | 557 (74) | 1446 (765) | ∞4e4 | 0/15 |
| DIRECT posik noiseless | 48 (9) | 112 (15) | 225 (32) | 357 (44) | 485 (28) | 874 (51) | 1393 (92) | 4/5 |
| EDA-PSO el-abd noiseless | 454 (68) | 1067 (115) | 1682 (93) | 2287 (115) | 2927 (94) | 4201 (131) | 5441 (119) | 15/15 |
| FULLNEWUOA ros noiseless | 5.4 (0.0) | 5.4 (0.0) | 5.5 (0.0) | 5.5 (0.0) | 5.5 (0.0) | 5.5 (0.0) | 5.5 (0.0) | 15/15 |
| G3PCX posik noiseless | 8.0 (0.8) | 13 (1.0) | 18 (2) | 23 (2) | 27 (2) | 37 (2) | 48 (1) | 15/15 |
| GA nicolau noiseless | 876 (33) | 1905 (116) | 3205 (248) | 1.2e4 (1e4) | 3.1e4 (6e4) | 6.7e5 (1e6) | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | 8.0 (0) | 8.0 (0) | 8.0 (0) | 8.0 (0) | 8.0 (0) | 8.0 (0) | 8.0 (0) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 7.1 (1) | 12 (2) | 18 (2) | 23 (2) | 29 (2) | 39 (1) | 50 (4) | 15/15 |
| LSfminbnd posik noiseless | 9.3 (1) | 10 (1) | 10 (1) | 10 (1) | 10 (1) | 10 (1) | 10 (1) | 15/15 |
| LSstep posik noiseless | 164 (12) | 175 (5) | 176 (2) | 177 (0.0) | 177 (0.0) | 177 (0.0) | 177 (0.0) | 15/15 |
| MA-LS-CHAIN molina noiseless | 21 (5) | 51 (7) | 78 (9) | 103 (11) | 122 (11) | 160 (18) | 196 (26) | 15/15 |
| MCS huyer noiseless | 2.4 (3) | 6.4 (2) | 6.8 (2) | 7.0 (3) | 7.0 (3) | 7.0 (2) | 7.0 (2) | 15/15 |
| NELDERDOERR doerr noiseless | 3.3 (1) | 6.7 (2) | 11 (5) | 16 (9) | 21 (7) | 32 (6) | 40 (3) | 15/15 |
| NELDER hansen noiseless | 5.2 (2) | 12 (4) | 19 (8) | 27 (8) | 32 (8) | 40 (4) | 49 (9) | 15/15 |
| NEWUOA ros noiseless | 1.0 (0.0) | 1.0 (0.0) | 1.0 (0.0) | 1.0 (0.0) | 1.0 (0.0) | 1.0 (0.0) | 1.0 (0.0) | 15/15 |
| ONEFIFTH auger noiseless | 4.9 (1) | 8.1 (2) | 11 (2) | 15 (2) | 18 (2) | 25 (3) | 31 (2) | 15/15 |
| POEMS kubalik noiseless | 184 (8) | 403 (53) | 874 (94) | 1377 (61) | 1787 (58) | 2794 (76) | 3779 (114) | 15/15 |
| PSO Bounds el-abd noiseless | 123 (48) | 1490 (666) | 2136 (545) | 2779 (1015) | 3330 (821) | 4509 (1007) | 1.6e4 (3013) | 15/15 |
| PSO el-abd noiseless | 22 (7) | 3399 (31) | 3446 (1e4) | 3507 (2e4) | 3563 (33) | 3680 (47) | 3808 (42) | 14/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | 3.8 (0.8) | 5.8 (0.4) | 7.2 (0.6) | 9.1 (0.4) | 11 (0.4) | 14 (0.9) | 17 (1) | 15/15 |
| VNS garcia-martinez noiseless | 10 (1) | 17 (1) | 23 (2) | 29 (2) | 36 (2) | 48 (2) | 60 (3) | 15/15 |
| iAMALGAM bosman noiseless | 27 (5) | 57 (9) | 88 (5) | 116 (9) | 145 (7) | 206 (9) | 267 (9) | 15/15 |
| Δ fopt f2, 20-D |
1e1 385 |
1e0 386 |
1e-1 387 |
1e-2 388 |
1e-3 390 |
1e-5 391 |
1e-7 393 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 88 (4) | 113 (5) | 136 (11) | 163 (10) | 189 (15) | 256 (17) | 366 (36) | 15/15 |
| AMALGAM bosman noiseless | 35 (6) | 43 (9) | 49 (9) | 56 (10) | 62 (8) | 76 (12) | 88 (13) | 15/15 |
| BAYEDA gallagher noiseless | 53 (3) | 64 (3) | 76 (2) | 94 (3) | 104 (27) | ∞ | ∞4e4 | 0/15 |
| BFGS ros noiseless | 20 (4) | 24 (5) | 26 (4) | 27 (5) | 27 (3) | 28 (3) | 28 (3) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 35 (7) | 40 (5) | 44 (3) | 45 (3) | 47 (2) | 48 (2) | 50 (2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 30 (4) | 37 (5) | 39 (3) | 41 (2) | 41 (3) | 43 (2) | 44 (2) | 15/15 |
| Cauchy-EDA posik noiseless | 414 (75) | 510 (129) | 612 (151) | 705 (157) | 797 (170) | 992 (99) | 1208 (202) | 15/15 |
| DASA korosec noiseless | 10 (0.8) | 14 (0.9) | 18 (2) | 23 (2) | 28 (0.8) | 39 (2) | 49 (3) | 15/15 |
| DE-PSO garcia-nieto noiseless | 42 (13) | 66 (10) | 108 (13) | 501 (513) | ∞ | ∞ | ∞4e4 | 0/15 |
| DIRECT posik noiseless | 134 (137) | 471 (587) | 487 (261) | 505 (390) | 537 (322) | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 331 (15) | 399 (31) | 471 (19) | 538 (21) | 604 (11) | 739 (9) | 876 (13) | 15/15 |
| FULLNEWUOA ros noiseless | 447 (122) | 3768 (4145) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| G3PCX posik noiseless | 127 (40) | 209 (65) | 319 (81) | 418 (115) | 546 (250) | 761 (261) | 986 (184) | 14/15 |
| GA nicolau noiseless | 3228 (5230) | 6769 (1e4) | 7.3e4 (9e4) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | 18 (3) | 23 (3) | 26 (8) | 30 (14) | 33 (14) | 51 (27) | 63 (142) | 13/15 |
| IPOP-SEP-CMA-ES ros noiseless | 7.5 (1) | 8.3 (1) | 9.1 (0.8) | 10 (0.5) | 10 (1) | 11 (0.5) | 13 (0.9) | 15/15 |
| LSfminbnd posik noiseless | 1.00 (0.0)★ | 1.00 (0.0)★ | 1.00 (0.0)★ | 1.00 (0.0)★ | 1.00 (0.0)★ | 1.0 (0.1)★ | 1.0 (0.1)★ | 15/15 |
| LSstep posik noiseless | 17 (0.5) | 17 (0.3) | 17 (0.1) | 17 (0.2) | 17 (0.4) | 17 (0.2) | 17 (0.1) | 15/15 |
| MA-LS-CHAIN molina noiseless | 15 (2) | 19 (2) | 23 (2) | 27 (3) | 32 (2) | 43 (12) | 76 (9) | 15/15 |
| MCS huyer noiseless | 5.4 (2) | 14 (6) | 21 (15) | 41 (28) | 43 (27) | 46 (26) | ∞8e4 | 0/15 |
| NELDERDOERR doerr noiseless | 13 (3) | 17 (5) | 19 (8) | 23 (5) | 28 (4) | 36 (23) | 48 (37) | 15/15 |
| NELDER hansen noiseless | 7.0 (2) | 7.8 (1) | 8.6 (1) | 9.2 (0.5) | 10 (1) | 11 (1.0) | 12 (1) | 15/15 |
| NEWUOA ros noiseless | 18 (10) | 42 (22) | 71 (16) | 92 (37) | 125 (39) | 174 (38) | 219 (59) | 15/15 |
| ONEFIFTH auger noiseless | 6938 (3901) | 1.6e4 (5177) | 2.6e4 (8825) | 3.8e4 (1e4) | 7.4e4 (1e5) | 3.8e5 (4e5) | ∞2e7 | 0/15 |
| POEMS kubalik noiseless | 245 (20) | 296 (35) | 340 (31) | 409 (19) | 452 (20) | 558 (39) | 662 (20) | 15/15 |
| PSO Bounds el-abd noiseless | 360 (237) | 528 (236) | 834 (300) | 1398 (934) | 1749 (546) | 2274 (932) | 2568 (606) | 14/15 |
| PSO el-abd noiseless | 4576 (1e4) | 4571 (3888) | 4565 (2589) | 4560 (9022) | 4543 (2567) | 4546 (7674) | 4537 (2551) | 8/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | 1.4 (0.2) | 1.6 (0.3) | 5.8 (0.2) | 18 (62) | 29 (80) | 73 (0.2) | 73 (254) | 14/15 |
| VNS garcia-martinez noiseless | 72 (69) | 82 (83) | 88 (86) | 95 (44) | 97 (2) | 98 (42) | 99 (45) | 15/15 |
| iAMALGAM bosman noiseless | 22 (2) | 27 (4) | 30 (4) | 33 (2) | 36 (1.0) | 43 (1) | 49 (3) | 15/15 |
| Δ fopt f3, 20-D |
1e1 5066 |
1e0 7626 |
1e-1 7635 |
1e-2 7637 |
1e-3 7643 |
1e-5 7646 |
1e-7 7651 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 50 (35) | 186 (76) | 231 (136) | 242 (101) | 271 (106) | 398 (136) | 3247 (3430) | 0/15 |
| AMALGAM bosman noiseless | 27 (17) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BFGS ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 12 (4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6e6 | 0/15 |
| CMA-ESPLUSSEL auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DASA korosec noiseless | 1.0 (0.2)★ | 8.3 (11) | 35 (48) | 35 (33) | 35 (47) | 36 (48) | 36 (33) | 15/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 44 (200) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| FULLNEWUOA ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| G3PCX posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GA nicolau noiseless | 29 (2) | 3709 (2690) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 10 (5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| LSfminbnd posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| LSstep posik noiseless | 1.5 (0.0) | 1.0 (2e-3)★ | 1.00 (2e-3)★ | 1.00 (2e-3)★ | 1.00 (1e-3)★ | 1.00 (1e-3)★ | 1.00 (2e-3)★ | 15/15 |
| MA-LS-CHAIN molina noiseless | 7.0 (5) | 95 (45) | 158 (133) | 158 (45) | 158 (58) | 158 (66) | 158 (35) | 14/15 |
| MCS huyer noiseless | 28 (20) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| NELDERDOERR doerr noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NEWUOA ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| ONEFIFTH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| POEMS kubalik noiseless | 10 (2) | 69 (30) | 141 (46) | 143 (191) | 146 (30) | 153 (111) | 158 (197) | 13/15 |
| PSO Bounds el-abd noiseless | 118 (395) | 192 (79) | 360 (335) | 361 (471) | 363 (267) | 402 (595) | 428 (526) | 7/15 |
| PSO el-abd noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| VNS garcia-martinez noiseless | 8.3 (4) | 345 (171) | 487 (1686) | 523 (1686) | 560 (266) | 629 (283) | 630 (421) | 12/15 |
| iAMALGAM bosman noiseless | 38 (29) | 1.8e4 (1e4) | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Δ fopt f4, 20-D |
1e1 4722 |
1e0 7628 |
1e-1 7666 |
1e-2 7686 |
1e-3 7700 |
1e-5 7758 |
1e-7 1.4e5 |
#succ 9/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 146 (75) | 9772 (9668) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BFGS ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6e6 | 0/15 |
| CMA-ESPLUSSEL auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DASA korosec noiseless | 1.00 (0.3)★ | 129 (45) | 1676 (2604) | 1672 (2378) | 1669 (1351) | 1657 (2563) | 91 (47) | 11/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 5955 (8789) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| FULLNEWUOA ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| G3PCX posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GA nicolau noiseless | 65 (214) | 3751 (7543) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| LSfminbnd posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| LSstep posik noiseless | 1.6 (9e-4) | 1.00 (2e-3)★ | 1.0 (4e-3)★ | 1.00 (8e-3)★ | 1 (6e-3)★ | 1.0 (0.0)★ | 1.0 (1) | 9/15 |
| MA-LS-CHAIN molina noiseless | 53 (30) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| MCS huyer noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| NELDERDOERR doerr noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NEWUOA ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| ONEFIFTH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| POEMS kubalik noiseless | 13 (2) | 143 (192) | 218 (142) | 243 (390) | 246 (174) | 250 (388) | 14 (9) | 10/15 |
| PSO Bounds el-abd noiseless | 186 (224) | 286 (396) | 296 (141) | 358 (317) | 359 (294) | 378 (324) | 21 (21) | 7/15 |
| PSO el-abd noiseless | 5940 (3283) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| VNS garcia-martinez noiseless | 27 (5) | 2.8e4 (6e4) | 1.3e5 (2e5) | 1.3e5 (1e5) | ∞ | ∞ | ∞7e7 | 0/15 |
| iAMALGAM bosman noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Δ fopt f5, 20-D |
1e1 41 |
1e0 41 |
1e-1 41 |
1e-2 41 |
1e-3 41 |
1e-5 41 |
1e-7 41 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 157 (37) | 207 (30) | 245 (36) | 273 (56) | 292 (55) | 322 (82) | 324 (43) | 15/15 |
| AMALGAM bosman noiseless | 74 (23) | 79 (14) | 80 (26) | 80 (20) | 80 (19) | 80 (21) | 80 (21) | 15/15 |
| BAYEDA gallagher noiseless | 152 (7) | 195 (13) | 203 (11) | 203 (17) | 204 (35) | 204 (57) | 204 (14) | 15/15 |
| BFGS ros noiseless | 2.3 (0.4) | 2.7 (0.4) | 2.8 (0.3) | 2.8 (0.3) | 2.8 (0.3) | 2.8 (0.3) | 2.8 (0.5) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 5.0 (0.7) | 6.1 (1) | 6.2 (1) | 6.2 (0.9) | 6.3 (0.9) | 6.3 (1) | 6.3 (1) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 3.1 (0.3) | 3.6 (1) | 3.7 (0.6) | 3.7 (0.7) | 3.7 (1) | 3.7 (0.4) | 3.7 (0.5) | 15/15 |
| Cauchy-EDA posik noiseless | 162 (88) | 164 (80) | 164 (72) | 164 (93) | 164 (96) | 164 (96) | 164 (96) | 15/15 |
| DASA korosec noiseless | 24 (5) | 29 (3) | 34 (2) | 38 (4) | 43 (8) | 51 (6) | 63 (14) | 15/15 |
| DE-PSO garcia-nieto noiseless | 38 (3) | 45 (4) | 48 (2) | 48 (1) | 48 (2) | 48 (2) | 48 (2) | 15/15 |
| DIRECT posik noiseless | 178 (0.0) | 222 (4) | 224 (0.0) | 224 (0.0) | 224 (0.0) | 224 (0.0) | 224 (0.0) | 5/5 |
| EDA-PSO el-abd noiseless | 27 (5) | 34 (9) | 37 (11) | 38 (43) | 39 (11) | 39 (10) | 39 (10) | 15/15 |
| FULLNEWUOA ros noiseless | 6.1 (0.4) | 6.4 (0.5) | 6.5 (0.7) | 6.5 (0.8) | 6.5 (0.6) | 6.5 (0.2) | 6.5 (0.6) | 15/15 |
| G3PCX posik noiseless | 18 (4) | 25 (5) | 26 (4) | 26 (8) | 26 (10) | 26 (9) | 26 (10) | 15/15 |
| GA nicolau noiseless | 2137 (79) | 4548 (313) | 7446 (169) | 1.1e4 (486) | 1.4e4 (374) | 2.2e4 (829) | 2.3e5 (2e5) | 0/15 |
| GLOBAL pal noiseless | 10 (0.9) | 11 (0.8) | 11 (0.9) | 11 (0.8) | 11 (0.9) | 11 (0.4) | 11 (1) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 6.1 (2) | 7.3 (2) | 7.6 (2) | 7.6 (2) | 7.6 (1) | 7.6 (2) | 7.6 (2) | 15/15 |
| LSfminbnd posik noiseless | 16 (0.4) | 16 (0) | 16 (0) | 16 (0) | 16 (0) | 16 (0) | 16 (0) | 15/15 |
| LSstep posik noiseless | 183 (5) | 185 (2) | 185 (0.0) | 185 (0.0) | 185 (6e-3) | 185 (0.0) | 185 (0.0) | 15/15 |
| MA-LS-CHAIN molina noiseless | 41 (7) | 44 (3) | 45 (6) | 45 (7) | 45 (9) | 45 (2) | 45 (2) | 15/15 |
| MCS huyer noiseless | 0.99 (0.0)★ | 0.99 (0.0)★ | 0.99 (0.0)★ | 0.99 (0)★ | 0.99 (0.0)★ | 0.99 (0.0)★ | 0.99 (0.0)★ | 15/15 |
| NELDERDOERR doerr noiseless | 5.2 (2) | 6.1 (2) | 6.3 (2) | 6.3 (2) | 6.3 (3) | 6.3 (2) | 6.3 (2) | 15/15 |
| NELDER hansen noiseless | 7.3 (0.9) | 8.8 (3) | 9.1 (3) | 9.1 (3) | 9.1 (3) | 9.1 (4) | 9.1 (2) | 15/15 |
| NEWUOA ros noiseless | 1.2 (0.2) | 1.4 (0.4) | 1.6 (0.5) | 1.6 (0.5) | 1.6 (0.5) | 1.6 (0.4) | 1.6 (0.4) | 15/15 |
| ONEFIFTH auger noiseless | 3.0 (0.9) | 3.5 (0.9) | 3.6 (2) | 3.6 (2) | 3.6 (0.9) | 3.6 (0.7) | 3.6 (1) | 15/15 |
| POEMS kubalik noiseless | 254 (20) | 309 (19) | 331 (17) | 344 (27) | 346 (44) | 350 (39) | 350 (55) | 15/15 |
| PSO Bounds el-abd noiseless | 154 (123) | 156 (183) | 157 (246) | 158 (122) | 158 (122) | 158 (120) | 158 (121) | 15/15 |
| PSO el-abd noiseless | 4.3e4 (7e4) | 4.3e4 (5e4) | 4.3e4 (9e4) | 4.3e4 (5e4) | 4.3e4 (6e4) | 4.3e4 (7e4) | 4.3e4 (9e4) | 8/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | 4.2 (0.3) | 4.3 (0.2) | 4.3 (0.2) | 4.3 (0.2) | 4.3 (0.2) | 4.3 (0.2) | 4.3 (0.2) | 15/15 |
| VNS garcia-martinez noiseless | 6.7 (0.8) | 7.6 (2) | 7.7 (1) | 7.7 (2) | 7.7 (2) | 7.7 (0.8) | 7.7 (2) | 15/15 |
| iAMALGAM bosman noiseless | 10 (1) | 11 (3) | 11 (2) | 11 (3) | 11 (2) | 11 (1) | 11 (1) | 15/15 |
| Δ fopt f6, 20-D |
1e1 1296 |
1e0 2343 |
1e-1 3413 |
1e-2 4255 |
1e-3 5220 |
1e-5 6728 |
1e-7 8409 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 34 (8) | 40 (11) | 46 (8) | 55 (14) | 72 (33) | 269 (163) | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 19 (4) | 16 (3) | 15 (3) | 16 (2) | 16 (1) | 16 (1) | 16 (1) | 15/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BFGS ros noiseless | 3.6 (2) | 3.5 (1) | 3.4 (0.9) | 3.5 (1) | 3.5 (0.8) | 3.6 (0.7) | 45 (19) | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.5 (0.3) | 1.3 (0.2) | 1.2 (0.1) | 1.1 (0.1) | 1.1 (0.1) | 1.2 (0.2) | 1.2 (0.1) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 13 (15) | 131 (328) | 835 (820) | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| Cauchy-EDA posik noiseless | 1029 (70) | 1266 (1385) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DASA korosec noiseless | 10 (11) | 14 (12) | 18 (12) | 24 (21) | 35 (34) | 46 (13) | 54 (44) | 15/15 |
| DE-PSO garcia-nieto noiseless | 12 (3) | 48 (47) | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 40 (6) | 34 (3) | 31 (3) | 32 (2) | 31 (1) | 32 (2) | 33 (2) | 15/15 |
| FULLNEWUOA ros noiseless | 1.4 (0.2) | 1.1 (0.2) | 1.0 (0.2) | 1.0 (0.2) | 1.0 (0.1) | 1.0 (0.1) | 1.00 (0.1) | 15/15 |
| G3PCX posik noiseless | 1.4 (0.7) | 1.5 (0.6) | 1.5 (0.5) | 1.5 (0.4) | 1.5 (0.3) | 1.7 (0.2) | 1.7 (0.4) | 15/15 |
| GA nicolau noiseless | 1955 (2340) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | 3.6 (1) | 3.6 (0.4) | 6.1 (4) | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.7 (0.3) | 1.4 (0.2) | 1.3 (0.2) | 1.3 (0.1) | 1.3 (0.1) | 1.5 (0.2) | 1.5 (0.3) | 15/15 |
| LSfminbnd posik noiseless | 158 (133) | 564 (534) | 825 (923) | 684 (776) | ∞ | ∞ | ∞2e5 | 0/15 |
| LSstep posik noiseless | 2293 (3666) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 7.5 (1) | 6.6 (1) | 5.7 (1) | 5.5 (1) | 5.1 (1) | 4.8 (1) | 4.4 (1) | 15/15 |
| MCS huyer noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| NELDERDOERR doerr noiseless | 9.1 (16) | 15 (10) | 20 (29) | 46 (66) | 79 (48) | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 2.7 (1) | 2.4 (1.0) | 2.3 (0.9) | 2.5 (0.6) | 2.5 (0.5) | 3.0 (0.5) | 5.4 (4) | 14/15 |
| NEWUOA ros noiseless | 1.00 (0.8) | 1.0 (0.3) | 1.00 (0.3) | 1.1 (0.6) | 1.1 (0.7) | 1.3 (0.7) | 1.3 (0.6) | 15/15 |
| ONEFIFTH auger noiseless | 2.1 (1) | 2.1 (2) | 2.8 (5) | 3.7 (0.6) | 4.3 (0.8) | 4.7 (1) | 4.9 (0.8) | 15/15 |
| POEMS kubalik noiseless | 31 (2) | 27 (2) | 26 (1) | 26 (1.0) | 25 (1) | 27 (1) | 27 (0.7) | 15/15 |
| PSO Bounds el-abd noiseless | 117 (46) | 109 (15) | 104 (15) | 102 (20) | 96 (11) | 115 (11) | 163 (16) | 10/15 |
| PSO el-abd noiseless | 1082 (1162) | 1009 (1284) | 705 (747) | 586 (1662) | 502 (386) | 423 (152) | 577 (311) | 5/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | 31 (19) | 56 (29) | 150 (226) | 163 (106) | 572 (699) | ∞ | ∞2e5 | 0/15 |
| VNS garcia-martinez noiseless | 1.9 (0.4) | 1.4 (0.2) | 1.2 (0.1) | 1.2 (0.1) | 1.2 (0.1) | 1.2 (0.1) | 1.2 (0.1) | 15/15 |
| iAMALGAM bosman noiseless | 5.4 (0.7) | 5.1 (0.6) | 5.1 (1) | 5.5 (1) | 5.5 (2) | 5.9 (1) | 6.1 (0.8) | 15/15 |
| Δ fopt f7, 20-D |
1e1 1351 |
1e0 4274 |
1e-1 9503 |
1e-2 16523 |
1e-3 16524 |
1e-5 16524 |
1e-7 16969 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 30 (50) | 849 (1180) | 934 (809) | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 3.6 (2) | 2.1 (0.6) | 1.3 (0.3) | 1.00 (0.1) | 1.0 (0.2) | 1.0 (0.2) | 1.00 (0.2) | 15/15 |
| BAYEDA gallagher noiseless | 57 (52) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BFGS ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2100 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.00 (1) | 4.9 (3) | 3.5 (1) | 2.2 (0.2) | 2.2 (0.3) | 2.2 (0.3) | 2.1 (0.3) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 30 (26) | 54 (15) | 304 (232) | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| Cauchy-EDA posik noiseless | 44 (22) | 29 (13) | 18 (6) | 14 (3) | 14 (5) | 14 (5) | 14 (4) | 15/15 |
| DASA korosec noiseless | 1.8e4 (2e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e6 | 0/15 |
| DE-PSO garcia-nieto noiseless | 18 (22) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 26 (2) | 952 (1756) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| FULLNEWUOA ros noiseless | 4.6 (4) | 700 (573) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| G3PCX posik noiseless | 764 (678) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| GA nicolau noiseless | 77 (13) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.3 (1) | 4.0 (2) | 2.4 (0.6) | 1.5 (1.0) | 1.5 (0.2) | 1.5 (0.3) | 1.5 (0.7) | 15/15 |
| LSfminbnd posik noiseless | 1045 (1726) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| LSstep posik noiseless | 2184 (1480) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 4.3 (2) | 119 (137) | 358 (296) | 385 (265) | 387 (667) | 387 (401) | 376 (335) | 4/15 |
| MCS huyer noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| NELDERDOERR doerr noiseless | 370 (466) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 2160 (1821) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NEWUOA ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| ONEFIFTH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| POEMS kubalik noiseless | 21 (6) | 1996 (2574) | 3054 (4893) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO Bounds el-abd noiseless | 9653 (2e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO el-abd noiseless | 427 (792) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞7e4 | 0/15 |
| VNS garcia-martinez noiseless | 5.4 (13) | 78 (70) | 72 (44) | 2395 (3365) | 2395 (4541) | 2395 (3454) | 2332 (4352) | 10/15 |
| iAMALGAM bosman noiseless | 1.7 (0.2) | 1.00 (0.3) | 1.00 (1) | 1.3 (1) | 1.3 (2) | 1.3 (0.7) | 1.3 (1) | 15/15 |
| Δ fopt f8, 20-D |
1e1 2039 |
1e0 3871 |
1e-1 4040 |
1e-2 4148 |
1e-3 4219 |
1e-5 4371 |
1e-7 4484 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 98 (87) | 443 (357) | 602 (746) | 742 (670) | 1024 (1079) | 3133 (3920) | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 19 (2) | 18 (1) | 19 (1) | 20 (1) | 20 (1) | 21 (0.9) | 22 (1) | 15/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BFGS ros noiseless | 1.8 (0.1) | 1.2 (0.1) | 1.2 (0.2) | 1.2 (0.3) | 1.2 (0.1) | 1.2 (0.1) | 1.2 (0.1) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 4.0 (1) | 4.0 (1) | 4.3 (1.0) | 4.5 (0.9) | 4.5 (0.9) | 4.6 (1) | 4.6 (0.3) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 3.7 (0.8) | 6.3 (5) | 6.6 (1) | 6.6 (5) | 6.6 (5) | 6.6 (4) | 6.6 (4) | 15/15 |
| Cauchy-EDA posik noiseless | 191 (61) | 178 (26) | 209 (31) | 255 (30) | 263 (186) | 357 (187) | 543 (559) | 4/15 |
| DASA korosec noiseless | 33 (45) | 55 (64) | 121 (61) | 198 (136) | 277 (116) | 420 (66) | 549 (75) | 15/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 187 (11) | 211 (5) | 264 (7) | 332 (9) | 408 (8) | ∞ | ∞2e6 | 0/15 |
| FULLNEWUOA ros noiseless | 1.4 (0.5) | 1.6 (0.8) | 1.6 (1) | 1.7 (1) | 1.7 (1) | 1.7 (0.6) | 1.7 (0.6) | 15/15 |
| G3PCX posik noiseless | 2.6 (0.9) | 5.4 (5) | 5.5 (5) | 5.5 (5) | 5.5 (6) | 5.5 (4) | 5.6 (3) | 15/15 |
| GA nicolau noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | 1.6 (0.6) | 1.2 (0.5) | 1.2 (0.4) | 1.2 (0.1) | 1.2 (0.4) | 1.2 (0.4) | 1.2 (0.7) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 5.4 (0.7) | 5.4 (0.2) | 5.7 (0.3) | 5.7 (0.4) | 5.8 (0.4) | 5.8 (0.3) | 5.8 (0.3) | 15/15 |
| LSfminbnd posik noiseless | 9.2 (26) | 114 (142) | 707 (965) | 719 (362) | ∞ | ∞ | ∞2e5 | 0/15 |
| LSstep posik noiseless | 24 (4) | 124 (90) | 222 (174) | 347 (326) | ∞ | ∞ | ∞2e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 13 (4) | 12 (27) | 13 (4) | 13 (3) | 14 (14) | 13 (3) | 13 (13) | 15/15 |
| MCS huyer noiseless | 1.5 (0.5) | 1.7 (1) | 1.8 (1) | 1.8 (1) | 1.8 (1) | 1.8 (1.0) | 1.8 (1) | 15/15 |
| NELDERDOERR doerr noiseless | 2.8 (6) | 4.7 (3) | 5.5 (14) | 6.0 (15) | 6.5 (3) | 7.7 (4) | 9.1 (8) | 15/15 |
| NELDER hansen noiseless | 3.3 (1) | 3.8 (2) | 4.1 (4) | 4.5 (4) | 4.9 (3) | 5.3 (2) | 5.6 (3) | 15/15 |
| NEWUOA ros noiseless | 1.00 (0.2) | 1.00 (0.5) | 1.0 (0.7) | 1.0 (0.5) | 1.0 (0.0) | 1.00 (0.5) | 1.00 (0.5) | 15/15 |
| ONEFIFTH auger noiseless | 13 (7) | 117 (266) | 124 (134) | 138 (266) | 157 (246) | 196 (115) | 234 (354) | 15/15 |
| POEMS kubalik noiseless | 571 (282) | 7396 (8008) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO Bounds el-abd noiseless | 524 (82) | 432 (95) | 1795 (1158) | 7172 (4942) | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO el-abd noiseless | 90 (33) | 307 (273) | 350 (350) | 406 (477) | 466 (542) | 894 (830) | 3276 (2370) | 1/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | 3.8 (5) | 24 (20) | 28 (60) | 35 (33) | 42 (42) | 62 (46) | 666 (401) | 0/15 |
| VNS garcia-martinez noiseless | 5.8 (1) | 6.0 (5) | 6.3 (5) | 6.4 (3) | 6.4 (0.7) | 6.4 (3) | 6.4 (3) | 15/15 |
| iAMALGAM bosman noiseless | 8.3 (0.9) | 8.9 (9) | 10 (9) | 10 (5) | 10 (9) | 10 (0.5) | 11 (0.9) | 15/15 |
| Δ fopt f9, 20-D |
1e1 1716 |
1e0 3102 |
1e-1 3277 |
1e-2 3379 |
1e-3 3455 |
1e-5 3594 |
1e-7 3727 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 349 (395) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 22 (2) | 22 (2) | 23 (1) | 24 (2) | 24 (2) | 25 (0.9) | 25 (2) | 15/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BFGS ros noiseless | 2.2 (0.3) | 2.2 (1) | 2.1 (0.9) | 2.1 (1) | 2.0 (0.8) | 2.0 (1) | 1.9 (0.8) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 4.7 (2) | 5.7 (0.4) | 6.0 (3) | 6.1 (1) | 6.1 (4) | 6.1 (0.7) | 6.1 (0.9) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 4.5 (3) | 6.7 (4) | 7.0 (4) | 7.0 (4) | 7.0 (4) | 7.0 (5) | 6.9 (2) | 15/15 |
| Cauchy-EDA posik noiseless | 193 (48) | 270 (203) | 290 (224) | 303 (162) | 309 (54) | 473 (578) | 630 (487) | 6/15 |
| DASA korosec noiseless | 207 (93) | 1337 (1924) | 1491 (1840) | 1770 (766) | 2072 (1624) | 2706 (1606) | 3734 (2230) | 13/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 284 (16) | 450 (24) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| FULLNEWUOA ros noiseless | 1.8 (0.3) | 2.2 (1) | 2.3 (1) | 2.3 (1) | 2.3 (0.4) | 2.3 (1) | 2.2 (1) | 15/15 |
| G3PCX posik noiseless | 2.9 (2) | 3.8 (6) | 4.0 (4) | 4.1 (3) | 4.1 (3) | 4.1 (0.6) | 4.2 (0.8) | 15/15 |
| GA nicolau noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | 1.7 (0.2) | 1.7 (0.4) | 1.6 (1.0) | 1.6 (0.7) | 1.6 (1) | 1.6 (1) | 1.5 (0.9) | 15/15 |
| IPOP-SEP-CMA-ES ros noiseless | 6.9 (1) | 7.0 (0.4) | 7.2 (0.3) | 7.3 (0.2) | 7.3 (2) | 7.2 (0.3) | 7.2 (0.2) | 15/15 |
| LSfminbnd posik noiseless | 52 (40) | 467 (266) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| LSstep posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 17 (11) | 25 (11) | 27 (24) | 29 (32) | 31 (27) | 30 (31) | 30 (22) | 15/15 |
| MCS huyer noiseless | 1.00 (0.5) | 1.3 (0.6) | 1.5 (0.5) | 1.6 (0.6) | 1.6 (0.7) | 1.7 (0.6) | 1.6 (0.7) | 15/15 |
| NELDERDOERR doerr noiseless | 3.3 (0.6) | 6.1 (3) | 6.6 (6) | 7.0 (0.6) | 7.5 (8) | 8.4 (9) | 9.3 (0.9) | 15/15 |
| NELDER hansen noiseless | 3.6 (1) | 6.6 (3) | 7.2 (8) | 7.8 (3) | 8.4 (7) | 8.8 (7) | 8.9 (4) | 15/15 |
| NEWUOA ros noiseless | 1.0 (0.2) | 1.00 (0.9) | 1.00 (1) | 1.0 (1) | 1 (1) | 1 (0.5)★ | 1.00 (0.1)★ | 15/15 |
| ONEFIFTH auger noiseless | 12 (4) | 52 (44) | 65 (149) | 86 (131) | 110 (141) | 159 (135) | 205 (129) | 15/15 |
| POEMS kubalik noiseless | 2033 (3550) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO Bounds el-abd noiseless | 705 (116) | 9661 (5803) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO el-abd noiseless | 670 (288) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | 8.4 (1) | 31 (33) | 37 (31) | 49 (45) | 63 (59) | ∞ | ∞2e5 | 0/15 |
| VNS garcia-martinez noiseless | 6.9 (3) | 8.2 (1) | 8.7 (15) | 8.7 (8) | 8.7 (8) | 8.6 (1) | 8.4 (1) | 15/15 |
| iAMALGAM bosman noiseless | 10 (1) | 11 (7) | 12 (12) | 12 (6) | 12 (6) | 12 (0.9) | 13 (1) | 15/15 |
| Δ fopt f10, 20-D |
1e1 7413 |
1e0 8661 |
1e-1 10735 |
1e-2 13641 |
1e-3 14920 |
1e-5 17073 |
1e-7 17476 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 1.8 (0.4) | 2.0 (0.4) | 1.9 (0.4) | 1.7 (0.2) | 1.7 (0.3) | 1.8 (0.3) | 2.1 (0.4) | 15/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BFGS ros noiseless | 1.0 (0.2) | 1.0 (0.1) | 1.00 (0.3) | 1.1 (0.6) | 1.1 (0.4) | 3.1 (5) | ∞1e6 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.9 (0.2) | 1.8 (0.2) | 1.6 (0.1) | 1.3 (0.1) | 1.2 (0.0) | 1.1 (0.0) | 1.1 (0.0) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 1.7 (0.3) | 1.7 (0.3) | 1.4 (0.2) | 1.2 (0.1) | 1.1 (0.1) | 1.00 (0.1) | 1.0 (0.1)★ | 15/15 |
| Cauchy-EDA posik noiseless | 20 (3) | 22 (4) | 20 (4) | 19 (4) | 20 (3) | 21 (4) | 25 (3) | 15/15 |
| DASA korosec noiseless | 3360 (2593) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| FULLNEWUOA ros noiseless | 34 (30) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| G3PCX posik noiseless | 6.5 (2) | 10 (2) | 12 (4) | 13 (4) | 15 (2) | 18 (4) | 23 (6) | 15/15 |
| GA nicolau noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | 1 (0.2) | 1.1 (0.4) | 1.1 (0.5) | 1.2 (0.4) | 2.0 (2) | 5.9 (6) | ∞4e4 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 3.1 (0.4) | 2.9 (0.3) | 2.4 (0.2) | 2.0 (0.1) | 1.8 (0.1) | 1.6 (0.1) | 1.6 (0.1) | 15/15 |
| LSfminbnd posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| LSstep posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 11 (13) | 13 (14) | 11 (7) | 8.5 (6) | 7.8 (5) | 6.9 (8) | 6.8 (4) | 15/15 |
| MCS huyer noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| NELDERDOERR doerr noiseless | 30 (34) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 390 (703) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NEWUOA ros noiseless | 1.7 (0.3) | 2.6 (0.7) | 3.3 (0.7) | 3.3 (1) | 4.0 (0.7) | 4.7 (0.9) | 5.8 (0.6) | 15/15 |
| ONEFIFTH auger noiseless | 301 (159) | 696 (214) | 996 (247) | 1043 (303) | 2234 (1734) | 8686 (3303) | ∞2e7 | 0/15 |
| POEMS kubalik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO Bounds el-abd noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO el-abd noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| VNS garcia-martinez noiseless | 4.8 (5) | 4.7 (4) | 4.2 (3) | 3.4 (3) | 3.1 (2) | 2.8 (2) | 2.7 (2) | 15/15 |
| iAMALGAM bosman noiseless | 1.3 (0.2) | 1.3 (0.1) | 1.2 (0.1) | 1.0 (0.1) | 1.00 (0.1) | 1.0 (0.1) | 1.1 (0.1) | 15/15 |
| Δ fopt f11, 20-D |
1e1 1002 |
1e0 2228 |
1e-1 6278 |
1e-2 8586 |
1e-3 9762 |
1e-5 12285 |
1e-7 14831 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 494 (215) | 977 (388) | 2237 (1364) | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 5.0 (1) | 3.7 (1.0) | 1.9 (0.4) | 1.6 (0.5) | 1.7 (0.2) | 1.8 (0.3) | 1.9 (0.3) | 15/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BFGS ros noiseless | 1 (0.7) | 1.0 (0.8) | 1.3 (4) | 2.6 (2) | 147 (122) | ∞ | ∞2e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 10 (0.7) | 5.1 (0.2) | 1.9 (0.1) | 1.5 (0.1) | 1.4 (0.0) | 1.2 (0.0) | 1.0 (0.0) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 7.0 (1) | 5.1 (0.6) | 2.4 (0.2) | 2.3 (0.4) | 2.4 (0.3) | 2.3 (0.3) | 2.0 (0.1) | 15/15 |
| Cauchy-EDA posik noiseless | 64 (12) | 44 (17) | 22 (6) | 20 (4) | 22 (4) | 25 (9) | 26 (4) | 15/15 |
| DASA korosec noiseless | 569 (122) | 693 (321) | 420 (352) | 548 (359) | 725 (378) | 978 (320) | 1529 (2378) | 2/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 1873 (1358) | 1.3e4 (1e4) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| FULLNEWUOA ros noiseless | 57 (12) | 45 (10) | 21 (5) | 18 (5) | 36 (17) | ∞ | ∞2e5 | 0/15 |
| G3PCX posik noiseless | 18 (3) | 14 (4) | 7.0 (1) | 6.5 (1) | 7.1 (0.5) | 7.6 (1.0) | 8.0 (0.9) | 15/15 |
| GA nicolau noiseless | 2.9e4 (4e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | 1.2 (0.1) | 1.0 (0.7) | 1.0 (2) | 2.2 (0.8) | ∞ | ∞ | ∞3e4 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 20 (2) | 10 (0.9) | 3.7 (0.2) | 2.8 (0.5) | 2.5 (0.3) | 2.1 (0.2) | 1.8 (0.1) | 15/15 |
| LSfminbnd posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| LSstep posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 63 (27) | 35 (15) | 14 (8) | 12 (5) | 11 (4) | 9.3 (6) | 7.8 (3) | 15/15 |
| MCS huyer noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| NELDERDOERR doerr noiseless | 17 (9) | 24 (25) | 74 (50) | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 41 (69) | 292 (276) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NEWUOA ros noiseless | 15 (2) | 13 (1) | 5.8 (0.5) | 5.6 (0.4) | 6.1 (0.7) | 6.6 (0.4) | 6.5 (0.3) | 15/15 |
| ONEFIFTH auger noiseless | 1625 (560) | 1233 (249) | 575 (34) | 559 (71) | 606 (34) | 665 (27) | 684 (54) | 12/15 |
| POEMS kubalik noiseless | 443 (117) | 407 (110) | 190 (41) | 195 (1) | 981 (1484) | ∞ | ∞2e6 | 0/15 |
| PSO Bounds el-abd noiseless | 575 (234) | 438 (206) | 222 (52) | 244 (88) | 478 (307) | 1205 (3297) | ∞2e6 | 0/15 |
| PSO el-abd noiseless | 143 (44) | 186 (27) | 109 (17) | 114 (11) | 132 (9) | 148 (9) | 2019 (1247) | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| VNS garcia-martinez noiseless | 12 (6) | 6.2 (2) | 2.4 (0.1) | 1.9 (1) | 1.8 (0.1) | 1.6 (0.0) | 1.4 (1) | 15/15 |
| iAMALGAM bosman noiseless | 4.4 (1) | 2.7 (0.7) | 1.2 (0.1) | 1 (0.2) | 1.00 (0.1) | 1.0 (0.1) | 1.0 (0.1) | 15/15 |
| Δ fopt f12, 20-D |
1e1 1042 |
1e0 1938 |
1e-1 2740 |
1e-2 3156 |
1e-3 4140 |
1e-5 12407 |
1e-7 13827 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 87 (110) | 244 (170) | 839 (666) | 3528 (3601) | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 19 (4) | 12 (1) | 13 (4) | 16 (4) | 15 (4) | 7.6 (0.6) | 8.4 (0.9) | 15/15 |
| BAYEDA gallagher noiseless | 42 (39) | 77 (26) | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BFGS ros noiseless | 1.6 (2) | 1.6 (2) | 1.6 (1) | 1.7 (1) | 1.6 (1.0) | 1.8 (1) | 45 (99) | 1/15 |
| BIPOP-CMA-ES hansen noiseless | 3.0 (1.0) | 4.0 (2) | 4.5 (3) | 4.9 (3) | 4.5 (2) | 1.9 (0.8) | 2.0 (0.7) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 7.7 (13) | 10 (11) | 10 (9) | 10 (8) | 8.3 (7) | 3.4 (2) | 3.6 (2) | 15/15 |
| Cauchy-EDA posik noiseless | 507 (630) | 445 (781) | 418 (204) | 402 (197) | 382 (145) | 392 (466) | 1084 (1863) | 0/15 |
| DASA korosec noiseless | 2.2e4 (3e4) | 2.8e4 (3e4) | 4.7e4 (4e4) | 8.9e4 (7e4) | 6.8e4 (1e5) | 2.3e4 (3e4) | ∞2e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | 68 (29) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| DIRECT posik noiseless | 421 (578) | 235 (233) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 302 (6) | 261 (776) | 721 (1094) | 2616 (3961) | 6829 (6522) | 2285 (4393) | ∞2e6 | 0/15 |
| FULLNEWUOA ros noiseless | 11 (17) | 15 (18) | 26 (33) | 27 (17) | 38 (12) | 35 (48) | 105 (64) | 0/15 |
| G3PCX posik noiseless | 2.7 (3) | 2.8 (1) | 3.0 (3) | 3.3 (2) | 2.9 (1) | 1.2 (0.4) | 1.3 (0.4) | 15/15 |
| GA nicolau noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | 1.00 (0.7) | 1.00 (0.9) | 1.00 (0.5) | 1.00 (0.4) | 1.0 (0.3) | 1.1 (0.7) | 3.4 (3) | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 5.8 (7) | 6.7 (6) | 6.4 (4) | 6.8 (3) | 5.9 (2) | 2.4 (0.8) | 2.5 (1.0) | 15/15 |
| LSfminbnd posik noiseless | 97 (96) | 414 (748) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| LSstep posik noiseless | 228 (49) | 676 (1058) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 7.4 (1) | 10 (15) | 131 (170) | 139 (180) | 150 (198) | 51 (83) | 47 (78) | 14/15 |
| MCS huyer noiseless | 1.1 (0.8) | 8.4 (9) | 12 (14) | 24 (25) | 43 (51) | 94 (94) | ∞8e4 | 0/15 |
| NELDERDOERR doerr noiseless | 13 (18) | 45 (37) | 61 (30) | 396 (451) | 1393 (797) | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 19 (38) | 26 (19) | 57 (52) | 78 (66) | 338 (405) | ∞ | ∞2e5 | 0/15 |
| NEWUOA ros noiseless | 3.0 (2) | 3.0 (2) | 3.0 (3) | 3.0 (2) | 2.5 (1) | 1.0 (0.5) | 1.00 (0.3) | 15/15 |
| ONEFIFTH auger noiseless | 1.2e4 (1e4) | 6.7e4 (8e4) | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| POEMS kubalik noiseless | 417 (484) | 2137 (1032) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO Bounds el-abd noiseless | 700 (558) | 3003 (2333) | 5067 (4932) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO el-abd noiseless | 1703 (3849) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | 14 (0.0) | 56 (98) | 208 (182) | 913 (1743) | ∞ | ∞ | ∞2e5 | 0/15 |
| VNS garcia-martinez noiseless | 5.9 (3) | 5.9 (7) | 6.6 (4) | 9.1 (12) | 8.3 (3) | 4.1 (3) | 4.4 (4) | 15/15 |
| iAMALGAM bosman noiseless | 8.7 (0.5) | 6.6 (3) | 7.2 (1) | 8.1 (4) | 7.8 (2) | 3.6 (0.7) | 3.9 (0.4) | 15/15 |
| Δ fopt f13, 20-D |
1e1 652 |
1e0 2021 |
1e-1 2751 |
1e-2 3507 |
1e-3 18749 |
1e-5 24455 |
1e-7 30201 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 97 (15) | 127 (142) | 420 (502) | 2682 (3524) | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 18 (8) | 8.0 (2) | 8.0 (1) | 7.7 (0.9) | 1.7 (0.2) | 1.7 (0.1) | 1.7 (0.2) | 15/15 |
| BAYEDA gallagher noiseless | 908 (1196) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BFGS ros noiseless | 1.7 (0.2) | 1.0 (0.1) | 1.00 (0.0) | 1.00 (0.1) | 23 (19) | ∞ | ∞5e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 4.3 (3) | 2.7 (4) | 5.1 (2) | 6.2 (4) | 1.5 (0.7) | 2.3 (2) | 3.0 (2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 4.9 (4) | 7.1 (13) | 10 (8) | 11 (13) | 4.2 (4) | 6.3 (8) | 14 (9) | 4/15 |
| Cauchy-EDA posik noiseless | 214 (39) | 105 (16) | 102 (13) | 101 (12) | 23 (3) | 23 (3) | 23 (1) | 15/15 |
| DASA korosec noiseless | 385 (663) | 232 (182) | 573 (315) | 1563 (790) | 668 (446) | 3729 (1937) | ∞2e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | 64 (20) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 162 (8) | 326 (495) | 1175 (1088) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| FULLNEWUOA ros noiseless | 1.8 (0.3) | 6.0 (3) | 18 (18) | 49 (35) | 26 (17) | 116 (190) | ∞2e5 | 0/15 |
| G3PCX posik noiseless | 9.3 (22) | 17 (19) | 43 (34) | 75 (74) | 47 (43) | 126 (135) | 326 (554) | 1/15 |
| GA nicolau noiseless | 5114 (5416) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | 2.0 (0.4) | 1.1 (0.1) | 1.1 (0.0) | 1.1 (0.1) | 4.5 (7) | ∞ | ∞2e4 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 5.8 (7) | 5.4 (2) | 7.7 (6) | 8.0 (3) | 1.7 (0.7) | 1.9 (0.4) | 2.0 (0.7) | 15/15 |
| LSfminbnd posik noiseless | 19 (32) | 19 (27) | 68 (68) | 148 (186) | 156 (320) | ∞ | ∞2e5 | 0/15 |
| LSstep posik noiseless | 463 (245) | 1436 (3340) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 11 (2) | 394 (653) | 704 (926) | 1845 (1498) | 1528 (2480) | ∞ | ∞2e6 | 0/15 |
| MCS huyer noiseless | 34 (29) | 37 (31) | 61 (114) | 331 (143) | ∞ | ∞ | ∞8e4 | 0/15 |
| NELDERDOERR doerr noiseless | 12 (11) | 18 (33) | 31 (9) | 87 (59) | 98 (64) | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 11 (12) | 29 (28) | 60 (34) | 185 (236) | 77 (70) | ∞ | ∞2e5 | 0/15 |
| NEWUOA ros noiseless | 1.00 (1)★ | 3.0 (3) | 9.3 (11) | 37 (37) | 19 (37) | ∞ | ∞2e5 | 0/15 |
| ONEFIFTH auger noiseless | 7.4 (5) | 13 (6) | 26 (20) | 95 (118) | 50 (38) | 410 (347) | 2031 (4810) | 2/15 |
| POEMS kubalik noiseless | 1662 (2311) | 1.4e4 (1e4) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO Bounds el-abd noiseless | 2262 (49) | 4087 (4942) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO el-abd noiseless | 6153 (1e4) | 6441 (1e4) | 1.0e4 (3e4) | 7993 (6558) | 1495 (2720) | ∞ | ∞2e6 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | 2.5 (3) | 4.2 (5) | 8.3 (6) | 31 (39) | 17 (30) | 122 (176) | ∞2e5 | 0/15 |
| VNS garcia-martinez noiseless | 4.3 (5) | 55 (6) | 121 (232) | 179 (242) | 127 (214) | 537 (710) | 1469 (1996) | 12/15 |
| iAMALGAM bosman noiseless | 8.7 (0.3) | 4.1 (0.2) | 4.3 (0.2) | 4.4 (0.5) | 1.00 (0.2) | 1 (0.1) | 1.0 (0.1) | 15/15 |
| Δ fopt f14, 20-D |
1e1 75 |
1e0 239 |
1e-1 304 |
1e-2 451 |
1e-3 932 |
1e-5 1648 |
1e-7 15661 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 41 (10) | 56 (17) | 78 (15) | 93 (19) | 191 (43) | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 19 (2) | 22 (10) | 30 (6) | 28 (8) | 17 (3) | 14 (4) | 1.9 (0.4) | 15/15 |
| BAYEDA gallagher noiseless | 55 (26) | 67 (24) | 152 (198) | 248 (289) | ∞ | ∞ | ∞4e4 | 0/15 |
| BFGS ros noiseless | 2.7 (2) | 1.8 (0.6) | 2.0 (0.8) | 1.8 (0.5) | 1.2 (0.3) | 1.1 (0.3) | ∞2e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 3.9 (1) | 2.9 (0.4) | 3.7 (0.6) | 4.3 (0.6) | 4.1 (0.4) | 6.2 (0.7) | 1.2 (0.1) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 3.1 (0.9) | 1.9 (0.4) | 2.3 (0.5) | 2.5 (0.5) | 2.3 (0.6) | 5.6 (1) | 1.2 (0.1) | 15/15 |
| Cauchy-EDA posik noiseless | 279 (106) | 266 (103) | 351 (72) | 338 (69) | 211 (53) | 179 (45) | 25 (6) | 15/15 |
| DASA korosec noiseless | 16 (6) | 10 (1) | 12 (1.0) | 22 (5) | 75 (21) | 5222 (1389) | ∞2e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | 14 (3) | 14 (3) | 25 (4) | 49 (11) | ∞ | ∞ | ∞4e4 | 0/15 |
| DIRECT posik noiseless | 8.4 (6) | 154 (212) | 290 (298) | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 85 (27) | 137 (24) | 200 (16) | 194 (8) | 126 (13) | ∞ | ∞2e6 | 0/15 |
| FULLNEWUOA ros noiseless | 5.9 (2) | 3.0 (0.4) | 3.6 (0.5) | 3.3 (0.4) | 2.6 (0.4) | 20 (2) | ∞2e5 | 0/15 |
| G3PCX posik noiseless | 4.1 (0.5) | 2.4 (0.4) | 2.8 (0.5) | 3.0 (0.4) | 2.7 (0.3) | 13 (3) | 59 (24) | 0/15 |
| GA nicolau noiseless | 277 (86) | 320 (49) | 477 (67) | 2898 (3529) | ∞ | ∞ | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | 5.0 (0.3) | 2.2 (0.2) | 2.1 (0.3) | 1.8 (0.1) | 1.1 (0.1) | 1.00 (0.0) | ∞8538 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 3.3 (1) | 2.6 (0.3) | 3.2 (0.4) | 3.7 (0.6) | 6.8 (1.0) | 10 (0.7) | 1.6 (0.1) | 15/15 |
| LSfminbnd posik noiseless | 8.4 (3) | 5.2 (0.6) | 5.6 (1.0) | 9.3 (2) | 58 (23) | ∞ | ∞2e5 | 0/15 |
| LSstep posik noiseless | 186 (79) | 115 (38) | 118 (24) | 208 (49) | ∞ | ∞ | ∞2e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 7.6 (3) | 11 (3) | 13 (2) | 16 (3) | 14 (2) | 23 (3) | 6.0 (6) | 15/15 |
| MCS huyer noiseless | 1 (0.5) | 2.1 (0.8) | 3.4 (0.5) | 3.7 (0.7) | 3.2 (0.9) | ∞ | ∞8e4 | 0/15 |
| NELDERDOERR doerr noiseless | 2.0 (1) | 2.1 (1) | 3.5 (2) | 3.7 (0.7) | 3.0 (0.6) | 21 (7) | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 2.3 (1) | 3.0 (2) | 3.9 (0.9) | 3.6 (0.7) | 2.9 (0.5) | 36 (17) | ∞2e5 | 0/15 |
| NEWUOA ros noiseless | 1.5 (0.5) | 1.0 (0.4) | 1.0 (0.4)★ | 1.00 (0.2)★ | 1.0 (0.1) | 9.1 (1) | 43 (31) | 0/15 |
| ONEFIFTH auger noiseless | 2.5 (1.0) | 1.8 (0.3) | 2.0 (0.4) | 2.2 (0.3) | 4.8 (0.5) | 466 (9) | ∞2e7 | 0/15 |
| POEMS kubalik noiseless | 107 (18) | 66 (11) | 121 (18) | 164 (8) | 130 (13) | ∞ | ∞2e6 | 0/15 |
| PSO Bounds el-abd noiseless | 23 (12) | 103 (82) | 173 (88) | 238 (68) | 378 (24) | ∞ | ∞2e6 | 0/15 |
| PSO el-abd noiseless | 6.7 (2) | 12 (5) | 20 (3) | 27 (5) | 54 (18) | ∞ | ∞2e6 | 0/15 |
| RANDOMSEARCH auger noiseless | 4.5e4 (5e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | 2.4 (0.5) | 1.2 (0.1) | 1.3 (0.2) | 1.8 (0.3) | 7.4 (2) | ∞ | ∞2e5 | 0/15 |
| VNS garcia-martinez noiseless | 6.4 (2) | 3.9 (0.8) | 4.4 (0.6) | 5.1 (0.5) | 5.0 (1) | 7.8 (1) | 1.4 (0.2) | 15/15 |
| iAMALGAM bosman noiseless | 11 (2) | 9.4 (0.8) | 13 (0.6) | 12 (0.6) | 7.8 (0.6) | 6.9 (0.7) | 1 (0.0) | 15/15 |
| Δ fopt f15, 20-D |
1e1 30378 |
1e0 1.5e5 |
1e-1 3.1e5 |
1e-2 3.2e5 |
1e-3 3.2e5 |
1e-5 4.5e5 |
1e-7 4.6e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 1.5 (3) | 2.0 (1) | 1.7 (1.0) | 1.7 (1.0) | 1.7 (1) | 1.2 (1.0) | 1.2 (0.9) | 15/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BFGS ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.0 (0.3) | 2.0 (0.5) | 1.4 (0.5) | 1.4 (0.5) | 1.4 (0.4) | 1.0 (0.4) | 1.00 (0.3) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DASA korosec noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 36 (67) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| FULLNEWUOA ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| G3PCX posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GA nicolau noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e4 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.1 (0.2) | 1 (0.3) | 1.00 (0.6) | 1.0 (0.3) | 1.00 (0.5) | 1.1 (0.8) | 6.4 (9) | 1/15 |
| LSfminbnd posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| LSstep posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 6.9 (6) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| MCS huyer noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| NELDERDOERR doerr noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NEWUOA ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| ONEFIFTH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| POEMS kubalik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO Bounds el-abd noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO el-abd noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| VNS garcia-martinez noiseless | 309 (200) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e8 | 0/15 |
| iAMALGAM bosman noiseless | 2.8 (3) | 14 (6) | 7.5 (5) | 7.5 (3) | 7.4 (2) | 5.3 (2) | 5.2 (3) | 15/15 |
| Δ fopt f16, 20-D |
1e1 1384 |
1e0 27265 |
1e-1 77015 |
1e-2 1.4e5 |
1e-3 1.9e5 |
1e-5 2.0e5 |
1e-7 2.2e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 9.3 (3) | 114 (166) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 14 (5) | 3.3 (4) | 5.2 (4) | 5.4 (7) | 6.2 (5) | 6.1 (4) | 5.7 (5) | 15/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BFGS ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.7 (0.4) | 1.0 (1) | 1.2 (0.7) | 1.0 (0.7) | 1.00 (0.9) | 1.0 (0.6) | 1.00 (0.8) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 34 (32) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DASA korosec noiseless | 976 (1056) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| DIRECT posik noiseless | 8.3 (17) | 7.0 (8) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 527 (469) | 55 (69) | 384 (500) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| FULLNEWUOA ros noiseless | 4.6 (4) | 108 (147) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| G3PCX posik noiseless | 17 (26) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GA nicolau noiseless | 138 (45) | 1037 (1541) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | 1.00 (0.6) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e4 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 3.1 (4) | 1.0 (0.5) | 1.0 (0.9) | 1.1 (0.7) | 1.4 (1) | 1.9 (4) | 1.7 (2) | 7/15 |
| LSfminbnd posik noiseless | 160 (220) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| LSstep posik noiseless | 239 (352) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 19 (35) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| MCS huyer noiseless | 11 (18) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| NELDERDOERR doerr noiseless | 7.2 (18) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 17 (26) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NEWUOA ros noiseless | 16 (27) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| ONEFIFTH auger noiseless | 1398 (2440) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| POEMS kubalik noiseless | 15 (3) | 21 (37) | 105 (175) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO Bounds el-abd noiseless | 128 (42) | 1036 (1229) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO el-abd noiseless | 111 (7) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| RANDOMSEARCH auger noiseless | 6.5e4 (4e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| VNS garcia-martinez noiseless | 3.6 (6) | 9.1 (4) | 502 (586) | ∞ | ∞ | ∞ | ∞6e7 | 0/15 |
| iAMALGAM bosman noiseless | 3.6 (0.8) | 1.7 (3) | 13 (12) | 18 (6) | 29 (18) | 28 (18) | 26 (12) | 15/15 |
| Δ fopt f17, 20-D |
1e1 63 |
1e0 1030 |
1e-1 4005 |
1e-2 12242 |
1e-3 30677 |
1e-5 56288 |
1e-7 80472 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 19 (10) | 28 (8) | 5063 (8406) | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 14 (8) | 7.7 (2) | 4.3 (1) | 5.1 (20) | 4.7 (7) | 5.1 (5) | 5.4 (2) | 15/15 |
| BAYEDA gallagher noiseless | 19 (18) | 19 (6) | 48 (81) | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BFGS ros noiseless | 359 (297) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 2.2 (1) | 1.0 (0.3) | 1.0 (0.8) | 1.0 (0.8) | 1.2 (0.8) | 1.3 (0.8) | 1.4 (0.9) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 29 (10) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| Cauchy-EDA posik noiseless | 256 (251) | 125 (52) | 62 (37) | 30 (6) | 16 (4) | 23 (14) | ∞1e6 | 0/15 |
| DASA korosec noiseless | 6.6e4 (2e5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | 8.3 (5) | 18 (22) | 147 (115) | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| DIRECT posik noiseless | 1.8 (1) | 55 (65) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 13 (13) | 36 (2) | 20 (1) | 22 (123) | 10 (65) | 18 (27) | 21 (13) | 6/15 |
| FULLNEWUOA ros noiseless | 13 (4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| G3PCX posik noiseless | 4.0 (1) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GA nicolau noiseless | 57 (41) | 92 (8) | 7071 (9869) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | 6.2 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞7e4 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.8 (2) | 4.0 (0.9) | 3.1 (1) | 1.6 (0.6) | 1.00 (0.3) | 1.0 (0.2) | 1.00 (0.2) | 15/15 |
| LSfminbnd posik noiseless | 992 (1595) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| LSstep posik noiseless | 1698 (6406) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 3.5 (2) | 5.1 (2) | 7.7 (18) | 10 (9) | 12 (16) | 59 (85) | 86 (116) | 2/15 |
| MCS huyer noiseless | 1 (0.7) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| NELDERDOERR doerr noiseless | 2.1 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 237 (522) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NEWUOA ros noiseless | 16 (1.0) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| ONEFIFTH auger noiseless | 5.2e4 (2e5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| POEMS kubalik noiseless | 94 (17) | 25 (2) | 19 (4) | 198 (244) | 267 (505) | ∞ | ∞2e6 | 0/15 |
| PSO Bounds el-abd noiseless | 3.0 (1) | 831 (1453) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO el-abd noiseless | 3.2 (2) | 2503 (3885) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| RANDOMSEARCH auger noiseless | 120 (153) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | 2.1e4 (2e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| VNS garcia-martinez noiseless | 5.3 (1) | 1.2 (0.2) | 1.5 (0.1) | 5.8 (2) | 34 (26) | ∞ | ∞9e7 | 0/15 |
| iAMALGAM bosman noiseless | 6.4 (4) | 2.9 (0.5) | 1.5 (0.2) | 1.4 (0.1) | 6.1 (10) | 29 (13) | 23 (4) | 15/15 |
| Δ fopt f18, 20-D |
1e1 621 |
1e0 3972 |
1e-1 19561 |
1e-2 28555 |
1e-3 67569 |
1e-5 1.3e5 |
1e-7 1.5e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 15 (4) | 430 (621) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 7.3 (4) | 3.0 (0.7) | 1.00 (0.2) | 1.00 (0.1) | 1.7 (3) | 2.8 (2) | 3.7 (1) | 15/15 |
| BAYEDA gallagher noiseless | 15 (1) | 17 (18) | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BFGS ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.0 (0.3) | 2.4 (5) | 1.2 (1.0) | 1.6 (1) | 1.1 (0.9) | 1.7 (0.8) | 1.6 (0.2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 4821 (3784) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| Cauchy-EDA posik noiseless | 96 (32) | 42 (12) | 15 (2) | 16 (3) | 12 (2) | 38 (56) | ∞1e6 | 0/15 |
| DASA korosec noiseless | 4.5e5 (5e5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | 7.1 (10) | 49 (63) | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| DIRECT posik noiseless | 9.1 (8) | 113 (126) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 30 (4) | 15 (1) | 5.2 (0.3) | 5.4 (0.9) | 18 (22) | 217 (256) | ∞2e6 | 0/15 |
| FULLNEWUOA ros noiseless | 947 (787) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| G3PCX posik noiseless | 7100 (8061) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GA nicolau noiseless | 76 (15) | 311 (382) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞7e4 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.00 (0.2) | 1.0 (2) | 1.1 (0.5) | 1.2 (0.9) | 1.00 (0.5) | 1.00 (0.3) | 1.00 (0.3) | 15/15 |
| LSfminbnd posik noiseless | 4515 (4831) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| LSstep posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 3.6 (1) | 3.6 (2) | 26 (34) | 78 (91) | 210 (227) | ∞ | ∞2e6 | 0/15 |
| MCS huyer noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| NELDERDOERR doerr noiseless | 4320 (3931) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NEWUOA ros noiseless | 1.2e4 (1e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| ONEFIFTH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| POEMS kubalik noiseless | 21 (6) | 144 (383) | 210 (230) | 986 (1348) | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO Bounds el-abd noiseless | 69 (10) | 7091 (5161) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO el-abd noiseless | 236 (6) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| VNS garcia-martinez noiseless | 1.3 (0.3) | 1.00 (2) | 14 (8) | 255 (306) | ∞ | ∞ | ∞9e7 | 0/15 |
| iAMALGAM bosman noiseless | 2.7 (0.3) | 1.2 (0.3) | 2.3 (4) | 3.7 (5) | 19 (15) | 16 (2) | 18 (10) | 15/15 |
| Δ fopt f19, 20-D |
1e1 1 |
1e0 1 |
1e-1 3.4e5 |
1e-2 4.7e6 |
1e-3 6.2e6 |
1e-5 6.7e6 |
1e-7 6.7e6 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 1248 (556) | 6.2e5 (2e5) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 736 (162) | 3.4e4 (4770) | 7.6 (10) | 4.5 (6) | 8.8 (14) | 8.2 (4) | 8.1 (4) | 5/15 |
| BAYEDA gallagher noiseless | 1522 (363) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BFGS ros noiseless | 1.2e6 (1e6) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 169 (88) | 2.4e4 (2e4) | 1.2 (0.8) | 1.0 (0.4) | 1.0 (0.3) | 1.0 (0.2) | 1 (0.2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 1365 (1064) | 2.8e6 (5e6) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| Cauchy-EDA posik noiseless | 8407 (5171) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DASA korosec noiseless | 1.8e6 (1e5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | 430 (204) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| DIRECT posik noiseless | 1 (0) | 1 (0) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 4640 (3161) | 2.8e7 (5e7) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| FULLNEWUOA ros noiseless | 475 (86) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| G3PCX posik noiseless | 796 (768) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GA nicolau noiseless | 1.4e4 (3190) | 6.5e5 (2e6) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | 5601 (1e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e4 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 153 (106) | 2.7e4 (3e4) | 8.7 (4) | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| LSfminbnd posik noiseless | 1173 (1080) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| LSstep posik noiseless | 7789 (1274) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 275 (100) | 2.9e4 (4e4) | 13 (19) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| MCS huyer noiseless | 1 (0) | 1 (0) | 1 (2) | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| NELDERDOERR doerr noiseless | 73 (20) | 4.3e5 (4e5) | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 165 (101) | 1.4e6 (3e6) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NEWUOA ros noiseless | 76 (50) | 4.3e6 (5e6) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| ONEFIFTH auger noiseless | 6.3e6 (1e7) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| POEMS kubalik noiseless | 6196 (502) | 1.4e6 (2e6) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO Bounds el-abd noiseless | 819 (948) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO el-abd noiseless | 382 (260) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| RANDOMSEARCH auger noiseless | 5.9e5 (4e5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| VNS garcia-martinez noiseless | 326 (56) | 8.2e4 (2e5) | ∞ | ∞ | ∞ | ∞ | ∞1e8 | 0/15 |
| iAMALGAM bosman noiseless | 456 (122) | 1.8e6 (1e6) | 44 (48) | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Δ fopt f20, 20-D |
1e1 82 |
1e0 46150 |
1e-1 3.1e6 |
1e-2 5.5e6 |
1e-3 5.5e6 |
1e-5 5.6e6 |
1e-7 5.6e6 |
#succ 14/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 53 (11) | 9.2 (10) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 20 (3) | 88 (34) | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| BAYEDA gallagher noiseless | 49 (6) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BFGS ros noiseless | 2.1 (0.4) | 5.8 (6) | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 4.3 (0.8) | 9.2 (4) | 1.00 (0.5) | 1.00 (0.3) | 1.00 (0.6) | 1.00 (0.3) | 1.00 (0.3) | 14/15 |
| CMA-ESPLUSSEL auger noiseless | 3.4 (0.5) | 21 (24) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| Cauchy-EDA posik noiseless | 336 (167) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DASA korosec noiseless | 20 (4) | 2.1 (2) | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | 15 (3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| DIRECT posik noiseless | 31 (6e-3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 229 (49) | 15 (44) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| FULLNEWUOA ros noiseless | 3.1 (0.3) | 64 (90) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| G3PCX posik noiseless | 5.0 (0.7) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GA nicolau noiseless | 502 (47) | 2.8 (0.4) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | 5.2 (0.1) | 1.6 (0.7) | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 4.4 (1) | 13 (13) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| LSfminbnd posik noiseless | 11 (3) | 5.9 (6) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| LSstep posik noiseless | 279 (41) | 11 (16) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 9.3 (2) | 3.3 (5) | 4.8 (3) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| MCS huyer noiseless | 4.7 (0.5) | 12 (8) | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| NELDERDOERR doerr noiseless | 2.2 (1) | 28 (31) | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 3.5 (1) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NEWUOA ros noiseless | 1.00 (0.4)★ | 15 (20) | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| ONEFIFTH auger noiseless | 3.1 (0.9) | 113 (86) | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| POEMS kubalik noiseless | 117 (25) | 1.00 (0.1) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO Bounds el-abd noiseless | 86 (91) | 11 (12) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO el-abd noiseless | 17 (9) | 50 (33) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | 2.6 (0.5) | 2.9 (3) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| VNS garcia-martinez noiseless | 7.1 (0.6) | 1.1 (0.3) | ∞ | ∞ | ∞ | ∞ | ∞2e8 | 0/15 |
| iAMALGAM bosman noiseless | 14 (3) | 243 (189) | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Δ fopt f21, 20-D |
1e1 561 |
1e0 6541 |
1e-1 14103 |
1e-2 14318 |
1e-3 14643 |
1e-5 15567 |
1e-7 17589 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 14 (4) | 13 (24) | 7.0 (2) | 7.7 (7) | 8.3 (6) | 10 (7) | 11 (5) | 15/15 |
| AMALGAM bosman noiseless | 51 (3) | 2412 (2225) | 1549 (1585) | 1529 (2287) | 1499 (1100) | 1418 (1169) | 1261 (519) | 9/15 |
| BAYEDA gallagher noiseless | 55 (88) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BFGS ros noiseless | 1.9 (3) | 5.5 (4) | 4.6 (2) | 4.6 (6) | 4.5 (7) | 4.3 (3) | 7.3 (5) | 2/15 |
| BIPOP-CMA-ES hansen noiseless | 3.2 (12) | 55 (114) | 48 (24) | 47 (152) | 46 (106) | 43 (21) | 39 (130) | 13/15 |
| CMA-ESPLUSSEL auger noiseless | 3.6 (5) | 7.6 (5) | 5.8 (5) | 5.7 (3) | 5.6 (7) | 5.3 (10) | 4.7 (4) | 14/15 |
| Cauchy-EDA posik noiseless | 1008 (1802) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DASA korosec noiseless | 241 (189) | 101 (184) | 103 (64) | 101 (184) | 99 (108) | 93 (101) | 83 (44) | 15/15 |
| DE-PSO garcia-nieto noiseless | 22 (36) | 13 (23) | 8.3 (9) | 8.6 (11) | 8.9 (10) | 19 (13) | ∞4e4 | 0/15 |
| DIRECT posik noiseless | 3.3 (2) | 27 (17) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 35 (8) | 846 (1148) | 570 (957) | 562 (803) | 550 (444) | 519 (514) | 461 (455) | 3/15 |
| FULLNEWUOA ros noiseless | 7.4 (3) | 3.4 (3) | 4.5 (4) | 4.5 (4) | 4.4 (6) | 4.1 (6) | 3.7 (7) | 14/15 |
| G3PCX posik noiseless | 12 (9) | 7.2 (13) | 5.1 (9) | 5.0 (6) | 4.9 (9) | 4.6 (7) | 4.1 (6) | 15/15 |
| GA nicolau noiseless | 90 (41) | 625 (687) | 398 (639) | 397 (630) | 904 (888) | ∞ | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | 1.0 (0.7) | 1.00 (0.3) | 1.0 (1) | 1.00 (0.7) | 1.0 (1) | 1.0 (1) | 2.1 (3) | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 15 (42) | 50 (61) | 58 (57) | 57 (56) | 56 (79) | 53 (67) | 47 (25) | 3/15 |
| LSfminbnd posik noiseless | 30 (60) | 27 (19) | 20 (31) | 20 (16) | 19 (35) | 18 (31) | 16 (8) | 7/15 |
| LSstep posik noiseless | 124 (178) | 204 (115) | 202 (333) | 200 (217) | 197 (140) | 187 (276) | 168 (190) | 1/15 |
| MA-LS-CHAIN molina noiseless | 141 (349) | 309 (318) | 228 (222) | 225 (208) | 220 (184) | 207 (224) | 184 (119) | 6/15 |
| MCS huyer noiseless | 26 (27) | 32 (24) | 26 (18) | 25 (24) | 25 (31) | 23 (12) | 32 (29) | 2/15 |
| NELDERDOERR doerr noiseless | 7.6 (11) | 4.0 (4) | 2.0 (2) | 2.1 (2) | 2.1 (1) | 2.0 (1) | 1.8 (1) | 15/15 |
| NELDER hansen noiseless | 7.7 (10) | 20 (14) | 24 (18) | 24 (14) | 23 (36) | 22 (15) | 20 (20) | 7/15 |
| NEWUOA ros noiseless | 1.7 (3) | 2.2 (2) | 1.2 (0.7) | 1.2 (1) | 1.2 (2) | 1.1 (1) | 1.0 (2) | 15/15 |
| ONEFIFTH auger noiseless | 8.3 (2) | 13 (13) | 9.4 (9) | 9.3 (14) | 9.1 (12) | 8.6 (17) | 7.6 (14) | 15/15 |
| POEMS kubalik noiseless | 2491 (5347) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO Bounds el-abd noiseless | 564 (6) | 1235 (1300) | 1993 (1595) | 1965 (2619) | 1922 (2322) | 1814 (2280) | 1609 (1933) | 1/15 |
| PSO el-abd noiseless | 1785 (1784) | 4281 (3669) | 1986 (1347) | 1956 (1537) | 1913 (2902) | 1799 (2216) | 1593 (1905) | 1/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | 7.8 (5) | 7.6 (14) | 4.7 (5) | 4.6 (3) | 4.5 (8) | 4.3 (3) | 3.8 (7) | 14/15 |
| VNS garcia-martinez noiseless | 11 (37) | 55 (69) | 29 (42) | 29 (17) | 29 (16) | 27 (16) | 25 (32) | 15/15 |
| iAMALGAM bosman noiseless | 10 (30) | 674 (914) | 540 (672) | 535 (502) | 527 (1170) | 543 (901) | 485 (823) | 12/15 |
| Δ fopt f22, 20-D |
1e1 467 |
1e0 5580 |
1e-1 23491 |
1e-2 24163 |
1e-3 24948 |
1e-5 26847 |
1e-7 1.3e5 |
#succ 12/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 19 (8) | 10 (10) | 79 (161) | 81 (57) | 86 (102) | 184 (308) | 133 (434) | 1/15 |
| AMALGAM bosman noiseless | 8.2 (4) | 1889 (1809) | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| BAYEDA gallagher noiseless | 34 (93) | 31 (48) | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BFGS ros noiseless | 2.5 (3) | 1.8 (1) | 8.1 (8) | 7.9 (5) | 7.7 (5) | 10 (5) | 14 (23) | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 6.8 (7) | 13 (9) | 215 (161) | 209 (300) | 202 (264) | 188 (136) | 37 (49) | 5/15 |
| CMA-ESPLUSSEL auger noiseless | 3.5 (2) | 4.2 (3) | 5.6 (6) | 5.5 (5) | 5.3 (2) | 5.0 (2) | 1.00 (2) | 12/15 |
| Cauchy-EDA posik noiseless | 470 (1085) | 1186 (1971) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DASA korosec noiseless | 34 (84) | 75 (100) | 218 (137) | 214 (223) | 209 (79) | 198 (146) | 40 (24) | 14/15 |
| DE-PSO garcia-nieto noiseless | 20 (5) | 16 (16) | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| DIRECT posik noiseless | 10 (8) | 16 (32) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 1599 (2145) | 995 (1075) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| FULLNEWUOA ros noiseless | 2.2 (2) | 12 (14) | 60 (57) | 59 (70) | 57 (53) | 53 (86) | 11 (8) | 2/15 |
| G3PCX posik noiseless | 11 (14) | 6.6 (7) | 23 (16) | 22 (30) | 22 (12) | 20 (26) | 4.0 (6) | 9/15 |
| GA nicolau noiseless | 110 (53) | 1452 (2869) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | 1.1 (0.4) | 1 (2) | 1 (1) | 1 (1) | 1.0 (2) | 1.00 (1) | 1.3 (1) | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 6.2 (12) | 23 (9) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| LSfminbnd posik noiseless | 59 (66) | 16 (7) | 37 (43) | 36 (27) | 36 (28) | 34 (19) | 7.2 (12) | 3/15 |
| LSstep posik noiseless | 280 (329) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 3.8 (2) | 812 (899) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| MCS huyer noiseless | 17 (0.8) | 20 (23) | 50 (74) | 48 (42) | 47 (36) | ∞ | ∞8e4 | 0/15 |
| NELDERDOERR doerr noiseless | 5.2 (13) | 6.5 (5) | 8.3 (10) | 8.2 (7) | 8.0 (7) | 7.5 (8) | 1.5 (1) | 13/15 |
| NELDER hansen noiseless | 17 (4) | 18 (14) | 61 (47) | 59 (42) | 58 (78) | 54 (70) | 11 (14) | 2/15 |
| NEWUOA ros noiseless | 1.00 (0.1) | 4.9 (4) | 6.8 (4) | 6.6 (12) | 6.4 (4) | 6.0 (8) | 1.2 (2) | 7/15 |
| ONEFIFTH auger noiseless | 11 (26) | 5.0 (10) | 11 (22) | 11 (22) | 11 (18) | 10 (14) | 2.1 (4) | 15/15 |
| POEMS kubalik noiseless | 2266 (1334) | 5022 (4301) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO Bounds el-abd noiseless | 677 (1090) | 727 (628) | 1201 (1979) | 1173 (1366) | 1141 (2165) | 1070 (1918) | 215 (671) | 1/15 |
| PSO el-abd noiseless | 5.0 (3) | 411 (627) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| RANDOMSEARCH auger noiseless | 6.4e5 (7e5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | 3.4 (5) | 4.3 (4) | 12 (9) | 12 (11) | 12 (23) | 11 (10) | 2.2 (2) | 8/15 |
| VNS garcia-martinez noiseless | 14 (29) | 67 (45) | 1277 (1200) | 1243 (3644) | 1207 (2383) | 1126 (1059) | 440 (299) | 13/15 |
| iAMALGAM bosman noiseless | 8.1 (1) | 437 (365) | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Δ fopt f23, 20-D |
1e1 3.0 |
1e0 1614 |
1e-1 67457 |
1e-2 3.7e5 |
1e-3 4.9e5 |
1e-5 8.1e5 |
1e-7 8.4e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 2.0 (2) | 82 (59) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 1.9 (1) | 23 (9) | 1.1 (1) | 1.0 (1) | 1.0 (0.3) | 1.00 (0.5) | 1.00 (3) | 15/15 |
| BAYEDA gallagher noiseless | 1.8 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BFGS ros noiseless | 50 (96) | 304 (537) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 4.6 (6) | 32 (24) | 1.00 (0.6) | 1.7 (0.9) | 2.0 (0.8) | 1.2 (0.7) | 1.2 (0.7) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 6.2 (10) | 9.1 (9) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| Cauchy-EDA posik noiseless | 2.0 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DASA korosec noiseless | 3.6 (5) | 64 (74) | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | 1.7 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| DIRECT posik noiseless | 4.4 (7) | 52 (50) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | 2.2 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| FULLNEWUOA ros noiseless | 15 (8) | 7.0 (8) | 44 (58) | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| G3PCX posik noiseless | 3.0 (2) | 7.8 (7) | ∞ | ∞ | ∞ | ∞ | ∞6e5 | 0/15 |
| GA nicolau noiseless | 1.8 (0.8) | 4570 (4377) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | 3.0 (3) | 1.00 (0.6) | ∞ | ∞ | ∞ | ∞ | ∞9259 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 5.3 (6) | 18 (14) | 3.8 (6) | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| LSfminbnd posik noiseless | 4.7 (6) | 206 (80) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| LSstep posik noiseless | 2.4 (1) | 81 (53) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 1.9 (2) | 7.1 (30) | 8.9 (12) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| MCS huyer noiseless | 1.4 (2) | 124 (144) | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| NELDERDOERR doerr noiseless | 2.0 (2) | 1.4 (2) | 86 (92) | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 2.3 (4) | 3.3 (5) | 43 (56) | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NEWUOA ros noiseless | 12 (12) | 3.5 (2) | 32 (23) | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| ONEFIFTH auger noiseless | 29 (116) | 32 (27) | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| POEMS kubalik noiseless | 25 (41) | 42 (13) | 13 (30) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO Bounds el-abd noiseless | 3.2 (2) | 8431 (2e4) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO el-abd noiseless | 2.4 (2) | 1554 (1327) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| RANDOMSEARCH auger noiseless | 2.8 (5) | 5.5e4 (8e4) | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | 1.8 (0.8) | 4.6 (4) | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| VNS garcia-martinez noiseless | 1.1 (0.3) | 25 (24) | 10 (8) | 1745 (1469) | ∞ | ∞ | ∞4e7 | 0/15 |
| iAMALGAM bosman noiseless | 2.0 (2) | 5.4 (2) | 1.6 (2) | 2.3 (2) | 5.1 (3) | 3.3 (2) | 3.2 (2) | 15/15 |
| Δ fopt f24, 20-D |
1e1 1.3e6 |
1e0 7.5e6 |
1e-1 5.2e7 |
1e-2 5.2e7 |
1e-3 5.2e7 |
1e-5 5.2e7 |
1e-7 5.2e7 |
#succ 3/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 5.1 (6) | 19 (18) | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| BFGS ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.00 (1) | 1.00 (0.9) | 1.0 (1) | 1 (1.0) | 1.00 (1) | 1 (0.9) | 1.00 (1) | 3/15 |
| CMA-ESPLUSSEL auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| DASA korosec noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| EDA-PSO el-abd noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| FULLNEWUOA ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| G3PCX posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GA nicolau noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GLOBAL pal noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e4 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.0 (0.8) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| LSfminbnd posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| LSstep posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| MA-LS-CHAIN molina noiseless | 42 (60) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/29 |
| MCS huyer noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| NELDERDOERR doerr noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| NEWUOA ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| ONEFIFTH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| POEMS kubalik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO Bounds el-abd noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| PSO el-abd noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| VNS garcia-martinez noiseless | 68 (146) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e8 | 0/15 |
| iAMALGAM bosman noiseless | 2.8 (1) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
Previous dimension | Dimension = 40 | First dimension
| Δ fopt f1, 40-D |
1e1 83 |
1e0 83 |
1e-1 83 |
1e-2 83 |
1e-3 83 |
1e-5 83 |
1e-7 83 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 217 (23) | 421 (41) | 639 (60) | 873 (68) | 1132 (78) | 1720 (94) | 2763 (78) | 15/15 |
| AMALGAM bosman noiseless | 154 (26) | 292 (64) | 433 (152) | 565 (117) | 688 (152) | 968 (168) | 1230 (179) | 15/15 |
| BAYEDA gallagher noiseless | 211 (10) | 351 (13) | 503 (14) | 648 (17) | 794 (15) | ∞ | ∞8e4 | 0/15 |
| BFGS ros noiseless | 1 (0) | 1 (0) | 1 (0) | 1 (0) | 1 (0) | 1 (0) | 1 (0) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 10 (0.8) | 15 (2) | 21 (2) | 28 (1) | 34 (1) | 45 (2) | 58 (2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 7.0 (0.6) | 11 (0.8) | 15 (0.9) | 19 (0.7) | 23 (1) | 31 (2) | 39 (2) | 30/30 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DASA korosec noiseless | 33 (5) | 57 (7) | 94 (13) | 132 (13) | 179 (16) | 262 (15) | 344 (21) | 15/15 |
| DE-PSO garcia-nieto noiseless | 65 (15) | 356 (80) | 1.4e4 (2e4) | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| DIRECT posik noiseless | 241 (48) | 531 (58) | 914 (189) | 6039 (6380) | ∞ | ∞ | ∞1e5 | 0/5 |
| G3PCX posik noiseless | 13 (0.6) | 20 (1.0) | 27 (1) | 35 (1) | 42 (2) | 56 (2) | 70 (2) | 15/15 |
| GA nicolau noiseless | 1467 (78) | 2990 (170) | 2.3e4 (611) | 6.8e5 (3e5) | ∞ | ∞ | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 8.7 (0.7) | 14 (1.0) | 19 (0.8) | 25 (1) | 30 (0.8) | 41 (2) | 51 (2) | 15/15 |
| LSfminbnd posik noiseless | 11 (1) | 11 (0.3) | 11 (0.3) | 11 (0.8) | 11 (0.9) | 11 (0.2) | 11 (0.6) | 15/15 |
| LSstep posik noiseless | 182 (10) | 187 (2) | 188 (0.0) | 188 (0) | 188 (0.0) | 188 (0.0) | 188 (0.0) | 15/15 |
| NELDER hansen noiseless | 13 (5) | 21 (4) | 28 (6) | 35 (6) | 42 (5) | 55 (8) | 67 (9) | 15/15 |
| NEWUOA ros noiseless | 1 (0) | 1 (0) | 1 (0) | 1 (0) | 1 (0) | 1 (0) | 1 (0) | 15/15 |
| ONEFIFTH auger noiseless | 5.8 (1.0) | 9.2 (2) | 13 (1) | 16 (2) | 19 (2) | 26 (3) | 33 (2) | 15/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | 4.4 (0.5) | 6.4 (0.4) | 8.1 (0.5) | 10 (0.4) | 12 (0.7) | 15 (0.4) | 19 (1) | 15/15 |
| iAMALGAM bosman noiseless | 73 (3) | 127 (6) | 184 (4) | 239 (4) | 294 (4) | 405 (6) | 516 (5) | 15/15 |
| Δ fopt f2, 40-D |
1e1 796 |
1e0 797 |
1e-1 799 |
1e-2 799 |
1e-3 800 |
1e-5 802 |
1e-7 804 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 102 (3) | 130 (8) | 159 (8) | 197 (4) | 251 (6) | 506 (72) | 1828 (346) | 15/15 |
| AMALGAM bosman noiseless | 83 (21) | 96 (9) | 108 (16) | 119 (11) | 129 (22) | 156 (27) | 180 (14) | 15/15 |
| BAYEDA gallagher noiseless | 78 (2) | 93 (2) | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BFGS ros noiseless | 36 (4) | 42 (4) | 45 (5) | 48 (6) | 51 (6) | 53 (4) | 54 (7) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 63 (4) | 71 (5) | 78 (4) | 82 (4) | 85 (5) | 88 (3) | 90 (2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 55 (9) | 65 (3) | 74 (7) | 80 (7) | 82 (6) | 86 (4) | 86 (3) | 30/30 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DASA korosec noiseless | 15 (1) | 19 (1) | 24 (1) | 28 (0.7) | 32 (2) | 40 (2) | 49 (2) | 15/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| G3PCX posik noiseless | 309 (106) | 646 (62) | 1123 (194) | 1468 (218) | 2135 (275) | 3.7e4 (5e4) | ∞2e6 | 0/15 |
| GA nicolau noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 8.8 (0.8) | 10 (0.7) | 10 (0.7) | 11 (0.7) | 12 (0.8) | 13 (0.8) | 14 (0.5) | 15/15 |
| LSfminbnd posik noiseless | 1 (0.0)★ | 1.0 (0.0)★ | 1.00 (0.0)★ | 1.0 (0.0)★ | 1 (0.0)★ | 1.00 (0.0)★ | 1.00 (0.0)★ | 15/15 |
| LSstep posik noiseless | 17 (0.2) | 17 (0.2) | 17 (0.2) | 17 (0.2) | 17 (0.2) | 17 (0.2) | 17 (0.2) | 15/15 |
| NELDER hansen noiseless | 5.9 (0.7) | 6.9 (1.0) | 7.8 (1) | 8.6 (1) | 9.5 (1) | 11 (1) | 13 (2) | 15/15 |
| NEWUOA ros noiseless | 26 (6) | 44 (8) | 68 (12) | 85 (18) | 108 (18) | 139 (26) | 168 (37) | 15/15 |
| ONEFIFTH auger noiseless | 8671 (2582) | 1.7e4 (1274) | 2.7e4 (4974) | 3.8e4 (2e4) | 8.4e4 (1e5) | 7.5e5 (8e5) | ∞4e7 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | 1.4 (0.1) | 1.6 (0.2) | 1.7 (0.2) | 1.9 (0.2) | 2.1 (0.1) | 2.5 (0.1) | 2.8 (0.3) | 15/15 |
| iAMALGAM bosman noiseless | 46 (8) | 53 (8) | 60 (8) | 65 (9) | 71 (11) | 82 (8) | 93 (7) | 15/15 |
| Δ fopt f3, 40-D |
1e1 15526 |
1e0 15602 |
1e-1 15612 |
1e-2 15641 |
1e-3 15646 |
1e-5 15651 |
1e-7 15656 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 3139 (1344) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BFGS ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| CMA-ESPLUSSEL auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/23 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DASA korosec noiseless | 1.1 (0.2) | 63 (80) | 407 (535) | 406 (201) | 406 (351) | 406 (391) | 407 (362) | 15/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| G3PCX posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GA nicolau noiseless | 476 (651) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| LSfminbnd posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| LSstep posik noiseless | 1.0 (0.0) | 1.0 (6e-4) | 1.0 (1e-3) | 1.00 (1e-3) | 1.0 (4e-4) | 1.0 (3e-4) | 1.0 (7e-4) | 15/15 |
| NELDER hansen noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NEWUOA ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| ONEFIFTH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| iAMALGAM bosman noiseless | 871 (446) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Δ fopt f4, 40-D |
1e1 15536 |
1e0 15601 |
1e-1 15659 |
1e-2 15678 |
1e-3 15703 |
1e-5 15733 |
1e-7 2.8e5 |
#succ 6/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BFGS ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| CMA-ESPLUSSEL auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DASA korosec noiseless | 1.5 (0.2) | 4367 (6425) | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| G3PCX posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GA nicolau noiseless | 3716 (3218) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| LSfminbnd posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| LSstep posik noiseless | 1.00 (6e-4)★ | 1.0 (2e-3)★ | 1.0 (3e-3)★ | 1 (6e-3)★ | 1.00 (8e-3)★ | 1.00 (8e-3)★ | 1.0 (2) | 6/15 |
| NELDER hansen noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NEWUOA ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6e5 | 0/15 |
| ONEFIFTH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| iAMALGAM bosman noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Δ fopt f5, 40-D |
1e1 98 |
1e0 116 |
1e-1 120 |
1e-2 121 |
1e-3 121 |
1e-5 121 |
1e-7 121 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 137 (7) | 156 (13) | 180 (28) | 198 (29) | 208 (35) | 225 (14) | 231 (44) | 15/15 |
| AMALGAM bosman noiseless | 122 (19) | 104 (19) | 101 (13) | 100 (14) | 100 (13) | 100 (18) | 100 (18) | 15/15 |
| BAYEDA gallagher noiseless | 213 (11) | 217 (9) | 219 (8) | 218 (6) | 218 (11) | 218 (8) | 218 (5) | 15/15 |
| BFGS ros noiseless | 2.1 (0.6) | 2.3 (0.7) | 2.3 (0.6) | 2.3 (0.6) | 2.3 (0.6) | 2.3 (0.7) | 2.3 (0.7) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 4.5 (0.5) | 4.4 (0.5) | 4.4 (0.4) | 4.4 (0.5) | 4.4 (0.5) | 4.4 (0.4) | 4.4 (0.3) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 3.0 (1) | 3.0 (0.9) | 2.9 (0.7) | 3.0 (0.8) | 3.0 (0.7) | 3.0 (1) | 3.0 (0.4) | 15/15 |
| Cauchy-EDA posik noiseless | 315 (111) | 266 (84) | 257 (72) | 255 (87) | 255 (86) | 255 (94) | 255 (86) | 15/15 |
| DASA korosec noiseless | 17 (2) | 19 (3) | 23 (2) | 27 (2) | 34 (4) | 50 (4) | 68 (6) | 15/15 |
| DE-PSO garcia-nieto noiseless | 29 (3) | 30 (3) | 30 (2) | 31 (2) | 31 (1) | 31 (0.8) | 31 (2) | 15/15 |
| DIRECT posik noiseless | 700 (5e-3) | 678 (6) | 660 (4e-3) | 655 (4e-3) | 655 (4e-3) | 655 (4e-3) | 655 (4e-3) | 5/5 |
| G3PCX posik noiseless | 19 (2) | 21 (3) | 20 (3) | 21 (3) | 21 (4) | 21 (3) | 21 (3) | 15/15 |
| GA nicolau noiseless | 3000 (127) | 4798 (185) | 7016 (433) | 9476 (366) | 1.2e4 (426) | 1.8e4 (640) | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 5.3 (0.5) | 5.4 (0.5) | 5.3 (0.3) | 5.2 (0.5) | 5.2 (0.3) | 5.2 (0.5) | 5.2 (0.5) | 15/15 |
| LSfminbnd posik noiseless | 13 (0.3) | 11 (0.1) | 11 (4e-3) | 11 (0) | 11 (0) | 11 (0) | 11 (0) | 15/15 |
| LSstep posik noiseless | 157 (3) | 134 (4e-3) | 130 (2e-3) | 129 (4e-3) | 129 (4e-3) | 129 (4e-3) | 129 (4e-3) | 15/15 |
| NELDER hansen noiseless | 14 (4) | 13 (0.9) | 13 (4) | 13 (3) | 13 (3) | 13 (3) | 13 (3) | 15/15 |
| NEWUOA ros noiseless | 1.0 (0.2)★ | 1.00 (0.2)★ | 1.0 (0.3)★ | 1.00 (0.2)★ | 1.00 (0.3)★ | 1.00 (0.3)★ | 1.00 (0.3)★ | 15/15 |
| ONEFIFTH auger noiseless | 2.9 (0.9) | 2.9 (0.6) | 2.9 (0.6) | 2.9 (0.6) | 2.9 (0.9) | 2.9 (0.7) | 2.9 (0.7) | 15/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | 3.6 (0.1) | 3.1 (0.0) | 3.0 (0.1) | 2.9 (0.0) | 2.9 (0.1) | 2.9 (0.1) | 2.9 (0.1) | 15/15 |
| iAMALGAM bosman noiseless | 8.1 (2) | 7.3 (1) | 7.2 (2) | 7.1 (1) | 7.1 (1) | 7.1 (2) | 7.1 (0.8) | 15/15 |
| Δ fopt f6, 40-D |
1e1 3507 |
1e0 5523 |
1e-1 7168 |
1e-2 9470 |
1e-3 11538 |
1e-5 15007 |
1e-7 19222 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 53 (13) | 93 (41) | 332 (198) | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 56 (15) | 48 (5) | 47 (4) | 43 (8) | 42 (4) | 41 (3) | 40 (4) | 15/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BFGS ros noiseless | 4.5 (2) | 4.6 (1) | 4.7 (1) | 4.6 (1) | 4.6 (1) | 5.1 (0.9) | 25 (21) | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.6 (0.2) | 1.5 (0.2) | 1.5 (0.2) | 1.4 (0.1) | 1.4 (0.1) | 1.4 (0.1) | 1.4 (0.1) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 356 (599) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DASA korosec noiseless | 18 (6) | 25 (17) | 36 (33) | 41 (37) | 46 (31) | 56 (41) | 59 (13) | 15/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| G3PCX posik noiseless | 1.6 (0.3) | 1.6 (0.2) | 1.7 (0.3) | 1.7 (0.2) | 1.7 (0.2) | 1.8 (0.1) | 1.7 (0.1) | 15/15 |
| GA nicolau noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.9 (0.4) | 1.8 (0.3) | 1.9 (0.2) | 1.8 (0.1) | 1.8 (0.3) | 2.0 (0.6) | 2.0 (0.4) | 15/15 |
| LSfminbnd posik noiseless | 100 (161) | 524 (489) | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| LSstep posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 2.7 (0.3) | 2.5 (0.4) | 2.6 (0.3) | 2.8 (2) | 3.5 (3) | 16 (15) | 68 (80) | 2/15 |
| NEWUOA ros noiseless | 1.00 (0.3)★ | 1.0 (0.2)★ | 1.0 (0.2)★ | 1.00 (0.2)★ | 1.0 (0.1)★ | 1.00 (0.2)★ | 1.00 (0.1)★ | 15/15 |
| ONEFIFTH auger noiseless | 3.2 (2) | 4.6 (5) | 6.1 (6) | 6.8 (6) | 7.4 (7) | 8.6 (3) | 9.0 (7) | 15/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | 23 (19) | 39 (40) | 99 (64) | 199 (160) | ∞ | ∞ | ∞4e5 | 0/15 |
| iAMALGAM bosman noiseless | 10 (2) | 10 (2) | 11 (2) | 10 (2) | 10 (1) | 11 (2) | 11 (2) | 15/15 |
| Δ fopt f7, 40-D |
1e1 10698 |
1e0 17839 |
1e-1 41037 |
1e-2 66294 |
1e-3 66294 |
1e-5 66294 |
1e-7 68145 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 1965 (982) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 2.5 (0.5) | 2.2 (0.5) | 1.3 (0.2) | 1.0 (0.2) | 1.0 (0.1) | 1.0 (0.2) | 1.0 (0.1) | 15/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BFGS ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4100 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.2 (0.8) | 8.3 (0.5) | 4.0 (0.2) | 2.6 (0.7) | 2.6 (0.1) | 2.6 (0.2) | 2.5 (0.1) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 100 (76) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DASA korosec noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| G3PCX posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| GA nicolau noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.3 (0.8) | 5.2 (1) | 2.5 (0.1) | 1.6 (0.1) | 1.6 (0.1) | 1.6 (0.1) | 1.6 (0.1) | 15/15 |
| LSfminbnd posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| LSstep posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NEWUOA ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| ONEFIFTH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| iAMALGAM bosman noiseless | 1.00 (0.1) | 1.00 (0.1) | 1.00 (0.6) | 1.7 (1) | 1.7 (2) | 1.7 (2) | 1.7 (0.4) | 15/15 |
| Δ fopt f8, 40-D |
1e1 7080 |
1e0 10655 |
1e-1 11012 |
1e-2 11265 |
1e-3 11430 |
1e-5 11701 |
1e-7 11969 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 530 (174) | 1064 (2437) | 1935 (1430) | 1991 (1443) | 3182 (2634) | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 47 (0.9) | 40 (1) | 41 (1) | 42 (1) | 43 (1) | 43 (2) | 44 (1) | 15/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BFGS ros noiseless | 2.4 (0.3) | 2.2 (0.6) | 2.2 (1.0) | 2.1 (0.5) | 2.1 (0.8) | 2.1 (0.9) | 2.0 (0.5) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 7.3 (0.3) | 7.7 (3) | 7.9 (5) | 7.9 (2) | 7.9 (3) | 7.9 (2) | 7.8 (2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 8.3 (2) | 8.3 (2) | 8.6 (1) | 8.7 (3) | 8.8 (3) | 8.8 (1) | 8.9 (3) | 15/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DASA korosec noiseless | 55 (41) | 61 (60) | 85 (47) | 116 (60) | 153 (67) | 224 (28) | 290 (69) | 15/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| G3PCX posik noiseless | 6.4 (0.2) | 8.4 (11) | 8.6 (5) | 8.9 (7) | 9.1 (10) | 9.5 (2) | 10 (4) | 15/15 |
| GA nicolau noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 10 (1) | 9.1 (4) | 9.2 (0.3) | 9.1 (4) | 9.1 (0.5) | 9.1 (0.5) | 9.0 (0.3) | 15/15 |
| LSfminbnd posik noiseless | 5.1 (10) | 88 (131) | 257 (263) | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| LSstep posik noiseless | 16 (2) | 90 (47) | 164 (137) | 254 (275) | 520 (569) | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 148 (251) | 281 (398) | 550 (786) | 540 (449) | 532 (381) | 520 (294) | 509 (594) | 1/15 |
| NEWUOA ros noiseless | 1.0 (0.3) | 1.0 (0.7)★ | 1.00 (0.7)★ | 1.00 (0.4)★ | 1.00 (0.4)★ | 1.0 (0.6)★ | 1 (0.4)★ | 15/15 |
| ONEFIFTH auger noiseless | 27 (3) | 67 (55) | 73 (107) | 85 (93) | 101 (97) | 134 (1) | 165 (93) | 13/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | 32 (65) | 81 (104) | 92 (56) | 98 (90) | 252 (264) | 505 (308) | ∞4e5 | 0/15 |
| iAMALGAM bosman noiseless | 17 (0.7) | 15 (0.7) | 15 (0.7) | 15 (0.4) | 16 (0.6) | 16 (0.8) | 16 (0.5) | 15/15 |
| Δ fopt f9, 40-D |
1e1 6122 |
1e0 12982 |
1e-1 13300 |
1e-2 13496 |
1e-3 13651 |
1e-5 13909 |
1e-7 14142 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 54 (4) | 32 (1) | 34 (1) | 35 (2) | 35 (2) | 36 (2) | 37 (2) | 15/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BFGS ros noiseless | 2.6 (0.1) | 1.8 (0.7) | 1.8 (1) | 1.8 (1) | 1.7 (0.8) | 1.7 (0.4) | 1.7 (0.7) | 15/15 |
| BIPOP-CMA-ES hansen noiseless | 8.2 (1) | 6.2 (2) | 6.4 (4) | 6.5 (0.4) | 6.5 (0.3) | 6.5 (2) | 6.5 (0.3) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 10 (1) | 10 (8) | 10 (8) | 10 (6) | 10 (6) | 10 (8) | 10 (5) | 15/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DASA korosec noiseless | 410 (29) | 423 (855) | 518 (3) | 653 (541) | 817 (415) | 1147 (546) | 1564 (51) | 14/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| G3PCX posik noiseless | 6.9 (0.6) | 5.8 (0.6) | 6.2 (2) | 6.4 (0.3) | 6.6 (3) | 6.9 (6) | 7.2 (5) | 15/15 |
| GA nicolau noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 10 (1) | 6.9 (2) | 7.1 (4) | 7.1 (2) | 7.1 (4) | 7.1 (0.2) | 7.1 (0.2) | 15/15 |
| LSfminbnd posik noiseless | 964 (1192) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| LSstep posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 160 (111) | 225 (322) | 455 (413) | 449 (496) | 444 (335) | ∞ | ∞4e5 | 0/15 |
| NEWUOA ros noiseless | 1 (0.2)★ | 1.0 (0.7) | 1.0 (0.5) | 1 (0.7) | 1.0 (0.6) | 1.0 (0.4) | 1.00 (0.5) | 15/15 |
| ONEFIFTH auger noiseless | 33 (7) | 91 (0.7) | 95 (82) | 105 (51) | 118 (160) | 145 (127) | 172 (165) | 15/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | 22 (0.8) | 19 (16) | 22 (0.9) | 30 (0.7) | ∞ | ∞ | ∞4e5 | 0/15 |
| iAMALGAM bosman noiseless | 20 (0.9) | 12 (0.6) | 13 (0.7) | 13 (0.7) | 13 (0.6) | 13 (0.6) | 14 (0.5) | 15/15 |
| Δ fopt f10, 40-D |
1e1 25536 |
1e0 29762 |
1e-1 35676 |
1e-2 51579 |
1e-3 56007 |
1e-5 65128 |
1e-7 70824 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 2.4 (0.4) | 2.4 (0.4) | 2.3 (0.3) | 1.8 (0.3) | 1.9 (0.3) | 1.9 (0.3) | 2.1 (0.4) | 15/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BFGS ros noiseless | 1.00 (0.1)★ | 1.00 (0.2)★ | 1.0 (0.2)★ | 1.6 (1) | 8.0 (4) | 134 (199) | ∞4e6 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.9 (0.2) | 1.9 (0.2) | 1.8 (0.2) | 1.3 (0.1) | 1.2 (0.1) | 1.1 (0.0) | 1.0 (0.0) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 1.7 (0.3) | 1.8 (0.2) | 1.7 (0.1) | 1.3 (0.1) | 1.2 (0.1) | 1.1 (0.0) | 1.00 (0.0) | 15/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DASA korosec noiseless | 2.3e4 (4e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| G3PCX posik noiseless | 11 (5) | 19 (6) | 25 (8) | 23 (9) | 33 (39) | 150 (104) | ∞2e6 | 0/15 |
| GA nicolau noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.9 (0.2) | 2.7 (0.2) | 2.4 (0.2) | 1.8 (0.1) | 1.7 (0.1) | 1.5 (0.0) | 1.4 (0.0) | 15/15 |
| LSfminbnd posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| LSstep posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NEWUOA ros noiseless | 1.3 (0.2) | 1.6 (0.4) | 1.8 (0.6) | 1.5 (0.3) | 1.7 (0.4) | 1.9 (0.5) | 2.1 (0.4) | 15/15 |
| ONEFIFTH auger noiseless | 262 (152) | 435 (216) | 595 (259) | 624 (441) | 1033 (420) | ∞ | ∞4e7 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| iAMALGAM bosman noiseless | 1.4 (0.2) | 1.4 (0.1) | 1.3 (0.1) | 1.0 (0.1) | 1.00 (0.0) | 1.00 (0.1)★ | 1.1 (0.1) | 15/15 |
| Δ fopt f11, 40-D |
1e1 2368 |
1e0 4855 |
1e-1 11681 |
1e-2 25315 |
1e-3 29749 |
1e-5 38949 |
1e-7 48211 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 965 (340) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 9.5 (1) | 6.8 (1.0) | 3.8 (0.6) | 2.2 (0.3) | 2.2 (0.3) | 2.3 (0.4) | 2.2 (0.3) | 15/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BFGS ros noiseless | 1.0 (0.4)★ | 1.0 (0.5)★ | 1.00 (0.6)★ | 2.3 (1) | 65 (85) | ∞ | ∞4e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 15 (2) | 8.0 (2) | 3.5 (0.6) | 1.7 (0.3) | 1.5 (0.3) | 1.2 (0.1) | 1.0 (0.1) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 7.1 (0.7) | 5.5 (0.6) | 3.1 (0.2) | 1.9 (0.2) | 2.0 (0.2) | 2.2 (0.3) | 2.3 (0.2) | 15/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DASA korosec noiseless | 588 (266) | 795 (421) | 500 (174) | 387 (190) | 447 (94) | 572 (261) | 938 (988) | 3/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| G3PCX posik noiseless | 18 (3) | 14 (2) | 8.0 (0.6) | 4.7 (0.5) | 4.8 (0.4) | 5.1 (0.3) | 5.1 (0.3) | 15/15 |
| GA nicolau noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 25 (3) | 13 (1) | 5.7 (0.6) | 2.7 (0.2) | 2.4 (0.1) | 1.9 (0.1) | 1.6 (0.1) | 15/15 |
| LSfminbnd posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| LSstep posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NEWUOA ros noiseless | 13 (3) | 10 (2) | 4.9 (0.8) | 2.8 (0.3) | 2.8 (0.5) | 2.7 (0.3) | 2.7 (0.1) | 15/15 |
| ONEFIFTH auger noiseless | 866 (157) | 654 (96) | 350 (34) | 212 (19) | 213 (13) | 223 (10) | 225 (6) | 14/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| iAMALGAM bosman noiseless | 5.0 (0.7) | 3.3 (0.2) | 1.8 (0.1) | 1.0 (0.0) | 1.00 (0.0)★ | 1.0 (0.0)★ | 1.0 (0.0) | 15/15 |
| Δ fopt f12, 40-D |
1e1 4169 |
1e0 7452 |
1e-1 9174 |
1e-2 10751 |
1e-3 13146 |
1e-5 22758 |
1e-7 25192 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 179 (381) | 688 (737) | 8147 (1e4) | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 21 (3) | 13 (1) | 14 (2) | 16 (2) | 17 (2) | 14 (2) | 15 (0.7) | 15/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BFGS ros noiseless | 1.0 (0.5) | 1.0 (0.2) | 1.0 (0.5) | 1.0 (0.4) | 1.00 (0.3) | 15 (24) | 656 (901) | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 2.2 (3) | 2.3 (2) | 2.5 (2) | 2.5 (1) | 2.5 (2) | 1.9 (0.6) | 1.9 (0.6) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 2.1 (2) | 3.1 (3) | 4.1 (5) | 4.4 (3) | 4.6 (3) | 3.6 (2) | 4.1 (2) | 15/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DASA korosec noiseless | 3.8e4 (1e5) | 3.5e4 (1e4) | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| G3PCX posik noiseless | 2.0 (2) | 2.5 (2) | 3.0 (2) | 3.3 (1) | 3.2 (2) | 2.5 (1) | 2.7 (0.8) | 15/15 |
| GA nicolau noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.8 (4) | 3.6 (3) | 4.2 (2) | 4.2 (1) | 3.9 (2) | 2.7 (0.8) | 2.7 (0.6) | 15/15 |
| LSfminbnd posik noiseless | 265 (192) | 752 (1261) | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| LSstep posik noiseless | 148 (408) | 352 (456) | 613 (621) | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 15 (22) | 24 (18) | 52 (51) | 185 (198) | ∞ | ∞ | ∞4e5 | 0/15 |
| NEWUOA ros noiseless | 1.4 (1) | 1.4 (1) | 1.4 (1) | 1.5 (0.7) | 1.4 (0.5) | 1.00 (0.4)★ | 1.00 (0.2)★ | 15/15 |
| ONEFIFTH auger noiseless | 4798 (9595) | 7717 (4971) | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | 17 (29) | 30 (22) | 51 (45) | 115 (198) | 433 (563) | ∞ | ∞4e5 | 0/15 |
| iAMALGAM bosman noiseless | 8.6 (1) | 6.4 (3) | 7.0 (4) | 7.3 (2) | 7.2 (2) | 5.4 (0.6) | 5.7 (0.3) | 15/15 |
| Δ fopt f13, 40-D |
1e1 2029 |
1e0 6916 |
1e-1 8734 |
1e-2 11861 |
1e-3 71936 |
1e-5 98467 |
1e-7 1.2e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 128 (93) | 189 (251) | 862 (782) | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 28 (8) | 12 (2) | 12 (2) | 10 (1) | 2.0 (0.1) | 1.9 (0.2) | 1.9 (0.2) | 15/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BFGS ros noiseless | 1.4 (0.1) | 1.0 (0.0) | 1 (0.0) | 1.00 (0.0) | 46 (26) | ∞ | ∞2e6 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 2.6 (4) | 2.6 (3) | 5.0 (6) | 17 (26) | 4.4 (3) | 5.3 (3) | 5.9 (2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 1.7 (1) | 4.2 (8) | 9.5 (9) | 20 (15) | 5.6 (6) | 18 (19) | 48 (113) | 1/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DASA korosec noiseless | 40 (33) | 73 (62) | 154 (131) | 544 (631) | 217 (129) | 2854 (1958) | ∞4e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| G3PCX posik noiseless | 7.2 (11) | 11 (14) | 34 (29) | 45 (61) | 21 (32) | 77 (100) | 218 (154) | 0/15 |
| GA nicolau noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.1 (0.3) | 2.8 (4) | 6.3 (6) | 8.2 (7) | 2.6 (0.8) | 2.8 (3) | 2.9 (1) | 14/15 |
| LSfminbnd posik noiseless | 10 (20) | 15 (27) | 56 (85) | 144 (133) | 78 (63) | ∞ | ∞4e5 | 0/15 |
| LSstep posik noiseless | 213 (204) | 196 (174) | 682 (435) | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 10 (12) | 20 (45) | 71 (63) | 161 (161) | 41 (62) | ∞ | ∞4e5 | 0/15 |
| NEWUOA ros noiseless | 1.0 (1)★ | 2.0 (2) | 3.0 (3) | 13 (9) | 7.3 (9) | 28 (28) | ∞4e5 | 0/15 |
| ONEFIFTH auger noiseless | 4.7 (6) | 4.5 (4) | 18 (30) | 36 (29) | 11 (12) | 104 (60) | 1405 (1438) | 2/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | 2.2 (4) | 2.6 (2) | 5.9 (5) | 11 (13) | 5.6 (13) | 60 (64) | ∞4e5 | 0/15 |
| iAMALGAM bosman noiseless | 11 (0.4) | 4.5 (0.1) | 4.7 (0.1) | 4.8 (0.9) | 1.00 (0.2) | 1.0 (0.2) | 1.0 (0.1) | 15/15 |
| Δ fopt f14, 40-D |
1e1 304 |
1e0 616 |
1e-1 777 |
1e-2 1105 |
1e-3 2207 |
1e-5 4825 |
1e-7 57711 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 38 (4) | 60 (4) | 80 (4) | 143 (30) | 514 (102) | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 44 (12) | 47 (11) | 53 (17) | 50 (7) | 30 (3) | 20 (3) | 2.1 (0.2) | 15/15 |
| BAYEDA gallagher noiseless | 74 (6) | 91 (6) | 179 (78) | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BFGS ros noiseless | 1.7 (0.9) | 1.6 (0.4) | 1.8 (0.6) | 1.7 (0.4) | 1.2 (0.2) | 1.0 (0.2)★ | ∞7e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 2.7 (0.7) | 2.5 (0.2) | 3.1 (0.3) | 3.9 (0.1) | 4.4 (0.3) | 6.6 (0.6) | 1.1 (0.0) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 2.1 (0.2) | 1.8 (0.2) | 2.0 (0.2) | 2.2 (0.2) | 2.2 (0.4) | 5.3 (0.5) | 1.0 (0.1) | 15/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DASA korosec noiseless | 8.8 (2) | 8.7 (0.8) | 13 (0.7) | 22 (2) | 71 (8) | 4649 (633) | ∞4e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | 11 (2) | 28 (5) | 295 (310) | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| DIRECT posik noiseless | 34 (9) | 315 (283) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| G3PCX posik noiseless | 2.9 (0.4) | 2.7 (0.1) | 3.1 (0.3) | 3.6 (0.1) | 3.6 (0.3) | 19 (4) | ∞2e6 | 0/15 |
| GA nicolau noiseless | 276 (32) | 399 (63) | 1.1e4 (9234) | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 2.4 (0.4) | 2.4 (0.3) | 2.8 (0.3) | 3.7 (0.4) | 6.8 (0.8) | 10 (1) | 1.5 (0.1) | 15/15 |
| LSfminbnd posik noiseless | 5.3 (1) | 4.2 (0.5) | 4.6 (0.4) | 9.1 (0.6) | 55 (14) | ∞ | ∞4e5 | 0/15 |
| LSstep posik noiseless | 131 (21) | 106 (13) | 113 (9) | 210 (40) | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 2.5 (2) | 2.8 (0.3) | 3.0 (0.3) | 3.4 (0.7) | 3.4 (0.4) | ∞ | ∞4e5 | 0/15 |
| NEWUOA ros noiseless | 1.0 (0.5) | 1.0 (0.3) | 1.00 (0.3) | 1.00 (0.2)★ | 1.00 (0.2) | 8.6 (0.5) | 24 (0.1) | 0/15 |
| ONEFIFTH auger noiseless | 1.9 (0.5) | 1.6 (0.3) | 1.8 (0.2) | 2.2 (0.0) | 5.2 (0.1) | 400 (5) | ∞4e7 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | 1.3 (0.2) | 1.0 (0.1) | 1.1 (0.1) | 1.6 (0.1) | 6.7 (2) | ∞ | ∞4e5 | 0/15 |
| iAMALGAM bosman noiseless | 13 (2) | 15 (0.6) | 19 (0.9) | 19 (0.2) | 12 (0.2) | 8.6 (0.4) | 1.00 (0.0) | 15/15 |
| Δ fopt f15, 40-D |
1e1 1.9e5 |
1e0 7.9e5 |
1e-1 1.0e6 |
1e-2 1.1e6 |
1e-3 1.1e6 |
1e-5 1.1e6 |
1e-7 1.1e6 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 1.9 (3) | 1.5 (0.8) | 1.6 (1) | 1.6 (2) | 1.6 (1) | 1.6 (0.6) | 1.7 (0.7) | 15/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BFGS ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.4 (0.5) | 1.0 (0.5) | 1.0 (0.3) | 1.00 (0.4) | 1.00 (0.4) | 1.00 (0.6) | 1.00 (0.5) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DASA korosec noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| G3PCX posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GA nicolau noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.0 (0.4) | 3.6 (4) | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| LSfminbnd posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| LSstep posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NEWUOA ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| ONEFIFTH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| iAMALGAM bosman noiseless | 10 (8) | 14 (5) | 11 (4) | 11 (2) | 11 (2) | 10 (2) | 10 (2) | 15/15 |
| Δ fopt f16, 40-D |
1e1 5244 |
1e0 72122 |
1e-1 3.2e5 |
1e-2 7.1e5 |
1e-3 1.4e6 |
1e-5 2.0e6 |
1e-7 2.0e6 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 11 (7) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 17 (1) | 3.4 (5) | 3.6 (2) | 4.8 (6) | 3.4 (3) | 3.1 (1) | 3.8 (2) | 15/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BFGS ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1 (0.3) | 1.00 (0.4) | 1.0 (0.6) | 1.3 (0.5) | 1.00 (0.4) | 1.0 (0.8) | 1.0 (1) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 545 (733) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DASA korosec noiseless | 1.1e5 (1e5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| DIRECT posik noiseless | 19 (18) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| G3PCX posik noiseless | 56 (82) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GA nicolau noiseless | 255 (581) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.8 (0.5) | 1.5 (0.8) | 1.0 (0.7) | 1.00 (0.8) | 1.4 (1) | ∞ | ∞4e5 | 0/15 |
| LSfminbnd posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| LSstep posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 95 (83) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NEWUOA ros noiseless | 17 (19) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞6e5 | 0/15 |
| ONEFIFTH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| iAMALGAM bosman noiseless | 3.1 (0.5) | 4.3 (14) | 24 (11) | 27 (5) | 17 (15) | 27 (33) | 27 (32) | 8/15 |
| Δ fopt f17, 40-D |
1e1 399 |
1e0 4220 |
1e-1 14158 |
1e-2 34948 |
1e-3 51958 |
1e-5 1.3e5 |
1e-7 2.7e5 |
#succ 14/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 7.0 (3) | 3767 (4739) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 13 (6) | 9.3 (2) | 4.9 (1) | 3.0 (0.5) | 2.6 (0.2) | 1.6 (0.1) | 4.5 (6) | 15/15 |
| BAYEDA gallagher noiseless | 22 (7) | 14 (2) | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BFGS ros noiseless | 382 (251) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.0 (0.3) | 1.0 (2) | 1.0 (1) | 1.0 (1.0) | 1.00 (0.4)★ | 1.00 (0.4) | 1.4 (0.2) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 67 (0.7) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DASA korosec noiseless | 9.4e4 (1e5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | 4.0 (2) | 31 (24) | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| DIRECT posik noiseless | 1.8 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| G3PCX posik noiseless | 297 (1103) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GA nicolau noiseless | 63 (13) | 231 (246) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.0 (0.2) | 2.1 (2) | 2.4 (1) | 1.6 (0.1) | 1.6 (0.3) | 1.3 (0.3) | 1.0 (0.3) | 14/15 |
| LSfminbnd posik noiseless | 1156 (2006) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| LSstep posik noiseless | 1316 (1493) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 306 (291) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NEWUOA ros noiseless | 38 (1) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| ONEFIFTH auger noiseless | 5.6e4 (1e5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| RANDOMSEARCH auger noiseless | 2.2e4 (4e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| iAMALGAM bosman noiseless | 5.2 (2) | 2.6 (0.1) | 1.5 (0.0) | 1.0 (0.1) | 54 (72) | 103 (39) | 62 (19) | 15/15 |
| Δ fopt f18, 40-D |
1e1 1442 |
1e0 16998 |
1e-1 47068 |
1e-2 1.3e5 |
1e-3 1.9e5 |
1e-5 6.7e5 |
1e-7 9.5e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 38 (31) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 18 (6) | 3.3 (0.5) | 1.9 (0.3) | 1.00 (0.1) | 2.2 (5) | 2.6 (5) | 5.0 (12) | 15/15 |
| BAYEDA gallagher noiseless | 23 (3) | 35 (60) | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BFGS ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 1.1 (0.8) | 1.1 (1) | 1.4 (0.6) | 1.1 (0.5) | 1.1 (0.3) | 1.2 (2) | 1.1 (0.6) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DASA korosec noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | 25 (12) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| DIRECT posik noiseless | 125 (110) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| G3PCX posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GA nicolau noiseless | 104 (23) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1.0 (0.4) | 1.3 (2) | 1.7 (0.4) | 1.1 (0.4) | 1.00 (0.5) | 1.0 (0.5) | 1.00 (1) | 5/15 |
| LSfminbnd posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| LSstep posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NEWUOA ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/30 |
| ONEFIFTH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| iAMALGAM bosman noiseless | 4.6 (0.4) | 1.00 (0.1) | 1.00 (0.0)★ | 9.0 (27) | 52 (48) | 44 (22) | 43 (44) | 10/15 |
| Δ fopt f19, 40-D |
1e1 1 |
1e0 1 |
1e-1 1.4e6 |
1e-2 1.7e7 |
1e-3 2.6e7 |
1e-5 4.5e7 |
1e-7 4.5e7 |
#succ 8/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 2278 (301) | 3.5e7 (2e7) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 3921 (616) | 1.4e5 (4453) | 1.0 (0.4) | 2.6 (4) | 7.4 (15) | 4.2 (4) | 4.2 (4) | 3/15 |
| BAYEDA gallagher noiseless | 6438 (1020) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BFGS ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 391 (120) | 5.6e4 (2e4) | 1.2 (0.4) | 1.00 (0.3) | 1 (0.4) | 1.00 (0.9) | 1.00 (1) | 8/15 |
| CMA-ESPLUSSEL auger noiseless | 5544 (2e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| Cauchy-EDA posik noiseless | 1.3e7 (1e7) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DASA korosec noiseless | 5.6e8 (3e8) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | 1369 (849) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| DIRECT posik noiseless | 1 (0)★ | 1 (0)★ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| G3PCX posik noiseless | 3213 (1713) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GA nicolau noiseless | 4.6e4 (6348) | 5.7e7 (8e7) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 370 (81) | 2.6e5 (5e5) | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| LSfminbnd posik noiseless | 2.6e4 (5e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| LSstep posik noiseless | 5.5e4 (5e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 4213 (2e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NEWUOA ros noiseless | 352 (219) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/30 |
| ONEFIFTH auger noiseless | 2.7e8 (3e8) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| iAMALGAM bosman noiseless | 2451 (304) | 6.0e5 (4e6) | 46 (55) | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Δ fopt f20, 40-D |
1e1 222 |
1e0 1.3e5 |
1e-1 1.6e8 |
1e-2 ∞ |
1e-3 ∞ |
1e-5 ∞ |
1e-7 ∞ |
#succ 0/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 40 (6) | ∞ | ∞ | 0/15 | ||||
| AMALGAM bosman noiseless | 52 (22) | 1388 (1021) | ∞ | 0/15 | ||||
| BAYEDA gallagher noiseless | 64 (2) | ∞ | ∞ | 0/15 | ||||
| BFGS ros noiseless | 1.5 (0.1) | 33 (13) | ∞ | 0/15 | ||||
| BIPOP-CMA-ES hansen noiseless | 4.1 (0.6) | 22 (8) | 1 (1) | 0/15 | ||||
| CMA-ESPLUSSEL auger noiseless | 2.7 (0.3) | ∞ | ∞ | 0/15 | ||||
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | 0/15 | ||||
| DASA korosec noiseless | 14 (3) | 1.00 (1) | ∞ | 0/15 | ||||
| DE-PSO garcia-nieto noiseless | 22 (9) | ∞ | ∞ | 0/15 | ||||
| DIRECT posik noiseless | 66 (1e-3) | ∞ | ∞ | 0/5 | ||||
| G3PCX posik noiseless | 5.0 (0.7) | ∞ | ∞ | 0/15 | ||||
| GA nicolau noiseless | 514 (39) | 2.9 (0.4) | ∞ | 0/15 | ||||
| IPOP-SEP-CMA-ES ros noiseless | 3.5 (0.5) | ∞ | ∞ | 0/15 | ||||
| LSfminbnd posik noiseless | 10 (1) | ∞ | ∞ | 0/15 | ||||
| LSstep posik noiseless | 234 (56) | 10 (11) | ∞ | 0/15 | ||||
| NELDER hansen noiseless | 4.1 (2) | ∞ | ∞ | 0/15 | ||||
| NEWUOA ros noiseless | 1.00 (0.3)★2 | 311 (521) | ∞ | 0/30 | ||||
| ONEFIFTH auger noiseless | 2.6 (0.7) | 1379 (1876) | ∞ | 0/15 | ||||
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | 0/15 | ||||
| Rosenbrock posik noiseless | 2.2 (0.4) | 44 (33) | ∞ | 0/15 | ||||
| iAMALGAM bosman noiseless | 23 (1) | ∞ | ∞ | 0/15 |
| Δ fopt f21, 40-D |
1e1 1044 |
1e0 21144 |
1e-1 1.0e5 |
1e-2 1.0e5 |
1e-3 1.0e5 |
1e-5 1.0e5 |
1e-7 1.0e5 |
#succ 26/30 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 20 (11) | 6.5 (3) | 2.7 (1) | 3.0 (0.8) | 3.3 (4) | 4.2 (4) | 5.9 (6) | 15/15 |
| AMALGAM bosman noiseless | 21 (6) | 1772 (1907) | 1712 (2186) | 1708 (975) | 1704 (2636) | 1696 (1866) | 1690 (1661) | 3/15 |
| BAYEDA gallagher noiseless | 37 (41) | 8.0 (10) | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BFGS ros noiseless | 2.9 (3) | 2.3 (3) | 2.1 (2) | 2.1 (3) | 2.1 (1) | 2.1 (1) | 9.3 (8) | 2/15 |
| BIPOP-CMA-ES hansen noiseless | 2.7 (3) | 49 (131) | 112 (95) | 112 (83) | 111 (149) | 111 (139) | 110 (149) | 5/15 |
| CMA-ESPLUSSEL auger noiseless | 4.1 (18) | 1.8 (2) | 1.7 (3) | 1.7 (3) | 1.7 (3) | 1.6 (1) | 1.6 (3) | 13/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DASA korosec noiseless | 46 (27) | 44 (84) | 27 (29) | 27 (37) | 27 (27) | 27 (19) | 27 (36) | 15/15 |
| DE-PSO garcia-nieto noiseless | 18 (2) | 16 (8) | 12 (11) | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| DIRECT posik noiseless | 8.8 (2) | 8.6 (8) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| G3PCX posik noiseless | 3.9 (11) | 2.8 (3) | 2.3 (4) | 2.3 (3) | 2.3 (1) | 2.3 (1) | 2.3 (1) | 14/15 |
| GA nicolau noiseless | 120 (14) | 768 (707) | 559 (1072) | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 3.4 (4) | 19 (31) | 16 (26) | 16 (21) | 16 (39) | 16 (21) | 16 (22) | 3/15 |
| LSfminbnd posik noiseless | 4.2 (7) | 10 (11) | 5.5 (5) | 5.5 (8) | 5.5 (4) | 5.5 (8) | 5.5 (5) | 7/15 |
| LSstep posik noiseless | 126 (207) | 266 (364) | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 13 (27) | 14 (22) | 5.6 (5) | 5.5 (9) | 5.5 (5) | 5.5 (9) | 5.5 (5) | 7/15 |
| NEWUOA ros noiseless | 1.00 (2) | 1.0 (0.5) | 1.0 (1) | 1.0 (0.9) | 1 (0.9) | 1.0 (2) | 1.00 (0.6) | 26/30 |
| ONEFIFTH auger noiseless | 3.6 (5) | 5.2 (10) | 2.8 (1) | 2.8 (2) | 2.8 (2) | 2.8 (5) | 2.8 (3) | 15/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | 2.5 (3) | 2.6 (4) | 1.9 (0.7) | 1.9 (3) | 1.9 (3) | 1.9 (2) | 1.9 (0.6) | 12/15 |
| iAMALGAM bosman noiseless | 38 (110) | 659 (702) | 848 (1789) | 847 (1439) | 845 (909) | 842 (1325) | 841 (587) | 5/15 |
| Δ fopt f22, 40-D |
1e1 3090 |
1e0 35442 |
1e-1 6.5e5 |
1e-2 6.5e5 |
1e-3 6.5e5 |
1e-5 6.5e5 |
1e-7 6.5e5 |
#succ 8/30 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 13 (38) | 12 (13) | 35 (44) | 114 (92) | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 3259 (6483) | 761 (860) | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| BAYEDA gallagher noiseless | 26 (27) | 10 (12) | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BFGS ros noiseless | 1.5 (5) | 1.5 (3) | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 10 (6) | 60 (157) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| CMA-ESPLUSSEL auger noiseless | 4.0 (10) | 1.8 (5) | 2.0 (0.9) | 2.0 (2) | 2.0 (3) | 2.0 (3) | 2.0 (2) | 4/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DASA korosec noiseless | 48 (28) | 31 (25) | 45 (69) | 45 (57) | 45 (16) | 45 (61) | 45 (69) | 10/15 |
| DE-PSO garcia-nieto noiseless | 11 (26) | 10 (8) | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| DIRECT posik noiseless | 18 (16) | 5.6 (7) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| G3PCX posik noiseless | 10 (4) | 6.0 (10) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GA nicolau noiseless | 130 (327) | 178 (113) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 20 (32) | 6.0 (4) | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| LSfminbnd posik noiseless | 14 (7) | 4.2 (2) | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| LSstep posik noiseless | 70 (99) | 34 (40) | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 7.1 (6) | 3.8 (1) | 9.0 (21) | 9.0 (7) | 9.0 (5) | 8.9 (5) | 8.9 (11) | 1/15 |
| NEWUOA ros noiseless | 4.0 (1) | 1.0 (0.8) | 1.0 (0.8) | 1 (0.8) | 1.0 (1) | 1.00 (1) | 1.0 (2) | 8/30 |
| ONEFIFTH auger noiseless | 4.9 (7) | 2.7 (2) | 6.6 (13) | 6.6 (13) | 6.6 (7) | 6.6 (7) | 6.6 (9) | 15/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | 1.00 (1) | 3.3 (9) | 7.8 (12) | 7.8 (11) | 7.8 (7) | 7.8 (13) | 7.7 (10) | 1/15 |
| iAMALGAM bosman noiseless | 558 (287) | 757 (848) | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Δ fopt f23, 40-D |
1e1 7.0 |
1e0 11925 |
1e-1 75453 |
1e-2 6.6e5 |
1e-3 1.3e6 |
1e-5 3.2e6 |
1e-7 3.4e6 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | 1.4 (0.8) | 147 (188) | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 1.5 (1) | 12 (4) | 2.5 (0.6) | 1 (0.4) | 1.00 (0.9) | 1.0 (0.8) | 1.0 (0.9) | 15/15 |
| BAYEDA gallagher noiseless | 1.5 (1) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BFGS ros noiseless | 78 (19) | 263 (299) | ∞ | ∞ | ∞ | ∞ | ∞2e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 7.6 (10) | 4.8 (3) | 1.0 (1) | 1.6 (2) | 2.0 (0.5) | 1.4 (1) | 1.4 (0.8) | 15/15 |
| CMA-ESPLUSSEL auger noiseless | 16 (12) | 12 (14) | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| Cauchy-EDA posik noiseless | 2.1 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DASA korosec noiseless | 2.0 (3) | 76 (104) | ∞ | ∞ | ∞ | ∞ | ∞2e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | 1.6 (2) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| DIRECT posik noiseless | 1.9 (1) | 7.8 (6) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| G3PCX posik noiseless | 1.9 (2) | 2.7 (5) | ∞ | ∞ | ∞ | ∞ | ∞1e6 | 0/15 |
| GA nicolau noiseless | 1.5 (2) | 437 (445) | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 8.4 (9) | 4.9 (3) | 6.3 (6) | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| LSfminbnd posik noiseless | 1.1 (0.9) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| LSstep posik noiseless | 1.0 (1) | 245 (201) | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | 1.7 (2) | 1.00 (2) | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NEWUOA ros noiseless | 10 (8) | 1.8 (2) | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| ONEFIFTH auger noiseless | 33 (49) | 278 (327) | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/26 |
| RANDOMSEARCH auger noiseless | 1.9 (1) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | 1.6 (2) | 2.4 (4) | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/15 |
| iAMALGAM bosman noiseless | 1.5 (2) | 2.3 (0.2) | 1.1 (4) | 3.1 (3) | 12 (8) | 8.0 (3) | 7.7 (11) | 13/15 |
| Δ fopt f24, 40-D |
1e1 5.8e6 |
1e0 9.8e7 |
1e-1 3.0e8 |
1e-2 3.0e8 |
1e-3 3.0e8 |
1e-5 3.0e8 |
1e-7 3.0e8 |
#succ 1/15 |
|---|---|---|---|---|---|---|---|---|
| ALPS hornby noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e6 | 0/15 |
| AMALGAM bosman noiseless | 17 (18) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| BAYEDA gallagher noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| BFGS ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞3e5 | 0/15 |
| BIPOP-CMA-ES hansen noiseless | 4.6 (5) | 1.00 (0.4) | 1 (0.9) | 1 (1) | 1 (0.6) | 1 (1) | 1 (0.7) | 1/15 |
| CMA-ESPLUSSEL auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| Cauchy-EDA posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| DASA korosec noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| DE-PSO garcia-nieto noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞8e4 | 0/15 |
| DIRECT posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞1e5 | 0/5 |
| G3PCX posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| GA nicolau noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e6 | 0/15 |
| IPOP-SEP-CMA-ES ros noiseless | 1 (0.7) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| LSfminbnd posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| LSstep posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NELDER hansen noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| NEWUOA ros noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| ONEFIFTH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| RANDOMSEARCH auger noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |
| Rosenbrock posik noiseless | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e5 | 0/15 |
| iAMALGAM bosman noiseless | 8.5 (7) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞4e7 | 0/15 |