Last dimension | Dimension = 2 | Next dimension
| Δ fopt f1, 2-D |
1e1 2.0 |
1e0 6.0 |
1e-1 6.0 |
1e-2 6.0 |
1e-3 6.0 |
1e-5 6.0 |
1e-7 6.0 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 3.2 (2) | 1.5 (0) | 1.5 (0) | 1.5 (0) | 1.5 (0) | 1.5 (0) | 1.7 (0.4) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 2.6 (2) | 1.5 (0) | 1.5 (0) | 1.5 (0) | 1.5 (0) | 1.5 (0) | 1.9 (0.8) | 15/15 |
| CMA-ES-python Baudis | 2.9 (3) | 4.2 (3) | 9.5 (6) | 17 (7) | 24 (7) | 35 (9) | 48 (13) | 15/15 |
| EG50-cocopf Baudis | 4.9 (4) | 2.6 (1) | 3.1 (0.2) | 3.2 (0.3) | 3.3 (0.2) | 3.3 (0.2) | 3.3 (0.2) | 15/15 |
| L-BFGS-B-scipy Baudis | 2.6 (2) | 1.5 (0.1) | 1.5 (0.1) | 1.5 (0.1) | 1.5 (0.1) | 1.5 (0.1) | 1.8 (0.4) | 15/15 |
| Nelder-Mead-scipy Baudis | 6.7 (9) | 6.1 (3) | 8.5 (3) | 11 (4) | 12 (3) | 16 (3) | 20 (4) | 15/15 |
| Powell-scipy Baudis | 3.4 (3) | 2.2 (0.2) | 2.4 (0.2) | 2.4 (0.1) | 2.5 (0.1) | 2.5 (0.1) | 2.5 (0.1) | 15/15 |
| SLSQP-scipy Baudis | 2.7 (2) | 1.5 (0.2) | 1.8 (1) | 2.1 (1) | 2.3 (1) | 2.6 (2) | 2.9 (2) | 15/15 |
| UNIF-cocopf Baudis | 8.0 (3) | 3.2 (0.2) | 3.2 (0.2) | 3.2 (0.2) | 3.3 (0.3) | 3.3 (0.3) | 3.5 (0.3) | 15/15 |
| Δ fopt f2, 2-D |
1e1 16 |
1e0 19 |
1e-1 25 |
1e-2 25 |
1e-3 26 |
1e-5 28 |
1e-7 29 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 2.1 (0.4) | 2.0 (0.5) | 1.8 (0.5) | 2.0 (0.6) | 2.1 (0.7) | 2.3 (0.8) | 2.5 (0.7) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 6.2 (3) | 15 (10) | 20 (16) | 32 (23) | 41 (43) | 82 (75) | 213 (160) | 15/15 |
| CMA-ES-python Baudis | 17 (14) | 25 (9) | 21 (7) | 24 (4) | 24 (4) | 25 (4) | 27 (5) | 15/15 |
| EG50-cocopf Baudis | 4.7 (3) | 5.0 (2) | 4.2 (3) | 4.7 (2) | 4.8 (2) | 5.1 (2) | 5.5 (1) | 15/15 |
| L-BFGS-B-scipy Baudis | 2.5 (3) | 3.5 (3) | 4.5 (2) | 5.2 (0.8) | 6.1 (1) | 6.3 (1) | 15 (19) | 15/15 |
| Nelder-Mead-scipy Baudis | 5.0 (3) | 4.9 (2) | 4.2 (1) | 4.7 (1) | 4.9 (1) | 5.4 (1) | 5.9 (1) | 15/15 |
| Powell-scipy Baudis | 1.7 (0.7) | 1.7 (0.6) | 1.5 (0.3) | 1.5 (0.3) | 1.7 (0.5) | 2.0 (0.4) | 2.2 (0.5) | 15/15 |
| SLSQP-scipy Baudis | 3.1 (1) | 2.9 (1) | 2.4 (0.9) | 2.7 (1.0) | 2.8 (1) | 2.9 (0.9) | 4.8 (3) | 15/15 |
| UNIF-cocopf Baudis | 5.1 (3) | 4.6 (2) | 4.0 (0.4) | 4.1 (0.5) | 4.3 (0.5) | 4.8 (1) | 4.7 (1) | 15/15 |
| Δ fopt f3, 2-D |
1e1 15 |
1e0 271 |
1e-1 445 |
1e-2 446 |
1e-3 450 |
1e-5 454 |
1e-7 464 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 55 (101) | 10 (10) | 10 (8) | 10 (8) | 10 (8) | 10 (7) | 10 (7) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 45 (54) | 22 (24) | 27 (32) | 27 (32) | 27 (32) | 27 (31) | 27 (31) | 15/15 |
| CMA-ES-python Baudis | 8.3 (5) | 3.4 (3) | 10 (11) | 12 (13) | 12 (13) | 12 (13) | 12 (12) | 15/15 |
| EG50-cocopf Baudis | 1.5 (0.7) | 0.73 (0.5) | 0.85 (0.5) | 0.87 (0.5) | 0.89 (0.5) | 0.91 (0.5) | 0.94 (0.5) | 15/15 |
| L-BFGS-B-scipy Baudis | 37 (35) | 9.3 (13) | 10 (11) | 10 (11) | 10 (11) | 10 (11) | 10 (11) | 15/15 |
| Nelder-Mead-scipy Baudis | 259 (382) | 65 (90) | 56 (56) | 56 (56) | 55 (56) | 55 (55) | 135 (118) | 0/15 |
| Powell-scipy Baudis | 4.3 (4) | 0.96 (1) | 0.79 (0.9) | 0.81 (0.9) | 0.83 (0.9) | 0.85 (0.9) | 0.85 (0.9) | 15/15 |
| SLSQP-scipy Baudis | 12 (9) | 2.6 (2) | 3.6 (4) | 3.6 (4) | 3.6 (4) | 3.6 (4) | 4.8 (4) | 15/15 |
| UNIF-cocopf Baudis | 5.0 (5) | 2.3 (2) | 2.0 (1) | 2.1 (1) | 2.1 (1) | 2.1 (1) | 2.1 (1) | 15/15 |
| Δ fopt f4, 2-D |
1e1 22 |
1e0 344 |
1e-1 459 |
1e-2 496 |
1e-3 523 |
1e-5 544 |
1e-7 566 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 62 (67) | 8.3 (11) | 14 (9) | 13 (8) | 12 (8) | 12 (8) | 11 (7) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 75 (136) | 24 (26) | 48 (48) | 44 (44) | 43 (42) | 41 (40) | 40 (39) | 15/15 |
| CMA-ES-python Baudis | 2.8 (2) | 11 (17) | 40 (32) | 37 (30) | 35 (28) | 34 (27) | 33 (26) | 15/15 |
| EG50-cocopf Baudis | 3.5 (3) | 0.60 (0.6) | 0.69 (0.8) | 0.68 (0.7) | 0.67 (0.7) | 0.68 (0.7) | 0.72 (0.6) | 15/15 |
| L-BFGS-B-scipy Baudis | 6.0 (5) | 4.7 (6) | 19 (26) | 17 (24) | 16 (22) | 16 (22) | 16 (24) | 15/15 |
| Nelder-Mead-scipy Baudis | 234 (402) | 46 (56) | 36 (41) | 34 (38) | 32 (36) | 31 (35) | 106 (114) | 5/15 |
| Powell-scipy Baudis | 1.7 (2) | 0.32 (0.3)↑0 | 0.35 (0.3)↑0 | 0.35 (0.2)↑0 | 0.36 (0.3)↑0 | 0.37 (0.2)↑0 | 0.40 (0.3)↑0 | 15/15 |
| SLSQP-scipy Baudis | 15 (14) | 8.8 (8) | 12 (13) | 12 (12) | 11 (11) | 11 (11) | 21 (16) | 15/15 |
| UNIF-cocopf Baudis | 3.1 (4) | 0.71 (0.6) | 0.69 (0.7) | 0.68 (0.6) | 0.68 (0.6) | 0.71 (0.6) | 0.74 (0.6) | 15/15 |
| Δ fopt f5, 2-D |
1e1 4.0 |
1e0 4.0 |
1e-1 4.0 |
1e-2 4.0 |
1e-3 4.0 |
1e-5 4.0 |
1e-7 4.0 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 1.2 (0) | 3.5 (2) | 3.8 (1) | 3.8 (1) | 3.8 (1) | 3.8 (1) | 3.8 (1) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 1.2 (0) | 3.5 (2) | 3.8 (1) | 3.8 (1) | 3.8 (1) | 3.8 (1) | 3.8 (1) | 15/15 |
| CMA-ES-python Baudis | 3.1 (2) | 20 (28) | 23 (29) | 23 (29) | 23 (29) | 23 (29) | 23 (29) | 15/15 |
| EG50-cocopf Baudis | 6.2 (0.5) | 6.2 (0.5) | 6.2 (0.5) | 6.2 (0.5) | 6.2 (0.5) | 6.2 (0.5) | 6.2 (0.5) | 15/15 |
| L-BFGS-B-scipy Baudis | 1.1 (0.5) | 4.1 (2) | 4.4 (1) | 4.4 (1) | 4.4 (1) | 4.4 (1) | 4.4 (1) | 15/15 |
| Nelder-Mead-scipy Baudis | 5.4 (2) | 7.1 (5) | 7.3 (5) | 7.3 (5) | 7.3 (5) | 7.3 (5) | 7.3 (5) | 15/15 |
| Powell-scipy Baudis | 4.0 (2) | 4.8 (0.5) | 4.8 (0.5) | 4.8 (0.5) | 4.8 (0.5) | 4.8 (0.5) | 4.8 (0.5) | 15/15 |
| SLSQP-scipy Baudis | 1.2 (0) | 3.9 (2) | 4.5 (3) | 4.8 (3) | 4.8 (3) | 4.9 (3) | 4.9 (3) | 15/15 |
| UNIF-cocopf Baudis | 4.7 (3) | 6.2 (0.4) | 6.2 (0.4) | 6.2 (0.4) | 6.2 (0.4) | 6.2 (0.4) | 6.2 (0.4) | 15/15 |
| Δ fopt f6, 2-D |
1e1 13 |
1e0 23 |
1e-1 41 |
1e-2 54 |
1e-3 67 |
1e-5 95 |
1e-7 124 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 16 (19) | 11 (9) | 6.8 (5) | 5.6 (4) | 4.9 (3) | 4.0 (2) | 4.0 (2) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 11 (11) | 10 (7) | 8.4 (5) | 8.6 (6) | 8.3 (6) | 9.2 (5) | 12 (11) | 15/15 |
| CMA-ES-python Baudis | 3.1 (4) | 4.8 (4) | 4.6 (2) | 5.2 (1) | 5.2 (1) | 5.5 (1) | 5.5 (0.9) | 15/15 |
| EG50-cocopf Baudis | 6.6 (5) | 6.3 (6) | 6.8 (4) | 5.7 (3) | 7.0 (7) | 7.9 (6) | 11 (14) | 15/15 |
| L-BFGS-B-scipy Baudis | 7.7 (11) | 6.9 (6) | 5.3 (2) | 4.7 (2) | 4.2 (2) | 5.6 (5) | 8.6 (8) | 15/15 |
| Nelder-Mead-scipy Baudis | 4.1 (3) | 3.0 (1) | 2.2 (1) | 2.0 (0.7) | 2.1 (0.6) | 2.0 (0.8) | 2.5 (2) | 15/15 |
| Powell-scipy Baudis | 13 (5) | 12 (3) | 7.6 (2) | 8.3 (2) | 8.5 (3) | 28 (5) | 75 (126) | 14/15 |
| SLSQP-scipy Baudis | 3.6 (3) | 3.4 (2) | 2.5 (2) | 2.2 (1) | 2.2 (1) | 3.1 (2) | 23 (23) | 15/15 |
| UNIF-cocopf Baudis | 11 (12) | 13 (16) | 9.4 (8) | 8.3 (6) | 10 (8) | 12 (10) | 13 (11) | 15/15 |
| Δ fopt f7, 2-D |
1e1 3.0 |
1e0 21 |
1e-1 60 |
1e-2 193 |
1e-3 217 |
1e-5 217 |
1e-7 241 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 114 (177) | 67 (32) | 38 (35) | 33 (54) | 75 (119) | 75 (119) | 195 (295) | 5/15 |
| CG-Fletcher-Reeves-scipy Baudis | 110 (216) | 53 (67) | 47 (65) | 120 (129) | 147 (186) | 147 (186) | 297 (406) | 6/15 |
| CMA-ES-python Baudis | 6.5 (7) | 4.0 (5) | 4.5 (4) | 2.2 (1) | 2.1 (1) | 2.1 (1) | 2.1 (1) | 15/15 |
| EG50-cocopf Baudis | 21 (39) | 22 (20) | 31 (30) | 24 (38) | 40 (36) | 40 (36) | 39 (40) | 15/15 |
| L-BFGS-B-scipy Baudis | 84 (151) | 196 (418) | 105 (237) | 89 (167) | 129 (182) | 129 (182) | 394 (483) | 1/15 |
| Nelder-Mead-scipy Baudis | 419 (519) | 170 (148) | 90 (70) | 39 (22) | 39 (23) | 39 (23) | 35 (21) | 15/15 |
| Powell-scipy Baudis | 26 (9) | 77 (105) | 44 (72) | 16 (22) | 15 (20) | 15 (20) | 13 (18) | 15/15 |
| SLSQP-scipy Baudis | 89 (110) | 64 (115) | 42 (65) | 106 (181) | 170 (205) | 170 (205) | 529 (714) | 7/15 |
| UNIF-cocopf Baudis | 9.3 (14) | 26 (27) | 29 (46) | 25 (25) | 51 (80) | 51 (80) | 60 (66) | 15/15 |
| Δ fopt f8, 2-D |
1e1 5.0 |
1e0 12 |
1e-1 37 |
1e-2 46 |
1e-3 86 |
1e-5 94 |
1e-7 112 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 12 (12) | 11 (10) | 5.1 (3) | 4.7 (2) | 2.6 (1) | 2.5 (1) | 2.2 (1) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 11 (12) | 13 (12) | 6.3 (4) | 5.8 (3) | 3.3 (2) | 3.3 (2) | 3.0 (1) | 15/15 |
| CMA-ES-python Baudis | 7.3 (6) | 8.8 (4) | 8.2 (5) | 9.2 (5) | 5.7 (2) | 6.1 (2) | 5.9 (1) | 15/15 |
| EG50-cocopf Baudis | 4.2 (2) | 6.2 (4) | 14 (23) | 13 (18) | 7.6 (10) | 10 (8) | 8.9 (7) | 15/15 |
| L-BFGS-B-scipy Baudis | 6.4 (7) | 9.0 (7) | 4.3 (3) | 4.1 (2) | 2.3 (1) | 2.3 (1) | 2.0 (0.9) | 15/15 |
| Nelder-Mead-scipy Baudis | 7.4 (3) | 7.5 (5) | 3.8 (2) | 3.7 (2) | 2.1 (1) | 2.2 (0.9) | 2.1 (0.8) | 15/15 |
| Powell-scipy Baudis | 12 (10) | 40 (122) | 35 (42) | 38 (40) | 21 (21) | 133 (211) | 1890 (2900) | 4/15 |
| SLSQP-scipy Baudis | 3.6 (2) | 5.6 (4) | 3.1 (1) | 3.0 (1) | 1.8 (0.6) | 1.7 (0.6) | 1.8 (0.7) | 15/15 |
| UNIF-cocopf Baudis | 2.7 (1) | 3.5 (4) | 8.0 (11) | 11 (10) | 7.0 (7) | 8.4 (4) | 9.0 (3) | 14/15 |
| Δ fopt f9, 2-D |
1e1 1 |
1e0 18 |
1e-1 30 |
1e-2 44 |
1e-3 68 |
1e-5 81 |
1e-7 92 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 41 (30) | 4.0 (4) | 3.8 (4) | 3.2 (3) | 2.3 (2) | 2.1 (1) | 1.9 (1) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 33 (10) | 5.3 (4) | 5.6 (3) | 4.5 (2) | 3.3 (1) | 3.5 (2) | 3.4 (2) | 15/15 |
| CMA-ES-python Baudis | 34 (14) | 6.7 (7) | 10 (10) | 11 (7) | 8.7 (4) | 8.6 (3) | 8.5 (3) | 15/15 |
| EG50-cocopf Baudis | 45 (45) | 11 (11) | 12 (12) | 12 (7) | 10 (7) | 8.9 (8) | 11 (10) | 12/15 |
| L-BFGS-B-scipy Baudis | 18 (10) | 3.2 (3) | 3.6 (3) | 3.1 (2) | 2.2 (1) | 2.0 (0.9) | 1.8 (0.8) | 15/15 |
| Nelder-Mead-scipy Baudis | 28 (26) | 5.1 (4) | 4.8 (3) | 3.9 (2) | 2.7 (2) | 2.6 (1) | 2.5 (1) | 15/15 |
| Powell-scipy Baudis | 210 (110) | 40 (61) | 43 (72) | 34 (54) | 37 (48) | 315 (635) | 1340 (1572) | 7/15 |
| SLSQP-scipy Baudis | 15 (9) | 3.3 (4) | 3.5 (3) | 3.0 (2) | 2.1 (1) | 1.9 (1) | 2.1 (1) | 15/15 |
| UNIF-cocopf Baudis | 41 (49) | 7.6 (4) | 13 (8) | 13 (7) | 11 (5) | 11 (4) | 11 (4) | 15/15 |
| Δ fopt f10, 2-D |
1e1 30 |
1e0 46 |
1e-1 54 |
1e-2 61 |
1e-3 68 |
1e-5 82 |
1e-7 98 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 1.4 (0.7) | 1.3 (0.9) | 1.2 (1) | 1.2 (0.8) | 1.2 (0.8) | 1.9 (1) | 6.4 (6) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 5.6 (7) | 5.6 (6) | 8.4 (8) | 11 (6) | 16 (15) | 66 (62) | 526 (605) | 11/15 |
| CMA-ES-python Baudis | 10 (7) | 10 (6) | 10 (2) | 10 (2) | 10 (2) | 8.8 (1) | 8.1 (1) | 15/15 |
| EG50-cocopf Baudis | 5.6 (7) | 6.9 (8) | 6.8 (6) | 6.4 (5) | 9.2 (6) | 11 (9) | 26 (29) | 14/15 |
| L-BFGS-B-scipy Baudis | 1.8 (1) | 1.8 (1) | 2.1 (1) | 2.1 (0.6) | 2.2 (0.4) | 2.7 (0.8) | 14 (20) | 15/15 |
| Nelder-Mead-scipy Baudis | 2.5 (2) | 2.2 (0.8) | 2.1 (0.7) | 2.1 (0.6) | 2.0 (0.5) | 1.9 (0.4) | 1.8 (0.4) | 15/15 |
| Powell-scipy Baudis | 12 (12) | 15 (17) | 16 (16) | 31 (22) | 36 (28) | 179 (233) | 1413 (1958) | 7/15 |
| SLSQP-scipy Baudis | 1.1 (0.8) | 0.88 (0.4) | 0.89 (0.4) | 0.90 (0.4) | 0.89 (0.4) | 1.0 (0.5) | 4.7 (7) | 15/15 |
| UNIF-cocopf Baudis | 5.3 (4) | 5.7 (4) | 6.7 (2) | 7.7 (2) | 8.1 (2) | 10 (4) | 22 (18) | 14/15 |
| Δ fopt f11, 2-D |
1e1 35 |
1e0 45 |
1e-1 50 |
1e-2 62 |
1e-3 67 |
1e-5 81 |
1e-7 97 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 1.0 (0.3) | 0.93 (0.2) | 0.94 (0.2) | 0.88 (0.2) | 0.91 (0.2) | 1.7 (2) | 14 (8) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 3.8 (3) | 6.3 (3) | 7.2 (4) | 8.9 (6) | 12 (7) | 48 (65) | 551 (681) | 12/15 |
| CMA-ES-python Baudis | 8.4 (6) | 11 (4) | 11 (2) | 10 (1) | 10 (1) | 9.1 (0.7) | 8.2 (0.8) | 15/15 |
| EG50-cocopf Baudis | 7.3 (9) | 11 (9) | 11 (8) | 10 (6) | 9.4 (6) | 10 (7) | 29 (33) | 15/15 |
| L-BFGS-B-scipy Baudis | 1.1 (1) | 2.0 (1) | 2.8 (0.6) | 2.4 (0.5) | 2.4 (0.4) | 2.9 (2) | 19 (22) | 15/15 |
| Nelder-Mead-scipy Baudis | 2.1 (2) | 2.3 (0.9) | 2.5 (0.7) | 2.2 (0.6) | 2.2 (0.5) | 2.1 (0.5) | 1.9 (0.4) | 15/15 |
| Powell-scipy Baudis | 26 (33) | 31 (33) | 36 (37) | 37 (30) | 45 (42) | 241 (388) | 1089 (1296) | 9/15 |
| SLSQP-scipy Baudis | 0.96 (0.5) | 0.86 (0.4) | 0.90 (0.4) | 0.79 (0.3) | 0.84 (0.3) | 1.9 (1) | 10 (14) | 15/15 |
| UNIF-cocopf Baudis | 3.5 (3) | 6.0 (5) | 8.0 (6) | 7.4 (5) | 8.3 (2) | 11 (5) | 34 (26) | 14/15 |
| Δ fopt f12, 2-D |
1e1 35 |
1e0 46 |
1e-1 75 |
1e-2 94 |
1e-3 105 |
1e-5 153 |
1e-7 195 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 14 (12) | 12 (13) | 8.4 (10) | 7.2 (9) | 6.6 (8) | 4.9 (7) | 6.1 (6) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 95 (132) | 73 (100) | 45 (62) | 36 (49) | 50 (104) | 35 (71) | 38 (56) | 15/15 |
| CMA-ES-python Baudis | 6.3 (4) | 8.9 (4) | 10 (7) | 9.4 (10) | 9.4 (11) | 8.5 (11) | 8.1 (12) | 15/15 |
| EG50-cocopf Baudis | 16 (28) | 17 (21) | 12 (13) | 11 (13) | 11 (12) | 8.1 (8) | 11 (21) | 15/15 |
| L-BFGS-B-scipy Baudis | 0.90 (0.8) | 1.3 (0.9) | 1.1 (0.6) | 1.0 (0.6) | 1.3 (2) | 1.3 (2) | 4.3 (6) | 15/15 |
| Nelder-Mead-scipy Baudis | 4.4 (6) | 7.1 (11) | 7.0 (10) | 6.7 (9) | 6.4 (8) | 5.6 (6) | 5.1 (5) | 15/15 |
| Powell-scipy Baudis | 5.5 (9) | 12 (18) | 10 (16) | 11 (14) | 20 (24) | 47 (69) | 181 (395) | 10/15 |
| SLSQP-scipy Baudis | 2.3 (2) | 3.8 (5) | 3.3 (4) | 3.0 (4) | 2.9 (4) | 2.8 (4) | 10 (8) | 14/15 |
| UNIF-cocopf Baudis | 26 (41) | 33 (35) | 24 (23) | 22 (19) | 20 (16) | 15 (11) | 21 (28) | 14/15 |
| Δ fopt f13, 2-D |
1e1 23 |
1e0 35 |
1e-1 46 |
1e-2 60 |
1e-3 71 |
1e-5 95 |
1e-7 122 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 15 (12) | 34 (47) | 44 (74) | 46 (79) | 74 (81) | 340 (416) | 5300 (3862) | 2/15 |
| CG-Fletcher-Reeves-scipy Baudis | 109 (157) | 165 (136) | 186 (255) | 153 (185) | 234 (273) | 797 (1043) | ∞2e5 | 0/15 |
| CMA-ES-python Baudis | 4.8 (3) | 7.7 (5) | 8.6 (4) | 8.5 (2) | 8.9 (2) | 8.9 (1) | 8.5 (1) | 15/15 |
| EG50-cocopf Baudis | 17 (27) | 27 (38) | 26 (28) | 28 (25) | 53 (53) | 61 (90) | 177 (143) | 15/15 |
| L-BFGS-B-scipy Baudis | 8.0 (19) | 13 (14) | 20 (52) | 27 (57) | 61 (114) | 88 (122) | 638 (1189) | 9/15 |
| Nelder-Mead-scipy Baudis | 2.7 (3) | 3.0 (2) | 2.8 (2) | 2.4 (1) | 2.3 (1) | 2.1 (0.8) | 2.7 (1) | 15/15 |
| Powell-scipy Baudis | 51 (87) | 59 (74) | 52 (58) | 49 (54) | 94 (103) | 366 (460) | 2.5e4 (2e4) | 0/15 |
| SLSQP-scipy Baudis | 0.84 (0.3) | 0.86 (0.4)★2 | 0.83 (0.4)★3 | 0.78 (0.2)★3 | 0.77 (0.2)★4↑0 | 0.84 (0.1)★3↑1 | 6.3 (8) | 15/15 |
| UNIF-cocopf Baudis | 12 (23) | 14 (18) | 26 (24) | 32 (15) | 45 (15) | 52 (17) | 130 (107) | 15/15 |
| Δ fopt f14, 2-D |
1e1 1 |
1e0 7.0 |
1e-1 16 |
1e-2 24 |
1e-3 38 |
1e-5 67 |
1e-7 90 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 4.7 (4) | 2.3 (0.9) | 1.7 (0.5) | 1.9 (0.7) | 1.8 (0.4) | 1.6 (0.2) | 8.6 (5) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 5.3 (4) | 1.9 (2) | 1.4 (0.9) | 1.9 (1.0) | 1.9 (1.0) | 2.2 (0.7) | 6.5 (6) | 15/15 |
| CMA-ES-python Baudis | 4.1 (5) | 3.1 (4) | 4.7 (2) | 6.0 (2) | 6.9 (3) | 7.6 (1) | 8.8 (1) | 15/15 |
| EG50-cocopf Baudis | 6.5 (10) | 4.9 (5) | 3.4 (3) | 5.0 (2) | 5.7 (3) | 4.7 (2) | 15 (10) | 15/15 |
| L-BFGS-B-scipy Baudis | 5.3 (4) | 2.4 (2) | 2.0 (1) | 2.0 (0.9) | 1.7 (0.7) | 1.5 (0.4) | 11 (8) | 15/15 |
| Nelder-Mead-scipy Baudis | 8.7 (10) | 5.5 (4) | 3.6 (2) | 3.3 (1) | 2.6 (1.0) | 2.1 (0.7) | 2.0 (0.6) | 15/15 |
| Powell-scipy Baudis | 7.4 (16) | 3.5 (4) | 2.3 (2) | 2.9 (2) | 15 (15) | 27 (28) | 118 (183) | 15/15 |
| SLSQP-scipy Baudis | 5.0 (3) | 2.3 (0.9) | 1.6 (0.6) | 1.5 (0.6) | 1.3 (0.4) | 1.1 (0.3) | 16 (19) | 15/15 |
| UNIF-cocopf Baudis | 10 (20) | 4.8 (4) | 3.4 (2) | 4.9 (6) | 5.8 (5) | 7.2 (2) | 23 (22) | 15/15 |
| Δ fopt f15, 2-D |
1e1 37 |
1e0 291 |
1e-1 1033 |
1e-2 1066 |
1e-3 1113 |
1e-5 1231 |
1e-7 1412 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 20 (26) | 5.7 (6) | 3.9 (3) | 3.7 (3) | 3.6 (3) | 3.3 (3) | 2.9 (2) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 24 (34) | 8.5 (6) | 4.9 (6) | 4.7 (5) | 4.6 (5) | 4.2 (5) | 3.9 (4) | 15/15 |
| CMA-ES-python Baudis | 3.1 (2) | 5.5 (6) | 6.6 (6) | 7.3 (6) | 7.0 (6) | 6.4 (5) | 5.6 (4) | 15/15 |
| EG50-cocopf Baudis | 3.9 (6) | 3.1 (3) | 3.2 (3) | 3.1 (3) | 3.0 (3) | 2.9 (2) | 3.7 (4) | 14/15 |
| L-BFGS-B-scipy Baudis | 9.2 (9) | 4.2 (4) | 2.3 (2) | 2.2 (2) | 2.2 (2) | 2.0 (2) | 1.8 (1) | 15/15 |
| Nelder-Mead-scipy Baudis | 30 (39) | 15 (13) | 5.6 (5) | 5.5 (5) | 5.3 (5) | 4.8 (5) | 21 (25) | 3/15 |
| Powell-scipy Baudis | 7.5 (10) | 3.7 (4) | 2.5 (3) | 2.4 (3) | 2.5 (4) | 2.5 (3) | 3.8 (4) | 15/15 |
| SLSQP-scipy Baudis | 2.2 (2) | 1.6 (1) | 1.4 (1) | 1.4 (1) | 1.4 (1) | 1.2 (1) | 2.2 (3) | 15/15 |
| UNIF-cocopf Baudis | 4.5 (5) | 2.9 (2) | 2.8 (2) | 2.8 (2) | 3.5 (4) | 3.5 (4) | 5.7 (6) | 14/15 |
| Δ fopt f16, 2-D |
1e1 9.0 |
1e0 50 |
1e-1 174 |
1e-2 326 |
1e-3 358 |
1e-5 409 |
1e-7 538 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 64 (76) | 125 (148) | 184 (229) | 242 (279) | 1834 (1999) | ∞ | ∞2e5 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | 153 (279) | 66 (87) | 74 (71) | 124 (154) | 456 (415) | ∞ | ∞2e5 | 0/15 |
| CMA-ES-python Baudis | 2.9 (4) | 3.2 (2) | 2.0 (1.0) | 1.3 (0.5) | 1.3 (0.5)★ | 1.5 (2)★ | 1.3 (1)★2 | 15/15 |
| EG50-cocopf Baudis | 1.8 (2) | 7.1 (12) | 5.8 (5) | 6.6 (8) | 11 (13) | 30 (41) | 27 (32) | 15/15 |
| L-BFGS-B-scipy Baudis | 87 (62) | 101 (114) | 86 (98) | 201 (261) | 913 (987) | ∞ | ∞2e5 | 0/15 |
| Nelder-Mead-scipy Baudis | 48 (32) | 148 (152) | 49 (50) | 30 (27) | 32 (48) | 28 (42) | 22 (32) | 15/15 |
| Powell-scipy Baudis | 7.4 (11) | 62 (84) | 20 (23) | 23 (29) | 46 (61) | 205 (264) | 408 (449) | 8/15 |
| SLSQP-scipy Baudis | 21 (24) | 51 (94) | 40 (41) | 95 (78) | 1117 (1111) | ∞ | ∞2e5 | 0/15 |
| UNIF-cocopf Baudis | 10 (9) | 22 (21) | 15 (16) | 16 (17) | 27 (34) | 94 (65) | 111 (183) | 13/15 |
| Δ fopt f17, 2-D |
1e1 3.0 |
1e0 61 |
1e-1 133 |
1e-2 275 |
1e-3 396 |
1e-5 1086 |
1e-7 1657 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 38 (40) | 11 (11) | 33 (31) | 224 (280) | 1607 (1843) | ∞ | ∞2e5 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | 43 (72) | 16 (11) | 19 (15) | 172 (226) | 779 (1334) | ∞ | ∞2e5 | 0/15 |
| CMA-ES-python Baudis | 20 (7) | 3.5 (7) | 3.7 (4) | 2.4 (2)★ | 2.9 (2)★ | 3.5 (3)★2 | 3.9 (3)★ | 15/15 |
| EG50-cocopf Baudis | 6.9 (10) | 5.8 (5) | 8.1 (7) | 8.7 (10) | 10 (7) | 25 (25) | 21 (22) | 15/15 |
| L-BFGS-B-scipy Baudis | 20 (25) | 8.7 (8) | 10 (12) | 80 (55) | 381 (366) | ∞ | ∞2e5 | 0/15 |
| Nelder-Mead-scipy Baudis | 3655 (6675) | 355 (353) | 180 (168) | 170 (190) | 216 (311) | 2587 (2716) | ∞2e5 | 0/15 |
| Powell-scipy Baudis | 145 (185) | 13 (16) | 6.5 (7) | 9.2 (11) | 11 (13) | 1301 (1442) | ∞2e5 | 0/15 |
| SLSQP-scipy Baudis | 24 (48) | 7.0 (7) | 7.7 (6) | 50 (58) | 185 (165) | ∞ | ∞2e5 | 0/15 |
| UNIF-cocopf Baudis | 11 (14) | 9.4 (7) | 13 (12) | 20 (18) | 48 (67) | 125 (126) | 122 (145) | 9/15 |
| Δ fopt f18, 2-D |
1e1 19 |
1e0 134 |
1e-1 666 |
1e-2 1249 |
1e-3 1708 |
1e-5 2438 |
1e-7 2858 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 50 (62) | 28 (22) | 41 (50) | 2262 (2122) | ∞ | ∞ | ∞2e5 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | 44 (56) | 70 (68) | 44 (67) | 373 (521) | ∞ | ∞ | ∞2e5 | 0/15 |
| CMA-ES-python Baudis | 6.0 (3) | 9.4 (9) | 3.9 (5) | 2.7 (3) | 2.4 (2)★3 | 6.4 (7)★3 | 11 (14)★3 | 15/15 |
| EG50-cocopf Baudis | 15 (15) | 13 (18) | 6.5 (5) | 13 (12) | 74 (73) | 282 (151) | 984 (1505) | 1/15 |
| L-BFGS-B-scipy Baudis | 23 (13) | 55 (44) | 27 (55) | 401 (512) | ∞ | ∞ | ∞2e5 | 0/15 |
| Nelder-Mead-scipy Baudis | 245 (260) | 104 (96) | 29 (29) | 39 (39) | 99 (168) | ∞ | ∞2e5 | 0/15 |
| Powell-scipy Baudis | 23 (43) | 11 (11) | 5.1 (5) | 12 (13) | 65 (69) | ∞ | ∞2e5 | 0/15 |
| SLSQP-scipy Baudis | 5.4 (5) | 21 (15) | 12 (16) | 137 (179) | 313 (299) | ∞ | ∞2e5 | 0/15 |
| UNIF-cocopf Baudis | 8.8 (10) | 24 (25) | 12 (9) | 36 (51) | 89 (79) | 175 (185) | 182 (182) | 5/15 |
| Δ fopt f19, 2-D |
1e1 1 |
1e0 1 |
1e-1 26 |
1e-2 216 |
1e-3 227 |
1e-5 252 |
1e-7 276 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 418 (461) | 2258 (3447) | 169 (284) | 69 (71) | 65 (67) | 59 (60) | 54 (55) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 141 (231) | 496 (289) | 44 (42) | 36 (30) | 35 (30) | 36 (27) | 54 (76) | 15/15 |
| CMA-ES-python Baudis | 8.5 (14) | 315 (508) | 43 (53) | 29 (22) | 30 (21) | 33 (30) | 30 (27) | 15/15 |
| EG50-cocopf Baudis | 11 (10) | 92 (110) | 17 (22) | 25 (27) | 33 (40) | 45 (51) | 94 (108) | 15/15 |
| L-BFGS-B-scipy Baudis | 35 (54) | 465 (391) | 45 (25) | 14 (13) | 13 (12) | 12 (11) | 73 (56) | 11/15 |
| Nelder-Mead-scipy Baudis | 93 (174) | 2203 (2330) | 158 (256) | 69 (89) | 66 (84) | 59 (76) | 54 (70) | 15/15 |
| Powell-scipy Baudis | 6.3 (9) | 158 (282) | 13 (10) | 119 (161) | 141 (228) | 235 (405) | 521 (572) | 5/15 |
| SLSQP-scipy Baudis | 593 (872) | 2588 (2440) | 153 (185) | 42 (43) | 40 (41) | 36 (37) | 1.1e4 (1e4) | 0/15 |
| UNIF-cocopf Baudis | 14 (10) | 175 (158) | 31 (48) | 49 (48) | 51 (53) | 56 (45) | 67 (40) | 15/15 |
| Δ fopt f20, 2-D |
1e1 4.0 |
1e0 61 |
1e-1 365 |
1e-2 366 |
1e-3 366 |
1e-5 370 |
1e-7 375 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 3.6 (2) | 15 (14) | 11 (17) | 11 (17) | 11 (17) | 11 (17) | 11 (16) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 3.1 (1) | 42 (54) | 26 (30) | 26 (30) | 26 (30) | 26 (30) | 25 (29) | 15/15 |
| CMA-ES-python Baudis | 4.3 (5) | 10 (14) | 16 (23) | 17 (23) | 17 (23) | 17 (23) | 18 (22) | 15/15 |
| EG50-cocopf Baudis | 7.2 (6) | 7.0 (6) | 5.6 (7) | 5.7 (7) | 5.7 (7) | 5.7 (7) | 5.7 (7) | 15/15 |
| L-BFGS-B-scipy Baudis | 3.4 (2) | 13 (25) | 23 (24) | 23 (24) | 23 (24) | 23 (23) | 23 (23) | 15/15 |
| Nelder-Mead-scipy Baudis | 6.9 (7) | 12 (14) | 14 (20) | 14 (19) | 14 (19) | 14 (19) | 14 (19) | 15/15 |
| Powell-scipy Baudis | 11 (9) | 4.7 (2) | 4.6 (8) | 4.7 (8) | 4.7 (8) | 5.1 (8) | 5.3 (8) | 15/15 |
| SLSQP-scipy Baudis | 2.4 (0.8) | 7.6 (5) | 5.9 (11) | 5.9 (11) | 5.9 (11) | 5.8 (11) | 5.8 (10) | 15/15 |
| UNIF-cocopf Baudis | 4.4 (6) | 4.3 (3) | 5.4 (7) | 5.5 (7) | 5.6 (7) | 5.6 (7) | 6.3 (7) | 14/15 |
| Δ fopt f21, 2-D |
1e1 2.0 |
1e0 51 |
1e-1 174 |
1e-2 276 |
1e-3 290 |
1e-5 324 |
1e-7 330 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 4.6 (4) | 12 (19) | 13 (16) | 8.5 (10) | 8.1 (10) | 7.3 (9) | 7.3 (8) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 7.3 (8) | 33 (51) | 29 (46) | 19 (29) | 18 (27) | 16 (25) | 16 (24) | 15/15 |
| CMA-ES-python Baudis | 1.1 (1) | 11 (10) | 8.1 (9) | 5.5 (6) | 7.0 (7) | 6.4 (7) | 6.5 (7) | 15/15 |
| EG50-cocopf Baudis | 2.4 (2) | 3.1 (3) | 4.6 (5) | 3.0 (3) | 3.0 (3) | 2.9 (3) | 3.6 (4) | 14/15 |
| L-BFGS-B-scipy Baudis | 3.1 (3) | 22 (37) | 44 (34) | 28 (22) | 26 (21) | 24 (18) | 23 (18) | 15/15 |
| Nelder-Mead-scipy Baudis | 14 (7) | 277 (321) | 285 (439) | 180 (277) | 171 (264) | 153 (236) | 151 (232) | 14/15 |
| Powell-scipy Baudis | 3.3 (2) | 64 (72) | 82 (103) | 52 (65) | 49 (62) | 44 (55) | 44 (54) | 15/15 |
| SLSQP-scipy Baudis | 3.6 (3) | 34 (38) | 38 (38) | 26 (27) | 26 (25) | 28 (23) | 28 (22) | 15/15 |
| UNIF-cocopf Baudis | 2.7 (3) | 4.6 (4) | 5.6 (5) | 3.8 (3) | 3.9 (3) | 4.2 (2) | 5.6 (5) | 15/15 |
| Δ fopt f22, 2-D |
1e1 5.0 |
1e0 27 |
1e-1 168 |
1e-2 218 |
1e-3 249 |
1e-5 289 |
1e-7 306 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 28 (44) | 71 (103) | 16 (20) | 12 (15) | 11 (13) | 9.2 (12) | 8.9 (11) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 14 (17) | 86 (168) | 27 (42) | 21 (32) | 18 (28) | 16 (24) | 17 (23) | 15/15 |
| CMA-ES-python Baudis | 2.1 (2) | 15 (31) | 7.6 (8) | 8.5 (9) | 8.0 (8) | 7.7 (8) | 7.4 (7) | 15/15 |
| EG50-cocopf Baudis | 3.4 (4) | 4.7 (6) | 6.3 (9) | 5.9 (7) | 5.6 (8) | 5.3 (7) | 5.9 (6) | 15/15 |
| L-BFGS-B-scipy Baudis | 5.5 (6) | 48 (57) | 18 (32) | 14 (25) | 13 (22) | 11 (19) | 12 (18) | 15/15 |
| Nelder-Mead-scipy Baudis | 5.1 (5) | 398 (902) | 102 (150) | 79 (115) | 69 (101) | 60 (87) | 56 (82) | 15/15 |
| Powell-scipy Baudis | 15 (21) | 141 (244) | 39 (65) | 30 (50) | 27 (44) | 24 (37) | 23 (35) | 15/15 |
| SLSQP-scipy Baudis | 6.9 (9) | 29 (70) | 12 (11) | 9.0 (9) | 8.0 (8) | 6.9 (7) | 8.2 (9) | 15/15 |
| UNIF-cocopf Baudis | 4.2 (4) | 5.1 (5) | 5.5 (13) | 5.4 (10) | 5.7 (9) | 6.2 (9) | 7.3 (9) | 15/15 |
| Δ fopt f23, 2-D |
1e1 8.0 |
1e0 193 |
1e-1 234 |
1e-2 263 |
1e-3 299 |
1e-5 348 |
1e-7 379 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 53 (142) | 37 (22) | 86 (79) | 437 (463) | 1133 (1089) | ∞ | ∞2e5 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | 11 (6) | 11 (12) | 133 (157) | 1252 (1339) | 2995 (3521) | ∞ | ∞2e5 | 0/15 |
| CMA-ES-python Baudis | 1.6 (2) | 11 (8) | 15 (11) | 14 (9) | 13 (8) | 11 (7) | 11 (6)★3 | 15/15 |
| EG50-cocopf Baudis | 1.1 (1) | 4.6 (6) | 18 (19) | 19 (20) | 21 (25) | 86 (131) | 108 (109) | 15/15 |
| L-BFGS-B-scipy Baudis | 13 (21) | 13 (13) | 48 (61) | 76 (81) | 98 (69) | 515 (653) | ∞2e5 | 0/15 |
| Nelder-Mead-scipy Baudis | 5.5 (9) | 1.3 (1) | 1.2 (1) | 1.4 (1)★ | 1.3 (0.9)★2 | 8224 (1e4) | ∞2e5 | 0/15 |
| Powell-scipy Baudis | 1.9 (2) | 10 (7) | 60 (72) | 454 (447) | 538 (669) | 818 (776) | 3525 (5278) | 1/15 |
| SLSQP-scipy Baudis | 3.1 (4) | 2.0 (2) | 6.5 (5) | 7.3 (5) | 40 (39) | 1880 (1378) | ∞2e5 | 0/15 |
| UNIF-cocopf Baudis | 2.8 (2) | 8.3 (12) | 37 (37) | 46 (59) | 50 (52) | 401 (414) | 493 (359) | 11/15 |
| Δ fopt f24, 2-D |
1e1 18 |
1e0 857 |
1e-1 8515 |
1e-2 23399 |
1e-3 24113 |
1e-5 24721 |
1e-7 24721 |
#succ 5/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 89 (135) | 34 (40) | 4.1 (4) | 1.7 (2) | 1.6 (2) | 1.6 (2) | 1.6 (2) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 111 (184) | 55 (70) | 6.3 (7) | 3.2 (3) | 3.1 (2) | 3.0 (2) | 3.0 (2) | 14/15 |
| CMA-ES-python Baudis | 1.8 (1) | 6.9 (6) | 13 (15) | 17 (19) | 17 (22) | 16 (24) | 16 (15) | 6/15 |
| EG50-cocopf Baudis | 3.1 (4) | 6.6 (7) | 2.1 (3) | 1.4 (1) | 1.4 (1) | 1.4 (1) | 1.9 (2) | 12/15 |
| L-BFGS-B-scipy Baudis | 8.2 (7) | 2.4 (3) | 0.47 (0.4)↑1 | 0.54 (0.7) | 0.53 (0.7) | 0.51 (0.7) | 0.51 (0.7) | 15/15 |
| Nelder-Mead-scipy Baudis | 105 (158) | 35 (58) | 3.8 (6) | 2.0 (2) | 1.9 (2) | 1.9 (2) | ∞2e5 | 0/15 |
| Powell-scipy Baudis | 8.9 (14) | 28 (41) | 3.7 (4) | 4.2 (4) | 4.1 (4) | 4.5 (5) | 5.0 (7) | 11/15 |
| SLSQP-scipy Baudis | 8.9 (12) | 6.2 (6) | 0.68 (0.6) | 0.60 (0.9) | 0.59 (0.9) | 0.57 (0.8) | 0.61 (0.8) | 15/15 |
| UNIF-cocopf Baudis | 4.9 (5) | 6.7 (6) | 1.7 (1) | 1.1 (1.0) | 1.1 (1.0) | 1.3 (0.9) | 1.6 (1) | 9/15 |
Previous dimension | Dimension = 3 | Next dimension
Previous dimension | Dimension = 5 | Next dimension
| Δ fopt f1, 5-D |
1e1 11 |
1e0 12 |
1e-1 12 |
1e-2 12 |
1e-3 12 |
1e-5 12 |
1e-7 12 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 1.4 (0) | 1.2 (0) | 1.2 (0) | 1.2 (0) | 1.2 (0) | 1.2 (0) | 1.7 (0.3) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 1.4 (0) | 1.2 (0) | 1.2 (0) | 1.2 (0) | 1.2 (0) | 1.2 (0) | 1.8 (0.6) | 15/15 |
| CMA-ES-python Baudis | 3.6 (3) | 11 (3) | 20 (4) | 27 (6) | 36 (5) | 51 (5) | 68 (8) | 15/15 |
| EG50-cocopf Baudis | 3.6 (1.0) | 4.0 (0.3) | 4.1 (0.3) | 4.2 (0.3) | 4.2 (0.2) | 4.2 (0.2) | 4.2 (0.2) | 15/15 |
| L-BFGS-B-scipy Baudis | 1.4 (0.0) | 1.3 (0.0) | 1.3 (0.0) | 1.4 (0.3) | 1.4 (0.3) | 1.4 (0.3) | 1.4 (0.3) | 15/15 |
| Nelder-Mead-scipy Baudis | 12 (13) | 28 (11) | 34 (8) | 37 (8) | 41 (8) | 47 (10) | 53 (10) | 15/15 |
| Powell-scipy Baudis | 3.1 (1) | 3.5 (0.2) | 3.5 (0.2) | 3.6 (0.2) | 3.6 (0.2) | 3.6 (0.2) | 3.6 (0.2) | 15/15 |
| SLSQP-scipy Baudis | 1.2 (0.3) | 2.4 (2) | 2.8 (2) | 3.1 (3) | 3.4 (3) | 3.8 (3) | 4.1 (3) | 15/15 |
| UNIF-cocopf Baudis | 3.5 (1) | 4.1 (0.2) | 4.2 (0.2) | 4.3 (0.2) | 4.3 (0.2) | 4.4 (0.3) | 5.0 (0.9) | 15/15 |
| Δ fopt f2, 5-D |
1e1 83 |
1e0 87 |
1e-1 88 |
1e-2 89 |
1e-3 90 |
1e-5 92 |
1e-7 94 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 2.7 (1) | 2.9 (1) | 3.4 (2) | 3.6 (2) | 3.9 (3) | 4.2 (3) | 4.7 (3) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 64 (67) | 223 (168) | 422 (304) | 828 (496) | 2517 (2028) | 2.5e4 (3e4) | ∞5e5 | 0/15 |
| CMA-ES-python Baudis | 16 (5) | 20 (4) | 22 (3) | 23 (3) | 24 (2) | 26 (2) | 27 (3) | 15/15 |
| EG50-cocopf Baudis | 1.9 (1.0) | 2.5 (0.2) | 2.5 (0.2) | 2.5 (0.3) | 2.5 (0.3) | 3.0 (0.5) | 3.4 (0.2) | 15/15 |
| L-BFGS-B-scipy Baudis | 3.2 (2) | 4.1 (2) | 5.1 (2) | 6.9 (2) | 7.7 (3) | 8.2 (3) | 44 (40) | 15/15 |
| Nelder-Mead-scipy Baudis | 23 (11) | 26 (14) | 28 (14) | 29 (14) | 29 (14) | 33 (21) | 40 (38) | 15/15 |
| Powell-scipy Baudis | 1.1 (0.4) | 1.2 (0.4)★ | 1.3 (0.1)★ | 1.3 (0.1)★ | 1.4 (0.1)★2 | 1.9 (0.4) | 2.1 (0.2)★2 | 15/15 |
| SLSQP-scipy Baudis | 1.5 (0.6) | 1.7 (0.6) | 1.9 (0.7) | 2.1 (0.7) | 2.2 (0.8) | 2.5 (0.9) | 11 (11) | 15/15 |
| UNIF-cocopf Baudis | 1.8 (1) | 2.3 (0.4) | 2.4 (0.2) | 2.4 (0.2) | 2.6 (0.5) | 3.2 (0.8) | 3.8 (0.3) | 15/15 |
| Δ fopt f3, 5-D |
1e1 716 |
1e0 1622 |
1e-1 1637 |
1e-2 1642 |
1e-3 1646 |
1e-5 1650 |
1e-7 1654 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 27 (25) | 86 (122) | 311 (238) | 310 (270) | 309 (419) | 308 (393) | 308 (282) | 10/15 |
| CG-Fletcher-Reeves-scipy Baudis | 71 (78) | 348 (486) | 1316 (1827) | 1312 (1328) | 1309 (2270) | 1306 (1922) | 1303 (1436) | 3/15 |
| CMA-ES-python Baudis | 2.1 (1) | 54 (60) | 347 (515) | 346 (356) | 345 (453) | 344 (409) | 344 (415) | 9/15 |
| EG50-cocopf Baudis | 0.89 (0.6) | 2.6 (3) | 14 (10) | 14 (10) | 14 (10) | 14 (10) | 18 (21) | 15/15 |
| L-BFGS-B-scipy Baudis | 13 (16) | 55 (84) | 176 (149) | 175 (146) | 175 (188) | 174 (173) | 217 (217) | 8/15 |
| Nelder-Mead-scipy Baudis | 144 (132) | 632 (719) | 1403 (1316) | 1399 (1236) | 1396 (1511) | 1392 (1306) | ∞5e5 | 0/15 |
| Powell-scipy Baudis | 0.57 (1) | 2.8 (2) | 25 (27) | 25 (27) | 25 (27) | 25 (27) | 26 (25) | 15/15 |
| SLSQP-scipy Baudis | 3.3 (3) | 10 (11) | 56 (67) | 56 (66) | 55 (66) | 55 (66) | 267 (218) | 0/15 |
| UNIF-cocopf Baudis | 1.1 (1) | 3.7 (4) | 23 (22) | 23 (22) | 23 (22) | 23 (22) | 36 (23) | 15/15 |
| Δ fopt f4, 5-D |
1e1 809 |
1e0 1633 |
1e-1 1688 |
1e-2 1758 |
1e-3 1817 |
1e-5 1886 |
1e-7 1903 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 55 (37) | 4460 (5052) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | 258 (375) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CMA-ES-python Baudis | 3.3 (5) | 941 (1207) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| EG50-cocopf Baudis | 0.33 (0.3)↑0 | 1.2 (0.9) | 7.7 (7) | 7.4 (7) | 7.5 (7) | 7.3 (7) | 7.2 (7) | 15/15 |
| L-BFGS-B-scipy Baudis | 28 (32) | 536 (642) | 4369 (4221) | 4195 (5262) | 4059 (5160) | 3911 (6098) | ∞5e5 | 0/15 |
| Nelder-Mead-scipy Baudis | 161 (128) | 474 (671) | 4178 (3777) | 4012 (5617) | 3882 (3990) | 3740 (5899) | ∞5e5 | 0/15 |
| Powell-scipy Baudis | 0.23 (0.3)↑0 | 0.86 (0.6) | 5.1 (6) | 5.0 (6) | 4.8 (6) | 4.6 (5) | 5.0 (5) | 15/15 |
| SLSQP-scipy Baudis | 8.9 (12) | 93 (78) | 1003 (1432) | 963 (617) | 932 (925) | 3748 (5103) | ∞5e5 | 0/15 |
| UNIF-cocopf Baudis | 0.35 (0.4)↑0 | 1.4 (2) | 9.2 (12) | 8.9 (11) | 8.6 (11) | 8.3 (11) | 8.6 (12) | 15/15 |
| Δ fopt f5, 5-D |
1e1 10 |
1e0 10 |
1e-1 10 |
1e-2 10 |
1e-3 10 |
1e-5 10 |
1e-7 10 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 1.7 (0.8) | 2.6 (0.8) | 2.7 (0.8) | 2.8 (0.8) | 2.8 (0.8) | 2.8 (0.8) | 2.8 (0.8) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 1.9 (1) | 3.4 (1) | 3.6 (1) | 3.6 (1) | 3.6 (1) | 3.6 (1) | 3.6 (1) | 15/15 |
| CMA-ES-python Baudis | 8.7 (8) | 23 (17) | 25 (20) | 26 (23) | 26 (23) | 26 (23) | 26 (23) | 15/15 |
| EG50-cocopf Baudis | 7.0 (0.2) | 7.0 (0.2) | 7.0 (0.2) | 7.0 (0.2) | 7.0 (0.2) | 7.0 (0.2) | 7.0 (0.2) | 15/15 |
| L-BFGS-B-scipy Baudis | 1.7 (0.3) | 3.5 (2) | 3.6 (2) | 3.7 (2) | 3.7 (2) | 3.7 (2) | 3.7 (2) | 15/15 |
| Nelder-Mead-scipy Baudis | 25 (38) | 35 (44) | 36 (44) | 36 (44) | 36 (44) | 36 (44) | 36 (44) | 15/15 |
| Powell-scipy Baudis | 6.2 (0.5) | 6.2 (0.5) | 6.3 (0.5) | 6.3 (0.5) | 6.3 (0.5) | 6.3 (0.5) | 6.3 (0.5) | 15/15 |
| SLSQP-scipy Baudis | 1.8 (1) | 4.9 (3) | 6.6 (4) | 7.3 (5) | 7.6 (5) | 7.7 (5) | 7.7 (5) | 15/15 |
| UNIF-cocopf Baudis | 7.0 (0.3) | 7.0 (0.3) | 7.0 (0.3) | 7.0 (0.3) | 7.0 (0.3) | 7.0 (0.3) | 7.0 (0.3) | 15/15 |
| Δ fopt f6, 5-D |
1e1 114 |
1e0 214 |
1e-1 281 |
1e-2 404 |
1e-3 580 |
1e-5 1038 |
1e-7 1332 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 5.5 (4) | 4.1 (2) | 4.0 (2) | 3.8 (2) | 3.1 (2) | 2.6 (2) | 4.1 (4) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 7.1 (6) | 6.5 (4) | 7.2 (4) | 6.5 (3) | 5.3 (2) | 4.7 (3) | 6.9 (6) | 14/15 |
| CMA-ES-python Baudis | 2.2 (1) | 2.3 (0.6) | 2.6 (0.7) | 2.3 (0.5) | 2.0 (0.3) | 1.4 (0.2) | 1.5 (0.2)★ | 15/15 |
| EG50-cocopf Baudis | 6.0 (4) | 5.9 (3) | 6.6 (3) | 8.2 (9) | 8.9 (7) | 12 (8) | 14 (13) | 15/15 |
| L-BFGS-B-scipy Baudis | 4.3 (3) | 3.9 (2) | 4.2 (2) | 3.4 (2) | 2.8 (1) | 4.6 (4) | 191 (261) | 6/15 |
| Nelder-Mead-scipy Baudis | 14 (11) | 13 (10) | 13 (9) | 12 (9) | 13 (10) | 23 (27) | 1151 (1217) | 0/15 |
| Powell-scipy Baudis | 7.0 (7) | 7.0 (7) | 8.8 (8) | 15 (22) | 112 (113) | 2054 (2504) | 5346 (6570) | 0/15 |
| SLSQP-scipy Baudis | 1.8 (2) | 1.6 (0.8) | 1.8 (1) | 1.7 (1) | 2.9 (3) | 7.7 (9) | 288 (254) | 2/15 |
| UNIF-cocopf Baudis | 10 (9) | 12 (8) | 14 (9) | 14 (7) | 13 (5) | 14 (5) | 16 (6) | 15/15 |
| Δ fopt f7, 5-D |
1e1 24 |
1e0 324 |
1e-1 1171 |
1e-2 1451 |
1e-3 1572 |
1e-5 1572 |
1e-7 1597 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 175 (325) | 210 (175) | 6233 (7688) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | 302 (530) | 242 (296) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CMA-ES-python Baudis | 6.1 (4) | 2.2 (2)★2 | 3.3 (4)★ | 2.9 (3)★3 | 3.0 (3)★3 | 3.0 (3)★3 | 3.5 (6)★3 | 15/15 |
| EG50-cocopf Baudis | 61 (26) | 28 (28) | 24 (22) | 118 (148) | 169 (174) | 169 (239) | 209 (394) | 11/15 |
| L-BFGS-B-scipy Baudis | 194 (297) | 222 (369) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| Nelder-Mead-scipy Baudis | 454 (391) | 99 (152) | 306 (364) | 2319 (2119) | 2179 (3101) | 2179 (1965) | 2145 (2689) | 2/15 |
| Powell-scipy Baudis | 33 (26) | 14 (19) | 14 (16) | 160 (209) | 291 (323) | 291 (335) | 463 (521) | 7/15 |
| SLSQP-scipy Baudis | 198 (209) | 107 (140) | 6088 (4910) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| UNIF-cocopf Baudis | 48 (41) | 72 (78) | 113 (200) | 206 (237) | 273 (494) | 273 (181) | 284 (310) | 9/15 |
| Δ fopt f8, 5-D |
1e1 73 |
1e0 273 |
1e-1 336 |
1e-2 372 |
1e-3 391 |
1e-5 410 |
1e-7 422 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 3.2 (1) | 2.2 (2) | 2.0 (1) | 1.9 (1) | 1.9 (1) | 1.9 (1) | 1.8 (1) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 2.7 (2) | 20 (16) | 17 (13) | 16 (11) | 16 (11) | 15 (10) | 15 (10) | 15/15 |
| CMA-ES-python Baudis | 4.6 (1) | 9.1 (12) | 9.0 (9) | 8.9 (8) | 8.9 (8) | 9.1 (7) | 9.3 (7) | 15/15 |
| EG50-cocopf Baudis | 5.3 (2) | 4.4 (4) | 5.6 (4) | 6.9 (6) | 7.1 (5) | 8.5 (7) | 9.2 (7) | 15/15 |
| L-BFGS-B-scipy Baudis | 1.9 (1.0) | 42 (120) | 34 (97) | 31 (88) | 29 (84) | 28 (80) | 27 (77) | 15/15 |
| Nelder-Mead-scipy Baudis | 6.5 (6) | 33 (79) | 28 (64) | 25 (58) | 24 (55) | 24 (52) | 24 (51) | 15/15 |
| Powell-scipy Baudis | 3.3 (3) | 18 (40) | 30 (43) | 37 (40) | 42 (49) | 330 (389) | 8286 (1e4) | 0/15 |
| SLSQP-scipy Baudis | 1.6 (0.7) | 17 (16) | 14 (13) | 13 (12) | 12 (11) | 11 (11) | 12 (10) | 15/15 |
| UNIF-cocopf Baudis | 5.0 (2) | 3.7 (4) | 5.3 (5) | 7.2 (3) | 8.5 (3) | 11 (6) | 14 (8) | 14/15 |
| Δ fopt f9, 5-D |
1e1 35 |
1e0 127 |
1e-1 214 |
1e-2 263 |
1e-3 300 |
1e-5 335 |
1e-7 369 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 4.5 (2) | 3.2 (1) | 2.2 (0.8) | 2.0 (0.7) | 1.8 (0.6) | 1.7 (0.5) | 1.5 (0.5) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 4.1 (2) | 6.9 (1) | 5.2 (1) | 4.8 (1) | 4.7 (1) | 4.7 (1) | 4.7 (1) | 15/15 |
| CMA-ES-python Baudis | 8.6 (4) | 16 (15) | 12 (9) | 11 (7) | 10 (7) | 10 (6) | 9.4 (5) | 15/15 |
| EG50-cocopf Baudis | 11 (4) | 8.4 (6) | 7.2 (4) | 7.1 (4) | 8.2 (4) | 10 (9) | 10 (9) | 15/15 |
| L-BFGS-B-scipy Baudis | 2.5 (2) | 5.9 (16) | 3.9 (9) | 3.3 (8) | 3.0 (7) | 2.7 (6) | 2.5 (5) | 15/15 |
| Nelder-Mead-scipy Baudis | 11 (6) | 60 (81) | 37 (48) | 30 (39) | 27 (35) | 24 (31) | 22 (28) | 15/15 |
| Powell-scipy Baudis | 6.9 (5) | 30 (15) | 20 (9) | 18 (7) | 38 (61) | 360 (314) | ∞5e5 | 0/15 |
| SLSQP-scipy Baudis | 2.8 (1) | 1.5 (1.0) | 1.2 (0.7) | 1.1 (0.5) | 1.0 (0.4) | 1.00 (0.4) | 1.4 (1.0) | 15/15 |
| UNIF-cocopf Baudis | 12 (7) | 12 (5) | 10 (4) | 11 (4) | 11 (4) | 11 (3) | 12 (3) | 13/15 |
| Δ fopt f10, 5-D |
1e1 349 |
1e0 500 |
1e-1 574 |
1e-2 607 |
1e-3 626 |
1e-5 829 |
1e-7 880 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 0.62 (0.3)↑1 | 0.49 (0.2)↑0 | 0.47 (0.3)↑0 | 0.48 (0.3)↑0 | 0.50 (0.3)↑0 | 0.51 (0.3)↑1 | 14 (12) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 21 (18) | 40 (34) | 67 (65) | 119 (76) | 335 (402) | 8643 (8293) | ∞5e5 | 0/15 |
| CMA-ES-python Baudis | 3.8 (2) | 3.2 (1) | 3.2 (0.7) | 3.3 (0.5) | 3.4 (0.5) | 2.8 (0.4) | 2.8 (0.3) | 15/15 |
| EG50-cocopf Baudis | 7.2 (9) | 6.1 (6) | 5.6 (6) | 5.4 (6) | 5.3 (5) | 4.4 (4) | 31 (43) | 15/15 |
| L-BFGS-B-scipy Baudis | 1.3 (0.4) | 1.1 (0.3) | 1.0 (0.3) | 1.0 (0.3) | 1.0 (0.3) | 1.2 (0.6) | 95 (174) | 6/15 |
| Nelder-Mead-scipy Baudis | 5.6 (3) | 6.6 (4) | 6.4 (6) | 7.4 (6) | 8.5 (7) | 7.6 (8) | 7.4 (7) | 15/15 |
| Powell-scipy Baudis | 46 (69) | 53 (61) | 55 (52) | 210 (288) | 381 (387) | 2593 (3212) | ∞5e5 | 0/15 |
| SLSQP-scipy Baudis | 0.40 (0.2)↑0 | 0.32 (0.1)↑0 | 0.30 (0.1)↑0 | 0.32 (0.1)↑0 | 0.34 (0.1)↑0 | 0.44 (0.5) | 13 (14) | 7/15 |
| UNIF-cocopf Baudis | 4.5 (2) | 3.8 (2) | 3.7 (2) | 3.8 (2) | 4.0 (2) | 4.1 (2) | 42 (42) | 14/15 |
| Δ fopt f11, 5-D |
1e1 143 |
1e0 202 |
1e-1 763 |
1e-2 977 |
1e-3 1177 |
1e-5 1467 |
1e-7 1673 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 0.59 (0.2)↑1 | 0.51 (0.3)↑1 | 0.17 (0.1)↑0 | 0.15 (0.1)↑0 | 0.14 (0.1)↑0 | 0.43 (0.5) | 26 (41) | 12/15 |
| CG-Fletcher-Reeves-scipy Baudis | 3.6 (3) | 3.3 (2) | 1.6 (1) | 2.0 (1) | 2.2 (2) | 29 (33) | 4191 (4633) | 0/15 |
| CMA-ES-python Baudis | 7.9 (5) | 7.7 (2) | 2.4 (0.5) | 2.0 (0.4) | 1.7 (0.3) | 1.5 (0.2) | 1.5 (0.2)★ | 15/15 |
| EG50-cocopf Baudis | 11 (7) | 10 (9) | 2.8 (2) | 2.3 (2) | 2.0 (2) | 2.7 (2) | 36 (27) | 15/15 |
| L-BFGS-B-scipy Baudis | 1.2 (0.3) | 1.3 (0.4) | 0.51 (0.2)↑0 | 0.58 (0.3)↑0 | 0.71 (0.3) | 16 (18) | ∞5e5 | 0/15 |
| Nelder-Mead-scipy Baudis | 10 (8) | 13 (7) | 5.7 (3) | 6.1 (3) | 7.2 (6) | 12 (8) | 15 (10) | 15/15 |
| Powell-scipy Baudis | 45 (49) | 107 (143) | 223 (168) | 3387 (4580) | 6335 (7860) | ∞ | ∞5e5 | 0/15 |
| SLSQP-scipy Baudis | 0.44 (0.3)↑0 | 0.39 (0.2)↑0 | 0.12 (0.1)↑0 | 0.11 (0.1)↑0 | 0.11 (0.0)↑0 | 0.30 (0.4)↑1 | 28 (20) | 1/15 |
| UNIF-cocopf Baudis | 5.8 (5) | 5.4 (3) | 1.7 (0.8) | 1.5 (0.6) | 1.5 (0.5) | 2.9 (2) | 37 (23) | 15/15 |
| Δ fopt f12, 5-D |
1e1 108 |
1e0 268 |
1e-1 371 |
1e-2 413 |
1e-3 461 |
1e-5 1303 |
1e-7 1494 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 1603 (2345) | 648 (965) | 468 (994) | 421 (680) | 378 (607) | 141 (192) | 422 (383) | 4/15 |
| CG-Fletcher-Reeves-scipy Baudis | 2027 (2766) | 819 (1073) | 606 (733) | 545 (674) | 491 (766) | 430 (479) | 2332 (2430) | 0/15 |
| CMA-ES-python Baudis | 8.8 (7) | 6.9 (8) | 7.5 (8) | 7.9 (7) | 8.3 (6) | 3.9 (2) | 4.1 (2)★ | 15/15 |
| EG50-cocopf Baudis | 74 (69) | 47 (45) | 46 (36) | 49 (25) | 53 (19) | 31 (17) | 173 (129) | 14/15 |
| L-BFGS-B-scipy Baudis | 1.1 (1) | 1.1 (0.9) | 1.2 (0.9) | 1.3 (0.8) | 1.4 (0.9) | 2.0 (2) | 148 (209) | 9/15 |
| Nelder-Mead-scipy Baudis | 15 (13) | 11 (9) | 13 (13) | 15 (12) | 39 (55) | 295 (385) | 522 (502) | 2/15 |
| Powell-scipy Baudis | 40 (37) | 22 (21) | 21 (24) | 20 (21) | 38 (40) | 132 (106) | 4812 (7196) | 0/15 |
| SLSQP-scipy Baudis | 2.7 (2) | 1.6 (2) | 1.6 (1) | 1.6 (1) | 1.7 (1) | 3.7 (5) | 276 (395) | 4/15 |
| UNIF-cocopf Baudis | 123 (140) | 108 (94) | 117 (70) | 119 (68) | 127 (76) | 70 (55) | 358 (474) | 6/15 |
| Δ fopt f13, 5-D |
1e1 132 |
1e0 195 |
1e-1 250 |
1e-2 319 |
1e-3 1310 |
1e-5 1752 |
1e-7 2255 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 1.0 (0.1) | 1.0 (0.1) | 1.00 (0.1) | 0.97 (0.1) | 1.0 (0.8) | 464 (538) | ∞5e5 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | 16 (40) | 28 (32) | 30 (26) | 31 (25) | 21 (22) | 209 (186) | ∞5e5 | 0/15 |
| CMA-ES-python Baudis | 4.3 (3) | 5.3 (3) | 5.8 (3) | 6.1 (3) | 1.9 (0.8) | 1.8 (0.5)★2 | 1.9 (0.6)★4 | 15/15 |
| EG50-cocopf Baudis | 10 (13) | 10 (11) | 11 (9) | 12 (8) | 5.1 (6) | 28 (16) | 35 (24) | 15/15 |
| L-BFGS-B-scipy Baudis | 6.4 (9) | 22 (28) | 23 (25) | 33 (60) | 16 (20) | 91 (118) | ∞5e5 | 0/15 |
| Nelder-Mead-scipy Baudis | 9.3 (11) | 8.8 (9) | 8.9 (8) | 10 (8) | 6.9 (10) | 65 (85) | 3109 (2993) | 0/15 |
| Powell-scipy Baudis | 26 (35) | 35 (38) | 37 (31) | 50 (46) | 165 (214) | 4201 (3853) | ∞5e5 | 0/15 |
| SLSQP-scipy Baudis | 0.78 (0.1)★3↑0 | 0.80 (0.1)★4↑0 | 0.82 (0.1)★4↑0 | 0.80 (0.1)★4↑0 | 5.9 (2) | 1185 (1668) | ∞5e5 | 0/15 |
| UNIF-cocopf Baudis | 6.8 (4) | 10 (1) | 11 (0.7) | 11 (0.7) | 7.1 (4) | 47 (32) | 57 (9) | 15/15 |
| Δ fopt f14, 5-D |
1e1 10 |
1e0 41 |
1e-1 58 |
1e-2 90 |
1e-3 139 |
1e-5 251 |
1e-7 476 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 1.8 (0.8) | 0.93 (0.4) | 1.2 (0.3) | 1.2 (0.2) | 1.1 (0.1) | 0.93 (0.1) | 85 (90) | 6/15 |
| CG-Fletcher-Reeves-scipy Baudis | 2.2 (2) | 1.2 (0.5) | 1.4 (0.5) | 1.5 (0.5) | 1.8 (0.4) | 7.8 (8) | 4957 (5669) | 1/15 |
| CMA-ES-python Baudis | 2.5 (4) | 3.7 (2) | 4.7 (2) | 4.8 (1) | 5.2 (1) | 6.5 (1) | 5.1 (0.8) | 15/15 |
| EG50-cocopf Baudis | 4.9 (6) | 4.0 (2) | 4.0 (1) | 4.4 (3) | 5.4 (4) | 6.6 (7) | 74 (33) | 15/15 |
| L-BFGS-B-scipy Baudis | 2.1 (0.8) | 1.4 (0.5) | 1.5 (0.3) | 1.4 (0.3) | 1.2 (0.2) | 1.6 (1) | 684 (1054) | 1/15 |
| Nelder-Mead-scipy Baudis | 16 (14) | 10 (4) | 8.8 (2) | 6.8 (1) | 5.1 (0.7) | 4.0 (0.8) | 2.7 (0.4)★2 | 15/15 |
| Powell-scipy Baudis | 4.5 (3) | 2.9 (1) | 2.7 (0.7) | 4.7 (4) | 1177 (2121) | ∞ | ∞5e5 | 0/15 |
| SLSQP-scipy Baudis | 1.2 (0.9) | 0.79 (0.4) | 1.0 (0.4) | 0.98 (0.2) | 0.87 (0.2)★2 | 0.76 (0.1)★2↑0 | 936 (1264) | 0/15 |
| UNIF-cocopf Baudis | 4.6 (4) | 4.3 (3) | 4.6 (3) | 8.0 (2) | 9.0 (2) | 8.6 (1) | 110 (14) | 15/15 |
| Δ fopt f15, 5-D |
1e1 511 |
1e0 9310 |
1e-1 19369 |
1e-2 19743 |
1e-3 20073 |
1e-5 20769 |
1e-7 21359 |
#succ 14/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 15 (11) | 3.0 (2) | 6.6 (9) | 6.5 (9) | 6.4 (9) | 6.2 (8) | 6.0 (8) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 25 (15) | 4.1 (4) | 10 (9) | 9.4 (9) | 9.3 (9) | 9.0 (8) | 8.7 (8) | 15/15 |
| CMA-ES-python Baudis | 1.7 (3) | 4.4 (5) | 22 (26) | 22 (27) | 22 (19) | 21 (21) | 20 (24) | 10/15 |
| EG50-cocopf Baudis | 11 (10) | 5.0 (4) | 7.7 (8) | 7.6 (7) | 7.7 (7) | 10 (7) | 15 (13) | 12/15 |
| L-BFGS-B-scipy Baudis | 6.4 (5) | 2.0 (2) | 2.8 (2) | 2.8 (2) | 2.7 (2) | 2.6 (2) | 4.9 (4) | 9/15 |
| Nelder-Mead-scipy Baudis | 34 (25) | 5.2 (4) | 11 (10) | 11 (10) | 11 (9) | 11 (9) | ∞5e5 | 0/15 |
| Powell-scipy Baudis | 12 (11) | 5.9 (5) | 10 (11) | 10 (11) | 11 (10) | 102 (108) | ∞5e5 | 0/15 |
| SLSQP-scipy Baudis | 3.2 (3) | 0.92 (0.8) | 1.5 (2) | 1.4 (2) | 1.4 (2) | 1.7 (2) | 19 (25) | 0/15 |
| UNIF-cocopf Baudis | 16 (12) | 3.5 (2) | 4.6 (6) | 4.5 (6) | 4.8 (6) | 6.8 (6) | 17 (15) | 11/15 |
| Δ fopt f16, 5-D |
1e1 120 |
1e0 612 |
1e-1 2662 |
1e-2 10163 |
1e-3 10449 |
1e-5 11644 |
1e-7 12095 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 250 (241) | 1761 (982) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | 91 (96) | 2023 (2229) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CMA-ES-python Baudis | 2.2 (1) | 3.6 (6)★ | 7.4 (9) | 4.7 (3)★2 | 7.1 (3)★2 | 10 (10)★2 | 11 (13)★ | 13/15 |
| EG50-cocopf Baudis | 5.6 (8) | 13 (8) | 37 (38) | 36 (41) | 53 (51) | 84 (74) | 100 (125) | 5/15 |
| L-BFGS-B-scipy Baudis | 35 (38) | 310 (354) | 2802 (3052) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| Nelder-Mead-scipy Baudis | 25 (39) | 57 (68) | 64 (57) | 99 (78) | ∞ | ∞ | ∞5e5 | 0/15 |
| Powell-scipy Baudis | 10 (16) | 17 (15) | 20 (18) | 146 (221) | 679 (897) | ∞ | ∞5e5 | 0/15 |
| SLSQP-scipy Baudis | 19 (24) | 218 (198) | 2643 (2207) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| UNIF-cocopf Baudis | 6.8 (9) | 51 (74) | 57 (66) | 225 (321) | 351 (322) | 316 (331) | 613 (817) | 1/15 |
| Δ fopt f17, 5-D |
1e1 5.0 |
1e0 215 |
1e-1 899 |
1e-2 2861 |
1e-3 3669 |
1e-5 6351 |
1e-7 7934 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 105 (246) | 67 (54) | 1348 (1305) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | 529 (861) | 221 (271) | 1846 (2957) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CMA-ES-python Baudis | 4.9 (4) | 2.0 (0.4)★3 | 1.0 (1)★3 | 0.78 (0.7)★3 | 1.9 (2) | 10 (7) | 24 (32) | 11/15 |
| EG50-cocopf Baudis | 16 (24) | 19 (11) | 13 (12) | 7.7 (10) | 9.3 (11) | 47 (58) | 122 (110) | 3/15 |
| L-BFGS-B-scipy Baudis | 37 (36) | 45 (52) | 244 (290) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| Nelder-Mead-scipy Baudis | 2300 (2904) | 2747 (2198) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| Powell-scipy Baudis | 125 (159) | 92 (83) | 48 (55) | 1173 (1169) | ∞ | ∞ | ∞5e5 | 0/15 |
| SLSQP-scipy Baudis | 33 (39) | 21 (10) | 421 (560) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| UNIF-cocopf Baudis | 20 (31) | 19 (12) | 16 (6) | 16 (20) | 36 (46) | 149 (216) | 889 (993) | 1/15 |
| Δ fopt f18, 5-D |
1e1 103 |
1e0 378 |
1e-1 3968 |
1e-2 8451 |
1e-3 9280 |
1e-5 10905 |
1e-7 12469 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 55 (57) | 396 (507) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | 593 (396) | 2204 (2314) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CMA-ES-python Baudis | 1.6 (0.8)★ | 3.8 (6)★2 | 1.8 (2)★ | 2.8 (4)★ | 11 (10)★2 | 73 (94)★2 | ∞5e5 | 0/15 |
| EG50-cocopf Baudis | 18 (23) | 32 (24) | 11 (12) | 28 (31) | 76 (77) | ∞ | ∞5e5 | 0/15 |
| L-BFGS-B-scipy Baudis | 72 (163) | 212 (288) | 1775 (1859) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| Nelder-Mead-scipy Baudis | 568 (393) | 1796 (1412) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| Powell-scipy Baudis | 30 (31) | 48 (46) | 118 (98) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| SLSQP-scipy Baudis | 33 (36) | 98 (55) | 1814 (2835) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| UNIF-cocopf Baudis | 41 (42) | 82 (115) | 58 (83) | 115 (88) | 792 (498) | ∞ | ∞5e5 | 0/15 |
| Δ fopt f19, 5-D |
1e1 1 |
1e0 1 |
1e-1 242 |
1e-2 1.0e5 |
1e-3 1.2e5 |
1e-5 1.2e5 |
1e-7 1.2e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 3546 (4608) | 1.4e4 (9298) | 744 (694) | 23 (26) | ∞ | ∞ | ∞5e5 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | 4600 (4484) | 2.7e4 (2e4) | 1108 (1033) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CMA-ES-python Baudis | 35 (33) | 4132 (6032) | 724 (1020) | 34 (35) | ∞ | ∞ | ∞5e5 | 0/15 |
| EG50-cocopf Baudis | 262 (220) | 7212 (5745) | 638 (421) | 33 (28) | 60 (102) | 59 (70) | 59 (75) | 0/15 |
| L-BFGS-B-scipy Baudis | 2848 (4106) | 1.1e4 (5890) | 165 (166) | 7.0 (9) | 59 (57) | 59 (76) | 58 (68) | 0/15 |
| Nelder-Mead-scipy Baudis | 4374 (4898) | 2.1e4 (2e4) | 1282 (1706) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| Powell-scipy Baudis | 183 (358) | 7666 (8482) | 711 (681) | 68 (103) | ∞ | ∞ | ∞5e5 | 0/15 |
| SLSQP-scipy Baudis | 4345 (6048) | 2.2e4 (2e4) | 442 (462) | 68 (98) | 60 (76) | 59 (46) | ∞5e5 | 0/15 |
| UNIF-cocopf Baudis | 198 (268) | 1.7e4 (2e4) | 616 (630) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| Δ fopt f20, 5-D |
1e1 16 |
1e0 851 |
1e-1 38111 |
1e-2 51362 |
1e-3 54470 |
1e-5 54861 |
1e-7 55313 |
#succ 14/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 6.9 (4) | 4.0 (4) | 3.1 (4) | 2.3 (3) | 2.2 (3) | 2.1 (3) | 2.1 (3) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 2.4 (0.7) | 33 (43) | 44 (43) | 33 (30) | 31 (28) | 31 (37) | 30 (32) | 4/15 |
| CMA-ES-python Baudis | 5.0 (3) | 14 (16) | 26 (40) | 19 (24) | 18 (22) | 18 (17) | 18 (16) | 6/15 |
| EG50-cocopf Baudis | 9.5 (8) | 1.5 (0.9) | 6.5 (8) | 4.9 (6) | 8.6 (13) | 30 (26) | 129 (102) | 0/15 |
| L-BFGS-B-scipy Baudis | 1.8 (0.8) | 6.1 (5) | 16 (21) | 12 (17) | 11 (9) | 11 (6) | 11 (13) | 9/15 |
| Nelder-Mead-scipy Baudis | 19 (18) | 11 (16) | 6.6 (7) | 4.9 (6) | 4.6 (6) | 4.6 (5) | 5.4 (6) | 0/15 |
| Powell-scipy Baudis | 8.3 (3) | 1.5 (1) | 3.1 (3) | 2.3 (2) | 3.1 (4) | 23 (26) | 129 (136) | 0/15 |
| SLSQP-scipy Baudis | 1.5 (1) | 3.6 (4) | 10 (9) | 7.5 (8) | 7.0 (6) | 7.0 (8) | 9.2 (8) | 8/15 |
| UNIF-cocopf Baudis | 13 (6) | 1.6 (1) | 5.8 (7) | 4.3 (5) | 5.2 (6) | 16 (11) | 18 (19) | 5/15 |
| Δ fopt f21, 5-D |
1e1 41 |
1e0 1157 |
1e-1 1674 |
1e-2 1692 |
1e-3 1705 |
1e-5 1729 |
1e-7 1757 |
#succ 14/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 52 (104) | 59 (44) | 132 (121) | 131 (120) | 130 (119) | 128 (117) | 126 (115) | 14/15 |
| CG-Fletcher-Reeves-scipy Baudis | 144 (173) | 204 (219) | 304 (317) | 301 (292) | 298 (279) | 294 (348) | 292 (383) | 0/15 |
| CMA-ES-python Baudis | 5.7 (1) | 4.7 (4) | 8.1 (7) | 8.0 (7) | 8.0 (7) | 7.9 (7) | 7.9 (6) | 15/15 |
| EG50-cocopf Baudis | 6.7 (13) | 36 (50) | 64 (95) | 63 (94) | 63 (93) | 63 (91) | 63 (90) | 14/15 |
| L-BFGS-B-scipy Baudis | 51 (69) | 52 (53) | 86 (60) | 85 (59) | 84 (59) | 83 (58) | 82 (57) | 14/15 |
| Nelder-Mead-scipy Baudis | 693 (1002) | 469 (513) | 593 (802) | 587 (472) | 582 (440) | 574 (707) | 565 (1131) | 6/15 |
| Powell-scipy Baudis | 50 (2) | 130 (162) | 170 (182) | 169 (148) | 167 (152) | 165 (174) | 292 (296) | 7/15 |
| SLSQP-scipy Baudis | 14 (24) | 44 (61) | 62 (55) | 62 (55) | 61 (54) | 60 (54) | 145 (187) | 4/15 |
| UNIF-cocopf Baudis | 2.9 (2) | 28 (40) | 60 (83) | 60 (82) | 60 (82) | 60 (81) | 83 (120) | 14/15 |
| Δ fopt f22, 5-D |
1e1 71 |
1e0 386 |
1e-1 938 |
1e-2 980 |
1e-3 1008 |
1e-5 1040 |
1e-7 1068 |
#succ 14/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 71 (117) | 99 (146) | 188 (258) | 180 (247) | 175 (240) | 170 (232) | 165 (226) | 13/15 |
| CG-Fletcher-Reeves-scipy Baudis | 312 (473) | 219 (282) | 247 (249) | 237 (239) | 230 (232) | 224 (225) | 281 (241) | 1/15 |
| CMA-ES-python Baudis | 8.4 (15) | 11 (9) | 40 (61) | 39 (58) | 38 (56) | 37 (55) | 36 (53) | 15/15 |
| EG50-cocopf Baudis | 12 (14) | 68 (121) | 155 (228) | 148 (219) | 144 (213) | 143 (206) | 182 (206) | 14/15 |
| L-BFGS-B-scipy Baudis | 65 (141) | 111 (111) | 84 (85) | 80 (81) | 78 (79) | 76 (77) | 76 (73) | 15/15 |
| Nelder-Mead-scipy Baudis | 232 (315) | 523 (709) | 582 (668) | 557 (702) | 541 (627) | 525 (603) | 511 (426) | 9/15 |
| Powell-scipy Baudis | 177 (324) | 176 (325) | 143 (265) | 137 (254) | 156 (302) | 323 (368) | 458 (466) | 7/15 |
| SLSQP-scipy Baudis | 24 (52) | 63 (93) | 59 (73) | 57 (70) | 55 (68) | 54 (66) | 160 (192) | 8/15 |
| UNIF-cocopf Baudis | 3.8 (4) | 33 (19) | 62 (88) | 60 (84) | 60 (83) | 61 (81) | 109 (163) | 13/15 |
| Δ fopt f23, 5-D |
1e1 3.0 |
1e0 518 |
1e-1 14249 |
1e-2 27890 |
1e-3 31654 |
1e-5 33030 |
1e-7 34256 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 63 (116) | 60 (81) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | 108 (191) | 139 (201) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CMA-ES-python Baudis | 2.9 (3) | 8.5 (10) | 7.9 (11) | 12 (13) | 11 (12) | 13 (19) | 13 (10) | 10/15 |
| EG50-cocopf Baudis | 2.3 (2) | 6.8 (6) | 29 (26) | 80 (103) | 71 (113) | 68 (67) | 66 (51) | 3/15 |
| L-BFGS-B-scipy Baudis | 32 (76) | 32 (29) | 105 (149) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| Nelder-Mead-scipy Baudis | 4.3 (5) | 2.6 (4) | 4.6 (5) | 23 (35) | 236 (190) | ∞ | ∞5e5 | 0/15 |
| Powell-scipy Baudis | 3.1 (3) | 7.5 (7) | 111 (128) | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| SLSQP-scipy Baudis | 4.2 (4) | 2.2 (2) | 7.7 (7) | 18 (20) | 229 (221) | ∞ | ∞5e5 | 0/15 |
| UNIF-cocopf Baudis | 2.7 (2) | 14 (14) | 50 (50) | 126 (117) | ∞ | ∞ | ∞5e5 | 0/15 |
| Δ fopt f24, 5-D |
1e1 1622 |
1e0 2.2e5 |
1e-1 6.4e6 |
1e-2 9.6e6 |
1e-3 9.6e6 |
1e-5 1.3e7 |
1e-7 1.3e7 |
#succ 3/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 13 (5) | 0.54 (0.5) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | 25 (16) | 1.9 (2) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| CMA-ES-python Baudis | 3.1 (5) | 3.1 (4) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| EG50-cocopf Baudis | 12 (7) | 0.73 (0.7) | 1.1 (1) | 0.76 (0.8) | 0.75 (0.6) | 0.56 (0.4) | ∞5e5 | 0/15 |
| L-BFGS-B-scipy Baudis | 2.5 (2) | 0.18 (0.2)↑0 | 0.55 (0.5) | 0.76 (0.6) | 0.75 (0.7) | 0.57 (0.6) | 0.57 (0.5) | 1/15 |
| Nelder-Mead-scipy Baudis | 14 (6) | 1.5 (2) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| Powell-scipy Baudis | 10 (9) | 1.4 (2) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
| SLSQP-scipy Baudis | 2.6 (1) | 0.26 (0.3)↑0 | 0.56 (0.9) | 0.76 (1) | 0.75 (1.0) | 0.56 (0.9) | ∞5e5 | 0/15 |
| UNIF-cocopf Baudis | 14 (10) | 0.73 (0.6) | ∞ | ∞ | ∞ | ∞ | ∞5e5 | 0/15 |
Previous dimension | Dimension = 10 | Next dimension
Previous dimension | Dimension = 20 | Next dimension
| Δ fopt f1, 20-D |
1e1 43 |
1e0 43 |
1e-1 43 |
1e-2 43 |
1e-3 43 |
1e-5 43 |
1e-7 43 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 1.0 (0) | 1.0 (0) | 1.0 (0) | 1.0 (0) | 1.0 (0) | 1.0 (0) | 1.4 (0.3) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 1.0 (0) | 1.0 (0) | 1.0 (0) | 1.0 (0) | 1.0 (0) | 1.0 (0) | 1.7 (0.5) | 15/15 |
| CMA-ES-python Baudis | 10 (1) | 18 (3) | 25 (2) | 33 (3) | 40 (4) | 55 (4) | 70 (5) | 15/15 |
| EG50-cocopf Baudis | 4.7 (0.4) | 4.8 (0.1) | 4.8 (0.1) | 4.8 (0.1) | 4.9 (0.1) | 4.9 (0.1) | 5.0 (0.6) | 15/15 |
| L-BFGS-B-scipy Baudis | 1.1 (0) | 1.1 (0) | 1.1 (0) | 1.1 (0) | 1.1 (0) | 1.1 (0) | 1.1 (0) | 15/15 |
| Nelder-Mead-scipy Baudis | 178 (50) | 288 (90) | 393 (84) | 661 (336) | 1383 (1512) | 3.8e4 (5e4) | 8.5e4 (7e4) | 0/15 |
| Powell-scipy Baudis | 4.2 (0.2) | 4.3 (0.1) | 4.3 (0.0) | 4.3 (0.0) | 4.3 (0.0) | 5.2 (0.0) | 6.0 (6) | 15/15 |
| SLSQP-scipy Baudis | 1.3 (0.8) | 3.4 (3) | 4.1 (4) | 4.6 (4) | 5.3 (5) | 5.8 (5) | 6.2 (5) | 15/15 |
| UNIF-cocopf Baudis | 4.7 (0.2) | 4.8 (0.2) | 4.9 (0.1) | 4.9 (0.1) | 4.9 (0.1) | 5.0 (0.5) | 5.2 (0.6) | 15/15 |
| Δ fopt f2, 20-D |
1e1 385 |
1e0 386 |
1e-1 387 |
1e-2 388 |
1e-3 390 |
1e-5 391 |
1e-7 393 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 4.5 (1) | 4.9 (2) | 5.2 (1) | 5.6 (1) | 5.8 (1) | 6.3 (1) | 6.8 (1) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 206 (66) | 416 (238) | 863 (474) | 1345 (612) | 3684 (3167) | ∞ | ∞2e6 | 0/15 |
| CMA-ES-python Baudis | 38 (5) | 44 (3) | 49 (3) | 51 (3) | 52 (2) | 54 (2) | 55 (2) | 15/15 |
| EG50-cocopf Baudis | 2.0 (0.2) | 2.0 (0.2) | 2.0 (0.2) | 2.1 (0.2) | 2.3 (0.5) | 2.8 (0.2) | 2.9 (0.2) | 15/15 |
| L-BFGS-B-scipy Baudis | 26 (10) | 70 (45) | 159 (137) | 1099 (1548) | ∞ | ∞ | ∞2e6 | 0/15 |
| Nelder-Mead-scipy Baudis | 7.5e4 (8e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Powell-scipy Baudis | 1.2 (0.0)★2 | 1.2 (0.0)★4 | 1.2 (0.0)★4 | 1.2 (0.0)★3 | 1.4 (0.4)★2 | 1.9 (0.1)★4 | 1.9 (0.0)★4 | 15/15 |
| SLSQP-scipy Baudis | 3.2 (0.8) | 3.8 (0.7) | 4.1 (0.7) | 4.3 (0.7) | 4.4 (0.9) | 4.8 (0.8) | 1137 (797) | 0/15 |
| UNIF-cocopf Baudis | 1.8 (0.1) | 1.9 (0.1) | 2.0 (0.1) | 2.1 (0.6) | 2.3 (0.7) | 3.1 (0.2) | 3.2 (0.2) | 15/15 |
| Δ fopt f3, 20-D |
1e1 5066 |
1e0 7626 |
1e-1 7635 |
1e-2 7637 |
1e-3 7643 |
1e-5 7646 |
1e-7 7651 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA-ES-python Baudis | 1821 (2037) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| EG50-cocopf Baudis | 12 (11) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| L-BFGS-B-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Nelder-Mead-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Powell-scipy Baudis | 11 (9) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SLSQP-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| UNIF-cocopf Baudis | 19 (14) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Δ fopt f4, 20-D |
1e1 4722 |
1e0 7628 |
1e-1 7666 |
1e-2 7686 |
1e-3 7700 |
1e-5 7758 |
1e-7 1.4e5 |
#succ 9/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA-ES-python Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| EG50-cocopf Baudis | 11 (9) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| L-BFGS-B-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Nelder-Mead-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Powell-scipy Baudis | 14 (18) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SLSQP-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| UNIF-cocopf Baudis | 16 (14) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Δ fopt f5, 20-D |
1e1 41 |
1e0 41 |
1e-1 41 |
1e-2 41 |
1e-3 41 |
1e-5 41 |
1e-7 41 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 1.5 (0.3) | 2.4 (0.6) | 2.5 (0.3) | 2.5 (0.3) | 2.5 (0.3) | 2.5 (0.3) | 2.5 (0.3) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 2.2 (0.6) | 2.9 (0.6) | 3.1 (0.8) | 3.1 (0.8) | 3.1 (0.8) | 3.1 (0.8) | 3.1 (0.8) | 15/15 |
| CMA-ES-python Baudis | 22 (6) | 37 (9) | 42 (10) | 42 (10) | 43 (10) | 43 (10) | 43 (10) | 15/15 |
| EG50-cocopf Baudis | 7.4 (0.1) | 7.4 (0.1) | 7.4 (0.1) | 7.4 (0.1) | 7.4 (0.1) | 7.4 (0.1) | 7.4 (0.1) | 15/15 |
| L-BFGS-B-scipy Baudis | 2.2 (0) | 3.0 (0.6) | 3.2 (0.3) | 3.2 (0.3) | 3.2 (0.3) | 3.2 (0.3) | 3.2 (0.3) | 15/15 |
| Nelder-Mead-scipy Baudis | 257 (215) | 355 (386) | 359 (389) | 359 (390) | 359 (390) | 359 (390) | 359 (390) | 15/15 |
| Powell-scipy Baudis | 6.9 (0.2) | 6.9 (0.1) | 6.9 (0.1) | 6.9 (0.1) | 6.9 (0.1) | 6.9 (0.1) | 6.9 (0.1) | 15/15 |
| SLSQP-scipy Baudis | 2.1 (0.3) | 4.1 (3) | 14 (31) | 19 (31) | 19 (31) | 19 (31) | 19 (31) | 15/15 |
| UNIF-cocopf Baudis | 7.4 (0.2) | 7.4 (0.2) | 7.4 (0.2) | 7.4 (0.2) | 7.4 (0.2) | 7.4 (0.2) | 7.4 (0.2) | 15/15 |
| Δ fopt f6, 20-D |
1e1 1296 |
1e0 2343 |
1e-1 3413 |
1e-2 4255 |
1e-3 5220 |
1e-5 6728 |
1e-7 8409 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 6.3 (2) | 5.0 (2) | 5.2 (1) | 5.2 (2) | 5.9 (3) | 11 (7) | 22 (19) | 4/15 |
| CG-Fletcher-Reeves-scipy Baudis | 4.3 (1) | 4.2 (1) | 4.5 (1) | 4.9 (2) | 4.8 (2) | 5.7 (2) | 7.1 (6) | 13/15 |
| CMA-ES-python Baudis | 1.8 (0.3) | 1.5 (0.2) | 1.4 (0.2)★ | 1.4 (0.2)★2 | 1.4 (0.2)★2 | 1.4 (0.1)★4 | 1.4 (0.1)★4 | 15/15 |
| EG50-cocopf Baudis | 21 (17) | 25 (13) | 28 (18) | 26 (18) | 25 (16) | 25 (12) | 24 (10) | 15/15 |
| L-BFGS-B-scipy Baudis | 3.1 (1) | 3.1 (0.6) | 3.0 (0.4) | 3.1 (0.4) | 4.7 (2) | 840 (1040) | ∞2e6 | 0/15 |
| Nelder-Mead-scipy Baudis | 109 (64) | 560 (481) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Powell-scipy Baudis | 25 (19) | 23 (15) | 604 (558) | 6821 (8814) | ∞ | ∞ | ∞2e6 | 0/15 |
| SLSQP-scipy Baudis | 1.7 (0.7) | 2.1 (2) | 4.9 (4) | 30 (28) | 120 (112) | ∞ | ∞2e6 | 0/15 |
| UNIF-cocopf Baudis | 18 (11) | 19 (9) | 20 (8) | 23 (12) | 30 (12) | 42 (16) | 53 (20) | 15/15 |
| Δ fopt f7, 20-D |
1e1 1351 |
1e0 4274 |
1e-1 9503 |
1e-2 16523 |
1e-3 16524 |
1e-5 16524 |
1e-7 16969 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA-ES-python Baudis | 1.4 (1)★4 | 117 (128)★3 | 978 (966)★3 | ∞★3 | ∞★3 | ∞★3 | ∞2e6★3 | 0/15 |
| EG50-cocopf Baudis | 78 (64) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| L-BFGS-B-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Nelder-Mead-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Powell-scipy Baudis | 62 (26) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SLSQP-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| UNIF-cocopf Baudis | 153 (69) | 6696 (5269) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Δ fopt f8, 20-D |
1e1 2039 |
1e0 3871 |
1e-1 4040 |
1e-2 4148 |
1e-3 4219 |
1e-5 4371 |
1e-7 4484 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 1.2 (0.2) | 1.8 (1) | 1.8 (1) | 1.7 (1) | 1.7 (1) | 1.7 (1) | 1.6 (1) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 1.6 (0.5) | 27 (91) | 26 (88) | 26 (85) | 26 (84) | 25 (81) | 25 (79) | 15/15 |
| CMA-ES-python Baudis | 4.1 (0.7) | 4.5 (0.4) | 4.9 (0.5) | 5.0 (0.4) | 5.1 (0.4) | 5.1 (0.4) | 5.2 (0.4) | 15/15 |
| EG50-cocopf Baudis | 2.5 (2) | 3.5 (4) | 4.9 (5) | 6.5 (5) | 8.9 (5) | 10 (3) | 10 (3) | 15/15 |
| L-BFGS-B-scipy Baudis | 0.58 (0.2)↑0 | 4.9 (11) | 4.8 (11) | 4.7 (10) | 4.6 (10) | 4.5 (10) | 5.6 (9) | 13/15 |
| Nelder-Mead-scipy Baudis | 42 (41) | 172 (214) | 447 (703) | 823 (612) | 6842 (5689) | ∞ | ∞2e6 | 0/15 |
| Powell-scipy Baudis | 1.8 (1) | 4.1 (5) | 6.9 (6) | 58 (85) | 1058 (1368) | ∞ | ∞2e6 | 0/15 |
| SLSQP-scipy Baudis | 0.68 (0.3)↑1 | 22 (32) | 21 (30) | 20 (30) | 20 (29) | 19 (28) | 19 (27) | 15/15 |
| UNIF-cocopf Baudis | 4.4 (3) | 5.0 (4) | 6.2 (4) | 7.7 (3) | 9.2 (2) | 9.1 (2) | 11 (5) | 13/15 |
| Δ fopt f9, 20-D |
1e1 1716 |
1e0 3102 |
1e-1 3277 |
1e-2 3379 |
1e-3 3455 |
1e-5 3594 |
1e-7 3727 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 1.6 (0.6) | 2.0 (2) | 1.9 (2) | 1.9 (2) | 1.9 (2) | 1.8 (2) | 1.8 (2) | 15/15 |
| CG-Fletcher-Reeves-scipy Baudis | 2.0 (0.6) | 20 (56) | 20 (53) | 19 (51) | 19 (50) | 19 (48) | 19 (46) | 15/15 |
| CMA-ES-python Baudis | 5.3 (2) | 6.4 (1) | 6.8 (1) | 6.9 (1) | 6.9 (1) | 6.9 (1) | 6.9 (0.9) | 15/15 |
| EG50-cocopf Baudis | 5.3 (3) | 7.7 (4) | 8.9 (4) | 11 (5) | 12 (7) | 14 (7) | 15 (8) | 15/15 |
| L-BFGS-B-scipy Baudis | 0.85 (0.2) | 4.7 (14) | 4.5 (13) | 4.4 (13) | 4.3 (13) | 4.2 (12) | 4.1 (12) | 15/15 |
| Nelder-Mead-scipy Baudis | 245 (231) | 4478 (7357) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Powell-scipy Baudis | 5.8 (2) | 12 (3) | 14 (4) | 18 (8) | 52 (53) | ∞ | ∞2e6 | 0/15 |
| SLSQP-scipy Baudis | 1.0 (0.2) | 3.3 (2) | 3.2 (1) | 3.2 (1) | 3.1 (1) | 3.0 (1) | 3.2 (1) | 15/15 |
| UNIF-cocopf Baudis | 7.6 (2) | 8.8 (2) | 9.4 (2) | 10 (2) | 10 (2) | 10 (2) | 11 (3) | 14/15 |
| Δ fopt f10, 20-D |
1e1 7413 |
1e0 8661 |
1e-1 10735 |
1e-2 13641 |
1e-3 14920 |
1e-5 17073 |
1e-7 17476 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 0.21 (0.0)↑0 | 0.19 (0.0)↑0 | 0.17 (0.0)↑0 | 0.14 (0.0)↑0 | 0.13 (0.0)↑0 | 0.18 (0.1)↑0 | 25 (21) | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | 12 (6) | 26 (13) | 46 (20) | 72 (45) | 946 (1158) | ∞ | ∞2e6 | 0/15 |
| CMA-ES-python Baudis | 1.8 (0.2) | 2.0 (0.2) | 1.7 (0.2) | 1.4 (0.1) | 1.4 (0.0) | 1.2 (0.0) | 1.2 (0.0)★2 | 15/15 |
| EG50-cocopf Baudis | 10 (2) | 8.6 (1) | 7.0 (1) | 5.5 (0.9) | 5.0 (0.8) | 4.5 (0.7) | 61 (35) | 15/15 |
| L-BFGS-B-scipy Baudis | 2.7 (0.7) | 4.9 (2) | 9.1 (4) | 186 (169) | ∞ | ∞ | ∞2e6 | 0/15 |
| Nelder-Mead-scipy Baudis | 3831 (3372) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Powell-scipy Baudis | 122 (94) | 1680 (1597) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SLSQP-scipy Baudis | 0.16 (0.0)★↑0 | 0.15 (0.0)↑0 | 0.13 (0.0)↑0 | 0.11 (0.0)↑0 | 0.11 (0.0)↑0 | 0.12 (0.1)↑0 | ∞2e6 | 0/15 |
| UNIF-cocopf Baudis | 2.3 (0.3) | 2.2 (0.6) | 1.9 (0.5) | 1.6 (0.4) | 1.6 (0.4) | 1.6 (0.5) | 62 (28) | 15/15 |
| Δ fopt f11, 20-D |
1e1 1002 |
1e0 2228 |
1e-1 6278 |
1e-2 8586 |
1e-3 9762 |
1e-5 12285 |
1e-7 14831 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 0.28 (0.2)↑0 | 0.17 (0.1)↑0 | 0.07 (0.1)↑0 | 0.06 (0.0)↑0 | 0.07 (0.0)↑0 | 0.25 (0.3)↑0 | 13 (12) | 7/15 |
| CG-Fletcher-Reeves-scipy Baudis | 2.1 (2) | 1.6 (0.9) | 1.0 (0.7) | 0.96 (0.7) | 1.5 (2) | 26 (40) | ∞2e6 | 0/15 |
| CMA-ES-python Baudis | 10 (0.6) | 5.5 (0.3) | 2.1 (0.1) | 1.6 (0.1) | 1.5 (0.1) | 1.3 (0.0) | 1.1 (0.0)★2 | 15/15 |
| EG50-cocopf Baudis | 8.5 (7) | 4.1 (3) | 1.6 (1) | 1.2 (0.8) | 1.2 (0.9) | 1.8 (1) | 52 (35) | 15/15 |
| L-BFGS-B-scipy Baudis | 0.80 (0.3) | 0.56 (0.1)↑0 | 0.30 (0.1)↑0 | 0.33 (0.2)↑0 | 0.94 (0.7) | 248 (250) | ∞2e6 | 0/15 |
| Nelder-Mead-scipy Baudis | 75 (45) | 222 (181) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Powell-scipy Baudis | 579 (999) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SLSQP-scipy Baudis | 0.38 (0.5) | 0.26 (0.2)↑0 | 0.11 (0.1)↑0 | 0.09 (0.1)↑0 | 0.09 (0.1)↑0 | 0.14 (0.1)↑0 | 968 (910) | 0/15 |
| UNIF-cocopf Baudis | 3.9 (1) | 2.6 (1) | 1.1 (0.4) | 0.96 (0.3) | 0.98 (0.3) | 1.5 (0.6) | 54 (37) | 15/15 |
| Δ fopt f12, 20-D |
1e1 1042 |
1e0 1938 |
1e-1 2740 |
1e-2 3156 |
1e-3 4140 |
1e-5 12407 |
1e-7 13827 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA-ES-python Baudis | 2.4 (0.2) | 3.4 (2) | 3.8 (3) | 4.2 (2) | 4.0 (2) | 1.8 (0.6) | 1.9 (0.5)★2 | 15/15 |
| EG50-cocopf Baudis | 24 (45) | 24 (35) | 31 (32) | 41 (30) | 40 (27) | 27 (13) | ∞2e6 | 0/15 |
| L-BFGS-B-scipy Baudis | 1.1 (0.9) | 1.3 (0.5) | 1.3 (0.4) | 1.2 (0.4) | 1.0 (0.3) | 0.60 (0.3)↑1 | 64 (50) | 5/15 |
| Nelder-Mead-scipy Baudis | 555 (655) | 634 (752) | 879 (1670) | 2032 (3967) | 6889 (6763) | ∞ | ∞2e6 | 0/15 |
| Powell-scipy Baudis | 22 (40) | 18 (26) | 19 (20) | 19 (17) | 23 (25) | 96 (77) | ∞2e6 | 0/15 |
| SLSQP-scipy Baudis | 2.2 (2) | 1.6 (1) | 1.4 (1) | 1.3 (1) | 1.2 (0.9) | 0.81 (0.6) | 463 (447) | 0/15 |
| UNIF-cocopf Baudis | 68 (39) | 90 (83) | 126 (95) | 145 (99) | 168 (98) | 122 (97) | ∞2e6 | 0/15 |
| Δ fopt f13, 20-D |
1e1 652 |
1e0 2021 |
1e-1 2751 |
1e-2 3507 |
1e-3 18749 |
1e-5 24455 |
1e-7 30201 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 1.5 (0.1) | 0.67 (0.0)↑0 | 0.62 (0.0)↑0 | 0.59 (0.0)↑0 | 103 (160) | 1145 (1411) | ∞2e6 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | 5.5 (7) | 6.5 (8) | 6.8 (8) | 8.5 (7) | 3.2 (3) | 46 (51) | ∞2e6 | 0/15 |
| CMA-ES-python Baudis | 6.2 (6) | 5.2 (4) | 7.5 (11) | 7.4 (9) | 2.0 (2) | 4.8 (4)★2 | 11 (10)★4 | 14/15 |
| EG50-cocopf Baudis | 12 (16) | 9.4 (9) | 10 (6) | 10 (6) | 13 (19) | 106 (119) | 965 (877) | 0/15 |
| L-BFGS-B-scipy Baudis | 6.9 (10) | 7.7 (8) | 13 (15) | 25 (11) | 6.9 (5) | 122 (94) | ∞2e6 | 0/15 |
| Nelder-Mead-scipy Baudis | 137 (124) | 240 (522) | 807 (997) | 3994 (4562) | ∞ | ∞ | ∞2e6 | 0/15 |
| Powell-scipy Baudis | 24 (27) | 23 (20) | 24 (16) | 147 (289) | 706 (1223) | ∞ | ∞2e6 | 0/15 |
| SLSQP-scipy Baudis | 1.2 (0.1) | 0.56 (0.0)↑0 | 0.55 (0.0)★↑0 | 0.51 (0.0)★2↑0 | 34 (60) | ∞ | ∞2e6 | 0/15 |
| UNIF-cocopf Baudis | 6.0 (3) | 5.9 (4) | 7.4 (4) | 8.1 (2) | 11 (11) | 259 (354) | ∞2e6 | 0/15 |
| Δ fopt f14, 20-D |
1e1 75 |
1e0 239 |
1e-1 304 |
1e-2 451 |
1e-3 932 |
1e-5 1648 |
1e-7 15661 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 1.6 (0.3) | 0.91 (0.2) | 1.1 (0.3) | 1.2 (0.2) | 0.79 (0.1)↑0 | 0.73 (0.1)↑0 | ∞2e6 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | 1.7 (0.4) | 0.99 (0.2) | 1.2 (0.3) | 1.6 (0.3) | 2.3 (0.6) | 20 (13) | ∞2e6 | 0/15 |
| CMA-ES-python Baudis | 5.0 (1) | 3.3 (0.6) | 4.2 (0.4) | 5.0 (0.8) | 4.6 (0.6) | 7.0 (0.7) | 1.3 (0.1)★4 | 15/15 |
| EG50-cocopf Baudis | 7.2 (1) | 3.2 (0.7) | 3.4 (0.9) | 11 (13) | 11 (10) | 12 (10) | 33 (4) | 15/15 |
| L-BFGS-B-scipy Baudis | 1.8 (0.3) | 0.96 (0.2) | 1.1 (0.2) | 1.2 (0.2) | 0.97 (0.1) | 1463 (1632) | ∞2e6 | 0/15 |
| Nelder-Mead-scipy Baudis | 64 (40) | 62 (28) | 78 (29) | 115 (87) | 1068 (1201) | ∞ | ∞2e6 | 0/15 |
| Powell-scipy Baudis | 4.9 (1) | 2.7 (0.5) | 2.9 (0.5) | 42 (43) | ∞ | ∞ | ∞2e6 | 0/15 |
| SLSQP-scipy Baudis | 1.1 (0.2) | 0.69 (0.1)★↑0 | 0.85 (0.1)★↑1 | 0.91 (0.1)★3↑0 | 0.61 (0.1)★3↑0 | 0.70 (0.3) | ∞2e6 | 0/15 |
| UNIF-cocopf Baudis | 8.6 (2) | 4.5 (1) | 4.7 (1) | 10 (4) | 8.9 (1) | 8.0 (0.7) | 72 (6) | 15/15 |
| Δ fopt f15, 20-D |
1e1 30378 |
1e0 1.5e5 |
1e-1 3.1e5 |
1e-2 3.2e5 |
1e-3 3.2e5 |
1e-5 4.5e5 |
1e-7 4.6e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 206 (271) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA-ES-python Baudis | 108 (131) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| EG50-cocopf Baudis | 944 (1202) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| L-BFGS-B-scipy Baudis | 928 (1020) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Nelder-Mead-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Powell-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SLSQP-scipy Baudis | 218 (223) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| UNIF-cocopf Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Δ fopt f16, 20-D |
1e1 1384 |
1e0 27265 |
1e-1 77015 |
1e-2 1.4e5 |
1e-3 1.9e5 |
1e-5 2.0e5 |
1e-7 2.2e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA-ES-python Baudis | 1.7 (0.9)★4 | 1.1 (1)★4 | 48 (68)★2 | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| EG50-cocopf Baudis | 42 (39) | 77 (61) | 370 (513) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| L-BFGS-B-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Nelder-Mead-scipy Baudis | 170 (184) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Powell-scipy Baudis | 40 (49) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SLSQP-scipy Baudis | 4898 (4244) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| UNIF-cocopf Baudis | 41 (61) | 309 (477) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Δ fopt f17, 20-D |
1e1 63 |
1e0 1030 |
1e-1 4005 |
1e-2 12242 |
1e-3 30677 |
1e-5 56288 |
1e-7 80472 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 184 (195) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | 4150 (7383) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA-ES-python Baudis | 2.9 (2)★ | 1.3 (0.6)★4 | 1.6 (2)★3 | 4.7 (6)★ | 26 (27)★3 | ∞ | ∞2e6 | 0/15 |
| EG50-cocopf Baudis | 55 (84) | 23 (18) | 24 (38) | 38 (46) | 478 (668) | ∞ | ∞2e6 | 0/15 |
| L-BFGS-B-scipy Baudis | 301 (385) | 1.4e4 (1e4) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Nelder-Mead-scipy Baudis | 5741 (4836) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Powell-scipy Baudis | 821 (1244) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SLSQP-scipy Baudis | 111 (208) | 2.8e4 (2e4) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| UNIF-cocopf Baudis | 52 (41) | 71 (17) | 181 (254) | 290 (288) | ∞ | ∞ | ∞2e6 | 0/15 |
| Δ fopt f18, 20-D |
1e1 621 |
1e0 3972 |
1e-1 19561 |
1e-2 28555 |
1e-3 67569 |
1e-5 1.3e5 |
1e-7 1.5e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 1313 (1686) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA-ES-python Baudis | 1.3 (0.4)★4 | 1.0 (0.2)★3 | 7.8 (10)★ | 469 (1010)★3 | ∞ | ∞ | ∞2e6 | 0/15 |
| EG50-cocopf Baudis | 35 (21) | 25 (34) | 53 (66) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| L-BFGS-B-scipy Baudis | 759 (832) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Nelder-Mead-scipy Baudis | 4.6e4 (3e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Powell-scipy Baudis | 8397 (8343) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SLSQP-scipy Baudis | 336 (225) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| UNIF-cocopf Baudis | 63 (12) | 59 (91) | 323 (245) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Δ fopt f19, 20-D |
1e1 1 |
1e0 1 |
1e-1 3.4e5 |
1e-2 4.7e6 |
1e-3 6.2e6 |
1e-5 6.7e6 |
1e-7 6.7e6 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 7.1e4 (3e4) | 2.8e7 (3e7) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | 1.1e5 (1e5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA-ES-python Baudis | 294 (116)★4 | 7.7e4 (8e4)★3 | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| EG50-cocopf Baudis | 4.2e4 (3e4) | 1.1e6 (1e6) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| L-BFGS-B-scipy Baudis | 4.5e5 (5e5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Nelder-Mead-scipy Baudis | 4.3e5 (3e5) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Powell-scipy Baudis | 1.1e5 (8e4) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SLSQP-scipy Baudis | 3.5e4 (3e4) | 7.6e5 (6e5) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| UNIF-cocopf Baudis | 2.0e4 (1e4) | 3.4e6 (3e6) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Δ fopt f20, 20-D |
1e1 82 |
1e0 46150 |
1e-1 3.1e6 |
1e-2 5.5e6 |
1e-3 5.5e6 |
1e-5 5.6e6 |
1e-7 5.6e6 |
#succ 14/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 13 (4) | 14 (12) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | 1.9 (0.3) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA-ES-python Baudis | 6.3 (1) | 198 (209) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| EG50-cocopf Baudis | 10 (3) | 0.52 (0.4)↑1 | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| L-BFGS-B-scipy Baudis | 1.6 (0.4) | 30 (28) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Nelder-Mead-scipy Baudis | 103 (28) | 196 (324) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Powell-scipy Baudis | 10 (2) | 0.27 (0.4)↑0 | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SLSQP-scipy Baudis | 2.1 (0.9) | 308 (441) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| UNIF-cocopf Baudis | 15 (2) | 0.70 (1) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Δ fopt f21, 20-D |
1e1 561 |
1e0 6541 |
1e-1 14103 |
1e-2 14318 |
1e-3 14643 |
1e-5 15567 |
1e-7 17589 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 120 (158) | 116 (111) | 113 (88) | 111 (121) | 109 (108) | 102 (110) | 157 (159) | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | 100 (115) | 244 (301) | 227 (240) | 223 (305) | 218 (180) | 206 (221) | 1694 (1677) | 0/15 |
| CMA-ES-python Baudis | 10 (14) | 7.6 (9) | 6.9 (6) | 6.8 (6) | 6.6 (6) | 6.3 (5) | 5.6 (5)★2 | 15/15 |
| EG50-cocopf Baudis | 30 (88) | 86 (140) | 71 (87) | 70 (87) | 69 (77) | 100 (125) | 201 (205) | 4/15 |
| L-BFGS-B-scipy Baudis | 43 (76) | 129 (117) | 91 (101) | 89 (96) | 87 (135) | 82 (99) | 78 (81) | 2/15 |
| Nelder-Mead-scipy Baudis | 1004 (1302) | 1264 (1479) | 2037 (2907) | 2007 (1746) | 1963 (1776) | 1848 (1927) | 1637 (2018) | 1/15 |
| Powell-scipy Baudis | 168 (168) | 232 (185) | 187 (201) | 184 (204) | 180 (198) | 583 (536) | ∞2e6 | 0/15 |
| SLSQP-scipy Baudis | 65 (103) | 73 (90) | 74 (73) | 73 (78) | 72 (79) | 67 (72) | ∞2e6 | 0/15 |
| UNIF-cocopf Baudis | 8.0 (2) | 114 (161) | 83 (115) | 82 (96) | 80 (89) | 92 (134) | 524 (427) | 3/15 |
| Δ fopt f22, 20-D |
1e1 467 |
1e0 5580 |
1e-1 23491 |
1e-2 24163 |
1e-3 24948 |
1e-5 26847 |
1e-7 1.3e5 |
#succ 12/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 34 (72) | 109 (179) | 1261 (1341) | 1226 (869) | 1188 (1583) | 1104 (801) | ∞2e6 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | 181 (324) | 126 (184) | 367 (416) | 357 (431) | 345 (308) | 321 (347) | ∞2e6 | 0/15 |
| CMA-ES-python Baudis | 23 (43) | 37 (10) | 393 (621) | 382 (335) | 370 (545) | 344 (417) | 68 (56) | 3/15 |
| EG50-cocopf Baudis | 103 (5) | 63 (69) | 275 (209) | 389 (395) | 1189 (1042) | ∞ | ∞2e6 | 0/15 |
| L-BFGS-B-scipy Baudis | 19 (34) | 32 (48) | 192 (200) | 186 (351) | 181 (200) | 168 (126) | ∞2e6 | 0/15 |
| Nelder-Mead-scipy Baudis | 1542 (1557) | 1149 (1409) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Powell-scipy Baudis | 138 (125) | 121 (178) | 152 (228) | 149 (162) | 538 (657) | ∞ | ∞2e6 | 0/15 |
| SLSQP-scipy Baudis | 88 (82) | 51 (56) | 201 (226) | 196 (230) | 189 (335) | 177 (187) | ∞2e6 | 0/15 |
| UNIF-cocopf Baudis | 3.0 (4) | 43 (91) | 133 (176) | 152 (157) | 192 (160) | 492 (593) | ∞2e6 | 0/15 |
| Δ fopt f23, 20-D |
1e1 3.0 |
1e0 1614 |
1e-1 67457 |
1e-2 3.7e5 |
1e-3 4.9e5 |
1e-5 8.1e5 |
1e-7 8.4e5 |
#succ 15/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | 428 (37) | 8773 (8365) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | 166 (187) | 1.8e4 (3e4) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA-ES-python Baudis | 3.4 (4) | 24 (20) | 4.7 (5)★3 | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| EG50-cocopf Baudis | 3.5 (2) | 36 (33) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| L-BFGS-B-scipy Baudis | 44 (59) | 369 (427) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Nelder-Mead-scipy Baudis | 3.2 (2) | 3.9 (9) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Powell-scipy Baudis | 1.6 (1) | 109 (107) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SLSQP-scipy Baudis | 10 (11) | 2.4 (3) | 420 (726) | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| UNIF-cocopf Baudis | 3.2 (3) | 47 (72) | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Δ fopt f24, 20-D |
1e1 1.3e6 |
1e0 7.5e6 |
1e-1 5.2e7 |
1e-2 5.2e7 |
1e-3 5.2e7 |
1e-5 5.2e7 |
1e-7 5.2e7 |
#succ 3/15 |
|---|---|---|---|---|---|---|---|---|
| BFGS-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CG-Fletcher-Reeves-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| CMA-ES-python Baudis | 22 (22) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| EG50-cocopf Baudis | 22 (24) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| L-BFGS-B-scipy Baudis | 21 (30) | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Nelder-Mead-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| Powell-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| SLSQP-scipy Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
| UNIF-cocopf Baudis | ∞ | ∞ | ∞ | ∞ | ∞ | ∞ | ∞2e6 | 0/15 |
Previous dimension | Dimension = 40 | First dimension
Expected runtime (ERT in number of f-evaluations) divided by the respective best ERT measured during BBOB-2009 (when finite) in different dimensions. This ERT ratio and, in braces as dispersion measure, the half difference between 10 and 90%-tile of (bootstrapped) run lengths appear for each algorithm and target, the corresponding reference ERT in the first row. The different target ∆f-values are shown in the top row. #succ is the number of trials that reached the (final) target fopt+ 10−8. The median number of conducted function evaluations is additionally given in italics, if the target in the last column was never reached. The best entry is marked by a star when the largest p-value of pairwise rank-sum tests with the other algorithms either obeys 0.01 < p ≤ 0.05 or 10−k−1 < p ≤ 10−k when the star is followed by the number k, with Bonferroni correction by the number of functions (24). A ↑ signifies the number of trials that were worse than the ERT of the best algorithm from BBOB 2009 shown only when less than 10 percent were worse and the ERT was better. Best results are printed in bold.