pptables

Table showing the ERT in number of evaluations divided by the best ERT of the reference algorithm

Last dimension | Dimension = 2 | Next dimension

Δ f_opt f1, 2-D	1e1 2.0	1e0 6.0	1e-1 6.0	1e-2 6.0	1e-3 6.0	1e-5 6.0	1e-7 6.0	#succ 15/15
CMA-ES-pycma Gharafi	1.6 (1)	2.4 (2)	7.1 (2)	11 (4)	15 (4)	24 (5)	33 (6)	15/15
NELDERDOERR doerr	0.93 (0.8)	1.4 (0.8)	2.7 (0.6)	4.1 (0.7)	5.3 (0.4)	7.6 (0.8)	10 (0.8)	15/15
SLSQP-11-scipy Hansen	2.1 (2)	1.1 (0)	1.2 (0)^★2	1.2 (0)^★4	1.2 (0)^★4	1.2 (0)^★4	1.2 (0)^★4	15/15

Δ f_opt
f2, 2-D 1e1
16 1e0
19 1e-1
25 1e-2
25 1e-3
26 1e-5
28 1e-7
29 #succ
15/15

CMA-ES-pycma Gharafi 8.3 (5) 11 (3) 9.4 (3) 11 (3) 12 (2) 13 (2) 14 (1) 15/15
NELDERDOERR doerr 1.7 (0.4) 1.9 (0.2) 1.7 (0.1) 2.0 (0.1) 2.1 (0.2) 2.5 (0.2) 3.0 (0.2) 15/15
SLSQP-11-scipy Hansen 1.4 (0.5) 1.4 (0.5)^★ 1.2 (0.4)^★2 1.4 (0.5)^★2 1.5 (0.5)^★3 1.6 (0.4)^★4 1.8 (0.7)^★4 15/15

Δ f_opt f2, 2-D	1e1 16	1e0 19	1e-1 25	1e-2 25	1e-3 26	1e-5 28	1e-7 29	#succ 15/15
CMA-ES-pycma Gharafi	8.3 (5)	11 (3)	9.4 (3)	11 (3)	12 (2)	13 (2)	14 (1)	15/15
NELDERDOERR doerr	1.7 (0.4)	1.9 (0.2)	1.7 (0.1)	2.0 (0.1)	2.1 (0.2)	2.5 (0.2)	3.0 (0.2)	15/15
SLSQP-11-scipy Hansen	1.4 (0.5)	1.4 (0.5)^★	1.2 (0.4)^★2	1.4 (0.5)^★2	1.5 (0.5)^★3	1.6 (0.4)^★4	1.8 (0.7)^★4	15/15

Δ f_opt
f3, 2-D 1e1
15 1e0
271 1e-1
445 1e-2
446 1e-3
450 1e-5
454 1e-7
464 #succ
15/15

CMA-ES-pycma Gharafi 3.0 (3) 1.8 (1) 4.7 (7) 5.9 (7) 7.0 (8) 7.3 (9) 7.5 (9) 15/15
NELDERDOERR doerr 0.98 (0.5) 1.00 (1) 1.7 (2) 1.8 (2) 1.8 (2) 1.8 (2) 1.8 (2) 15/15
SLSQP-11-scipy Hansen 3.9 (7) 2.6 (2) 10 (8) 10 (8) 10 (7) 10 (7) 10 (7) 15/15

Δ f_opt f3, 2-D	1e1 15	1e0 271	1e-1 445	1e-2 446	1e-3 450	1e-5 454	1e-7 464	#succ 15/15
CMA-ES-pycma Gharafi	3.0 (3)	1.8 (1)	4.7 (7)	5.9 (7)	7.0 (8)	7.3 (9)	7.5 (9)	15/15
NELDERDOERR doerr	0.98 (0.5)	1.00 (1)	1.7 (2)	1.8 (2)	1.8 (2)	1.8 (2)	1.8 (2)	15/15
SLSQP-11-scipy Hansen	3.9 (7)	2.6 (2)	10 (8)	10 (8)	10 (7)	10 (7)	10 (7)	15/15

Δ f_opt
f4, 2-D 1e1
22 1e0
344 1e-1
459 1e-2
496 1e-3
523 1e-5
544 1e-7
566 #succ
15/15

CMA-ES-pycma Gharafi 1.7 (1) 10 (15) 66 (92) 112 (120) 126 (126) 140 (137) 140 (133) 15/15
NELDERDOERR doerr 1.9 (2) 1.4 (2) 3.5 (3) 3.2 (3) 3.1 (3) 3.0 (2) 3.0 (2) 15/15
SLSQP-11-scipy Hansen 4.4 (7) 3.1 (3) 10 (8) 9.4 (7) 9.0 (7) 8.6 (7) 8.3 (6) 15/15

Δ f_opt f4, 2-D	1e1 22	1e0 344	1e-1 459	1e-2 496	1e-3 523	1e-5 544	1e-7 566	#succ 15/15
CMA-ES-pycma Gharafi	1.7 (1)	10 (15)	66 (92)	112 (120)	126 (126)	140 (137)	140 (133)	15/15
NELDERDOERR doerr	1.9 (2)	1.4 (2)	3.5 (3)	3.2 (3)	3.1 (3)	3.0 (2)	3.0 (2)	15/15
SLSQP-11-scipy Hansen	4.4 (7)	3.1 (3)	10 (8)	9.4 (7)	9.0 (7)	8.6 (7)	8.3 (6)	15/15

Δ f_opt
f5, 2-D 1e1
4.0 1e0
4.0 1e-1
4.0 1e-2
4.0 1e-3
4.0 1e-5
4.0 1e-7
4.0 #succ
15/15

CMA-ES-pycma Gharafi 4.3 (2) 7.2 (4) 7.5 (4) 7.5 (4) 7.5 (4) 7.5 (4) 7.5 (4) 15/15
NELDERDOERR doerr 1.1 (0.4)^★ 2.1 (0.9)^★3 2.1 (0.9)^★3 2.1 (0.9)^★3 2.1 (0.9)^★3 2.1 (0.9)^★3 2.1 (0.9)^★3 15/15
SLSQP-11-scipy Hansen 1.5 (0) 3.5 (0) 3.5 (0) 3.5 (0) 3.5 (0) 3.5 (0) 3.5 (0) 15/15

Δ f_opt f5, 2-D	1e1 4.0	1e0 4.0	1e-1 4.0	1e-2 4.0	1e-3 4.0	1e-5 4.0	1e-7 4.0	#succ 15/15
CMA-ES-pycma Gharafi	4.3 (2)	7.2 (4)	7.5 (4)	7.5 (4)	7.5 (4)	7.5 (4)	7.5 (4)	15/15
NELDERDOERR doerr	1.1 (0.4)^★	2.1 (0.9)^★3	2.1 (0.9)^★3	2.1 (0.9)^★3	2.1 (0.9)^★3	2.1 (0.9)^★3	2.1 (0.9)^★3	15/15
SLSQP-11-scipy Hansen	1.5 (0)	3.5 (0)	3.5 (0)	3.5 (0)	3.5 (0)	3.5 (0)	3.5 (0)	15/15

Δ f_opt
f6, 2-D 1e1
13 1e0
23 1e-1
41 1e-2
54 1e-3
67 1e-5
95 1e-7
124 #succ
15/15

CMA-ES-pycma Gharafi 2.2 (2) 3.5 (1) 2.9 (1) 3.5 (0.6) 3.7 (0.6) 3.8 (0.4) 3.8 (0.4) 15/15
NELDERDOERR doerr 1.2 (0.8) 1.3 (0.3) 1 (0.2) 1.00 (0.1) 1 (0.1) 1.00 (0.1) 1.0 (0.1) 15/15
SLSQP-11-scipy Hansen 5.2 (5) 4.1 (3) 2.6 (2) 2.2 (1) 2.1 (2) 1.8 (1) 2.0 (1) 15/15

Δ f_opt f6, 2-D	1e1 13	1e0 23	1e-1 41	1e-2 54	1e-3 67	1e-5 95	1e-7 124	#succ 15/15
CMA-ES-pycma Gharafi	2.2 (2)	3.5 (1)	2.9 (1)	3.5 (0.6)	3.7 (0.6)	3.8 (0.4)	3.8 (0.4)	15/15
NELDERDOERR doerr	1.2 (0.8)	1.3 (0.3)	1 (0.2)	1.00 (0.1)	1 (0.1)	1.00 (0.1)	1.0 (0.1)	15/15
SLSQP-11-scipy Hansen	5.2 (5)	4.1 (3)	2.6 (2)	2.2 (1)	2.1 (2)	1.8 (1)	2.0 (1)	15/15

Δ f_opt
f7, 2-D 1e1
3.0 1e0
21 1e-1
60 1e-2
193 1e-3
217 1e-5
217 1e-7
241 #succ
15/15

CMA-ES-pycma Gharafi 1.7 (2) 2.0 (2) 3.3 (2) 1.3 (0.8) 1.3 (0.7) 1.3 (0.7) 1.3 (0.7) 15/15
NELDERDOERR doerr 2.8 (2) 1.0 (0.5) 8.6 (12) 5.4 (7) 5.2 (9) 5.2 (9) 5.4 (8) 15/15
SLSQP-11-scipy Hansen 17 (32) 24 (26) 89 (110) 241 (209) 571 (715) 571 (660) 514 (412) 4/15

Δ f_opt f7, 2-D	1e1 3.0	1e0 21	1e-1 60	1e-2 193	1e-3 217	1e-5 217	1e-7 241	#succ 15/15
CMA-ES-pycma Gharafi	1.7 (2)	2.0 (2)	3.3 (2)	1.3 (0.8)	1.3 (0.7)	1.3 (0.7)	1.3 (0.7)	15/15
NELDERDOERR doerr	2.8 (2)	1.0 (0.5)	8.6 (12)	5.4 (7)	5.2 (9)	5.2 (9)	5.4 (8)	15/15
SLSQP-11-scipy Hansen	17 (32)	24 (26)	89 (110)	241 (209)	571 (715)	571 (660)	514 (412)	4/15

Δ f_opt
f8, 2-D 1e1
5.0 1e0
12 1e-1
37 1e-2
46 1e-3
86 1e-5
94 1e-7
112 #succ
15/15

CMA-ES-pycma Gharafi 3.5 (4) 8.9 (16) 7.0 (8) 7.1 (7) 4.5 (3) 4.8 (3) 4.5 (3) 15/15
NELDERDOERR doerr 4.9 (4) 6.2 (4) 2.9 (1) 2.8 (1) 1.6 (0.7) 1.6 (0.5) 1.5 (0.5) 15/15
SLSQP-11-scipy Hansen 3.2 (3) 3.2 (4) 2.0 (2) 2.1 (1) 1.2 (0.8) 1.2 (0.7) 1.1 (0.6) 15/15

Δ f_opt f8, 2-D	1e1 5.0	1e0 12	1e-1 37	1e-2 46	1e-3 86	1e-5 94	1e-7 112	#succ 15/15
CMA-ES-pycma Gharafi	3.5 (4)	8.9 (16)	7.0 (8)	7.1 (7)	4.5 (3)	4.8 (3)	4.5 (3)	15/15
NELDERDOERR doerr	4.9 (4)	6.2 (4)	2.9 (1)	2.8 (1)	1.6 (0.7)	1.6 (0.5)	1.5 (0.5)	15/15
SLSQP-11-scipy Hansen	3.2 (3)	3.2 (4)	2.0 (2)	2.1 (1)	1.2 (0.8)	1.2 (0.7)	1.1 (0.6)	15/15

Δ f_opt
f9, 2-D 1e1
1 1e0
18 1e-1
30 1e-2
44 1e-3
68 1e-5
81 1e-7
92 #succ
15/15

CMA-ES-pycma Gharafi 1 (0) 2.7 (2) 5.5 (4) 5.3 (3) 4.0 (2) 4.1 (2) 4.2 (2) 15/15
NELDERDOERR doerr 11 (6) 2.2 (2) 2.6 (1) 2.1 (0.9) 1.5 (0.6) 1.4 (0.5) 1.4 (0.4) 15/15
SLSQP-11-scipy Hansen 1 (0) 0.50 (0)^★2_↑0 0.63 (0)^★4_↑0 0.98 (0)^★2_↑0 0.78 (0)^★2_↑0 0.80 (0)^★2_↑0 0.75 (0)^★4_↑0 15/15

Δ f_opt f9, 2-D	1e1 1	1e0 18	1e-1 30	1e-2 44	1e-3 68	1e-5 81	1e-7 92	#succ 15/15
CMA-ES-pycma Gharafi	1 (0)	2.7 (2)	5.5 (4)	5.3 (3)	4.0 (2)	4.1 (2)	4.2 (2)	15/15
NELDERDOERR doerr	11 (6)	2.2 (2)	2.6 (1)	2.1 (0.9)	1.5 (0.6)	1.4 (0.5)	1.4 (0.4)	15/15
SLSQP-11-scipy Hansen	1 (0)	0.50 (0)^★2_↑0	0.63 (0)^★4_↑0	0.98 (0)^★2_↑0	0.78 (0)^★2_↑0	0.80 (0)^★2_↑0	0.75 (0)^★4_↑0	15/15

Δ f_opt
f10, 2-D 1e1
30 1e0
46 1e-1
54 1e-2
61 1e-3
68 1e-5
82 1e-7
98 #succ
15/15

CMA-ES-pycma Gharafi 5.1 (3) 4.8 (1) 5.0 (0.9) 5.0 (0.8) 4.8 (0.8) 4.7 (0.7) 4.5 (0.6) 15/15
NELDERDOERR doerr 1.2 (0.4) 0.99 (0.2) 1.00 (0.2) 1.00 (0.2) 1.0 (0.2) 1.00 (0.1) 1.00 (0.1) 15/15
SLSQP-11-scipy Hansen 0.82 (0.3)^★2 0.65 (0.2)^★3_↑1 0.61 (0.2)^★3_↑0 0.59 (0.2)^★3_↑0 0.57 (0.2)^★3_↑0 38 (3) 166 (322) 8/15

Δ f_opt f10, 2-D	1e1 30	1e0 46	1e-1 54	1e-2 61	1e-3 68	1e-5 82	1e-7 98	#succ 15/15
CMA-ES-pycma Gharafi	5.1 (3)	4.8 (1)	5.0 (0.9)	5.0 (0.8)	4.8 (0.8)	4.7 (0.7)	4.5 (0.6)	15/15
NELDERDOERR doerr	1.2 (0.4)	0.99 (0.2)	1.00 (0.2)	1.00 (0.2)	1.0 (0.2)	1.00 (0.1)	1.00 (0.1)	15/15
SLSQP-11-scipy Hansen	0.82 (0.3)^★2	0.65 (0.2)^★3_↑1	0.61 (0.2)^★3_↑0	0.59 (0.2)^★3_↑0	0.57 (0.2)^★3_↑0	38 (3)	166 (322)	8/15

Δ f_opt
f11, 2-D 1e1
35 1e0
45 1e-1
50 1e-2
62 1e-3
67 1e-5
81 1e-7
97 #succ
15/15

CMA-ES-pycma Gharafi 3.3 (3) 4.6 (2) 4.9 (1) 4.7 (0.9) 4.8 (0.9) 4.6 (0.6) 4.5 (0.4) 15/15
NELDERDOERR doerr 1.0 (0.3) 1 (0.4) 1.0 (0.3) 0.99 (0.3) 1.0 (0.2) 1.0 (0.2) 1.0 (0.2) 15/15
SLSQP-11-scipy Hansen 0.67 (0.3)^★2 0.61 (0.3)^★2_↑1 0.63 (0.2)^★3_↑0 0.59 (0.2)^★3_↑0 0.63 (0.2)^★3_↑0 83 (237) 288 (433) 8/15

Δ f_opt f11, 2-D	1e1 35	1e0 45	1e-1 50	1e-2 62	1e-3 67	1e-5 81	1e-7 97	#succ 15/15
CMA-ES-pycma Gharafi	3.3 (3)	4.6 (2)	4.9 (1)	4.7 (0.9)	4.8 (0.9)	4.6 (0.6)	4.5 (0.4)	15/15
NELDERDOERR doerr	1.0 (0.3)	1 (0.4)	1.0 (0.3)	0.99 (0.3)	1.0 (0.2)	1.0 (0.2)	1.0 (0.2)	15/15
SLSQP-11-scipy Hansen	0.67 (0.3)^★2	0.61 (0.3)^★2_↑1	0.63 (0.2)^★3_↑0	0.59 (0.2)^★3_↑0	0.63 (0.2)^★3_↑0	83 (237)	288 (433)	8/15

Δ f_opt
f12, 2-D 1e1
35 1e0
46 1e-1
75 1e-2
94 1e-3
105 1e-5
153 1e-7
195 #succ
15/15

CMA-ES-pycma Gharafi 3.8 (2) 5.6 (4) 6.4 (10) 7.0 (10) 7.0 (9) 6.2 (8) 6.0 (8) 15/15
NELDERDOERR doerr 1.1 (0.5) 1.6 (2) 1.6 (2) 1.7 (2) 1.7 (1) 1.4 (1) 1.3 (1.0) 15/15
SLSQP-11-scipy Hansen 1.1 (0.8) 1.0 (0.6) 0.64 (0.3)_↑0 0.52 (0.3)_↑0 0.48 (0.2)^★2_↑0 0.37 (0.2)^★2_↑0 1.5 (3) 15/15

Δ f_opt f12, 2-D	1e1 35	1e0 46	1e-1 75	1e-2 94	1e-3 105	1e-5 153	1e-7 195	#succ 15/15
CMA-ES-pycma Gharafi	3.8 (2)	5.6 (4)	6.4 (10)	7.0 (10)	7.0 (9)	6.2 (8)	6.0 (8)	15/15
NELDERDOERR doerr	1.1 (0.5)	1.6 (2)	1.6 (2)	1.7 (2)	1.7 (1)	1.4 (1)	1.3 (1.0)	15/15
SLSQP-11-scipy Hansen	1.1 (0.8)	1.0 (0.6)	0.64 (0.3)_↑0	0.52 (0.3)_↑0	0.48 (0.2)^★2_↑0	0.37 (0.2)^★2_↑0	1.5 (3)	15/15

Δ f_opt
f13, 2-D 1e1
23 1e0
35 1e-1
46 1e-2
60 1e-3
71 1e-5
95 1e-7
122 #succ
15/15

CMA-ES-pycma Gharafi 2.9 (2) 3.5 (2) 4.2 (1) 4.0 (1) 4.3 (0.8) 4.4 (0.7) 4.5 (0.5) 15/15
NELDERDOERR doerr 1.1 (0.8) 1.1 (0.5) 1.1 (0.3) 1.0 (0.3) 1.0 (0.2) 1.1 (0.2) 1.0 (0.2) 15/15
SLSQP-11-scipy Hansen 0.90 (0.3) 0.79 (0.2)_↑1 0.82 (0.2) 0.76 (0.1)^★2_↑1 0.75 (0.1)^★3_↑0 0.87 (0.6)^★ 56 (173) 9/15

Δ f_opt f13, 2-D	1e1 23	1e0 35	1e-1 46	1e-2 60	1e-3 71	1e-5 95	1e-7 122	#succ 15/15
CMA-ES-pycma Gharafi	2.9 (2)	3.5 (2)	4.2 (1)	4.0 (1)	4.3 (0.8)	4.4 (0.7)	4.5 (0.5)	15/15
NELDERDOERR doerr	1.1 (0.8)	1.1 (0.5)	1.1 (0.3)	1.0 (0.3)	1.0 (0.2)	1.1 (0.2)	1.0 (0.2)	15/15
SLSQP-11-scipy Hansen	0.90 (0.3)	0.79 (0.2)_↑1	0.82 (0.2)	0.76 (0.1)^★2_↑1	0.75 (0.1)^★3_↑0	0.87 (0.6)^★	56 (173)	9/15

Δ f_opt
f14, 2-D 1e1
1 1e0
7.0 1e-1
16 1e-2
24 1e-3
38 1e-5
67 1e-7
90 #succ
15/15

CMA-ES-pycma Gharafi 1.7 (2) 2.3 (2) 3.1 (1) 3.9 (2) 3.8 (1) 4.0 (0.9) 4.3 (0.8) 15/15
NELDERDOERR doerr 1.8 (2) 1.4 (0.7) 1.3 (0.5) 1.3 (0.2) 1.1 (0.1) 1.0 (0.1) 1.0 (0.1)^★2 15/15
SLSQP-11-scipy Hansen 3.8 (3) 1.6 (1) 1.3 (0.6) 1.4 (0.4) 1.1 (0.4) 0.97 (0.2) 3.5 (4) 14/15

Δ f_opt f14, 2-D	1e1 1	1e0 7.0	1e-1 16	1e-2 24	1e-3 38	1e-5 67	1e-7 90	#succ 15/15
CMA-ES-pycma Gharafi	1.7 (2)	2.3 (2)	3.1 (1)	3.9 (2)	3.8 (1)	4.0 (0.9)	4.3 (0.8)	15/15
NELDERDOERR doerr	1.8 (2)	1.4 (0.7)	1.3 (0.5)	1.3 (0.2)	1.1 (0.1)	1.0 (0.1)	1.0 (0.1)^★2	15/15
SLSQP-11-scipy Hansen	3.8 (3)	1.6 (1)	1.3 (0.6)	1.4 (0.4)	1.1 (0.4)	0.97 (0.2)	3.5 (4)	14/15

Δ f_opt
f15, 2-D 1e1
37 1e0
291 1e-1
1033 1e-2
1066 1e-3
1113 1e-5
1231 1e-7
1412 #succ
15/15

CMA-ES-pycma Gharafi 1.2 (1) 1.9 (2) 1.7 (2) 1.8 (2) 1.8 (2) 1.7 (2) 1.6 (1) 15/15
NELDERDOERR doerr 1.1 (2) 1.3 (1) 1.4 (1) 1.3 (1) 1.3 (1) 1.2 (1) 1.0 (1) 15/15
SLSQP-11-scipy Hansen 2.9 (4) 2.7 (3) 2.4 (2) 2.4 (2) 2.3 (2) 2.1 (2) 1.8 (1) 15/15

Δ f_opt f15, 2-D	1e1 37	1e0 291	1e-1 1033	1e-2 1066	1e-3 1113	1e-5 1231	1e-7 1412	#succ 15/15
CMA-ES-pycma Gharafi	1.2 (1)	1.9 (2)	1.7 (2)	1.8 (2)	1.8 (2)	1.7 (2)	1.6 (1)	15/15
NELDERDOERR doerr	1.1 (2)	1.3 (1)	1.4 (1)	1.3 (1)	1.3 (1)	1.2 (1)	1.0 (1)	15/15
SLSQP-11-scipy Hansen	2.9 (4)	2.7 (3)	2.4 (2)	2.4 (2)	2.3 (2)	2.1 (2)	1.8 (1)	15/15

Δ f_opt
f16, 2-D 1e1
9.0 1e0
50 1e-1
174 1e-2
326 1e-3
358 1e-5
409 1e-7
538 #succ
15/15

CMA-ES-pycma Gharafi 4.2 (5) 4.3 (8) 2.5 (3) 2.8 (4) 3.2 (4) 3.0 (4) 2.4 (3) 15/15
NELDERDOERR doerr 1.7 (1) 3.5 (5) 1.8 (2) 1.1 (1) 1.1 (1) 1.0 (0.9) 1.00 (0.7) 15/15
SLSQP-11-scipy Hansen 430 (1470) 513 (793) 457 (527) 599 (986) 1850 (2037) ∞ ∞4e4 0/15

Δ f_opt f16, 2-D	1e1 9.0	1e0 50	1e-1 174	1e-2 326	1e-3 358	1e-5 409	1e-7 538	#succ 15/15
CMA-ES-pycma Gharafi	4.2 (5)	4.3 (8)	2.5 (3)	2.8 (4)	3.2 (4)	3.0 (4)	2.4 (3)	15/15
NELDERDOERR doerr	1.7 (1)	3.5 (5)	1.8 (2)	1.1 (1)	1.1 (1)	1.0 (0.9)	1.00 (0.7)	15/15
SLSQP-11-scipy Hansen	430 (1470)	513 (793)	457 (527)	599 (986)	1850 (2037)	∞	∞4e4	0/15

Δ f_opt
f17, 2-D 1e1
3.0 1e0
61 1e-1
133 1e-2
275 1e-3
396 1e-5
1086 1e-7
1657 #succ
15/15

CMA-ES-pycma Gharafi 1.2 (1) 2.2 (0.5) 1.6 (0.3) 1.1 (0.3) 1.4 (1) 1.3 (0.9) 1.0 (0.7) 15/15
NELDERDOERR doerr 1.2 (0.8) 1.5 (2) 3.3 (5) 3.0 (4) 3.1 (3) 5.9 (6) 4.0 (4) 14/15
SLSQP-11-scipy Hansen 11 (16) 14 (12) 72 (61) 2121 (2793) ∞ ∞ ∞4e4 0/15

Δ f_opt f17, 2-D	1e1 3.0	1e0 61	1e-1 133	1e-2 275	1e-3 396	1e-5 1086	1e-7 1657	#succ 15/15
CMA-ES-pycma Gharafi	1.2 (1)	2.2 (0.5)	1.6 (0.3)	1.1 (0.3)	1.4 (1)	1.3 (0.9)	1.0 (0.7)	15/15
NELDERDOERR doerr	1.2 (0.8)	1.5 (2)	3.3 (5)	3.0 (4)	3.1 (3)	5.9 (6)	4.0 (4)	14/15
SLSQP-11-scipy Hansen	11 (16)	14 (12)	72 (61)	2121 (2793)	∞	∞	∞4e4	0/15

Δ f_opt
f18, 2-D 1e1
19 1e0
134 1e-1
666 1e-2
1249 1e-3
1708 1e-5
2438 1e-7
2858 #succ
15/15

CMA-ES-pycma Gharafi 1.3 (0.8) 3.1 (3) 1.1 (1) 0.74 (0.8) 0.65 (0.6)^★2 0.83 (0.5)^★3 0.81 (0.4)^★3 15/15
NELDERDOERR doerr 1.2 (0.4) 3.1 (4) 2.4 (3) 4.3 (8) 5.8 (6) 25 (25) 21 (25) 6/15
SLSQP-11-scipy Hansen 10 (12) 59 (80) 103 (144) 501 (639) 366 (360) ∞ ∞4e4 0/15

Δ f_opt f18, 2-D	1e1 19	1e0 134	1e-1 666	1e-2 1249	1e-3 1708	1e-5 2438	1e-7 2858	#succ 15/15
CMA-ES-pycma Gharafi	1.3 (0.8)	3.1 (3)	1.1 (1)	0.74 (0.8)	0.65 (0.6)^★2	0.83 (0.5)^★3	0.81 (0.4)^★3	15/15
NELDERDOERR doerr	1.2 (0.4)	3.1 (4)	2.4 (3)	4.3 (8)	5.8 (6)	25 (25)	21 (25)	6/15
SLSQP-11-scipy Hansen	10 (12)	59 (80)	103 (144)	501 (639)	366 (360)	∞	∞4e4	0/15

Δ f_opt
f19, 2-D 1e1
1 1e0
1 1e-1
26 1e-2
216 1e-3
227 1e-5
252 1e-7
276 #succ
15/15

CMA-ES-pycma Gharafi 1 (0) 1 (0) 2.4 (2) 7.3 (7) 10 (12) 9.2 (12) 8.9 (10) 15/15
NELDERDOERR doerr 4.6 (4) 52 (74) 11 (13) 8.1 (11) 7.8 (10) 7.1 (9) 6.5 (8) 15/15
SLSQP-11-scipy Hansen 1 (0) 1 (0) 0.54 (0)_↑0 ∞ ∞ ∞ ∞4e4 0/15

Δ f_opt f19, 2-D	1e1 1	1e0 1	1e-1 26	1e-2 216	1e-3 227	1e-5 252	1e-7 276	#succ 15/15
CMA-ES-pycma Gharafi	1 (0)	1 (0)	2.4 (2)	7.3 (7)	10 (12)	9.2 (12)	8.9 (10)	15/15
NELDERDOERR doerr	4.6 (4)	52 (74)	11 (13)	8.1 (11)	7.8 (10)	7.1 (9)	6.5 (8)	15/15
SLSQP-11-scipy Hansen	1 (0)	1 (0)	0.54 (0)_↑0	∞	∞	∞	∞4e4	0/15

Δ f_opt
f20, 2-D 1e1
4.0 1e0
61 1e-1
365 1e-2
366 1e-3
366 1e-5
370 1e-7
375 #succ
15/15

CMA-ES-pycma Gharafi 1.7 (2) 13 (14) 13 (12) 15 (15) 16 (16) 16 (17) 17 (17) 15/15
NELDERDOERR doerr 1.4 (1) 3.9 (4) 2.8 (3)^★2 2.8 (3)^★2 2.9 (3)^★2 2.9 (3)^★2 2.9 (3)^★2 15/15
SLSQP-11-scipy Hansen 2.5 (0) 4.7 (7) 21 (35) 21 (34) 21 (34) 21 (34) 21 (34) 15/15

Δ f_opt f20, 2-D	1e1 4.0	1e0 61	1e-1 365	1e-2 366	1e-3 366	1e-5 370	1e-7 375	#succ 15/15
CMA-ES-pycma Gharafi	1.7 (2)	13 (14)	13 (12)	15 (15)	16 (16)	16 (17)	17 (17)	15/15
NELDERDOERR doerr	1.4 (1)	3.9 (4)	2.8 (3)^★2	2.8 (3)^★2	2.9 (3)^★2	2.9 (3)^★2	2.9 (3)^★2	15/15
SLSQP-11-scipy Hansen	2.5 (0)	4.7 (7)	21 (35)	21 (34)	21 (34)	21 (34)	21 (34)	15/15

Δ f_opt
f21, 2-D 1e1
2.0 1e0
51 1e-1
174 1e-2
276 1e-3
290 1e-5
324 1e-7
330 #succ
15/15

CMA-ES-pycma Gharafi 0.80 (0.8) 3.8 (7) 2.5 (2) 5.2 (9) 7.0 (9) 6.9 (8) 7.4 (9) 15/15
NELDERDOERR doerr 1.2 (1) 2.6 (4) 2.6 (4) 1.7 (3) 1.6 (2) 1.5 (2) 1.5 (2) 15/15
SLSQP-11-scipy Hansen 2.5 (2) 3.2 (3) 1.3 (1) 0.88 (0.9) 0.86 (0.8) 0.83 (0.7) 0.89 (0.7) 15/15

Δ f_opt f21, 2-D	1e1 2.0	1e0 51	1e-1 174	1e-2 276	1e-3 290	1e-5 324	1e-7 330	#succ 15/15
CMA-ES-pycma Gharafi	0.80 (0.8)	3.8 (7)	2.5 (2)	5.2 (9)	7.0 (9)	6.9 (8)	7.4 (9)	15/15
NELDERDOERR doerr	1.2 (1)	2.6 (4)	2.6 (4)	1.7 (3)	1.6 (2)	1.5 (2)	1.5 (2)	15/15
SLSQP-11-scipy Hansen	2.5 (2)	3.2 (3)	1.3 (1)	0.88 (0.9)	0.86 (0.8)	0.83 (0.7)	0.89 (0.7)	15/15

Δ f_opt
f22, 2-D 1e1
5.0 1e0
27 1e-1
168 1e-2
218 1e-3
249 1e-5
289 1e-7
306 #succ
15/15

CMA-ES-pycma Gharafi 1.3 (1) 10 (11) 6.9 (4) 12 (19) 56 (18) 82 (269) 80 (267) 15/15
NELDERDOERR doerr 1.3 (0.9) 8.0 (14) 1.8 (2) 1.4 (2) 1.2 (2) 1.1 (1) 1.1 (1) 15/15
SLSQP-11-scipy Hansen 2.1 (2) 4.2 (7) 1.5 (1) 1.2 (1) 1.1 (1) 1.0 (0.9) 1.0 (0.9) 15/15

Δ f_opt f22, 2-D	1e1 5.0	1e0 27	1e-1 168	1e-2 218	1e-3 249	1e-5 289	1e-7 306	#succ 15/15
CMA-ES-pycma Gharafi	1.3 (1)	10 (11)	6.9 (4)	12 (19)	56 (18)	82 (269)	80 (267)	15/15
NELDERDOERR doerr	1.3 (0.9)	8.0 (14)	1.8 (2)	1.4 (2)	1.2 (2)	1.1 (1)	1.1 (1)	15/15
SLSQP-11-scipy Hansen	2.1 (2)	4.2 (7)	1.5 (1)	1.2 (1)	1.1 (1)	1.0 (0.9)	1.0 (0.9)	15/15

Δ f_opt
f23, 2-D 1e1
8.0 1e0
193 1e-1
234 1e-2
263 1e-3
299 1e-5
348 1e-7
379 #succ
15/15

CMA-ES-pycma Gharafi 2.3 (2) 5.4 (5) 13 (15) 12 (14) 11 (12) 10 (11) 9.3 (10) 15/15
NELDERDOERR doerr 4.6 (3) 1.00 (1) 1.00 (1)^★ 1.00 (1.0)^★2 1.0 (0.9)^★3 1.00 (0.8)^★3 1.0 (0.8)^★3 15/15
SLSQP-11-scipy Hansen 9.2 (13) 10 (13) 16 (22) 23 (33) 31 (46) 111 (106) ∞4e4 0/15

Δ f_opt f23, 2-D	1e1 8.0	1e0 193	1e-1 234	1e-2 263	1e-3 299	1e-5 348	1e-7 379	#succ 15/15
CMA-ES-pycma Gharafi	2.3 (2)	5.4 (5)	13 (15)	12 (14)	11 (12)	10 (11)	9.3 (10)	15/15
NELDERDOERR doerr	4.6 (3)	1.00 (1)	1.00 (1)^★	1.00 (1.0)^★2	1.0 (0.9)^★3	1.00 (0.8)^★3	1.0 (0.8)^★3	15/15
SLSQP-11-scipy Hansen	9.2 (13)	10 (13)	16 (22)	23 (33)	31 (46)	111 (106)	∞4e4	0/15

Δ f_opt
f24, 2-D 1e1
18 1e0
857 1e-1
8515 1e-2
23399 1e-3
24113 1e-5
24721 1e-7
24721 #succ
5/15

CMA-ES-pycma Gharafi 1.4 (0.8) 93 (151) 492 (427) 278 (374) 582 (394) 568 (993) 568 (709) 1/15
NELDERDOERR doerr 1.6 (1) 1.9 (3) 1.5 (1) 3.2 (4) 3.1 (2) 3.0 (3) 3.0 (3) 6/15
SLSQP-11-scipy Hansen 4.2 (4) 1.7 (2) 1.5 (1) 3.4 (4) 3.3 (3) 3.3 (4) 3.3 (3) 6/15

Δ f_opt f24, 2-D	1e1 18	1e0 857	1e-1 8515	1e-2 23399	1e-3 24113	1e-5 24721	1e-7 24721	#succ 5/15
CMA-ES-pycma Gharafi	1.4 (0.8)	93 (151)	492 (427)	278 (374)	582 (394)	568 (993)	568 (709)	1/15
NELDERDOERR doerr	1.6 (1)	1.9 (3)	1.5 (1)	3.2 (4)	3.1 (2)	3.0 (3)	3.0 (3)	6/15
SLSQP-11-scipy Hansen	4.2 (4)	1.7 (2)	1.5 (1)	3.4 (4)	3.3 (3)	3.3 (4)	3.3 (3)	6/15

Previous dimension | Dimension = 3 | Next dimension

Δ f_opt f1, 3-D	1e1 4.0	1e0 8.0	1e-1 8.0	1e-2 8.0	1e-3 8.0	1e-5 8.0	1e-7 8.0	#succ 15/15
CMA-ES-pycma Gharafi	1.4 (2)	3.9 (2)	8.6 (3)	14 (2)	20 (5)	30 (4)	43 (6)	15/15
NELDERDOERR doerr	1.8 (2)	2.4 (0.6)	3.9 (0.9)	5.4 (0.8)	6.9 (0.8)	10 (1)	14 (2)	15/15
SLSQP-11-scipy Hansen	1.6 (0.9)	1 (0)^★2	1 (0)^★4	1 (0)^★4	1 (0)^★4	1 (0)^★4	1 (0)^★4	15/15

Δ f_opt
f2, 3-D 1e1
38 1e0
42 1e-1
43 1e-2
44 1e-3
45 1e-5
47 1e-7
48 #succ
15/15

CMA-ES-pycma Gharafi 6.7 (3) 8.7 (2) 10 (1) 11 (1) 12 (1) 13 (1) 15 (1) 15/15
NELDERDOERR doerr 2.3 (1) 2.8 (2) 3.2 (1) 3.6 (1) 3.7 (1) 4.2 (1) 4.6 (1) 15/15
SLSQP-11-scipy Hansen 0.98 (0.2)^★3 1.1 (0.3)^★3 1.2 (0.3)^★3 1.3 (0.3)^★4 1.4 (0.4)^★4 1.6 (0.6)^★4 1.8 (0.6)^★4 15/15

Δ f_opt f2, 3-D	1e1 38	1e0 42	1e-1 43	1e-2 44	1e-3 45	1e-5 47	1e-7 48	#succ 15/15
CMA-ES-pycma Gharafi	6.7 (3)	8.7 (2)	10 (1)	11 (1)	12 (1)	13 (1)	15 (1)	15/15
NELDERDOERR doerr	2.3 (1)	2.8 (2)	3.2 (1)	3.6 (1)	3.7 (1)	4.2 (1)	4.6 (1)	15/15
SLSQP-11-scipy Hansen	0.98 (0.2)^★3	1.1 (0.3)^★3	1.2 (0.3)^★3	1.3 (0.3)^★4	1.4 (0.4)^★4	1.6 (0.6)^★4	1.8 (0.6)^★4	15/15

Δ f_opt
f3, 3-D 1e1
38 1e0
822 1e-1
830 1e-2
835 1e-3
842 1e-5
847 1e-7
853 #succ
15/15

CMA-ES-pycma Gharafi 2.3 (2) 2.0 (2) 11 (12) 12 (14) 12 (14) 13 (14) 13 (15) 15/15
NELDERDOERR doerr 3.0 (3) 1.5 (2) 8.4 (8) 8.3 (8) 8.3 (8) 8.3 (8) 8.3 (8) 15/15
SLSQP-11-scipy Hansen 15 (26) 6.8 (10) 47 (69) 47 (48) 47 (49) 46 (43) 46 (57) 12/15

Δ f_opt f3, 3-D	1e1 38	1e0 822	1e-1 830	1e-2 835	1e-3 842	1e-5 847	1e-7 853	#succ 15/15
CMA-ES-pycma Gharafi	2.3 (2)	2.0 (2)	11 (12)	12 (14)	12 (14)	13 (14)	13 (15)	15/15
NELDERDOERR doerr	3.0 (3)	1.5 (2)	8.4 (8)	8.3 (8)	8.3 (8)	8.3 (8)	8.3 (8)	15/15
SLSQP-11-scipy Hansen	15 (26)	6.8 (10)	47 (69)	47 (48)	47 (49)	46 (43)	46 (57)	12/15

Δ f_opt
f4, 3-D 1e1
40 1e0
808 1e-1
866 1e-2
921 1e-3
952 1e-5
1015 1e-7
1044 #succ
15/15

CMA-ES-pycma Gharafi 5.4 (2) 199 (224) 1.3e4 (1e4) 2.4e4 (3e4) 2.3e4 (2e4) 2.2e4 (2e4) 2.1e4 (3e4) 1/15
NELDERDOERR doerr 4.6 (5) 7.8 (8) 43 (57)^★2 40 (42)^★2 39 (37)^★2 37 (33)^★2 36 (50)^★2 12/15
SLSQP-11-scipy Hansen 21 (24) 39 (40) 328 (353) 309 (247) 299 (243) 280 (256) 272 (349) 3/15

Δ f_opt f4, 3-D	1e1 40	1e0 808	1e-1 866	1e-2 921	1e-3 952	1e-5 1015	1e-7 1044	#succ 15/15
CMA-ES-pycma Gharafi	5.4 (2)	199 (224)	1.3e4 (1e4)	2.4e4 (3e4)	2.3e4 (2e4)	2.2e4 (2e4)	2.1e4 (3e4)	1/15
NELDERDOERR doerr	4.6 (5)	7.8 (8)	43 (57)^★2	40 (42)^★2	39 (37)^★2	37 (33)^★2	36 (50)^★2	12/15
SLSQP-11-scipy Hansen	21 (24)	39 (40)	328 (353)	309 (247)	299 (243)	280 (256)	272 (349)	3/15

Δ f_opt
f5, 3-D 1e1
7.0 1e0
7.0 1e-1
7.0 1e-2
7.0 1e-3
7.0 1e-5
7.0 1e-7
7.0 #succ
15/15

CMA-ES-pycma Gharafi 3.8 (4) 6.2 (4) 6.5 (4) 6.5 (4) 6.5 (4) 6.5 (4) 6.5 (4) 15/15
NELDERDOERR doerr 1.3 (0.9) 2.3 (0.9) 2.3 (0.9) 2.3 (0.9) 2.3 (0.9) 2.3 (0.9) 2.3 (0.9) 15/15
SLSQP-11-scipy Hansen 1 (0) 3.1 (0) 3.1 (0) 3.1 (0) 3.1 (0) 3.1 (0) 3.1 (0) 15/15

Δ f_opt f5, 3-D	1e1 7.0	1e0 7.0	1e-1 7.0	1e-2 7.0	1e-3 7.0	1e-5 7.0	1e-7 7.0	#succ 15/15
CMA-ES-pycma Gharafi	3.8 (4)	6.2 (4)	6.5 (4)	6.5 (4)	6.5 (4)	6.5 (4)	6.5 (4)	15/15
NELDERDOERR doerr	1.3 (0.9)	2.3 (0.9)	2.3 (0.9)	2.3 (0.9)	2.3 (0.9)	2.3 (0.9)	2.3 (0.9)	15/15
SLSQP-11-scipy Hansen	1 (0)	3.1 (0)	3.1 (0)	3.1 (0)	3.1 (0)	3.1 (0)	3.1 (0)	15/15

Δ f_opt
f6, 3-D 1e1
34 1e0
56 1e-1
90 1e-2
117 1e-3
149 1e-5
215 1e-7
265 #succ
15/15

CMA-ES-pycma Gharafi 2.1 (2) 3.4 (1) 2.9 (0.8) 3.1 (0.5) 3.1 (0.6) 2.8 (0.4) 3.0 (0.3) 15/15
NELDERDOERR doerr 0.99 (0.6) 1 (0.4)^★3 1.0 (0.2)^★3 1.00 (0.2)^★2 1.0 (0.3)^★2 1.00 (0.3)^★3 1.00 (0.2)^★3 15/15
SLSQP-11-scipy Hansen 4.4 (3) 3.3 (2) 2.6 (2) 2.4 (1) 2.3 (1) 2.0 (0.9) 2.4 (0.7) 15/15

Δ f_opt f6, 3-D	1e1 34	1e0 56	1e-1 90	1e-2 117	1e-3 149	1e-5 215	1e-7 265	#succ 15/15
CMA-ES-pycma Gharafi	2.1 (2)	3.4 (1)	2.9 (0.8)	3.1 (0.5)	3.1 (0.6)	2.8 (0.4)	3.0 (0.3)	15/15
NELDERDOERR doerr	0.99 (0.6)	1 (0.4)^★3	1.0 (0.2)^★3	1.00 (0.2)^★2	1.0 (0.3)^★2	1.00 (0.3)^★3	1.00 (0.2)^★3	15/15
SLSQP-11-scipy Hansen	4.4 (3)	3.3 (2)	2.6 (2)	2.4 (1)	2.3 (1)	2.0 (0.9)	2.4 (0.7)	15/15

Δ f_opt
f7, 3-D 1e1
11 1e0
65 1e-1
342 1e-2
464 1e-3
482 1e-5
482 1e-7
535 #succ
15/15

CMA-ES-pycma Gharafi 2.4 (3) 1.8 (2) 0.66 (0.7) 0.69 (0.5) 0.79 (0.5)^★ 0.79 (0.5)^★ 0.74 (0.4)^★2 15/15
NELDERDOERR doerr 7.8 (2) 4.2 (9) 4.3 (7) 4.2 (5) 8.8 (6) 8.8 (6) 8.8 (4) 15/15
SLSQP-11-scipy Hansen 16 (18) 190 (306) 324 (374) 1846 (2384) 1777 (2578) 1777 (1824) 1601 (1700) 1/15

Δ f_opt f7, 3-D	1e1 11	1e0 65	1e-1 342	1e-2 464	1e-3 482	1e-5 482	1e-7 535	#succ 15/15
CMA-ES-pycma Gharafi	2.4 (3)	1.8 (2)	0.66 (0.7)	0.69 (0.5)	0.79 (0.5)^★	0.79 (0.5)^★	0.74 (0.4)^★2	15/15
NELDERDOERR doerr	7.8 (2)	4.2 (9)	4.3 (7)	4.2 (5)	8.8 (6)	8.8 (6)	8.8 (4)	15/15
SLSQP-11-scipy Hansen	16 (18)	190 (306)	324 (374)	1846 (2384)	1777 (2578)	1777 (1824)	1601 (1700)	1/15

Δ f_opt
f8, 3-D 1e1
27 1e0
45 1e-1
152 1e-2
179 1e-3
188 1e-5
198 1e-7
208 #succ
15/15

CMA-ES-pycma Gharafi 2.6 (2) 7.3 (6) 3.5 (2) 3.7 (2) 3.8 (2) 4.2 (2) 4.4 (2) 15/15
NELDERDOERR doerr 1.6 (0.9) 4.0 (3) 1.5 (1.0) 1.4 (0.8) 1.4 (0.8) 1.5 (0.7) 1.5 (0.6) 15/15
SLSQP-11-scipy Hansen 1.3 (0.4) 2.2 (2) 0.95 (0.6) 0.94 (0.6) 0.96 (0.5) 0.96 (0.5) 0.95 (0.5) 15/15

Δ f_opt f8, 3-D	1e1 27	1e0 45	1e-1 152	1e-2 179	1e-3 188	1e-5 198	1e-7 208	#succ 15/15
CMA-ES-pycma Gharafi	2.6 (2)	7.3 (6)	3.5 (2)	3.7 (2)	3.8 (2)	4.2 (2)	4.4 (2)	15/15
NELDERDOERR doerr	1.6 (0.9)	4.0 (3)	1.5 (1.0)	1.4 (0.8)	1.4 (0.8)	1.5 (0.7)	1.5 (0.6)	15/15
SLSQP-11-scipy Hansen	1.3 (0.4)	2.2 (2)	0.95 (0.6)	0.94 (0.6)	0.96 (0.5)	0.96 (0.5)	0.95 (0.5)	15/15

Δ f_opt
f9, 3-D 1e1
21 1e0
65 1e-1
127 1e-2
149 1e-3
159 1e-5
169 1e-7
178 #succ
15/15

CMA-ES-pycma Gharafi 1.9 (0.6) 2.9 (2) 3.2 (1) 3.6 (2) 3.8 (1) 4.2 (1) 4.5 (0.9) 15/15
NELDERDOERR doerr 1.5 (0.9) 1.4 (0.9) 1.1 (0.5) 1.1 (0.5) 1.1 (0.5) 1.2 (0.4) 1.3 (0.4) 15/15
SLSQP-11-scipy Hansen 0.48 (0)^★2_↑0 0.15 (0)^★4_↑0 0.44 (0)^★2_↑0 0.48 (0)^★3_↑0 0.55 (0)^★2_↑0 0.57 (0)^★4_↑0 0.57 (0)^★4_↑0 15/15

Δ f_opt f9, 3-D	1e1 21	1e0 65	1e-1 127	1e-2 149	1e-3 159	1e-5 169	1e-7 178	#succ 15/15
CMA-ES-pycma Gharafi	1.9 (0.6)	2.9 (2)	3.2 (1)	3.6 (2)	3.8 (1)	4.2 (1)	4.5 (0.9)	15/15
NELDERDOERR doerr	1.5 (0.9)	1.4 (0.9)	1.1 (0.5)	1.1 (0.5)	1.1 (0.5)	1.2 (0.4)	1.3 (0.4)	15/15
SLSQP-11-scipy Hansen	0.48 (0)^★2_↑0	0.15 (0)^★4_↑0	0.44 (0)^★2_↑0	0.48 (0)^★3_↑0	0.55 (0)^★2_↑0	0.57 (0)^★4_↑0	0.57 (0)^★4_↑0	15/15

Δ f_opt
f10, 3-D 1e1
114 1e0
152 1e-1
168 1e-2
180 1e-3
194 1e-5
218 1e-7
242 #succ
15/15

CMA-ES-pycma Gharafi 2.4 (1) 2.3 (1) 2.4 (1) 2.6 (0.7) 2.6 (0.6) 2.7 (0.6) 2.8 (0.5) 15/15
NELDERDOERR doerr 1.1 (0.8) 1.1 (0.5) 1.1 (0.4) 1.1 (0.4) 1.1 (0.4) 1.0 (0.3) 1.0 (0.3) 15/15
SLSQP-11-scipy Hansen 0.33 (0.1)^★4_↑0 0.29 (0.1)^★4_↑0 0.30 (0.1)^★4_↑0 0.31 (0.1)^★4_↑0 0.32 (0.1)^★4_↑0 0.41 (0.2)^★3_↑1 108 (187) 9/15

Δ f_opt f10, 3-D	1e1 114	1e0 152	1e-1 168	1e-2 180	1e-3 194	1e-5 218	1e-7 242	#succ 15/15
CMA-ES-pycma Gharafi	2.4 (1)	2.3 (1)	2.4 (1)	2.6 (0.7)	2.6 (0.6)	2.7 (0.6)	2.8 (0.5)	15/15
NELDERDOERR doerr	1.1 (0.8)	1.1 (0.5)	1.1 (0.4)	1.1 (0.4)	1.1 (0.4)	1.0 (0.3)	1.0 (0.3)	15/15
SLSQP-11-scipy Hansen	0.33 (0.1)^★4_↑0	0.29 (0.1)^★4_↑0	0.30 (0.1)^★4_↑0	0.31 (0.1)^★4_↑0	0.32 (0.1)^★4_↑0	0.41 (0.2)^★3_↑1	108 (187)	9/15

Δ f_opt
f11, 3-D 1e1
67 1e0
105 1e-1
227 1e-2
263 1e-3
277 1e-5
302 1e-7
327 #succ
15/15

CMA-ES-pycma Gharafi 3.2 (2) 3.1 (0.8) 1.7 (0.3) 1.6 (0.3) 1.7 (0.3) 1.9 (0.2) 2.0 (0.2) 15/15
NELDERDOERR doerr 2.3 (2) 2.0 (0.7) 1.1 (0.3) 1 (0.2) 1.0 (0.2) 1 (0.2) 1.0 (0.2) 15/15
SLSQP-11-scipy Hansen 0.44 (0.2)^★3_↑0 0.34 (0.1)^★4_↑0 0.19 (0.1)^★4_↑0 0.19 (0.1)^★4_↑0 0.21 (0.1)^★4_↑0 33 (74) 169 (270) 5/15

Δ f_opt f11, 3-D	1e1 67	1e0 105	1e-1 227	1e-2 263	1e-3 277	1e-5 302	1e-7 327	#succ 15/15
CMA-ES-pycma Gharafi	3.2 (2)	3.1 (0.8)	1.7 (0.3)	1.6 (0.3)	1.7 (0.3)	1.9 (0.2)	2.0 (0.2)	15/15
NELDERDOERR doerr	2.3 (2)	2.0 (0.7)	1.1 (0.3)	1 (0.2)	1.0 (0.2)	1 (0.2)	1.0 (0.2)	15/15
SLSQP-11-scipy Hansen	0.44 (0.2)^★3_↑0	0.34 (0.1)^★4_↑0	0.19 (0.1)^★4_↑0	0.19 (0.1)^★4_↑0	0.21 (0.1)^★4_↑0	33 (74)	169 (270)	5/15

Δ f_opt
f12, 3-D 1e1
65 1e0
168 1e-1
338 1e-2
401 1e-3
445 1e-5
696 1e-7
790 #succ
15/15

CMA-ES-pycma Gharafi 5.9 (5) 5.5 (7) 4.1 (5) 4.3 (5) 4.2 (4) 3.3 (3) 3.7 (3) 15/15
NELDERDOERR doerr 1.7 (1) 1.6 (2) 1.3 (1) 1.2 (1.0) 1.3 (0.9) 1.00 (0.7) 1.0 (0.7) 15/15
SLSQP-11-scipy Hansen 2.3 (3) 1.5 (2) 1.0 (1) 1.0 (1) 1.0 (1) 1.2 (1) 4.6 (6) 9/15

Δ f_opt f12, 3-D	1e1 65	1e0 168	1e-1 338	1e-2 401	1e-3 445	1e-5 696	1e-7 790	#succ 15/15
CMA-ES-pycma Gharafi	5.9 (5)	5.5 (7)	4.1 (5)	4.3 (5)	4.2 (4)	3.3 (3)	3.7 (3)	15/15
NELDERDOERR doerr	1.7 (1)	1.6 (2)	1.3 (1)	1.2 (1.0)	1.3 (0.9)	1.00 (0.7)	1.0 (0.7)	15/15
SLSQP-11-scipy Hansen	2.3 (3)	1.5 (2)	1.0 (1)	1.0 (1)	1.0 (1)	1.2 (1)	4.6 (6)	9/15

Δ f_opt
f13, 3-D 1e1
49 1e0
85 1e-1
108 1e-2
136 1e-3
215 1e-5
281 1e-7
365 #succ
15/15

CMA-ES-pycma Gharafi 3.7 (2) 3.2 (0.9) 3.5 (0.8) 3.5 (0.7) 2.6 (0.4) 2.7 (0.4) 2.6 (0.3) 15/15
NELDERDOERR doerr 1.0 (0.2) 1.1 (0.5) 1.2 (0.7) 1.3 (0.7) 1.2 (0.7) 1.2 (0.8)^★2 1.1 (0.6)^★3 15/15
SLSQP-11-scipy Hansen 0.89 (0.2) 0.77 (0.1)_↑0 0.79 (0.1)_↑0 0.77 (0.1)^★2_↑0 41 (104) 287 (277) ∞9e4 0/15

Δ f_opt f13, 3-D	1e1 49	1e0 85	1e-1 108	1e-2 136	1e-3 215	1e-5 281	1e-7 365	#succ 15/15
CMA-ES-pycma Gharafi	3.7 (2)	3.2 (0.9)	3.5 (0.8)	3.5 (0.7)	2.6 (0.4)	2.7 (0.4)	2.6 (0.3)	15/15
NELDERDOERR doerr	1.0 (0.2)	1.1 (0.5)	1.2 (0.7)	1.3 (0.7)	1.2 (0.7)	1.2 (0.8)^★2	1.1 (0.6)^★3	15/15
SLSQP-11-scipy Hansen	0.89 (0.2)	0.77 (0.1)_↑0	0.79 (0.1)_↑0	0.77 (0.1)^★2_↑0	41 (104)	287 (277)	∞9e4	0/15

Δ f_opt
f14, 3-D 1e1
2.0 1e0
17 1e-1
28 1e-2
43 1e-3
71 1e-5
110 1e-7
194 #succ
15/15

CMA-ES-pycma Gharafi 1.4 (2) 2.2 (2) 3.0 (0.8) 3.7 (1.0) 3.5 (0.7) 3.9 (0.6) 3.2 (0.3) 15/15
NELDERDOERR doerr 2.9 (2) 1.1 (0.6) 1.4 (0.4) 1.8 (0.7) 1.5 (0.3) 1.6 (0.4) 1.2 (0.2)^★2 15/15
SLSQP-11-scipy Hansen 2.6 (2) 0.90 (0.6) 0.83 (0.4)^★2 0.85 (0.3)^★3 0.74 (0.3)^★3 0.75 (0.2)^★4_↑0 38 (44) 11/15

Δ f_opt f14, 3-D	1e1 2.0	1e0 17	1e-1 28	1e-2 43	1e-3 71	1e-5 110	1e-7 194	#succ 15/15
CMA-ES-pycma Gharafi	1.4 (2)	2.2 (2)	3.0 (0.8)	3.7 (1.0)	3.5 (0.7)	3.9 (0.6)	3.2 (0.3)	15/15
NELDERDOERR doerr	2.9 (2)	1.1 (0.6)	1.4 (0.4)	1.8 (0.7)	1.5 (0.3)	1.6 (0.4)	1.2 (0.2)^★2	15/15
SLSQP-11-scipy Hansen	2.6 (2)	0.90 (0.6)	0.83 (0.4)^★2	0.85 (0.3)^★3	0.74 (0.3)^★3	0.75 (0.2)^★4_↑0	38 (44)	11/15

Δ f_opt
f15, 3-D 1e1
121 1e0
1372 1e-1
6285 1e-2
8282 1e-3
8429 1e-5
8787 1e-7
9041 #succ
15/15

CMA-ES-pycma Gharafi 1.0 (0.7) 1.6 (2) 0.98 (0.7) 0.79 (0.6) 0.79 (0.6) 0.80 (0.6) 0.80 (0.6) 15/15
NELDERDOERR doerr 1.4 (2) 1.0 (1) 2.5 (4) 1.9 (4) 1.9 (3) 1.8 (3) 1.8 (3) 13/15
SLSQP-11-scipy Hansen 5.0 (5) 6.4 (7) 9.2 (8) 7.0 (7) 6.8 (5) 6.6 (5) 6.4 (5) 10/15

Δ f_opt f15, 3-D	1e1 121	1e0 1372	1e-1 6285	1e-2 8282	1e-3 8429	1e-5 8787	1e-7 9041	#succ 15/15
CMA-ES-pycma Gharafi	1.0 (0.7)	1.6 (2)	0.98 (0.7)	0.79 (0.6)	0.79 (0.6)	0.80 (0.6)	0.80 (0.6)	15/15
NELDERDOERR doerr	1.4 (2)	1.0 (1)	2.5 (4)	1.9 (4)	1.9 (3)	1.8 (3)	1.8 (3)	13/15
SLSQP-11-scipy Hansen	5.0 (5)	6.4 (7)	9.2 (8)	7.0 (7)	6.8 (5)	6.6 (5)	6.4 (5)	10/15

Δ f_opt
f16, 3-D 1e1
41 1e0
319 1e-1
582 1e-2
789 1e-3
1864 1e-5
3204 1e-7
3361 #succ
15/15

CMA-ES-pycma Gharafi 1.4 (2) 3.5 (3) 2.2 (1) 2.0 (1) 0.88 (0.5) 0.59 (0.3)^★2_↑1 0.60 (0.3)^★2_↑1 15/15
NELDERDOERR doerr 1.2 (0.8) 2.8 (4) 3.4 (4) 3.9 (5) 3.2 (3) 2.6 (2) 6.3 (7) 14/15
SLSQP-11-scipy Hansen 66 (85) 367 (460) 1750 (3199) ∞ ∞ ∞ ∞7e4 0/15

Δ f_opt f16, 3-D	1e1 41	1e0 319	1e-1 582	1e-2 789	1e-3 1864	1e-5 3204	1e-7 3361	#succ 15/15
CMA-ES-pycma Gharafi	1.4 (2)	3.5 (3)	2.2 (1)	2.0 (1)	0.88 (0.5)	0.59 (0.3)^★2_↑1	0.60 (0.3)^★2_↑1	15/15
NELDERDOERR doerr	1.2 (0.8)	2.8 (4)	3.4 (4)	3.9 (5)	3.2 (3)	2.6 (2)	6.3 (7)	14/15
SLSQP-11-scipy Hansen	66 (85)	367 (460)	1750 (3199)	∞	∞	∞	∞7e4	0/15

Δ f_opt
f17, 3-D 1e1
4.0 1e0
78 1e-1
282 1e-2
491 1e-3
1134 1e-5
2347 1e-7
3469 #succ
15/15

CMA-ES-pycma Gharafi 1.5 (2) 1.1 (0.6) 0.80 (0.2)^★2_↑1 1.2 (1)^★3 1.0 (0.7)^★4 1.1 (0.5)^★4 1.0 (0.4)^★4 15/15
NELDERDOERR doerr 1.7 (2) 3.8 (3) 8.5 (8) 36 (52) 69 (83) ∞ ∞5e4 0/15
SLSQP-11-scipy Hansen 2.1 (2) 46 (72) ∞ ∞ ∞ ∞ ∞6e4 0/15

Δ f_opt f17, 3-D	1e1 4.0	1e0 78	1e-1 282	1e-2 491	1e-3 1134	1e-5 2347	1e-7 3469	#succ 15/15
CMA-ES-pycma Gharafi	1.5 (2)	1.1 (0.6)	0.80 (0.2)^★2_↑1	1.2 (1)^★3	1.0 (0.7)^★4	1.1 (0.5)^★4	1.0 (0.4)^★4	15/15
NELDERDOERR doerr	1.7 (2)	3.8 (3)	8.5 (8)	36 (52)	69 (83)	∞	∞5e4	0/15
SLSQP-11-scipy Hansen	2.1 (2)	46 (72)	∞	∞	∞	∞	∞6e4	0/15

Δ f_opt
f18, 3-D 1e1
40 1e0
145 1e-1
1289 1e-2
3084 1e-3
3523 1e-5
4738 1e-7
5527 #succ
15/15

CMA-ES-pycma Gharafi 0.86 (1) 1.8 (0.7) 0.78 (0.8)^★ 0.53 (0.5)^★3 0.57 (0.4)^★4_↑1 0.67 (0.9)^★4 0.70 (0.8)^★4 15/15
NELDERDOERR doerr 1.9 (2) 5.4 (6) 7.0 (10) 16 (13) 72 (83) 169 (177) ∞6e4 0/15
SLSQP-11-scipy Hansen 18 (22) 582 (563) ∞ ∞ ∞ ∞ ∞6e4 0/15

Δ f_opt f18, 3-D	1e1 40	1e0 145	1e-1 1289	1e-2 3084	1e-3 3523	1e-5 4738	1e-7 5527	#succ 15/15
CMA-ES-pycma Gharafi	0.86 (1)	1.8 (0.7)	0.78 (0.8)^★	0.53 (0.5)^★3	0.57 (0.4)^★4_↑1	0.67 (0.9)^★4	0.70 (0.8)^★4	15/15
NELDERDOERR doerr	1.9 (2)	5.4 (6)	7.0 (10)	16 (13)	72 (83)	169 (177)	∞6e4	0/15
SLSQP-11-scipy Hansen	18 (22)	582 (563)	∞	∞	∞	∞	∞6e4	0/15

Δ f_opt
f19, 3-D 1e1
1 1e0
1 1e-1
109 1e-2
6764 1e-3
7367 1e-5
7399 1e-7
7441 #succ
15/15

CMA-ES-pycma Gharafi 1 (0) 1 (0) 41 (55) 2.6 (3) 3.3 (3) 3.4 (3) 3.4 (3) 15/15
NELDERDOERR doerr 7.6 (7) 146 (212) 20 (16) 5.4 (5) 11 (12) 11 (13) 11 (11) 7/15
SLSQP-11-scipy Hansen 1 (0) 1 (0) 0.14 (0)^★4_↑0 ∞ ∞ ∞ ∞9e4 0/15

Δ f_opt f19, 3-D	1e1 1	1e0 1	1e-1 109	1e-2 6764	1e-3 7367	1e-5 7399	1e-7 7441	#succ 15/15
CMA-ES-pycma Gharafi	1 (0)	1 (0)	41 (55)	2.6 (3)	3.3 (3)	3.4 (3)	3.4 (3)	15/15
NELDERDOERR doerr	7.6 (7)	146 (212)	20 (16)	5.4 (5)	11 (12)	11 (13)	11 (11)	7/15
SLSQP-11-scipy Hansen	1 (0)	1 (0)	0.14 (0)^★4_↑0	∞	∞	∞	∞9e4	0/15

Δ f_opt
f20, 3-D 1e1
8.0 1e0
385 1e-1
2291 1e-2
2398 1e-3
2481 1e-5
2573 1e-7
2776 #succ
15/15

CMA-ES-pycma Gharafi 1.0 (0.9) 4.3 (7) 4.4 (4) 4.4 (4) 4.4 (4) 4.5 (4) 4.3 (4) 15/15
NELDERDOERR doerr 1.8 (1) 3.6 (4) 10 (12) 10 (14) 10 (15) 9.4 (12) 8.7 (10) 13/15
SLSQP-11-scipy Hansen 1.4 (0) 4.1 (4) 11 (11) 10 (10) 10 (10) 10 (10) 8.9 (9) 14/15

Δ f_opt f20, 3-D	1e1 8.0	1e0 385	1e-1 2291	1e-2 2398	1e-3 2481	1e-5 2573	1e-7 2776	#succ 15/15
CMA-ES-pycma Gharafi	1.0 (0.9)	4.3 (7)	4.4 (4)	4.4 (4)	4.4 (4)	4.5 (4)	4.3 (4)	15/15
NELDERDOERR doerr	1.8 (1)	3.6 (4)	10 (12)	10 (14)	10 (15)	9.4 (12)	8.7 (10)	13/15
SLSQP-11-scipy Hansen	1.4 (0)	4.1 (4)	11 (11)	10 (10)	10 (10)	10 (10)	8.9 (9)	14/15

Δ f_opt
f21, 3-D 1e1
6.0 1e0
184 1e-1
425 1e-2
439 1e-3
458 1e-5
469 1e-7
482 #succ
14/15

CMA-ES-pycma Gharafi 1.2 (2) 8.7 (19) 7.2 (13) 7.5 (13) 7.5 (14) 7.7 (14) 7.7 (14) 15/15
NELDERDOERR doerr 2.0 (2) 2.8 (4) 2.9 (3) 2.8 (3) 2.7 (3) 2.7 (3) 2.6 (3) 15/15
SLSQP-11-scipy Hansen 2.7 (3) 1.8 (2) 1.7 (2) 1.6 (1) 1.6 (1) 1.6 (1) 2.3 (2) 15/15

Δ f_opt f21, 3-D	1e1 6.0	1e0 184	1e-1 425	1e-2 439	1e-3 458	1e-5 469	1e-7 482	#succ 14/15
CMA-ES-pycma Gharafi	1.2 (2)	8.7 (19)	7.2 (13)	7.5 (13)	7.5 (14)	7.7 (14)	7.7 (14)	15/15
NELDERDOERR doerr	2.0 (2)	2.8 (4)	2.9 (3)	2.8 (3)	2.7 (3)	2.7 (3)	2.6 (3)	15/15
SLSQP-11-scipy Hansen	2.7 (3)	1.8 (2)	1.7 (2)	1.6 (1)	1.6 (1)	1.6 (1)	2.3 (2)	15/15

Δ f_opt
f22, 3-D 1e1
18 1e0
170 1e-1
354 1e-2
362 1e-3
384 1e-5
401 1e-7
414 #succ
15/15

CMA-ES-pycma Gharafi 1.1 (0.9) 4.5 (6) 13 (15) 17 (17) 71 (50) 103 (53) 101 (53) 15/15
NELDERDOERR doerr 4.1 (4) 2.0 (2) 2.2 (2) 2.2 (2) 2.1 (2) 2.0 (1) 2.0 (1) 15/15
SLSQP-11-scipy Hansen 2.2 (2) 2.4 (3) 2.1 (3) 2.1 (3) 2.0 (2) 2.0 (2) 2.1 (2) 15/15

Δ f_opt f22, 3-D	1e1 18	1e0 170	1e-1 354	1e-2 362	1e-3 384	1e-5 401	1e-7 414	#succ 15/15
CMA-ES-pycma Gharafi	1.1 (0.9)	4.5 (6)	13 (15)	17 (17)	71 (50)	103 (53)	101 (53)	15/15
NELDERDOERR doerr	4.1 (4)	2.0 (2)	2.2 (2)	2.2 (2)	2.1 (2)	2.0 (1)	2.0 (1)	15/15
SLSQP-11-scipy Hansen	2.2 (2)	2.4 (3)	2.1 (3)	2.1 (3)	2.0 (2)	2.0 (2)	2.1 (2)	15/15

Δ f_opt
f23, 3-D 1e1
3.0 1e0
407 1e-1
906 1e-2
1215 1e-3
2214 1e-5
2293 1e-7
2393 #succ
15/15

CMA-ES-pycma Gharafi 4.2 (5) 6.7 (6) 4.9 (4) 3.8 (3) 2.2 (2) 2.3 (2) 2.3 (2) 15/15
NELDERDOERR doerr 5.8 (6) 1.00 (1)^★ 1.0 (1.0)^★2 1.0 (1)^★ 1.1 (0.8) 1.4 (2) 1.4 (2) 15/15
SLSQP-11-scipy Hansen 21 (30) 6.6 (10) 21 (36) 22 (34) 15 (16) 83 (118) ∞6e4 0/15

Δ f_opt f23, 3-D	1e1 3.0	1e0 407	1e-1 906	1e-2 1215	1e-3 2214	1e-5 2293	1e-7 2393	#succ 15/15
CMA-ES-pycma Gharafi	4.2 (5)	6.7 (6)	4.9 (4)	3.8 (3)	2.2 (2)	2.3 (2)	2.3 (2)	15/15
NELDERDOERR doerr	5.8 (6)	1.00 (1)^★	1.0 (1.0)^★2	1.0 (1)^★	1.1 (0.8)	1.4 (2)	1.4 (2)	15/15
SLSQP-11-scipy Hansen	21 (30)	6.6 (10)	21 (36)	22 (34)	15 (16)	83 (118)	∞6e4	0/15

Δ f_opt
f24, 3-D 1e1
97 1e0
10391 1e-1
1.0e5 1e-2
3.6e5 1e-3
3.6e5 1e-5
3.6e5 1e-7
3.6e5 #succ
2/15

CMA-ES-pycma Gharafi 2.0 (1) 168 (181) 96 (91) ∞ ∞ ∞ ∞2e6 0/15
NELDERDOERR doerr 2.3 (4) 1.5 (1) 3.9 (6) 2.4 (5) 2.4 (2) 2.4 (2) 2.4 (3) 1/15
SLSQP-11-scipy Hansen 8.2 (8) 3.2 (4) 8.4 (14) ∞ ∞ ∞ ∞6e4 0/15

Δ f_opt f24, 3-D	1e1 97	1e0 10391	1e-1 1.0e5	1e-2 3.6e5	1e-3 3.6e5	1e-5 3.6e5	1e-7 3.6e5	#succ 2/15
CMA-ES-pycma Gharafi	2.0 (1)	168 (181)	96 (91)	∞	∞	∞	∞2e6	0/15
NELDERDOERR doerr	2.3 (4)	1.5 (1)	3.9 (6)	2.4 (5)	2.4 (2)	2.4 (2)	2.4 (3)	1/15
SLSQP-11-scipy Hansen	8.2 (8)	3.2 (4)	8.4 (14)	∞	∞	∞	∞6e4	0/15

Previous dimension | Dimension = 5 | Next dimension

Δ f_opt f1, 5-D	1e1 11	1e0 12	1e-1 12	1e-2 12	1e-3 12	1e-5 12	1e-7 12	#succ 15/15
CMA-ES-pycma Gharafi	1.6 (1)	7.1 (2)	13 (3)	20 (3)	27 (3)	39 (4)	50 (6)	15/15
NELDERDOERR doerr	1.5 (1)	3.5 (1)	5.6 (2)	7.6 (2)	10 (2)	14 (2)	18 (3)	15/15
SLSQP-11-scipy Hansen	0.91 (0)_↑0	0.83 (0)^★4_↑0	0.83 (0)^★4_↑0	0.83 (0)^★4_↑0	0.83 (0)^★4_↑0	0.83 (0)^★4_↑0	0.83 (0)^★4_↑0	15/15

Δ f_opt
f2, 5-D 1e1
83 1e0
87 1e-1
88 1e-2
89 1e-3
90 1e-5
92 1e-7
94 #succ
15/15

CMA-ES-pycma Gharafi 7.2 (2) 8.5 (2) 10 (2) 11 (2) 12 (2) 13 (2) 15 (2) 15/15
NELDERDOERR doerr 4.9 (4) 8.2 (4) 9.0 (6) 9.3 (6) 10 (6) 10 (6) 10 (6) 15/15
SLSQP-11-scipy Hansen 1.1 (0.4)^★3 1.2 (0.3)^★4 1.3 (0.4)^★4 1.4 (0.6)^★4 1.5 (0.7)^★4 1.8 (0.7)^★4 1.9 (0.7)^★4 15/15

Δ f_opt f2, 5-D	1e1 83	1e0 87	1e-1 88	1e-2 89	1e-3 90	1e-5 92	1e-7 94	#succ 15/15
CMA-ES-pycma Gharafi	7.2 (2)	8.5 (2)	10 (2)	11 (2)	12 (2)	13 (2)	15 (2)	15/15
NELDERDOERR doerr	4.9 (4)	8.2 (4)	9.0 (6)	9.3 (6)	10 (6)	10 (6)	10 (6)	15/15
SLSQP-11-scipy Hansen	1.1 (0.4)^★3	1.2 (0.3)^★4	1.3 (0.4)^★4	1.4 (0.6)^★4	1.5 (0.7)^★4	1.8 (0.7)^★4	1.9 (0.7)^★4	15/15

Δ f_opt
f3, 5-D 1e1
716 1e0
1622 1e-1
1637 1e-2
1642 1e-3
1646 1e-5
1650 1e-7
1654 #succ
15/15

CMA-ES-pycma Gharafi 0.79 (0.4) 28 (74) 853 (1394) 1087 (1531) 1085 (1757) 1083 (1117) 1081 (1261) 10/15
NELDERDOERR doerr 1.5 (3) 33 (39) 268 (267) 268 (281) 267 (329) 266 (294) 266 (268) 3/15
SLSQP-11-scipy Hansen 17 (25) 879 (826) ∞ ∞ ∞ ∞ ∞1e5 0/15

Δ f_opt
f4, 5-D 1e1
809 1e0
1633 1e-1
1688 1e-2
1758 1e-3
1817 1e-5
1886 1e-7
1903 #succ
15/15

CMA-ES-pycma Gharafi 1.9 (2)^★ ∞ ∞ ∞ ∞ ∞ ∞3e6 0/15
NELDERDOERR doerr 7.1 (5) 898 (1087) 870 (622) 835 (825) 808 (1032) 779 (663) 772 (749) 1/15
SLSQP-11-scipy Hansen 59 (48) ∞ ∞ ∞ ∞ ∞ ∞1e5 0/15

Δ f_opt
f5, 5-D 1e1
10 1e0
10 1e-1
10 1e-2
10 1e-3
10 1e-5
10 1e-7
10 #succ
15/15

CMA-ES-pycma Gharafi 4.8 (2) 6.4 (2) 6.5 (2) 6.5 (2) 6.5 (2) 6.5 (2) 6.5 (2) 15/15
NELDERDOERR doerr 1.9 (0.8) 2.4 (0.8) 2.5 (0.8) 2.5 (0.8) 2.5 (0.8) 2.5 (0.8) 2.5 (0.8) 15/15
SLSQP-11-scipy Hansen 1.6 (0) 2.3 (0) 3.0 (0) 3.0 (0) 3.0 (0) 3.0 (0) 3.0 (0) 15/15

Δ f_opt
f6, 5-D 1e1
114 1e0
214 1e-1
281 1e-2
404 1e-3
580 1e-5
1038 1e-7
1332 #succ
15/15

CMA-ES-pycma Gharafi 1.6 (0.7) 1.7 (0.4) 1.9 (0.4) 1.7 (0.3) 1.5 (0.2) 1.1 (0.1) 1.1 (0.1) 15/15
NELDERDOERR doerr 5.1 (7) 5.6 (7) 5.6 (6) 4.9 (4) 5.3 (6) 5.6 (5) 8.5 (7) 14/15
SLSQP-11-scipy Hansen 2.9 (1) 2.1 (1) 2.2 (1) 1.7 (0.9) 1.4 (0.6) 0.99 (0.5) 2.2 (2) 15/15

Δ f_opt
f7, 5-D 1e1
24 1e0
324 1e-1
1171 1e-2
1451 1e-3
1572 1e-5
1572 1e-7
1597 #succ
15/15

CMA-ES-pycma Gharafi 2.8 (3) 1.1 (1.0) 0.58 (0.3)^★2_↑0 0.59 (0.3)^★4_↑0 0.61 (0.3)^★4_↑0 0.61 (0.3)^★4_↑0 0.63 (0.3)^★4_↑0 15/15
NELDERDOERR doerr 1.3 (0.5) 7.5 (12) 15 (11) 39 (41) 71 (55) 71 (75) 71 (47) 9/15
SLSQP-11-scipy Hansen 286 (599) 1064 (1248) ∞ ∞ ∞ ∞ ∞1e5 0/15

Δ f_opt
f8, 5-D 1e1
73 1e0
273 1e-1
336 1e-2
372 1e-3
391 1e-5
410 1e-7
422 #succ
15/15

CMA-ES-pycma Gharafi 2.6 (1.0) 4.2 (4) 4.6 (4) 4.7 (4) 4.7 (3) 5.0 (3) 5.3 (3) 15/15
NELDERDOERR doerr 2.1 (2) 2.4 (2) 2.4 (2) 2.3 (2) 2.3 (1) 2.4 (1) 2.4 (1) 15/15
SLSQP-11-scipy Hansen 1.3 (0.5) 1.1 (0.9) 1.0 (0.8) 1.0 (0.6)^★ 1.0 (0.6)^★ 1.0 (0.6)^★2 1.0 (0.6)^★2 15/15

Δ f_opt
f9, 5-D 1e1
35 1e0
127 1e-1
214 1e-2
263 1e-3
300 1e-5
335 1e-7
369 #succ
15/15

CMA-ES-pycma Gharafi 4.2 (2) 6.0 (2) 5.2 (1) 5.0 (1) 4.7 (1) 4.7 (1) 4.7 (1) 15/15
NELDERDOERR doerr 2.3 (0.9) 3.1 (2) 2.5 (1) 2.3 (0.9) 2.1 (0.8) 2.1 (0.7) 2.0 (0.7) 15/15
SLSQP-11-scipy Hansen 0.63 (0)^★4_↑0 0.46 (0)^★4_↑0 0.54 (0)^★4_↑0 0.55 (0)^★4_↑0 0.53 (0)^★4_↑0 0.51 (0)^★4_↑0 0.50 (0)^★4_↑0 15/15

Δ f_opt
f10, 5-D 1e1
349 1e0
500 1e-1
574 1e-2
607 1e-3
626 1e-5
829 1e-7
880 #succ
15/15

CMA-ES-pycma Gharafi 1.7 (0.7) 1.5 (0.5) 1.5 (0.3) 1.6 (0.3) 1.6 (0.3) 1.4 (0.2) 1.5 (0.2) 15/15
NELDERDOERR doerr 1.2 (0.9) 1.3 (0.6) 1.2 (0.5) 1.2 (0.5) 1.2 (0.5) 1.0 (0.4) 1.00 (0.4) 15/15
SLSQP-11-scipy Hansen 0.25 (0.1)^★4_↑0 0.20 (0.0)^★4_↑0 0.19 (0.0)^★4_↑0 0.19 (0.0)^★4_↑0 0.20 (0.0)^★4_↑0 0.22 (0.1)^★4_↑0 23 (31) 10/15

Δ f_opt
f11, 5-D 1e1
143 1e0
202 1e-1
763 1e-2
977 1e-3
1177 1e-5
1467 1e-7
1673 #succ
15/15

CMA-ES-pycma Gharafi 3.6 (1.0) 3.3 (0.6) 0.98 (0.2) 0.85 (0.1)_↑1 0.77 (0.1)_↑0 0.73 (0.1)_↑0 0.73 (0.1)^★_↑0 15/15
NELDERDOERR doerr 4.5 (4) 4.7 (3) 1.5 (0.8) 1.4 (0.6) 1.2 (0.5) 1.1 (0.5) 1.2 (0.5) 15/15
SLSQP-11-scipy Hansen 0.28 (0.1)^★4_↑0 0.27 (0.1)^★4_↑0 0.08 (0.0)^★4_↑0 0.07 (0.0)^★4_↑0 0.07 (0.0)^★4_↑0 7.2 (17) 195 (234) 0/15

Δ f_opt
f12, 5-D 1e1
108 1e0
268 1e-1
371 1e-2
413 1e-3
461 1e-5
1303 1e-7
1494 #succ
15/15

CMA-ES-pycma Gharafi 10 (11) 6.9 (9) 7.0 (9) 7.4 (9) 7.4 (8) 3.4 (3) 3.4 (3) 15/15
NELDERDOERR doerr 4.4 (6) 2.9 (4) 2.7 (3) 2.7 (3) 2.7 (2) 1.1 (1.0) 1.2 (1.0) 15/15
SLSQP-11-scipy Hansen 2.8 (3) 1.7 (2) 1.5 (2) 1.5 (2) 1.5 (2) 0.88 (0.7) 4.2 (6) 11/15

Δ f_opt
f13, 5-D 1e1
132 1e0
195 1e-1
250 1e-2
319 1e-3
1310 1e-5
1752 1e-7
2255 #succ
15/15

CMA-ES-pycma Gharafi 2.3 (0.8) 3.0 (1) 3.6 (0.9) 3.4 (0.6) 0.97 (0.2) 0.99 (0.2) 1.00 (0.1) 15/15
NELDERDOERR doerr 2.4 (3) 2.4 (3) 5.2 (6) 6.1 (9) 1.9 (2) 3.9 (3) 5.0 (5) 15/15
SLSQP-11-scipy Hansen 0.76 (0.1)_↑0 0.74 (0.1)_↑0 0.76 (0.1)^★2_↑0 0.73 (0.0)^★4_↑0 35 (45) 437 (554) ∞1e5 0/15

Δ f_opt
f14, 5-D 1e1
10 1e0
41 1e-1
58 1e-2
90 1e-3
139 1e-5
251 1e-7
476 #succ
15/15

CMA-ES-pycma Gharafi 0.64 (0.7) 1.8 (0.8) 3.0 (1.0) 3.2 (0.7) 3.3 (0.6) 3.2 (0.4) 2.5 (0.2) 15/15
NELDERDOERR doerr 1.0 (0.7) 1.1 (0.4) 1.4 (0.6) 1.6 (0.5) 1.7 (0.6) 1.6 (0.5) 1.3 (0.4)^★3 15/15
SLSQP-11-scipy Hansen 0.89 (0.8) 0.58 (0.3)^★2_↑0 0.74 (0.2)^★4_↑0 0.77 (0.2)^★4_↑1 0.70 (0.1)^★4_↑0 0.59 (0.1)^★4_↑0 512 (1034) 3/15

Δ f_opt
f15, 5-D 1e1
511 1e0
9310 1e-1
19369 1e-2
19743 1e-3
20073 1e-5
20769 1e-7
21359 #succ
14/15

CMA-ES-pycma Gharafi 1.1 (0.4)^★2 1.1 (0.7)^★3 1.2 (0.7)^★4 1.2 (0.7)^★4 1.2 (0.7)^★4 1.2 (0.7)^★3 1.2 (0.7)^★3 15/15
NELDERDOERR doerr 4.5 (5) 20 (25) 73 (101) 72 (89) 71 (139) 69 (51) 67 (51) 1/15
SLSQP-11-scipy Hansen 30 (33) 153 (174) ∞ ∞ ∞ ∞ ∞1e5 0/15

Δ f_opt
f16, 5-D 1e1
120 1e0
612 1e-1
2662 1e-2
10163 1e-3
10449 1e-5
11644 1e-7
12095 #succ
15/15

CMA-ES-pycma Gharafi 1.9 (1) 2.5 (2) 1.2 (1)^★3 0.53 (0.6)^★4 0.58 (0.6)^★4 0.57 (0.5)^★4 0.57 (0.5)^★4 15/15
NELDERDOERR doerr 1.6 (3) 4.8 (7) 10 (10) 6.3 (6) 13 (19) 59 (60) 119 (165) 0/15
SLSQP-11-scipy Hansen 250 (459) ∞ ∞ ∞ ∞ ∞ ∞1e5 0/15

Δ f_opt
f17, 5-D 1e1
5.0 1e0
215 1e-1
899 1e-2
2861 1e-3
3669 1e-5
6351 1e-7
7934 #succ
15/15

CMA-ES-pycma Gharafi 1.6 (2) 1.5 (0.3) 0.97 (1)^★3 0.66 (0.6)^★4 0.67 (0.5)^★4 0.80 (0.8)^★4 1.0 (0.5)^★4 15/15
NELDERDOERR doerr 2.0 (2) 10 (17) 48 (48) ∞ ∞ ∞ ∞1e5 0/15
SLSQP-11-scipy Hansen 31 (62) 300 (261) ∞ ∞ ∞ ∞ ∞1e5 0/15

Δ f_opt
f18, 5-D 1e1
103 1e0
378 1e-1
3968 1e-2
8451 1e-3
9280 1e-5
10905 1e-7
12469 #succ
15/15

CMA-ES-pycma Gharafi 0.81 (0.4) 3.9 (6) 0.87 (0.9)^★2 0.76 (0.7)^★4 0.79 (0.5)^★4 0.80 (0.4)^★4 0.89 (0.6)^★4 15/15
NELDERDOERR doerr 4.3 (7) 28 (34) 43 (56) ∞ ∞ ∞ ∞1e5 0/15
SLSQP-11-scipy Hansen 46 (39) ∞ ∞ ∞ ∞ ∞ ∞1e5 0/15

Δ f_opt
f19, 5-D 1e1
1 1e0
1 1e-1
242 1e-2
1.0e5 1e-3
1.2e5 1e-5
1.2e5 1e-7
1.2e5 #succ
15/15

CMA-ES-pycma Gharafi 1 (0) 1 (0) 126 (104) 0.81 (0.8) 0.92 (0.6) 0.93 (0.6) 0.94 (0.6) 15/15
NELDERDOERR doerr 12 (9) 340 (262) 107 (156) 14 (10) ∞ ∞ ∞1e5 0/15
SLSQP-11-scipy Hansen 1 (0) 1 (0) 0.12 (0)^★4_↑0 ∞ ∞ ∞ ∞1e5 0/15

Δ f_opt
f20, 5-D 1e1
16 1e0
851 1e-1
38111 1e-2
51362 1e-3
54470 1e-5
54861 1e-7
55313 #succ
14/15

CMA-ES-pycma Gharafi 1.9 (1) 5.7 (6) 1.1 (0.7)^★4 0.89 (0.5)^★4 0.85 (0.5)^★4 0.88 (0.5)^★4 0.89 (0.5)^★4 15/15
NELDERDOERR doerr 2.2 (2) 8.5 (6) 37 (36) 28 (27) 26 (19) 26 (36) 26 (25) 1/15
SLSQP-11-scipy Hansen 0.81 (0)_↑0 2.3 (2) ∞ ∞ ∞ ∞ ∞1e5 0/15

Δ f_opt
f21, 5-D 1e1
41 1e0
1157 1e-1
1674 1e-2
1692 1e-3
1705 1e-5
1729 1e-7
1757 #succ
14/15

CMA-ES-pycma Gharafi 3.7 (1) 53 (6) 148 (263) 146 (260) 145 (259) 144 (256) 141 (253) 14/15
NELDERDOERR doerr 2.9 (6) 1.5 (2) 1.2 (1) 1.2 (1) 1.2 (1) 1.2 (1) 1.2 (1) 15/15
SLSQP-11-scipy Hansen 1.3 (2) 0.81 (0.9) 1.3 (0.7) 1.2 (0.7) 1.2 (0.7) 1.3 (0.7) 1.4 (1) 15/15

Δ f_opt
f22, 5-D 1e1
71 1e0
386 1e-1
938 1e-2
980 1e-3
1008 1e-5
1040 1e-7
1068 #succ
14/15

CMA-ES-pycma Gharafi 5.1 (10) 6.0 (8) 204 (213) 277 (582) 269 (566) 262 (549) 255 (534) 15/15
NELDERDOERR doerr 2.5 (6) 2.5 (3) 2.1 (4) 2.0 (4) 2.0 (4) 2.0 (3) 2.1 (3) 15/15
SLSQP-11-scipy Hansen 1.8 (2) 1.1 (0.7) 1.8 (2) 1.7 (2) 1.7 (2) 1.7 (2) 2.0 (2) 14/15

Δ f_opt
f23, 5-D 1e1
3.0 1e0
518 1e-1
14249 1e-2
27890 1e-3
31654 1e-5
33030 1e-7
34256 #succ
15/15

CMA-ES-pycma Gharafi 1.8 (2) 9.4 (9) 17 (15) 9.4 (8) 8.3 (7) 8.0 (7) 7.8 (6) 14/15
NELDERDOERR doerr 1.5 (1) 1.00 (1)^★3 1.0 (2) 3.6 (4) 15 (15) ∞ ∞1e5 0/15
SLSQP-11-scipy Hansen 27 (8) 13 (19) 17 (19) 25 (30) ∞ ∞ ∞1e5 0/15

Δ f_opt
f24, 5-D 1e1
1622 1e0
2.2e5 1e-1
6.4e6 1e-2
9.6e6 1e-3
9.6e6 1e-5
1.3e7 1e-7
1.3e7 #succ
3/15

CMA-ES-pycma Gharafi 2.2 (2) 46 (72) 5.5 (6) ∞ ∞ ∞ ∞3e6 0/15
NELDERDOERR doerr 1.0 (1) 1.4 (2) ∞ ∞ ∞ ∞ ∞1e5 0/15
SLSQP-11-scipy Hansen 6.4 (7) ∞ ∞ ∞ ∞ ∞ ∞1e5 0/15

Previous dimension | Dimension = 10 | Next dimension

Δ f_opt f1, 10-D	1e1 22	1e0 23	1e-1 23	1e-2 23	1e-3 23	1e-5 23	1e-7 23	#succ 15/15
CMA-ES-pycma Gharafi	4.2 (2)	11 (2)	17 (3)	24 (3)	30 (3)	43 (4)	57 (4)	15/15
NELDERDOERR doerr	2.4 (2)	5.2 (2)	8.1 (3)	11 (4)	14 (5)	21 (5)	32 (9)	15/15
SLSQP-11-scipy Hansen	0.68 (0)^★4_↑0	0.65 (0)^★4_↑0	0.65 (0)^★4_↑0	0.65 (0)^★4_↑0	0.65 (0)^★4_↑0	0.65 (0)^★4_↑0	0.65 (0)^★4_↑0	15/15

Δ f_opt
f2, 10-D 1e1
187 1e0
190 1e-1
191 1e-2
191 1e-3
193 1e-5
194 1e-7
195 #succ
15/15

CMA-ES-pycma Gharafi 13 (2) 15 (1) 16 (1) 17 (1) 18 (1) 19 (1) 21 (1) 15/15
NELDERDOERR doerr 22 (11) 52 (41) 83 (63) 102 (91) 119 (90) 128 (97) 203 (144) 14/15
SLSQP-11-scipy Hansen 1.6 (0.5)^★4 1.6 (0.5)^★4 1.7 (0.5)^★4 1.9 (0.5)^★4 2.0 (0.5)^★4 2.3 (0.6)^★4 2.6 (0.6)^★4 15/15

Δ f_opt
f3, 10-D 1e1
1739 1e0
3600 1e-1
3609 1e-2
3636 1e-3
3642 1e-5
3646 1e-7
3651 #succ
15/15

CMA-ES-pycma Gharafi 2.7 (1)^★4 647 (1267) 6260 (6714) 6214 (1e4) 6204 (8713) 6198 (6434) 6190 (8446) 3/15
NELDERDOERR doerr 179 (209) ∞ ∞ ∞ ∞ ∞ ∞2e5 0/15
SLSQP-11-scipy Hansen ∞ ∞ ∞ ∞ ∞ ∞ ∞2e5 0/15

Δ f_opt
f4, 10-D 1e1
2234 1e0
3626 1e-1
3660 1e-2
3695 1e-3
3707 1e-5
3744 1e-7
28767 #succ
12/15

CMA-ES-pycma Gharafi 6.9 (5)^★4 ∞ ∞ ∞ ∞ ∞ ∞5e6 0/15
NELDERDOERR doerr ∞ ∞ ∞ ∞ ∞ ∞ ∞2e5 0/15
SLSQP-11-scipy Hansen ∞ ∞ ∞ ∞ ∞ ∞ ∞2e5 0/15

Δ f_opt
f5, 10-D 1e1
20 1e0
20 1e-1
20 1e-2
20 1e-3
20 1e-5
20 1e-7
20 #succ
15/15

CMA-ES-pycma Gharafi 5.0 (1) 6.3 (1) 6.7 (1) 6.7 (1) 6.7 (1) 6.7 (1) 6.7 (1) 15/15
NELDERDOERR doerr 3.1 (0.9) 4.1 (1) 4.2 (1) 4.2 (1) 4.2 (1) 4.2 (1) 4.2 (1) 15/15
SLSQP-11-scipy Hansen 1.3 (0)^★4 2.5 (0)^★4 2.5 (0)^★4 2.5 (0)^★4 2.5 (0)^★4 2.5 (0)^★4 2.5 (0)^★4 15/15

Δ f_opt
f6, 10-D 1e1
412 1e0
623 1e-1
826 1e-2
1039 1e-3
1292 1e-5
1841 1e-7
2370 #succ
15/15

CMA-ES-pycma Gharafi 1.7 (0.5) 1.7 (0.4) 1.8 (0.3) 1.7 (0.3)^★2 1.7 (0.2)^★2 1.6 (0.2)^★3 1.6 (0.2)^★4 15/15
NELDERDOERR doerr 3.7 (3) 10 (7) 15 (6) 18 (8) 25 (20) 256 (359) ∞2e5 0/15
SLSQP-11-scipy Hansen 2.3 (0.9) 2.0 (0.5) 2.1 (0.4) 2.3 (0.3) 2.3 (0.5) 2.4 (0.5) 8.4 (11) 4/15

Δ f_opt
f7, 10-D 1e1
172 1e0
1611 1e-1
4195 1e-2
5099 1e-3
5141 1e-5
5141 1e-7
5389 #succ
15/15

CMA-ES-pycma Gharafi 1.7 (0.4) 0.84 (0.6)^★4 0.69 (0.5)^★4 0.73 (0.3)^★4 0.73 (0.3)^★4 0.73 (0.3)^★4 0.71 (0.3)^★4 15/15
NELDERDOERR doerr 59 (66) 404 (511) ∞ ∞ ∞ ∞ ∞2e5 0/15
SLSQP-11-scipy Hansen ∞ ∞ ∞ ∞ ∞ ∞ ∞2e5 0/15

Δ f_opt
f8, 10-D 1e1
326 1e0
921 1e-1
1114 1e-2
1217 1e-3
1267 1e-5
1315 1e-7
1343 #succ
15/15

CMA-ES-pycma Gharafi 1.8 (0.6) 3.8 (0.9) 3.9 (0.7) 3.9 (0.7) 4.0 (0.7) 4.1 (0.6) 4.2 (0.6) 15/15
NELDERDOERR doerr 1.3 (0.4) 2.2 (2) 2.7 (1) 2.9 (1) 3.1 (1) 3.3 (1) 3.6 (1) 15/15
SLSQP-11-scipy Hansen 1.4 (0.9) 1.1 (0.7) 0.97 (0.5)^★3 0.94 (0.5)^★3 0.93 (0.5)^★4 0.92 (0.5)^★4 0.91 (0.4)^★4 15/15

Δ f_opt
f9, 10-D 1e1
200 1e0
648 1e-1
857 1e-2
993 1e-3
1065 1e-5
1138 1e-7
1185 #succ
15/15

CMA-ES-pycma Gharafi 2.8 (0.9) 5.4 (0.8) 5.1 (0.5) 4.7 (0.4) 4.6 (0.5) 4.7 (0.4) 4.8 (0.3) 15/15
NELDERDOERR doerr 2.7 (1) 7.1 (7) 6.5 (5) 6.1 (4) 6.0 (4) 6.0 (3) 6.0 (3) 15/15
SLSQP-11-scipy Hansen 0.82 (0)^★4_↑0 0.39 (0)^★4_↑0 0.39 (0)^★4_↑0 0.39 (0)^★4_↑0 0.39 (0)^★4_↑0 0.39 (0)^★4_↑0 0.39 (0)^★4_↑0 15/15

Δ f_opt
f10, 10-D 1e1
1835 1e0
2172 1e-1
2455 1e-2
2728 1e-3
2802 1e-5
4543 1e-7
4739 #succ
15/15

CMA-ES-pycma Gharafi 1.2 (0.3) 1.2 (0.2) 1.2 (0.2) 1.2 (0.2) 1.2 (0.1) 0.81 (0.1)_↑0 0.85 (0.1)_↑0 15/15
NELDERDOERR doerr 9.5 (5) 25 (28) 34 (42) 57 (71) 335 (391) ∞ ∞2e5 0/15
SLSQP-11-scipy Hansen 0.16 (0.1)^★4_↑0 0.15 (0.1)^★4_↑0 0.14 (0.0)^★4_↑0 0.14 (0.1)^★4_↑0 0.15 (0.0)^★4_↑0 0.10 (0.0)^★4_↑0 5.3 (8) 9/15

Δ f_opt
f11, 10-D 1e1
266 1e0
1041 1e-1
2602 1e-2
2954 1e-3
3338 1e-5
4092 1e-7
4843 #succ
15/15

CMA-ES-pycma Gharafi 5.2 (0.9) 1.6 (0.2) 0.72 (0.1)_↑0 0.70 (0.1)_↑0 0.66 (0.0)_↑0 0.62 (0.0)_↑0 0.58 (0.0)^★2_↑0 15/15
NELDERDOERR doerr 13 (9) 7.8 (4) 5.4 (2) 10 (11) 17 (24) 93 (81) ∞2e5 0/15
SLSQP-11-scipy Hansen 0.25 (0.1)^★4_↑0 0.09 (0.0)^★4_↑0 0.04 (0.0)^★4_↑0 0.04 (0.0)^★4_↑0 0.05 (0.0)^★4_↑0 0.62 (0.3)_↑1 85 (98) 0/15

Δ f_opt
f12, 10-D 1e1
515 1e0
896 1e-1
1240 1e-2
1390 1e-3
1569 1e-5
3660 1e-7
5154 #succ
15/15

CMA-ES-pycma Gharafi 3.1 (2) 3.6 (3) 3.9 (3) 4.3 (3) 4.4 (2) 2.4 (0.9) 2.0 (0.7) 15/15
NELDERDOERR doerr 3.0 (6) 6.1 (8) 7.2 (6) 7.6 (6) 7.7 (6) 4.3 (3) 6.5 (7) 15/15
SLSQP-11-scipy Hansen 1.9 (2) 1.6 (1) 1.4 (0.9)^★ 1.3 (0.8)^★3 1.3 (0.7)^★4 1.2 (1)^★ 4.2 (4) 10/15

Δ f_opt
f13, 10-D 1e1
387 1e0
596 1e-1
797 1e-2
1014 1e-3
4587 1e-5
6208 1e-7
7779 #succ
15/15

CMA-ES-pycma Gharafi 2.0 (0.5) 3.0 (2) 3.2 (1) 3.5 (1) 0.89 (0.3) 1.0 (0.4)^★ 1.0 (0.4)^★4 15/15
NELDERDOERR doerr 7.2 (11) 16 (17) 40 (42) 76 (103) 64 (71) 479 (701) ∞2e5 0/15
SLSQP-11-scipy Hansen 0.65 (0.0)^★3_↑0 0.64 (0.0)^★4_↑0 0.62 (0.0)^★4_↑0 0.61 (0.0)^★4_↑0 52 (86) 266 (378) ∞3e5 0/15

Δ f_opt
f14, 10-D 1e1
37 1e0
98 1e-1
133 1e-2
205 1e-3
392 1e-5
687 1e-7
4305 #succ
15/15

CMA-ES-pycma Gharafi 1.3 (1) 2.5 (0.8) 3.4 (0.8) 3.6 (0.5) 3.0 (0.3) 3.2 (0.4) 0.76 (0.1)^★4_↑0 15/15
NELDERDOERR doerr 1.1 (1) 2.4 (0.8) 2.8 (2) 3.5 (3) 3.7 (2) 6.2 (3) 43 (29) 0/15
SLSQP-11-scipy Hansen 0.66 (0.2)_↑1 0.58 (0.1)^★4_↑0 0.70 (0.1)^★4_↑0 0.74 (0.1)^★4_↑0 0.56 (0.1)^★4_↑0 0.53 (0.1)^★4_↑0 727 (627) 0/15

Δ f_opt
f15, 10-D 1e1
4774 1e0
39246 1e-1
73643 1e-2
74669 1e-3
75790 1e-5
77814 1e-7
79834 #succ
12/15

CMA-ES-pycma Gharafi 0.99 (0.7)^★4 1.0 (0.5)^★4 0.93 (0.2)^★4 0.94 (0.3)^★4 0.94 (0.2)^★4 0.95 (0.2)^★4 0.96 (0.2)^★4 15/15
NELDERDOERR doerr 47 (42) ∞ ∞ ∞ ∞ ∞ ∞2e5 0/15
SLSQP-11-scipy Hansen ∞ ∞ ∞ ∞ ∞ ∞ ∞2e5 0/15

Δ f_opt
f16, 10-D 1e1
425 1e0
7029 1e-1
15779 1e-2
45669 1e-3
51151 1e-5
65798 1e-7
71570 #succ
15/15

CMA-ES-pycma Gharafi 2.4 (0.8) 0.65 (0.6)^★4 1.0 (0.9)^★4 0.56 (0.3)^★4_↑1 0.60 (0.6)^★4 0.49 (0.5)^★4 0.46 (0.5)^★4 15/15
NELDERDOERR doerr 1.4 (0.2)^★2 23 (21) ∞ ∞ ∞ ∞ ∞2e5 0/15
SLSQP-11-scipy Hansen 6940 (7092) ∞ ∞ ∞ ∞ ∞ ∞2e5 0/15

Δ f_opt
f17, 10-D 1e1
26 1e0
429 1e-1
2203 1e-2
6329 1e-3
9851 1e-5
20190 1e-7
26503 #succ
15/15

CMA-ES-pycma Gharafi 0.63 (2) 0.96 (0.4)^★2 0.85 (2)^★4 0.74 (0.7)^★4 0.83 (0.7)^★4 0.96 (0.3)^★4 1.1 (0.4)^★4 15/15
NELDERDOERR doerr 1.2 (1.0) 447 (624) ∞ ∞ ∞ ∞ ∞2e5 0/15
SLSQP-11-scipy Hansen 32 (64) ∞ ∞ ∞ ∞ ∞ ∞2e5 0/15

Δ f_opt
f18, 10-D 1e1
238 1e0
836 1e-1
7012 1e-2
15928 1e-3
27536 1e-5
37234 1e-7
42708 #succ
15/15

CMA-ES-pycma Gharafi 0.94 (0.4) 2.1 (5)^★4 1.0 (0.9)^★4 1.1 (0.9)^★4 0.82 (0.6)^★4 0.79 (0.5)^★4 0.92 (0.3)^★4 15/15
NELDERDOERR doerr 72 (133) 3542 (5024) ∞ ∞ ∞ ∞ ∞2e5 0/15
SLSQP-11-scipy Hansen 2547 (3007) ∞ ∞ ∞ ∞ ∞ ∞2e5 0/15

Δ f_opt
f19, 10-D 1e1
1 1e0
1 1e-1
10609 1e-2
9.8e5 1e-3
1.4e6 1e-5
1.4e6 1e-7
1.4e6 #succ
15/15

CMA-ES-pycma Gharafi 1 (0) 1 (0) 12 (8) 0.55 (0.2)_↑0 0.51 (0.3)_↑0 0.51 (0.3)_↑1 0.52 (0.3)_↑1 15/15
NELDERDOERR doerr 24 (10) 1.2e4 (1e4) ∞ ∞ ∞ ∞ ∞2e5 0/15
SLSQP-11-scipy Hansen 1 (0) 1 (0) 6.8e-3 (5e-5)^★4_↑0 ∞ ∞ ∞ ∞3e5 0/15

Δ f_opt
f20, 10-D 1e1
32 1e0
15426 1e-1
5.5e5 1e-2
5.7e5 1e-3
5.7e5 1e-5
5.8e5 1e-7
5.9e5 #succ
15/15

CMA-ES-pycma Gharafi 3.5 (2) 2.0 (1) 0.88 (0.4) 0.90 (0.4) 0.90 (0.4) 0.91 (0.4) 0.91 (0.4) 15/15
NELDERDOERR doerr 2.3 (2) 5.7 (7) ∞ ∞ ∞ ∞ ∞2e5 0/15
SLSQP-11-scipy Hansen 1 (0)^★2 4.0 (5) ∞ ∞ ∞ ∞ ∞2e5 0/15

Δ f_opt
f21, 10-D 1e1
130 1e0
2236 1e-1
4392 1e-2
4487 1e-3
4618 1e-5
5074 1e-7
11329 #succ
15/15

CMA-ES-pycma Gharafi 1.5 (0.6) 52 (58) 153 (152) 150 (148) 146 (144) 134 (131) 60 (59) 14/15
NELDERDOERR doerr 8.4 (18) 6.0 (6) 3.7 (4) 3.6 (4) 3.5 (4) 3.3 (3) 1.6 (2) 15/15
SLSQP-11-scipy Hansen 1.8 (3) 1.4 (2) 1.2 (2) 1.1 (2) 1.1 (1) 1.0 (1) 0.70 (1) 15/15

Δ f_opt
f22, 10-D 1e1
98 1e0
2839 1e-1
6353 1e-2
6620 1e-3
6798 1e-5
8296 1e-7
10351 #succ
15/15

CMA-ES-pycma Gharafi 22 (34) 191 (462) 1879 (2288) 1803 (1588) 1756 (1891) 1439 (1507) 1153 (1605) 5/15
NELDERDOERR doerr 18 (20) 2.5 (2) 5.0 (4) 4.9 (4) 4.9 (4) 4.0 (4) 3.3 (3) 14/15
SLSQP-11-scipy Hansen 1.2 (1)^★ 0.60 (0.3)^★_↑1 0.82 (1)^★ 0.79 (1)^★ 0.78 (1)^★2 0.67 (0.8)^★2 2.9 (5) 9/15

Δ f_opt
f23, 10-D 1e1
3.0 1e0
915 1e-1
16425 1e-2
1.8e5 1e-3
2.0e5 1e-5
2.1e5 1e-7
2.1e5 #succ
15/15

CMA-ES-pycma Gharafi 1.7 (2) 21 (23) 16 (22) 16 (15) 19 (32) 19 (24) 18 (37) 9/15
NELDERDOERR doerr 1.6 (2) 1.4 (1)^★3 11 (9) ∞ ∞ ∞ ∞2e5 0/15
SLSQP-11-scipy Hansen 9.3 (7) 15 (18) 87 (109) ∞ ∞ ∞ ∞2e5 0/15

Δ f_opt
f24, 10-D 1e1
98761 1e0
1.0e6 1e-1
7.5e7 1e-2
7.5e7 1e-3
7.5e7 1e-5
7.5e7 1e-7
7.5e7 #succ
1/15

CMA-ES-pycma Gharafi 38 (51) 15 (17) ∞ ∞ ∞ ∞ ∞5e6 0/15
NELDERDOERR doerr 2.6 (3) ∞ ∞ ∞ ∞ ∞ ∞2e5 0/15
SLSQP-11-scipy Hansen ∞ ∞ ∞ ∞ ∞ ∞ ∞2e5 0/15

Previous dimension | Dimension = 20 | Next dimension

Δ f_opt f1, 20-D	1e1 43	1e0 43	1e-1 43	1e-2 43	1e-3 43	1e-5 43	1e-7 43	#succ 15/15
CMA-ES-pycma Gharafi	6.7 (1)	13 (1)	19 (1)	26 (2)	32 (2)	45 (2)	58 (3)	15/15
NELDERDOERR doerr	3.3 (2)	6.7 (3)	11 (4)	16 (5)	21 (9)	32 (8)	40 (5)	15/15
SLSQP-11-scipy Hansen	0.58 (0)^★4_↑0	0.58 (0)^★4_↑0	0.58 (0)^★4_↑0	0.58 (0)^★4_↑0	0.58 (0)^★4_↑0	0.58 (0)^★4_↑0	0.58 (0)^★4_↑0	15/15

Δ f_opt
f2, 20-D 1e1
385 1e0
386 1e-1
387 1e-2
388 1e-3
390 1e-5
391 1e-7
393 #succ
15/15

CMA-ES-pycma Gharafi 20 (4) 25 (4) 27 (2) 29 (2) 31 (2) 32 (2) 33 (2) 15/15
NELDERDOERR doerr 13 (3) 17 (4) 19 (6) 23 (5) 28 (13) 36 (16) 48 (32) 15/15
SLSQP-11-scipy Hansen 2.5 (0.5)^★4 2.6 (0.5)^★4 2.8 (0.6)^★4 3.0 (0.6)^★4 3.2 (0.8)^★4 3.5 (0.9)^★4 3.8 (1)^★4 15/15

Δ f_opt
f3, 20-D 1e1
5066 1e0
7626 1e-1
7635 1e-2
7637 1e-3
7643 1e-5
7646 1e-7
7651 #succ
15/15

CMA-ES-pycma Gharafi 14 (6)^★4 1.8e4 (1e4) ∞ ∞ ∞ ∞ ∞1e7 0/15
NELDERDOERR doerr ∞ ∞ ∞ ∞ ∞ ∞ ∞4e5 0/15
SLSQP-11-scipy Hansen ∞ ∞ ∞ ∞ ∞ ∞ ∞4e5 0/15

Δ f_opt
f4, 20-D 1e1
4722 1e0
7628 1e-1
7666 1e-2
7686 1e-3
7700 1e-5
7758 1e-7
1.4e5 #succ
9/15

CMA-ES-pycma Gharafi ∞ ∞ ∞ ∞ ∞ ∞ ∞1e7 0/15
NELDERDOERR doerr ∞ ∞ ∞ ∞ ∞ ∞ ∞4e5 0/15
SLSQP-11-scipy Hansen ∞ ∞ ∞ ∞ ∞ ∞ ∞4e5 0/15

Δ f_opt
f5, 20-D 1e1
41 1e0
41 1e-1
41 1e-2
41 1e-3
41 1e-5
41 1e-7
41 #succ
15/15

CMA-ES-pycma Gharafi 4.9 (0.9) 5.7 (1) 5.9 (1) 5.9 (1) 5.9 (1) 5.9 (1) 5.9 (1) 15/15
NELDERDOERR doerr 5.2 (2) 6.1 (2) 6.3 (2) 6.3 (2) 6.3 (2) 6.3 (2) 6.3 (2) 15/15
SLSQP-11-scipy Hansen 1.7 (0)^★4 2.2 (0)^★4 2.2 (0)^★4 2.2 (0)^★4 2.2 (0)^★4 2.2 (0)^★4 2.2 (0)^★4 15/15

Δ f_opt
f6, 20-D 1e1
1296 1e0
2343 1e-1
3413 1e-2
4255 1e-3
5220 1e-5
6728 1e-7
8409 #succ
15/15

CMA-ES-pycma Gharafi 1.4 (0.2)^★2 1.2 (0.1)^★3 1.0 (0.1)^★3 1.1 (0.1)^★4 1.1 (0.1)^★3 1.1 (0.1)^★4 1.1 (0.2)^★4 15/15
NELDERDOERR doerr 9.1 (14) 15 (15) 20 (22) 46 (53) 79 (117) ∞ ∞4e5 0/15
SLSQP-11-scipy Hansen 2.5 (0.6) 2.0 (0.5) 2.1 (0.7) 2.3 (0.9) 2.4 (1) 2.6 (0.9) 8.7 (8) 0/15

Δ f_opt
f7, 20-D 1e1
1351 1e0
4274 1e-1
9503 1e-2
16523 1e-3
16524 1e-5
16524 1e-7
16969 #succ
15/15

CMA-ES-pycma Gharafi 1.3 (1)^★4 2.2 (2)^★4 1.6 (1.0)^★4 1.1 (0.4)^★4 1.1 (0.4)^★4 1.1 (0.4)^★4 1.1 (0.4)^★4 15/15
NELDERDOERR doerr 370 (372) ∞ ∞ ∞ ∞ ∞ ∞4e5 0/15
SLSQP-11-scipy Hansen ∞ ∞ ∞ ∞ ∞ ∞ ∞4e5 0/15

Δ f_opt
f8, 20-D 1e1
2039 1e0
3871 1e-1
4040 1e-2
4148 1e-3
4219 1e-5
4371 1e-7
4484 #succ
15/15

CMA-ES-pycma Gharafi 3.2 (0.6) 3.2 (0.3) 3.5 (0.3) 3.6 (0.3) 3.6 (0.3) 3.7 (0.3) 3.7 (0.3) 15/15
NELDERDOERR doerr 2.8 (6) 4.7 (4) 5.5 (4) 6.0 (4) 6.5 (4) 7.7 (4) 9.1 (8) 15/15
SLSQP-11-scipy Hansen 0.78 (0.2)_↑1 0.76 (0.6) 0.78 (0.5)^★2 0.78 (0.5)^★3 0.78 (0.5)^★3 0.77 (0.5)^★4 0.76 (0.5)^★4 15/15

Δ f_opt
f9, 20-D 1e1
1716 1e0
3102 1e-1
3277 1e-2
3379 1e-3
3455 1e-5
3594 1e-7
3727 #succ
15/15

CMA-ES-pycma Gharafi 3.8 (0.6) 4.4 (0.4) 4.7 (0.4) 4.7 (0.4) 4.8 (0.3) 4.8 (0.3) 4.8 (0.3) 15/15
NELDERDOERR doerr 3.3 (0.8) 6.1 (6) 6.6 (6) 7.0 (6) 7.5 (6) 8.4 (6) 9.3 (5) 15/15
SLSQP-11-scipy Hansen 0.35 (0)^★4_↑0 0.28 (0)^★4_↑0 0.32 (0)^★4_↑0 0.35 (0)^★4_↑0 0.36 (3e-3)^★4_↑0 0.36 (3e-3)^★4_↑0 0.36 (3e-3)^★4_↑0 15/15

Δ f_opt
f10, 20-D 1e1
7413 1e0
8661 1e-1
10735 1e-2
13641 1e-3
14920 1e-5
17073 1e-7
17476 #succ
15/15

CMA-ES-pycma Gharafi 1.2 (0.2) 1.2 (0.2) 1.0 (0.1) 0.86 (0.0)_↑0 0.81 (0.0)_↑0 0.74 (0.0)_↑0 0.76 (0.0)^★2_↑0 15/15
NELDERDOERR doerr 30 (40) ∞ ∞ ∞ ∞ ∞ ∞4e5 0/15
SLSQP-11-scipy Hansen 0.13 (0.0)^★4_↑0 0.12 (0.0)^★4_↑0 0.10 (0.0)^★4_↑0 0.09 (0.0)^★4_↑0 0.08 (0.0)^★4_↑0 0.09 (0.0)^★4_↑0 8.0 (11) 1/15

Δ f_opt
f11, 20-D 1e1
1002 1e0
2228 1e-1
6278 1e-2
8586 1e-3
9762 1e-5
12285 1e-7
14831 #succ
15/15

CMA-ES-pycma Gharafi 4.4 (0.4) 2.2 (0.1) 0.85 (0.0)_↑0 0.66 (0.0)_↑0 0.62 (0.0)_↑0 0.55 (0.0)_↑0 0.49 (0.0)^★_↑0 15/15
NELDERDOERR doerr 17 (8) 24 (16) 74 (63) ∞ ∞ ∞ ∞4e5 0/15
SLSQP-11-scipy Hansen 0.15 (0.1)^★4_↑0 0.09 (0.0)^★4_↑0 0.04 (0.0)^★4_↑0 0.03 (9e-3)^★4_↑0 0.03 (9e-3)^★4_↑0 0.64 (0.2)_↑1 36 (55) 0/15

Δ f_opt
f12, 20-D 1e1
1042 1e0
1938 1e-1
2740 1e-2
3156 1e-3
4140 1e-5
12407 1e-7
13827 #succ
15/15

CMA-ES-pycma Gharafi 2.6 (2) 3.1 (2) 3.3 (2) 3.4 (2) 3.0 (2) 1.3 (0.4) 1.4 (0.3) 15/15
NELDERDOERR doerr 13 (24) 45 (33) 61 (60) 396 (382) 1393 (1280) ∞ ∞4e5 0/15
SLSQP-11-scipy Hansen 2.8 (2) 2.1 (1) 1.7 (1) 1.6 (0.9) 1.3 (0.7)^★2 1.8 (1) 3.3 (2) 9/15

Δ f_opt
f13, 20-D 1e1
652 1e0
2021 1e-1
2751 1e-2
3507 1e-3
18749 1e-5
24455 1e-7
30201 #succ
15/15

CMA-ES-pycma Gharafi 2.9 (1) 3.8 (2) 4.0 (2) 3.3 (2) 0.77 (0.4) 1.1 (0.6)^★3 1.4 (0.5)^★4 15/15
NELDERDOERR doerr 12 (18) 18 (18) 31 (35) 87 (65) 98 (174) ∞ ∞4e5 0/15
SLSQP-11-scipy Hansen 1.2 (0.1)^★3 0.55 (0.0)^★4_↑0 0.51 (0.0)^★4_↑0 0.50 (0.0)^★4_↑0 31 (27) 131 (139) ∞5e5 0/15

Δ f_opt
f14, 20-D 1e1
75 1e0
239 1e-1
304 1e-2
451 1e-3
932 1e-5
1648 1e-7
15661 #succ
15/15

CMA-ES-pycma Gharafi 2.5 (1) 2.4 (0.4) 3.3 (0.4) 3.8 (0.3) 3.2 (0.3) 3.8 (0.2) 0.67 (0.1)^★4_↑0 15/15
NELDERDOERR doerr 2.0 (0.8) 2.1 (1) 3.5 (2) 3.7 (1) 3.0 (0.9) 21 (17) ∞4e5 0/15
SLSQP-11-scipy Hansen 0.75 (0.2)^★3_↑0 0.52 (0.1)^★4_↑0 0.69 (0.1)^★4_↑0 0.76 (0.1)^★4_↑0 0.53 (0.0)^★4_↑0 0.51 (0.0)^★4_↑0 ∞4e5 0/15

Δ f_opt
f15, 20-D 1e1
30378 1e0
1.5e5 1e-1
3.1e5 1e-2
3.2e5 1e-3
3.2e5 1e-5
4.5e5 1e-7
4.6e5 #succ
15/15

CMA-ES-pycma Gharafi 0.87 (0.6)^★4 1.0 (0.5)^★4 0.73 (0.2)^★4 0.74 (0.2)^★4 0.75 (0.2)^★4 0.55 (0.2)^★4_↑0 0.56 (0.2)^★4_↑0 15/15
NELDERDOERR doerr ∞ ∞ ∞ ∞ ∞ ∞ ∞4e5 0/15
SLSQP-11-scipy Hansen ∞ ∞ ∞ ∞ ∞ ∞ ∞4e5 0/15

Δ f_opt
f16, 20-D 1e1
1384 1e0
27265 1e-1
77015 1e-2
1.4e5 1e-3
1.9e5 1e-5
2.0e5 1e-7
2.2e5 #succ
15/15

CMA-ES-pycma Gharafi 1.7 (1.0) 0.80 (0.7)^★4 0.76 (0.8)^★4 0.88 (0.9)^★4 1.0 (0.7)^★4 1.0 (0.7)^★4 1.0 (0.6)^★4 15/15
NELDERDOERR doerr 7.2 (7) ∞ ∞ ∞ ∞ ∞ ∞4e5 0/15
SLSQP-11-scipy Hansen ∞ ∞ ∞ ∞ ∞ ∞ ∞4e5 0/15

Δ f_opt
f17, 20-D 1e1
63 1e0
1030 1e-1
4005 1e-2
12242 1e-3
30677 1e-5
56288 1e-7
80472 #succ
15/15

CMA-ES-pycma Gharafi 0.95 (1.0) 0.81 (0.3)^★4 0.82 (1)^★4 0.86 (0.6)^★4 0.76 (0.4)^★4 0.87 (0.3)^★4 0.85 (0.3)^★4 15/15
NELDERDOERR doerr 2.1 (2) ∞ ∞ ∞ ∞ ∞ ∞4e5 0/15
SLSQP-11-scipy Hansen 111 (71) ∞ ∞ ∞ ∞ ∞ ∞4e5 0/15

Δ f_opt
f18, 20-D 1e1
621 1e0
3972 1e-1
19561 1e-2
28555 1e-3
67569 1e-5
1.3e5 1e-7
1.5e5 #succ
15/15

CMA-ES-pycma Gharafi 0.83 (0.1)^★2_↑1 0.71 (0.3)^★4 0.86 (0.5)^★4 1.1 (0.4)^★4 0.94 (0.3)^★4 0.83 (0.5)^★4 0.80 (0.4)^★4 15/15
NELDERDOERR doerr 4320 (4831) ∞ ∞ ∞ ∞ ∞ ∞4e5 0/15
SLSQP-11-scipy Hansen ∞ ∞ ∞ ∞ ∞ ∞ ∞4e5 0/15

Δ f_opt
f19, 20-D 1e1
1 1e0
1 1e-1
3.4e5 1e-2
4.7e6 1e-3
6.2e6 1e-5
6.7e6 1e-7
6.7e6 #succ
15/15

CMA-ES-pycma Gharafi 1 (0) 1 (0) 1.2 (0.5) 0.57 (0.2)_↑1 0.53 (0.2)_↑0 0.56 (0.2)_↑0 0.57 (0.2)_↑0 15/15
NELDERDOERR doerr 73 (36) 4.3e5 (5e5) ∞ ∞ ∞ ∞ ∞4e5 0/15
SLSQP-11-scipy Hansen 1 (0) 1 (0) 5.6e-4 (0)^★4_↑0 ∞ ∞ ∞ ∞5e5 0/15

Δ f_opt
f20, 20-D 1e1
82 1e0
46150 1e-1
3.1e6 1e-2
5.5e6 1e-3
5.5e6 1e-5
5.6e6 1e-7
5.6e6 #succ
14/15

CMA-ES-pycma Gharafi 3.6 (0.7) 3.6 (2) 0.92 (0.4) 0.75 (0.2)_↑0 0.76 (0.2)_↑0 0.76 (0.2)_↑0 0.76 (0.2)_↑0 15/15
NELDERDOERR doerr 2.2 (2) 28 (40) ∞ ∞ ∞ ∞ ∞4e5 0/15
SLSQP-11-scipy Hansen 0.65 (0)^★4_↑0 14 (13) ∞ ∞ ∞ ∞ ∞4e5 0/15

Δ f_opt
f21, 20-D 1e1
561 1e0
6541 1e-1
14103 1e-2
14318 1e-3
14643 1e-5
15567 1e-7
17589 #succ
15/15

CMA-ES-pycma Gharafi 3.1 (5) 102 (171) 170 (238) 168 (234) 164 (229) 155 (216) 137 (191) 14/15
NELDERDOERR doerr 7.6 (11) 4.0 (5) 2.0 (2) 2.1 (2) 2.1 (2) 2.0 (2) 1.8 (2) 15/15
SLSQP-11-scipy Hansen 0.66 (0.8) 0.56 (0.6)^★2 2.8 (6) 2.8 (6) 2.7 (6) 2.6 (5) 3.3 (5) 7/15

Δ f_opt
f22, 20-D 1e1
467 1e0
5580 1e-1
23491 1e-2
24163 1e-3
24948 1e-5
26847 1e-7
1.3e5 #succ
12/15

CMA-ES-pycma Gharafi 5.1 (5) 541 (902) ∞ ∞ ∞ ∞ ∞1e7 0/15
NELDERDOERR doerr 5.2 (10) 6.5 (7) 8.3 (11) 8.2 (9) 8.0 (8) 7.5 (12) 1.5 (2) 13/15
SLSQP-11-scipy Hansen 1.0 (1) 3.2 (2) 4.1 (7) 4.0 (6) 3.8 (6) 3.6 (6) 4.3 (5) 1/15

Δ f_opt
f23, 20-D 1e1
3.0 1e0
1614 1e-1
67457 1e-2
3.7e5 1e-3
4.9e5 1e-5
8.1e5 1e-7
8.4e5 #succ
15/15

CMA-ES-pycma Gharafi 1.6 (1) 272 (376) 19 (25) 49 (42) 141 (142) 85 (80) 83 (82) 2/15
NELDERDOERR doerr 2.0 (2) 1.4 (2)^★ 86 (74) ∞ ∞ ∞ ∞4e5 0/15
SLSQP-11-scipy Hansen 13 (10) 18 (27) ∞ ∞ ∞ ∞ ∞4e5 0/15

Δ f_opt
f24, 20-D 1e1
1.3e6 1e0
7.5e6 1e-1
5.2e7 1e-2
5.2e7 1e-3
5.2e7 1e-5
5.2e7 1e-7
5.2e7 #succ
3/15

CMA-ES-pycma Gharafi 13 (20) 20 (17) ∞ ∞ ∞ ∞ ∞1e7 0/15
NELDERDOERR doerr ∞ ∞ ∞ ∞ ∞ ∞ ∞4e5 0/15
SLSQP-11-scipy Hansen ∞ ∞ ∞ ∞ ∞ ∞ ∞4e5 0/15

Previous dimension | Dimension = 40 | First dimension

Δ f_opt f1, 40-D	1e1 83	1e0 83	1e-1 83	1e-2 83	1e-3 83	1e-5 83	1e-7 83	#succ 15/15
CMA-ES-pycma Gharafi	8.5 (1)	14 (1)	20 (1)	26 (1)	32 (2)	45 (2)	57 (2)	15/15
SLSQP-11-scipy Hansen	0.54 (0)^★4_↑0	0.54 (0)^★4_↑0	0.54 (0)^★4_↑0	0.54 (0)^★4_↑0	0.54 (0)^★4_↑0	0.54 (0)^★4_↑0	0.54 (0)^★4_↑0	15/15

Δ f_opt
f2, 40-D 1e1
796 1e0
797 1e-1
799 1e-2
799 1e-3
800 1e-5
802 1e-7
804 #succ
15/15

CMA-ES-pycma Gharafi 37 (3) 45 (4) 51 (5) 55 (4) 58 (4) 61 (3) 63 (2) 15/15
SLSQP-11-scipy Hansen 3.7 (0.6)^★4 4.0 (0.7)^★4 4.2 (0.7)^★4 4.5 (0.7)^★4 4.7 (0.6)^★4 5.1 (0.6)^★4 5.5 (0.7)^★4 15/15

Δ f_opt
f3, 40-D 1e1
15526 1e0
15602 1e-1
15612 1e-2
15641 1e-3
15646 1e-5
15651 1e-7
15656 #succ
15/15

CMA-ES-pycma Gharafi 5557 (7019) ∞ ∞ ∞ ∞ ∞ ∞2e7 0/15
SLSQP-11-scipy Hansen ∞ ∞ ∞ ∞ ∞ ∞ ∞8e5 0/15

Δ f_opt
f4, 40-D 1e1
15536 1e0
15601 1e-1
15659 1e-2
15678 1e-3
15703 1e-5
15733 1e-7
2.8e5 #succ
6/15

CMA-ES-pycma Gharafi ∞ ∞ ∞ ∞ ∞ ∞ ∞2e7 0/15
SLSQP-11-scipy Hansen ∞ ∞ ∞ ∞ ∞ ∞ ∞8e5 0/15

Δ f_opt
f5, 40-D 1e1
98 1e0
116 1e-1
120 1e-2
121 1e-3
121 1e-5
121 1e-7
121 #succ
15/15

CMA-ES-pycma Gharafi 4.7 (0.8) 4.5 (0.7) 4.5 (0.5) 4.5 (0.5) 4.5 (0.5) 4.5 (0.5) 4.5 (0.5) 15/15
SLSQP-11-scipy Hansen 1.3 (0)^★4 1.5 (0)^★4 1.4 (0)^★4 1.4 (0)^★4 1.4 (0)^★4 1.4 (0)^★4 1.4 (0)^★4 15/15

Δ f_opt
f6, 40-D 1e1
3507 1e0
5523 1e-1
7168 1e-2
9470 1e-3
11538 1e-5
15007 1e-7
19222 #succ
15/15

CMA-ES-pycma Gharafi 1.5 (0.2)^★3 1.4 (0.2)^★4 1.4 (0.2)^★4 1.3 (0.2)^★4 1.3 (0.2)^★4 1.3 (0.2)^★4 1.3 (0.2)^★4 15/15
SLSQP-11-scipy Hansen 3.5 (2) 3.5 (2) 3.7 (2) 3.6 (2) 3.7 (1) 4.1 (1.0) 16 (14) 0/15

Δ f_opt
f7, 40-D 1e1
10698 1e0
17839 1e-1
41037 1e-2
66294 1e-3
66294 1e-5
66294 1e-7
68145 #succ
15/15

CMA-ES-pycma Gharafi 1.2 (0.6)^★4 3.5 (1)^★4 2.0 (0.6)^★4 1.3 (0.4)^★4 1.3 (0.4)^★4 1.3 (0.4)^★4 1.3 (0.4)^★4 15/15
SLSQP-11-scipy Hansen ∞ ∞ ∞ ∞ ∞ ∞ ∞8e5 0/15

Δ f_opt
f8, 40-D 1e1
7080 1e0
10655 1e-1
11012 1e-2
11265 1e-3
11430 1e-5
11701 1e-7
11969 #succ
15/15

CMA-ES-pycma Gharafi 5.6 (0.5) 6.4 (4) 6.5 (4) 6.5 (4) 6.5 (4) 6.4 (3) 6.4 (3) 15/15
SLSQP-11-scipy Hansen 0.94 (0.5)^★4 0.94 (0.4)^★4 0.94 (0.3)^★4 0.94 (0.3)^★4 0.94 (0.3)^★4 0.93 (0.3)^★4 0.91 (0.3)^★4 15/15

Δ f_opt
f9, 40-D 1e1
6122 1e0
12982 1e-1
13300 1e-2
13496 1e-3
13651 1e-5
13909 1e-7
14142 #succ
15/15

CMA-ES-pycma Gharafi 6.7 (0.9) 5.5 (2) 5.6 (2) 5.7 (2) 5.7 (2) 5.7 (2) 5.7 (2) 15/15
SLSQP-11-scipy Hansen 0.34 (0)^★4_↑0 0.20 (0)^★4_↑0 0.22 (0)^★4_↑0 0.23 (0)^★4_↑0 0.24 (0)^★4_↑0 0.24 (0)^★4_↑0 0.24 (1e-3)^★4_↑0 15/15

Δ f_opt
f10, 40-D 1e1
25536 1e0
29762 1e-1
35676 1e-2
51579 1e-3
56007 1e-5
65128 1e-7
70824 #succ
15/15

CMA-ES-pycma Gharafi 1.2 (0.1) 1.2 (0.1) 1.1 (0.1) 0.85 (0.0)_↑0 0.82 (0.0)_↑0 0.76 (0.0)_↑0 0.72 (0.0)^★2_↑0 15/15
SLSQP-11-scipy Hansen 0.12 (0.0)^★4_↑0 0.11 (0.0)^★4_↑0 0.10 (0.0)^★4_↑0 0.07 (0.0)^★4_↑0 0.07 (1e-2)^★4_↑0 0.07 (0.0)^★4_↑0 53 (61) 0/15

Δ f_opt
f11, 40-D 1e1
2368 1e0
4855 1e-1
11681 1e-2
25315 1e-3
29749 1e-5
38949 1e-7
48211 #succ
15/15

CMA-ES-pycma Gharafi 5.8 (0.2) 3.1 (0.1) 1.3 (0.0) 0.66 (0.0)_↑0 0.58 (0.0)_↑0 0.48 (1e-2)_↑0 0.42 (7e-3)^★_↑0 15/15
SLSQP-11-scipy Hansen 0.09 (0.0)^★4_↑0 0.06 (0.0)^★4_↑0 0.03 (7e-3)^★4_↑0 0.02 (4e-3)^★4_↑0 0.02 (4e-3)^★4_↑0 0.04 (0.0)^★4_↑0 9.0 (13) 0/15

Δ f_opt
f12, 40-D 1e1
4169 1e0
7452 1e-1
9174 1e-2
10751 1e-3
13146 1e-5
22758 1e-7
25192 #succ
15/15

CMA-ES-pycma Gharafi 1.4 (1) 1.8 (1) 2.0 (1) 2.1 (0.7) 2.0 (0.5) 1.5 (0.3) 1.5 (0.3) 15/15
SLSQP-11-scipy Hansen 2.4 (2) 1.6 (1) 1.4 (0.9) 1.3 (0.8)^★ 1.1 (0.7)^★2 4.0 (4) 8.1 (17) 11/15

Δ f_opt
f13, 40-D 1e1
2029 1e0
6916 1e-1
8734 1e-2
11861 1e-3
71936 1e-5
98467 1e-7
1.2e5 #succ
15/15

CMA-ES-pycma Gharafi 3.0 (4) 2.0 (2) 4.1 (4) 4.7 (3) 1.2 (0.7) 1.8 (0.8)^★4 1.9 (0.9)^★4 15/15
SLSQP-11-scipy Hansen 1.2 (0.0)^★4 0.48 (0.0)^★4_↑0 0.52 (0.0)^★4_↑0 0.45 (0.0)^★4_↑0 25 (38) ∞ ∞9e5 0/15

Δ f_opt
f14, 40-D 1e1
304 1e0
616 1e-1
777 1e-2
1105 1e-3
2207 1e-5
4825 1e-7
57711 #succ
15/15

CMA-ES-pycma Gharafi 2.0 (0.4) 2.2 (0.2) 2.9 (0.4) 3.6 (0.4) 3.6 (0.3) 4.2 (0.3) 0.65 (0.0)^★4_↑0 15/15
SLSQP-11-scipy Hansen 0.50 (0.1)^★4_↑0 0.49 (0.1)^★4_↑0 0.60 (0.1)^★4_↑0 0.75 (0.1)^★4_↑0 0.56 (0.1)^★4_↑0 0.47 (0.0)^★4_↑0 ∞8e5 0/15

Δ f_opt
f15, 40-D 1e1
1.9e5 1e0
7.9e5 1e-1
1.0e6 1e-2
1.1e6 1e-3
1.1e6 1e-5
1.1e6 1e-7
1.1e6 #succ
15/15

CMA-ES-pycma Gharafi 0.85 (0.3)^★4 0.65 (0.3)^★4 0.61 (0.5)^★4 0.62 (0.5)^★4 0.62 (0.5)^★4 0.63 (0.5)^★4 0.64 (0.5)^★4 15/15
SLSQP-11-scipy Hansen ∞ ∞ ∞ ∞ ∞ ∞ ∞8e5 0/15

Δ f_opt
f16, 40-D 1e1
5244 1e0
72122 1e-1
3.2e5 1e-2
7.1e5 1e-3
1.4e6 1e-5
2.0e6 1e-7
2.0e6 #succ
15/15

CMA-ES-pycma Gharafi 0.88 (0.3)^★4 0.75 (0.4)^★4 0.84 (0.9)^★4 0.74 (0.5)^★4 0.56 (0.4)^★4_↑1 0.44 (0.3)_↑0 0.46 (0.3)_↑0 15/15
SLSQP-11-scipy Hansen ∞ ∞ ∞ ∞ ∞ ∞ ∞8e5 0/15

Δ f_opt
f17, 40-D 1e1
399 1e0
4220 1e-1
14158 1e-2
34948 1e-3
51958 1e-5
1.3e5 1e-7
2.7e5 #succ
14/15

CMA-ES-pycma Gharafi 0.59 (0.2)_↑1 0.49 (0.1)^★4_↑0 0.92 (1.0)^★4 1.2 (0.5)^★4 1.2 (0.4)^★4 0.93 (0.3)^★4 0.73 (0.3)^★4 15/15
SLSQP-11-scipy Hansen 12 (38) ∞ ∞ ∞ ∞ ∞ ∞8e5 0/15

Δ f_opt
f18, 40-D 1e1
1442 1e0
16998 1e-1
47068 1e-2
1.3e5 1e-3
1.9e5 1e-5
6.7e5 1e-7
9.5e5 #succ
15/15

CMA-ES-pycma Gharafi 0.81 (0.2)^★4 0.60 (0.9)^★4 1.0 (0.4)^★4 0.74 (0.3)^★4 0.71 (0.2)^★4_↑1 0.56 (0.3)^★4_↑0 0.46 (0.2)^★4_↑0 15/15
SLSQP-11-scipy Hansen ∞ ∞ ∞ ∞ ∞ ∞ ∞8e5 0/15

Δ f_opt
f19, 40-D 1e1
1 1e0
1 1e-1
1.4e6 1e-2
1.7e7 1e-3
2.6e7 1e-5
4.5e7 1e-7
4.5e7 #succ
8/15

CMA-ES-pycma Gharafi 1 (0) 1 (0) 1.2 (1.0) 0.57 (0.4)_↑1 0.72 (0.6) 0.91 (0.7) 0.91 (0.7) 6/15
SLSQP-11-scipy Hansen 1 (0) 1 (0) 4.7e-4 (0)^★4_↑0 ∞ ∞ ∞ ∞9e5 0/15

Δ f_opt
f20, 40-D 1e1
222 1e0
1.3e5 1e-1
1.6e8 1e-2
∞ 1e-3
∞ 1e-5
∞ 1e-7
∞ #succ
0/15

CMA-ES-pycma Gharafi 3.3 (0.6) 10 (5) 0.87 (1.0) ∞ ∞ ∞ ∞2e7 0/15
SLSQP-11-scipy Hansen 0.42 (0)^★4_↑0 ∞ ∞ ∞ ∞ ∞ ∞8e5 0/15

Δ f_opt
f21, 40-D 1e1
1044 1e0
21144 1e-1
1.0e5 1e-2
1.0e5 1e-3
1.0e5 1e-5
1.0e5 1e-7
1.0e5 #succ
26/30

CMA-ES-pycma Gharafi 2.7 (4) 154 (418) 141 (217) 141 (105) 141 (154) 140 (189) 139 (98) 10/15
SLSQP-11-scipy Hansen 0.55 (0.7) 0.84 (2) 0.29 (0.3)_↑1 0.29 (0.3)_↑1 0.29 (0.3)_↑1 0.30 (0.3)_↑1 1.6 (4) 5/15

Δ f_opt
f22, 40-D 1e1
3090 1e0
35442 1e-1
6.5e5 1e-2
6.5e5 1e-3
6.5e5 1e-5
6.5e5 1e-7
6.5e5 #succ
8/30

CMA-ES-pycma Gharafi 113 (415) 250 (334) ∞ ∞ ∞ ∞ ∞2e7 0/15
SLSQP-11-scipy Hansen 0.83 (0.9) 5.2 (11) 2.4 (3) 2.4 (3) 2.4 (2) 2.4 (3) 8.6 (8) 0/15

Δ f_opt
f23, 40-D 1e1
7.0 1e0
11925 1e-1
75453 1e-2
6.6e5 1e-3
1.3e6 1e-5
3.2e6 1e-7
3.4e6 #succ
15/15

CMA-ES-pycma Gharafi 1.4 (2)^★ 6.8 (8) 21 (4) 22 (17) 103 (102) 87 (96) 84 (89) 1/15
SLSQP-11-scipy Hansen 12 (11) 6.8 (8) ∞ ∞ ∞ ∞ ∞8e5 0/15

Δ f_opt
f24, 40-D 1e1
5.8e6 1e0
9.8e7 1e-1
3.0e8 1e-2
3.0e8 1e-3
3.0e8 1e-5
3.0e8 1e-7
3.0e8 #succ
1/15

CMA-ES-pycma Gharafi 8.4 (10) ∞ ∞ ∞ ∞ ∞ ∞2e7 0/15
SLSQP-11-scipy Hansen ∞ ∞ ∞ ∞ ∞ ∞ ∞8e5 0/15

Expected runtime (ERT in number of f-evaluations) divided by the respective best ERT measured during BBOB-2009 (when finite) in different dimensions. This ERT ratio and, in braces as dispersion measure, the half difference between 10 and 90%-tile of (bootstrapped) run lengths appear for each algorithm and target, the corresponding reference ERT in the first row. The different target ∆f-values are shown in the top row. #succ is the number of trials that reached the (final) target f_opt+ 10⁻⁸. The median number of conducted function evaluations is additionally given in italics, if the target in the last column was never reached. The best entry is marked by a star when the largest p-value of pairwise rank-sum tests with the other algorithms either obeys 0.01 < p ≤ 0.05 or 10^−k−1 < p ≤ 10^−k when the star is followed by the number k, with Bonferroni correction by the number of functions (24). A ↑ signifies the number of trials that were worse than the ERT of the best algorithm from BBOB 2009 shown only when less than 10 percent were worse and the ERT was better. Best results are printed in bold.

Δ f_opt f3, 5-D	1e1 716	1e0 1622	1e-1 1637	1e-2 1642	1e-3 1646	1e-5 1650	1e-7 1654	#succ 15/15
CMA-ES-pycma Gharafi	0.79 (0.4)	28 (74)	853 (1394)	1087 (1531)	1085 (1757)	1083 (1117)	1081 (1261)	10/15
NELDERDOERR doerr	1.5 (3)	33 (39)	268 (267)	268 (281)	267 (329)	266 (294)	266 (268)	3/15
SLSQP-11-scipy Hansen	17 (25)	879 (826)	∞	∞	∞	∞	∞1e5	0/15

Δ f_opt f4, 5-D	1e1 809	1e0 1633	1e-1 1688	1e-2 1758	1e-3 1817	1e-5 1886	1e-7 1903	#succ 15/15
CMA-ES-pycma Gharafi	1.9 (2)^★	∞	∞	∞	∞	∞	∞3e6	0/15
NELDERDOERR doerr	7.1 (5)	898 (1087)	870 (622)	835 (825)	808 (1032)	779 (663)	772 (749)	1/15
SLSQP-11-scipy Hansen	59 (48)	∞	∞	∞	∞	∞	∞1e5	0/15

Δ f_opt f5, 5-D	1e1 10	1e0 10	1e-1 10	1e-2 10	1e-3 10	1e-5 10	1e-7 10	#succ 15/15
CMA-ES-pycma Gharafi	4.8 (2)	6.4 (2)	6.5 (2)	6.5 (2)	6.5 (2)	6.5 (2)	6.5 (2)	15/15
NELDERDOERR doerr	1.9 (0.8)	2.4 (0.8)	2.5 (0.8)	2.5 (0.8)	2.5 (0.8)	2.5 (0.8)	2.5 (0.8)	15/15
SLSQP-11-scipy Hansen	1.6 (0)	2.3 (0)	3.0 (0)	3.0 (0)	3.0 (0)	3.0 (0)	3.0 (0)	15/15

Δ f_opt f6, 5-D	1e1 114	1e0 214	1e-1 281	1e-2 404	1e-3 580	1e-5 1038	1e-7 1332	#succ 15/15
CMA-ES-pycma Gharafi	1.6 (0.7)	1.7 (0.4)	1.9 (0.4)	1.7 (0.3)	1.5 (0.2)	1.1 (0.1)	1.1 (0.1)	15/15
NELDERDOERR doerr	5.1 (7)	5.6 (7)	5.6 (6)	4.9 (4)	5.3 (6)	5.6 (5)	8.5 (7)	14/15
SLSQP-11-scipy Hansen	2.9 (1)	2.1 (1)	2.2 (1)	1.7 (0.9)	1.4 (0.6)	0.99 (0.5)	2.2 (2)	15/15

Δ f_opt f7, 5-D	1e1 24	1e0 324	1e-1 1171	1e-2 1451	1e-3 1572	1e-5 1572	1e-7 1597	#succ 15/15
CMA-ES-pycma Gharafi	2.8 (3)	1.1 (1.0)	0.58 (0.3)^★2_↑0	0.59 (0.3)^★4_↑0	0.61 (0.3)^★4_↑0	0.61 (0.3)^★4_↑0	0.63 (0.3)^★4_↑0	15/15
NELDERDOERR doerr	1.3 (0.5)	7.5 (12)	15 (11)	39 (41)	71 (55)	71 (75)	71 (47)	9/15
SLSQP-11-scipy Hansen	286 (599)	1064 (1248)	∞	∞	∞	∞	∞1e5	0/15

Δ f_opt f8, 5-D	1e1 73	1e0 273	1e-1 336	1e-2 372	1e-3 391	1e-5 410	1e-7 422	#succ 15/15
CMA-ES-pycma Gharafi	2.6 (1.0)	4.2 (4)	4.6 (4)	4.7 (4)	4.7 (3)	5.0 (3)	5.3 (3)	15/15
NELDERDOERR doerr	2.1 (2)	2.4 (2)	2.4 (2)	2.3 (2)	2.3 (1)	2.4 (1)	2.4 (1)	15/15
SLSQP-11-scipy Hansen	1.3 (0.5)	1.1 (0.9)	1.0 (0.8)	1.0 (0.6)^★	1.0 (0.6)^★	1.0 (0.6)^★2	1.0 (0.6)^★2	15/15

Δ f_opt f9, 5-D	1e1 35	1e0 127	1e-1 214	1e-2 263	1e-3 300	1e-5 335	1e-7 369	#succ 15/15
CMA-ES-pycma Gharafi	4.2 (2)	6.0 (2)	5.2 (1)	5.0 (1)	4.7 (1)	4.7 (1)	4.7 (1)	15/15
NELDERDOERR doerr	2.3 (0.9)	3.1 (2)	2.5 (1)	2.3 (0.9)	2.1 (0.8)	2.1 (0.7)	2.0 (0.7)	15/15
SLSQP-11-scipy Hansen	0.63 (0)^★4_↑0	0.46 (0)^★4_↑0	0.54 (0)^★4_↑0	0.55 (0)^★4_↑0	0.53 (0)^★4_↑0	0.51 (0)^★4_↑0	0.50 (0)^★4_↑0	15/15

Δ f_opt f10, 5-D	1e1 349	1e0 500	1e-1 574	1e-2 607	1e-3 626	1e-5 829	1e-7 880	#succ 15/15
CMA-ES-pycma Gharafi	1.7 (0.7)	1.5 (0.5)	1.5 (0.3)	1.6 (0.3)	1.6 (0.3)	1.4 (0.2)	1.5 (0.2)	15/15
NELDERDOERR doerr	1.2 (0.9)	1.3 (0.6)	1.2 (0.5)	1.2 (0.5)	1.2 (0.5)	1.0 (0.4)	1.00 (0.4)	15/15
SLSQP-11-scipy Hansen	0.25 (0.1)^★4_↑0	0.20 (0.0)^★4_↑0	0.19 (0.0)^★4_↑0	0.19 (0.0)^★4_↑0	0.20 (0.0)^★4_↑0	0.22 (0.1)^★4_↑0	23 (31)	10/15

Δ f_opt f11, 5-D	1e1 143	1e0 202	1e-1 763	1e-2 977	1e-3 1177	1e-5 1467	1e-7 1673	#succ 15/15
CMA-ES-pycma Gharafi	3.6 (1.0)	3.3 (0.6)	0.98 (0.2)	0.85 (0.1)_↑1	0.77 (0.1)_↑0	0.73 (0.1)_↑0	0.73 (0.1)^★_↑0	15/15
NELDERDOERR doerr	4.5 (4)	4.7 (3)	1.5 (0.8)	1.4 (0.6)	1.2 (0.5)	1.1 (0.5)	1.2 (0.5)	15/15
SLSQP-11-scipy Hansen	0.28 (0.1)^★4_↑0	0.27 (0.1)^★4_↑0	0.08 (0.0)^★4_↑0	0.07 (0.0)^★4_↑0	0.07 (0.0)^★4_↑0	7.2 (17)	195 (234)	0/15

Δ f_opt f12, 5-D	1e1 108	1e0 268	1e-1 371	1e-2 413	1e-3 461	1e-5 1303	1e-7 1494	#succ 15/15
CMA-ES-pycma Gharafi	10 (11)	6.9 (9)	7.0 (9)	7.4 (9)	7.4 (8)	3.4 (3)	3.4 (3)	15/15
NELDERDOERR doerr	4.4 (6)	2.9 (4)	2.7 (3)	2.7 (3)	2.7 (2)	1.1 (1.0)	1.2 (1.0)	15/15
SLSQP-11-scipy Hansen	2.8 (3)	1.7 (2)	1.5 (2)	1.5 (2)	1.5 (2)	0.88 (0.7)	4.2 (6)	11/15

Δ f_opt f13, 5-D	1e1 132	1e0 195	1e-1 250	1e-2 319	1e-3 1310	1e-5 1752	1e-7 2255	#succ 15/15
CMA-ES-pycma Gharafi	2.3 (0.8)	3.0 (1)	3.6 (0.9)	3.4 (0.6)	0.97 (0.2)	0.99 (0.2)	1.00 (0.1)	15/15
NELDERDOERR doerr	2.4 (3)	2.4 (3)	5.2 (6)	6.1 (9)	1.9 (2)	3.9 (3)	5.0 (5)	15/15
SLSQP-11-scipy Hansen	0.76 (0.1)_↑0	0.74 (0.1)_↑0	0.76 (0.1)^★2_↑0	0.73 (0.0)^★4_↑0	35 (45)	437 (554)	∞1e5	0/15

Δ f_opt f14, 5-D	1e1 10	1e0 41	1e-1 58	1e-2 90	1e-3 139	1e-5 251	1e-7 476	#succ 15/15
CMA-ES-pycma Gharafi	0.64 (0.7)	1.8 (0.8)	3.0 (1.0)	3.2 (0.7)	3.3 (0.6)	3.2 (0.4)	2.5 (0.2)	15/15
NELDERDOERR doerr	1.0 (0.7)	1.1 (0.4)	1.4 (0.6)	1.6 (0.5)	1.7 (0.6)	1.6 (0.5)	1.3 (0.4)^★3	15/15
SLSQP-11-scipy Hansen	0.89 (0.8)	0.58 (0.3)^★2_↑0	0.74 (0.2)^★4_↑0	0.77 (0.2)^★4_↑1	0.70 (0.1)^★4_↑0	0.59 (0.1)^★4_↑0	512 (1034)	3/15

Δ f_opt f15, 5-D	1e1 511	1e0 9310	1e-1 19369	1e-2 19743	1e-3 20073	1e-5 20769	1e-7 21359	#succ 14/15
CMA-ES-pycma Gharafi	1.1 (0.4)^★2	1.1 (0.7)^★3	1.2 (0.7)^★4	1.2 (0.7)^★4	1.2 (0.7)^★4	1.2 (0.7)^★3	1.2 (0.7)^★3	15/15
NELDERDOERR doerr	4.5 (5)	20 (25)	73 (101)	72 (89)	71 (139)	69 (51)	67 (51)	1/15
SLSQP-11-scipy Hansen	30 (33)	153 (174)	∞	∞	∞	∞	∞1e5	0/15

Δ f_opt f16, 5-D	1e1 120	1e0 612	1e-1 2662	1e-2 10163	1e-3 10449	1e-5 11644	1e-7 12095	#succ 15/15
CMA-ES-pycma Gharafi	1.9 (1)	2.5 (2)	1.2 (1)^★3	0.53 (0.6)^★4	0.58 (0.6)^★4	0.57 (0.5)^★4	0.57 (0.5)^★4	15/15
NELDERDOERR doerr	1.6 (3)	4.8 (7)	10 (10)	6.3 (6)	13 (19)	59 (60)	119 (165)	0/15
SLSQP-11-scipy Hansen	250 (459)	∞	∞	∞	∞	∞	∞1e5	0/15

Δ f_opt f17, 5-D	1e1 5.0	1e0 215	1e-1 899	1e-2 2861	1e-3 3669	1e-5 6351	1e-7 7934	#succ 15/15
CMA-ES-pycma Gharafi	1.6 (2)	1.5 (0.3)	0.97 (1)^★3	0.66 (0.6)^★4	0.67 (0.5)^★4	0.80 (0.8)^★4	1.0 (0.5)^★4	15/15
NELDERDOERR doerr	2.0 (2)	10 (17)	48 (48)	∞	∞	∞	∞1e5	0/15
SLSQP-11-scipy Hansen	31 (62)	300 (261)	∞	∞	∞	∞	∞1e5	0/15

Δ f_opt f18, 5-D	1e1 103	1e0 378	1e-1 3968	1e-2 8451	1e-3 9280	1e-5 10905	1e-7 12469	#succ 15/15
CMA-ES-pycma Gharafi	0.81 (0.4)	3.9 (6)	0.87 (0.9)^★2	0.76 (0.7)^★4	0.79 (0.5)^★4	0.80 (0.4)^★4	0.89 (0.6)^★4	15/15
NELDERDOERR doerr	4.3 (7)	28 (34)	43 (56)	∞	∞	∞	∞1e5	0/15
SLSQP-11-scipy Hansen	46 (39)	∞	∞	∞	∞	∞	∞1e5	0/15

Δ f_opt f19, 5-D	1e1 1	1e0 1	1e-1 242	1e-2 1.0e5	1e-3 1.2e5	1e-5 1.2e5	1e-7 1.2e5	#succ 15/15
CMA-ES-pycma Gharafi	1 (0)	1 (0)	126 (104)	0.81 (0.8)	0.92 (0.6)	0.93 (0.6)	0.94 (0.6)	15/15
NELDERDOERR doerr	12 (9)	340 (262)	107 (156)	14 (10)	∞	∞	∞1e5	0/15
SLSQP-11-scipy Hansen	1 (0)	1 (0)	0.12 (0)^★4_↑0	∞	∞	∞	∞1e5	0/15

Δ f_opt f20, 5-D	1e1 16	1e0 851	1e-1 38111	1e-2 51362	1e-3 54470	1e-5 54861	1e-7 55313	#succ 14/15
CMA-ES-pycma Gharafi	1.9 (1)	5.7 (6)	1.1 (0.7)^★4	0.89 (0.5)^★4	0.85 (0.5)^★4	0.88 (0.5)^★4	0.89 (0.5)^★4	15/15
NELDERDOERR doerr	2.2 (2)	8.5 (6)	37 (36)	28 (27)	26 (19)	26 (36)	26 (25)	1/15
SLSQP-11-scipy Hansen	0.81 (0)_↑0	2.3 (2)	∞	∞	∞	∞	∞1e5	0/15

Δ f_opt f21, 5-D	1e1 41	1e0 1157	1e-1 1674	1e-2 1692	1e-3 1705	1e-5 1729	1e-7 1757	#succ 14/15
CMA-ES-pycma Gharafi	3.7 (1)	53 (6)	148 (263)	146 (260)	145 (259)	144 (256)	141 (253)	14/15
NELDERDOERR doerr	2.9 (6)	1.5 (2)	1.2 (1)	1.2 (1)	1.2 (1)	1.2 (1)	1.2 (1)	15/15
SLSQP-11-scipy Hansen	1.3 (2)	0.81 (0.9)	1.3 (0.7)	1.2 (0.7)	1.2 (0.7)	1.3 (0.7)	1.4 (1)	15/15

Δ f_opt f22, 5-D	1e1 71	1e0 386	1e-1 938	1e-2 980	1e-3 1008	1e-5 1040	1e-7 1068	#succ 14/15
CMA-ES-pycma Gharafi	5.1 (10)	6.0 (8)	204 (213)	277 (582)	269 (566)	262 (549)	255 (534)	15/15
NELDERDOERR doerr	2.5 (6)	2.5 (3)	2.1 (4)	2.0 (4)	2.0 (4)	2.0 (3)	2.1 (3)	15/15
SLSQP-11-scipy Hansen	1.8 (2)	1.1 (0.7)	1.8 (2)	1.7 (2)	1.7 (2)	1.7 (2)	2.0 (2)	14/15

Δ f_opt f23, 5-D	1e1 3.0	1e0 518	1e-1 14249	1e-2 27890	1e-3 31654	1e-5 33030	1e-7 34256	#succ 15/15
CMA-ES-pycma Gharafi	1.8 (2)	9.4 (9)	17 (15)	9.4 (8)	8.3 (7)	8.0 (7)	7.8 (6)	14/15
NELDERDOERR doerr	1.5 (1)	1.00 (1)^★3	1.0 (2)	3.6 (4)	15 (15)	∞	∞1e5	0/15
SLSQP-11-scipy Hansen	27 (8)	13 (19)	17 (19)	25 (30)	∞	∞	∞1e5	0/15

Δ f_opt f24, 5-D	1e1 1622	1e0 2.2e5	1e-1 6.4e6	1e-2 9.6e6	1e-3 9.6e6	1e-5 1.3e7	1e-7 1.3e7	#succ 3/15
CMA-ES-pycma Gharafi	2.2 (2)	46 (72)	5.5 (6)	∞	∞	∞	∞3e6	0/15
NELDERDOERR doerr	1.0 (1)	1.4 (2)	∞	∞	∞	∞	∞1e5	0/15
SLSQP-11-scipy Hansen	6.4 (7)	∞	∞	∞	∞	∞	∞1e5	0/15

Δ f_opt f2, 10-D	1e1 187	1e0 190	1e-1 191	1e-2 191	1e-3 193	1e-5 194	1e-7 195	#succ 15/15
CMA-ES-pycma Gharafi	13 (2)	15 (1)	16 (1)	17 (1)	18 (1)	19 (1)	21 (1)	15/15
NELDERDOERR doerr	22 (11)	52 (41)	83 (63)	102 (91)	119 (90)	128 (97)	203 (144)	14/15
SLSQP-11-scipy Hansen	1.6 (0.5)^★4	1.6 (0.5)^★4	1.7 (0.5)^★4	1.9 (0.5)^★4	2.0 (0.5)^★4	2.3 (0.6)^★4	2.6 (0.6)^★4	15/15

Δ f_opt f3, 10-D	1e1 1739	1e0 3600	1e-1 3609	1e-2 3636	1e-3 3642	1e-5 3646	1e-7 3651	#succ 15/15
CMA-ES-pycma Gharafi	2.7 (1)^★4	647 (1267)	6260 (6714)	6214 (1e4)	6204 (8713)	6198 (6434)	6190 (8446)	3/15
NELDERDOERR doerr	179 (209)	∞	∞	∞	∞	∞	∞2e5	0/15
SLSQP-11-scipy Hansen	∞	∞	∞	∞	∞	∞	∞2e5	0/15

Δ f_opt f4, 10-D	1e1 2234	1e0 3626	1e-1 3660	1e-2 3695	1e-3 3707	1e-5 3744	1e-7 28767	#succ 12/15
CMA-ES-pycma Gharafi	6.9 (5)^★4	∞	∞	∞	∞	∞	∞5e6	0/15
NELDERDOERR doerr	∞	∞	∞	∞	∞	∞	∞2e5	0/15
SLSQP-11-scipy Hansen	∞	∞	∞	∞	∞	∞	∞2e5	0/15

Δ f_opt f5, 10-D	1e1 20	1e0 20	1e-1 20	1e-2 20	1e-3 20	1e-5 20	1e-7 20	#succ 15/15
CMA-ES-pycma Gharafi	5.0 (1)	6.3 (1)	6.7 (1)	6.7 (1)	6.7 (1)	6.7 (1)	6.7 (1)	15/15
NELDERDOERR doerr	3.1 (0.9)	4.1 (1)	4.2 (1)	4.2 (1)	4.2 (1)	4.2 (1)	4.2 (1)	15/15
SLSQP-11-scipy Hansen	1.3 (0)^★4	2.5 (0)^★4	2.5 (0)^★4	2.5 (0)^★4	2.5 (0)^★4	2.5 (0)^★4	2.5 (0)^★4	15/15

Δ f_opt f6, 10-D	1e1 412	1e0 623	1e-1 826	1e-2 1039	1e-3 1292	1e-5 1841	1e-7 2370	#succ 15/15
CMA-ES-pycma Gharafi	1.7 (0.5)	1.7 (0.4)	1.8 (0.3)	1.7 (0.3)^★2	1.7 (0.2)^★2	1.6 (0.2)^★3	1.6 (0.2)^★4	15/15
NELDERDOERR doerr	3.7 (3)	10 (7)	15 (6)	18 (8)	25 (20)	256 (359)	∞2e5	0/15
SLSQP-11-scipy Hansen	2.3 (0.9)	2.0 (0.5)	2.1 (0.4)	2.3 (0.3)	2.3 (0.5)	2.4 (0.5)	8.4 (11)	4/15

Δ f_opt f7, 10-D	1e1 172	1e0 1611	1e-1 4195	1e-2 5099	1e-3 5141	1e-5 5141	1e-7 5389	#succ 15/15
CMA-ES-pycma Gharafi	1.7 (0.4)	0.84 (0.6)^★4	0.69 (0.5)^★4	0.73 (0.3)^★4	0.73 (0.3)^★4	0.73 (0.3)^★4	0.71 (0.3)^★4	15/15
NELDERDOERR doerr	59 (66)	404 (511)	∞	∞	∞	∞	∞2e5	0/15
SLSQP-11-scipy Hansen	∞	∞	∞	∞	∞	∞	∞2e5	0/15

Δ f_opt f8, 10-D	1e1 326	1e0 921	1e-1 1114	1e-2 1217	1e-3 1267	1e-5 1315	1e-7 1343	#succ 15/15
CMA-ES-pycma Gharafi	1.8 (0.6)	3.8 (0.9)	3.9 (0.7)	3.9 (0.7)	4.0 (0.7)	4.1 (0.6)	4.2 (0.6)	15/15
NELDERDOERR doerr	1.3 (0.4)	2.2 (2)	2.7 (1)	2.9 (1)	3.1 (1)	3.3 (1)	3.6 (1)	15/15
SLSQP-11-scipy Hansen	1.4 (0.9)	1.1 (0.7)	0.97 (0.5)^★3	0.94 (0.5)^★3	0.93 (0.5)^★4	0.92 (0.5)^★4	0.91 (0.4)^★4	15/15

Δ f_opt f9, 10-D	1e1 200	1e0 648	1e-1 857	1e-2 993	1e-3 1065	1e-5 1138	1e-7 1185	#succ 15/15
CMA-ES-pycma Gharafi	2.8 (0.9)	5.4 (0.8)	5.1 (0.5)	4.7 (0.4)	4.6 (0.5)	4.7 (0.4)	4.8 (0.3)	15/15
NELDERDOERR doerr	2.7 (1)	7.1 (7)	6.5 (5)	6.1 (4)	6.0 (4)	6.0 (3)	6.0 (3)	15/15
SLSQP-11-scipy Hansen	0.82 (0)^★4_↑0	0.39 (0)^★4_↑0	0.39 (0)^★4_↑0	0.39 (0)^★4_↑0	0.39 (0)^★4_↑0	0.39 (0)^★4_↑0	0.39 (0)^★4_↑0	15/15