Overview page

Table showing the aRT in number of function evaluations divided by the best aRT measured during BBOB-2009

Last dimension | Dimension = 2 | Next dimension

Δ fopt
f101, 2-D		 1e1
2.0		 1e0
8.0		 1e-1
10		 1e-2
11		 1e-3
14		 1e-5
20		 1e-7
23		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 3.5 (11)4.4 (6)10 (9)20 (10)23 (12)34 (11)47 (7)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 3.9 (6)4.1 (2)6.2 (6)7.8 (2)10 (3)11 (3)13 (2)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 5.9 (11)6.2 (10)11 (9)23 (6)27 (8)31 (12)45 (8)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 9.3 (8)6.7 (3)8.3 (4)10 (4)11 (8)12 (2)14 (2)15/15

Δ fopt
f102, 2-D		 1e1
2.0		 1e0
7.0		 1e-1
11		 1e-2
17		 1e-3
19		 1e-5
25		 1e-7
31		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 6.1 (9)7.2 (13)12 (19)16 (7)21 (9)31 (6)34 (5)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 4.5 (12)3.8 (5)5.4 (3)5.8 (2)7.6 (2)9.0 (2)10 (2)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 2.3 (5)6.4 (5)13 (7)16 (5)18 (3)27 (8)36 (6)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 4.6 (7)4.2 (6)5.3 (4)4.9 (3)6.3 (2)8.1 (0.9)9.5 (1)15/15

Δ fopt
f103, 2-D		 1e1
2.0		 1e0
8.0		 1e-1
9.0		 1e-2
9.0		 1e-3
9.0		 1e-5
10		 1e-7
14		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 9.0 (20)8.5 (9)16 (7)32 (14)50 (18)73 (15)83 (19)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 6.0 (7)5.6 (6)7.4 (6)11 (6)16 (4)25 (5)25 (3)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 7.0 (11)6.9 (5)12 (6)29 (23)49 (17)74 (17)86 (13)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 11 (40)8.8 (28)39 (74)43 (61)49 (70)59 (122)54 (3)15/15

Δ fopt
f104, 2-D		 1e1
5.0		 1e0
15		 1e-1
194		 1e-2
240		 1e-3
248		 1e-5
256		 1e-7
263		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 15 (26)20 (4)4.5 (5)6.7 (17)10 (4)11 (5)11 (10)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 5.7 (6)8.2 (2)162 (1045)308 (212)299 (613)529 (398)675 (580)8/15
PSAaSmC-CMA-ES Nishida bbob-noisy 8.3 (6)10 (8)4.0 (7)6.8 (7)8.6 (9)10 (3)10 (7)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 5.0 (7)4.3 (3)386 (797)756 (1321)1701 (1917)2256 (4109)2196 (1437)4/15

Δ fopt
f105, 2-D		 1e1
5.0		 1e0
15		 1e-1
357		 1e-2
371		 1e-3
381		 1e-5
397		 1e-7
410		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 5.5 (6)12 (21)43 (2)204 (550)199 (405)192 (388)187 (126)11/15
PSAaLmD-CMA-ES Nishida bbob-noisy 6.4 (6)4.7 (7)378 (283)625 (545)799 (1594)1403 (1915)1359 (1115)4/15
PSAaSmC-CMA-ES Nishida bbob-noisy 12 (9)2100 (3400)144 (287)142 (276)140 (269)135 (387)131 (126)12/15
PSAaSmD-CMA-ES Nishida bbob-noisy 2906 (3e4)3381 (1e4)511 (452)835 (1361)1082 (2387)1424 (1933)1380 (2439)4/15

Δ fopt
f106, 2-D		 1e1
5.0		 1e0
15		 1e-1
139		 1e-2
280		 1e-3
352		 1e-5
490		 1e-7
650		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 8.5 (7)10 (5)5.0 (4)4.7 (3)5.0 (3)4.1 (1)3.6 (0.8)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 5.3 (7)10 (16)4.6 (3)8.9 (7)8.3 (7)6.9 (7)5.3 (5)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 10 (7)15 (9)5.3 (8)6.4 (5)6.4 (6)5.5 (4)4.6 (3)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 4.3 (3)5.8 (4)6.1 (5)4.9 (7)9.4 (9)10 (13)12 (16)14/15

Δ fopt
f107, 2-D		 1e1
2.0		 1e0
13		 1e-1
28		 1e-2
113		 1e-3
158		 1e-5
255		 1e-7
421		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 8.8 (25)5.3 (5)6.1 (5)2.7 (1)2.9 (1)3.4 (0.9)3.3 (0.6)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 7.0 (10)5.2 (4)3.5 (1)1.4 (2)1.4 (0.9)1.3 (0.3)1.2 (0.4)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 7.4 (16)5.5 (7)5.5 (6)3.0 (1)3.4 (2)3.7 (0.6)3.5 (0.5)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 18 (11)6.4 (16)563 (10)288 (0.6)206 (318)128 (197)78 (120)13/15

Δ fopt
f108, 2-D		 1e1
2.0		 1e0
30		 1e-1
202		 1e-2
1425		 1e-3
3422		 1e-5
7369		 1e-7
15979		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 95 (606)70 (190)14 (25)5.6 (12)7.2 (8)4.1 (3)2.5 (7)14/15
PSAaLmD-CMA-ES Nishida bbob-noisy 13 (3)503 (25)80 (7)12 (37)5.4 (0.8)3.3 (7)2.0 (7)14/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1257 (6)491 (1696)76 (254)12 (36)5.4 (15)3.1 (14)1.9 (0.3)14/15
PSAaSmD-CMA-ES Nishida bbob-noisy 2.6e4 (3e4)4725 (5119)1194 (2289)582 (401)847 (967)394 (525)182 (232)1/15

Δ fopt
f109, 2-D		 1e1
2.0		 1e0
10		 1e-1
13		 1e-2
67		 1e-3
68		 1e-5
96		 1e-7
96		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 17 (50)7.0 (12)13 (7)4.5 (2)7.1 (3)11 (2)17 (3)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 3.0 (1)2.8 (4)3.8 (3)1.4 (0.6)2.4 (1)3.8 (1)7.7 (2)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 9.0 (24)5.6 (3)11 (8)4.0 (2)6.8 (3)10 (2)18 (4)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 11 (8)5.9 (2)19 (54)6.9 (20)8.4 (22)10 (22)17 (26)15/15

Δ fopt
f110, 2-D		 1e1
7.0		 1e0
34		 1e-1
623		 1e-2
1301		 1e-3
2319		 1e-5
8407		 1e-7
9154		 #succ
14/15
PSAaLmC-CMA-ES Nishida bbob-noisy 8.5 (9)5.4 (2)0.72 (1)28 (49)62 (44)17 (48)16 (35)9/15
PSAaLmD-CMA-ES Nishida bbob-noisy 4.2 (7)50 (2)285 (567)235 (317)176 (286)67 (61)61 (89)4/15
PSAaSmC-CMA-ES Nishida bbob-noisy 5.2 (5)428 (4)163 (325)315 (818)351 (590)97 (144)89 (94)3/15
PSAaSmD-CMA-ES Nishida bbob-noisy 2077 (7262)1499 (3)284 (490)431 (701)351 (348)157 (367)144 (116)2/15

Δ fopt
f111, 2-D		 1e1
24		 1e0
119		 1e-1
718		 1e-2
5415		 1e-3
12718		 1e-5
61860		 1e-7
1.7e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 2.8 (5)122 (847)103 (142)28 (28)32 (72)14 (17)5.0 (5)3/15
PSAaLmD-CMA-ES Nishida bbob-noisy 18 (63)131 (13)248 (424)43 (38)35 (36)14 (19)5.2 (11)3/15
PSAaSmC-CMA-ES Nishida bbob-noisy 10 (6)126 (2)46 (213)33 (37)19 (24)6.8 (12)2.6 (2)5/15
PSAaSmD-CMA-ES Nishida bbob-noisy 4237 (73)1965 (3859)1150 (1282)532 (470)226 (240)47 (53)17 (20)1/15

Δ fopt
f112, 2-D		 1e1
5.0		 1e0
15		 1e-1
625		 1e-2
1043		 1e-3
1154		 1e-5
1373		 1e-7
1531		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 7.5 (6)10 (12)1.8 (1.0)2.7 (3)4.7 (9)4.5 (7)4.3 (1)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 8.7 (6)87 (337)5.1 (11)6.9 (10)7.1 (12)10 (5)9.1 (9)14/15
PSAaSmC-CMA-ES Nishida bbob-noisy 8.1 (7)9.3 (8)0.75 (1)4.1 (17)7.4 (1)6.7 (10)6.3 (10)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 6.1 (7)28 (41)5.8 (9)6.1 (4)10 (19)13 (6)12 (11)12/15

Δ fopt
f113, 2-D		 1e1
5.0		 1e0
31		 1e-1
87		 1e-2
140		 1e-3
174		 1e-5
174		 1e-7
876		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 7.6 (10)3.2 (2)5.1 (2)226 (1)182 (1)182 (1453)36 (0.3)13/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.6 (4)2.3 (3)666 (1)599 (1595)482 (1505)482 (2266)96 (215)11/15
PSAaSmC-CMA-ES Nishida bbob-noisy 5.4 (1)2.8 (4)170 (2)108 (2)88 (295)88 (294)17 (59)14/15
PSAaSmD-CMA-ES Nishida bbob-noisy 15 (47)3.1 (7)1173 (1167)730 (364)783 (598)783 (1168)156 (347)9/15

Δ fopt
f114, 2-D		 1e1
9.0		 1e0
43		 1e-1
698		 1e-2
2475		 1e-3
5343		 1e-5
5343		 1e-7
8680		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 11 (30)7.6 (10)1.7 (2)14 (0.8)6.8 (20)6.8 (10)4.2 (12)13/15
PSAaLmD-CMA-ES Nishida bbob-noisy 3.8 (6)3.7 (9)26 (9)15 (45)7.2 (21)7.2 (22)4.4 (20)13/15
PSAaSmC-CMA-ES Nishida bbob-noisy 23 (71)7.4 (4)74 (74)21 (0.2)10 (28)10 (20)6.1 (6)12/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1597 (0.9)732 (2)257 (369)96 (250)58 (39)58 (57)36 (72)6/15

Δ fopt
f115, 2-D		 1e1
3.0		 1e0
13		 1e-1
225		 1e-2
360		 1e-3
394		 1e-5
394		 1e-7
543		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 6.8 (10)13 (24)1.6 (1)1.4 (1)1.6 (0.9)1.6 (0.9)1.2 (0.8)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 7.6 (18)3.9 (3)1.5 (2)1.1 (0.7)1.1 (1)1.1 (0.6)0.78 (1.0)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 12 (11)9.0 (15)1.6 (2)1.4 (1)1.6 (0.4)1.6 (0.8)1.2 (0.4)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 15 (2)11 (12)1.7 (3)1.2 (1)1.3 (0.7)1.3 (2)1.00 (0.9)15/15

Δ fopt
f116, 2-D		 1e1
49		 1e0
101		 1e-1
155		 1e-2
206		 1e-3
275		 1e-5
1041		 1e-7
1788		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 6.5 (4)6.0 (7)5.8 (9)5.4 (1)4.9 (1)1.7 (0.7)1.3 (0.1)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 84 (29)57 (17)237 (214)179 (488)188 (741)50 (246)29 (57)12/15
PSAaSmC-CMA-ES Nishida bbob-noisy 4.0 (3)4.9 (3)4.9 (3)4.8 (1)4.4 (0.6)1.6 (0.2)1.2 (0.1)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 634 (1031)1778 (3100)1663 (1380)1488 (3221)1115 (558)295 (244)172 (230)6/15

Δ fopt
f117, 2-D		 1e1
167		 1e0
1346		 1e-1
6454		 1e-2
13914		 1e-3
28223		 1e-5
36420		 1e-7
43231		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 18 (90)26 (58)6.3 (4)3.1 (0.3)1.6 (4)1.4 (2)1.4 (0.7)14/15
PSAaLmD-CMA-ES Nishida bbob-noisy 127 (419)68 (118)15 (38)7.2 (7)3.6 (6)2.9 (6)2.6 (2)11/15
PSAaSmC-CMA-ES Nishida bbob-noisy 90 (305)12 (2)8.3 (16)4.0 (15)2.0 (2)1.8 (0.2)1.7 (6)12/15
PSAaSmD-CMA-ES Nishida bbob-noisy 441 (604)133 (151)36 (55)41 (41)30 (65)37 (38)67 (58)1/15

Δ fopt
f118, 2-D		 1e1
21		 1e0
103		 1e-1
132		 1e-2
503		 1e-3
584		 1e-5
776		 1e-7
972		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 7.8 (4)3.6 (3)4.6 (2)1.6 (0.6)1.7 (0.4)2.1 (0.4)2.3 (0.4)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 5.1 (8)5.4 (12)9.0 (8)2.5 (2)2.3 (3)2.0 (3)1.9 (3)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 8.7 (10)3.7 (3)4.9 (0.7)1.8 (0.4)1.9 (0.4)2.1 (0.3)2.4 (0.2)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 6.7 (3)5.1 (13)8.3 (15)3.3 (8)3.0 (1)3.2 (4)2.8 (1)15/15

Δ fopt
f119, 2-D		 1e1
1		 1e0
11		 1e-1
71		 1e-2
176		 1e-3
1040		 1e-5
4767		 1e-7
10082		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 3.3 (5)4.5 (10)2.7 (1)2.3 (0.9)0.71 (0.3)0.40 (0.1)0.30 (0.1)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.4 (4)9.3 (28)3.3 (4)1.9 (0.4)0.54 (0.5)3.3 (0.1)7.5 (10)11/15
PSAaSmC-CMA-ES Nishida bbob-noisy 3.6 (2)3.2 (3)2.2 (0.9)2.4 (0.9)0.74 (0.1)0.36 (0.1)0.29 (0.0)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1.9 (1)2847 (9368)442 (0.7)288 (0.3)49 (96)86 (54)81 (91)1/15

Δ fopt
f120, 2-D		 1e1
1		 1e0
11		 1e-1
374		 1e-2
2514		 1e-3
5724		 1e-5
75406		 1e-7
1.9e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 7.1 (1)8.0 (15)1.3 (1)1.3 (0.7)1.7 (1)0.63 (0.3)0.44 (0.6)14/15
PSAaLmD-CMA-ES Nishida bbob-noisy 286 (12)4833 (4794)144 (148)23 (63)11 (19)1.1 (1)0.65 (0.6)12/15
PSAaSmC-CMA-ES Nishida bbob-noisy 5.6 (6)51 (7)4.2 (22)3.4 (0.3)2.6 (3)1.7 (2)0.98 (1)8/15
PSAaSmD-CMA-ES Nishida bbob-noisy 21 (130)1.3e4 (1e4)376 (409)99 (103)101 (161)18 (26)15 (37)0/15

Δ fopt
f121, 2-D		 1e1
1		 1e0
7.0		 1e-1
42		 1e-2
144		 1e-3
327		 1e-5
1120		 1e-7
1702		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 3.4 (0.8)9.3 (16)3.8 (2)2.7 (0.8)2.4 (0.8)1.7 (0.2)1.8 (0.3)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 4.1 (1)5.2 (4)2.0 (0.4)1.2 (0.6)1.0 (0.7)1.7 (1)2.4 (2)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 8.7 (38)5.2 (8)3.5 (2)2.4 (1)2.1 (0.5)1.7 (0.3)1.9 (0.2)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 5.1 (6)4.3 (2)1.5 (0.7)1.1 (0.8)2.1 (0.6)2.7 (4)3.1 (3)15/15

Δ fopt
f122, 2-D		 1e1
3.0		 1e0
95		 1e-1
523		 1e-2
1411		 1e-3
2244		 1e-5
4351		 1e-7
9561		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 19 (9)3.4 (2)2.0 (0.9)1.2 (0.4)1.3 (0.2)1.2 (0.2)0.85 (0.1)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 3.6 (3)165 (568)31 (104)12 (77)7.6 (48)4.1 (12)2.1 (0.1)14/15
PSAaSmC-CMA-ES Nishida bbob-noisy 4.5 (8)4.8 (7)2.1 (1)1.3 (0.3)1.3 (0.5)1.1 (0.3)2.4 (0.1)14/15
PSAaSmD-CMA-ES Nishida bbob-noisy 8.6 (14)539 (1627)196 (193)97 (108)61 (135)54 (13)60 (92)3/15

Δ fopt
f123, 2-D		 1e1
3.0		 1e0
211		 1e-1
6371		 1e-2
24855		 1e-3
38734		 1e-5
1.0e5		 1e-7
2.2e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 550 (6)78 (13)4.0 (6)1.8 (1)1.9 (0.9)2.0 (2)∞2e50/15
PSAaLmD-CMA-ES Nishida bbob-noisy 4824 (2e4)375 (646)14 (18)4.4 (7)3.8 (7)2.9 (2)∞2e50/15
PSAaSmC-CMA-ES Nishida bbob-noisy 4808 (2)82 (483)3.3 (8)2.1 (0.4)1.9 (5)1.6 (3)4.5 (9)2/15
PSAaSmD-CMA-ES Nishida bbob-noisy 5.1 (6)501 (525)49 (42)13 (15)22 (24)14 (22)∞2e50/15

Δ fopt
f124, 2-D		 1e1
4.0		 1e0
64		 1e-1
316		 1e-2
680		 1e-3
1991		 1e-5
5595		 1e-7
9019		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 5.3 (13)3.2 (2)1.8 (0.7)2.0 (0.4)1.1 (0.2)0.92 (0.3)1.4 (0.5)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 1.7 (4)1.8 (0.6)0.88 (0.2)0.87 (0.5)0.54 (0.3)0.62 (0.2)1.1 (0.5)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 4.5 (3)2.2 (2)1.6 (0.7)1.7 (0.4)1.1 (0.4)0.95 (0.5)1.0 (0.9)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 3.8 (3)3.9 (11)2.3 (2)1.6 (2)0.88 (0.7)1.2 (2)3.4 (1)11/15

Δ fopt
f125, 2-D		 1e1
1		 1e0
1		 1e-1
1		 1e-2
149		 1e-3
1150		 1e-5
3854		 1e-7
7556		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.1 (0.5)11 (23)52 (50)1.7 (4)45 (0.7)20 (27)11 (1)11/15
PSAaLmD-CMA-ES Nishida bbob-noisy 1.6 (0.8)6.3 (5)37 (45)1.0 (0.7)15 (0.7)9.3 (29)7.8 (15)12/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.2 (0.5)4.3 (7)67 (93)1.2 (0.7)14 (3)4.7 (0.9)4.9 (0.4)13/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1.3 (0.5)3.6 (2)26 (42)6.6 (0.4)119 (91)61 (106)41 (81)6/15

Δ fopt
f126, 2-D		 1e1
1		 1e0
1		 1e-1
1		 1e-2
301		 1e-3
3417		 1e-5
11056		 1e-7
36387		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.1 (0.5)5.6 (6)44 (44)1.4 (1)1.3 (0.4)3.4 (13)6.0 (3)3/15
PSAaLmD-CMA-ES Nishida bbob-noisy 1.1 (0.2)9.5 (6)859 (2976)41 (146)43 (44)17 (18)7.3 (18)5/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.1 (0.5)6.7 (2)29 (28)0.94 (0.6)16 (15)10 (18)4.2 (5)7/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1.6 (0.2)4.9 (5)83 (136)171 (0.9)166 (153)52 (70)17 (16)3/15

Δ fopt
f127, 2-D		 1e1
1		 1e0
1		 1e-1
1		 1e-2
186		 1e-3
1185		 1e-5
6771		 1e-7
7277		 #succ
13/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.5 (0.5)3.2 (0.8)33 (37)1.2 (1)0.79 (1)1.2 (0.8)4.3 (1)14/15
PSAaLmD-CMA-ES Nishida bbob-noisy 1.3 (0.5)5.7 (12)40 (43)1.6 (3)33 (55)7.4 (8)16 (22)11/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.3 (0.8)5.2 (8)40 (57)1.1 (2)17 (86)4.0 (9)4.5 (8)14/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1.3 (0.5)3.7 (4)37 (28)78 (270)102 (92)24 (62)23 (50)9/15

Δ fopt
f128, 2-D		 1e1
2.0		 1e0
41		 1e-1
134		 1e-2
314		 1e-3
387		 1e-5
593		 1e-7
620		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.5 (0.8)354 (1234)551 (1133)323 (162)263 (392)172 (427)219 (327)9/15
PSAaLmD-CMA-ES Nishida bbob-noisy 1.9 (3)1.8 (2)382 (757)164 (165)135 (6)88 (90)84 (164)12/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.7 (1)1.7 (1)234 (755)162 (646)192 (394)172 (171)165 (163)10/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1.5 (0.6)2504 (1260)1784 (2323)762 (1513)618 (1498)404 (172)386 (350)7/15

Δ fopt
f129, 2-D		 1e1
2.0		 1e0
65		 1e-1
220		 1e-2
523		 1e-3
1902		 1e-5
5944		 1e-7
10661		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.5 (1)228 (776)162 (516)162 (194)47 (112)21 (3)13 (15)10/15
PSAaLmD-CMA-ES Nishida bbob-noisy 0.93 (0.8)801 (3932)1492 (2577)638 (684)180 (273)75 (77)42 (77)5/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.8 (0.5)486 (1551)336 (1381)260 (290)72 (106)31 (34)24 (52)7/15
PSAaSmD-CMA-ES Nishida bbob-noisy 0.87 (0.8)2132 (4773)1404 (2091)1082 (1272)298 (460)225 (269)271 (430)1/15

Δ fopt
f130, 2-D		 1e1
2.0		 1e0
45		 1e-1
198		 1e-2
497		 1e-3
797		 1e-5
1772		 1e-7
4442		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.4 (1)42 (134)20 (52)8.3 (21)7.0 (2)3.5 (5)1.6 (2)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 1.6 (2)26 (24)14 (20)5.8 (9)3.7 (3)1.8 (3)0.77 (1)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.1 (0.5)22 (4)16 (27)10 (9)8.5 (18)5.3 (8)2.2 (4)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1.8 (1)24 (30)16 (26)7.5 (6)4.7 (8)3.2 (6)1.6 (1)13/15

Previous dimension | Dimension = 3 | Next dimension

Δ fopt
f101, 3-D		 1e1
4.0		 1e0
13		 1e-1
19		 1e-2
20		 1e-3
28		 1e-5
33		 1e-7
38		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 5.5 (8)8.3 (9)14 (3)23 (10)24 (8)36 (6)43 (6)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 7.2 (8)5.8 (4)7.5 (2)10 (5)11 (2)15 (2)18 (2)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 7.2 (13)9.3 (4)15 (4)23 (5)20 (8)35 (4)44 (7)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 8.2 (12)6.1 (4)8.1 (3)11 (2)11 (1)14 (3)17 (3)15/15

Δ fopt
f102, 3-D		 1e1
4.0		 1e0
12		 1e-1
23		 1e-2
28		 1e-3
32		 1e-5
39		 1e-7
48		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 11 (8)10 (7)13 (4)16 (6)20 (4)29 (5)36 (5)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 3.6 (6)5.3 (2)5.0 (2)6.7 (1)10 (2)13 (2)15 (1)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 11 (7)13 (8)13 (7)18 (6)22 (4)30 (4)35 (6)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 6.6 (6)6.2 (3)6.3 (2)7.4 (3)9.4 (3)12 (2)13 (1)15/15

Δ fopt
f103, 3-D		 1e1
4.0		 1e0
13		 1e-1
19		 1e-2
19		 1e-3
19		 1e-5
23		 1e-7
43		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 5.2 (2)10 (9)16 (4)23 (9)36 (12)50 (7)39 (9)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 6.0 (11)5.1 (3)7.0 (4)11 (4)15 (3)21 (2)17 (0.9)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 7.8 (9)8.4 (6)13 (4)23 (7)31 (7)51 (10)43 (3)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 5.4 (4)5.7 (2)6.8 (3)10 (6)15 (5)21 (4)16 (3)15/15

Δ fopt
f104, 3-D		 1e1
30		 1e0
207		 1e-1
602		 1e-2
637		 1e-3
648		 1e-5
658		 1e-7
668		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 8.0 (4)110 (5)131 (0.5)180 (239)241 (354)238 (693)235 (117)10/15
PSAaLmD-CMA-ES Nishida bbob-noisy 3.9 (2)106 (0.8)753 (753)1897 (2130)1866 (1746)6423 (4012)6327 (5875)1/15
PSAaSmC-CMA-ES Nishida bbob-noisy 7.8 (4)110 (5)82 (254)79 (121)78 (235)78 (3)78 (4)13/15
PSAaSmD-CMA-ES Nishida bbob-noisy 3.1 (3)229 (1105)760 (1790)958 (1313)1294 (2360)3006 (4155)2961 (3180)2/15

Δ fopt
f105, 3-D		 1e1
28		 1e0
507		 1e-1
1070		 1e-2
3228		 1e-3
3247		 1e-5
3271		 1e-7
3297		 #succ
5/15
PSAaLmC-CMA-ES Nishida bbob-noisy 8.4 (4)1.7 (1)109 (284)142 (118)141 (234)140 (209)139 (185)6/15
PSAaLmD-CMA-ES Nishida bbob-noisy 4.5 (4)97 (161)324 (424)258 (469)607 (491)602 (1250)598 (1013)2/15
PSAaSmC-CMA-ES Nishida bbob-noisy 7.8 (5)2.0 (2)192 (426)109 (165)143 (259)188 (163)186 (300)5/15
PSAaSmD-CMA-ES Nishida bbob-noisy 4.6 (2)150 (0.4)324 (706)188 (211)187 (257)185 (347)184 (367)5/15

Δ fopt
f106, 3-D		 1e1
29		 1e0
68		 1e-1
156		 1e-2
443		 1e-3
759		 1e-5
1294		 1e-7
1447		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 7.8 (4)18 (14)22 (15)19 (7)15 (23)15 (22)13 (13)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 3.7 (2)22 (59)67 (94)62 (99)45 (94)39 (55)36 (52)11/15
PSAaSmC-CMA-ES Nishida bbob-noisy 9.3 (7)12 (7)16 (7)13 (23)8.5 (14)5.4 (8)5.1 (1)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 3.5 (2)51 (92)100 (79)75 (56)55 (42)57 (63)52 (23)9/15

Δ fopt
f107, 3-D		 1e1
6.0		 1e0
47		 1e-1
153		 1e-2
232		 1e-3
325		 1e-5
505		 1e-7
685		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 6.7 (8)3.9 (4)2.8 (2)3.3 (1)3.4 (0.5)3.7 (0.6)3.8 (0.4)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 28 (153)14 (3)5.2 (0.7)3.9 (9)3.3 (7)3.0 (4)2.8 (6)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 4.4 (5)4.2 (9)2.3 (0.7)2.8 (1)2.8 (0.9)3.3 (1)3.8 (0.8)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 3939 (1e4)2338 (4809)720 (2475)653 (1630)467 (933)301 (600)222 (661)10/15

Δ fopt
f108, 3-D		 1e1
6.0		 1e0
98		 1e-1
1966		 1e-2
5527		 1e-3
10825		 1e-5
17187		 1e-7
32181		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 37 (4)9.0 (7)1.5 (0.5)1.1 (0.7)0.96 (0.3)1.5 (0.5)1.5 (0.3)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 64 (8)83 (9)12 (17)5.4 (0.5)3.2 (12)2.9 (5)2.3 (3)14/15
PSAaSmC-CMA-ES Nishida bbob-noisy 13 (42)6.8 (7)1.0 (0.5)0.86 (0.3)0.80 (0.2)1.3 (0.9)1.2 (0.3)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 3688 (3e4)1346 (2353)104 (192)38 (41)26 (14)17 (35)9.3 (24)8/15

Δ fopt
f109, 3-D		 1e1
4.0		 1e0
21		 1e-1
93		 1e-2
145		 1e-3
193		 1e-5
251		 1e-7
251		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 11 (13)6.9 (3)3.3 (0.8)3.4 (1)4.3 (2)7.5 (1)11 (1)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 4.5 (11)2.2 (2)1.2 (0.8)1.3 (0.6)2.0 (0.6)4.1 (1)6.1 (1)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 7.5 (12)6.5 (5)3.1 (1)3.4 (1)4.2 (1)6.6 (0.9)10 (2)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 5.3 (6)3.4 (3)1.4 (0.4)1.7 (0.7)1.8 (0.8)2.8 (0.2)★4.6 (0.8)★15/15

Δ fopt
f110, 3-D		 1e1
56		 1e0
922		 1e-1
6277		 1e-2
20456		 1e-3
35327		 1e-5
61979		 1e-7
63571		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 4.1 (3)26 (5)139 (291)210 (311)123 (75)∞∞3e50/15
PSAaLmD-CMA-ES Nishida bbob-noisy 1.8 (1)127 (245)74 (51)97 (100)120 (49)68 (41)67 (32)1/15
PSAaSmC-CMA-ES Nishida bbob-noisy 3.9 (3)1.6 (0.4)97 (85)60 (126)56 (56)32 (66)31 (30)2/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1.9 (1)220 (331)677 (882)208 (200)∞∞∞3e50/15

Δ fopt
f111, 3-D		 1e1
174		 1e0
3475		 1e-1
29972		 1e-2
75886		 1e-3
1.9e5		 1e-5
1.4e6		 1e-7
1.5e6		 #succ
14/15
PSAaLmC-CMA-ES Nishida bbob-noisy 3.1 (2)6.9 (0.6)40 (58)∞∞∞∞3e50/15
PSAaLmD-CMA-ES Nishida bbob-noisy 88 (105)22 (22)29 (21)26 (39)11 (16)1.5 (2)1.4 (0.4)2/15
PSAaSmC-CMA-ES Nishida bbob-noisy 2.5 (1)22 (44)141 (126)56 (123)22 (22)3.0 (2)2.9 (5)1/15
PSAaSmD-CMA-ES Nishida bbob-noisy 126 (867)100 (87)28 (30)26 (33)10 (7)1.4 (0.9)1.4 (0.6)2/15

Δ fopt
f112, 3-D		 1e1
29		 1e0
338		 1e-1
1568		 1e-2
2478		 1e-3
2849		 1e-5
3105		 1e-7
3534		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 8.3 (5)2.6 (2)13 (6)36 (18)38 (44)50 (88)44 (63)11/15
PSAaLmD-CMA-ES Nishida bbob-noisy 4.4 (2)7.5 (16)11 (16)26 (23)29 (69)30 (45)26 (33)11/15
PSAaSmC-CMA-ES Nishida bbob-noisy 7.6 (5)2.2 (2)4.1 (1)21 (23)49 (73)78 (152)97 (68)9/15
PSAaSmD-CMA-ES Nishida bbob-noisy 4.8 (2)11 (13)13 (13)16 (12)25 (18)36 (41)46 (24)6/15

Δ fopt
f113, 3-D		 1e1
26		 1e0
126		 1e-1
1948		 1e-2
3093		 1e-3
3236		 1e-5
3236		 1e-7
3428		 #succ
12/15
PSAaLmC-CMA-ES Nishida bbob-noisy 3.5 (6)3.0 (5)12 (0.1)7.4 (49)7.1 (24)7.1 (24)6.7 (22)14/15
PSAaLmD-CMA-ES Nishida bbob-noisy 4.1 (6)2.3 (2)40 (79)25 (74)24 (47)24 (47)23 (45)12/15
PSAaSmC-CMA-ES Nishida bbob-noisy 4.3 (7)2.2 (2)0.38 (0.1)0.38 (0.1)0.41 (0.1)0.41 (0.1)0.39 (0.1)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 21 (75)919 (1251)81 (84)90 (103)86 (194)86 (96)81 (184)8/15

Δ fopt
f114, 3-D		 1e1
26		 1e0
1015		 1e-1
6279		 1e-2
18884		 1e-3
28324		 1e-5
28324		 1e-7
32580		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 22 (12)4.1 (7)1.6 (1)0.81 (0.6)0.58 (0.2)0.58 (0.3)0.51 (0.4)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 15 (43)1.5 (3)0.72 (0.2)0.47 (0.3)0.37 (0.3)0.37 (0.2)0.33 (0.3)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 7.5 (3)2.6 (6)4.5 (13)3.0 (5)2.0 (3)2.0 (0.1)1.8 (0.1)13/15
PSAaSmD-CMA-ES Nishida bbob-noisy 3192 (3)201 (149)56 (206)33 (73)30 (30)30 (22)26 (37)4/15

Δ fopt
f115, 3-D		 1e1
12		 1e0
118		 1e-1
593		 1e-2
841		 1e-3
890		 1e-5
890		 1e-7
1246		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 6.0 (9)2.1 (1)1.1 (0.3)1.1 (0.7)1.2 (0.2)1.2 (0.3)0.91 (0.4)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 3.6 (6)2.1 (1)1.8 (2)1.7 (1)1.7 (1)1.7 (2)1.3 (2)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 5.0 (6)1.7 (1)0.93 (0.4)1.0 (0.2)1.1 (0.2)1.1 (0.3)0.88 (0.2)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 4.2 (3)2.4 (3)1.6 (2)1.4 (2)1.6 (1)1.6 (2)1.2 (1.0)15/15

Δ fopt
f116, 3-D		 1e1
169		 1e0
2642		 1e-1
4419		 1e-2
6154		 1e-3
7143		 1e-5
9614		 1e-7
11370		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 3.2 (1)0.41 (0.1)0.30 (0.1)0.29 (0.1)0.31 (0.0)0.30 (0.0)0.33 (0.0)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 176 (449)23 (71)18 (24)16 (25)14 (39)12 (24)10 (21)11/15
PSAaSmC-CMA-ES Nishida bbob-noisy 133 (7)18 (0.4)11 (18)8.0 (25)6.9 (21)5.2 (8)4.5 (7)13/15
PSAaSmD-CMA-ES Nishida bbob-noisy 129 (1344)65 (144)60 (104)43 (49)37 (64)28 (40)23 (47)8/15

Δ fopt
f117, 3-D		 1e1
2392		 1e0
14361		 1e-1
39508		 1e-2
56448		 1e-3
61720		 1e-5
73678		 1e-7
80041		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 0.72 (0.4)2.0 (11)0.85 (2)0.69 (0.1)0.69 (3)0.79 (0.2)0.98 (0.2)14/15
PSAaLmD-CMA-ES Nishida bbob-noisy 22 (64)10 (11)3.9 (6)2.8 (4)2.6 (2)2.4 (4)2.7 (3)10/15
PSAaSmC-CMA-ES Nishida bbob-noisy 10 (64)6.2 (22)3.4 (13)3.5 (4)3.3 (7)3.3 (5)3.2 (5)9/15
PSAaSmD-CMA-ES Nishida bbob-noisy 46 (63)26 (32)16 (19)11 (11)10 (14)8.9 (10)11 (6)4/15

Δ fopt
f118, 3-D		 1e1
109		 1e0
205		 1e-1
712		 1e-2
853		 1e-3
1008		 1e-5
1283		 1e-7
1593		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 3.8 (3)4.2 (1)1.5 (0.3)1.5 (0.1)1.7 (0.4)1.9 (0.5)2.2 (0.4)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.3 (1)2.3 (0.5)1.6 (7)1.5 (3)1.4 (3)1.5 (0.2)1.5 (0.2)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 5.4 (5)5.3 (6)2.4 (0.3)4.0 (19)3.7 (16)3.6 (0.1)3.5 (0.2)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 6.4 (2)22 (24)6.8 (8)6.5 (6)8.9 (14)7.3 (11)6.1 (13)15/15

Δ fopt
f119, 3-D		 1e1
2.0		 1e0
66		 1e-1
421		 1e-2
610		 1e-3
2005		 1e-5
12038		 1e-7
15719		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 8.7 (1)3.0 (3)1.1 (0.7)1.5 (0.5)0.77 (0.2)0.28 (0.0)0.31 (0.1)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 7.4 (2)0.95 (2)0.58 (0.5)0.78 (0.2)0.38 (0.1)0.29 (0.0)1.6 (10)14/15
PSAaSmC-CMA-ES Nishida bbob-noisy 5.4 (5)1.8 (2)1.0 (0.7)1.4 (0.4)0.82 (0.3)0.29 (0.2)0.34 (0.1)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 14 (45)8.2 (11)111 (0.2)77 (0.4)55 (75)38 (31)270 (593)1/15

Δ fopt
f120, 3-D		 1e1
2.0		 1e0
81		 1e-1
1802		 1e-2
6937		 1e-3
31935		 1e-5
1.2e5		 1e-7
2.7e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 19 (25)4.0 (4)1.4 (2)1.1 (0.5)0.61 (0.4)0.56 (0.1)0.47 (0.0)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 43 (9)21 (4)3.6 (7)1.7 (2)0.80 (0.8)0.59 (0.2)0.49 (0.1)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 59 (14)277 (9)28 (2)8.1 (22)2.0 (5)2.1 (3)1.6 (3)6/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1.8e4 (8e4)1723 (1402)126 (272)42 (71)11 (12)4.1 (4)2.6 (6)3/15

Δ fopt
f121, 3-D		 1e1
2.0		 1e0
41		 1e-1
116		 1e-2
250		 1e-3
699		 1e-5
2297		 1e-7
3321		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 5.4 (4)3.8 (4)3.4 (2)2.6 (1)1.7 (0.4)1.3 (0.3)1.4 (0.2)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 6.3 (7)2.0 (1)2.2 (0.5)4.6 (2)2.3 (0.7)1.3 (2)1.5 (1)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 3.7 (7)2.4 (2)2.8 (1)2.6 (1)1.8 (0.8)1.3 (0.1)1.4 (0.1)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 6.3 (12)1.9 (2)1.4 (0.9)1.4 (1)1.7 (0.8)2.9 (2)5.0 (7)14/15

Δ fopt
f122, 3-D		 1e1
6.0		 1e0
357		 1e-1
1802		 1e-2
4317		 1e-3
7595		 1e-5
12242		 1e-7
19009		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 2.4 (3)1.7 (2)1.0 (0.5)0.85 (0.2)0.74 (0.1)0.82 (0.1)0.93 (0.1)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 3.0 (6)7.7 (5)14 (4)6.0 (19)3.6 (10)2.5 (0.6)2.0 (4)14/15
PSAaSmC-CMA-ES Nishida bbob-noisy 9.3 (5)63 (637)13 (43)5.8 (0.1)3.6 (20)2.5 (0.1)3.3 (0.2)13/15
PSAaSmD-CMA-ES Nishida bbob-noisy 5.2 (10)1.4 (2)62 (1)47 (71)35 (30)69 (93)64 (52)3/15

Δ fopt
f123, 3-D		 1e1
5.0		 1e0
1546		 1e-1
21830		 1e-2
50182		 1e-3
93159		 1e-5
1.9e5		 1e-7
4.4e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 14 (15)4.4 (1)1.9 (0.7)2.0 (2)2.1 (1)24 (26)∞3e50/15
PSAaLmD-CMA-ES Nishida bbob-noisy 9.3 (10)26 (30)2.6 (2)2.3 (3)2.1 (0.7)∞∞3e50/15
PSAaSmC-CMA-ES Nishida bbob-noisy 22 (50)6.3 (4)1.9 (4)1.5 (2)1.6 (0.3)1.4 (1)10 (11)0/15
PSAaSmD-CMA-ES Nishida bbob-noisy 4340 (5)180 (245)23 (38)10 (10)7.7 (10)5.4 (5)∞3e50/15

Δ fopt
f124, 3-D		 1e1
4.0		 1e0
196		 1e-1
926		 1e-2
3416		 1e-3
7091		 1e-5
12902		 1e-7
14882		 #succ
14/15
PSAaLmC-CMA-ES Nishida bbob-noisy 8.7 (6)2.4 (0.9)1.1 (0.8)0.63 (0.4)0.53 (0.1)0.58 (0.1)0.78 (0.1)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 7.8 (20)3.0 (0.7)0.96 (0.2)0.51 (0.5)0.38 (0.1)0.47 (0.4)0.66 (0.3)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 4.5 (7)1.5 (0.8)0.99 (0.3)0.56 (0.1)0.44 (0.1)0.48 (0.0)0.78 (0.1)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 4.2 (6)0.85 (0.8)1.3 (0.2)0.99 (2)0.62 (0.5)1.0 (0.7)1.5 (1)14/15

Δ fopt
f125, 3-D		 1e1
1		 1e0
1		 1e-1
1		 1e-2
4419		 1e-3
24677		 1e-5
36351		 1e-7
38000		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.8 (2)9.5 (13)267 (132)0.70 (0.6)1.3 (0.7)2.0 (0.6)2.0 (0.4)14/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.0 (0.8)20 (26)257 (356)7.0 (18)7.9 (7)6.1 (7)5.8 (9)9/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.3 (1)14 (10)177 (108)1.2 (0.6)1.7 (4)2.8 (11)2.7 (4)12/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1.2 (0)5.7 (2)200 (196)12 (34)15 (28)18 (23)23 (18)4/15

Δ fopt
f126, 3-D		 1e1
1		 1e0
1		 1e-1
1		 1e-2
13498		 1e-3
1.1e5		 1e-5
6.3e5		 1e-7
9.6e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.4 (1)11 (6)450 (166)1.1 (2)2.0 (2)7.2 (7)∞3e50/15
PSAaLmD-CMA-ES Nishida bbob-noisy 1.2 (0.5)10 (8)618 (816)2.2 (0.6)2.1 (2)7.0 (8)∞3e50/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.3 (0.5)10 (7)414 (361)0.77 (0.4)2.1 (4)3.4 (4)∞3e50/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1.5 (0.5)13 (11)5.6e4 (1e5)16 (12)11 (10)∞∞3e50/15

Δ fopt
f127, 3-D		 1e1
1		 1e0
1		 1e-1
1		 1e-2
3505		 1e-3
39085		 1e-5
45347		 1e-7
45996		 #succ
8/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.7 (1)9.5 (4)226 (187)8.2 (2)2.5 (3)3.1 (3)3.2 (3)13/15
PSAaLmD-CMA-ES Nishida bbob-noisy 1.4 (0.5)14 (14)171 (121)1.6 (1.0)2.7 (6)3.3 (5)4.2 (3)11/15
PSAaSmC-CMA-ES Nishida bbob-noisy 2.7 (2)14 (11)263 (138)8.9 (9)3.0 (6)3.4 (0.6)3.4 (4)11/15
PSAaSmD-CMA-ES Nishida bbob-noisy 2.0 (0.5)14 (14)194 (135)61 (68)32 (29)45 (38)44 (63)2/15

Δ fopt
f128, 3-D		 1e1
6.0		 1e0
426		 1e-1
1125		 1e-2
1346		 1e-3
1917		 1e-5
2715		 1e-7
4340		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 3.4 (4)473 (531)403 (336)449 (728)316 (315)223 (639)139 (104)5/15
PSAaLmD-CMA-ES Nishida bbob-noisy 1.6 (1)179 (178)236 (270)197 (225)139 (197)98 (111)61 (18)8/15
PSAaSmC-CMA-ES Nishida bbob-noisy 2.2 (2)110 (356)308 (537)338 (449)237 (355)168 (585)105 (122)6/15
PSAaSmD-CMA-ES Nishida bbob-noisy 2.4 (2)622 (1422)538 (539)450 (1180)316 (711)223 (223)140 (174)5/15

Δ fopt
f129, 3-D		 1e1
5.0		 1e0
362		 1e-1
3392		 1e-2
7851		 1e-3
11584		 1e-5
28362		 1e-7
38534		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.9 (3)64 (15)33 (90)15 (38)24 (26)13 (13)10 (7)7/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.4 (3)566 (1479)105 (156)59 (58)41 (47)18 (30)13 (21)6/15
PSAaSmC-CMA-ES Nishida bbob-noisy 3.0 (1)211 (211)102 (67)44 (48)30 (13)13 (35)9.3 (10)7/15
PSAaSmD-CMA-ES Nishida bbob-noisy 4.9 (4)1265 (3168)180 (383)107 (184)72 (72)30 (24)22 (30)4/15

Δ fopt
f130, 3-D		 1e1
6.0		 1e0
245		 1e-1
515		 1e-2
916		 1e-3
1502		 1e-5
11944		 1e-7
14346		 #succ
12/15
PSAaLmC-CMA-ES Nishida bbob-noisy 2.9 (1)14 (6)21 (34)14 (19)9.2 (7)1.2 (1)1.0 (0.9)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 1.8 (0.8)12 (26)35 (38)20 (41)12 (27)1.7 (2)1.4 (2)12/15
PSAaSmC-CMA-ES Nishida bbob-noisy 3.1 (4)17 (29)23 (12)13 (15)8.7 (12)1.1 (1)0.96 (1)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 3.0 (4)21 (17)23 (24)13 (9)7.9 (10)1.0 (0.7)0.85 (1)13/15

Previous dimension | Dimension = 5 | Next dimension

Δ fopt
f101, 5-D		 1e1
11		 1e0
37		 1e-1
44		 1e-2
49		 1e-3
62		 1e-5
69		 1e-7
75		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 8.4 (8)8.5 (4)14 (2)18 (4)20 (2)31 (3)40 (2)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 7.8 (7)7.1 (4)8.8 (3)13 (2)14 (2)21 (3)28 (2)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 8.3 (10)8.9 (5)12 (5)17 (4)20 (2)30 (3)38 (3)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 6.9 (4)6.1 (3)8.4 (3)12 (6)13 (3)19 (2)24 (1)★315/15

Δ fopt
f102, 5-D		 1e1
11		 1e0
35		 1e-1
50		 1e-2
66		 1e-3
72		 1e-5
86		 1e-7
99		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 10 (11)9.3 (6)12 (3)14 (2)19 (1)26 (3)31 (2)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 6.4 (3)6.0 (3)7.0 (3)9.3 (0.8)12 (2)17 (1)21 (2)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 11 (10)10 (3)11 (2)13 (2)17 (3)25 (3)28 (3)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 9.3 (6)6.5 (3)7.7 (2)8.7 (2)11 (1)15 (1)★18 (2)★215/15

Δ fopt
f103, 5-D		 1e1
11		 1e0
28		 1e-1
30		 1e-2
30		 1e-3
31		 1e-5
35		 1e-7
115		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 13 (6)12 (2)19 (5)30 (4)43 (3)66 (6)29 (3)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 8.2 (3)8.3 (1)13 (2)21 (4)28 (6)44 (5)20 (2)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 8.6 (9)11 (3)18 (4)28 (5)40 (9)59 (2)27 (2)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 6.9 (6)8.3 (4)13 (5)18 (4)26 (4)37 (5)★17 (1)★315/15

Δ fopt
f104, 5-D		 1e1
173		 1e0
773		 1e-1
1287		 1e-2
1574		 1e-3
1768		 1e-5
2040		 1e-7
2284		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 4.1 (2)331 (654)5502 (5007)4502 (2169)∞∞∞5e50/15
PSAaLmD-CMA-ES Nishida bbob-noisy 3.4 (2)573 (489)∞∞∞∞∞5e50/15
PSAaSmC-CMA-ES Nishida bbob-noisy 4.4 (1)577 (1310)1578 (1377)4509 (9249)∞∞∞5e50/15
PSAaSmD-CMA-ES Nishida bbob-noisy 2.5 (0.7)979 (2117)∞∞∞∞∞5e50/15

Δ fopt
f105, 5-D		 1e1
167		 1e0
1436		 1e-1
5174		 1e-2
9998		 1e-3
10388		 1e-5
10824		 1e-7
11202		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 4.3 (2)239 (791)∞∞∞∞∞5e50/15
PSAaLmD-CMA-ES Nishida bbob-noisy 3.2 (1)258 (526)∞∞∞∞∞5e50/15
PSAaSmC-CMA-ES Nishida bbob-noisy 3.9 (1)405 (968)∞∞∞∞∞5e50/15
PSAaSmD-CMA-ES Nishida bbob-noisy 2.9 (2)1402 (1576)∞∞∞∞∞5e50/15

Δ fopt
f106, 5-D		 1e1
92		 1e0
529		 1e-1
1050		 1e-2
1770		 1e-3
2666		 1e-5
2887		 1e-7
3087		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 8.3 (2)17 (5)384 (561)564 (863)1308 (1251)1213 (1312)1134 (2394)2/15
PSAaLmD-CMA-ES Nishida bbob-noisy 5.8 (1)10 (4)212 (234)263 (361)279 (346)344 (508)322 (354)3/15
PSAaSmC-CMA-ES Nishida bbob-noisy 8.1 (5)31 (39)230 (435)214 (165)220 (232)456 (551)427 (545)5/15
PSAaSmD-CMA-ES Nishida bbob-noisy 5.0 (2)43 (88)447 (497)549 (431)365 (323)514 (1142)480 (417)2/15

Δ fopt
f107, 5-D		 1e1
40		 1e0
228		 1e-1
453		 1e-2
692		 1e-3
940		 1e-5
1376		 1e-7
1850		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 5.0 (7)3.2 (1)2.8 (1.0)2.9 (0.7)3.3 (0.6)3.9 (0.5)4.2 (0.3)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 6.5 (7)3.1 (2)2.8 (0.8)2.5 (0.8)2.8 (0.5)3.0 (0.2)3.2 (0.3)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 6.1 (3)3.5 (3)2.9 (0.8)2.9 (1)2.9 (0.6)3.3 (0.3)3.4 (0.1)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 2.6 (2)1.9 (1)1.9 (1)1.9 (0.8)2.1 (0.4)2.2 (0.2)★32.4 (0.3)★315/15

Δ fopt
f108, 5-D		 1e1
87		 1e0
5144		 1e-1
14469		 1e-2
24649		 1e-3
30935		 1e-5
58628		 1e-7
80667		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 40 (21)1.7 (2)1.0 (2)1.2 (0.8)1.6 (0.7)1.9 (0.5)2.4 (0.4)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 8.2 (19)0.91 (1)0.82 (0.5)1.1 (0.2)1.4 (0.2)1.9 (0.3)2.5 (0.3)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 40 (52)11 (32)7.3 (29)5.5 (8)6.9 (8)4.1 (6)3.5 (8)11/15
PSAaSmD-CMA-ES Nishida bbob-noisy 25 (57)16 (23)8.3 (9)5.8 (5)4.9 (5)3.1 (2)2.8 (9)12/15

Δ fopt
f109, 5-D		 1e1
11		 1e0
57		 1e-1
216		 1e-2
375		 1e-3
572		 1e-5
873		 1e-7
946		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 7.9 (11)5.6 (1)2.6 (0.8)2.8 (0.5)3.1 (1)4.4 (1)6.5 (1.0)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 8.7 (6)4.3 (2)2.0 (0.7)2.3 (0.9)3.1 (0.8)4.0 (1.0)5.6 (1)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 8.4 (6)5.1 (2)2.6 (0.7)2.8 (0.7)3.3 (0.6)4.1 (0.2)5.4 (0.7)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 5.9 (7)3.9 (1)1.7 (0.5)2.0 (0.7)2.3 (0.3)2.9 (0.3)★34.0 (0.4)★315/15

Δ fopt
f110, 5-D		 1e1
949		 1e0
33625		 1e-1
1.2e5		 1e-2
5.6e5		 1e-3
5.9e5		 1e-5
6.0e5		 1e-7
6.1e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.3 (0.6)24 (13)59 (44)13 (15)∞∞∞5e50/15
PSAaLmD-CMA-ES Nishida bbob-noisy 0.86 (0.3)99 (78)∞∞∞∞∞5e50/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.1 (0.2)105 (104)∞∞∞∞∞5e50/15
PSAaSmD-CMA-ES Nishida bbob-noisy 0.82 (1.0)34 (64)59 (93)13 (7)12 (9)12 (14)12 (12)1/15

Δ fopt
f111, 5-D		 1e1
6856		 1e0
6.1e5		 1e-1
8.8e6		 1e-2
2.3e7		 1e-3
2.3e7		 1e-5
3.1e7		 1e-7
3.1e7		 #succ
3/15
PSAaLmC-CMA-ES Nishida bbob-noisy 0.70 (0.1)12 (9)∞∞∞∞∞5e50/15
PSAaLmD-CMA-ES Nishida bbob-noisy 0.44 (0.4)∞∞∞∞∞∞5e50/15
PSAaSmC-CMA-ES Nishida bbob-noisy 0.63 (0.2)12 (8)∞∞∞∞∞5e50/15
PSAaSmD-CMA-ES Nishida bbob-noisy 5.7 (0.4)12 (12)0.80 (0.7)0.32 (0.3)0.33 (0.3)∞∞5e50/15

Δ fopt
f112, 5-D		 1e1
107		 1e0
1684		 1e-1
3421		 1e-2
4162		 1e-3
4502		 1e-5
5132		 1e-7
5596		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 7.7 (2)31 (41)101 (101)841 (1067)1623 (1324)1424 (940)1306 (2016)1/15
PSAaLmD-CMA-ES Nishida bbob-noisy 4.9 (0.9)5.6 (1)172 (239)167 (101)250 (406)490 (485)450 (504)2/15
PSAaSmC-CMA-ES Nishida bbob-noisy 6.8 (1)47 (149)359 (406)825 (1170)763 (878)669 (1008)614 (611)2/15
PSAaSmD-CMA-ES Nishida bbob-noisy 4.2 (1)36 (51)101 (54)261 (303)∞∞∞2e50/15

Δ fopt
f113, 5-D		 1e1
133		 1e0
1883		 1e-1
8081		 1e-2
24021		 1e-3
24128		 1e-5
24128		 1e-7
24402		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 2.2 (1)0.54 (0.1)0.31 (0.1)0.15 (0.0)0.16 (0.0)0.16 (0.0)0.17 (0.0)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.1 (2)0.53 (0.2)4.7 (0.1)1.6 (10)1.6 (0.0)1.6 (0.0)1.6 (0.0)14/15
PSAaSmC-CMA-ES Nishida bbob-noisy 3.3 (3)0.71 (0.3)4.7 (47)1.6 (0.0)1.6 (5)1.6 (5)1.6 (0.0)14/15
PSAaSmD-CMA-ES Nishida bbob-noisy 2.4 (2)42 (0.5)23 (47)14 (31)14 (21)14 (16)14 (26)9/15

Δ fopt
f114, 5-D		 1e1
767		 1e0
14720		 1e-1
56311		 1e-2
78890		 1e-3
83272		 1e-5
83272		 1e-7
84949		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.4 (2)0.56 (0.4)0.40 (0.2)0.59 (0.3)0.63 (0.1)0.63 (0.1)0.64 (0.1)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 5.6 (12)0.91 (0.6)0.49 (0.4)0.62 (0.4)0.68 (0.2)0.68 (0.1)0.67 (0.3)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 3.4 (6)3.2 (0.6)3.6 (7)3.6 (3)3.4 (6)3.4 (6)3.4 (3)10/15
PSAaSmD-CMA-ES Nishida bbob-noisy 4.5 (12)6.1 (9)3.5 (5)3.5 (5)3.3 (3)3.3 (8)3.3 (4)10/15

Δ fopt
f115, 5-D		 1e1
64		 1e0
485		 1e-1
1829		 1e-2
2274		 1e-3
2550		 1e-5
2550		 1e-7
2970		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 3.8 (3)1.5 (0.5)0.73 (0.2)0.91 (0.2)0.91 (0.2)0.91 (0.2)0.81 (0.2)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.4 (1)0.88 (0.1)0.43 (0.1)0.62 (0.2)0.62 (0.1)0.62 (0.1)0.56 (0.1)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 3.2 (2)1.3 (0.6)0.69 (0.2)0.99 (0.5)0.92 (0.2)0.92 (0.8)0.87 (0.5)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 3.1 (2)1.3 (0.3)0.74 (0.9)0.97 (1)1.2 (0.8)1.2 (0.9)1.0 (1.0)15/15

Δ fopt
f116, 5-D		 1e1
5730		 1e0
14472		 1e-1
22311		 1e-2
26243		 1e-3
26868		 1e-5
30329		 1e-7
31661		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 0.37 (0.4)2.7 (9)1.8 (6)1.6 (0.0)1.6 (0.1)1.5 (0.0)1.5 (8)14/15
PSAaLmD-CMA-ES Nishida bbob-noisy 0.29 (0.2)0.27 (0.1)0.27 (0.5)1.5 (10)1.5 (0.1)1.4 (4)1.4 (8)14/15
PSAaSmC-CMA-ES Nishida bbob-noisy 14 (44)13 (35)12 (11)13 (10)13 (9)11 (21)11 (36)9/15
PSAaSmD-CMA-ES Nishida bbob-noisy 17 (10)18 (18)20 (23)17 (29)17 (9)15 (25)14 (8)8/15

Δ fopt
f117, 5-D		 1e1
26686		 1e0
76052		 1e-1
1.1e5		 1e-2
1.3e5		 1e-3
1.4e5		 1e-5
1.7e5		 1e-7
1.9e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.8 (9)0.86 (0.6)0.78 (0.5)0.78 (1)0.87 (2)1.0 (0.1)1.4 (0.4)14/15
PSAaLmD-CMA-ES Nishida bbob-noisy 0.84 (1)0.51 (0.6)0.45 (0.1)0.51 (0.1)0.62 (0.1)0.85 (0.3)1.2 (0.5)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 7.4 (14)4.4 (4)5.8 (7)5.3 (6)5.9 (11)4.9 (4)4.6 (7)6/15
PSAaSmD-CMA-ES Nishida bbob-noisy 13 (24)7.7 (13)7.0 (18)6.1 (6)5.8 (10)4.7 (7)4.5 (4)6/15

Δ fopt
f118, 5-D		 1e1
429		 1e0
1217		 1e-1
1555		 1e-2
1774		 1e-3
1998		 1e-5
2430		 1e-7
2913		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 2.8 (0.9)1.3 (0.3)1.2 (0.2)1.3 (0.2)1.5 (0.2)2.2 (0.2)2.7 (0.2)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 1.8 (0.7)0.89 (0.3)0.85 (0.3)0.95 (0.3)1.1 (0.2)1.8 (0.2)2.0 (0.2)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 2.3 (0.7)1.1 (0.4)1.0 (0.3)1.2 (0.3)1.5 (0.1)1.8 (0.2)2.1 (0.2)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1.7 (3)2.4 (0.1)3.3 (10)3.3 (4)3.9 (8)3.7 (7)3.5 (4)15/15

Δ fopt
f119, 5-D		 1e1
12		 1e0
657		 1e-1
1136		 1e-2
2363		 1e-3
10372		 1e-5
35296		 1e-7
49747		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 7.4 (8)1.3 (0.4)1.6 (1)1.3 (0.8)0.47 (0.1)0.26 (0.0)0.26 (0.0)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.9 (4)1.1 (1)1.4 (1)1.2 (0.9)0.41 (0.1)0.21 (0.1)0.21 (0.0)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 6.9 (3)2.1 (0.9)2.0 (3)1.4 (3)0.48 (0.4)0.26 (0.3)0.93 (3)14/15
PSAaSmD-CMA-ES Nishida bbob-noisy 5.4 (7)0.97 (0.7)1.2 (0.9)1.0 (0.4)0.51 (1)2.4 (0.0)4.1 (5)10/15

Δ fopt
f120, 5-D		 1e1
16		 1e0
2900		 1e-1
18698		 1e-2
34491		 1e-3
72438		 1e-5
3.3e5		 1e-7
5.5e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 8.0 (12)1.3 (0.6)0.71 (0.6)1.1 (0.5)1.1 (0.5)0.71 (0.1)0.83 (0.3)2/15
PSAaLmD-CMA-ES Nishida bbob-noisy 19 (8)7.1 (14)1.7 (3)1.7 (1)1.4 (0.8)0.73 (0.2)0.91 (1)1/15
PSAaSmC-CMA-ES Nishida bbob-noisy 4.7 (7)2.4 (6)1.6 (0.6)1.9 (0.7)1.3 (2)0.47 (0.5)0.52 (0.3)13/15
PSAaSmD-CMA-ES Nishida bbob-noisy 21 (19)18 (6)3.7 (2)2.6 (2)2.3 (2)0.90 (0.8)1.1 (2)9/15

Δ fopt
f121, 5-D		 1e1
9.0		 1e0
111		 1e-1
273		 1e-2
533		 1e-3
1583		 1e-5
3870		 1e-7
6195		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 3.5 (3)3.2 (1.0)2.9 (1)2.9 (0.6)1.8 (0.6)1.6 (0.2)1.5 (0.1)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 3.2 (6)2.3 (0.7)1.9 (0.5)2.1 (0.8)1.6 (0.4)1.4 (0.2)1.3 (0.2)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 5.0 (12)2.7 (2)2.6 (0.8)2.6 (1)1.6 (0.4)1.3 (0.1)1.2 (0.2)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 2.5 (2)1.7 (0.8)1.6 (0.5)1.7 (0.6)1.2 (0.5)★1.2 (1)★1.9 (1.0)15/15

Δ fopt
f122, 5-D		 1e1
10		 1e0
1727		 1e-1
9190		 1e-2
21579		 1e-3
30087		 1e-5
53743		 1e-7
1.1e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 8.9 (9)0.99 (0.6)0.67 (0.3)0.64 (0.2)0.73 (0.1)0.73 (0.1)0.79 (0.2)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 10 (11)1.0 (0.9)0.64 (0.1)0.63 (0.1)0.70 (0.1)0.74 (0.1)0.86 (0.1)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 11 (22)22 (74)14 (41)6.3 (12)4.7 (13)3.9 (5)2.1 (1)11/15
PSAaSmD-CMA-ES Nishida bbob-noisy 5.7 (15)2.1 (0.3)8.9 (0.5)4.0 (6)4.6 (13)2.7 (2)1.5 (0.0)12/15

Δ fopt
f123, 5-D		 1e1
11		 1e0
16066		 1e-1
81505		 1e-2
2.3e5		 1e-3
3.4e5		 1e-5
6.7e5		 1e-7
2.2e6		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 5.1 (4)1.2 (2)1.6 (0.7)1.9 (0.4)∞∞∞5e50/15
PSAaLmD-CMA-ES Nishida bbob-noisy 10 (10)1.1 (1)1.5 (1.0)2.0 (0.3)∞∞∞5e50/15
PSAaSmC-CMA-ES Nishida bbob-noisy 6.3 (13)0.76 (0.9)0.72 (0.3)0.66 (0.1)0.82 (0.1)★2∞∞5e50/15
PSAaSmD-CMA-ES Nishida bbob-noisy 10 (12)8.3 (8)3.0 (5)1.5 (1)1.6 (1)∞∞5e50/15

Δ fopt
f124, 5-D		 1e1
10		 1e0
202		 1e-1
1040		 1e-2
8974		 1e-3
20478		 1e-5
45337		 1e-7
95200		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 5.6 (11)3.4 (2)1.9 (0.6)0.61 (0.1)0.44 (0.0)0.41 (0.0)0.29 (0.0)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.4 (3)2.5 (1)1.5 (0.3)0.48 (0.1)0.39 (0.1)0.37 (0.1)0.25 (0.0)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 5.2 (7)3.4 (0.6)1.6 (0.3)0.50 (0.1)0.33 (0.0)0.28 (0.0)0.23 (0.1)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 5.6 (7)3.0 (0.6)3.6 (9)0.61 (1)0.34 (0.0)0.42 (0.2)0.25 (0.4)15/15

Δ fopt
f125, 5-D		 1e1
1		 1e0
1		 1e-1
1		 1e-2
1.3e5		 1e-3
2.4e5		 1e-5
2.4e5		 1e-7
2.5e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.9 (0.5)28 (24)3562 (2846)2.1 (1)16 (24)15 (18)15 (27)2/15
PSAaLmD-CMA-ES Nishida bbob-noisy 1.7 (2)23 (15)2721 (1720)2.2 (0.8)31 (29)31 (38)30 (38)1/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.3 (0.5)28 (22)2145 (1160)1.7 (2)1.3 (1.0)2.3 (2)2.2 (4)8/15
PSAaSmD-CMA-ES Nishida bbob-noisy 2.0 (2)27 (32)2054 (902)1.4 (0.2)2.4 (2)4.0 (4)15 (17)2/15

Δ fopt
f126, 5-D		 1e1
1		 1e0
1		 1e-1
1		 1e-2
8.8e5		 1e-3
∞		 1e-5
∞		 1e-7
∞		 #succ
0/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.7 (1)46 (46)8647 (8238)8.2 (20)   0/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.1 (2)46 (22)1.2e4 (8362)2.7 (2)   0/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.5 (1)42 (70)6393 (7797)3.9 (7)   0/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1.7 (2)42 (122)4.1e4 (1e5)1.5 (2)   0/15

Δ fopt
f127, 5-D		 1e1
1		 1e0
1		 1e-1
1		 1e-2
1.3e5		 1e-3
3.4e5		 1e-5
3.9e5		 1e-7
4.0e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.7 (1)44 (47)1764 (742)1.1 (0.4)0.78 (0.2)0.70 (0.2)0.69 (0.2)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 1.9 (1)30 (22)1975 (1814)1.4 (1)1.1 (0.6)0.98 (0.2)1.1 (1)12/15
PSAaSmC-CMA-ES Nishida bbob-noisy 2.2 (2)35 (42)1511 (1433)0.64 (1)0.41 (0.1)0.47 (0.7)0.60 (0.6)12/15
PSAaSmD-CMA-ES Nishida bbob-noisy 2.1 (2)22 (11)1839 (1696)1.4 (2)1.3 (1)2.4 (3)8.5 (7)2/15

Δ fopt
f128, 5-D		 1e1
111		 1e0
4248		 1e-1
7808		 1e-2
10500		 1e-3
12447		 1e-5
17217		 1e-7
21162		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 2.0 (4)474 (651)419 (307)311 (275)263 (394)190 (182)155 (160)2/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.0 (2)178 (207)178 (210)132 (191)111 (111)81 (95)66 (71)4/15
PSAaSmC-CMA-ES Nishida bbob-noisy 3.2 (2)136 (208)97 (129)72 (72)61 (61)44 (29)36 (48)6/15
PSAaSmD-CMA-ES Nishida bbob-noisy 2.1 (2)237 (385)257 (161)191 (287)161 (212)117 (131)95 (201)3/15

Δ fopt
f129, 5-D		 1e1
64		 1e0
10710		 1e-1
59443		 1e-2
2.3e5		 1e-3
2.8e5		 1e-5
5.1e5		 1e-7
5.8e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 3.3 (4)34 (85)17 (28)4.5 (3)3.7 (5)2.1 (2)1.8 (3)5/15
PSAaLmD-CMA-ES Nishida bbob-noisy 7.0 (8)75 (61)23 (25)8.7 (12)7.1 (6)4.0 (6)3.5 (2)3/15
PSAaSmC-CMA-ES Nishida bbob-noisy 3.8 (5)54 (59)13 (17)4.4 (4)3.6 (5)2.0 (2)1.8 (3)5/15
PSAaSmD-CMA-ES Nishida bbob-noisy 10 (5)189 (235)119 (61)30 (36)25 (39)14 (17)12 (19)1/15

Δ fopt
f130, 5-D		 1e1
55		 1e0
812		 1e-1
3034		 1e-2
8198		 1e-3
32823		 1e-5
33889		 1e-7
34528		 #succ
10/15
PSAaLmC-CMA-ES Nishida bbob-noisy 3.2 (3)71 (27)31 (44)11 (19)2.9 (4)2.8 (3)2.8 (4)9/15
PSAaLmD-CMA-ES Nishida bbob-noisy 1.9 (1)28 (40)12 (14)4.3 (5)1.1 (0.8)1.1 (2)1.1 (2)14/15
PSAaSmC-CMA-ES Nishida bbob-noisy 2.6 (3)34 (93)13 (14)4.8 (7)1.2 (1)1.2 (1)1.2 (2)12/15
PSAaSmD-CMA-ES Nishida bbob-noisy 10 (64)22 (26)10 (11)3.9 (8)0.97 (0.7)0.95 (0.9)0.95 (0.7)14/15

Previous dimension | Dimension = 10 | Next dimension

Δ fopt
f101, 10-D		 1e1
26		 1e0
40		 1e-1
181		 1e-2
185		 1e-3
194		 1e-5
210		 1e-7
226		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 14 (7)22 (3)8.1 (2)14 (3)22 (2)35 (2)47 (3)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 15 (4)22 (4)9.0 (1)14 (2)23 (2)35 (2)47 (3)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 16 (9)20 (6)7.8 (1)12 (2)18 (2)29 (2)38 (2)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 17 (6)23 (3)7.9 (0.9)13 (1.0)18 (1)28 (2)38 (2)15/15

Δ fopt
f102, 10-D		 1e1
26		 1e0
41		 1e-1
197		 1e-2
208		 1e-3
226		 1e-5
265		 1e-7
304		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 17 (5)23 (2)8.2 (2)12 (2)19 (3)29 (3)36 (1)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 16 (4)23 (5)7.6 (1)13 (2)19 (2)29 (1)35 (1)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 13 (7)20 (5)7.1 (1)12 (2)16 (2)23 (1)29 (0.6)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 12 (5)18 (3)7.2 (0.8)11 (1)16 (1)23 (1)28 (1)15/15

Δ fopt
f103, 10-D		 1e1
26		 1e0
47		 1e-1
126		 1e-2
141		 1e-3
360		 1e-5
363		 1e-7
364		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 16 (7)20 (3)13 (1)21 (2)12 (1)23 (3)34 (2)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 18 (6)20 (5)12 (2)19 (2)12 (1)22 (1)34 (2)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 14 (4)17 (3)12 (2)17 (3)10 (1.0)18 (1)26 (1)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 16 (7)18 (3)12 (2)18 (2)10 (0.7)18 (0.8)26 (2)15/15

Δ fopt
f104, 10-D		 1e1
610		 1e0
9987		 1e-1
16641		 1e-2
18419		 1e-3
19364		 1e-5
20764		 1e-7
22011		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 6.8 (0.6)∞∞∞∞∞∞1e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy 6.7 (0.8)∞∞∞∞∞∞1e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy 5.3 (0.6)∞∞∞∞∞∞1e60/15
PSAaSmD-CMA-ES Nishida bbob-noisy 5.3 (0.8)∞∞∞∞∞∞1e60/15

Δ fopt
f105, 10-D		 1e1
950		 1e0
21491		 1e-1
70146		 1e-2
72570		 1e-3
74217		 1e-5
78195		 1e-7
79729		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 4.4 (0.6)∞∞∞∞∞∞1e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy 4.3 (0.3)∞∞∞∞∞∞1e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy 3.7 (1)∞∞∞∞∞∞1e60/15
PSAaSmD-CMA-ES Nishida bbob-noisy 3.2 (0.3)∞∞∞∞∞∞1e60/15

Δ fopt
f106, 10-D		 1e1
288		 1e0
3425		 1e-1
7705		 1e-2
8190		 1e-3
8501		 1e-5
8968		 1e-7
9372		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 14 (2)∞∞∞∞∞∞1e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy 14 (0.8)3853 (2417)1713 (925)∞∞∞∞9e50/15
PSAaSmC-CMA-ES Nishida bbob-noisy 12 (5)1718 (3828)764 (1246)1487 (1007)1433 (1976)1359 (765)1300 (929)1/15
PSAaSmD-CMA-ES Nishida bbob-noisy 11 (7)3632 (4780)∞∞∞∞∞9e50/15

Δ fopt
f107, 10-D		 1e1
945		 1e0
2255		 1e-1
3871		 1e-2
5207		 1e-3
7352		 1e-5
11340		 1e-7
14303		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.4 (0.9)1.8 (0.8)1.8 (0.2)2.5 (0.5)3.0 (0.3)3.8 (0.3)4.5 (0.4)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 1.4 (0.4)1.8 (0.5)1.8 (0.4)2.3 (0.2)2.9 (0.3)3.8 (0.2)4.4 (0.1)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.7 (0.7)1.7 (0.4)1.5 (0.2)2.0 (0.3)2.2 (0.2)2.6 (0.2)2.8 (0.2)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1.3 (1)1.5 (0.3)1.5 (0.5)1.8 (0.5)2.1 (0.1)2.4 (0.4)2.8 (0.2)15/15

Δ fopt
f108, 10-D		 1e1
10015		 1e0
31433		 1e-1
47589		 1e-2
77508		 1e-3
1.1e5		 1e-5
1.8e5		 1e-7
3.1e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.5 (1)1.6 (0.5)2.2 (0.5)2.6 (0.4)3.7 (0.8)27 (24)∞1e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy 1.4 (1)1.4 (0.4)2.2 (0.4)2.5 (0.6)3.4 (0.8)42 (58)∞1e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.2 (1)1.0 (0.6)1.3 (0.2)1.5 (0.3)1.9 (0.3)2.8 (0.3)2.8 (0.3)3/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1.1 (3)1.0 (0.6)1.2 (0.3)1.5 (0.3)1.9 (0.3)2.6 (0.3)2.7 (0.4)4/15

Δ fopt
f109, 10-D		 1e1
28		 1e0
286		 1e-1
499		 1e-2
824		 1e-3
1159		 1e-5
1786		 1e-7
2415		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 15 (4)3.4 (0.5)3.6 (0.5)5.2 (2)7.5 (2)12 (1.0)14 (0.7)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 16 (3)3.4 (0.6)3.0 (0.7)5.0 (1.0)8.1 (2)12 (0.9)14 (2)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 13 (5)2.9 (0.8)3.2 (0.6)3.8 (1.0)5.4 (0.5)7.6 (0.9)8.5 (0.4)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 13 (5)3.2 (0.5)3.2 (0.9)4.2 (1)5.5 (1)7.4 (0.8)8.4 (0.7)15/15

Δ fopt
f110, 10-D		 1e1
11224		 1e0
3.3e7		 1e-1
7.0e7		 1e-2
1.6e8		 1e-3
∞		 1e-5
∞		 1e-7
∞		 #succ
0/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.6 (0.5)∞∞∞   0/15
PSAaLmD-CMA-ES Nishida bbob-noisy 1.7 (0.3)∞∞∞   0/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.0 (0.2)∞∞∞   0/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1.0 (0.3)∞∞∞   0/15

Δ fopt
f111, 10-D		 1e1
82927		 1e0
∞		 1e-1
∞		 1e-2
∞		 1e-3
∞		 1e-5
∞		 1e-7
∞		 #succ
0/15
PSAaLmC-CMA-ES Nishida bbob-noisy 2.2 (0.4)      0/15
PSAaLmD-CMA-ES Nishida bbob-noisy 3.1 (2)      0/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.0 (0.3)      0/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1.9 (0.2)      0/15

Δ fopt
f112, 10-D		 1e1
884		 1e0
11583		 1e-1
16109		 1e-2
17394		 1e-3
18239		 1e-5
19461		 1e-7
20444		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 4.6 (0.2)1251 (696)900 (719)834 (1247)795 (705)746 (1321)710 (531)1/15
PSAaLmD-CMA-ES Nishida bbob-noisy 4.6 (0.6)∞∞∞∞∞∞1e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy 3.5 (0.2)1151 (1956)828 (1036)767 (791)731 (861)686 (460)653 (693)1/15
PSAaSmD-CMA-ES Nishida bbob-noisy 3.9 (0.7)∞∞∞∞∞∞1e60/15

Δ fopt
f113, 10-D		 1e1
4469		 1e0
27633		 1e-1
1.0e5		 1e-2
1.1e5		 1e-3
1.1e5		 1e-5
1.1e5		 1e-7
1.1e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 0.75 (0.3)0.38 (0.1)0.17 (0.0)0.23 (0.0)0.24 (0.0)0.24 (0.0)0.24 (0.0)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 0.76 (0.4)0.38 (0.2)0.17 (0.0)0.23 (0.0)0.24 (0.0)0.24 (0.0)0.26 (0.1)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 0.68 (0.3)0.34 (0.1)0.83 (2)0.82 (0.0)0.82 (0.0)0.82 (0.0)0.80 (0.0)14/15
PSAaSmD-CMA-ES Nishida bbob-noisy 0.83 (0.4)0.35 (0.2)0.83 (5)0.82 (2)0.82 (5)0.82 (2)0.80 (0.0)14/15

Δ fopt
f114, 10-D		 1e1
36612		 1e0
1.3e5		 1e-1
3.3e5		 1e-2
3.9e5		 1e-3
3.9e5		 1e-5
3.9e5		 1e-7
4.1e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 0.58 (0.4)0.94 (0.2)0.70 (0.2)1.2 (0.3)1.2 (0.2)1.2 (0.2)1.2 (0.2)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 0.77 (0.3)1.1 (0.2)0.86 (0.2)1.3 (0.1)1.3 (0.1)1.3 (0.1)1.3 (0.1)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 0.44 (0.3)0.50 (0.3)0.40 (0.1)0.51 (0.1)0.52 (0.1)0.52 (0.1)0.54 (0.2)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 0.65 (0.5)0.83 (0.8)0.80 (0.4)0.86 (2)0.87 (0.1)0.87 (0.7)0.85 (0.5)14/15

Δ fopt
f115, 10-D		 1e1
398		 1e0
2899		 1e-1
8595		 1e-2
12320		 1e-3
12602		 1e-5
12602		 1e-7
12807		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 2.4 (0.6)0.87 (0.2)0.45 (0.1)0.56 (0.1)0.58 (0.1)0.58 (0.1)0.69 (0.1)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.7 (1)0.84 (0.3)0.49 (0.2)0.61 (0.1)0.65 (0.1)0.65 (0.1)0.68 (0.2)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 2.5 (0.7)0.81 (0.2)0.43 (0.1)0.45 (0.1)0.46 (0.1)0.46 (0.1)0.53 (0.0)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 2.3 (0.7)0.75 (0.2)0.53 (0.7)0.61 (0.5)0.63 (0.6)0.63 (0.1)0.67 (0.1)15/15

Δ fopt
f116, 10-D		 1e1
71444		 1e0
1.1e5		 1e-1
1.1e5		 1e-2
1.1e5		 1e-3
1.2e5		 1e-5
1.2e5		 1e-7
1.7e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 0.22 (0.0)0.20 (0.0)0.24 (0.0)0.30 (0.0)0.37 (0.0)0.52 (0.0)0.49 (0.0)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 0.17 (0.1)0.17 (0.0)0.21 (0.0)0.28 (0.0)0.36 (0.0)0.50 (0.0)0.49 (0.0)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 0.28 (0.1)1.6 (2)1.6 (7)1.6 (2)1.6 (4)1.6 (4)1.2 (2)13/15
PSAaSmD-CMA-ES Nishida bbob-noisy 0.16 (0.1)0.15 (0.1)0.18 (0.1)0.21 (0.0)0.24 (0.1)0.33 (0.0)0.32 (0.0)15/15

Δ fopt
f117, 10-D		 1e1
2.3e5		 1e0
4.0e5		 1e-1
4.9e5		 1e-2
6.3e5		 1e-3
6.5e5		 1e-5
7.2e5		 1e-7
7.9e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 0.49 (0.2)0.51 (0.1)0.62 (0.1)0.71 (0.1)1.1 (0.1)∞∞1e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy 0.48 (0.2)0.49 (0.2)0.59 (0.1)0.70 (0.1)1.0 (0.1)∞∞1e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy 0.33 (0.2)0.31 (0.2)0.34 (0.1)0.36 (0.0)0.49 (0.1)0.81 (0.0)1.6 (1.0)0/15
PSAaSmD-CMA-ES Nishida bbob-noisy 0.48 (0.5)0.52 (0.8)0.53 (0.0)0.51 (0.1)0.61 (0.0)0.92 (0.4)2.0 (0.7)1/15

Δ fopt
f118, 10-D		 1e1
1348		 1e0
3241		 1e-1
4345		 1e-2
5298		 1e-3
6097		 1e-5
7070		 1e-7
8063		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 2.2 (0.4)1.3 (0.1)1.2 (0.1)1.4 (0.2)2.1 (0.1)3.6 (0.5)4.8 (0.2)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.4 (0.2)1.3 (0.2)1.2 (0.1)1.4 (0.2)2.0 (0.2)3.6 (0.2)4.6 (0.3)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 2.1 (0.5)1.1 (0.3)1.1 (0.2)1.3 (0.2)1.5 (0.2)2.3 (0.3)2.8 (0.4)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 2.1 (0.4)1.2 (0.2)1.1 (0.2)1.2 (0.1)1.4 (0.2)2.3 (0.1)2.9 (0.2)15/15

Δ fopt
f119, 10-D		 1e1
128		 1e0
3122		 1e-1
4969		 1e-2
11200		 1e-3
36536		 1e-5
3.0e5		 1e-7
4.0e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 3.7 (6)1.3 (0.8)2.0 (0.4)1.6 (0.6)0.97 (0.2)0.24 (0.0)0.26 (0.0)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 3.1 (1)1.4 (0.4)1.8 (0.3)1.5 (0.2)0.89 (0.1)0.23 (0.0)0.26 (0.0)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 3.0 (0.3)1.1 (0.5)1.5 (0.3)1.2 (0.2)0.60 (0.1)0.14 (1e-2)0.15 (0.0)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 3.7 (3)0.97 (0.3)1.5 (0.8)1.1 (0.4)0.60 (0.1)0.14 (0.0)0.15 (9e-3)15/15

Δ fopt
f120, 10-D		 1e1
471		 1e0
39910		 1e-1
74629		 1e-2
1.6e5		 1e-3
4.4e5		 1e-5
1.3e6		 1e-7
2.5e6		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 4.1 (5)1.2 (0.7)2.4 (0.5)2.2 (0.7)1.7 (0.3)∞∞1e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy 5.5 (13)1.2 (0.6)2.6 (0.5)2.4 (0.6)1.8 (0.2)∞∞1e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy 3.6 (7)0.73 (0.3)1.2 (0.3)1.1 (0.5)0.84 (0.2)0.95 (0.3)∞1e60/15
PSAaSmD-CMA-ES Nishida bbob-noisy 3.9 (5)0.90 (0.4)1.2 (0.4)1.1 (0.6)0.86 (0.2)0.88 (0.7)∞1e60/15

Δ fopt
f121, 10-D		 1e1
72		 1e0
317		 1e-1
631		 1e-2
1475		 1e-3
3676		 1e-5
9995		 1e-7
18211		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 4.1 (2)3.9 (2)4.0 (0.9)3.2 (1)3.5 (0.5)3.1 (0.4)2.7 (0.3)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 4.1 (2)4.1 (1)3.8 (0.5)3.8 (0.9)3.5 (0.6)2.9 (0.3)2.7 (0.1)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 3.3 (2)3.3 (0.6)3.4 (0.6)3.1 (0.5)2.4 (0.4)1.8 (0.2)1.5 (0.2)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 3.6 (3)3.4 (0.9)3.2 (0.8)3.1 (0.6)2.5 (0.3)1.8 (0.2)1.5 (0.1)15/15

Δ fopt
f122, 10-D		 1e1
55		 1e0
11563		 1e-1
33165		 1e-2
97901		 1e-3
1.4e5		 1e-5
4.4e5		 1e-7
8.2e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 3.0 (5)1.2 (0.3)1.5 (0.7)1.8 (0.2)2.0 (0.2)1.3 (0.1)∞1e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy 6.0 (10)1.0 (0.2)1.5 (0.5)1.8 (0.1)2.0 (0.1)1.3 (0.1)∞1e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy 4.1 (2)0.97 (0.5)1.1 (0.2)0.88 (0.1)0.92 (0.1)0.56 (0.0)0.76 (0.2)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 3.8 (5)0.80 (0.5)0.92 (0.2)0.83 (0.1)0.88 (0.1)0.55 (0.0)0.80 (0.1)15/15

Δ fopt
f123, 10-D		 1e1
40		 1e0
94387		 1e-1
3.9e5		 1e-2
6.6e5		 1e-3
1.3e6		 1e-5
3.3e6		 1e-7
1.0e7		 #succ
7/15
PSAaLmC-CMA-ES Nishida bbob-noisy 17 (24)2.7 (2)4.9 (2)∞∞∞∞1e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy 24 (50)2.5 (1)4.3 (3)∞∞∞∞1e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy 18 (44)1.3 (0.8)1.4 (0.4)∞∞∞∞1e60/15
PSAaSmD-CMA-ES Nishida bbob-noisy 15 (15)1.4 (2)1.4 (0.8)∞∞∞∞1e60/15

Δ fopt
f124, 10-D		 1e1
37		 1e0
614		 1e-1
10452		 1e-2
34296		 1e-3
52887		 1e-5
1.4e5		 1e-7
3.3e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 2.9 (1)3.2 (0.7)0.80 (0.3)0.93 (0.1)1.1 (0.1)0.87 (0.1)0.56 (0.0)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 3.3 (4)3.0 (0.7)0.74 (0.2)0.98 (0.1)1.1 (0.1)0.87 (0.0)0.55 (0.0)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 3.5 (6)2.8 (0.8)0.54 (0.1)0.50 (0.0)0.54 (0.1)0.42 (0.0)0.25 (0.0)15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 3.9 (4)2.8 (0.9)0.60 (0.1)0.51 (0.1)0.54 (0.0)0.42 (0.0)0.25 (0.0)15/15

Δ fopt
f125, 10-D		 1e1
1		 1e0
1		 1e-1
1		 1e-2
1.1e6		 1e-3
3.0e6		 1e-5
6.4e6		 1e-7
6.4e6		 #succ
13/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.9 (0.5)198 (134)3.3e6 (4e6)∞∞∞∞1e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.1 (0.8)179 (138)1.9e6 (2e6)∞∞∞∞1e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy 2.6 (2)209 (180)1.2e6 (7e5)∞∞∞∞1e60/15
PSAaSmD-CMA-ES Nishida bbob-noisy 2.1 (2)184 (40)1.2e6 (7e5)∞∞∞∞1e60/15

Δ fopt
f126, 10-D		 1e1
1		 1e0
1		 1e-1
1		 1e-2
∞		 1e-3
∞		 1e-5
∞		 1e-7
∞		 #succ
0/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.9 (0.8)572 (284)4.7e6 (5e6)    0/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.3 (2)378 (465)7.2e6 (2e6)    0/15
PSAaSmC-CMA-ES Nishida bbob-noisy 2.4 (2)390 (150)4.7e6 (5e6)    0/15
PSAaSmD-CMA-ES Nishida bbob-noisy 2.5 (2)349 (331)3.6e6 (2e6)    0/15

Δ fopt
f127, 10-D		 1e1
1		 1e0
1		 1e-1
1		 1e-2
8.0e5		 1e-3
1.3e6		 1e-5
2.1e6		 1e-7
2.1e6		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.9 (2)147 (119)4.5e5 (5e5)∞∞∞∞1e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.5 (1)121 (74)4.7e5 (2e5)∞∞∞∞1e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy 2.3 (2)120 (70)1.9e5 (1e5)0.66 (0.1)0.93 (0.9)1.0 (1)1.6 (2)2/15
PSAaSmD-CMA-ES Nishida bbob-noisy 2.2 (2)161 (91)2.0e5 (1e5)0.64 (0.2)0.68 (0.4)0.50 (0.3)0.58 (0.4)7/15

Δ fopt
f128, 10-D		 1e1
9151		 1e0
1.4e5		 1e-1
1.4e5		 1e-2
1.4e5		 1e-3
2.9e5		 1e-5
3.8e5		 1e-7
5.3e5		 #succ
9/15
PSAaLmC-CMA-ES Nishida bbob-noisy 5.5 (17)15 (13)20 (30)19 (21)10 (15)7.3 (9)5.3 (8)4/15
PSAaLmD-CMA-ES Nishida bbob-noisy 10 (4)15 (7)29 (23)28 (56)14 (14)11 (22)7.6 (9)3/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.9 (2)15 (22)14 (21)14 (24)6.9 (9)5.3 (7)3.8 (4)5/15
PSAaSmD-CMA-ES Nishida bbob-noisy 9.4 (2)20 (44)46 (48)45 (37)22 (38)17 (17)12 (19)2/15

Δ fopt
f129, 10-D		 1e1
53967		 1e0
1.4e6		 1e-1
1.4e6		 1e-2
1.4e6		 1e-3
1.4e6		 1e-5
1.4e6		 1e-7
1.5e6		 #succ
14/15
PSAaLmC-CMA-ES Nishida bbob-noisy 6.4 (8)2.5 (2)5.1 (3)5.1 (7)5.1 (6)5.0 (6)5.0 (4)2/15
PSAaLmD-CMA-ES Nishida bbob-noisy 11 (16)5.3 (10)5.2 (3)5.1 (4)5.1 (4)10 (7)10 (22)1/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.6 (3)1.3 (1.0)2.1 (4)2.1 (1)2.1 (3)2.1 (0.5)2.1 (2)4/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1.9 (2)1.6 (2)2.9 (3)2.9 (6)2.9 (3)2.8 (2)2.8 (4)3/15

Δ fopt
f130, 10-D		 1e1
481		 1e0
5878		 1e-1
37470		 1e-2
70516		 1e-3
70910		 1e-5
72192		 1e-7
73340		 #succ
10/15
PSAaLmC-CMA-ES Nishida bbob-noisy 11 (0.8)88 (132)28 (50)15 (17)15 (10)14 (15)14 (23)7/15
PSAaLmD-CMA-ES Nishida bbob-noisy 10 (32)46 (22)12 (29)6.3 (7)6.3 (13)6.2 (5)6.2 (5)10/15
PSAaSmC-CMA-ES Nishida bbob-noisy 6.4 (18)24 (45)5.2 (6)2.8 (1)2.8 (5)2.7 (3)2.7 (4)12/15
PSAaSmD-CMA-ES Nishida bbob-noisy 6.8 (21)28 (4)6.8 (15)3.6 (6)3.6 (2)3.6 (2)3.5 (3)10/15

Previous dimension | Dimension = 20 | Next dimension

Δ fopt
f101, 20-D		 1e1
59		 1e0
425		 1e-1
571		 1e-2
677		 1e-3
700		 1e-5
739		 1e-7
783		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 23 (5)7.5 (0.9)11 (1)19 (3)31 (2)55 (2)75 (1)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 32 (8)10 (2)14 (2)21 (2)34 (3)58 (3)81 (2)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 21 (2)6.2 (1)8.0 (0.5)★314 (3)★323 (2)★339 (2)★453 (1)★415/15
PSAaSmD-CMA-ES Nishida bbob-noisy 30 (8)8.5 (1)11 (2)18 (1)27 (2)45 (2)61 (2)15/15

Δ fopt
f102, 20-D		 1e1
231		 1e0
399		 1e-1
579		 1e-2
755		 1e-3
921		 1e-5
1157		 1e-7
1407		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 5.6 (1)7.5 (1)11 (2)17 (2)24 (1)35 (1)42 (1)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 7.8 (0.9)10 (0.9)12 (2)19 (2)27 (2)38 (1)46 (1)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 4.8 (1)6.2 (0.7)★8.4 (1)★213 (1)★18 (1)★325 (0.6)★430 (0.8)★415/15
PSAaSmD-CMA-ES Nishida bbob-noisy 7.2 (1)8.7 (1)11 (0.7)15 (1)21 (1)29 (1)34 (0.7)15/15

Δ fopt
f103, 20-D		 1e1
65		 1e0
417		 1e-1
629		 1e-2
1043		 1e-3
1313		 1e-5
1893		 1e-7
2464		 #succ
14/15
PSAaLmC-CMA-ES Nishida bbob-noisy 21 (3)7.5 (0.7)10 (1)12 (2)16 (1)24 (0.7)29 (1)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 30 (3)10 (1)12 (1)14 (2)18 (1)26 (1)31 (0.7)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 19 (5)6.5 (0.7)7.7 (0.9)★29.3 (1)★212 (1.0)★316 (0.7)★420 (0.9)★315/15
PSAaSmD-CMA-ES Nishida bbob-noisy 26 (6)8.6 (1)10 (1)12 (0.6)15 (1)19 (0.8)22 (1)15/15

Δ fopt
f104, 20-D		 1e1
23690		 1e0
85656		 1e-1
1.7e5		 1e-2
1.8e5		 1e-3
1.8e5		 1e-5
1.9e5		 1e-7
2.0e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy ∞∞∞∞∞∞∞2e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy ∞∞∞∞∞∞∞2e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy ∞∞∞∞∞∞∞2e60/15
PSAaSmD-CMA-ES Nishida bbob-noisy ∞∞∞∞∞∞∞2e60/15

Δ fopt
f105, 20-D		 1e1
1.9e5		 1e0
6.1e5		 1e-1
6.3e5		 1e-2
6.4e5		 1e-3
6.5e5		 1e-5
6.6e5		 1e-7
6.7e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy ∞∞∞∞∞∞∞2e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy ∞∞∞∞∞∞∞2e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy ∞∞∞∞∞∞∞2e60/15
PSAaSmD-CMA-ES Nishida bbob-noisy ∞∞∞∞∞∞∞2e60/15

Δ fopt
f106, 20-D		 1e1
11480		 1e0
21668		 1e-1
23746		 1e-2
24788		 1e-3
25470		 1e-5
26492		 1e-7
27360		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy ∞∞∞∞∞∞∞2e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy ∞∞∞∞∞∞∞2e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy ∞∞∞∞∞∞∞1e60/15
PSAaSmD-CMA-ES Nishida bbob-noisy ∞∞∞∞∞∞∞2e60/15

Δ fopt
f107, 20-D		 1e1
8571		 1e0
13582		 1e-1
16226		 1e-2
21100		 1e-3
27357		 1e-5
52486		 1e-7
65052		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.6 (0.4)2.6 (0.5)4.9 (0.3)7.2 (1.0)11 (1)12 (0.6)15 (0.5)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.0 (0.3)3.2 (0.8)5.3 (0.7)7.4 (1)11 (1)12 (0.5)14 (0.6)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.1 (0.2)1.6 (0.3)★22.5 (0.4)★34.2 (0.7)5.8 (0.3)★5.9 (0.3)★37.1 (0.3)★215/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1.5 (0.7)2.1 (0.3)3.2 (0.2)4.8 (0.8)6.4 (0.4)6.5 (0.3)7.7 (0.4)15/15

Δ fopt
f108, 20-D		 1e1
58063		 1e0
97228		 1e-1
2.0e5		 1e-2
4.0e5		 1e-3
4.5e5		 1e-5
6.3e5		 1e-7
9.0e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 2.6 (0.6)5.6 (1)6.4 (0.7)75 (92)∞∞∞2e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.4 (0.9)6.0 (1)6.4 (0.8)74 (107)∞∞∞2e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.4 (0.5)2.3 (0.3)2.4 (0.2)2.7 (0.2)∞∞∞2e60/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1.5 (0.4)2.5 (0.3)2.5 (0.5)2.8 (0.5)68 (53)∞∞2e60/15

Δ fopt
f109, 20-D		 1e1
333		 1e0
632		 1e-1
1138		 1e-2
1679		 1e-3
2287		 1e-5
3583		 1e-7
4952		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 4.2 (0.6)5.1 (0.7)6.2 (1)11 (2)22 (3)42 (4)51 (3)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 6.0 (0.6)6.9 (1)7.1 (1)12 (2)23 (3)42 (2)49 (3)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 3.6 (0.8)4.4 (1)4.7 (0.6)★28.7 (2)15 (2)21 (0.8)★224 (1.0)★15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 5.2 (0.8)6.0 (0.9)6.2 (0.3)10 (1)17 (1.0)23 (2)26 (1)15/15

Δ fopt
f110, 20-D		 1e1
∞		 1e0
∞		 1e-1
∞		 1e-2
∞		 1e-3
∞		 1e-5
∞		 1e-7
∞		 #succ
0/15
PSAaLmC-CMA-ES Nishida bbob-noisy        0/15
PSAaLmD-CMA-ES Nishida bbob-noisy        0/15
PSAaSmC-CMA-ES Nishida bbob-noisy        0/15
PSAaSmD-CMA-ES Nishida bbob-noisy        0/15

Δ fopt
f111, 20-D		 1e1
∞		 1e0
∞		 1e-1
∞		 1e-2
∞		 1e-3
∞		 1e-5
∞		 1e-7
∞		 #succ
0/15
PSAaLmC-CMA-ES Nishida bbob-noisy        0/15
PSAaLmD-CMA-ES Nishida bbob-noisy        0/15
PSAaSmC-CMA-ES Nishida bbob-noisy        0/15
PSAaSmD-CMA-ES Nishida bbob-noisy        0/15

Δ fopt
f112, 20-D		 1e1
25552		 1e0
64124		 1e-1
69621		 1e-2
72175		 1e-3
73557		 1e-5
76137		 1e-7
78238		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy ∞∞∞∞∞∞∞2e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy ∞∞∞∞∞∞∞2e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy ∞∞∞∞∞∞∞2e60/15
PSAaSmD-CMA-ES Nishida bbob-noisy ∞∞∞∞∞∞∞2e60/15

Δ fopt
f113, 20-D		 1e1
50123		 1e0
3.6e5		 1e-1
5.6e5		 1e-2
5.9e5		 1e-3
5.9e5		 1e-5
5.9e5		 1e-7
5.9e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 0.85 (0.3)0.36 (0.1)0.39 (0.1)0.64 (0.1)0.64 (0.1)0.64 (0.1)0.66 (0.1)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 1.0 (0.3)0.38 (0.1)0.39 (0.1)0.62 (0.1)0.62 (0.1)0.62 (0.0)0.65 (0.1)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 0.52 (0.2)0.20 (0.1)0.20 (0.0)0.28 (0.0)★20.28 (0.0)★20.28 (0.0)★20.29 (0.0)★15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 0.63 (0.3)0.22 (0.1)0.22 (0.0)0.32 (0.0)0.32 (0.0)0.32 (0.0)0.32 (0.0)15/15

Δ fopt
f114, 20-D		 1e1
2.1e5		 1e0
1.1e6		 1e-1
1.4e6		 1e-2
1.6e6		 1e-3
1.6e6		 1e-5
1.6e6		 1e-7
1.6e6		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 2.7 (0.8)2.6 (2)∞∞∞∞∞2e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.5 (1)2.6 (4)∞∞∞∞∞2e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.4 (0.5)0.82 (0.3)1.1 (0.2)∞∞∞∞2e60/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1.1 (0.4)0.68 (0.2)0.91 (0.3)19 (17)19 (27)19 (12)19 (31)0/15

Δ fopt
f115, 20-D		 1e1
2405		 1e0
30268		 1e-1
91749		 1e-2
1.3e5		 1e-3
1.3e5		 1e-5
1.3e5		 1e-7
1.3e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.9 (0.3)0.37 (0.1)0.20 (0.0)0.27 (0.0)0.28 (0.1)0.28 (0.0)0.31 (0.1)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.1 (0.4)0.40 (0.1)0.20 (0.0)0.28 (0.1)0.29 (0.1)0.29 (0.1)0.30 (0.1)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.5 (0.6)0.27 (0.0)★30.14 (0.0)★20.18 (0.0)★20.18 (0.0)★20.18 (0.0)★20.19 (9e-3)★15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1.9 (0.4)0.36 (0.0)0.18 (0.0)0.22 (0.0)0.22 (0.0)0.22 (0.0)0.24 (0.0)15/15

Δ fopt
f116, 20-D		 1e1
5.0e5		 1e0
6.9e5		 1e-1
8.9e5		 1e-2
1.0e6		 1e-3
1.0e6		 1e-5
1.1e6		 1e-7
1.1e6		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 0.33 (0.1)0.32 (0.1)0.33 (0.0)0.42 (0.0)0.56 (0.0)0.83 (0.0)1.1 (0.0)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 0.31 (0.1)0.31 (0.0)0.33 (0.0)0.43 (0.0)0.57 (0.0)0.84 (0.0)1.1 (0.0)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 0.18 (0.1)0.17 (0.0)0.17 (0.0)★0.20 (0.0)★30.28 (0.0)★30.40 (0.0)★30.51 (0.0)★315/15
PSAaSmD-CMA-ES Nishida bbob-noisy 0.22 (0.1)0.20 (0.0)0.20 (8e-3)0.24 (0.0)0.31 (0.0)0.44 (0.0)0.57 (0.0)15/15

Δ fopt
f117, 20-D		 1e1
1.8e6		 1e0
2.5e6		 1e-1
2.6e6		 1e-2
2.8e6		 1e-3
2.9e6		 1e-5
3.2e6		 1e-7
3.6e6		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.2 (0.6)∞∞∞∞∞∞2e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy 1.0 (0.7)∞∞∞∞∞∞2e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy 0.42 (0.1)0.45 (0.1)0.59 (0.0)∞∞∞∞2e60/15
PSAaSmD-CMA-ES Nishida bbob-noisy 0.39 (0.1)0.41 (0.1)0.55 (0.1)∞∞∞∞2e60/15

Δ fopt
f118, 20-D		 1e1
6908		 1e0
11786		 1e-1
17514		 1e-2
22206		 1e-3
26342		 1e-5
30062		 1e-7
32659		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 2.0 (0.2)1.5 (0.1)1.3 (0.2)1.8 (0.1)2.8 (0.4)5.7 (0.1)8.3 (0.3)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.4 (0.3)1.8 (0.2)1.5 (0.1)1.9 (0.2)2.8 (0.2)5.7 (0.3)8.3 (0.3)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.5 (0.2)★31.2 (0.2)★30.96 (0.1)★41.2 (0.2)★1.7 (0.2)★3.1 (0.2)4.1 (0.2)★15/15
PSAaSmD-CMA-ES Nishida bbob-noisy 2.0 (0.2)1.5 (0.1)1.2 (0.0)1.4 (0.2)2.0 (0.2)3.2 (0.2)4.4 (0.2)15/15

Δ fopt
f119, 20-D		 1e1
2771		 1e0
29365		 1e-1
35930		 1e-2
63288		 1e-3
4.1e5		 1e-5
1.4e6		 1e-7
1.9e6		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 1.4 (0.8)1.6 (0.3)3.0 (0.7)3.5 (0.9)1.2 (0.1)0.75 (0.0)0.85 (0.0)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.0 (0.8)1.7 (0.5)3.2 (0.3)3.3 (1.0)1.2 (0.2)0.73 (0.1)0.83 (0.0)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.4 (0.9)0.87 (0.1)★1.4 (0.2)★21.9 (0.3)0.56 (0.1)★0.33 (0.0)★0.38 (0.0)★315/15
PSAaSmD-CMA-ES Nishida bbob-noisy 1.8 (1)1.1 (0.3)1.8 (0.3)2.2 (0.5)0.64 (0.0)0.37 (0.0)0.42 (0.0)15/15

Δ fopt
f120, 20-D		 1e1
36040		 1e0
1.8e5		 1e-1
2.8e5		 1e-2
8.5e5		 1e-3
1.6e6		 1e-5
6.7e6		 1e-7
1.4e7		 #succ
13/15
PSAaLmC-CMA-ES Nishida bbob-noisy 0.71 (0.4)4.6 (0.7)35 (20)∞∞∞∞2e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy 1.1 (0.7)4.2 (1.0)20 (17)∞∞∞∞2e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy 0.26 (0.2)★1.7 (1)2.9 (0.9)2.4 (1)∞∞∞2e60/15
PSAaSmD-CMA-ES Nishida bbob-noisy 0.70 (0.6)1.8 (0.4)3.0 (0.5)2.0 (0.6)∞∞∞2e60/15

Δ fopt
f121, 20-D		 1e1
249		 1e0
769		 1e-1
1426		 1e-2
3433		 1e-3
9304		 1e-5
34434		 1e-7
57404		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 5.3 (1)6.4 (1)7.2 (0.9)10 (2)10 (0.9)6.7 (0.3)6.4 (0.2)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 6.4 (1)7.9 (1)8.1 (1)10 (3)10 (2)6.4 (0.2)6.1 (0.2)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 3.9 (1)4.8 (0.5)★25.2 (2)★6.5 (1)5.2 (0.7)3.1 (0.1)2.8 (0.1)★215/15
PSAaSmD-CMA-ES Nishida bbob-noisy 5.6 (2)6.7 (0.7)6.6 (0.9)6.9 (1)5.7 (0.5)3.3 (0.3)3.0 (0.1)15/15

Δ fopt
f122, 20-D		 1e1
692		 1e0
52008		 1e-1
1.4e5		 1e-2
3.8e5		 1e-3
7.9e5		 1e-5
2.0e6		 1e-7
5.8e6		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 2.4 (2)2.9 (1)3.7 (0.4)∞∞∞∞2e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy 2.3 (0.7)3.0 (0.8)3.8 (1.0)∞∞∞∞2e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.5 (1)1.4 (0.4)2.1 (0.4)3.2 (0.4)2.6 (0.1)∞∞2e60/15
PSAaSmD-CMA-ES Nishida bbob-noisy 2.4 (1)1.6 (0.6)2.0 (0.5)3.2 (0.4)2.3 (0.1)∞∞2e60/15

Δ fopt
f123, 20-D		 1e1
1063		 1e0
5.3e5		 1e-1
1.5e6		 1e-2
3.3e6		 1e-3
5.3e6		 1e-5
2.7e7		 1e-7
1.6e8		 #succ
0/15
PSAaLmC-CMA-ES Nishida bbob-noisy 8.6 (12)56 (208)∞∞∞∞∞2e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy 7.1 (8)∞∞∞∞∞∞2e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy 3.2 (5)2.4 (2)∞∞∞∞∞2e60/15
PSAaSmD-CMA-ES Nishida bbob-noisy 5.9 (7)2.1 (0.5)∞∞∞∞∞2e60/15

Δ fopt
f124, 20-D		 1e1
192		 1e0
1959		 1e-1
40840		 1e-2
64491		 1e-3
1.3e5		 1e-5
3.9e5		 1e-7
8.0e5		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 3.4 (1)3.5 (0.6)0.99 (0.5)4.2 (0.3)3.7 (0.3)2.7 (0.1)2.1 (0.1)15/15
PSAaLmD-CMA-ES Nishida bbob-noisy 4.4 (2)4.6 (0.5)0.93 (0.1)4.0 (0.2)3.6 (0.2)2.6 (0.1)2.0 (0.1)15/15
PSAaSmC-CMA-ES Nishida bbob-noisy 2.7 (2)2.9 (0.5)0.71 (0.1)1.7 (0.1)★1.4 (0.1)★30.95 (0.0)★40.71 (0.0)★315/15
PSAaSmD-CMA-ES Nishida bbob-noisy 4.1 (2)3.4 (0.8)0.81 (0.3)1.9 (0.2)1.6 (0.1)1.0 (0.0)0.78 (0.0)15/15

Δ fopt
f125, 20-D		 1e1
1		 1e0
1		 1e-1
1		 1e-2
1.2e7		 1e-3
2.5e7		 1e-5
8.0e7		 1e-7
8.1e7		 #succ
4/15
PSAaLmC-CMA-ES Nishida bbob-noisy 4.3 (1)832 (382)∞∞∞∞∞2e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy 3.7 (2)944 (535)∞∞∞∞∞2e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy 2.7 (2)675 (343)∞∞∞∞∞2e60/15
PSAaSmD-CMA-ES Nishida bbob-noisy 3.7 (2)857 (1026)∞∞∞∞∞2e60/15

Δ fopt
f126, 20-D		 1e1
1		 1e0
1		 1e-1
1		 1e-2
∞		 1e-3
∞		 1e-5
∞		 1e-7
∞		 #succ
0/15
PSAaLmC-CMA-ES Nishida bbob-noisy 3.4 (2)2736 (810)∞    0/15
PSAaLmD-CMA-ES Nishida bbob-noisy 3.0 (2)2927 (1228)∞    0/15
PSAaSmC-CMA-ES Nishida bbob-noisy 3.3 (2)1845 (1174)∞    0/15
PSAaSmD-CMA-ES Nishida bbob-noisy 4.3 (0.8)2609 (1240)∞    0/15

Δ fopt
f127, 20-D		 1e1
1		 1e0
1		 1e-1
1		 1e-2
1.6e6		 1e-3
4.4e6		 1e-5
7.3e6		 1e-7
7.4e6		 #succ
15/15
PSAaLmC-CMA-ES Nishida bbob-noisy 3.2 (2)560 (222)∞∞∞∞∞2e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy 3.3 (2)732 (174)∞∞∞∞∞2e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy 3.9 (2)475 (138)∞∞∞∞∞2e60/15
PSAaSmD-CMA-ES Nishida bbob-noisy 3.5 (2)651 (158)∞∞∞∞∞2e60/15

Δ fopt
f128, 20-D		 1e1
1.4e5		 1e0
1.3e7		 1e-1
1.7e7		 1e-2
1.7e7		 1e-3
1.7e7		 1e-5
1.7e7		 1e-7
1.7e7		 #succ
9/15
PSAaLmC-CMA-ES Nishida bbob-noisy 19 (11)0.66 (0.5)0.80 (1)0.80 (0.9)0.80 (1)0.80 (1)0.80 (1)2/15
PSAaLmD-CMA-ES Nishida bbob-noisy 11 (8)0.46 (0.5)0.50 (2)0.50 (0.5)0.50 (0.7)0.51 (0.4)0.51 (0.4)3/15
PSAaSmC-CMA-ES Nishida bbob-noisy 2.7 (4)0.19 (0.1)0.19 (0.2)0.19 (0.2)0.19 (0.3)0.19 (0.2)0.19 (0.3)6/15
PSAaSmD-CMA-ES Nishida bbob-noisy 11 (2)0.62 (0.7)0.48 (0.8)0.48 (0.6)0.49 (0.8)0.49 (0.6)0.49 (0.4)3/15

Δ fopt
f129, 20-D		 1e1
7.8e6		 1e0
4.1e7		 1e-1
4.2e7		 1e-2
4.2e7		 1e-3
4.2e7		 1e-5
4.2e7		 1e-7
4.2e7		 #succ
5/15
PSAaLmC-CMA-ES Nishida bbob-noisy ∞∞∞∞∞∞∞2e60/15
PSAaLmD-CMA-ES Nishida bbob-noisy 3.8 (4)∞∞∞∞∞∞2e60/15
PSAaSmC-CMA-ES Nishida bbob-noisy 1.8 (1)0.35 (0.5)0.35 (0.1)0.35 (0.3)0.35 (0.2)0.35 (0.4)0.35 (0.4)0/15
PSAaSmD-CMA-ES Nishida bbob-noisy ∞∞∞∞∞∞∞2e60/15

Δ fopt
f130, 20-D		 1e1
4904		 1e0
93149		 1e-1
2.5e5		 1e-2
2.5e5		 1e-3
2.5e5		 1e-5
2.6e5		 1e-7
2.6e5		 #succ
7/15
PSAaLmC-CMA-ES Nishida bbob-noisy 43 (126)34 (59)18 (22)18 (26)18 (26)18 (12)18 (20)5/15
PSAaLmD-CMA-ES Nishida bbob-noisy 20 (28)24 (24)12 (15)12 (6)12 (22)12 (8)12 (8)7/15
PSAaSmC-CMA-ES Nishida bbob-noisy 25 (50)14 (12)5.6 (5)5.6 (12)5.6 (8)5.6 (6)5.7 (5)10/15
PSAaSmD-CMA-ES Nishida bbob-noisy 12 (11)11 (17)4.7 (3)4.7 (16)4.7 (4)4.7 (6)4.7 (7)11/15

Previous dimension | Dimension = 40 | First dimension

Average runtime (aRT in number of function evaluations) divided by the respective best aRT measured during BBOB-2009 in different dimensions. The aRT and in braces, as dispersion measure, the half difference between 10 and 90%-tile of bootstrapped run lengths appear for each algorithm and target, the corresponding reference aRT  in the first row. The different target ∆f-values are shown in the top row. #succ is the number of trials that reached the (final) target fopt+ 10−8. The median number of conducted function evaluations is additionally given in italics, if the target in the last column was never reached. Entries, succeeded by a star, are statistically significantly better (according to the rank-sum test) when compared to all other algorithms of the table, with p = 0.05 or p = 10−k when the number k following the star is larger than 1, with Bonferroni correction by the number of functions (24). A ↓ indicates the same tested against the best algorithm from BBOB 2009. Best results are printed in bold.
Data produced with COCO v2.0.778