Overview page

Table showing the aRT in number of function evaluations divided by the best aRT measured during BBOB-2009

Last dimension | Dimension = 2 | Next dimension

Δ fopt
f1, 2-D
1e1
2.0
1e0
6.0
1e-1
6.0
1e-2
6.0
1e-3
6.0
1e-5
6.0
1e-7
6.0
#succ
15/15
1komma2 brockhoff noiseless 4.4 (12)7.3 (11)13 (8)20 (12)25 (12)39 (15)55 (19)15/15
1komma2mir brockhoff noiseless 1.9 (2)2.2 (2)7.9 (2)16 (12)20 (9)35 (14)50 (8)15/15
1komma2mirser brockhoff noiseless 2.5 (4)2.7 (2)6.1 (6)11 (7)17 (4)30 (12)40 (9)15/15
1komma2ser brockhoff noiseless 4.7 (9)3.2 (2)7.7 (4)11 (10)20 (6)38 (13)50 (19)15/15
1komma4 brockhoff noiseless 3.4 (1)3.2 (3)6.1 (3)10 (5)15 (3)25 (4)33 (6)15/15
1komma4mir brockhoff noiseless 1.9 (3)2.2 (0.8)6.2 (2)11 (4)17 (7)23 (8)31 (6)15/15
1komma4mirser brockhoff noiseless 3.0 (3)2.3 (2)4.5 (2)8.8 (5)12 (3)18 (4)24 (3)15/15
1komma4ser brockhoff noiseless 4.6 (4)3.3 (2)6.1 (3)9.3 (3)13 (4)20 (3)26 (5)15/15
1plus1 brockhoff noiseless 2.6 (2)3.2 (3)6.7 (3)11 (3)14 (4)21 (3)28 (3)15/15
1plus2mirser brockhoff noiseless 2.7 (2)2.2 (2)5.7 (2)10 (3)13 (2)20 (3)26 (5)15/15
ABC elabd noiseless 2.0 (3)7.0 (10)21 (11)39 (24)62 (16)109 (21)156 (23)31/33
AVGNEWUOA ros noiseless 1.7 (1)1 (0)1 (0)★21 (0)★41 (0)★41 (0)★41 (0)★415/15
CMAEGS finck noiseless 13 (17)6.9 (6)14 (9)23 (11)49 (35)97 (34)129 (38)15/15
DE-F-AUC fialho noiseless 3.2 (5)5.7 (3)18 (8)30 (12)41 (17)71 (12)104 (12)15/15
DEuniform fialho noiseless 2.2 (3)4.3 (4)17 (7)32 (4)45 (16)73 (10)103 (13)15/15
IPOP-ACTCMA-ES ros noiseless 3.2 (4)3.1 (1)7.8 (5)11 (4)17 (5)27 (7)37 (6)15/15
IPOP-CMA-ES ros noiseless 4.6 (6)4.3 (4)10 (6)15 (4)20 (5)28 (4)37 (5)15/15
MOS torre noiseless 2.1 (3)3.4 (3)20 (14)46 (16)77 (27)126 (26)177 (49)15/15
NBC-CMA preuss noiseless 2.2 (2)3.9 (4)28 (20)55 (18)71 (18)98 (8)120 (11)15/15
PM-AdapSS-DE fialho noiseless 2.1 (1)3.1 (3)15 (8)26 (10)39 (9)69 (11)94 (21)15/15
RCGA tran noiseless 2.0 (1)8.7 (7)44 (19)80 (40)194 (157)482 (357)759 (587)15/15
SPSA finck noiseless 37 (19)19 (10)25 (24)29 (33)34 (18)48 (32)63 (43)15/15
oPOEMS kubalic noiseless 155 (127)79 (27)110 (69)335 (217)717 (155)1441 (112)2031 (385)15/15
pPOEMS kubalic noiseless 49 (51)78 (27)145 (114)354 (309)2481 (1326)6450 (2350)1.3e4 (871)15/15

Δ fopt
f2, 2-D
1e1
16
1e0
19
1e-1
25
1e-2
25
1e-3
26
1e-5
28
1e-7
29
#succ
15/15
1komma2 brockhoff noiseless 69 (57)80 (19)64 (15)67 (15)66 (9)64 (16)66 (11)15/15
1komma2mir brockhoff noiseless 87 (83)99 (53)84 (23)87 (12)85 (7)82 (12)83 (20)15/15
1komma2mirser brockhoff noiseless 57 (48)70 (22)60 (14)62 (21)63 (9)61 (9)62 (11)15/15
1komma2ser brockhoff noiseless 206 (251)213 (149)165 (196)169 (203)165 (118)157 (143)154 (135)15/15
1komma4 brockhoff noiseless 17 (16)26 (16)23 (6)26 (3)26 (5)27 (6)27 (4)15/15
1komma4mir brockhoff noiseless 24 (14)29 (7)24 (4)26 (3)26 (3)26 (3)27 (4)15/15
1komma4mirser brockhoff noiseless 19 (14)19 (14)18 (4)19 (3)19 (4)19 (2)20 (5)15/15
1komma4ser brockhoff noiseless 19 (20)26 (12)22 (5)23 (4)23 (6)23 (5)24 (6)15/15
1plus1 brockhoff noiseless 12 (7)16 (6)14 (1)15 (2)15 (1)16 (2)17 (2)15/15
1plus2mirser brockhoff noiseless 5.9 (7)11 (5)11 (1.0)12 (2)12 (1)13 (1)★214 (0.9)★215/15
ABC elabd noiseless 22 (14)32 (19)37 (13)47 (13)52 (20)62 (14)76 (9)30/30
AVGNEWUOA ros noiseless 2.0 (2)★25.5 (3)8.4 (4)11 (5)14 (10)20 (7)26 (9)15/15
CMAEGS finck noiseless 1364 (1250)1947 (2637)4116 (4006)4119 (6013)3964 (7707)3689 (1e4)3574 (3457)10/15
DE-F-AUC fialho noiseless 15 (4)15 (4)16 (3)19 (3)21 (2)26 (4)31 (1)15/15
DEuniform fialho noiseless 13 (4)16 (5)16 (3)19 (3)22 (3)27 (2)31 (4)15/15
IPOP-ACTCMA-ES ros noiseless 14 (7)18 (3)15 (2)16 (3)17 (2)18 (2)19 (2)15/15
IPOP-CMA-ES ros noiseless 16 (10)21 (7)18 (3)20 (4)20 (3)21 (1)22 (3)15/15
MOS torre noiseless 24 (15)30 (17)33 (10)40 (8)45 (6)59 (8)68 (4)15/15
NBC-CMA preuss noiseless 39 (65)102 (84)116 (38)159 (80)201 (63)295 (70)301 (27)15/15
PM-AdapSS-DE fialho noiseless 13 (4)15 (3)15 (3)19 (3)22 (2)25 (3)30 (3)15/15
RCGA tran noiseless 38 (23)56 (47)63 (30)127 (108)154 (118)350 (387)536 (174)15/15
SPSA finck noiseless 1639 (2792)8919 (9462)1.4e4 (1e4)1.7e4 (1e4)2e50/15
oPOEMS kubalic noiseless 386 (140)407 (110)387 (160)456 (122)542 (53)642 (145)796 (64)15/15
pPOEMS kubalic noiseless 1886 (174)2145 (652)2384 (969)2707 (377)3118 (1318)4175 (429)5146 (366)15/15

Δ fopt
f3, 2-D
1e1
15
1e0
271
1e-1
445
1e-2
446
1e-3
450
1e-5
454
1e-7
464
#succ
15/15
1komma2 brockhoff noiseless 13 (40)15 (12)47 (54)47 (55)47 (33)47 (75)46 (52)9/15
1komma2mir brockhoff noiseless 3.2 (3)8.4 (6)28 (38)35 (36)43 (57)43 (60)42 (30)9/15
1komma2mirser brockhoff noiseless 3.3 (2)6.2 (4)18 (10)25 (17)25 (18)25 (55)25 (39)12/15
1komma2ser brockhoff noiseless 18 (31)15 (13)44 (49)44 (104)43 (62)51 (73)50 (79)8/15
1komma4 brockhoff noiseless 10 (35)8.8 (5)14 (9)14 (7)14 (26)14 (10)14 (16)14/15
1komma4mir brockhoff noiseless 3.4 (2)3.8 (5)5.4 (3)6.1 (6)6.1 (6)6.2 (7)6.2 (5)15/15
1komma4mirser brockhoff noiseless 2.1 (2)3.0 (3)8.5 (9)11 (12)11 (17)11 (9)11 (10)15/15
1komma4ser brockhoff noiseless 5.1 (2)7.1 (4)20 (35)24 (28)24 (38)24 (20)24 (26)12/15
1plus1 brockhoff noiseless 5.5 (9)12 (10)26 (46)26 (27)26 (33)26 (47)26 (42)11/15
1plus2mirser brockhoff noiseless 9.0 (14)6.6 (8)8.6 (7)8.6 (11)8.6 (7)8.6 (10)8.5 (9)15/15
ABC elabd noiseless 5.5 (3)1.7 (1)1.6 (1)2.4 (1)2.9 (0.5)4.1 (0.9)5.0 (1)30/30
AVGNEWUOA ros noiseless 5.0 (7)1.6 (1)3.2 (2)3.2 (5)3.2 (3)3.2 (2)3.1 (3)15/15
CMAEGS finck noiseless 94 (221)272 (995)443 (350)727 (1359)1244 (1322)2876 (1878)2814 (4209)2/15
DE-F-AUC fialho noiseless 5.2 (4)2.0 (0.6)1.6 (0.9)2.0 (0.4)2.4 (0.2)2.8 (0.4)3.1 (0.4)15/15
DEuniform fialho noiseless 5.1 (4)2.0 (0.6)1.7 (0.4)2.3 (0.6)2.5 (0.4)2.9 (0.3)3.1 (0.5)15/15
IPOP-ACTCMA-ES ros noiseless 4.1 (5)3.5 (3)7.1 (4)7.4 (11)7.6 (7)7.8 (11)8.0 (7)15/15
IPOP-CMA-ES ros noiseless 4.1 (5)3.3 (2)7.7 (5)8.0 (8)8.8 (8)9.0 (6)9.1 (8)15/15
MOS torre noiseless 6.5 (6)2.4 (0.8)2.2 (0.9)2.9 (0.7)3.4 (0.7)4.3 (0.3)5.1 (1)15/15
NBC-CMA preuss noiseless 6.1 (6)4.9 (4)6.5 (5)9.4 (16)10 (4)10 (6)10 (4)15/15
PM-AdapSS-DE fialho noiseless 4.9 (3)1.8 (0.7)34 (0.4)34 (0.3)34 (222)34 (0.3)34 (108)14/15
RCGA tran noiseless 5.7 (9)18 (21)18 (15)38 (23)67 (22)81 (17)83 (50)14/15
SPSA finck noiseless 975 (34)941 (1661)1281 (1486)2e50/15
oPOEMS kubalic noiseless 41 (5)10 (7)12 (6)18 (4)23 (2)33 (3)41 (4)15/15
pPOEMS kubalic noiseless 44 (9)22 (20)42 (24)104 (45)125 (12)201 (24)267 (15)15/15

Δ fopt
f4, 2-D
1e1
22
1e0
344
1e-1
459
1e-2
496
1e-3
523
1e-5
544
1e-7
566
#succ
15/15
1komma2 brockhoff noiseless 8.3 (3)13 (5)58 (68)73 (107)70 (53)67 (52)65 (68)6/15
1komma2mir brockhoff noiseless 7.8 (39)10 (8)26 (23)30 (51)29 (59)28 (56)27 (22)11/15
1komma2mirser brockhoff noiseless 2.2 (1)13 (14)48 (57)46 (31)43 (31)42 (48)40 (64)10/15
1komma2ser brockhoff noiseless 6.9 (1)30 (11)72 (80)68 (10)65 (67)63 (33)61 (50)7/15
1komma4 brockhoff noiseless 1.3 (1)7.9 (12)27 (23)25 (22)24 (39)23 (39)22 (24)12/15
1komma4mir brockhoff noiseless 2.0 (2)8.5 (5)24 (17)27 (27)26 (9)25 (30)24 (12)13/15
1komma4mirser brockhoff noiseless 5.9 (11)5.0 (2)14 (22)17 (21)16 (26)16 (29)15 (36)13/15
1komma4ser brockhoff noiseless 3.4 (2)3.9 (3)18 (33)17 (29)16 (24)16 (18)15 (18)13/15
1plus1 brockhoff noiseless 3.6 (2)13 (18)48 (119)44 (69)42 (125)41 (37)39 (25)8/15
1plus2mirser brockhoff noiseless 1.7 (1)4.7 (6)13 (23)12 (15)12 (22)11 (22)11 (4)14/15
ABC elabd noiseless 3.7 (2)1.9 (2)2.6 (3)3.0 (1)3.4 (1)4.6 (2)5.6 (2)30/30
AVGNEWUOA ros noiseless 6.1 (5)4.0 (3)14 (23)13 (18)12 (15)12 (13)11 (15)13/15
CMAEGS finck noiseless 19 (53)178 (218)1791 (3163)5680 (6562)5388 (7948)5197 (1840)4997 (5130)1/15
DE-F-AUC fialho noiseless 3.9 (7)2.0 (0.7)111 (218)103 (202)98 (383)95 (92)91 (265)12/15
DEuniform fialho noiseless 4.5 (3)1.9 (0.3)111 (218)104 (202)141 (192)136 (276)131 (177)11/15
IPOP-ACTCMA-ES ros noiseless 3.1 (2)5.7 (6)39 (54)62 (80)80 (120)85 (63)84 (119)15/15
IPOP-CMA-ES ros noiseless 4.6 (9)12 (13)61 (113)97 (64)114 (196)171 (265)171 (90)14/15
MOS torre noiseless 4.3 (3)3.1 (5)5.2 (6)5.8 (6)6.1 (3)6.8 (6)7.6 (7)15/15
NBC-CMA preuss noiseless 6.5 (4)5.8 (7)14 (6)16 (5)16 (20)26 (23)25 (19)15/15
PM-AdapSS-DE fialho noiseless 3.7 (2)147 (292)292 (763)271 (303)257 (574)247 (276)238 (354)9/15
RCGA tran noiseless 9.0 (7)39 (47)222 (256)472 (695)2791 (2199)1e50/15
SPSA finck noiseless 4641 (4548)3781 (3779)2e50/15
oPOEMS kubalic noiseless 34 (22)14 (7)29 (56)31 (26)35 (26)40 (40)47 (40)15/15
pPOEMS kubalic noiseless 33 (15)31 (24)45 (27)103 (14)131 (29)179 (34)216 (15)15/15

Δ fopt
f5, 2-D
1e1
4.0
1e0
4.0
1e-1
4.0
1e-2
4.0
1e-3
4.0
1e-5
4.0
1e-7
4.0
#succ
15/15
1komma2 brockhoff noiseless 4.6 (8)9.1 (12)10 (9)10 (9)10 (12)10 (9)10 (8)15/15
1komma2mir brockhoff noiseless 2.4 (2)5.8 (4)6.1 (5)6.1 (4)6.1 (5)6.1 (5)6.1 (3)15/15
1komma2mirser brockhoff noiseless 1.6 (0.7)3.0 (2)3.2 (2)3.2 (2)3.2 (2)3.2 (2)3.2 (2)15/15
1komma2ser brockhoff noiseless 1.9 (1)5.6 (3)6.3 (5)6.4 (3)6.4 (5)6.4 (4)6.4 (7)15/15
1komma4 brockhoff noiseless 2.7 (1)4.6 (4)5.0 (4)5.0 (3)5.0 (3)5.0 (3)5.0 (3)15/15
1komma4mir brockhoff noiseless 2.3 (1)5.1 (2)5.3 (3)5.3 (2)5.3 (2)5.3 (2)5.3 (2)15/15
1komma4mirser brockhoff noiseless 1.9 (1)3.5 (2)3.9 (2)3.9 (1)3.9 (2)3.9 (4)3.9 (3)15/15
1komma4ser brockhoff noiseless 2.1 (1)5.8 (3)6.2 (4)6.2 (8)6.2 (7)6.2 (8)6.2 (6)15/15
1plus1 brockhoff noiseless 2.0 (2)4.9 (5)5.3 (3)5.3 (4)5.3 (4)5.3 (5)5.3 (4)15/15
1plus2mirser brockhoff noiseless 1.6 (1)3.2 (2)3.5 (2)3.5 (2)3.5 (2)3.5 (2)3.5 (2)15/15
ABC elabd noiseless 4.2 (5)21 (13)27 (23)28 (18)28 (21)28 (18)28 (26)30/30
AVGNEWUOA ros noiseless 1.0 (0.2)1.7 (0.4)1.8 (0.2)1.8 (0.2)1.8 (0.2)1.8 (0.2)1.8 (0.2)15/15
CMAEGS finck noiseless 3.1 (3)7.7 (6)7.8 (5)7.8 (6)7.8 (7)7.8 (6)7.8 (4)15/15
DE-F-AUC fialho noiseless 3.0 (3)10 (5)11 (3)11 (5)11 (6)11 (5)11 (4)15/15
DEuniform fialho noiseless 4.7 (5)16 (5)16 (13)16 (5)16 (16)16 (10)16 (10)15/15
IPOP-ACTCMA-ES ros noiseless 3.0 (2)6.3 (2)6.7 (4)6.7 (4)6.7 (4)6.7 (6)6.7 (6)15/15
IPOP-CMA-ES ros noiseless 2.8 (2)7.7 (3)8.8 (3)8.8 (15)8.8 (8)8.8 (8)8.8 (9)15/15
MOS torre noiseless 5.4 (5)21 (8)25 (10)26 (9)26 (8)26 (10)26 (7)15/15
NBC-CMA preuss noiseless 3.9 (5)67 (30)79 (6)82 (7)82 (6)82 (4)82 (4)15/15
PM-AdapSS-DE fialho noiseless 6.5 (0.4)10 (4)12 (4)12 (4)12 (4)12 (4)12 (4)15/15
RCGA tran noiseless 5.2 (5)667 (111)1278 (249)2418 (1341)3639 (1395)6327 (1362)3.7e4 (3e4)1/15
SPSA finck noiseless 17 (57)41 (25)44 (64)44 (53)44 (26)44 (61)44 (64)15/15
oPOEMS kubalic noiseless 116 (38)155 (52)172 (85)184 (89)189 (97)190 (98)190 (74)15/15
pPOEMS kubalic noiseless 58 (86)162 (50)176 (53)180 (26)181 (51)181 (51)181 (0.5)15/15

Δ fopt
f6, 2-D
1e1
13
1e0
23
1e-1
41
1e-2
54
1e-3
67
1e-5
95
1e-7
124
#succ
15/15
1komma2 brockhoff noiseless 4.3 (5)4.6 (7)3.9 (3)5.1 (3)6.5 (2)6.8 (2)6.5 (2)15/15
1komma2mir brockhoff noiseless 2.3 (2)4.6 (2)5.9 (4)5.8 (3)6.0 (2)6.8 (3)6.4 (2)15/15
1komma2mirser brockhoff noiseless 3.1 (2)4.5 (4)3.8 (2)4.3 (2)5.6 (6)5.2 (0.7)5.3 (2)15/15
1komma2ser brockhoff noiseless 4.0 (5)7.3 (9)16 (17)14 (23)14 (9)12 (5)11 (6)15/15
1komma4 brockhoff noiseless 1.6 (2)2.7 (2)2.6 (1)2.9 (0.8)3.1 (0.9)3.1 (0.7)3.2 (0.4)15/15
1komma4mir brockhoff noiseless 1.4 (1)2.2 (1)2.7 (0.8)3.0 (0.7)3.0 (0.6)3.0 (0.3)3.0 (0.4)15/15
1komma4mirser brockhoff noiseless 1.7 (3)2.7 (3)2.5 (1)2.4 (1)2.5 (0.9)2.4 (0.5)2.3 (0.4)15/15
1komma4ser brockhoff noiseless 1.9 (4)2.6 (2)2.7 (2)2.6 (2)2.7 (1)2.6 (1)2.6 (0.9)15/15
1plus1 brockhoff noiseless 2.0 (2)2.4 (0.8)2.2 (0.8)2.3 (0.6)2.2 (0.7)2.1 (0.5)2.1 (0.3)15/15
1plus2mirser brockhoff noiseless 1.1 (1)1.9 (0.8)1.8 (0.4)1.9 (0.6)1.9 (0.5)2.0 (0.3)2.0 (0.2)15/15
ABC elabd noiseless 2.7 (4)9.4 (5)20 (18)51 (37)149 (84)870 (2147)1171 (1222)20/30
AVGNEWUOA ros noiseless 3.0 (4)4.7 (5)3.9 (4)4.3 (4)4.4 (3)4.7 (0.9)4.6 (0.7)15/15
CMAEGS finck noiseless 70 (98)901 (2264)1848 (7370)1423 (961)1564 (2252)1115 (1063)1133 (3233)9/15
DE-F-AUC fialho noiseless 2.9 (3)5.9 (6)6.3 (2)7.3 (3)7.8 (1)8.5 (1)8.9 (0.7)15/15
DEuniform fialho noiseless 2.8 (2)7.7 (2)7.8 (2)8.5 (2)9.1 (0.8)9.4 (1)10 (0.4)15/15
IPOP-ACTCMA-ES ros noiseless 2.0 (2)3.2 (2)3.2 (2)3.5 (0.9)4.0 (1)3.9 (1)3.8 (0.7)15/15
IPOP-CMA-ES ros noiseless 2.3 (2)5.0 (2)4.2 (3)4.7 (2)4.5 (1)4.3 (2)4.5 (0.8)15/15
MOS torre noiseless 2.4 (4)12 (10)13 (5)16 (6)16 (4)17 (3)18 (3)15/15
NBC-CMA preuss noiseless 2.9 (2)8.3 (8)33 (93)28 (136)24 (110)19 (1)17 (30)15/15
PM-AdapSS-DE fialho noiseless 1.9 (2)4.0 (3)6.1 (1)8.1 (1)8.8 (1)8.7 (0.8)8.9 (1)15/15
RCGA tran noiseless 5.9 (23)120 (246)375 (691)593 (702)1340 (2328)3124 (3255)5742 (6311)1/15
SPSA finck noiseless 9892 (2e4)8413 (9603)7901 (8683)8255 (1e4)2.0e4 (3e4)2e50/15
oPOEMS kubalic noiseless 59 (62)91 (59)99 (58)112 (35)121 (19)135 (31)148 (19)15/15
pPOEMS kubalic noiseless 52 (13)115 (211)362 (307)599 (173)806 (246)910 (133)980 (137)15/15

Δ fopt
f7, 2-D
1e1
3.0
1e0
21
1e-1
60
1e-2
193
1e-3
217
1e-5
217
1e-7
241
#succ
15/15
1komma2 brockhoff noiseless 6.6 (5)6.6 (8)24 (12)13 (13)37 (32)37 (21)259 (210)0/15
1komma2mir brockhoff noiseless 5.8 (4)9.3 (14)10 (27)17 (19)23 (29)23 (39)54 (64)5/15
1komma2mirser brockhoff noiseless 4.6 (8)4.5 (5)13 (8)24 (23)31 (72)31 (21)69 (34)4/15
1komma2ser brockhoff noiseless 23 (56)22 (15)15 (18)27 (38)35 (22)35 (47)89 (152)2/15
1komma4 brockhoff noiseless 5.4 (8)3.7 (3)4.2 (3)2.8 (3)3.0 (2)3.0 (5)4.3 (5)15/15
1komma4mir brockhoff noiseless 5.2 (6)5.8 (6)4.8 (7)4.9 (9)5.3 (6)5.3 (8)5.6 (8)15/15
1komma4mirser brockhoff noiseless 17 (106)6.4 (3)4.4 (4)2.3 (4)2.7 (3)2.7 (3)6.4 (12)15/15
1komma4ser brockhoff noiseless 3.7 (3)5.1 (4)3.8 (3)3.6 (3)5.6 (6)5.6 (4)7.7 (6)15/15
1plus1 brockhoff noiseless 3.9 (9)2.8 (1)2.0 (1)0.72 (0.8)0.70 (0.7)0.70 (0.6)0.72 (0.5)15/15
1plus2mirser brockhoff noiseless 5.0 (6)4.4 (13)2.6 (2)1.1 (0.7)1.0 (0.3)1.0 (0.8)0.99 (0.5)15/15
ABC elabd noiseless 6.8 (11)4.2 (2)10 (11)17 (34)60 (31)60 (41)123 (130)24/30
AVGNEWUOA ros noiseless 4.2 (7)3.7 (8)6.8 (4)5.0 (10)10 (12)10 (8)9.0 (13)15/15
CMAEGS finck noiseless 919 (3890)730 (429)593 (897)938 (1043)1091 (1183)1091 (866)1611 (1274)1/15
DE-F-AUC fialho noiseless 4.2 (4)3.0 (3)2.3 (1)1.3 (0.4)1.4 (0.4)1.4 (0.4)1.6 (0.2)15/15
DEuniform fialho noiseless 6.9 (6)3.9 (2)2.8 (0.5)1.3 (0.3)1.3 (0.6)1.3 (0.4)1.4 (0.6)15/15
IPOP-ACTCMA-ES ros noiseless 6.6 (7)3.9 (5)2.6 (2)1.0 (0.9)1.1 (0.7)1.1 (0.6)1.4 (0.5)15/15
IPOP-CMA-ES ros noiseless 7.9 (4)4.1 (3)3.7 (2)1.9 (2)1.7 (2)1.7 (0.8)1.9 (2)15/15
MOS torre noiseless 4.6 (7)4.0 (2)5.2 (4)3.0 (0.7)3.4 (2)3.4 (0.8)3.5 (1)15/15
NBC-CMA preuss noiseless 4.3 (4)3.9 (2)4.6 (3)2.5 (1)2.7 (1)2.7 (0.9)4.5 (8)15/15
PM-AdapSS-DE fialho noiseless 4.6 (3)3.2 (2)2.7 (0.5)1.4 (0.3)1.4 (0.3)1.4 (0.2)1.6 (0.6)15/15
RCGA tran noiseless 4.4 (4)7.1 (5)81 (174)127 (289)240 (269)240 (383)302 (251)9/15
SPSA finck noiseless 1.9e4 (2811)4.0e4 (3e4)2e50/15
oPOEMS kubalic noiseless 177 (37)40 (18)41 (22)19 (8)22 (12)22 (10)24 (9)15/15
pPOEMS kubalic noiseless 116 (87)42 (19)45 (42)70 (69)96 (47)96 (53)125 (52)15/15

Δ fopt
f8, 2-D
1e1
5.0
1e0
12
1e-1
37
1e-2
46
1e-3
86
1e-5
94
1e-7
112
#succ
15/15
1komma2 brockhoff noiseless 28 (86)65 (88)35 (52)35 (46)22 (17)23 (21)20 (18)15/15
1komma2mir brockhoff noiseless 26 (4)47 (94)27 (37)31 (28)18 (18)18 (17)16 (8)15/15
1komma2mirser brockhoff noiseless 6.1 (8)19 (44)15 (9)21 (8)12 (4)12 (6)11 (3)15/15
1komma2ser brockhoff noiseless 58 (197)236 (332)122 (112)118 (145)87 (59)96 (178)82 (174)13/15
1komma4 brockhoff noiseless 5.7 (6)22 (27)13 (10)13 (6)8.0 (4)8.4 (4)7.7 (4)15/15
1komma4mir brockhoff noiseless 5.9 (4)8.0 (11)6.7 (6)7.9 (5)5.4 (2)6.1 (1)5.6 (0.9)15/15
1komma4mirser brockhoff noiseless 3.1 (1)10 (10)7.0 (9)8.7 (4)5.1 (3)5.2 (3)4.7 (2)15/15
1komma4ser brockhoff noiseless 6.0 (5)18 (14)11 (11)11 (11)7.1 (5)7.2 (4)6.5 (3)15/15
1plus1 brockhoff noiseless 5.6 (5)12 (17)6.4 (9)6.8 (4)4.1 (3)4.3 (2)4.0 (3)15/15
1plus2mirser brockhoff noiseless 3.8 (4)6.6 (5)5.0 (2)5.3 (3)3.2 (2)3.4 (2)3.2 (1)15/15
ABC elabd noiseless 6.2 (2)10 (10)18 (24)189 (89)826 (1226)1.8e4 (2e4)3e50/30
AVGNEWUOA ros noiseless 2.8 (3)4.6 (3)2.3 (2)2.4 (1)1.4 (0.9)★21.4 (0.8)★31.3 (0.8)★315/15
CMAEGS finck noiseless 21 (25)42 (22)34 (24)43 (112)25 (5)26 (7)25 (32)15/15
DE-F-AUC fialho noiseless 7.9 (7)11 (7)6.2 (3)10 (3)6.8 (2)8.2 (2)8.5 (1)15/15
DEuniform fialho noiseless 7.2 (8)10 (5)394 (6)321 (1090)174 (583)161 (1)136 (894)14/15
IPOP-ACTCMA-ES ros noiseless 7.1 (3)7.9 (6)7.5 (7)8.6 (7)5.2 (4)5.6 (2)5.2 (2)15/15
IPOP-CMA-ES ros noiseless 5.9 (4)14 (6)9.4 (10)11 (5)6.3 (2)6.7 (3)6.1 (2)15/15
MOS torre noiseless 6.7 (8)16 (15)15 (13)22 (12)14 (8)17 (12)17 (10)15/15
NBC-CMA preuss noiseless 6.5 (6)10 (7)13 (9)20 (9)13 (7)17 (13)17 (4)15/15
PM-AdapSS-DE fialho noiseless 7.5 (6)8.0 (3)7.4 (2)8.5 (3)6.1 (1)7.5 (1)7.9 (1)15/15
RCGA tran noiseless 11 (15)16 (9)142 (427)480 (955)785 (1205)7166 (3135)1.3e4 (1e4)1/15
SPSA finck noiseless 3410 (1e4)7112 (1e4)2.2e4 (4e4)6.2e4 (7e4)3.4e4 (8e4)2e50/15
oPOEMS kubalic noiseless 224 (222)379 (132)171 (20)186 (272)119 (165)177 (149)193 (216)15/15
pPOEMS kubalic noiseless 120 (62)109 (56)126 (101)488 (288)465 (200)796 (84)1002 (99)15/15

Δ fopt
f9, 2-D
1e1
1
1e0
18
1e-1
30
1e-2
44
1e-3
68
1e-5
81
1e-7
92
#succ
15/15
1komma2 brockhoff noiseless 69 (194)38 (45)55 (47)51 (37)36 (26)32 (18)29 (20)15/15
1komma2mir brockhoff noiseless 24 (12)18 (3)26 (60)28 (23)21 (14)19 (6)18 (13)15/15
1komma2mirser brockhoff noiseless 22 (20)15 (15)22 (30)22 (14)17 (9)16 (8)15 (8)15/15
1komma2ser brockhoff noiseless 21 (14)42 (35)108 (165)87 (48)64 (89)59 (58)55 (49)15/15
1komma4 brockhoff noiseless 21 (30)8.0 (16)11 (5)11 (6)8.0 (4)7.7 (5)7.4 (4)15/15
1komma4mir brockhoff noiseless 22 (18)3.1 (3)11 (7)9.4 (7)7.5 (3)7.1 (3)7.2 (2)15/15
1komma4mirser brockhoff noiseless 29 (54)4.0 (8)6.1 (4)6.2 (3)4.7 (3)4.5 (2)4.6 (2)15/15
1komma4ser brockhoff noiseless 15 (15)8.2 (9)10 (16)10 (5)7.9 (5)7.6 (2)7.2 (4)15/15
1plus1 brockhoff noiseless 21 (12)5.4 (7)6.4 (6)5.7 (2)4.2 (2)4.2 (2)4.1 (1.0)15/15
1plus2mirser brockhoff noiseless 26 (45)4.9 (5)5.3 (7)5.1 (2)3.7 (4)3.7 (2)3.8 (2)15/15
ABC elabd noiseless 29 (18)6.7 (7)14 (11)42 (42)240 (456)5146 (4382)9439 (6736)7/30
AVGNEWUOA ros noiseless 22 (34)4.6 (5)4.0 (2)3.2 (1)2.3 (0.6)2.1 (0.9)1.9 (0.9)★315/15
CMAEGS finck noiseless 693 (1095)64 (86)58 (64)49 (38)33 (27)31 (4)30 (16)15/15
DE-F-AUC fialho noiseless 44 (32)7.8 (8)489 (7)340 (3)223 (737)390 (618)346 (545)13/15
DEuniform fialho noiseless 28 (44)7.2 (7)10 (7)12 (5)10 (2)11 (3)11 (2)15/15
IPOP-ACTCMA-ES ros noiseless 22 (12)6.8 (9)8.8 (7)7.9 (8)6.2 (2)6.0 (2)6.0 (2)15/15
IPOP-CMA-ES ros noiseless 39 (20)10 (21)12 (5)11 (4)7.8 (4)7.4 (2)7.2 (4)15/15
MOS torre noiseless 20 (28)6.1 (3)8.4 (3)11 (6)11 (2)13 (2)14 (2)15/15
NBC-CMA preuss noiseless 32 (23)8.0 (14)18 (13)17 (4)13 (2)16 (3)17 (3)15/15
PM-AdapSS-DE fialho noiseless 33 (5)11 (3)497 (27)713 (2278)464 (2210)392 (1852)347 (1638)13/15
RCGA tran noiseless 49 (38)7.9 (9)29 (63)205 (196)988 (422)2871 (2006)1.5e4 (2e4)1/15
SPSA finck noiseless 5.5e4 (1e5)8802 (1e4)2e50/15
oPOEMS kubalic noiseless 558 (139)57 (43)75 (70)104 (64)106 (37)128 (39)157 (18)15/15
pPOEMS kubalic noiseless 558 (354)50 (37)173 (182)498 (216)605 (196)898 (60)1110 (109)15/15

Δ fopt
f10, 2-D
1e1
30
1e0
46
1e-1
54
1e-2
61
1e-3
68
1e-5
82
1e-7
98
#succ
15/15
1komma2 brockhoff noiseless 39 (36)39 (28)36 (19)33 (13)31 (14)27 (11)23 (11)15/15
1komma2mir brockhoff noiseless 48 (12)35 (16)33 (7)30 (17)27 (6)25 (5)22 (4)15/15
1komma2mirser brockhoff noiseless 29 (23)22 (16)21 (13)23 (6)21 (6)19 (5)17 (5)15/15
1komma2ser brockhoff noiseless 120 (149)114 (65)105 (73)95 (49)92 (62)80 (53)68 (28)15/15
1komma4 brockhoff noiseless 8.8 (7)11 (7)11 (5)11 (1)10 (2)8.8 (1)8.0 (1)15/15
1komma4mir brockhoff noiseless 12 (9)13 (5)12 (1)11 (1)10 (1)9.4 (1)8.5 (0.9)15/15
1komma4mirser brockhoff noiseless 7.8 (7)7.5 (3)8.0 (3)7.6 (2)7.1 (1)6.6 (1)5.9 (1)15/15
1komma4ser brockhoff noiseless 8.8 (8)8.3 (2)8.7 (4)8.4 (2)8.4 (2)7.5 (1)6.7 (1)15/15
1plus1 brockhoff noiseless 6.4 (4)5.5 (0.8)5.6 (0.8)5.5 (1)5.2 (0.6)5.0 (0.5)4.5 (0.5)15/15
1plus2mirser brockhoff noiseless 5.6 (5)5.6 (0.9)5.4 (0.7)5.0 (0.7)4.9 (0.9)4.5 (0.6)4.2 (0.4)15/15
ABC elabd noiseless 20 (26)96 (129)767 (1081)6925 (8221)3e50/30
AVGNEWUOA ros noiseless 3.8 (5)4.8 (5)6.9 (5)7.6 (3)8.8 (4)10 (5)11 (4)15/15
CMAEGS finck noiseless 143 (31)362 (1117)639 (2861)863 (825)776 (9)646 (1218)543 (1535)12/15
DE-F-AUC fialho noiseless 6.7 (4)6.8 (0.9)7.2 (0.5)7.7 (0.7)8.3 (0.5)8.5 (0.7)8.6 (0.6)15/15
DEuniform fialho noiseless 7.2 (4)6.9 (3)7.5 (2)8.1 (1)8.4 (1)9.1 (1.0)9.3 (0.7)15/15
IPOP-ACTCMA-ES ros noiseless 5.3 (2)5.4 (3)5.8 (2)6.1 (1)5.9 (2)5.4 (0.8)5.2 (0.7)15/15
IPOP-CMA-ES ros noiseless 10 (6)8.6 (3)8.4 (1)7.8 (1)7.6 (1)6.9 (1)6.4 (1)15/15
MOS torre noiseless 13 (7)18 (7)20 (5)20 (3)20 (4)20 (5)19 (3)15/15
NBC-CMA preuss noiseless 25 (28)51 (40)64 (38)77 (9)81 (19)96 (20)87 (15)15/15
PM-AdapSS-DE fialho noiseless 7.4 (2)6.5 (1)7.2 (2)7.4 (0.6)7.8 (1)8.4 (0.5)8.9 (0.7)15/15
RCGA tran noiseless 114 (5)1495 (2724)1865 (2831)3097 (4508)6583 (5742)1e50/15
SPSA finck noiseless 868 (2851)1862 (2824)1.7e4 (2e4)2.4e4 (2e4)2e50/15
oPOEMS kubalic noiseless 300 (440)738 (518)1316 (1150)1754 (1166)1893 (193)2690 (1329)2644 (1201)15/15
pPOEMS kubalic noiseless 154 (246)461 (274)833 (199)1015 (184)1262 (408)1576 (263)1740 (195)15/15

Δ fopt
f11, 2-D
1e1
35
1e0
45
1e-1
50
1e-2
62
1e-3
67
1e-5
81
1e-7
97
#succ
15/15
1komma2 brockhoff noiseless 27 (31)35 (21)35 (22)30 (13)29 (11)25 (9)22 (7)15/15
1komma2mir brockhoff noiseless 34 (27)36 (15)34 (9)29 (12)28 (13)25 (10)22 (5)15/15
1komma2mirser brockhoff noiseless 25 (22)26 (23)28 (13)26 (13)25 (11)22 (8)19 (7)15/15
1komma2ser brockhoff noiseless 53 (95)75 (57)106 (54)86 (26)85 (44)72 (51)61 (101)14/15
1komma4 brockhoff noiseless 12 (8)12 (6)11 (5)10 (2)10 (2)8.8 (1)7.9 (0.8)15/15
1komma4mir brockhoff noiseless 12 (10)13 (4)12 (3)11 (1)10 (2)9.3 (2)8.3 (1)15/15
1komma4mirser brockhoff noiseless 6.9 (7)8.5 (4)9.3 (4)8.4 (2)8.0 (2)7.1 (2)6.4 (2)15/15
1komma4ser brockhoff noiseless 11 (10)10 (8)10 (3)8.6 (4)8.3 (4)7.6 (3)6.7 (2)15/15
1plus1 brockhoff noiseless 4.2 (3)6.5 (2)6.8 (1)5.8 (0.5)5.6 (0.4)5.1 (0.4)4.8 (0.5)15/15
1plus2mirser brockhoff noiseless 3.3 (2)5.5 (2)5.7 (0.6)5.0 (0.6)4.9 (0.6)4.6 (0.4)4.2 (0.4)15/15
ABC elabd noiseless 11 (19)103 (73)821 (2131)7816 (1e4)4.1e4 (6e4)3e50/30
AVGNEWUOA ros noiseless 1.5 (0.6)3.3 (2)5.2 (3)5.3 (3)6.9 (4)8.0 (3)8.8 (5)15/15
CMAEGS finck noiseless 521 (1459)994 (2228)1277 (3013)1257 (10)1166 (1542)967 (654)812 (1552)11/15
DE-F-AUC fialho noiseless 6.4 (2)7.0 (2)8.0 (0.5)7.9 (1)8.2 (1)8.8 (0.6)9.0 (1)15/15
DEuniform fialho noiseless 6.0 (3)6.9 (2)7.9 (0.9)8.3 (1)8.5 (1.0)9.0 (0.6)9.4 (0.3)15/15
IPOP-ACTCMA-ES ros noiseless 5.2 (4)6.7 (4)7.0 (1)6.1 (2)6.1 (1)5.8 (0.6)5.5 (0.8)15/15
IPOP-CMA-ES ros noiseless 7.6 (6)8.3 (4)8.8 (3)7.6 (2)7.5 (2)6.8 (1)6.4 (1)15/15
MOS torre noiseless 13 (10)19 (7)23 (5)21 (3)21 (3)21 (2)20 (2)15/15
NBC-CMA preuss noiseless 25 (75)41 (88)58 (45)65 (53)87 (59)102 (48)88 (31)15/15
PM-AdapSS-DE fialho noiseless 6.3 (2)7.3 (2)8.3 (2)8.2 (1)8.9 (0.6)9.2 (1)9.4 (0.7)15/15
RCGA tran noiseless 75 (8)958 (1669)2155 (3255)6880 (4606)1e50/15
SPSA finck noiseless 1414 (1827)4983 (9391)1.8e4 (1e4)4.7e4 (3e4)4.3e4 (5e4)2e50/15
oPOEMS kubalic noiseless 537 (776)811 (785)1309 (504)1881 (1129)2305 (1288)2838 (286)3257 (970)15/15
pPOEMS kubalic noiseless 114 (180)477 (429)874 (482)1082 (214)1268 (199)1651 (284)1788 (180)15/15

Δ fopt
f12, 2-D
1e1
35
1e0
46
1e-1
75
1e-2
94
1e-3
105
1e-5
153
1e-7
195
#succ
15/15
1komma2 brockhoff noiseless 13 (22)24 (32)27 (33)32 (38)33 (30)35 (69)30 (3)14/15
1komma2mir brockhoff noiseless 32 (33)28 (24)26 (17)26 (19)24 (28)20 (7)21 (34)14/15
1komma2mirser brockhoff noiseless 43 (60)52 (77)43 (11)37 (27)34 (44)25 (32)21 (20)15/15
1komma2ser brockhoff noiseless 96 (131)171 (242)142 (130)116 (141)105 (127)73 (79)57 (120)13/15
1komma4 brockhoff noiseless 16 (27)21 (22)18 (27)16 (24)16 (23)13 (18)11 (10)15/15
1komma4mir brockhoff noiseless 16 (16)21 (25)19 (18)18 (17)17 (15)15 (17)13 (14)15/15
1komma4mirser brockhoff noiseless 16 (26)22 (33)18 (7)16 (21)15 (18)12 (9)10 (10)15/15
1komma4ser brockhoff noiseless 14 (24)20 (31)16 (24)15 (16)14 (1)11 (12)10 (21)15/15
1plus1 brockhoff noiseless 8.9 (4)10 (25)7.7 (12)7.0 (18)6.7 (1)5.6 (3)5.2 (6)15/15
1plus2mirser brockhoff noiseless 4.3 (3)7.6 (4)6.9 (7)6.5 (4)6.5 (7)5.8 (6)5.6 (5)15/15
ABC elabd noiseless 13 (8)176 (19)569 (1949)1468 (1921)2627 (5242)2785 (5541)2254 (2922)12/30
AVGNEWUOA ros noiseless 0.97 (0.5)★21.6 (2)★21.5 (2)★21.5 (2)★21.5 (0.6)★21.4 (1)★21.4 (2)15/15
CMAEGS finck noiseless 1082 (1321)8155 (1e4)1.1e4 (1e4)8737 (9186)1.2e4 (5717)1.8e4 (3e4)2e50/15
DE-F-AUC fialho noiseless 8.2 (3)8.3 (4)7.5 (1)7.2 (3)7.6 (5)7.5 (2)7.2 (3)15/15
DEuniform fialho noiseless 8.1 (1)321 (4)417 (668)335 (1065)301 (479)208 (982)165 (513)13/15
IPOP-ACTCMA-ES ros noiseless 5.1 (5)7.8 (7)8.3 (9)8.2 (3)8.4 (13)13 (49)11 (41)15/15
IPOP-CMA-ES ros noiseless 10 (5)12 (4)9.3 (7)9.0 (8)8.6 (13)7.2 (12)6.4 (6)15/15
MOS torre noiseless 17 (37)22 (6)18 (17)18 (17)19 (15)17 (8)17 (13)15/15
NBC-CMA preuss noiseless 21 (58)66 (130)74 (117)69 (112)76 (28)69 (56)57 (33)15/15
PM-AdapSS-DE fialho noiseless 8.3 (3)8.6 (3)198 (669)335 (2129)301 (953)333 (328)262 (514)12/15
RCGA tran noiseless 120 (10)731 (1242)854 (678)805 (1830)1021 (1226)1572 (781)1572 (1538)1/15
SPSA finck noiseless 1.6e4 (2e4)6.1e4 (9e4)3.7e4 (3e4)3.0e4 (3e4)2e50/15
oPOEMS kubalic noiseless 336 (35)727 (830)1041 (1004)1491 (1802)2232 (2855)2523 (3423)2592 (2092)11/15
pPOEMS kubalic noiseless 285 (410)408 (300)623 (345)668 (201)729 (195)798 (184)842 (108)15/15

Δ fopt
f13, 2-D
1e1
23
1e0
35
1e-1
46
1e-2
60
1e-3
71
1e-5
95
1e-7
122
#succ
15/15
1komma2 brockhoff noiseless 16 (26)30 (23)32 (15)29 (10)29 (13)28 (7)37 (24)15/15
1komma2mir brockhoff noiseless 12 (21)32 (43)41 (41)39 (29)40 (26)67 (32)68 (54)13/15
1komma2mirser brockhoff noiseless 11 (20)26 (28)30 (28)31 (19)37 (30)51 (27)51 (31)13/15
1komma2ser brockhoff noiseless 67 (88)58 (69)100 (155)97 (129)94 (92)102 (152)152 (71)7/15
1komma4 brockhoff noiseless 7.0 (9)10 (6)10 (5)8.5 (3)10 (4)10 (2)10 (1)15/15
1komma4mir brockhoff noiseless 6.2 (7)7.7 (5)7.8 (4)11 (4)11 (3)11 (3)11 (1)15/15
1komma4mirser brockhoff noiseless 2.8 (4)6.5 (5)8.3 (5)7.2 (3)7.3 (2)7.3 (1)8.0 (2)15/15
1komma4ser brockhoff noiseless 9.0 (12)10 (8)10 (6)10 (3)10 (5)10 (4)10 (3)15/15
1plus1 brockhoff noiseless 4.0 (3)5.6 (4)6.9 (5)6.6 (4)6.0 (3)7.1 (6)8.0 (6)15/15
1plus2mirser brockhoff noiseless 3.6 (4)5.6 (5)9.1 (5)8.2 (5)8.1 (5)8.1 (6)8.9 (3)15/15
ABC elabd noiseless 5.5 (3)61 (78)2278 (996)1.8e4 (9283)3e50/30
AVGNEWUOA ros noiseless 6.6 (23)17 (20)38 (46)54 (36)73 (45)140 (224)772 (698)1/15
CMAEGS finck noiseless 379 (1630)2727 (2917)4987 (8030)9966 (2e4)2e50/15
DE-F-AUC fialho noiseless 4.4 (3)6.9 (1)8.3 (2)8.5 (1)9.3 (1)9.3 (1.0)9.5 (1.0)15/15
DEuniform fialho noiseless 4.4 (3)7.1 (3)8.5 (1)8.2 (1)8.8 (0.4)10 (0.9)10 (1.0)15/15
IPOP-ACTCMA-ES ros noiseless 4.3 (5)6.1 (3)6.2 (3)5.9 (1)6.1 (1)5.9 (0.7)5.8 (0.9)15/15
IPOP-CMA-ES ros noiseless 4.9 (3)6.3 (4)6.7 (2)6.3 (1)6.6 (2)6.8 (1)7.1 (1)15/15
MOS torre noiseless 7.6 (6)17 (6)19 (4)19 (4)20 (3)19 (3)19 (1)15/15
NBC-CMA preuss noiseless 7.8 (5)14 (3)17 (4)25 (7)44 (22)48 (26)40 (19)15/15
PM-AdapSS-DE fialho noiseless 5.1 (2)6.4 (2)7.8 (2)8.1 (1)8.7 (1)9.2 (1)9.1 (0.7)15/15
RCGA tran noiseless 83 (314)1014 (1098)2825 (4046)7126 (5955)2.1e4 (2e4)1e50/15
SPSA finck noiseless 47 (85)333 (228)2477 (2694)1.6e4 (2e4)2.0e4 (1e4)3.1e4 (3e4)2e50/15
oPOEMS kubalic noiseless 54 (26)103 (29)147 (44)491 (1645)1443 (2967)1.5e4 (2e4)6.9e4 (5e4)0/15
pPOEMS kubalic noiseless 47 (14)234 (128)862 (141)1073 (322)1436 (226)1964 (509)2204 (364)15/15

Δ fopt
f14, 2-D
1e1
1
1e0
7.0
1e-1
16
1e-2
24
1e-3
38
1e-5
67
1e-7
90
#succ
15/15
1komma2 brockhoff noiseless 13 (81)10 (6)7.5 (6)11 (11)18 (11)22 (9)29 (9)15/15
1komma2mir brockhoff noiseless 2.9 (2)2.4 (1)4.6 (4)5.6 (3)11 (5)22 (10)30 (8)15/15
1komma2mirser brockhoff noiseless 2.3 (1)2.8 (3)4.0 (3)4.8 (3)10 (9)19 (4)24 (2)15/15
1komma2ser brockhoff noiseless 2.7 (0.8)4.1 (5)8.4 (19)13 (9)29 (58)64 (29)86 (112)14/15
1komma4 brockhoff noiseless 3.7 (0.8)3.0 (3)2.8 (2)4.4 (1)4.8 (2)7.4 (2)8.8 (4)15/15
1komma4mir brockhoff noiseless 2.6 (3)1.4 (1)3.0 (2)3.9 (1)6.1 (2)8.0 (2)10 (2)15/15
1komma4mirser brockhoff noiseless 2.7 (1)2.4 (3)2.5 (2)3.1 (1)4.1 (3)5.3 (1)7.0 (1)15/15
1komma4ser brockhoff noiseless 3.2 (4)2.4 (2)2.3 (2)3.4 (2)5.1 (2)7.3 (2)8.2 (1)15/15
1plus1 brockhoff noiseless 2.5 (0)2.2 (5)2.8 (1)3.2 (1)3.1 (0.6)4.5 (0.8)5.0 (0.8)15/15
1plus2mirser brockhoff noiseless 2.1 (4)2.0 (2)3.2 (1)3.5 (1)3.5 (1)3.9 (0.7)4.0 (0.5)15/15
ABC elabd noiseless 2.3 (1)5.0 (9)10 (9)18 (10)27 (24)1.2e4 (2e4)3e50/30
AVGNEWUOA ros noiseless 4.7 (9)2.3 (0.7)1.4 (0.5)1.3 (0.5)★21.5 (0.5)★32.2 (0.5)★26.8 (0.9)6/15
CMAEGS finck noiseless 26 (50)18 (19)11 (6)15 (11)21 (17)37 (12)582 (564)11/15
DE-F-AUC fialho noiseless 1.5 (1)3.8 (3)5.7 (5)10 (2)10 (2)8.8 (2)9.0 (0.6)15/15
DEuniform fialho noiseless 2.3 (0.5)3.8 (3)7.9 (4)10 (1)8.5 (2)9.0 (2)9.4 (0.6)15/15
IPOP-ACTCMA-ES ros noiseless 3.2 (2)2.9 (2)3.3 (3)4.9 (1)4.9 (2)4.9 (1)5.9 (1)15/15
IPOP-CMA-ES ros noiseless 3.1 (5)3.1 (2)4.6 (2)5.1 (2)4.7 (2)6.1 (2)7.2 (2)15/15
MOS torre noiseless 2.5 (2)4.5 (3)13 (10)17 (4)18 (3)19 (3)20 (4)15/15
NBC-CMA preuss noiseless 2.7 (2)3.1 (4)12 (10)17 (2)14 (2)16 (2)22 (5)15/15
PM-AdapSS-DE fialho noiseless 2.4 (2)2.8 (3)7.7 (2)10 (3)9.2 (2)8.7 (1)9.0 (0.7)15/15
RCGA tran noiseless 2.1 (2)3.8 (2)28 (21)34 (25)71 (81)460 (331)1632 (2913)2/15
SPSA finck noiseless 339 (66)1040 (2951)537 (385)459 (293)846 (1014)4.2e4 (5e4)3.1e4 (4e4)0/15
oPOEMS kubalic noiseless 298 (161)78 (20)68 (69)143 (48)164 (52)248 (192)2037 (2626)3/15
pPOEMS kubalic noiseless 3.1 (2)60 (13)67 (56)398 (360)756 (161)1045 (126)1669 (357)15/15

Δ fopt
f15, 2-D
1e1
37
1e0
291
1e-1
1033
1e-2
1066
1e-3
1113
1e-5
1231
1e-7
1412
#succ
15/15
1komma2 brockhoff noiseless 3.0 (0.8)14 (17)17 (12)17 (22)16 (27)15 (19)13 (14)10/15
1komma2mir brockhoff noiseless 0.83 (0.5)7.8 (7)10 (17)13 (15)13 (9)12 (4)11 (11)11/15
1komma2mirser brockhoff noiseless 2.4 (6)6.8 (9)9.5 (5)9.2 (11)8.9 (7)8.1 (9)7.1 (8)14/15
1komma2ser brockhoff noiseless 10 (12)15 (18)20 (27)24 (18)23 (19)21 (32)18 (11)8/15
1komma4 brockhoff noiseless 2.1 (4)3.6 (3)2.7 (1)2.7 (0.9)2.6 (4)2.4 (4)2.1 (3)15/15
1komma4mir brockhoff noiseless 1.1 (0.5)2.8 (1)4.7 (2)4.9 (7)4.7 (4)4.3 (6)3.8 (4)15/15
1komma4mirser brockhoff noiseless 2.3 (3)3.6 (3)5.0 (5)4.9 (8)4.7 (7)4.2 (5)3.7 (3)15/15
1komma4ser brockhoff noiseless 2.4 (1)5.8 (6)9.4 (6)9.1 (7)8.8 (8)7.9 (11)7.0 (6)13/15
1plus1 brockhoff noiseless 3.2 (6)4.0 (4)6.5 (6)6.3 (6)6.1 (6)5.5 (8)4.8 (7)14/15
1plus2mirser brockhoff noiseless 1.6 (0.8)3.4 (6)6.0 (8)5.8 (9)5.6 (9)5.1 (8)4.5 (7)14/15
ABC elabd noiseless 1.9 (1)8.8 (21)17 (19)75 (47)164 (120)495 (1094)672 (726)7/30
AVGNEWUOA ros noiseless 2.5 (9)2.5 (1)3.3 (6)3.2 (8)3.1 (3)2.8 (3)2.4 (4)13/15
CMAEGS finck noiseless 109 (356)64 (107)158 (263)331 (253)418 (419)1067 (856)933 (1565)2/15
DE-F-AUC fialho noiseless 1.8 (1)1.7 (0.8)0.77 (0.2)0.95 (0.2)0.98 (0.1)1.0 (0.2)1.0 (0.1)15/15
DEuniform fialho noiseless 1.8 (2)1.5 (0.8)0.67 (0.2)0.88 (0.2)0.95 (0.1)1.0 (0.1)1.0 (0.1)15/15
IPOP-ACTCMA-ES ros noiseless 1.4 (1.0)2.6 (1)2.5 (0.9)2.9 (0.8)2.8 (5)2.7 (5)2.4 (4)15/15
IPOP-CMA-ES ros noiseless 0.99 (1)2.8 (3)2.5 (2)2.5 (1.0)2.4 (1)2.3 (2)2.1 (1)15/15
MOS torre noiseless 1.6 (2)4.0 (6)2.7 (2)3.3 (3)3.4 (2)3.3 (3)3.1 (1)15/15
NBC-CMA preuss noiseless 2.2 (1.0)2.7 (1)3.2 (3)4.2 (3)4.2 (3)4.0 (3)3.6 (3)15/15
PM-AdapSS-DE fialho noiseless 2.1 (1)1.7 (0.7)15 (49)14 (0.2)14 (90)13 (41)11 (36)14/15
RCGA tran noiseless 3.2 (4)32 (25)32 (22)40 (33)51 (60)80 (88)114 (104)3/15
SPSA finck noiseless 39 (5)1134 (3064)1353 (1642)2e50/15
oPOEMS kubalic noiseless 17 (2)20 (11)76 (25)76 (67)75 (65)71 (131)65 (0.8)14/15
pPOEMS kubalic noiseless 20 (10)46 (37)25 (14)50 (20)63 (9)82 (5)92 (10)15/15

Δ fopt
f16, 2-D
1e1
9.0
1e0
50
1e-1
174
1e-2
326
1e-3
358
1e-5
409
1e-7
538
#succ
15/15
1komma2 brockhoff noiseless 3.1 (3)14 (7)19 (38)44 (74)74 (117)115 (260)125 (90)3/15
1komma2mir brockhoff noiseless 23 (40)14 (22)32 (62)21 (23)20 (28)21 (13)19 (18)12/15
1komma2mirser brockhoff noiseless 12 (37)20 (52)27 (44)21 (25)29 (52)48 (51)41 (58)8/15
1komma2ser brockhoff noiseless 23 (2)39 (51)41 (60)74 (115)107 (102)696 (1039)529 (576)0/15
1komma4 brockhoff noiseless 10 (42)13 (18)7.1 (10)4.2 (2)4.4 (2)4.8 (6)4.0 (2)15/15
1komma4mir brockhoff noiseless 4.1 (2)9.1 (20)5.4 (8)4.3 (6)4.4 (5)7.6 (6)5.8 (12)14/15
1komma4mirser brockhoff noiseless 2.7 (2)5.9 (7)3.6 (3)5.3 (6)4.9 (7)5.3 (4)4.2 (5)15/15
1komma4ser brockhoff noiseless 7.7 (3)10 (25)10 (4)6.2 (2)12 (21)11 (7)21 (24)13/15
1plus1 brockhoff noiseless 5.7 (2)6.8 (5)5.6 (6)5.6 (4)7.4 (7)12 (13)10 (13)14/15
1plus2mirser brockhoff noiseless 3.7 (3)7.6 (6)5.4 (5)7.6 (12)7.7 (9)11 (8)10 (10)15/15
ABC elabd noiseless 2.3 (1)3.4 (3)8.7 (14)38 (19)201 (148)4756 (4010)3683 (7712)4/30
AVGNEWUOA ros noiseless 15 (19)9.1 (10)5.5 (3)6.8 (4)13 (10)38 (35)73 (54)3/15
CMAEGS finck noiseless 168 (5)134 (124)237 (437)489 (551)2330 (2293)2e50/15
DE-F-AUC fialho noiseless 1.6 (2)4.9 (5)3.5 (2)3.6 (2)4.0 (2)4.1 (2)3.5 (1)15/15
DEuniform fialho noiseless 2.8 (3)6.8 (4)4.0 (2)3.8 (1)4.6 (2)4.7 (2)4.0 (0.8)15/15
IPOP-ACTCMA-ES ros noiseless 3.9 (8)8.3 (11)6.1 (4)3.7 (4)3.6 (3)3.3 (3)2.7 (2)15/15
IPOP-CMA-ES ros noiseless 2.6 (3)11 (13)5.0 (5)3.6 (2)4.5 (6)4.2 (6)3.4 (3)15/15
MOS torre noiseless 5.4 (12)6.0 (4)3.9 (5)5.0 (1)5.8 (5)6.5 (9)6.5 (6)15/15
NBC-CMA preuss noiseless 2.4 (3)5.3 (4)12 (12)17 (18)22 (37)23 (17)19 (27)15/15
PM-AdapSS-DE fialho noiseless 3.1 (4)4.2 (3)4.6 (2)48 (307)44 (141)39 (1)30 (0.6)14/15
RCGA tran noiseless 1.8 (1)5.2 (4)69 (29)73 (44)87 (210)219 (167)290 (195)5/15
SPSA finck noiseless 72 (149)137 (192)299 (516)424 (555)821 (1101)7270 (7458)2e50/15
oPOEMS kubalic noiseless 68 (99)152 (952)82 (8)137 (77)131 (37)126 (32)103 (352)15/15
pPOEMS kubalic noiseless 40 (31)22 (3)58 (75)106 (42)162 (93)264 (38)283 (49)15/15

Δ fopt
f17, 2-D
1e1
3.0
1e0
61
1e-1
133
1e-2
275
1e-3
396
1e-5
1086
1e-7
1657
#succ
15/15
1komma2 brockhoff noiseless 34 (109)9.1 (12)18 (24)17 (18)59 (75)2e40/15
1komma2mir brockhoff noiseless 3.3 (4)1.6 (3)4.6 (0.8)5.2 (4)7.4 (10)60 (43)84 (109)2/15
1komma2mirser brockhoff noiseless 1.6 (0.7)2.5 (0.2)2.9 (2)4.2 (5)14 (15)62 (59)180 (244)1/15
1komma2ser brockhoff noiseless 6.6 (6)4.5 (9)17 (20)48 (85)332 (328)2e40/15
1komma4 brockhoff noiseless 3.4 (4)2.0 (0.6)3.6 (9)3.1 (5)5.0 (5)13 (17)39 (59)4/15
1komma4mir brockhoff noiseless 2.8 (3)1.8 (3)2.6 (2)2.6 (1)2.9 (4)12 (23)18 (23)7/15
1komma4mirser brockhoff noiseless 2.1 (1)5.2 (9)3.3 (4)2.5 (2)3.7 (4)36 (27)32 (41)5/15
1komma4ser brockhoff noiseless 5.5 (13)1.8 (4)3.7 (7)5.3 (5)10 (16)2e40/15
1plus1 brockhoff noiseless 3.6 (5)3.3 (3)4.5 (6)12 (4)19 (30)33 (58)22 (9)6/15
1plus2mirser brockhoff noiseless 2.7 (2)1.7 (3)2.2 (1)4.0 (4)3.0 (2)5.6 (4)3.7 (2)15/15
ABC elabd noiseless 2.0 (2)2.5 (2)6.7 (6)10 (6)94 (99)435 (567)3e50/30
AVGNEWUOA ros noiseless 11 (36)4.5 (5)13 (14)33 (51)117 (133)1e40/15
CMAEGS finck noiseless 12 (10)6.5 (2)61 (200)310 (364)810 (2150)2e50/15
DE-F-AUC fialho noiseless 2.6 (6)1.9 (0.9)2.5 (0.7)2.0 (0.3)2.1 (0.5)1.3 (0.3)1.2 (0.1)15/15
DEuniform fialho noiseless 2.2 (2)1.8 (1.0)2.5 (0.8)2.1 (0.4)2.1 (0.3)1.3 (0.2)1.2 (0.1)15/15
IPOP-ACTCMA-ES ros noiseless 4.8 (4)2.6 (3)2.2 (2)1.8 (1)1.5 (0.9)1.3 (0.1)1.1 (0.6)15/15
IPOP-CMA-ES ros noiseless 17 (54)2.4 (5)2.0 (2)1.6 (2)1.7 (1)1.5 (0.7)1.1 (0.7)15/15
MOS torre noiseless 2.0 (3)4.9 (9)6.6 (7)5.0 (2)5.0 (7)3.1 (4)2.6 (2)15/15
NBC-CMA preuss noiseless 1.7 (1)2.8 (1)4.6 (5)3.0 (2)2.5 (2)1.5 (0.1)2.1 (2)15/15
PM-AdapSS-DE fialho noiseless 2.2 (3)1.6 (0.7)2.2 (0.8)2.0 (0.4)2.1 (0.3)1.4 (0.2)1.2 (0.1)15/15
RCGA tran noiseless 2.6 (2)5.0 (3)47 (70)61 (67)103 (43)124 (60)1e50/15
SPSA finck noiseless 2.5e4 (7e4)1677 (4111)771 (756)1106 (1271)2e50/15
oPOEMS kubalic noiseless 116 (134)17 (8)33 (9)28 (3)32 (1)21 (1)19 (1)15/15
pPOEMS kubalic noiseless 45 (96)23 (12)116 (95)179 (68)220 (19)142 (16)133 (10)15/15

Δ fopt
f18, 2-D
1e1
19
1e0
134
1e-1
666
1e-2
1249
1e-3
1708
1e-5
2438
1e-7
2858
#succ
15/15
1komma2 brockhoff noiseless 8.4 (2)7.7 (7)16 (34)72 (84)82 (52)2e40/15
1komma2mir brockhoff noiseless 6.5 (19)17 (24)17 (12)53 (35)168 (304)2e40/15
1komma2mirser brockhoff noiseless 1.7 (2)8.2 (16)7.8 (12)23 (47)2e40/15
1komma2ser brockhoff noiseless 74 (121)41 (42)39 (73)2e40/15
1komma4 brockhoff noiseless 3.5 (7)10 (15)8.1 (7)10 (12)11 (20)119 (131)102 (192)1/15
1komma4mir brockhoff noiseless 3.5 (18)5.7 (3)3.7 (3)4.2 (5)6.9 (10)37 (59)31 (34)3/15
1komma4mirser brockhoff noiseless 0.70 (0.9)4.1 (9)2.6 (1)8.0 (7)20 (10)2e40/15
1komma4ser brockhoff noiseless 0.93 (0.7)6.7 (12)6.3 (5)12 (13)15 (19)2e40/15
1plus1 brockhoff noiseless 2.4 (1)10 (19)17 (13)33 (49)172 (117)2e40/15
1plus2mirser brockhoff noiseless 1.3 (0.6)7.6 (13)12 (12)39 (32)173 (228)2e40/15
ABC elabd noiseless 2.4 (1)8.2 (15)20 (46)597 (970)2564 (1803)3e50/30
AVGNEWUOA ros noiseless 5.4 (4)9.0 (13)6.1 (14)62 (62)1e40/15
CMAEGS finck noiseless 12 (30)462 (428)541 (867)2e50/15
DE-F-AUC fialho noiseless 2.6 (2)1.4 (0.7)0.73 (0.2)0.62 (0.1)0.66 (0.1)0.74 (0.1)0.81 (0.1)15/15
DEuniform fialho noiseless 2.9 (3)1.8 (0.7)0.77 (0.1)0.63 (0.1)0.63 (0.1)0.71 (0.1)0.80 (0.1)15/15
IPOP-ACTCMA-ES ros noiseless 1.4 (2)3.9 (5)1.2 (0.6)0.78 (0.5)0.71 (0.3)0.85 (0.4)0.92 (0.5)15/15
IPOP-CMA-ES ros noiseless 4.9 (12)3.7 (8)1.5 (2)1.1 (1)1.1 (0.6)1.0 (0.4)1.1 (0.3)15/15
MOS torre noiseless 2.5 (2)3.8 (2)2.6 (2)1.9 (2)2.1 (1)2.6 (9)2.5 (4)15/15
NBC-CMA preuss noiseless 2.4 (3)8.6 (20)2.9 (2)2.3 (0.7)2.3 (1)2.0 (2)2.2 (3)15/15
PM-AdapSS-DE fialho noiseless 2.6 (2)1.5 (1.0)0.71 (0.1)0.65 (0.1)0.63 (0.1)0.70 (0.1)0.77 (0.1)15/15
RCGA tran noiseless 2.1 (4)114 (68)138 (178)352 (403)836 (1742)1e50/15
SPSA finck noiseless 3903 (1e4)2414 (2870)1212 (681)2253 (3243)2e50/15
oPOEMS kubalic noiseless 31 (15)17 (9)10 (5)8.9 (1)8.9 (0.9)32 (6)30 (17)14/15
pPOEMS kubalic noiseless 29 (36)37 (29)56 (13)57 (11)63 (7)77 (4)94 (6)15/15

Δ fopt
f19, 2-D
1e1
1
1e0
1
1e-1
26
1e-2
216
1e-3
227
1e-5
252
1e-7
276
#succ
15/15
1komma2 brockhoff noiseless 3.9 (4)128 (239)19 (15)21 (10)31 (18)52 (28)49 (24)12/15
1komma2mir brockhoff noiseless 2.7 (2)30 (12)22 (24)19 (30)39 (41)58 (54)54 (65)11/15
1komma2mirser brockhoff noiseless 3.7 (3)56 (142)17 (38)13 (22)23 (22)37 (39)40 (47)12/15
1komma2ser brockhoff noiseless 3.1 (5)68 (75)12 (4)32 (57)41 (23)56 (112)53 (45)10/15
1komma4 brockhoff noiseless 4.3 (7)28 (40)15 (20)15 (19)28 (14)39 (43)36 (67)12/15
1komma4mir brockhoff noiseless 4.8 (5)35 (34)11 (30)9.1 (7)10 (13)16 (22)15 (10)15/15
1komma4mirser brockhoff noiseless 6.3 (8)42 (45)12 (7)17 (14)25 (49)27 (13)29 (45)13/15
1komma4ser brockhoff noiseless 9.4 (5)57 (128)26 (18)14 (12)22 (20)24 (59)22 (15)14/15
1plus1 brockhoff noiseless 3.1 (2)52 (113)77 (209)24 (10)23 (8)21 (13)20 (59)13/15
1plus2mirser brockhoff noiseless 4.7 (9)50 (14)16 (31)13 (17)12 (19)11 (11)10 (10)15/15
ABC elabd noiseless 6.1 (7)56 (50)11 (7)7.7 (8)16 (12)73 (91)881 (1265)3/30
AVGNEWUOA ros noiseless 8.0 (4)106 (74)13 (4)22 (36)21 (19)19 (12)18 (13)13/15
CMAEGS finck noiseless 87 (18)144 (342)24 (40)118 (34)281 (148)1301 (1052)2051 (934)2/15
DE-F-AUC fialho noiseless 6.5 (8)63 (60)8.5 (5)147 (464)143 (662)132 (202)122 (362)13/15
DEuniform fialho noiseless 3.9 (5)36 (51)9.0 (6)72 (7)70 (224)67 (6)62 (7)14/15
IPOP-ACTCMA-ES ros noiseless 5.1 (6)32 (14)9.3 (13)8.7 (8)14 (18)19 (6)18 (13)15/15
IPOP-CMA-ES ros noiseless 6.3 (6)22 (20)9.2 (15)17 (36)17 (8)18 (12)17 (8)15/15
MOS torre noiseless 3.8 (3)30 (34)6.8 (3)1.9 (0.9)3.1 (2)5.0 (0.8)5.4 (2)15/15
NBC-CMA preuss noiseless 5.4 (4)36 (11)8.0 (6)11 (14)13 (17)16 (9)18 (25)15/15
PM-AdapSS-DE fialho noiseless 5.5 (2)43 (34)10 (14)341 (468)327 (442)300 (600)276 (364)11/15
RCGA tran noiseless 5.7 (2)47 (68)9.0 (5)18 (20)22 (25)107 (88)452 (330)4/15
SPSA finck noiseless 573 (1465)982 (2063)205 (113)889 (1039)1595 (2079)1.1e4 (1e4)2e50/15
oPOEMS kubalic noiseless 310 (131)549 (146)47 (27)464 (551)451 (211)415 (1841)388 (721)14/15
pPOEMS kubalic noiseless 68 (127)539 (313)50 (39)38 (24)81 (56)186 (65)258 (42)15/15

Δ fopt
f20, 2-D
1e1
4.0
1e0
61
1e-1
365
1e-2
366
1e-3
366
1e-5
370
1e-7
375
#succ
15/15
1komma2 brockhoff noiseless 5.6 (6)15 (7)24 (36)37 (66)37 (38)37 (28)37 (75)11/15
1komma2mir brockhoff noiseless 3.0 (4)13 (15)24 (23)34 (65)34 (30)34 (28)33 (20)12/15
1komma2mirser brockhoff noiseless 2.0 (2)17 (25)31 (41)54 (88)54 (111)54 (154)53 (29)10/15
1komma2ser brockhoff noiseless 91 (625)20 (8)38 (41)51 (68)52 (33)57 (55)56 (35)10/15
1komma4 brockhoff noiseless 2.9 (3)9.3 (5)6.9 (3)7.8 (10)7.8 (9)7.9 (11)7.9 (6)15/15
1komma4mir brockhoff noiseless 2.3 (2)10 (23)12 (7)13 (5)13 (17)13 (5)13 (7)14/15
1komma4mirser brockhoff noiseless 3.4 (3)11 (7)14 (9)15 (15)17 (15)17 (30)17 (10)14/15
1komma4ser brockhoff noiseless 1.5 (1)8.4 (11)10 (14)11 (13)12 (12)12 (14)12 (8)15/15
1plus1 brockhoff noiseless 3.4 (4)15 (21)4.9 (3)4.9 (4)5.0 (3)5.1 (3)5.1 (2)15/15
1plus2mirser brockhoff noiseless 1.6 (2)11 (18)4.8 (6)4.9 (3)4.9 (4)5.0 (8)5.0 (6)15/15
ABC elabd noiseless 2.5 (3)4.6 (2)2.2 (2)4.1 (2)6.0 (4)10 (14)16 (18)30/30
AVGNEWUOA ros noiseless 2.0 (0.9)10 (9)4.0 (3)4.0 (4)4.0 (3)4.0 (4)3.9 (4)15/15
CMAEGS finck noiseless 14 (16)60 (53)336 (272)1101 (992)3697 (3696)2e50/15
DE-F-AUC fialho noiseless 2.8 (2)4.6 (3)482 (1507)481 (547)481 (1094)476 (271)471 (667)8/15
DEuniform fialho noiseless 2.7 (1)4.2 (3)276 (274)276 (547)276 (820)274 (406)271 (534)10/15
IPOP-ACTCMA-ES ros noiseless 1.7 (1)12 (19)10 (17)11 (14)12 (10)12 (19)12 (20)15/15
IPOP-CMA-ES ros noiseless 5.2 (6)12 (14)11 (8)12 (15)12 (20)13 (15)13 (9)15/15
MOS torre noiseless 3.0 (4)10 (23)4.8 (3)6.7 (2)7.8 (4)9.0 (6)12 (9)15/15
NBC-CMA preuss noiseless 3.3 (3)11 (17)6.7 (5)7.6 (7)8.1 (8)8.5 (7)8.8 (7)15/15
PM-AdapSS-DE fialho noiseless 2.0 (0.5)3.9 (0.6)628 (1096)627 (547)627 (1366)621 (946)613 (1200)7/15
RCGA tran noiseless 3.3 (6)32 (49)38 (24)143 (364)335 (380)850 (1164)1182 (1607)3/15
SPSA finck noiseless 95 (114)9063 (9875)7676 (7535)7657 (3962)7658 (9290)2e50/15
oPOEMS kubalic noiseless 113 (19)28 (13)40 (65)45 (35)49 (67)61 (64)68 (64)15/15
pPOEMS kubalic noiseless 86 (70)45 (52)43 (36)83 (40)132 (39)228 (14)301 (37)15/15

Δ fopt
f21, 2-D
1e1
2.0
1e0
51
1e-1
174
1e-2
276
1e-3
290
1e-5
324
1e-7
330
#succ
15/15
1komma2 brockhoff noiseless 1.1 (0.9)15 (16)14 (10)16 (17)16 (12)17 (16)17 (17)15/15
1komma2mir brockhoff noiseless 1.3 (2)7.6 (9)8.8 (9)8.7 (4)13 (22)16 (43)16 (23)14/15
1komma2mirser brockhoff noiseless 1.5 (2)5.5 (11)13 (34)13 (7)16 (24)15 (11)15 (20)14/15
1komma2ser brockhoff noiseless 1.2 (1)20 (28)14 (12)13 (19)20 (23)20 (25)20 (24)15/15
1komma4 brockhoff noiseless 1.2 (1)8.8 (10)5.8 (11)4.4 (6)4.4 (9)4.1 (3)4.1 (4)15/15
1komma4mir brockhoff noiseless 1.3 (0.4)5.5 (11)4.9 (5)4.2 (4)6.7 (13)6.3 (13)6.3 (18)15/15
1komma4mirser brockhoff noiseless 1.1 (0.9)6.5 (7)4.7 (4)3.7 (2)3.6 (3)3.3 (3)3.5 (4)15/15
1komma4ser brockhoff noiseless 1.2 (0.6)9.3 (17)7.6 (7)6.0 (7)5.7 (6)5.2 (4)5.2 (6)15/15
1plus1 brockhoff noiseless 1.4 (1)12 (6)11 (20)7.2 (8)6.9 (8)6.2 (7)6.2 (10)15/15
1plus2mirser brockhoff noiseless 1.1 (1)12 (44)7.9 (4)5.1 (2)4.9 (4)4.4 (3)4.4 (8)15/15
ABC elabd noiseless 1.0 (1)2.0 (2)1.8 (2)2.6 (1.0)5.5 (3)26 (24)59 (128)30/30
AVGNEWUOA ros noiseless 5.1 (2)6.4 (9)4.6 (13)2.9 (8)2.8 (3)2.6 (2)2.7 (4)15/15
CMAEGS finck noiseless 10 (10)23 (46)34 (84)75 (148)96 (112)234 (298)500 (740)8/15
DE-F-AUC fialho noiseless 1.1 (1)281 (2)83 (288)53 (1.0)51 (0.9)46 (155)45 (152)14/15
DEuniform fialho noiseless 1.3 (1)2.0 (1)1.0 (0.8)1.1 (0.7)1.5 (0.8)1.6 (0.7)2.0 (0.5)15/15
IPOP-ACTCMA-ES ros noiseless 1.3 (1)6.2 (6)7.0 (4)4.9 (2)5.3 (5)5.2 (4)25 (16)15/15
IPOP-CMA-ES ros noiseless 1.1 (1)13 (24)7.7 (9)5.4 (4)13 (34)13 (29)14 (7)15/15
MOS torre noiseless 1.3 (0.5)1.8 (3)4.3 (10)4.9 (4)5.3 (10)10 (4)12 (4)15/15
NBC-CMA preuss noiseless 0.80 (0.5)2.2 (1)7.1 (23)25 (38)30 (18)35 (100)35 (43)15/15
PM-AdapSS-DE fialho noiseless 1.4 (1)1.7 (2)83 (0.6)53 (363)51 (173)46 (0.8)45 (152)14/15
RCGA tran noiseless 1.2 (0.8)14 (100)13 (30)34 (37)71 (80)196 (322)285 (248)9/15
SPSA finck noiseless 39 (44)94 (108)266 (607)218 (157)223 (350)319 (381)753 (1765)6/15
oPOEMS kubalic noiseless 92 (92)142 (29)310 (1068)198 (1087)191 (602)178 (39)178 (110)14/15
pPOEMS kubalic noiseless 1.5 (1)17 (5)8.0 (13)14 (17)25 (22)60 (34)105 (37)15/15

Δ fopt
f22, 2-D
1e1
5.0
1e0
27
1e-1
168
1e-2
218
1e-3
249
1e-5
289
1e-7
306
#succ
15/15
1komma2 brockhoff noiseless 2.2 (2)17 (37)6.1 (9)9.1 (18)8.6 (14)12 (8)12 (13)15/15
1komma2mir brockhoff noiseless 1.5 (1)34 (72)19 (93)24 (15)25 (23)23 (16)22 (7)14/15
1komma2mirser brockhoff noiseless 1.3 (2)15 (2)10 (4)11 (28)14 (21)23 (36)22 (15)14/15
1komma2ser brockhoff noiseless 1.6 (0.3)31 (28)18 (30)18 (26)23 (32)31 (44)30 (34)13/15
1komma4 brockhoff noiseless 2.3 (2)10 (18)8.3 (6)7.0 (8)6.5 (10)6.6 (5)6.3 (9)15/15
1komma4mir brockhoff noiseless 1.6 (2)14 (0.9)11 (28)11 (9)11 (12)9.5 (11)9.1 (7)15/15
1komma4mirser brockhoff noiseless 3.3 (6)18 (14)6.5 (14)5.7 (8)5.3 (8)4.6 (7)4.4 (3)15/15
1komma4ser brockhoff noiseless 1.5 (2)16 (22)5.1 (8)6.0 (3)5.5 (6)5.3 (4)5.1 (3)15/15
1plus1 brockhoff noiseless 6.7 (2)19 (24)4.4 (4)3.6 (4)3.3 (3)3.0 (2)2.9 (2)15/15
1plus2mirser brockhoff noiseless 1.0 (1)8.4 (8)4.4 (2)3.5 (2)3.2 (5)2.8 (2)2.7 (2)15/15
ABC elabd noiseless 1.5 (1)2.7 (2)2.8 (3)4.2 (2)8.9 (2)47 (24)373 (261)20/30
AVGNEWUOA ros noiseless 3.0 (6)3.8 (6)1.3 (0.8)1.1 (0.7)1.1 (2)1.1 (2)1.3 (0.7)15/15
CMAEGS finck noiseless 4.9 (5)12 (34)34 (55)50 (86)119 (208)274 (520)759 (1484)7/15
DE-F-AUC fialho noiseless 1.9 (2)2.2 (3)184 (596)142 (0.7)125 (201)108 (0.5)103 (0.4)13/15
DEuniform fialho noiseless 1.4 (0.6)2.2 (2)1.0 (1)1.3 (1)1.5 (0.6)1.8 (0.6)2.2 (0.4)15/15
IPOP-ACTCMA-ES ros noiseless 1.2 (1)4.6 (12)5.5 (8)4.7 (7)7.7 (16)7.2 (4)15 (44)15/15
IPOP-CMA-ES ros noiseless 1.6 (1)5.8 (9)5.0 (14)5.0 (2)4.8 (7)23 (137)72 (479)14/15
MOS torre noiseless 1.3 (0.7)3.7 (5)2.9 (1)3.8 (3)4.7 (4)6.2 (5)8.4 (5)15/15
NBC-CMA preuss noiseless 1.3 (1)2.2 (2)8.4 (29)21 (2)31 (2)28 (4)28 (38)15/15
PM-AdapSS-DE fialho noiseless 1.5 (2)2.3 (2)86 (1)67 (459)59 (1)51 (174)49 (164)14/15
RCGA tran noiseless 1.4 (1)2.1 (2)11 (22)25 (28)69 (126)232 (181)603 (1137)5/15
SPSA finck noiseless 109 (323)282 (407)372 (208)749 (667)1931 (3756)9800 (1e4)2e50/15
oPOEMS kubalic noiseless 67 (54)30 (7)603 (425)466 (1288)412 (1045)364 (970)349 (660)14/15
pPOEMS kubalic noiseless 40 (45)26 (18)17 (18)32 (26)44 (43)70 (32)129 (41)15/15

Δ fopt
f23, 2-D
1e1
8.0
1e0
193
1e-1
234
1e-2
263
1e-3
299
1e-5
348
1e-7
379
#succ
15/15
1komma2 brockhoff noiseless 1.5 (1)22 (41)214 (280)252 (343)222 (258)192 (134)244 (285)0/15
1komma2mir brockhoff noiseless 4.1 (9)10 (8)76 (93)81 (102)71 (63)62 (90)57 (48)8/15
1komma2mirser brockhoff noiseless 2.1 (1)18 (26)90 (78)99 (63)90 (76)78 (77)72 (119)8/15
1komma2ser brockhoff noiseless 1.5 (2)14 (4)103 (41)225 (208)288 (209)249 (263)771 (739)0/15
1komma4 brockhoff noiseless 2.0 (2)11 (9)23 (31)23 (18)27 (24)24 (21)22 (36)11/15
1komma4mir brockhoff noiseless 3.7 (6)13 (11)19 (20)17 (23)15 (9)13 (11)13 (5)15/15
1komma4mirser brockhoff noiseless 4.3 (8)8.5 (8)13 (8)13 (9)12 (8)11 (5)10 (6)15/15
1komma4ser brockhoff noiseless 2.1 (2)14 (20)29 (10)29 (42)26 (30)22 (24)21 (11)11/15
1plus1 brockhoff noiseless 8.0 (2)3.1 (4)4.5 (5)4.4 (6)4.5 (4)5.6 (4)5.4 (4)15/15
1plus2mirser brockhoff noiseless 1.9 (6)2.2 (2)6.7 (9)14 (19)14 (8)12 (19)11 (13)15/15
ABC elabd noiseless 2.1 (2)15 (11)1790 (3137)2e50/16
AVGNEWUOA ros noiseless 4.1 (9)6.7 (6)25 (34)103 (115)262 (385)1e40/15
CMAEGS finck noiseless 3.9 (5)12 (6)2603 (1971)2e50/15
DE-F-AUC fialho noiseless 1.8 (3)2.4 (0.8)5.4 (1)7.6 (1)9.3 (0.9)12 (1)15 (0.8)15/15
DEuniform fialho noiseless 2.5 (3)2.3 (1)6.0 (2)8.2 (1)10 (2)13 (1)16 (1)15/15
IPOP-ACTCMA-ES ros noiseless 2.7 (3)6.6 (7)16 (3)19 (21)17 (21)15 (28)14 (21)15/15
IPOP-CMA-ES ros noiseless 1.9 (1)7.8 (4)162 (571)232 (783)205 (9)176 (17)163 (5)14/15
MOS torre noiseless 1.9 (1)5.5 (4)24 (12)40 (17)44 (88)43 (31)42 (88)15/15
NBC-CMA preuss noiseless 1.7 (2)10 (7)736 (744)760 (583)669 (457)576 (853)529 (792)7/15
PM-AdapSS-DE fialho noiseless 2.0 (2)1.9 (1)5.8 (1)8.5 (2)10 (0.9)13 (1)16 (1)15/15
RCGA tran noiseless 1.9 (2)5.2 (7)256 (234)888 (584)4699 (6773)1e50/15
SPSA finck noiseless 18 (18)264 (238)2e50/15
oPOEMS kubalic noiseless 12 (8)41 (34)253 (647)245 (576)233 (46)225 (69)230 (397)14/15
pPOEMS kubalic noiseless 11 (19)61 (51)658 (154)865 (98)997 (138)1198 (545)1406 (153)12/15

Δ fopt
f24, 2-D
1e1
18
1e0
857
1e-1
8515
1e-2
23399
1e-3
24113
1e-5
24721
1e-7
24721
#succ
5/15
1komma2 brockhoff noiseless 6.7 (2)12 (11)2e40/15
1komma2mir brockhoff noiseless 1.6 (2)5.7 (4)35 (16)2e40/15
1komma2mirser brockhoff noiseless 1.3 (0.6)7.8 (7)33 (52)2e40/15
1komma2ser brockhoff noiseless 2.4 (4)19 (27)35 (25)13 (12)12 (23)12 (9)12 (21)1/15
1komma4 brockhoff noiseless 1.2 (1)8.6 (9)17 (17)2e40/15
1komma4mir brockhoff noiseless 2.4 (2)4.6 (5)3.3 (3)5.8 (6)5.7 (7)5.5 (6)5.5 (4)2/15
1komma4mirser brockhoff noiseless 2.8 (3)5.9 (8)5.7 (10)3.9 (5)3.8 (4)3.7 (3)3.7 (4)3/15
1komma4ser brockhoff noiseless 1.6 (2)4.9 (7)7.8 (5)12 (12)12 (8)12 (9)12 (12)1/15
1plus1 brockhoff noiseless 37 (8)6.0 (15)7.5 (4)2.7 (4)2.6 (3)2.6 (6)2.6 (2)4/15
1plus2mirser brockhoff noiseless 4.3 (11)4.0 (4)5.3 (8)12 (7)12 (9)12 (21)12 (11)1/15
ABC elabd noiseless 2.1 (2)4.2 (3)16 (16)122 (190)2e50/15
AVGNEWUOA ros noiseless 3.4 (5)1.9 (1)1.4 (2)6.2 (8)6.0 (8)5.9 (10)5.9 (5)1/15
CMAEGS finck noiseless 3.9 (3)48 (96)60 (59)2e50/15
DE-F-AUC fialho noiseless 1.5 (3)934 (758)94 (106)34 (38)33 (58)32 (14)32 (44)3/15
DEuniform fialho noiseless 2.2 (3)351 (700)35 (53)17 (43)17 (21)16 (20)16 (30)5/15
IPOP-ACTCMA-ES ros noiseless 1.6 (3)80 (156)374 (538)477 (434)463 (455)452 (387)452 (370)1/15
IPOP-CMA-ES ros noiseless 1.3 (1)27 (39)375 (447)8e50/15
MOS torre noiseless 1.7 (2)3.7 (7)6.5 (2)3.1 (4)3.9 (5)4.2 (5)5.0 (5)14/15
NBC-CMA preuss noiseless 1.9 (2)48 (88)32 (24)24 (23)28 (19)37 (27)37 (35)4/15
PM-AdapSS-DE fialho noiseless 1.8 (2)351 (350)35 (24)13 (6)13 (12)12 (18)12 (26)6/15
RCGA tran noiseless 2.4 (4)73 (110)78 (97)61 (61)59 (57)58 (100)58 (67)1/15
SPSA finck noiseless 1742 (2076)2e50/15
oPOEMS kubalic noiseless 29 (20)4555 (6301)481 (493)176 (206)171 (177)167 (237)167 (194)2/15
pPOEMS kubalic noiseless 24 (19)507 (534)56 (55)27 (52)27 (38)28 (24)29 (37)8/15

Previous dimension | Dimension = 3 | Next dimension

Δ fopt
f1, 3-D
1e1
4.0
1e0
8.0
1e-1
8.0
1e-2
8.0
1e-3
8.0
1e-5
8.0
1e-7
8.0
#succ
15/15
1komma2 brockhoff noiseless 5.6 (5)9.3 (7)16 (12)26 (9)31 (9)46 (8)66 (7)15/15
1komma2mir brockhoff noiseless 2.6 (3)5.2 (3)12 (6)18 (5)24 (6)38 (7)51 (8)15/15
1komma2mirser brockhoff noiseless 1.7 (1)4.0 (1)8.2 (5)13 (5)19 (6)30 (9)41 (8)15/15
1komma2ser brockhoff noiseless 4.9 (4)6.7 (4)12 (5)19 (11)28 (4)42 (10)60 (15)15/15
1komma4 brockhoff noiseless 2.8 (4)4.5 (5)10 (8)14 (4)19 (7)29 (5)37 (6)15/15
1komma4mir brockhoff noiseless 3.0 (3)4.5 (2)8.3 (4)12 (3)17 (4)27 (5)35 (5)15/15
1komma4mirser brockhoff noiseless 2.2 (2)3.4 (2)5.8 (3)8.8 (2)12 (3)20 (4)26 (2)15/15
1komma4ser brockhoff noiseless 2.5 (3)3.7 (1)6.7 (2)11 (3)14 (5)24 (4)30 (5)15/15
1plus1 brockhoff noiseless 2.1 (2)3.9 (2)8.8 (4)12 (4)16 (6)23 (6)31 (7)15/15
1plus2mirser brockhoff noiseless 2.6 (3)4.8 (2)8.4 (2)12 (2)15 (2)23 (3)29 (4)15/15
ABC elabd noiseless 4.9 (6)20 (9)41 (16)64 (22)88 (4)147 (17)210 (18)15/15
AVGNEWUOA ros noiseless 2.1 (0)1.1 (0)1.1 (0)★21.1 (0)★41.1 (0)★41.1 (0)★41.1 (0)★415/15
CMAEGS finck noiseless 12 (10)14 (8)24 (13)40 (19)69 (30)139 (72)197 (67)15/15
DE-F-AUC fialho noiseless 2.2 (4)15 (13)33 (16)53 (13)76 (12)118 (11)163 (14)15/15
DEuniform fialho noiseless 3.1 (3)14 (9)35 (7)57 (9)79 (14)126 (15)174 (12)15/15
IPOP-ACTCMA-ES ros noiseless 3.2 (2)6.4 (2)11 (2)16 (4)23 (2)33 (6)44 (7)15/15
IPOP-CMA-ES ros noiseless 3.2 (2)4.9 (3)11 (2)18 (4)23 (3)35 (4)47 (6)15/15
MOS torre noiseless 2.3 (2)18 (5)48 (11)72 (15)100 (24)152 (71)208 (47)15/15
NBC-CMA preuss noiseless 2.0 (2)16 (6)45 (17)57 (5)66 (7)90 (9)112 (3)15/15
PM-AdapSS-DE fialho noiseless 2.2 (2)16 (6)33 (5)55 (10)77 (7)120 (15)166 (21)15/15
RCGA tran noiseless 1.8 (2)20 (17)77 (13)152 (109)268 (199)693 (459)1315 (431)15/15
SPSA finck noiseless 17 (11)11 (9)14 (5)17 (7)20 (6)27 (14)34 (13)15/15
oPOEMS kubalic noiseless 155 (33)108 (22)191 (147)479 (353)961 (156)1628 (311)2506 (233)15/15
pPOEMS kubalic noiseless 44 (86)90 (19)165 (93)1519 (1255)3923 (1514)9419 (2067)1.5e4 (1035)15/15

Δ fopt
f2, 3-D
1e1
38
1e0
42
1e-1
43
1e-2
44
1e-3
45
1e-5
47
1e-7
48
#succ
15/15
1komma2 brockhoff noiseless 45 (22)51 (25)63 (7)63 (11)63 (8)64 (10)65 (10)15/15
1komma2mir brockhoff noiseless 39 (21)46 (12)50 (15)51 (14)51 (19)54 (12)55 (11)15/15
1komma2mirser brockhoff noiseless 33 (16)40 (19)44 (11)44 (8)44 (7)45 (8)46 (11)15/15
1komma2ser brockhoff noiseless 97 (45)113 (50)112 (39)111 (42)113 (48)112 (44)114 (43)15/15
1komma4 brockhoff noiseless 16 (11)21 (9)23 (2)24 (2)24 (2)25 (5)26 (5)15/15
1komma4mir brockhoff noiseless 19 (11)22 (3)23 (4)23 (4)24 (4)24 (4)25 (3)15/15
1komma4mirser brockhoff noiseless 12 (6)13 (3)14 (4)15 (3)16 (2)16 (2)17 (2)15/15
1komma4ser brockhoff noiseless 11 (7)17 (4)19 (7)19 (4)20 (3)21 (4)21 (3)15/15
1plus1 brockhoff noiseless 10 (6)12 (0.6)12 (2)13 (2)13 (2)14 (1)15 (1)15/15
1plus2mirser brockhoff noiseless 8.5 (3)9.4 (2)11 (1)11 (1)11 (1)12 (1)13 (0.8)★215/15
ABC elabd noiseless 18 (7)20 (10)29 (10)37 (14)43 (14)53 (9)64 (14)15/15
AVGNEWUOA ros noiseless 1.7 (2)★38.1 (8)14 (12)21 (10)29 (14)43 (18)57 (25)15/15
CMAEGS finck noiseless 110 (66)114 (29)113 (29)160 (13)166 (38)166 (37)171 (12)15/15
DE-F-AUC fialho noiseless 14 (4)16 (2)20 (2)23 (2)27 (3)33 (3)38 (4)15/15
DEuniform fialho noiseless 15 (1)18 (3)22 (3)26 (2)29 (3)35 (3)43 (5)15/15
IPOP-ACTCMA-ES ros noiseless 11 (5)13 (3)14 (2)15 (2)16 (1)17 (2)18 (2)15/15
IPOP-CMA-ES ros noiseless 12 (6)17 (4)17 (2)18 (3)19 (3)21 (2)22 (2)15/15
MOS torre noiseless 22 (6)26 (3)34 (2)39 (4)45 (2)57 (7)67 (6)15/15
NBC-CMA preuss noiseless 21 (12)30 (10)40 (16)45 (12)52 (25)54 (11)57 (14)15/15
PM-AdapSS-DE fialho noiseless 14 (2)17 (3)21 (2)25 (2)28 (3)35 (3)41 (2)15/15
RCGA tran noiseless 71 (55)123 (80)168 (98)220 (63)314 (50)740 (1218)1950 (1601)6/15
SPSA finck noiseless 1.1e5 (1e5)3e50/15
oPOEMS kubalic noiseless 263 (54)315 (154)370 (77)466 (108)502 (78)626 (83)715 (94)15/15
pPOEMS kubalic noiseless 865 (1021)1208 (1006)2050 (600)2491 (740)3037 (565)3921 (678)4434 (613)15/15

Δ fopt
f3, 3-D
1e1
38
1e0
822
1e-1
830
1e-2
835
1e-3
842
1e-5
847
1e-7
853
#succ
15/15
1komma2 brockhoff noiseless 50 (46)60 (173)252 (268)250 (677)248 (315)247 (363)246 (402)2/15
1komma2mir brockhoff noiseless 4.1 (3)16 (8)108 (99)108 (164)107 (178)107 (87)106 (187)4/15
1komma2mirser brockhoff noiseless 8.5 (2)10 (7)101 (100)126 (123)125 (77)124 (186)123 (129)4/15
1komma2ser brockhoff noiseless 62 (86)78 (88)3e40/15
1komma4 brockhoff noiseless 10 (8)8.0 (11)40 (51)39 (35)39 (43)39 (40)39 (58)9/15
1komma4mir brockhoff noiseless 7.5 (10)7.6 (5)36 (22)41 (34)41 (35)41 (37)41 (26)9/15
1komma4mirser brockhoff noiseless 6.6 (6)10 (7)42 (23)42 (68)42 (45)42 (45)41 (57)8/15
1komma4ser brockhoff noiseless 9.2 (9)12 (6)58 (94)58 (60)58 (51)57 (106)57 (62)7/15
1plus1 brockhoff noiseless 8.9 (15)14 (22)95 (62)95 (90)94 (61)94 (168)93 (261)5/15
1plus2mirser brockhoff noiseless 14 (32)6.1 (3)47 (64)47 (56)46 (42)46 (80)46 (72)8/15
ABC elabd noiseless 5.8 (3)1.1 (0.6)1.8 (0.7)2.4 (0.6)2.8 (0.4)3.7 (0.8)4.4 (0.6)15/15
AVGNEWUOA ros noiseless 9.4 (9)5.0 (3)33 (28)33 (41)33 (51)33 (28)32 (20)7/15
CMAEGS finck noiseless 89 (129)343 (460)813 (1026)819 (817)1018 (1714)1430 (1780)1421 (1928)3/15
DE-F-AUC fialho noiseless 6.6 (3)2.5 (0.6)3.5 (1)4.0 (0.7)4.2 (0.8)4.6 (0.5)4.9 (0.7)15/15
DEuniform fialho noiseless 8.7 (2)2.9 (2)135 (272)135 (270)134 (0.3)134 (266)133 (0.2)11/15
IPOP-ACTCMA-ES ros noiseless 3.0 (2)2.7 (2)13 (51)17 (44)17 (5)17 (31)18 (33)15/15
IPOP-CMA-ES ros noiseless 7.5 (8)3.4 (2)25 (8)33 (86)34 (13)35 (13)36 (93)15/15
MOS torre noiseless 10 (6)1.7 (0.6)2.6 (0.6)3.2 (3)3.6 (3)4.4 (5)5.1 (3)15/15
NBC-CMA preuss noiseless 9.2 (4)5.9 (4)31 (54)31 (90)31 (20)31 (15)31 (54)15/15
PM-AdapSS-DE fialho noiseless 7.8 (2)2.5 (0.5)29 (181)59 (91)59 (89)59 (178)59 (0.7)13/15
RCGA tran noiseless 20 (16)22 (13)36 (21)52 (39)64 (40)68 (41)71 (33)15/15
SPSA finck noiseless 4157 (7906)3e50/15
oPOEMS kubalic noiseless 28 (8)7.8 (2)24 (21)28 (23)31 (22)38 (23)46 (5)15/15
pPOEMS kubalic noiseless 30 (15)20 (7)60 (37)87 (22)125 (19)174 (18)235 (19)15/15

Δ fopt
f4, 3-D
1e1
40
1e0
808
1e-1
866
1e-2
921
1e-3
952
1e-5
1015
1e-7
1044
#succ
15/15
1komma2 brockhoff noiseless 35 (36)68 (83)3e40/15
1komma2mir brockhoff noiseless 25 (33)22 (17)153 (164)144 (138)139 (180)131 (41)127 (90)3/15
1komma2mirser brockhoff noiseless 26 (27)38 (19)235 (217)221 (237)214 (271)201 (203)196 (438)2/15
1komma2ser brockhoff noiseless 68 (123)166 (130)494 (728)465 (309)450 (441)422 (451)411 (460)1/15
1komma4 brockhoff noiseless 18 (15)18 (22)109 (97)103 (81)99 (105)93 (180)91 (130)4/15
1komma4mir brockhoff noiseless 11 (17)10 (9)121 (88)113 (134)110 (181)103 (163)100 (65)4/15
1komma4mirser brockhoff noiseless 9.5 (4)23 (16)71 (102)67 (38)65 (59)61 (58)59 (25)6/15
1komma4ser brockhoff noiseless 26 (32)20 (13)57 (53)54 (86)52 (68)49 (58)48 (47)7/15
1plus1 brockhoff noiseless 36 (17)32 (35)236 (307)222 (318)215 (123)201 (176)196 (227)2/15
1plus2mirser brockhoff noiseless 20 (15)16 (9)63 (87)59 (122)57 (99)54 (76)52 (69)6/15
ABC elabd noiseless 6.6 (4)1.7 (1)2.6 (1)3.0 (0.9)3.5 (1)4.4 (0.8)5.2 (1)15/15
AVGNEWUOA ros noiseless 11 (10)14 (7)162 (150)153 (85)148 (242)139 (161)135 (121)2/15
CMAEGS finck noiseless 673 (446)3e50/15
DE-F-AUC fialho noiseless 11 (8)252 (372)1390 (953)1307 (978)1265 (2127)1187 (1552)1154 (1078)3/15
DEuniform fialho noiseless 11 (4)31 (94)524 (780)493 (488)477 (473)448 (517)436 (719)6/15
IPOP-ACTCMA-ES ros noiseless 8.3 (2)463 (597)6e50/15
IPOP-CMA-ES ros noiseless 12 (16)440 (1115)4534 (7384)4264 (4911)4125 (2703)3869 (5919)3762 (3853)2/15
MOS torre noiseless 11 (6)2.3 (1.0)5.6 (5)5.8 (5)6.0 (5)6.5 (5)7.0 (4)15/15
NBC-CMA preuss noiseless 12 (3)28 (31)104 (84)98 (117)95 (119)89 (119)87 (119)15/15
PM-AdapSS-DE fialho noiseless 12 (6)200 (187)958 (1298)901 (1222)872 (1182)836 (1313)813 (1454)4/15
RCGA tran noiseless 31 (24)2636 (3342)2e50/15
SPSA finck noiseless 1.2e4 (1e4)3e50/15
oPOEMS kubalic noiseless 43 (14)17 (26)41 (61)42 (78)43 (38)48 (35)53 (52)15/15
pPOEMS kubalic noiseless 41 (38)35 (20)66 (30)107 (13)122 (19)163 (27)211 (20)15/15

Δ fopt
f5, 3-D
1e1
7.0
1e0
7.0
1e-1
7.0
1e-2
7.0
1e-3
7.0
1e-5
7.0
1e-7
7.0
#succ
15/15
1komma2 brockhoff noiseless 3.8 (4)6.7 (4)7.1 (6)7.2 (6)7.2 (4)7.2 (6)7.2 (5)15/15
1komma2mir brockhoff noiseless 2.4 (0.8)3.8 (2)3.9 (2)3.9 (2)3.9 (1)3.9 (2)3.9 (2)15/15
1komma2mirser brockhoff noiseless 1.9 (1)3.0 (1)3.1 (2)3.1 (1)3.1 (1)3.1 (2)3.1 (2)15/15
1komma2ser brockhoff noiseless 4.4 (2)7.5 (9)7.9 (4)8.0 (8)8.0 (4)8.0 (3)8.0 (8)15/15
1komma4 brockhoff noiseless 2.9 (1)5.1 (2)5.3 (0.1)5.3 (3)5.3 (2)5.3 (2)5.3 (3)15/15
1komma4mir brockhoff noiseless 2.3 (2)3.5 (3)3.5 (0.3)3.6 (4)3.6 (1)3.6 (2)3.6 (2)15/15
1komma4mirser brockhoff noiseless 1.4 (0.6)2.4 (1)2.5 (1)2.6 (1)2.6 (1)2.6 (1)2.6 (2)15/15
1komma4ser brockhoff noiseless 2.5 (1)3.4 (2)3.6 (2)3.6 (2)3.6 (2)3.6 (3)3.6 (2)15/15
1plus1 brockhoff noiseless 2.2 (2)3.5 (3)3.7 (4)3.7 (1)3.7 (1)3.7 (6)3.7 (1)15/15
1plus2mirser brockhoff noiseless 2.2 (3)3.7 (2)3.8 (1)3.8 (2)3.8 (3)3.8 (3)3.8 (2)15/15
ABC elabd noiseless 15 (10)30 (17)33 (17)33 (18)33 (18)33 (19)33 (22)15/15
AVGNEWUOA ros noiseless 1.3 (0.1)1.4 (0.2)1.4 (0.2)1.4 (0.2)1.4 (0.1)1.4 (0.2)1.4 (0.2)15/15
CMAEGS finck noiseless 4.8 (6)7.2 (6)7.6 (4)7.6 (4)7.6 (5)7.6 (5)7.6 (3)15/15
DE-F-AUC fialho noiseless 8.2 (7)15 (9)16 (4)16 (6)16 (9)16 (6)16 (4)15/15
DEuniform fialho noiseless 6.2 (6)17 (6)19 (7)19 (9)19 (7)19 (6)19 (8)15/15
IPOP-ACTCMA-ES ros noiseless 3.1 (2)5.7 (3)6.0 (2)6.0 (3)6.0 (2)6.0 (4)6.0 (2)15/15
IPOP-CMA-ES ros noiseless 3.2 (0.8)5.4 (3)5.4 (3)5.4 (3)5.4 (3)5.4 (3)5.4 (2)15/15
MOS torre noiseless 9.3 (6)22 (5)33 (18)33 (8)33 (18)33 (18)33 (18)15/15
NBC-CMA preuss noiseless 18 (17)48 (4)49 (4)49 (4)49 (4)49 (2)49 (2)15/15
PM-AdapSS-DE fialho noiseless 6.1 (2)17 (10)18 (12)18 (13)18 (12)18 (10)18 (11)15/15
RCGA tran noiseless 140 (118)626 (123)1039 (178)1478 (185)1882 (235)2.8e4 (2e4)2e50/15
SPSA finck noiseless 10 (6)18 (27)19 (12)19 (27)19 (23)19 (22)19 (10)15/15
oPOEMS kubalic noiseless 111 (17)144 (22)163 (20)174 (4)175 (4)176 (3)176 (3)15/15
pPOEMS kubalic noiseless 104 (62)136 (20)161 (28)168 (9)174 (8)175 (3)176 (4)15/15

Δ fopt
f6, 3-D
1e1
34
1e0
56
1e-1
90
1e-2
117
1e-3
149
1e-5
215
1e-7
265
#succ
15/15
1komma2 brockhoff noiseless 4.9 (6)7.6 (11)6.3 (5)6.1 (2)5.8 (4)5.0 (0.9)5.5 (3)15/15
1komma2mir brockhoff noiseless 3.8 (3)4.4 (3)4.1 (1)4.4 (2)4.8 (1)4.1 (1)4.1 (1)15/15
1komma2mirser brockhoff noiseless 2.9 (3)3.5 (2)3.5 (1.0)3.7 (1)3.4 (1)3.4 (0.8)3.4 (0.6)15/15
1komma2ser brockhoff noiseless 8.1 (15)8.4 (5)6.9 (2)8.0 (4)7.5 (4)6.8 (4)7.2 (2)15/15
1komma4 brockhoff noiseless 1.9 (2)2.5 (1)2.3 (0.9)2.4 (1)2.5 (0.4)2.4 (0.6)2.5 (0.4)15/15
1komma4mir brockhoff noiseless 2.3 (2)2.7 (1)2.6 (0.6)2.6 (0.2)2.6 (0.5)2.4 (0.4)2.5 (0.6)15/15
1komma4mirser brockhoff noiseless 1.5 (1)1.8 (1)1.8 (0.7)1.8 (0.5)1.7 (0.5)1.7 (0.4)1.7 (0.1)15/15
1komma4ser brockhoff noiseless 1.7 (1)2.1 (2)1.9 (2)2.0 (1)1.9 (0.8)2.0 (0.7)2.2 (0.7)15/15
1plus1 brockhoff noiseless 1.6 (0.9)2.0 (1)1.9 (0.6)1.9 (0.8)1.8 (0.8)1.8 (0.4)1.9 (0.4)15/15
1plus2mirser brockhoff noiseless 1.8 (1)2.0 (0.9)1.7 (0.4)1.7 (0.5)1.6 (0.5)1.5 (0.3)1.6 (0.3)15/15
ABC elabd noiseless 3.8 (2)13 (7)43 (40)162 (174)445 (1235)591 (1418)523 (1153)11/15
AVGNEWUOA ros noiseless 2.6 (2)2.9 (3)2.9 (2)3.8 (5)3.9 (2)4.3 (4)4.7 (3)15/15
CMAEGS finck noiseless 114 (139)312 (718)208 (25)486 (33)608 (544)602 (710)2352 (3121)4/15
DE-F-AUC fialho noiseless 5.2 (2)8.8 (3)8.9 (2)9.0 (1)8.9 (0.9)8.7 (1)9.5 (0.5)15/15
DEuniform fialho noiseless 4.2 (4)9.2 (3)9.5 (1)10 (0.5)10 (0.5)10 (0.7)10 (0.8)15/15
IPOP-ACTCMA-ES ros noiseless 3.2 (1)3.3 (0.4)3.2 (0.9)3.3 (0.4)3.2 (0.6)3.0 (0.4)3.0 (0.4)15/15
IPOP-CMA-ES ros noiseless 2.8 (2)3.3 (2)3.3 (1)3.2 (0.8)3.2 (0.6)3.0 (0.5)3.1 (0.4)15/15
MOS torre noiseless 5.7 (5)14 (3)13 (4)15 (3)14 (2)13 (2)14 (2)15/15
NBC-CMA preuss noiseless 4.4 (1)14 (7)11 (4)9.3 (18)8.4 (7)7.2 (2)6.9 (2)15/15
PM-AdapSS-DE fialho noiseless 3.6 (3)8.6 (5)8.7 (3)9.1 (1)9.4 (2)9.4 (0.5)10 (1)15/15
RCGA tran noiseless 13 (26)160 (197)303 (194)810 (641)1494 (1307)4752 (7674)2e50/15
SPSA finck noiseless 1.1e4 (1e4)1.2e4 (1e4)1.4e4 (2e4)3e50/15
oPOEMS kubalic noiseless 34 (13)61 (39)83 (18)92 (10)101 (9)96 (7)108 (8)15/15
pPOEMS kubalic noiseless 37 (12)228 (127)456 (241)616 (121)631 (117)716 (51)802 (71)15/15

Δ fopt
f7, 3-D
1e1
11
1e0
65
1e-1
342
1e-2
464
1e-3
482
1e-5
482
1e-7
535
#succ
15/15
1komma2 brockhoff noiseless 16 (33)11 (15)17 (17)83 (85)202 (110)202 (314)257 (294)0/15
1komma2mir brockhoff noiseless 3.5 (3)6.8 (6)8.0 (7)20 (32)27 (46)27 (19)51 (44)4/15
1komma2mirser brockhoff noiseless 4.0 (3)3.4 (2)5.2 (5)25 (42)44 (63)44 (103)59 (35)4/15
1komma2ser brockhoff noiseless 7.2 (13)18 (22)17 (11)107 (93)179 (112)179 (299)389 (529)0/15
1komma4 brockhoff noiseless 4.1 (5)2.1 (3)3.1 (1)3.4 (4)6.7 (8)6.7 (8)16 (25)15/15
1komma4mir brockhoff noiseless 2.3 (2)2.1 (2)1.9 (2)3.3 (5)3.2 (2)3.2 (5)3.9 (6)15/15
1komma4mirser brockhoff noiseless 14 (5)3.8 (2)1.6 (1)2.2 (4)3.9 (5)3.9 (5)6.8 (12)15/15
1komma4ser brockhoff noiseless 3.5 (2)2.6 (1)2.6 (3)3.3 (3)5.6 (4)5.6 (8)10 (10)15/15
1plus1 brockhoff noiseless 2.8 (2)1.9 (2)0.82 (0.6)2.2 (0.5)2.5 (10)2.5 (0.7)2.3 (5)15/15
1plus2mirser brockhoff noiseless 2.3 (1)2.2 (1)1.3 (0.4)1.3 (1)1.5 (1)1.5 (1)1.4 (1)15/15
ABC elabd noiseless 6.3 (4)8.0 (9)10 (4)22 (37)85 (45)85 (49)125 (311)14/15
AVGNEWUOA ros noiseless 1.3 (0.2)6.8 (6)4.8 (4)19 (26)41 (51)41 (35)37 (31)8/15
CMAEGS finck noiseless 255 (744)780 (2318)2492 (1831)9087 (1e4)8748 (9999)8748 (1e4)7881 (6051)1/15
DE-F-AUC fialho noiseless 2.5 (2)3.4 (2)1.1 (0.3)1.2 (0.4)1.4 (0.2)1.4 (0.2)1.5 (0.3)15/15
DEuniform fialho noiseless 5.6 (4)4.2 (2)1.3 (0.4)1.4 (0.1)1.6 (0.3)1.6 (0.3)1.6 (0.3)15/15
IPOP-ACTCMA-ES ros noiseless 3.0 (3)1.7 (2)0.93 (0.4)0.90 (0.4)1.0 (0.4)1.0 (0.8)1.1 (0.8)15/15
IPOP-CMA-ES ros noiseless 3.6 (2)7.2 (1)2.0 (0.8)1.6 (4)1.9 (0.7)1.9 (0.9)1.8 (0.9)15/15
MOS torre noiseless 3.2 (6)4.4 (4)2.3 (0.9)2.2 (0.8)2.3 (0.8)2.3 (0.8)2.4 (0.9)15/15
NBC-CMA preuss noiseless 4.3 (5)4.9 (2)2.5 (2)2.2 (0.2)2.2 (0.2)2.2 (3)2.1 (2)15/15
PM-AdapSS-DE fialho noiseless 4.4 (3)3.5 (1)1.2 (0.2)1.3 (0.4)1.6 (0.2)1.6 (0.3)1.6 (0.3)15/15
RCGA tran noiseless 5.8 (5)42 (133)80 (97)161 (172)212 (61)212 (166)208 (228)8/15
SPSA finck noiseless 2.1e4 (4e4)3.0e4 (3e4)3e50/15
oPOEMS kubalic noiseless 79 (26)28 (7)27 (5)26 (80)28 (39)28 (4)28 (3)15/15
pPOEMS kubalic noiseless 63 (40)30 (20)40 (46)67 (28)91 (29)91 (20)106 (31)15/15

Δ fopt
f8, 3-D
1e1
27
1e0
45
1e-1
152
1e-2
179
1e-3
188
1e-5
198
1e-7
208
#succ
15/15
1komma2 brockhoff noiseless 12 (23)28 (45)16 (6)17 (5)18 (5)18 (11)18 (4)15/15
1komma2mir brockhoff noiseless 10 (26)20 (23)9.3 (12)10 (12)11 (16)11 (4)11 (10)15/15
1komma2mirser brockhoff noiseless 12 (29)28 (47)12 (7)12 (12)13 (4)13 (10)13 (9)15/15
1komma2ser brockhoff noiseless 3.9 (5)50 (61)23 (25)25 (13)28 (26)29 (22)29 (19)15/15
1komma4 brockhoff noiseless 3.8 (2)11 (7)5.3 (3)5.4 (3)5.7 (3)6.0 (2)6.2 (2)15/15
1komma4mir brockhoff noiseless 3.5 (3)13 (9)6.7 (5)6.6 (5)6.8 (4)6.9 (4)7.0 (4)15/15
1komma4mirser brockhoff noiseless 3.5 (1.0)9.5 (13)4.3 (2)4.4 (4)4.6 (4)4.7 (2)4.8 (3)15/15
1komma4ser brockhoff noiseless 2.0 (1)10 (6)5.0 (4)5.4 (6)5.7 (2)5.8 (4)5.8 (3)15/15
1plus1 brockhoff noiseless 2.5 (0.6)6.5 (6)2.9 (3)3.0 (2)3.0 (2)3.2 (2)3.4 (2)15/15
1plus2mirser brockhoff noiseless 2.1 (0.6)4.7 (3)2.3 (2)2.3 (2)2.5 (2)2.7 (2)2.8 (0.7)15/15
ABC elabd noiseless 3.9 (2)17 (19)26 (14)234 (531)3085 (2265)3e50/15
AVGNEWUOA ros noiseless 2.0 (2)2.6 (2)1.0 (0.8)0.98 (0.4)0.98 (0.8)★21.0 (0.8)★31.0 (0.5)★315/15
CMAEGS finck noiseless 25 (52)50 (30)21 (20)22 (10)22 (23)24 (23)25 (16)15/15
DE-F-AUC fialho noiseless 9.2 (4)13 (8)7.2 (2)7.9 (2)8.5 (3)10 (2)11 (2)15/15
DEuniform fialho noiseless 8.4 (3)16 (9)9.4 (2)11 (9)12 (4)14 (5)15 (5)15/15
IPOP-ACTCMA-ES ros noiseless 3.5 (2)7.4 (4)3.8 (2)4.1 (2)4.2 (1)4.5 (2)4.7 (0.8)15/15
IPOP-CMA-ES ros noiseless 5.0 (1)13 (11)5.8 (3)5.7 (2)5.8 (4)6.2 (0.7)6.3 (4)15/15
MOS torre noiseless 11 (4)19 (16)12 (3)13 (3)13 (5)15 (4)16 (4)15/15
NBC-CMA preuss noiseless 8.9 (3)13 (4)6.8 (2)7.3 (1)7.9 (1.0)8.4 (1)8.9 (1)15/15
PM-AdapSS-DE fialho noiseless 8.7 (3)13 (6)7.0 (1)8.7 (0.7)10 (2)56 (1)55 (3)15/15
RCGA tran noiseless 13 (8)61 (29)638 (742)1147 (1046)3458 (3419)2e50/15
SPSA finck noiseless 269 (609)8601 (7696)5810 (7224)2.4e4 (3e4)3e50/15
oPOEMS kubalic noiseless 45 (13)88 (32)55 (17)73 (18)163 (191)299 (195)380 (170)15/15
pPOEMS kubalic noiseless 43 (25)147 (185)221 (110)375 (75)479 (95)793 (95)1068 (95)15/15

Δ fopt
f9, 3-D
1e1
21
1e0
65
1e-1
127
1e-2
149
1e-3
159
1e-5
169
1e-7
178
#succ
15/15
1komma2 brockhoff noiseless 11 (2)14 (10)16 (13)17 (12)18 (11)18 (8)19 (4)15/15
1komma2mir brockhoff noiseless 5.2 (3)10 (18)10 (12)11 (8)11 (9)12 (6)12 (5)15/15
1komma2mirser brockhoff noiseless 16 (2)17 (43)13 (7)13 (9)13 (16)13 (10)14 (11)15/15
1komma2ser brockhoff noiseless 4.8 (2)6.8 (3)16 (10)21 (10)23 (7)24 (9)25 (5)15/15
1komma4 brockhoff noiseless 4.1 (2)7.5 (8)6.4 (5)6.6 (2)6.9 (3)7.2 (3)7.2 (4)15/15
1komma4mir brockhoff noiseless 3.0 (5)3.8 (4)4.1 (3)4.6 (2)5.0 (2)5.4 (1)5.6 (2)15/15
1komma4mirser brockhoff noiseless 2.5 (4)3.1 (1.0)3.5 (0.8)3.9 (1.0)4.1 (0.9)4.3 (1)4.4 (0.9)15/15
1komma4ser brockhoff noiseless 2.7 (2)9.2 (10)7.3 (6)7.3 (6)7.3 (4)7.3 (4)7.3 (3)15/15
1plus1 brockhoff noiseless 2.6 (0.6)3.4 (3)2.9 (3)3.1 (2)3.1 (1)3.4 (1)3.6 (0.6)15/15
1plus2mirser brockhoff noiseless 2.7 (1)4.0 (3)3.3 (3)3.3 (0.3)3.4 (2)3.6 (1)3.7 (1)15/15
ABC elabd noiseless 5.2 (2)7.3 (5)94 (360)473 (489)4869 (1e4)3e50/15
AVGNEWUOA ros noiseless 1.7 (2)1.7 (1)1.2 (0.8)★21.1 (0.7)★21.1 (0.8)★31.2 (0.7)★31.2 (0.8)★415/15
CMAEGS finck noiseless 26 (57)37 (62)29 (20)27 (32)27 (14)28 (22)29 (18)15/15
DE-F-AUC fialho noiseless 7.6 (3)10 (5)9.3 (5)11 (9)20 (2)24 (6)24 (4)15/15
DEuniform fialho noiseless 9.1 (6)9.1 (4)10 (3)12 (3)13 (7)14 (9)15 (9)15/15
IPOP-ACTCMA-ES ros noiseless 3.4 (3)5.9 (1)4.8 (5)4.8 (4)5.1 (4)5.4 (1)5.7 (3)15/15
IPOP-CMA-ES ros noiseless 2.9 (2)4.8 (2)4.4 (3)4.8 (2)5.0 (2)5.5 (2)5.7 (2)15/15
MOS torre noiseless 11 (4)4.9 (0.6)7.0 (3)9.3 (2)10 (1)12 (1)14 (1)15/15
NBC-CMA preuss noiseless 10 (5)9.1 (2)8.7 (1)9.3 (0.4)10 (0.8)10 (1)11 (0.8)15/15
PM-AdapSS-DE fialho noiseless 7.6 (5)8.5 (6)8.4 (5)10 (3)10 (2)12 (2)13 (3)15/15
RCGA tran noiseless 12 (4)183 (260)1570 (1502)7119 (1e4)2e50/15
SPSA finck noiseless 1403 (3330)9834 (5072)3e50/15
oPOEMS kubalic noiseless 54 (14)215 (40)138 (18)176 (252)253 (458)461 (222)605 (702)15/15
pPOEMS kubalic noiseless 58 (14)147 (174)323 (119)466 (95)626 (57)944 (91)1277 (114)15/15

Δ fopt
f10, 3-D
1e1
114
1e0
152
1e-1
168
1e-2
180
1e-3
194
1e-5
218
1e-7
242
#succ
15/15
1komma2 brockhoff noiseless 17 (11)16 (7)16 (4)16 (4)15 (4)14 (2)13 (3)15/15
1komma2mir brockhoff noiseless 16 (3)14 (2)13 (2)13 (3)12 (2)11 (1)11 (1)15/15
1komma2mirser brockhoff noiseless 10 (6)11 (2)10 (1)10 (2)9.2 (0.9)8.8 (2)8.4 (1)15/15
1komma2ser brockhoff noiseless 24 (15)30 (13)29 (12)28 (12)27 (9)25 (9)23 (12)15/15
1komma4 brockhoff noiseless 4.8 (2)5.2 (1)5.3 (1.0)5.3 (1)5.1 (0.8)5.1 (0.5)4.9 (0.7)15/15
1komma4mir brockhoff noiseless 5.3 (3)5.2 (2)5.6 (2)5.6 (0.4)5.6 (0.6)5.4 (0.5)5.1 (0.4)15/15
1komma4mirser brockhoff noiseless 3.8 (2)3.9 (0.5)3.9 (1.0)4.0 (0.9)4.0 (0.4)3.8 (0.2)3.7 (0.2)15/15
1komma4ser brockhoff noiseless 4.4 (3)5.2 (1)5.4 (1)5.2 (1)5.0 (1)4.7 (1.0)4.6 (0.9)15/15
1plus1 brockhoff noiseless 3.2 (1)3.1 (0.5)3.2 (0.4)3.2 (0.2)3.1 (0.6)3.1 (0.4)3.0 (0.4)15/15
1plus2mirser brockhoff noiseless 3.0 (1)2.7 (0.9)2.8 (0.6)2.9 (0.4)2.8 (0.3)2.8 (0.2)2.8 (0.3)15/15
ABC elabd noiseless 1201 (1188)2.8e4 (3e4)2.6e4 (4e4)3e50/15
AVGNEWUOA ros noiseless 1.9 (3)3.4 (2)5.8 (3)6.9 (3)7.9 (3)10 (4)11 (6)15/15
CMAEGS finck noiseless 41 (7)33 (5)31 (5)150 (5)140 (392)126 (4)115 (622)14/15
DE-F-AUC fialho noiseless 4.7 (1)4.5 (0.8)5.1 (0.5)5.8 (0.5)6.2 (0.7)7.1 (0.7)7.7 (0.7)15/15
DEuniform fialho noiseless 5.0 (0.7)4.7 (0.7)5.3 (0.5)6.1 (0.6)6.7 (0.6)7.5 (0.8)8.4 (0.7)15/15
IPOP-ACTCMA-ES ros noiseless 3.1 (2)3.4 (1)3.5 (0.8)3.6 (0.6)3.5 (0.6)3.5 (0.5)3.5 (0.7)15/15
IPOP-CMA-ES ros noiseless 3.9 (2)4.3 (2)4.4 (0.8)4.5 (0.6)4.4 (0.6)4.4 (0.6)4.3 (0.5)15/15
MOS torre noiseless 11 (4)13 (3)15 (5)15 (12)16 (13)17 (2)17 (0.8)15/15
NBC-CMA preuss noiseless 7.7 (2)9.1 (2)10 (2)12 (3)13 (3)12 (3)12 (3)15/15
PM-AdapSS-DE fialho noiseless 4.8 (0.7)4.6 (0.8)5.4 (0.3)5.9 (0.7)6.6 (0.9)7.4 (0.5)8.2 (0.3)15/15
RCGA tran noiseless 566 (705)2414 (2911)1.3e4 (9152)2e50/15
SPSA finck noiseless 1.7e4 (3e4)3e50/15
oPOEMS kubalic noiseless 826 (1763)1939 (1659)4072 (6516)6384 (5390)1.0e4 (9374)3.0e4 (3e4)5.5e4 (4e4)1/15
pPOEMS kubalic noiseless 364 (273)472 (198)713 (90)830 (93)922 (117)1185 (114)1303 (180)15/15

Δ fopt
f11, 3-D
1e1
67
1e0
105
1e-1
227
1e-2
263
1e-3
277
1e-5
302
1e-7
327
#succ
15/15
1komma2 brockhoff noiseless 36 (12)28 (8)14 (4)12 (2)12 (3)12 (3)11 (2)15/15
1komma2mir brockhoff noiseless 29 (14)23 (3)12 (2)10 (1)10 (1)10 (0.7)9.4 (2)15/15
1komma2mirser brockhoff noiseless 20 (8)19 (4)9.5 (2)8.5 (3)8.3 (2)8.2 (2)8.0 (2)15/15
1komma2ser brockhoff noiseless 36 (33)36 (25)19 (11)17 (10)17 (10)16 (8)15 (8)15/15
1komma4 brockhoff noiseless 10 (6)8.9 (3)4.7 (1)4.3 (0.7)4.3 (0.4)4.2 (0.4)4.2 (0.3)15/15
1komma4mir brockhoff noiseless 12 (4)9.4 (2)4.7 (0.7)4.3 (0.3)4.3 (0.3)4.3 (0.4)4.2 (0.4)15/15
1komma4mirser brockhoff noiseless 7.0 (5)7.0 (1)3.6 (0.5)3.2 (0.1)3.2 (0.2)3.1 (0.3)3.0 (0.1)15/15
1komma4ser brockhoff noiseless 9.3 (3)7.5 (3)4.0 (0.7)3.7 (0.6)3.6 (0.4)3.6 (0.8)3.5 (0.7)15/15
1plus1 brockhoff noiseless 5.9 (3)5.3 (1)2.8 (0.2)2.5 (0.3)2.5 (0.2)2.5 (0.2)2.5 (0.1)15/15
1plus2mirser brockhoff noiseless 5.3 (2)4.5 (1)2.5 (0.6)2.3 (0.3)2.2 (0.3)2.2 (0.2)2.3 (0.2)15/15
ABC elabd noiseless 28 (42)263 (351)2433 (2276)3e50/15
AVGNEWUOA ros noiseless 2.0 (2)3.3 (1.0)2.5 (1)2.7 (0.6)3.3 (1)4.3 (1)5.0 (2)15/15
CMAEGS finck noiseless 78 (30)59 (18)29 (2)25 (3)24 (3)23 (3)23 (3)15/15
DE-F-AUC fialho noiseless 5.7 (2)5.5 (1)3.0 (0.5)3.4 (0.4)3.7 (0.4)4.6 (0.5)5.3 (0.7)15/15
DEuniform fialho noiseless 5.9 (2)5.6 (0.7)3.3 (0.4)3.5 (0.4)3.9 (0.5)4.9 (0.5)5.7 (0.2)15/15
IPOP-ACTCMA-ES ros noiseless 5.3 (3)4.5 (1)2.4 (0.5)2.3 (0.2)2.3 (0.4)2.5 (0.2)2.5 (0.2)15/15
IPOP-CMA-ES ros noiseless 9.2 (4)7.5 (2)4.0 (0.4)3.7 (0.1)3.7 (0.3)3.7 (0.4)3.7 (0.3)15/15
MOS torre noiseless 17 (7)17 (3)8.8 (1.0)8.5 (0.2)8.8 (0.9)9.0 (1)9.4 (0.5)15/15
NBC-CMA preuss noiseless 11 (9)16 (9)9.1 (3)8.8 (1)9.2 (4)9.0 (1)9.1 (4)15/15
PM-AdapSS-DE fialho noiseless 6.2 (2)5.6 (0.8)3.4 (0.4)3.6 (0.3)4.1 (0.5)4.9 (0.6)5.6 (0.3)15/15
RCGA tran noiseless 343 (471)1207 (1787)2949 (3571)8132 (2e4)2e50/15
SPSA finck noiseless 3551 (2906)1.9e4 (3e4)3e50/15
oPOEMS kubalic noiseless 138 (342)717 (516)641 (555)891 (481)1260 (897)1683 (994)2375 (484)10/15
pPOEMS kubalic noiseless 86 (155)384 (246)312 (93)447 (152)534 (124)787 (95)944 (82)15/15

Δ fopt
f12, 3-D
1e1
65
1e0
168
1e-1
338
1e-2
401
1e-3
445
1e-5
696
1e-7
790
#succ
15/15
1komma2 brockhoff noiseless 54 (92)39 (40)27 (28)28 (36)27 (19)22 (14)21 (27)12/15
1komma2mir brockhoff noiseless 25 (20)16 (14)11 (7)10 (5)10 (8)8.1 (7)8.1 (6)15/15
1komma2mirser brockhoff noiseless 25 (35)17 (14)11 (5)10 (8)9.4 (10)6.9 (3)6.7 (6)15/15
1komma2ser brockhoff noiseless 96 (146)90 (163)60 (39)55 (108)52 (47)46 (52)67 (95)6/15
1komma4 brockhoff noiseless 19 (12)13 (10)8.0 (4)7.4 (6)7.1 (9)5.2 (9)5.2 (6)15/15
1komma4mir brockhoff noiseless 17 (25)12 (6)7.9 (6)7.3 (9)7.1 (6)5.3 (6)5.1 (3)15/15
1komma4mirser brockhoff noiseless 13 (11)10 (8)6.8 (6)6.4 (6)6.2 (6)4.7 (4)4.6 (4)15/15
1komma4ser brockhoff noiseless 6.8 (7)7.2 (6)5.6 (3)5.6 (4)5.5 (3)4.2 (3)4.2 (3)15/15
1plus1 brockhoff noiseless 10 (7)6.2 (4)4.1 (5)3.9 (2)3.8 (4)2.9 (3)3.0 (2)15/15
1plus2mirser brockhoff noiseless 10 (7)7.9 (5)5.1 (4)5.0 (4)4.7 (4)3.5 (2)3.5 (3)15/15
ABC elabd noiseless 53 (55)283 (430)1650 (1553)1.1e4 (9540)3e50/15
AVGNEWUOA ros noiseless 4.4 (6)3.2 (4)2.2 (2)2.2 (2)2.2 (2)1.8 (1)1.9 (2)15/15
CMAEGS finck noiseless 1353 (4699)1386 (2433)1872 (2355)2083 (2435)2724 (3555)2827 (3893)2492 (5046)2/15
DE-F-AUC fialho noiseless 14 (2)43 (4)146 (666)132 (188)173 (338)114 (324)145 (191)11/15
DEuniform fialho noiseless 14 (3)8.1 (4)227 (444)277 (377)251 (338)221 (432)196 (285)10/15
IPOP-ACTCMA-ES ros noiseless 10 (6)7.8 (13)6.2 (8)6.0 (5)5.9 (3)4.6 (5)4.6 (2)15/15
IPOP-CMA-ES ros noiseless 8.9 (3)6.6 (9)4.5 (5)4.6 (4)4.6 (4)3.7 (3)4.1 (3)15/15
MOS torre noiseless 24 (15)19 (11)13 (8)12 (9)12 (7)9.2 (4)9.1 (5)15/15
NBC-CMA preuss noiseless 24 (30)15 (10)10 (5)11 (5)11 (4)8.5 (3)8.7 (3)15/15
PM-AdapSS-DE fialho noiseless 343 (3)284 (448)229 (666)504 (749)456 (337)324 (255)286 (192)9/15
RCGA tran noiseless 590 (1176)575 (1079)414 (676)1103 (827)1141 (800)2e50/15
SPSA finck noiseless 7161 (8077)1.2e4 (6697)1.2e4 (2e4)3e50/15
oPOEMS kubalic noiseless 2183 (1149)3744 (8144)4463 (4659)5465 (6667)9e50/15
pPOEMS kubalic noiseless 849 (739)603 (153)442 (106)538 (124)617 (111)582 (193)651 (316)13/15

Δ fopt
f13, 3-D
1e1
49
1e0
85
1e-1
108
1e-2
136
1e-3
215
1e-5
281
1e-7
365
#succ
15/15
1komma2 brockhoff noiseless 21 (27)29 (15)27 (16)29 (17)26 (20)24 (20)41 (28)11/15
1komma2mir brockhoff noiseless 17 (18)26 (11)33 (24)32 (17)25 (21)36 (19)56 (63)7/15
1komma2mirser brockhoff noiseless 15 (19)19 (14)21 (11)22 (12)20 (15)28 (38)72 (83)7/15
1komma2ser brockhoff noiseless 17 (2)45 (28)47 (37)47 (23)37 (30)67 (68)91 (189)6/15
1komma4 brockhoff noiseless 6.6 (5)8.1 (5)8.7 (2)7.9 (4)6.1 (2)6.9 (3)8.1 (2)15/15
1komma4mir brockhoff noiseless 5.2 (6)8.6 (5)8.3 (5)7.8 (4)5.9 (3)7.1 (2)7.6 (4)15/15
1komma4mirser brockhoff noiseless 3.4 (2)5.1 (3)5.9 (2)6.1 (2)4.6 (2)6.3 (6)6.9 (5)15/15
1komma4ser brockhoff noiseless 7.3 (8)7.7 (6)7.7 (3)7.2 (0.8)5.6 (2)6.0 (0.5)5.5 (2)15/15
1plus1 brockhoff noiseless 4.1 (4)7.7 (8)6.9 (3)6.6 (6)5.3 (4)5.0 (1)6.0 (5)15/15
1plus2mirser brockhoff noiseless 5.2 (6)5.1 (4)5.1 (3)4.8 (2)3.4 (1)3.6 (0.9)4.5 (5)15/15
ABC elabd noiseless 12 (12)160 (155)3819 (3143)3.1e4 (3e4)3e50/15
AVGNEWUOA ros noiseless 5.7 (10)14 (16)42 (56)114 (145)159 (188)257 (351)2e40/15
CMAEGS finck noiseless 1639 (1825)2638 (3883)1.8e4 (2e4)3e50/15
DE-F-AUC fialho noiseless 7.4 (2)7.7 (2)8.7 (0.6)8.8 (0.7)7.0 (0.8)7.4 (0.4)7.2 (0.8)15/15
DEuniform fialho noiseless 8.9 (2)8.9 (0.9)10 (0.6)10 (0.7)7.6 (0.7)7.9 (0.5)7.7 (0.5)15/15
IPOP-ACTCMA-ES ros noiseless 3.4 (3)3.6 (1)3.9 (1)4.3 (2)3.3 (1.0)3.4 (0.7)3.4 (0.6)15/15
IPOP-CMA-ES ros noiseless 3.4 (2)5.0 (4)5.9 (2)5.7 (1)4.6 (1)4.6 (0.8)4.5 (0.8)15/15
MOS torre noiseless 14 (5)15 (2)15 (2)15 (3)11 (0.6)11 (1)10 (0.4)15/15
NBC-CMA preuss noiseless 10 (3)9.1 (2)12 (5)12 (5)8.8 (3)8.8 (0.8)8.6 (0.5)15/15
PM-AdapSS-DE fialho noiseless 7.9 (2)8.1 (2)10 (0.7)10 (1)7.5 (0.4)7.8 (0.5)7.7 (0.3)15/15
RCGA tran noiseless 115 (135)440 (634)1258 (1876)3763 (3680)5111 (4586)3921 (3470)2e50/15
SPSA finck noiseless 111 (81)2720 (2426)4.2e4 (6e4)3e50/15
oPOEMS kubalic noiseless 68 (31)1186 (472)3471 (4699)4086 (6623)1.2e4 (2e4)9e50/15
pPOEMS kubalic noiseless 102 (62)595 (226)926 (76)1236 (136)1021 (167)1392 (483)1651 (442)9/15

Δ fopt
f14, 3-D
1e1
2.0
1e0
17
1e-1
28
1e-2
43
1e-3
71
1e-5
110
1e-7
194
#succ
15/15
1komma2 brockhoff noiseless 15 (13)6.4 (7)6.6 (3)7.3 (2)12 (9)21 (7)18 (5)15/15
1komma2mir brockhoff noiseless 1.8 (1)4.2 (2)4.5 (2)4.9 (2)6.8 (4)15 (6)16 (1)15/15
1komma2mirser brockhoff noiseless 2.6 (3)2.5 (2)3.1 (2)3.9 (2)5.1 (3)13 (5)12 (2)15/15
1komma2ser brockhoff noiseless 3.9 (8)3.3 (2)5.2 (1.0)8.6 (1)13 (9)31 (31)27 (19)15/15
1komma4 brockhoff noiseless 5.2 (5)2.9 (2)3.3 (1)3.9 (2)4.2 (1)7.7 (1)6.7 (0.9)15/15
1komma4mir brockhoff noiseless 3.2 (5)2.1 (1)2.7 (0.6)3.0 (1)3.6 (2)7.2 (2)7.0 (0.9)15/15
1komma4mirser brockhoff noiseless 2.0 (1)1.6 (1)2.3 (0.8)2.6 (0.4)3.0 (1)5.2 (2)4.8 (0.6)15/15
1komma4ser brockhoff noiseless 4.6 (2)1.8 (1)2.7 (0.7)3.5 (1)4.4 (2)6.6 (2)5.8 (1)15/15
1plus1 brockhoff noiseless 3.8 (4)2.2 (1)3.0 (0.8)2.9 (0.5)3.4 (1)4.4 (0.9)3.9 (0.5)15/15
1plus2mirser brockhoff noiseless 2.0 (2)2.1 (1)2.6 (1)2.5 (0.7)2.7 (0.6)3.8 (1)3.3 (0.6)15/15
ABC elabd noiseless 1.6 (1)9.1 (3)14 (5)26 (11)317 (279)1.3e4 (1e4)3e50/15
AVGNEWUOA ros noiseless 5.2 (7)1.2 (0.3)1.2 (0.2)★21.1 (0.3)★41.2 (0.2)★32.7 (1)6.9 (2)6/15
CMAEGS finck noiseless 49 (12)14 (14)12 (6)15 (9)25 (16)36 (17)422 (1161)12/15
DE-F-AUC fialho noiseless 2.3 (2)3.8 (2)11 (4)12 (1)10 (0.6)10 (1)8.3 (0.8)15/15
DEuniform fialho noiseless 1.8 (2)4.5 (3)12 (5)14 (2)11 (1)12 (0.5)8.8 (0.6)15/15
IPOP-ACTCMA-ES ros noiseless 2.5 (3)2.8 (2)3.8 (1)4.2 (0.6)3.7 (1)5.0 (1)4.2 (0.4)15/15
IPOP-CMA-ES ros noiseless 3.1 (5)3.8 (4)4.1 (2)4.7 (2)4.8 (1)6.8 (2)5.8 (0.7)15/15
MOS torre noiseless 1.3 (0.8)4.1 (5)15 (6)17 (4)15 (3)18 (1)14 (2)15/15
NBC-CMA preuss noiseless 2.5 (4)5.9 (4)12 (2)12 (1)9.5 (1)11 (1)8.7 (0.3)15/15
PM-AdapSS-DE fialho noiseless 2.1 (1)5.5 (5)12 (3)13 (2)11 (1)11 (1)8.7 (0.5)15/15
RCGA tran noiseless 2.1 (3)10 (8)37 (38)71 (90)211 (149)1887 (2426)2e50/15
SPSA finck noiseless 587 (2920)300 (48)208 (635)166 (475)430 (199)2272 (3055)3e50/15
oPOEMS kubalic noiseless 296 (137)55 (15)64 (50)114 (34)139 (30)313 (45)1.5e4 (9485)2/15
pPOEMS kubalic noiseless 45 (88)44 (22)92 (65)470 (573)738 (282)1224 (107)1508 (1029)10/15

Δ fopt
f15, 3-D
1e1
121
1e0
1372
1e-1
6285
1e-2
8282
1e-3
8429
1e-5
8787
1e-7
9041
#succ
15/15
1komma2 brockhoff noiseless 7.6 (10)31 (59)67 (51)51 (66)50 (64)48 (44)47 (57)1/15
1komma2mir brockhoff noiseless 2.7 (7)8.2 (11)12 (6)9.0 (8)8.8 (5)8.5 (8)8.3 (5)5/15
1komma2mirser brockhoff noiseless 3.7 (4)10 (7)11 (17)8.4 (29)8.3 (14)7.9 (15)7.7 (7)5/15
1komma2ser brockhoff noiseless 9.0 (11)39 (43)33 (31)25 (12)25 (19)24 (41)23 (19)2/15
1komma4 brockhoff noiseless 3.9 (3)5.7 (4)7.0 (10)5.3 (6)5.2 (10)5.0 (5)4.9 (6)7/15
1komma4mir brockhoff noiseless 1.2 (0.3)2.9 (3)8.3 (15)6.3 (5)6.2 (4)6.0 (18)5.8 (10)6/15
1komma4mirser brockhoff noiseless 2.2 (4)2.0 (4)2.6 (3)2.0 (3)1.9 (2)1.9 (2)1.8 (4)12/15
1komma4ser brockhoff noiseless 4.2 (3)3.9 (3)22 (17)17 (24)17 (8)16 (25)16 (17)3/15
1plus1 brockhoff noiseless 2.5 (0.3)3.8 (3)11 (18)8.3 (9)8.2 (11)7.9 (4)7.7 (12)5/15
1plus2mirser brockhoff noiseless 2.1 (5)7.0 (9)7.2 (10)5.5 (8)5.4 (8)5.1 (6)5.0 (3)7/15
ABC elabd noiseless 3.6 (1)34 (84)42 (49)88 (111)250 (270)3e50/15
AVGNEWUOA ros noiseless 3.2 (4)3.7 (5)3.1 (5)2.3 (4)2.3 (3)2.2 (3)2.1 (2)8/15
CMAEGS finck noiseless 12 (21)36 (32)325 (322)519 (744)3e50/15
DE-F-AUC fialho noiseless 1.8 (1)1.4 (0.5)0.41 (0.1)0.37 (0.1)0.38 (0.1)0.40 (0.1)0.43 (0.1)15/15
DEuniform fialho noiseless 2.3 (0.8)1.6 (0.6)3.9 (12)3.0 (9)3.0 (0.1)2.9 (0.1)2.9 (8)14/15
IPOP-ACTCMA-ES ros noiseless 0.99 (0.8)1.6 (2)1.0 (0.6)0.85 (0.9)0.85 (0.4)0.85 (1.0)0.85 (0.5)15/15
IPOP-CMA-ES ros noiseless 2.4 (5)1.4 (2)1.2 (0.8)0.93 (0.7)0.93 (0.6)0.92 (0.8)0.93 (0.5)15/15
MOS torre noiseless 4.9 (2)3.8 (4)1.5 (1)1.6 (1)1.6 (2)1.6 (1)1.6 (0.7)15/15
NBC-CMA preuss noiseless 3.2 (1)3.1 (1)3.1 (3)2.4 (3)2.3 (2)2.3 (3)2.2 (2)15/15
PM-AdapSS-DE fialho noiseless 2.3 (2)1.5 (1)3.9 (0.1)3.0 (9)3.0 (9)2.9 (0.2)2.9 (8)14/15
RCGA tran noiseless 5.3 (3)24 (20)9.3 (14)7.5 (10)9.4 (10)17 (14)39 (91)2/15
SPSA finck noiseless 474 (140)3249 (5850)3e50/15
oPOEMS kubalic noiseless 15 (6)26 (13)85 (124)65 (41)65 (49)63 (48)62 (77)11/15
pPOEMS kubalic noiseless 17 (11)46 (14)23 (73)21 (30)23 (2)28 (53)32 (26)14/15

Δ fopt
f16, 3-D
1e1
41
1e0
319
1e-1
582
1e-2
789
1e-3
1864
1e-5
3204
1e-7
3361
#succ
15/15
1komma2 brockhoff noiseless 19 (15)37 (38)96 (70)160 (266)68 (57)3e40/15
1komma2mir brockhoff noiseless 2.4 (1)12 (11)21 (9)40 (35)26 (45)23 (16)42 (42)3/15
1komma2mirser brockhoff noiseless 2.5 (2)11 (21)19 (20)25 (40)17 (34)16 (9)64 (45)2/15
1komma2ser brockhoff noiseless 27 (14)33 (36)97 (67)129 (86)115 (78)3e40/15
1komma4 brockhoff noiseless 3.3 (1)13 (27)15 (10)19 (11)10 (11)8.7 (5)61 (85)2/15
1komma4mir brockhoff noiseless 5.3 (16)5.3 (3)8.1 (13)8.6 (8)5.6 (7)5.0 (8)5.0 (6)12/15
1komma4mirser brockhoff noiseless 1.8 (2)4.5 (7)5.3 (5)6.4 (12)7.3 (7)6.9 (8)6.9 (15)9/15
1komma4ser brockhoff noiseless 6.1 (2)8.1 (5)12 (9)18 (23)14 (17)16 (15)22 (24)5/15
1plus1 brockhoff noiseless 3.1 (9)3.7 (3)10 (12)20 (16)28 (39)27 (17)66 (67)1/15
1plus2mirser brockhoff noiseless 1.9 (4)3.4 (1)4.7 (4)13 (35)12 (9)41 (61)60 (76)2/15
ABC elabd noiseless 1.2 (0.9)3.1 (3)19 (23)142 (191)2272 (966)3e50/15
AVGNEWUOA ros noiseless 3.6 (3)6.1 (5)23 (22)59 (161)73 (77)2e40/15
CMAEGS finck noiseless 13 (37)90 (136)445 (677)5696 (6472)3e50/15
DE-F-AUC fialho noiseless 2.5 (2)4.4 (1)6.7 (4)5.8 (2)2.7 (1.0)8.5 (47)8.2 (0.6)14/15
DEuniform fialho noiseless 2.1 (3)4.5 (2)7.3 (3)7.5 (2)3.4 (0.9)2.2 (0.6)2.2 (0.4)15/15
IPOP-ACTCMA-ES ros noiseless 1.5 (2)3.2 (3)2.7 (3)3.1 (2)1.5 (1)0.93 (0.5)0.93 (0.6)15/15
IPOP-CMA-ES ros noiseless 2.2 (2)3.2 (8)3.8 (4)3.3 (2)1.4 (1.0)0.88 (0.6)1.1 (0.7)15/15
MOS torre noiseless 1.5 (2)5.3 (1.0)4.4 (10)3.8 (7)1.9 (2)1.3 (0.5)1.4 (2)15/15
NBC-CMA preuss noiseless 1.5 (0.9)7.5 (10)7.1 (10)8.6 (18)3.8 (5)2.4 (2)2.4 (4)15/15
PM-AdapSS-DE fialho noiseless 1.6 (2)6.4 (4)11 (7)11 (12)17 (5)10 (27)10 (3)14/15
RCGA tran noiseless 1.5 (1)17 (31)45 (62)117 (249)125 (127)117 (97)198 (263)1/15
SPSA finck noiseless 105 (90)312 (754)1570 (1333)3e50/15
oPOEMS kubalic noiseless 18 (4)28 (9)523 (775)521 (571)224 (362)133 (272)128 (326)11/15
pPOEMS kubalic noiseless 18 (7)15 (18)85 (41)112 (29)105 (247)103 (7)119 (139)13/15

Δ fopt
f17, 3-D
1e1
4.0
1e0
78
1e-1
282
1e-2
491
1e-3
1134
1e-5
2347
1e-7
3469
#succ
15/15
1komma2 brockhoff noiseless 5.8 (13)11 (17)24 (26)138 (209)3e40/15
1komma2mir brockhoff noiseless 3.6 (5)5.1 (5)3.9 (1)4.3 (5)11 (18)187 (211)3e40/15
1komma2mirser brockhoff noiseless 3.4 (2)1.3 (0.7)5.1 (10)7.5 (9)22 (28)184 (236)124 (84)1/15
1komma2ser brockhoff noiseless 102 (368)30 (37)50 (68)859 (871)3e40/15
1komma4 brockhoff noiseless 17 (2)7.5 (7)8.4 (10)16 (20)19 (6)91 (155)3e40/15
1komma4mir brockhoff noiseless 3.7 (4)4.6 (6)3.3 (10)5.9 (4)4.2 (4)61 (47)129 (169)1/15
1komma4mirser brockhoff noiseless 12 (40)3.6 (4)3.8 (5)3.8 (5)6.5 (13)87 (83)3e40/15
1komma4ser brockhoff noiseless 3.5 (1)5.0 (1.0)6.9 (13)12 (17)18 (21)3e40/15
1plus1 brockhoff noiseless 10 (60)5.2 (4)15 (21)36 (19)88 (64)3e40/15
1plus2mirser brockhoff noiseless 9.1 (30)6.3 (6)6.3 (10)13 (14)17 (18)92 (157)125 (89)1/15
ABC elabd noiseless 2.9 (2)6.7 (5)11 (7)42 (58)469 (385)1804 (2749)3e50/15
AVGNEWUOA ros noiseless 3.0 (1)8.0 (9)13 (7)153 (317)2e40/15
CMAEGS finck noiseless 15 (5)17 (28)12 (14)243 (311)739 (1003)1793 (1664)3e50/15
DE-F-AUC fialho noiseless 3.9 (3)3.3 (1)2.7 (0.9)2.6 (0.5)1.6 (0.2)1.3 (0.1)1.2 (0.1)15/15
DEuniform fialho noiseless 2.0 (2)3.6 (1)2.8 (0.8)2.7 (0.5)1.7 (0.1)1.4 (0.1)1.3 (0.1)15/15
IPOP-ACTCMA-ES ros noiseless 4.1 (4)6.6 (7)2.8 (2)2.1 (2)1.6 (0.8)1.2 (0.5)0.95 (0.5)15/15
IPOP-CMA-ES ros noiseless 18 (3)2.2 (3)1.1 (1)1.8 (1)1.2 (0.9)1.1 (0.4)1.0 (0.3)15/15
MOS torre noiseless 2.2 (2)5.9 (6)6.8 (5)6.2 (5)5.2 (5)3.7 (3)3.4 (4)15/15
NBC-CMA preuss noiseless 2.4 (2)4.1 (2)2.1 (0.4)1.7 (0.2)0.93 (0.1)1.4 (2)1.2 (1)15/15
PM-AdapSS-DE fialho noiseless 1.7 (1)3.7 (1)2.5 (0.8)2.7 (0.4)1.7 (0.3)1.3 (0.2)1.2 (0.1)15/15
RCGA tran noiseless 2.8 (4)25 (10)72 (65)81 (45)51 (20)155 (341)2e50/15
SPSA finck noiseless 2.9e4 (4e4)4545 (6742)1301 (865)2511 (3635)3e50/15
oPOEMS kubalic noiseless 166 (131)22 (7)26 (7)28 (5)18 (2)15 (1)30 (10)15/15
pPOEMS kubalic noiseless 15 (14)19 (6)129 (42)185 (26)125 (12)107 (8)105 (11)15/15

Δ fopt
f18, 3-D
1e1
40
1e0
145
1e-1
1289
1e-2
3084
1e-3
3523
1e-5
4738
1e-7
5527
#succ
15/15
1komma2 brockhoff noiseless 9.1 (26)28 (31)23 (43)137 (151)3e40/15
1komma2mir brockhoff noiseless 1.3 (1)10 (10)14 (12)26 (19)3e40/15
1komma2mirser brockhoff noiseless 1.4 (1.0)4.2 (4)6.1 (9)20 (15)3e40/15
1komma2ser brockhoff noiseless 15 (34)46 (44)103 (169)3e40/15
1komma4 brockhoff noiseless 5.4 (20)7.2 (10)5.5 (6)16 (12)120 (170)3e40/15
1komma4mir brockhoff noiseless 4.6 (12)5.0 (3)3.1 (3)6.2 (3)18 (13)3e40/15
1komma4mirser brockhoff noiseless 4.0 (4)4.7 (4)5.8 (6)8.7 (7)17 (26)3e40/15
1komma4ser brockhoff noiseless 5.3 (0.4)12 (26)8.8 (11)19 (19)125 (60)3e40/15
1plus1 brockhoff noiseless 6.0 (6)21 (21)11 (10)35 (25)3e40/15
1plus2mirser brockhoff noiseless 5.8 (11)11 (21)9.5 (21)26 (26)128 (145)3e40/15
ABC elabd noiseless 3.4 (2)15 (11)70 (108)315 (336)3e50/15
AVGNEWUOA ros noiseless 11 (4)30 (12)15 (14)89 (78)2e40/15
CMAEGS finck noiseless 13 (36)62 (167)284 (590)3e50/15
DE-F-AUC fialho noiseless 2.9 (2)3.7 (1)0.86 (0.2)0.57 (0.1)0.67 (0.1)0.78 (0.1)0.86 (0.0)15/15
DEuniform fialho noiseless 3.5 (1)3.6 (1)0.86 (0.2)0.57 (0.1)0.68 (0.1)0.78 (0.1)0.86 (0.1)15/15
IPOP-ACTCMA-ES ros noiseless 1.3 (1)1.3 (0.6)0.61 (0.7)0.91 (1.0)0.90 (0.8)0.92 (0.7)0.94 (0.7)15/15
IPOP-CMA-ES ros noiseless 1.4 (1)1.8 (4)1.2 (2)1.0 (1)1.2 (1)1.4 (0.7)1.3 (0.7)15/15
MOS torre noiseless 3.0 (4)7.8 (3)2.1 (1)1.7 (3)2.0 (1)1.8 (1.0)2.0 (2)15/15
NBC-CMA preuss noiseless 2.4 (2)4.8 (2)19 (58)8.1 (49)7.1 (1)5.8 (1)5.4 (15)14/15
PM-AdapSS-DE fialho noiseless 2.2 (2)3.6 (1)0.86 (0.1)0.55 (0.1)0.66 (0.1)0.77 (0.1)0.85 (0.1)15/15
RCGA tran noiseless 24 (160)86 (104)61 (53)327 (499)2e50/15
SPSA finck noiseless 3812 (7503)3143 (3115)1547 (1629)3e50/15
oPOEMS kubalic noiseless 23 (8)27 (10)8.9 (4)50 (0.4)110 (20)158 (257)226 (579)7/15
pPOEMS kubalic noiseless 28 (14)82 (62)55 (9)42 (4)53 (4)68 (4)83 (9)15/15

Δ fopt
f19, 3-D
1e1
1
1e0
1
1e-1
109
1e-2
6764
1e-3
7367
1e-5
7399
1e-7
7441
#succ
15/15
1komma2 brockhoff noiseless 4.8 (6)469 (460)178 (188)30 (51)3e40/15
1komma2mir brockhoff noiseless 6.7 (4)239 (269)132 (137)20 (16)3e40/15
1komma2mirser brockhoff noiseless 8.5 (13)556 (1438)87 (112)21 (19)29 (34)29 (34)29 (42)2/15
1komma2ser brockhoff noiseless 31 (98)550 (575)174 (147)31 (33)58 (72)58 (82)58 (128)1/15
1komma4 brockhoff noiseless 5.5 (4)329 (269)99 (162)6.7 (10)12 (10)12 (13)12 (30)4/15
1komma4mir brockhoff noiseless 10 (10)420 (656)60 (46)10 (6)13 (9)13 (14)12 (16)4/15
1komma4mirser brockhoff noiseless 10 (8)171 (143)89 (199)6.7 (4)28 (19)27 (38)27 (24)2/15
1komma4ser brockhoff noiseless 11 (8)251 (523)123 (161)65 (120)3e40/15
1plus1 brockhoff noiseless 7.4 (6)415 (772)187 (567)20 (50)18 (15)18 (23)18 (12)3/15
1plus2mirser brockhoff noiseless 12 (9)364 (840)122 (106)14 (24)28 (26)28 (26)28 (36)2/15
ABC elabd noiseless 12 (14)391 (252)52 (28)8.0 (2)24 (15)295 (365)3e50/15
AVGNEWUOA ros noiseless 13 (12)319 (189)122 (48)39 (81)76 (69)76 (76)76 (95)2/15
CMAEGS finck noiseless 47 (34)346 (396)150 (435)49 (40)98 (91)265 (315)566 (888)1/15
DE-F-AUC fialho noiseless 12 (15)218 (142)27 (13)5.0 (12)12 (31)12 (51)12 (31)12/15
DEuniform fialho noiseless 7.3 (11)335 (254)32 (27)5.5 (34)13 (31)13 (0.4)13 (20)12/15
IPOP-ACTCMA-ES ros noiseless 6.0 (8)234 (498)41 (37)4.0 (6)4.6 (5)4.7 (6)4.7 (1)15/15
IPOP-CMA-ES ros noiseless 11 (6)196 (266)67 (126)4.4 (2)4.1 (2)4.1 (4)4.1 (4)15/15
MOS torre noiseless 11 (3)213 (101)5.8 (4)3.7 (11)3.6 (0.7)3.7 (20)3.8 (0.7)14/15
NBC-CMA preuss noiseless 8.9 (13)235 (132)30 (30)3.2 (3)4.3 (3)4.3 (3)4.3 (3)15/15
PM-AdapSS-DE fialho noiseless 7.9 (6)237 (147)25 (24)2.3 (2)12 (41)12 (20)14 (30)12/15
RCGA tran noiseless 10 (12)273 (253)16 (16)8.7 (11)24 (31)141 (117)289 (267)1/15
SPSA finck noiseless 258 (314)1.0e4 (1e4)2985 (3592)637 (776)3e50/15
oPOEMS kubalic noiseless 611 (36)1680 (878)252 (60)81 (75)168 (309)169 (141)169 (173)7/15
pPOEMS kubalic noiseless 260 (330)1717 (396)260 (189)10 (2)11 (4)15 (3)21 (3)15/15

Δ fopt
f20, 3-D
1e1
8.0
1e0
385
1e-1
2291
1e-2
2398
1e-3
2481
1e-5
2573
1e-7
2776
#succ
15/15
1komma2 brockhoff noiseless 5.1 (5)4.1 (4)16 (35)15 (31)17 (22)16 (8)15 (13)7/15
1komma2mir brockhoff noiseless 3.3 (3)8.1 (9)41 (59)39 (34)38 (27)36 (60)34 (59)4/15
1komma2mirser brockhoff noiseless 4.0 (2)7.9 (5)91 (49)87 (128)84 (142)81 (55)75 (113)2/15
1komma2ser brockhoff noiseless 8.0 (6)11 (18)32 (51)32 (13)31 (49)30 (44)28 (18)5/15
1komma4 brockhoff noiseless 2.9 (3)4.1 (8)11 (15)11 (10)10 (11)10 (9)9.2 (18)11/15
1komma4mir brockhoff noiseless 2.1 (2)7.8 (3)18 (29)17 (17)16 (11)16 (16)15 (16)8/15
1komma4mirser brockhoff noiseless 1.8 (1)4.7 (5)54 (56)52 (132)50 (76)48 (38)45 (51)3/15
1komma4ser brockhoff noiseless 2.0 (3)6.0 (8)21 (16)20 (20)19 (9)19 (17)17 (13)7/15
1plus1 brockhoff noiseless 2.5 (2)3.0 (4)10 (4)10 (10)9.5 (15)9.1 (6)8.5 (6)10/15
1plus2mirser brockhoff noiseless 1.8 (2)2.0 (1)9.2 (15)8.8 (12)8.5 (16)8.3 (9)7.7 (17)11/15
ABC elabd noiseless 5.8 (5)1.1 (0.8)1.3 (0.9)1.8 (0.9)3.7 (3)6.9 (6)9.3 (7)15/15
AVGNEWUOA ros noiseless 1.4 (0.2)2.3 (2)10 (12)9.5 (11)9.2 (18)8.9 (12)8.2 (6)7/15
CMAEGS finck noiseless 14 (23)157 (157)3e50/15
DE-F-AUC fialho noiseless 4.7 (5)3.7 (3)34 (98)33 (126)32 (31)31 (29)28 (81)12/15
DEuniform fialho noiseless 4.8 (4)2.8 (2)34 (0.6)32 (32)32 (61)31 (58)28 (81)12/15
IPOP-ACTCMA-ES ros noiseless 2.0 (3)5.1 (7)5.8 (3)5.9 (3)5.9 (3)5.9 (3)5.6 (3)15/15
IPOP-CMA-ES ros noiseless 3.0 (4)4.5 (3)5.6 (5)5.7 (5)5.6 (4)5.7 (5)5.4 (4)15/15
MOS torre noiseless 4.7 (6)4.3 (7)3.5 (6)4.0 (5)4.8 (5)5.1 (6)7.8 (4)15/15
NBC-CMA preuss noiseless 5.1 (6)3.8 (3)13 (9)12 (18)12 (18)12 (17)11 (8)15/15
PM-AdapSS-DE fialho noiseless 2.9 (0.9)2.8 (2)21 (33)20 (31)20 (60)19 (29)18 (54)13/15
RCGA tran noiseless 4.8 (3)64 (79)217 (300)916 (407)887 (544)2e50/15
SPSA finck noiseless 53 (89)5069 (1e4)3e50/15
oPOEMS kubalic noiseless 83 (9)8.2 (5)146 (295)141 (282)138 (363)135 (350)128 (325)11/15
pPOEMS kubalic noiseless 67 (37)20 (11)17 (7)27 (4)36 (3)52 (8)64 (3)15/15

Δ fopt
f21, 3-D
1e1
6.0
1e0
184
1e-1
425
1e-2
439
1e-3
458
1e-5
469
1e-7
482
#succ
14/15
1komma2 brockhoff noiseless 6.7 (18)11 (15)25 (27)28 (21)27 (33)27 (27)26 (41)14/15
1komma2mir brockhoff noiseless 1.5 (2)7.7 (8)7.7 (7)11 (9)11 (9)11 (4)11 (4)15/15
1komma2mirser brockhoff noiseless 1.8 (2)8.0 (7)12 (32)13 (7)18 (28)17 (26)17 (49)13/15
1komma2ser brockhoff noiseless 4.1 (9)21 (20)40 (20)42 (31)40 (19)40 (47)39 (20)13/15
1komma4 brockhoff noiseless 1.4 (2)7.4 (8)13 (39)13 (8)12 (3)12 (20)12 (8)14/15
1komma4mir brockhoff noiseless 1.1 (0.5)5.4 (5)21 (33)26 (33)27 (59)27 (50)26 (16)12/15
1komma4mirser brockhoff noiseless 2.5 (2)5.1 (5)7.4 (5)7.2 (11)7.0 (4)6.9 (5)6.8 (4)15/15
1komma4ser brockhoff noiseless 2.4 (0.7)8.0 (16)11 (13)11 (10)11 (18)11 (8)10 (10)15/15
1plus1 brockhoff noiseless 2.5 (1)5.3 (13)10 (15)10 (14)9.4 (5)9.2 (17)9.0 (11)15/15
1plus2mirser brockhoff noiseless 1.6 (3)7.4 (15)9.0 (17)8.7 (13)8.4 (17)8.2 (12)8.1 (14)15/15
ABC elabd noiseless 2.3 (5)2.5 (4)3.7 (7)5.9 (5)10 (8)60 (69)145 (223)14/15
AVGNEWUOA ros noiseless 4.0 (1)2.5 (1)2.1 (2)2.0 (4)2.0 (3)2.0 (2)2.0 (4)15/15
CMAEGS finck noiseless 10 (6)35 (55)220 (569)305 (344)293 (332)573 (646)559 (1095)8/15
DE-F-AUC fialho noiseless 2.0 (2)2.1 (2)1.6 (0.8)1.9 (2)2.4 (0.8)2.9 (0.9)3.1 (0.5)15/15
DEuniform fialho noiseless 1.3 (1)1.9 (0.4)1.9 (0.6)2.3 (0.9)2.6 (0.6)3.0 (0.6)3.3 (0.4)15/15
IPOP-ACTCMA-ES ros noiseless 1.8 (0.9)6.6 (5)10 (4)10 (4)10 (25)11 (4)11 (26)15/15
IPOP-CMA-ES ros noiseless 1.5 (0.5)11 (63)10 (23)11 (31)11 (3)11 (18)11 (33)15/15
MOS torre noiseless 1.7 (1)13 (42)22 (37)106 (339)488 (22)745 (3763)860 (722)14/15
NBC-CMA preuss noiseless 1.3 (1)5.1 (1.0)31 (20)55 (57)52 (33)51 (142)50 (227)15/15
PM-AdapSS-DE fialho noiseless 1.1 (0.5)1.6 (2)52 (0.9)51 (0.8)49 (164)48 (0.7)47 (0.9)14/15
RCGA tran noiseless 1.8 (2)21 (37)59 (136)162 (236)164 (256)270 (330)293 (304)9/15
SPSA finck noiseless 30 (17)438 (615)1223 (1150)1186 (2051)1139 (1861)1156 (952)2914 (2216)1/15
oPOEMS kubalic noiseless 89 (4)999 (2645)800 (1184)776 (568)746 (879)735 (1340)721 (836)12/15
pPOEMS kubalic noiseless 31 (54)12 (8)11 (6)24 (21)39 (17)92 (22)145 (26)15/15

Δ fopt
f22, 3-D
1e1
18
1e0
170
1e-1
354
1e-2
362
1e-3
384
1e-5
401
1e-7
414
#succ
15/15
1komma2 brockhoff noiseless 4.0 (1)17 (25)28 (12)35 (57)34 (33)33 (18)32 (16)13/15
1komma2mir brockhoff noiseless 15 (50)11 (17)22 (35)25 (11)25 (43)25 (28)24 (31)14/15
1komma2mirser brockhoff noiseless 7.1 (10)7.6 (5)20 (12)31 (63)30 (25)34 (43)33 (33)13/15
1komma2ser brockhoff noiseless 18 (3)16 (19)26 (37)26 (34)27 (24)27 (12)27 (17)14/15
1komma4 brockhoff noiseless 4.0 (10)7.8 (13)7.8 (4)7.9 (8)7.6 (4)7.4 (6)7.3 (5)15/15
1komma4mir brockhoff noiseless 3.6 (2)6.8 (6)7.3 (7)7.4 (10)7.2 (11)7.1 (6)7.1 (9)15/15
1komma4mirser brockhoff noiseless 2.8 (7)10 (20)15 (14)16 (11)15 (11)15 (9)14 (15)15/15
1komma4ser brockhoff noiseless 9.1 (8)7.0 (10)10 (5)10 (11)10 (4)9.3 (16)9.1 (13)15/15
1plus1 brockhoff noiseless 6.4 (9)8.7 (7)7.2 (16)7.2 (11)6.9 (7)6.7 (12)6.6 (6)15/15
1plus2mirser brockhoff noiseless 3.1 (8)2.7 (3)3.4 (8)3.5 (12)3.3 (3)3.3 (3)3.3 (2)15/15
ABC elabd noiseless 2.5 (6)1.7 (2)4.3 (7)29 (4)105 (109)329 (563)4865 (4892)2/15
AVGNEWUOA ros noiseless 2.8 (8)2.0 (3)2.9 (1)2.9 (1)2.8 (2)2.9 (8)3.1 (5)15/15
CMAEGS finck noiseless 3.6 (2)43 (26)237 (78)524 (626)798 (1198)1153 (2080)1117 (1091)4/15
DE-F-AUC fialho noiseless 2.1 (2)2.2 (1)132 (425)130 (1)123 (0.9)119 (374)115 (544)13/15
DEuniform fialho noiseless 1.3 (0.8)1.5 (1)132 (425)130 (208)123 (197)118 (375)115 (363)13/15
IPOP-ACTCMA-ES ros noiseless 6.6 (20)7.1 (9)27 (47)83 (282)228 (478)222 (655)217 (310)12/15
IPOP-CMA-ES ros noiseless 1.2 (2)5.0 (7)21 (28)90 (229)247 (302)286 (624)281 (589)11/15
MOS torre noiseless 1.5 (0.8)16 (7)22 (38)28 (29)31 (41)44 (78)193 (114)15/15
NBC-CMA preuss noiseless 1.4 (1)109 (2)174 (48)225 (565)213 (337)204 (240)198 (312)13/15
PM-AdapSS-DE fialho noiseless 1.3 (1)127 (1)214 (636)210 (415)198 (391)190 (561)184 (725)12/15
RCGA tran noiseless 1.3 (0.8)32 (118)111 (107)389 (243)518 (561)1219 (935)5389 (3804)0/15
SPSA finck noiseless 31 (50)320 (849)5908 (7578)1.2e4 (7252)3e50/15
oPOEMS kubalic noiseless 2138 (12)623 (1778)990 (1739)974 (1214)921 (1701)890 (1016)868 (1174)14/15
pPOEMS kubalic noiseless 29 (15)12 (7)211 (649)227 (50)234 (36)298 (585)361 (1666)14/15

Δ fopt
f23, 3-D
1e1
3.0
1e0
407
1e-1
906
1e-2
1215
1e-3
2214
1e-5
2293
1e-7
2393
#succ
15/15
1komma2 brockhoff noiseless 6.2 (7)37 (12)237 (185)177 (292)197 (224)190 (271)3e40/15
1komma2mir brockhoff noiseless 5.6 (10)12 (9)48 (65)104 (56)57 (67)87 (105)3e40/15
1komma2mirser brockhoff noiseless 4.6 (3)18 (20)69 (37)81 (49)45 (35)63 (49)61 (69)1/15
1komma2ser brockhoff noiseless 8.5 (4)54 (45)231 (291)180 (140)199 (264)3e40/15
1komma4 brockhoff noiseless 2.2 (0.8)7.3 (5)20 (16)16 (14)10 (12)10 (8)11 (13)9/15
1komma4mir brockhoff noiseless 2.6 (2)6.2 (6)19 (14)21 (23)14 (13)14 (19)13 (15)9/15
1komma4mirser brockhoff noiseless 5.3 (3)8.2 (8)30 (20)27 (44)15 (26)14 (11)14 (21)9/15
1komma4ser brockhoff noiseless 8.2 (4)16 (13)40 (30)41 (80)34 (46)43 (45)55 (61)2/15
1plus1 brockhoff noiseless 4.8 (5)3.4 (1)13 (5)19 (22)13 (4)20 (27)29 (61)5/15
1plus2mirser brockhoff noiseless 4.2 (5)3.5 (12)10 (5)21 (17)16 (10)24 (21)23 (27)6/15
ABC elabd noiseless 3.7 (4)10 (7)3e50/15
AVGNEWUOA ros noiseless 9.4 (21)2.5 (4)22 (25)85 (78)147 (146)2e40/15
CMAEGS finck noiseless 14 (11)11 (8)3e50/15
DE-F-AUC fialho noiseless 2.7 (1)3.1 (1)5.1 (1.0)6.6 (0.8)5.1 (0.4)7.8 (0.6)10 (0.4)15/15
DEuniform fialho noiseless 3.4 (4)2.4 (0.9)5.3 (1)7.2 (0.9)5.5 (0.5)8.4 (0.5)11 (0.8)15/15
IPOP-ACTCMA-ES ros noiseless 6.2 (4)5.3 (3)10 (8)7.7 (5)4.3 (2)5.4 (4)5.4 (3)15/15
IPOP-CMA-ES ros noiseless 4.3 (2)5.2 (4)80 (252)60 (13)33 (103)32 (7)31 (188)14/15
MOS torre noiseless 3.4 (4)7.5 (5)10 (3)8.6 (5)5.2 (5)5.3 (4)5.4 (5)15/15
NBC-CMA preuss noiseless 2.3 (2)15 (16)353 (541)263 (556)145 (180)140 (195)134 (127)8/15
PM-AdapSS-DE fialho noiseless 3.6 (5)2.5 (2)5.7 (2)26 (64)16 (36)19 (6)20 (1)13/15
RCGA tran noiseless 4.6 (5)16 (19)271 (286)837 (876)2e50/15
SPSA finck noiseless 98 (104)945 (499)3e50/15
oPOEMS kubalic noiseless 17 (27)21 (16)106 (1)141 (186)83 (118)86 (310)88 (15)13/15
pPOEMS kubalic noiseless 13 (25)64 (61)264 (505)276 (211)189 (22)255 (134)328 (146)11/15

Δ fopt
f24, 3-D
1e1
97
1e0
10391
1e-1
1.0e5
1e-2
3.6e5
1e-3
3.6e5
1e-5
3.6e5
1e-7
3.6e5
#succ
2/15
1komma2 brockhoff noiseless 6.9 (12)43 (49)3e40/15
1komma2mir brockhoff noiseless 2.0 (1)20 (29)3e40/15
1komma2mirser brockhoff noiseless 3.3 (4)7.5 (18)3e40/15
1komma2ser brockhoff noiseless 12 (16)3e40/15
1komma4 brockhoff noiseless 3.2 (5)13 (10)3e40/15
1komma4mir brockhoff noiseless 1.5 (2)2.5 (2)3e40/15
1komma4mirser brockhoff noiseless 1.4 (2)4.1 (5)2.1 (4)1.2 (2)1.2 (1)1.2 (1)1.2 (2)1/15
1komma4ser brockhoff noiseless 5.3 (12)3.9 (4)3e40/15
1plus1 brockhoff noiseless 6.5 (8)3.4 (8)3e40/15
1plus2mirser brockhoff noiseless 2.0 (3)4.7 (2)3e40/15
ABC elabd noiseless 4.8 (5)8.4 (9)3e50/15
AVGNEWUOA ros noiseless 3.7 (4)1.2 (0.9)2.4 (4)2e40/15
CMAEGS finck noiseless 4.0 (1)14 (16)3e50/15
DE-F-AUC fialho noiseless 3.0 (4)80 (72)8.1 (12)3.4 (3)3.4 (4)3.4 (2)3.4 (4)3/15
DEuniform fialho noiseless 3.7 (3)58 (180)5.9 (4)1.7 (2)1.7 (1)1.7 (2)1.7 (3)5/15
IPOP-ACTCMA-ES ros noiseless 2.7 (5)146 (243)64 (81)39 (46)39 (68)39 (40)39 (50)1/15
IPOP-CMA-ES ros noiseless 1.9 (2)272 (322)1e60/15
MOS torre noiseless 6.4 (8)7.9 (23)3.5 (7)1.5 (1)1.9 (3)1.9 (3)1.9 (2)9/15
NBC-CMA preuss noiseless 2.8 (2)24 (17)43 (66)3e50/15
PM-AdapSS-DE fialho noiseless 4.0 (3)58 (123)12 (10)3.5 (3)5.7 (12)5.7 (7)5.7 (3)2/15
RCGA tran noiseless 5.0 (2)45 (75)21 (34)6.2 (6)2e50/15
SPSA finck noiseless 1.5e4 (1e4)3e50/15
oPOEMS kubalic noiseless 17 (5)564 (455)9e50/15
pPOEMS kubalic noiseless 19 (10)65 (90)12 (18)4.3 (7)4.4 (12)4.5 (3)4.7 (12)6/15

Previous dimension | Dimension = 5 | Next dimension

Δ fopt
f1, 5-D
1e1
11
1e0
12
1e-1
12
1e-2
12
1e-3
12
1e-5
12
1e-7
12
#succ
15/15
1komma2 brockhoff noiseless 7.4 (4)15 (3)27 (6)38 (16)48 (10)64 (14)81 (12)15/15
1komma2mir brockhoff noiseless 3.2 (3)10 (3)16 (5)22 (5)28 (5)41 (6)54 (5)15/15
1komma2mirser brockhoff noiseless 2.1 (1)7.3 (4)13 (7)18 (5)24 (6)35 (11)46 (5)15/15
1komma2ser brockhoff noiseless 4.5 (4)12 (8)22 (11)30 (22)39 (19)56 (11)72 (18)15/15
1komma4 brockhoff noiseless 2.5 (2)7.0 (2)11 (3)16 (3)21 (4)31 (6)41 (5)15/15
1komma4mir brockhoff noiseless 2.2 (2)6.3 (2)10 (2)15 (3)19 (3)28 (3)37 (4)15/15
1komma4mirser brockhoff noiseless 2.0 (1)5.1 (2)8.5 (3)12 (2)15 (3)23 (2)30 (5)15/15
1komma4ser brockhoff noiseless 2.5 (1)6.6 (3)10 (7)15 (3)18 (4)26 (6)35 (8)15/15
1plus1 brockhoff noiseless 2.1 (2)5.7 (1)10 (1)13 (3)17 (2)25 (4)33 (3)15/15
1plus2mirser brockhoff noiseless 1.5 (0.9)5.0 (1)8.1 (2)12 (2)15 (2)22 (2)28 (3)15/15
ABC elabd noiseless 12 (11)32 (30)63 (24)90 (32)124 (28)194 (20)259 (33)15/15
AVGNEWUOA ros noiseless 1.5 (0)1.3 (0)★41.3 (0.1)★41.3 (0.1)★41.3 (0.1)★41.3 (0)★41.3 (0.1)★415/15
CMAEGS finck noiseless 7.2 (4)16 (6)25 (10)34 (9)44 (8)68 (11)89 (16)15/15
DE-F-AUC fialho noiseless 5.9 (7)38 (15)68 (17)106 (11)134 (10)206 (11)271 (23)15/15
DEuniform fialho noiseless 8.6 (9)43 (11)81 (15)118 (15)158 (11)240 (9)318 (12)15/15
IPOP-ACTCMA-ES ros noiseless 3.2 (2)9.1 (4)15 (3)22 (4)27 (5)40 (6)51 (8)15/15
IPOP-CMA-ES ros noiseless 2.5 (2)8.1 (3)14 (3)21 (2)28 (2)40 (4)52 (4)15/15
MOS torre noiseless 6.5 (5)34 (18)67 (8)92 (13)123 (18)171 (14)220 (25)15/15
NBC-CMA preuss noiseless 5.6 (5)26 (12)42 (7)54 (6)66 (4)86 (4)109 (5)15/15
PM-AdapSS-DE fialho noiseless 4.8 (5)40 (16)75 (13)113 (16)147 (17)226 (13)297 (14)15/15
RCGA tran noiseless 8.7 (24)74 (14)158 (76)335 (60)571 (129)1160 (176)1770 (219)15/15
SPSA finck noiseless 11 (17)15 (23)19 (3)23 (32)28 (75)36 (53)45 (62)15/15
oPOEMS kubalic noiseless 102 (18)139 (37)334 (125)779 (129)1215 (198)2034 (355)2843 (262)15/15
pPOEMS kubalic noiseless 97 (14)131 (43)624 (534)2897 (396)5871 (919)1.3e4 (1149)1.9e4 (955)15/15

Δ fopt
f2, 5-D
1e1
83
1e0
87
1e-1
88
1e-2
89
1e-3
90
1e-5
92
1e-7
94
#succ
15/15
1komma2 brockhoff noiseless 58 (28)61 (25)64 (6)65 (8)66 (10)68 (9)69 (6)15/15
1komma2mir brockhoff noiseless 37 (11)40 (5)43 (5)43 (4)44 (5)45 (4)46 (5)15/15
1komma2mirser brockhoff noiseless 30 (7)34 (3)35 (6)36 (5)36 (4)37 (5)38 (4)15/15
1komma2ser brockhoff noiseless 67 (31)74 (16)81 (18)83 (17)85 (11)87 (17)89 (17)15/15
1komma4 brockhoff noiseless 20 (6)23 (3)24 (4)24 (5)25 (6)26 (4)27 (3)15/15
1komma4mir brockhoff noiseless 16 (7)19 (5)22 (3)22 (2)23 (2)24 (2)24 (2)15/15
1komma4mirser brockhoff noiseless 14 (5)15 (2)16 (2)16 (2)17 (2)18 (1)18 (2)15/15
1komma4ser brockhoff noiseless 18 (6)21 (6)22 (4)22 (3)23 (3)23 (3)24 (3)15/15
1plus1 brockhoff noiseless 11 (4)13 (1)13 (2)14 (2)14 (0.9)15 (2)15 (0.9)15/15
1plus2mirser brockhoff noiseless 10 (2)11 (2)12 (1)12 (1)13 (1)13 (1)14 (1)15/15
ABC elabd noiseless 11 (5)18 (8)26 (8)30 (13)38 (11)50 (10)62 (4)15/15
AVGNEWUOA ros noiseless 6.4 (11)21 (18)41 (26)56 (14)75 (20)108 (29)146 (44)15/15
CMAEGS finck noiseless 68 (12)69 (12)70 (11)70 (9)72 (11)73 (11)75 (7)15/15
DE-F-AUC fialho noiseless 18 (2)22 (1)26 (2)30 (2)35 (2)42 (2)50 (2)15/15
DEuniform fialho noiseless 21 (2)24 (3)30 (2)35 (3)40 (3)50 (3)58 (2)15/15
IPOP-ACTCMA-ES ros noiseless 10 (3)12 (3)14 (1)14 (1)15 (1)16 (1)18 (2)15/15
IPOP-CMA-ES ros noiseless 14 (4)16 (4)18 (2)19 (2)19 (2)21 (1)22 (2)15/15
MOS torre noiseless 23 (4)29 (3)35 (2)40 (4)46 (5)55 (5)64 (6)15/15
NBC-CMA preuss noiseless 23 (4)27 (7)30 (6)31 (4)33 (5)35 (6)37 (4)15/15
PM-AdapSS-DE fialho noiseless 19 (3)24 (1)28 (0.5)33 (3)38 (2)47 (2)55 (2)15/15
RCGA tran noiseless 78 (48)125 (51)170 (51)208 (41)252 (39)347 (40)1071 (675)7/15
SPSA finck noiseless 5e50/15
oPOEMS kubalic noiseless 201 (41)297 (39)342 (43)372 (51)437 (53)550 (53)638 (69)15/15
pPOEMS kubalic noiseless 1213 (454)1322 (434)1743 (357)2228 (470)2543 (414)3089 (445)3937 (286)15/15

Δ fopt
f3, 5-D
1e1
716
1e0
1622
1e-1
1637
1e-2
1642
1e-3
1646
1e-5
1650
1e-7
1654
#succ
15/15
1komma2 brockhoff noiseless 39 (33)5e40/15
1komma2mir brockhoff noiseless 3.5 (3)147 (272)454 (305)453 (487)452 (759)451 (439)450 (333)1/15
1komma2mirser brockhoff noiseless 6.1 (10)441 (663)5e40/15
1komma2ser brockhoff noiseless 28 (28)225 (478)5e40/15
1komma4 brockhoff noiseless 4.3 (6)434 (331)5e40/15
1komma4mir brockhoff noiseless 4.5 (5)79 (60)443 (435)442 (343)441 (433)440 (462)439 (446)1/15
1komma4mirser brockhoff noiseless 2.8 (4)98 (28)5e40/15
1komma4ser brockhoff noiseless 5.9 (7)5e40/15
1plus1 brockhoff noiseless 7.2 (7)5e40/15
1plus2mirser brockhoff noiseless 3.4 (3)91 (72)5e40/15
ABC elabd noiseless 1.0 (0.5)1.5 (0.6)1.8 (0.6)2.4 (0.3)2.7 (0.4)3.6 (0.7)4.4 (0.6)15/15
AVGNEWUOA ros noiseless 3.0 (4)130 (211)3e40/15
CMAEGS finck noiseless 40 (144)2261 (2876)4484 (7943)4473 (2208)4463 (2658)5e50/15
DE-F-AUC fialho noiseless 3.4 (2)12 (3)59 (154)59 (154)60 (3)60 (78)60 (79)13/15
DEuniform fialho noiseless 3.5 (2)12 (3)125 (3)125 (304)125 (533)126 (154)126 (151)11/15
IPOP-ACTCMA-ES ros noiseless 1.1 (0.2)20 (39)1359 (1077)1356 (1644)1353 (2386)1351 (2032)1348 (1399)4/15
IPOP-CMA-ES ros noiseless 2.2 (0.3)70 (193)3130 (6094)3121 (4400)3113 (5407)3106 (2232)3099 (6172)2/15
MOS torre noiseless 1.5 (0.5)1.6 (0.4)2.4 (2)2.9 (2)3.2 (2)3.8 (0.3)4.4 (0.2)15/15
NBC-CMA preuss noiseless 1.9 (0.8)30 (19)155 (147)154 (153)154 (312)154 (295)154 (133)10/15
PM-AdapSS-DE fialho noiseless 4.9 (4)33 (3)166 (231)217 (231)362 (305)621 (531)621 (907)5/15
RCGA tran noiseless 3.4 (2)37 (9)89 (65)95 (131)114 (64)118 (104)120 (185)12/15
SPSA finck noiseless 5e50/15
oPOEMS kubalic noiseless 4.0 (2)11 (5)36 (36)38 (36)42 (2)48 (37)54 (37)15/15
pPOEMS kubalic noiseless 4.8 (3)30 (9)64 (8)92 (9)116 (24)158 (17)203 (18)15/15

Δ fopt
f4, 5-D
1e1
809
1e0
1633
1e-1
1688
1e-2
1758
1e-3
1817
1e-5
1886
1e-7
1903
#succ
15/15
1komma2 brockhoff noiseless 75 (94)5e40/15
1komma2mir brockhoff noiseless 11 (11)5e40/15
1komma2mirser brockhoff noiseless 8.8 (5)445 (329)5e40/15
1komma2ser brockhoff noiseless 48 (40)5e40/15
1komma4 brockhoff noiseless 10 (7)5e40/15
1komma4mir brockhoff noiseless 4.6 (5)450 (528)5e40/15
1komma4mirser brockhoff noiseless 2.9 (3)456 (329)5e40/15
1komma4ser brockhoff noiseless 11 (14)448 (421)433 (718)416 (896)403 (351)388 (331)385 (322)1/15
1plus1 brockhoff noiseless 22 (18)5e40/15
1plus2mirser brockhoff noiseless 7.2 (6)444 (276)5e40/15
ABC elabd noiseless 1.1 (0.4)2.4 (1)2.9 (1)3.4 (0.6)4.3 (2)4.9 (2)6.0 (1)15/15
AVGNEWUOA ros noiseless 14 (16)4e40/15
CMAEGS finck noiseless 309 (340)5e50/15
DE-F-AUC fialho noiseless 5.7 (3)625 (535)5e50/15
DEuniform fialho noiseless 5.1 (2)626 (1608)1941 (1851)1864 (2987)1804 (3164)1738 (3248)1724 (2168)2/15
IPOP-ACTCMA-ES ros noiseless 1.8 (1)9e50/15
IPOP-CMA-ES ros noiseless 2.0 (1)9e50/15
MOS torre noiseless 1.6 (0.6)3.6 (4)5.6 (4)5.8 (4)6.1 (4)6.6 (4)7.3 (4)15/15
NBC-CMA preuss noiseless 2.6 (4)221 (148)1252 (1998)1202 (894)1163 (579)1121 (677)1111 (986)2/15
PM-AdapSS-DE fialho noiseless 4.9 (2)4296 (8114)5e50/15
RCGA tran noiseless 14 (7)2e50/15
SPSA finck noiseless 4240 (6291)5e50/15
oPOEMS kubalic noiseless 4.9 (2)43 (20)118 (36)117 (184)116 (278)119 (49)124 (156)15/15
pPOEMS kubalic noiseless 6.8 (4)36 (21)79 (13)106 (14)120 (13)158 (14)198 (11)15/15

Δ fopt
f5, 5-D
1e1
10
1e0
10
1e-1
10
1e-2
10
1e-3
10
1e-5
10
1e-7
10
#succ
15/15
1komma2 brockhoff noiseless 5.7 (3)7.5 (3)8.1 (5)8.1 (11)8.1 (3)8.1 (3)8.1 (4)15/15
1komma2mir brockhoff noiseless 3.1 (1)4.8 (2)4.8 (1)4.9 (2)4.9 (1)4.9 (3)4.9 (2)15/15
1komma2mirser brockhoff noiseless 2.6 (2)3.3 (1)3.5 (1)3.5 (2)3.5 (2)3.5 (1)3.5 (1)15/15
1komma2ser brockhoff noiseless 5.7 (4)8.4 (4)9.1 (5)9.1 (5)9.1 (9)9.1 (4)9.1 (6)15/15
1komma4 brockhoff noiseless 3.2 (2)4.3 (3)4.5 (2)4.5 (3)4.5 (2)4.5 (2)4.5 (2)15/15
1komma4mir brockhoff noiseless 3.3 (1)4.5 (2)4.8 (2)4.8 (1)4.8 (3)4.8 (2)4.8 (2)15/15
1komma4mirser brockhoff noiseless 2.4 (2)3.5 (2)3.6 (2)3.6 (2)3.6 (2)3.6 (2)3.6 (2)15/15
1komma4ser brockhoff noiseless 2.9 (2)3.9 (3)4.0 (2)4.0 (3)4.0 (3)4.0 (3)4.0 (3)15/15
1plus1 brockhoff noiseless 2.0 (2)2.9 (1)3.0 (2)3.0 (1)3.0 (1)3.0 (0.9)3.0 (1)15/15
1plus2mirser brockhoff noiseless 1.8 (0.7)2.7 (2)2.9 (2)2.9 (3)2.9 (3)2.9 (3)2.9 (2)15/15
ABC elabd noiseless 32 (16)49 (25)58 (32)59 (27)59 (37)59 (28)59 (33)15/15
AVGNEWUOA ros noiseless 1.8 (0.2)1.9 (0.2)1.9 (0.3)1.9 (0.2)1.9 (0.3)1.9 (0.3)1.9 (0.2)15/15
CMAEGS finck noiseless 4.9 (2)6.9 (2)7.2 (2)7.3 (1)7.3 (1)7.3 (1)7.3 (2)15/15
DE-F-AUC fialho noiseless 15 (7)23 (12)24 (12)24 (8)24 (7)24 (7)24 (12)15/15
DEuniform fialho noiseless 20 (10)34 (11)35 (15)35 (19)35 (23)35 (9)35 (22)15/15
IPOP-ACTCMA-ES ros noiseless 4.6 (2)6.3 (2)6.8 (2)6.8 (2)6.8 (3)6.8 (2)6.8 (2)15/15
IPOP-CMA-ES ros noiseless 4.6 (2)6.0 (2)6.3 (2)6.3 (3)6.3 (2)6.3 (2)6.3 (2)15/15
MOS torre noiseless 20 (7)42 (15)50 (12)50 (9)51 (13)51 (15)51 (15)15/15
NBC-CMA preuss noiseless 33 (3)39 (7)43 (5)43 (5)43 (8)43 (7)43 (8)15/15
PM-AdapSS-DE fialho noiseless 24 (10)33 (16)36 (15)36 (13)36 (15)36 (11)36 (16)15/15
RCGA tran noiseless 327 (45)747 (99)1146 (119)1577 (105)2004 (191)2866 (267)3740 (255)6/15
SPSA finck noiseless 9.3 (12)13 (14)14 (11)14 (13)14 (15)14 (13)14 (8)15/15
oPOEMS kubalic noiseless 161 (39)203 (35)222 (30)229 (44)230 (28)231 (8)231 (49)15/15
pPOEMS kubalic noiseless 153 (41)203 (26)215 (23)217 (9)218 (48)218 (27)218 (8)15/15

Δ fopt
f6, 5-D
1e1
114
1e0
214
1e-1
281
1e-2
404
1e-3
580
1e-5
1038
1e-7
1332
#succ
15/15
1komma2 brockhoff noiseless 5.9 (6)5.1 (4)5.0 (2)4.8 (2)4.3 (2)3.9 (2)4.0 (2)15/15
1komma2mir brockhoff noiseless 2.7 (1)2.4 (1)2.5 (1)2.1 (0.5)1.8 (0.3)1.4 (0.3)1.4 (0.2)15/15
1komma2mirser brockhoff noiseless 2.2 (1)2.0 (0.8)2.1 (0.7)1.9 (0.4)1.6 (0.4)1.1 (0.1)1.1 (0.2)15/15
1komma2ser brockhoff noiseless 6.5 (4)6.6 (7)7.7 (6)7.3 (7)6.8 (9)5.8 (8)5.9 (5)15/15
1komma4 brockhoff noiseless 1.6 (0.7)1.7 (0.8)1.8 (0.7)1.7 (0.3)1.5 (0.2)1.2 (0.3)1.2 (0.3)15/15
1komma4mir brockhoff noiseless 1.8 (1)1.6 (0.8)1.7 (0.4)1.5 (0.3)1.3 (0.1)1.00 (0.1)0.96 (0.2)15/15
1komma4mirser brockhoff noiseless 1.1 (0.7)1.1 (0.4)1.2 (0.5)1.1 (0.2)0.91 (0.1)0.70 (0.2)0.69 (0.2)15/15
1komma4ser brockhoff noiseless 1.8 (0.9)1.9 (1)1.9 (1)1.8 (0.9)1.5 (0.6)1.1 (0.3)1.1 (0.7)15/15
1plus1 brockhoff noiseless 1.8 (3)1.5 (2)1.9 (2)1.7 (1)1.4 (0.3)1.1 (0.6)1.4 (0.9)15/15
1plus2mirser brockhoff noiseless 1.1 (0.2)1.2 (0.5)1.6 (2)1.4 (0.6)1.4 (0.2)1.6 (0.9)2.2 (2)15/15
ABC elabd noiseless 4.9 (4)15 (6)365 (1953)408 (648)619 (1088)498 (847)507 (565)6/15
AVGNEWUOA ros noiseless 1.3 (0.7)1.6 (1)2.6 (2)2.6 (3)2.6 (2)2.4 (2)2.5 (3)15/15
CMAEGS finck noiseless 241 (722)656 (1787)519 (42)518 (1563)372 (651)220 (127)230 (664)9/15
DE-F-AUC fialho noiseless 6.5 (1)7.6 (1)8.5 (0.9)8.0 (1)7.0 (0.7)5.3 (0.2)5.4 (0.4)15/15
DEuniform fialho noiseless 9.0 (0.9)9.2 (0.8)10 (0.8)9.2 (0.9)7.9 (0.9)6.1 (0.5)6.1 (0.2)15/15
IPOP-ACTCMA-ES ros noiseless 2.5 (1)2.1 (0.5)2.2 (0.4)2.0 (0.4)1.6 (0.1)1.2 (0.1)1.2 (0.1)15/15
IPOP-CMA-ES ros noiseless 2.5 (1.0)2.1 (0.6)2.2 (0.4)2.0 (0.4)1.7 (0.2)1.3 (0.2)1.2 (0.1)15/15
MOS torre noiseless 8.0 (4)8.6 (2)8.8 (1)7.7 (0.7)6.3 (0.5)4.8 (0.4)4.6 (0.3)15/15
NBC-CMA preuss noiseless 8.2 (25)19 (3)16 (14)11 (7)8.4 (16)5.1 (5)4.3 (7)15/15
PM-AdapSS-DE fialho noiseless 8.1 (3)8.1 (1)9.0 (1)8.3 (1)7.3 (0.8)5.7 (0.3)5.7 (0.2)15/15
RCGA tran noiseless 27 (13)71 (39)255 (402)433 (778)598 (691)2e50/15
SPSA finck noiseless 2.9e4 (4e4)3.3e4 (2e4)2.5e4 (4e4)5e50/15
oPOEMS kubalic noiseless 26 (11)46 (7)54 (3)51 (4)45 (3)36 (2)37 (2)15/15
pPOEMS kubalic noiseless 31 (27)202 (70)314 (32)323 (57)306 (24)266 (22)282 (20)15/15

Δ fopt
f7, 5-D
1e1
24
1e0
324
1e-1
1171
1e-2
1451
1e-3
1572
1e-5
1572
1e-7
1597
#succ
15/15
1komma2 brockhoff noiseless 19 (11)28 (14)188 (164)5e40/15
1komma2mir brockhoff noiseless 7.0 (5)5.3 (5)11 (17)50 (26)225 (334)225 (201)221 (177)2/15
1komma2mirser brockhoff noiseless 5.7 (5)5.0 (5)17 (17)40 (67)81 (97)81 (58)104 (54)0/15
1komma2ser brockhoff noiseless 36 (59)39 (63)188 (239)5e40/15
1komma4 brockhoff noiseless 7.0 (13)3.1 (2)5.8 (6)25 (25)41 (28)41 (70)97 (134)2/15
1komma4mir brockhoff noiseless 5.4 (6)3.7 (1.0)7.1 (5)16 (5)35 (16)35 (36)80 (69)4/15
1komma4mirser brockhoff noiseless 4.0 (3)1.9 (1.0)3.9 (2)17 (20)25 (31)25 (22)60 (40)4/15
1komma4ser brockhoff noiseless 8.2 (9)4.2 (2)11 (11)23 (10)100 (171)100 (109)139 (141)2/15
1plus1 brockhoff noiseless 4.0 (3)2.8 (2)3.2 (1)3.0 (8)3.6 (0.6)3.6 (7)3.5 (3)15/15
1plus2mirser brockhoff noiseless 3.7 (1)2.6 (2)1.4 (0.9)1.7 (1)1.9 (2)1.9 (0.6)1.8 (0.4)15/15
ABC elabd noiseless 19 (18)16 (24)62 (57)464 (796)957 (966)957 (1460)1359 (774)1/15
AVGNEWUOA ros noiseless 4.3 (12)5.9 (11)13 (19)131 (117)4e40/15
CMAEGS finck noiseless 270 (803)1508 (2707)6255 (9312)5e50/15
DE-F-AUC fialho noiseless 13 (6)2.4 (0.7)1.1 (0.2)1.2 (0.3)1.2 (0.2)1.2 (0.2)1.3 (0.1)15/15
DEuniform fialho noiseless 13 (5)2.7 (0.7)1.2 (0.2)1.5 (0.2)1.4 (0.2)1.4 (0.1)1.6 (0.2)15/15
IPOP-ACTCMA-ES ros noiseless 3.9 (2)0.87 (0.1)0.70 (1)0.68 (0.4)0.69 (0.3)0.69 (0.4)0.70 (0.9)15/15
IPOP-CMA-ES ros noiseless 4.4 (4)1.7 (2)1.2 (0.8)1.1 (0.7)1.2 (0.1)1.2 (0.6)1.2 (0.5)15/15
MOS torre noiseless 12 (9)5.1 (2)2.5 (2)2.4 (1)2.3 (0.5)2.3 (1)2.3 (1)15/15
NBC-CMA preuss noiseless 6.9 (2)7.2 (0.3)6.1 (7)5.0 (6)4.7 (5)4.7 (5)4.7 (5)15/15
PM-AdapSS-DE fialho noiseless 12 (5)2.5 (0.4)1.2 (0.2)1.4 (0.2)1.3 (0.2)1.3 (0.1)1.5 (0.2)15/15
RCGA tran noiseless 25 (31)73 (75)147 (139)335 (454)690 (636)690 (243)1072 (2041)2/15
SPSA finck noiseless 3.2e4 (4e4)5e50/15
oPOEMS kubalic noiseless 81 (57)17 (7)9.0 (1)11 (1)11 (2)11 (2)12 (2)15/15
pPOEMS kubalic noiseless 88 (49)26 (14)43 (4)59 (15)76 (14)76 (17)79 (19)15/15

Δ fopt
f8, 5-D
1e1
73
1e0
273
1e-1
336
1e-2
372
1e-3
391
1e-5
410
1e-7
422
#succ
15/15
1komma2 brockhoff noiseless 10 (17)10 (6)14 (5)14 (7)15 (5)15 (5)15 (5)15/15
1komma2mir brockhoff noiseless 5.6 (4)5.7 (3)7.2 (4)7.8 (5)8.1 (4)8.4 (3)8.7 (4)15/15
1komma2mirser brockhoff noiseless 4.2 (4)5.8 (4)6.9 (3)7.3 (3)7.5 (2)7.6 (2)7.8 (1)15/15
1komma2ser brockhoff noiseless 12 (51)14 (20)19 (4)19 (16)20 (4)21 (14)21 (8)15/15
1komma4 brockhoff noiseless 2.6 (1)4.9 (3)5.7 (5)5.8 (4)5.9 (0.9)6.2 (1)6.3 (4)15/15
1komma4mir brockhoff noiseless 2.9 (0.5)3.6 (3)4.3 (2)4.7 (2)4.8 (2)5.0 (1)5.2 (2)15/15
1komma4mirser brockhoff noiseless 2.3 (1)2.9 (2)3.5 (2)3.6 (2)3.7 (2)3.8 (1)4.0 (2)15/15
1komma4ser brockhoff noiseless 2.4 (2)4.1 (2)5.0 (3)5.2 (3)5.4 (2)5.5 (2)5.6 (3)15/15
1plus1 brockhoff noiseless 2.3 (0.8)3.5 (5)3.8 (5)3.8 (4)3.8 (4)4.0 (2)4.1 (3)15/15
1plus2mirser brockhoff noiseless 1.9 (2)3.0 (7)3.2 (4)3.2 (2)3.3 (1.0)3.4 (5)3.5 (3)15/15
ABC elabd noiseless 6.0 (0.9)12 (15)52 (15)449 (1029)2510 (5998)5e50/15
AVGNEWUOA ros noiseless 1.2 (1)1.2 (0.9)1.1 (0.7)1.1 (0.2)★21.1 (1)★21.1 (1)★21.1 (0.6)★215/15
CMAEGS finck noiseless 8.2 (12)7.6 (9)8.2 (6)8.5 (12)8.8 (5)10 (8)11 (10)15/15
DE-F-AUC fialho noiseless 13 (2)8.9 (1)11 (2)11 (3)11 (2)13 (0.8)14 (2)15/15
DEuniform fialho noiseless 15 (2)10 (2)14 (3)16 (4)17 (2)18 (3)20 (3)15/15
IPOP-ACTCMA-ES ros noiseless 2.8 (1)3.0 (3)3.7 (1)3.8 (3)4.0 (2)4.2 (2)4.5 (2)15/15
IPOP-CMA-ES ros noiseless 3.5 (2)4.8 (6)5.3 (0.8)5.5 (3)5.6 (0.5)5.8 (1.0)6.1 (0.6)15/15
MOS torre noiseless 11 (2)11 (4)12 (3)13 (2)13 (2)14 (2)15 (2)15/15
NBC-CMA preuss noiseless 7.2 (1)7.0 (3)8.1 (1)8.4 (7)8.6 (3)8.9 (6)9.4 (1)15/15
PM-AdapSS-DE fialho noiseless 13 (3)9.4 (3)15 (2)18 (4)19 (3)20 (13)21 (4)15/15
RCGA tran noiseless 32 (48)558 (794)1451 (907)2995 (2779)2984 (3836)2e50/15
SPSA finck noiseless 3777 (6873)1.2e4 (1e4)5e50/15
oPOEMS kubalic noiseless 58 (16)52 (13)117 (166)380 (236)689 (226)1486 (452)2231 (689)15/15
pPOEMS kubalic noiseless 85 (70)262 (110)366 (32)482 (75)583 (36)796 (40)1053 (39)15/15

Δ fopt
f9, 5-D
1e1
35
1e0
127
1e-1
214
1e-2
263
1e-3
300
1e-5
335
1e-7
369
#succ
15/15
1komma2 brockhoff noiseless 12 (7)27 (24)24 (16)23 (15)21 (9)20 (12)19 (7)15/15
1komma2mir brockhoff noiseless 7.3 (3)14 (24)12 (11)12 (8)11 (10)11 (11)10 (2)15/15
1komma2mirser brockhoff noiseless 13 (6)12 (5)11 (4)10 (3)10 (9)9.2 (6)8.8 (2)15/15
1komma2ser brockhoff noiseless 16 (3)51 (71)40 (36)37 (27)34 (32)33 (32)31 (22)15/15
1komma4 brockhoff noiseless 8.9 (8)14 (11)11 (6)10 (6)9.4 (5)9.0 (7)8.6 (4)15/15
1komma4mir brockhoff noiseless 5.2 (5)9.5 (8)8.2 (5)7.7 (5)7.2 (5)7.0 (2)6.7 (4)15/15
1komma4mirser brockhoff noiseless 5.4 (5)10 (12)7.7 (9)6.8 (4)6.4 (5)6.0 (4)5.8 (4)15/15
1komma4ser brockhoff noiseless 5.6 (5)11 (13)9.2 (4)8.3 (4)7.7 (5)7.3 (6)6.9 (4)15/15
1plus1 brockhoff noiseless 3.3 (1)13 (28)9.0 (16)7.8 (12)7.2 (7)6.8 (12)6.4 (0.2)15/15
1plus2mirser brockhoff noiseless 4.5 (5)6.2 (3)5.0 (3)4.5 (2)4.2 (1.0)4.0 (2)3.9 (2)15/15
ABC elabd noiseless 14 (9)69 (78)699 (1120)3994 (4536)5e50/15
AVGNEWUOA ros noiseless 2.4 (1.0)3.1 (3)2.1 (2)1.8 (0.9)★21.7 (1)★21.6 (1)★31.5 (0.7)★315/15
CMAEGS finck noiseless 47 (85)79 (39)56 (85)50 (15)45 (23)46 (62)45 (53)15/15
DE-F-AUC fialho noiseless 24 (10)18 (3)16 (3)16 (3)16 (4)16 (3)17 (2)15/15
DEuniform fialho noiseless 30 (6)23 (3)21 (3)22 (4)22 (6)22 (5)22 (4)15/15
IPOP-ACTCMA-ES ros noiseless 5.4 (1)6.2 (2)5.7 (1)5.3 (0.8)5.0 (1)5.0 (0.6)4.9 (1)15/15
IPOP-CMA-ES ros noiseless 5.9 (0.8)11 (10)8.7 (6)7.9 (3)7.5 (1)7.4 (0.8)7.2 (4)15/15
MOS torre noiseless 13 (1)10 (4)17 (20)18 (2)17 (0.7)17 (11)17 (10)15/15
NBC-CMA preuss noiseless 15 (1)11 (3)11 (1)10 (1.0)10 (0.9)10 (0.8)9.5 (0.5)15/15
PM-AdapSS-DE fialho noiseless 25 (11)22 (10)21 (6)22 (6)21 (7)21 (6)22 (4)15/15
RCGA tran noiseless 40 (29)8950 (5697)2e50/15
SPSA finck noiseless 1.3e4 (9251)5.7e4 (3e4)5e50/15
oPOEMS kubalic noiseless 107 (54)116 (20)176 (31)617 (552)1041 (327)1858 (469)2809 (1658)11/15
pPOEMS kubalic noiseless 284 (225)563 (166)596 (93)631 (105)723 (100)996 (117)1200 (108)15/15

Δ fopt
f10, 5-D
1e1
349
1e0
500
1e-1
574
1e-2
607
1e-3
626
1e-5
829
1e-7
880
#succ
15/15
1komma2 brockhoff noiseless 16 (2)12 (2)11 (3)10 (2)10 (2)8.2 (2)8.0 (2)15/15
1komma2mir brockhoff noiseless 9.4 (3)7.6 (1.0)6.8 (0.9)6.6 (0.9)6.5 (0.7)5.1 (0.5)5.0 (0.5)15/15
1komma2mirser brockhoff noiseless 7.4 (2)5.8 (1)5.4 (1)5.2 (0.7)5.2 (0.7)4.1 (0.4)4.0 (0.4)15/15
1komma2ser brockhoff noiseless 19 (5)14 (4)13 (3)13 (4)13 (4)10 (3)10 (3)15/15
1komma4 brockhoff noiseless 5.0 (2)4.1 (2)3.9 (0.7)3.9 (0.6)3.9 (0.5)3.1 (0.4)3.0 (0.2)15/15
1komma4mir brockhoff noiseless 4.5 (1)3.6 (0.8)3.3 (0.5)3.3 (0.4)3.4 (0.4)2.7 (0.2)2.7 (0.1)15/15
1komma4mirser brockhoff noiseless 3.1 (0.6)2.6 (0.6)2.6 (0.5)2.5 (0.3)2.5 (0.3)2.0 (0.2)2.0 (0.2)15/15
1komma4ser brockhoff noiseless 3.7 (1)3.2 (0.3)3.1 (0.7)3.1 (0.4)3.1 (0.3)2.5 (0.3)2.5 (0.2)15/15
1plus1 brockhoff noiseless 2.6 (1)2.1 (0.6)2.1 (0.2)2.0 (0.1)2.0 (0.1)1.7 (0.2)1.7 (0.1)15/15
1plus2mirser brockhoff noiseless 2.2 (0.8)1.7 (0.4)1.7 (0.2)★21.7 (0.2)★21.7 (0.2)★21.4 (0.3)★21.4 (0.2)★215/15
ABC elabd noiseless 2.1e4 (2e4)5e50/15
AVGNEWUOA ros noiseless 3.1 (3)4.6 (2)6.6 (4)8.1 (4)10 (5)11 (4)14 (5)15/15
CMAEGS finck noiseless 16 (4)12 (2)11 (1)11 (1)10 (2)8.2 (1.0)8.1 (1)15/15
DE-F-AUC fialho noiseless 4.5 (0.8)3.9 (0.3)4.0 (0.6)4.5 (0.4)4.9 (0.5)4.7 (0.4)5.3 (0.6)15/15
DEuniform fialho noiseless 4.5 (0.8)4.2 (0.3)4.6 (0.2)5.1 (0.4)5.5 (0.3)5.4 (0.2)6.2 (0.3)15/15
IPOP-ACTCMA-ES ros noiseless 2.5 (0.7)2.2 (0.2)2.1 (0.3)2.1 (0.2)2.2 (0.2)1.8 (0.3)1.9 (0.2)15/15
IPOP-CMA-ES ros noiseless 3.7 (0.7)2.9 (0.6)2.7 (0.3)2.7 (0.2)2.8 (0.2)2.3 (0.2)2.3 (0.2)15/15
MOS torre noiseless 10 (2)8.1 (9)7.6 (8)7.6 (0.5)7.7 (0.7)6.4 (0.4)6.5 (3)15/15
NBC-CMA preuss noiseless 4.6 (2)4.5 (1.0)4.4 (0.5)4.4 (0.5)4.5 (0.5)3.8 (0.3)3.8 (0.3)15/15
PM-AdapSS-DE fialho noiseless 4.6 (0.4)4.0 (0.3)4.3 (0.2)4.8 (0.3)5.3 (0.3)5.2 (0.4)5.9 (0.2)15/15
RCGA tran noiseless 3245 (8238)2e50/15
SPSA finck noiseless 5e50/15
oPOEMS kubalic noiseless 1413 (3491)4128 (3048)1.7e4 (2e4)1e60/15
pPOEMS kubalic noiseless 553 (497)639 (437)738 (170)844 (264)1002 (476)1040 (338)1238 (363)11/15

Δ fopt
f11, 5-D
1e1
143
1e0
202
1e-1
763
1e-2
977
1e-3
1177
1e-5
1467
1e-7
1673
#succ
15/15
1komma2 brockhoff noiseless 28 (11)25 (5)7.3 (1)6.0 (1)5.1 (1)4.2 (1)3.9 (0.5)15/15
1komma2mir brockhoff noiseless 24 (5)20 (4)5.6 (0.7)4.6 (0.5)3.9 (0.4)3.3 (0.2)3.0 (0.3)15/15
1komma2mirser brockhoff noiseless 19 (7)16 (3)4.8 (0.9)3.9 (0.7)3.3 (0.4)2.8 (0.3)2.6 (0.3)15/15
1komma2ser brockhoff noiseless 30 (11)28 (6)9.0 (2)7.3 (3)6.3 (2)5.3 (2)4.9 (2)15/15
1komma4 brockhoff noiseless 10 (2)10 (2)2.9 (0.5)2.3 (0.3)2.0 (0.2)1.7 (0.2)1.6 (0.2)15/15
1komma4mir brockhoff noiseless 12 (3)10 (2)2.8 (0.7)2.3 (0.4)2.0 (0.2)1.7 (0.1)1.6 (0.2)15/15
1komma4mirser brockhoff noiseless 10 (2)7.9 (2)2.2 (0.2)1.8 (0.2)1.5 (0.2)1.3 (0.1)1.2 (0.1)15/15
1komma4ser brockhoff noiseless 10 (3)8.1 (1)2.3 (0.1)1.9 (0.5)1.7 (0.3)1.4 (0.3)1.3 (0.3)15/15
1plus1 brockhoff noiseless 5.8 (4)6.9 (1)2.1 (0.2)1.8 (0.2)1.5 (0.1)1.3 (0.1)1.2 (0.1)15/15
1plus2mirser brockhoff noiseless 4.9 (2)5.2 (1)1.7 (0.3)1.4 (0.2)1.2 (0.1)1.1 (0.1)0.98 (0.1)15/15
ABC elabd noiseless 160 (292)6082 (4592)9334 (1e4)5e50/15
AVGNEWUOA ros noiseless 5.4 (3)7.2 (4)2.7 (0.7)2.6 (0.3)2.8 (0.7)3.1 (1)3.4 (1.0)15/15
CMAEGS finck noiseless 61 (12)51 (3)14 (2)11 (2)9.0 (0.4)7.4 (0.8)6.7 (0.8)15/15
DE-F-AUC fialho noiseless 6.2 (1)6.6 (0.7)2.2 (0.1)2.1 (0.3)2.0 (0.1)2.2 (0.1)2.4 (0.1)15/15
DEuniform fialho noiseless 6.2 (0.9)6.6 (0.6)2.4 (0.2)2.3 (0.3)2.4 (0.1)2.6 (0.1)2.8 (0.1)15/15
IPOP-ACTCMA-ES ros noiseless 5.6 (0.5)4.7 (0.4)1.4 (0.1)1.2 (0.1)★21.0 (0.1)★20.95 (0.0)0.92 (0.1)15/15
IPOP-CMA-ES ros noiseless 8.6 (1)7.3 (0.9)2.1 (0.2)1.8 (0.2)1.6 (0.1)1.4 (0.1)1.3 (0.1)15/15
MOS torre noiseless 18 (5)17 (2)4.9 (0.3)4.2 (0.2)3.7 (0.2)3.3 (0.2)3.2 (0.2)15/15
NBC-CMA preuss noiseless 13 (7)14 (4)4.1 (0.8)3.4 (1)3.0 (0.9)2.6 (0.7)2.4 (0.5)15/15
PM-AdapSS-DE fialho noiseless 6.3 (1)6.4 (0.8)2.3 (0.2)2.2 (0.1)2.3 (0.2)2.4 (0.1)2.7 (0.1)15/15
RCGA tran noiseless 472 (619)5461 (5055)2e50/15
SPSA finck noiseless 4.9e4 (2e4)5e50/15
oPOEMS kubalic noiseless 556 (851)917 (1352)465 (475)496 (215)571 (303)680 (540)739 (363)11/15
pPOEMS kubalic noiseless 95 (85)393 (183)204 (36)232 (37)251 (30)291 (49)341 (45)15/15

Δ fopt
f12, 5-D
1e1
108
1e0
268
1e-1
371
1e-2
413
1e-3
461
1e-5
1303
1e-7
1494
#succ
15/15
1komma2 brockhoff noiseless 33 (48)26 (31)24 (20)25 (30)24 (22)10 (9)10 (6)15/15
1komma2mir brockhoff noiseless 25 (21)16 (12)14 (12)14 (9)14 (6)6.0 (5)5.9 (2)15/15
1komma2mirser brockhoff noiseless 20 (9)15 (15)14 (10)14 (17)13 (12)5.4 (6)5.2 (4)15/15
1komma2ser brockhoff noiseless 44 (21)38 (51)45 (24)46 (21)45 (23)23 (19)23 (37)12/15
1komma4 brockhoff noiseless 14 (19)9.0 (4)8.9 (8)8.9 (2)8.6 (8)3.6 (3)3.5 (3)15/15
1komma4mir brockhoff noiseless 14 (6)10 (11)10 (3)10 (7)10 (6)4.2 (4)4.1 (4)15/15
1komma4mirser brockhoff noiseless 15 (12)10 (7)8.9 (7)8.9 (9)8.6 (8)3.5 (3)3.3 (3)15/15
1komma4ser brockhoff noiseless 10 (6)8.2 (8)8.7 (6)9.0 (4)9.0 (6)3.9 (1)3.8 (2)15/15
1plus1 brockhoff noiseless 7.8 (10)6.8 (10)6.9 (8)7.2 (8)7.0 (6)3.1 (3)3.0 (2)15/15
1plus2mirser brockhoff noiseless 6.1 (9)4.2 (6)4.0 (4)4.2 (5)4.2 (3)1.8 (0.9)1.8 (2)15/15
ABC elabd noiseless 99 (106)547 (376)5846 (9098)5e50/15
AVGNEWUOA ros noiseless 3.5 (6)2.8 (2)2.8 (3)2.9 (3)3.0 (3)1.3 (1)1.4 (1)15/15
CMAEGS finck noiseless 52 (52)35 (42)32 (45)32 (21)31 (25)40 (107)36 (11)14/15
DE-F-AUC fialho noiseless 23 (3)13 (2)13 (7)13 (5)14 (13)6.4 (5)6.6 (2)15/15
DEuniform fialho noiseless 28 (4)21 (24)21 (6)22 (27)22 (28)10 (18)11 (12)15/15
IPOP-ACTCMA-ES ros noiseless 8.8 (8)5.9 (4)5.7 (6)6.0 (3)6.0 (5)2.6 (2)2.6 (2)15/15
IPOP-CMA-ES ros noiseless 9.5 (12)6.1 (8)6.2 (6)6.4 (5)6.4 (3)2.8 (2)2.8 (2)15/15
MOS torre noiseless 25 (5)16 (8)16 (13)16 (13)16 (11)6.9 (4)6.8 (4)15/15
NBC-CMA preuss noiseless 17 (24)10 (5)12 (10)12 (7)12 (8)5.5 (4)5.5 (3)15/15
PM-AdapSS-DE fialho noiseless 24 (4)16 (19)24 (50)27 (53)27 (6)12 (20)13 (13)15/15
RCGA tran noiseless 423 (650)664 (821)1670 (1058)8906 (1e4)7986 (7457)2e50/15
SPSA finck noiseless 1.9e4 (2e4)5e50/15
oPOEMS kubalic noiseless 9468 (2e4)6507 (2808)5.7e4 (1e5)5.1e4 (4e4)4.6e4 (8e4)2e60/15
pPOEMS kubalic noiseless 2091 (564)1365 (742)1383 (1143)1554 (441)1881 (1459)1009 (617)1369 (1104)8/15

Δ fopt
f13, 5-D
1e1
132
1e0
195
1e-1
250
1e-2
319
1e-3
1310
1e-5
1752
1e-7
2255
#succ
15/15
1komma2 brockhoff noiseless 25 (17)27 (34)37 (8)65 (39)22 (14)28 (35)98 (128)1/15
1komma2mir brockhoff noiseless 9.4 (9)30 (19)34 (73)34 (29)14 (14)27 (23)37 (37)4/15
1komma2mirser brockhoff noiseless 4.6 (1)17 (39)21 (11)24 (15)14 (9)18 (26)36 (46)5/15
1komma2ser brockhoff noiseless 16 (28)32 (18)44 (56)60 (13)23 (17)46 (45)153 (89)1/15
1komma4 brockhoff noiseless 7.0 (5)10 (6)11 (7)10 (7)3.0 (1)4.2 (3)5.1 (4)15/15
1komma4mir brockhoff noiseless 6.4 (10)11 (6)10 (3)9.1 (2)2.8 (3)3.2 (3)3.9 (3)15/15
1komma4mirser brockhoff noiseless 2.9 (1)4.9 (4)7.7 (6)6.7 (3)2.5 (1)3.1 (4)3.1 (2)15/15
1komma4ser brockhoff noiseless 5.0 (4)10 (4)10 (5)8.8 (4)3.3 (3)3.1 (0.8)5.0 (3)14/15
1plus1 brockhoff noiseless 3.7 (2)7.1 (6)8.3 (6)8.0 (3)2.4 (2)2.2 (2)3.1 (2)15/15
1plus2mirser brockhoff noiseless 3.1 (4)7.9 (7)7.1 (7)6.1 (3)1.9 (1)2.0 (1)2.3 (2)15/15
ABC elabd noiseless 18 (14)187 (331)6613 (7000)5e50/15
AVGNEWUOA ros noiseless 4.5 (4)8.1 (6)42 (47)67 (67)68 (71)391 (280)5e40/15
CMAEGS finck noiseless 506 (133)1307 (4488)8010 (7001)1.0e4 (2e4)5348 (6298)5e50/15
DE-F-AUC fialho noiseless 10 (1)11 (1)11 (0.8)11 (0.9)3.2 (0.2)3.2 (0.2)3.1 (0.2)15/15
DEuniform fialho noiseless 11 (0.9)12 (0.8)13 (0.5)13 (1.0)3.7 (0.1)3.8 (0.1)3.7 (0.1)15/15
IPOP-ACTCMA-ES ros noiseless 3.0 (1)4.1 (2)4.2 (1.0)4.0 (0.7)1.2 (0.1)1.2 (0.1)1.1 (0.1)15/15
IPOP-CMA-ES ros noiseless 3.2 (2)4.9 (3)5.3 (3)5.1 (2)1.4 (0.6)1.6 (0.3)1.6 (0.3)15/15
MOS torre noiseless 11 (2)12 (2)13 (2)13 (1)3.5 (0.3)3.4 (0.3)3.2 (0.3)15/15
NBC-CMA preuss noiseless 6.2 (3)7.5 (4)9.3 (3)9.3 (2)2.6 (0.4)2.7 (0.3)2.6 (0.2)15/15
PM-AdapSS-DE fialho noiseless 10 (1)11 (0.7)12 (0.9)12 (0.4)3.4 (0.1)3.5 (0.1)3.4 (0.1)15/15
RCGA tran noiseless 282 (216)1072 (1384)6910 (1e4)1.2e4 (2e4)2e50/15
SPSA finck noiseless 2058 (3069)5e50/15
oPOEMS kubalic noiseless 905 (30)2906 (9623)9132 (2e4)1.9e4 (3e4)1.6e4 (1e4)2e60/15
pPOEMS kubalic noiseless 447 (137)792 (174)1066 (161)1221 (208)390 (62)1316 (1220)9954 (5820)0/15

Δ fopt
f14, 5-D
1e1
10
1e0
41
1e-1
58
1e-2
90
1e-3
139
1e-5
251
1e-7
476
#succ
15/15
1komma2 brockhoff noiseless 2.2 (4)4.9 (4)5.9 (3)6.2 (3)8.3 (4)13 (4)13 (3)15/15
1komma2mir brockhoff noiseless 4.2 (4)3.5 (1)3.9 (0.7)4.3 (2)5.8 (2)11 (2)9.3 (2)15/15
1komma2mirser brockhoff noiseless 3.1 (3)3.2 (2)3.3 (1)3.6 (1)4.8 (2)9.2 (2)8.1 (0.8)15/15
1komma2ser brockhoff noiseless 3.4 (4)6.3 (2)6.4 (2)6.3 (3)11 (6)17 (3)16 (2)15/15
1komma4 brockhoff noiseless 1.6 (2)1.9 (1)3.1 (0.5)3.2 (0.4)4.2 (1)6.8 (1)5.4 (1)15/15
1komma4mir brockhoff noiseless 2.3 (1)2.1 (0.5)2.9 (0.5)3.3 (1)3.9 (1)6.1 (0.8)5.3 (0.5)15/15
1komma4mirser brockhoff noiseless 1.7 (0.8)1.8 (1)2.3 (0.7)2.3 (0.5)2.9 (1)4.5 (0.7)4.0 (0.5)15/15
1komma4ser brockhoff noiseless 1.9 (2)2.0 (2)2.5 (1)3.0 (0.9)3.8 (0.8)5.2 (1)4.6 (0.8)15/15
1plus1 brockhoff noiseless 1.2 (2)1.8 (0.5)2.3 (0.7)2.5 (0.3)2.7 (0.6)4.1 (0.9)3.3 (0.5)15/15
1plus2mirser brockhoff noiseless 0.81 (0.9)1.4 (1)1.7 (0.6)2.0 (0.5)2.7 (0.6)3.2 (0.8)2.7 (0.3)15/15
ABC elabd noiseless 3.4 (5)11 (7)19 (5)29 (9)677 (950)5e50/15
AVGNEWUOA ros noiseless 2.0 (0.7)1.0 (0.3)1.0 (0.1)★41.0 (0.2)★41.2 (0.3)★45.0 (1)1028 (1856)0/15
CMAEGS finck noiseless 14 (16)7.2 (5)7.5 (3)8.8 (5)16 (6)27 (6)203 (788)11/15
DE-F-AUC fialho noiseless 2.2 (4)9.4 (4)15 (2)15 (1)13 (2)11 (1)8.2 (0.4)15/15
DEuniform fialho noiseless 2.2 (2)10 (3)16 (5)18 (1)15 (1)13 (0.6)9.3 (0.6)15/15
IPOP-ACTCMA-ES ros noiseless 1.5 (0.9)2.2 (1)3.2 (0.7)3.6 (0.8)3.6 (0.3)3.8 (0.4)2.9 (0.2)15/15
IPOP-CMA-ES ros noiseless 2.1 (2)2.9 (3)3.8 (2)4.3 (1)4.7 (0.9)5.5 (0.5)4.4 (0.5)15/15
MOS torre noiseless 2.9 (2)13 (6)15 (5)15 (2)14 (3)15 (1)11 (1)15/15
NBC-CMA preuss noiseless 1.4 (0.5)7.0 (3)8.7 (1)8.1 (1)7.4 (0.7)7.8 (0.8)6.4 (0.2)15/15
PM-AdapSS-DE fialho noiseless 0.98 (0.5)9.4 (6)17 (2)17 (2)15 (1)12 (0.7)8.9 (0.7)15/15
RCGA tran noiseless 1.5 (2)23 (22)40 (22)59 (49)272 (217)1.5e4 (9213)2e50/15
SPSA finck noiseless 164 (362)106 (170)86 (78)69 (30)98 (69)2144 (3929)5e50/15
oPOEMS kubalic noiseless 109 (18)43 (12)79 (40)124 (34)135 (12)502 (725)2e60/15
pPOEMS kubalic noiseless 60 (58)47 (15)140 (121)596 (183)795 (241)1059 (190)2133 (1699)3/15

Δ fopt
f15, 5-D
1e1
511
1e0
9310
1e-1
19369
1e-2
19743
1e-3
20073
1e-5
20769
1e-7
21359
#succ
14/15
1komma2 brockhoff noiseless 27 (23)76 (114)5e40/15
1komma2mir brockhoff noiseless 8.1 (10)26 (24)5e40/15
1komma2mirser brockhoff noiseless 11 (18)25 (27)5e40/15
1komma2ser brockhoff noiseless 129 (191)5e40/15
1komma4 brockhoff noiseless 8.2 (9)38 (50)5e40/15
1komma4mir brockhoff noiseless 3.6 (4)18 (12)5e40/15
1komma4mirser brockhoff noiseless 2.8 (3)13 (16)38 (54)37 (59)36 (75)35 (26)34 (24)1/15
1komma4ser brockhoff noiseless 8.5 (10)40 (58)5e40/15
1plus1 brockhoff noiseless 6.1 (12)5e40/15
1plus2mirser brockhoff noiseless 4.6 (5)38 (48)5e40/15
ABC elabd noiseless 15 (50)243 (379)5e50/15
AVGNEWUOA ros noiseless 5.8 (6)46 (36)3e40/15
CMAEGS finck noiseless 8.6 (4)95 (64)185 (271)366 (222)361 (193)5e50/15
DE-F-AUC fialho noiseless 5.4 (3)2.0 (0.7)7.5 (7)7.4 (25)7.3 (19)7.1 (18)6.9 (6)12/15
DEuniform fialho noiseless 4.8 (4)2.2 (0.3)3.0 (0.2)3.0 (6)3.0 (6)2.9 (6)2.9 (0.1)14/15
IPOP-ACTCMA-ES ros noiseless 1.5 (0.4)0.89 (0.3)1.0 (1.0)1.0 (0.7)1.0 (0.6)1.0 (0.6)1.0 (0.5)15/15
IPOP-CMA-ES ros noiseless 2.3 (3)1.3 (0.6)1.2 (1)1.2 (0.7)1.2 (1)1.2 (1)1.2 (1)15/15
MOS torre noiseless 4.3 (2)1.4 (1)1.6 (0.9)1.6 (1)1.6 (1)1.6 (1)1.6 (1)15/15
NBC-CMA preuss noiseless 2.3 (0.6)4.3 (4)16 (17)16 (12)15 (10)15 (10)14 (12)10/15
PM-AdapSS-DE fialho noiseless 5.4 (3)6.3 (16)3.2 (8)3.2 (3)3.2 (0.2)7.6 (0.1)7.4 (19)12/15
RCGA tran noiseless 25 (41)9.4 (3)12 (10)12 (9)12 (9)15 (9)20 (44)4/15
SPSA finck noiseless 2250 (2427)5e50/15
oPOEMS kubalic noiseless 18 (7)232 (270)335 (639)329 (361)324 (302)314 (300)305 (419)3/15
pPOEMS kubalic noiseless 57 (33)29 (7)60 (116)61 (20)62 (94)64 (55)66 (176)9/15

Δ fopt
f16, 5-D
1e1
120
1e0
612
1e-1
2662
1e-2
10163
1e-3
10449
1e-5
11644
1e-7
12095
#succ
15/15
1komma2 brockhoff noiseless 42 (28)259 (261)5e40/15
1komma2mir brockhoff noiseless 16 (18)29 (23)45 (47)70 (65)69 (96)62 (131)5e40/15
1komma2mirser brockhoff noiseless 15 (32)43 (66)38 (27)36 (39)5e40/15
1komma2ser brockhoff noiseless 58 (43)589 (370)5e40/15
1komma4 brockhoff noiseless 7.3 (13)27 (18)31 (54)34 (12)5e40/15
1komma4mir brockhoff noiseless 2.9 (5)5.8 (8)12 (15)6.1 (9)11 (17)5e40/15
1komma4mirser brockhoff noiseless 5.6 (7)16 (25)19 (19)15 (12)33 (59)5e40/15
1komma4ser brockhoff noiseless 8.2 (10)20 (22)33 (30)72 (50)5e40/15
1plus1 brockhoff noiseless 2.0 (5)21 (17)19 (22)33 (36)5e40/15
1plus2mirser brockhoff noiseless 1.7 (2)7.7 (4)16 (17)5e40/15
ABC elabd noiseless 2.3 (1)10 (10)95 (110)5e50/15
AVGNEWUOA ros noiseless 2.6 (2)12 (13)47 (40)4e40/15
CMAEGS finck noiseless 7.8 (32)179 (466)409 (482)324 (373)671 (587)5e50/15
DE-F-AUC fialho noiseless 6.4 (5)39 (39)31 (4)8.2 (1)12 (13)11 (12)10 (31)13/15
DEuniform fialho noiseless 4.3 (2)44 (30)20 (6)13 (26)17 (37)16 (22)15 (21)12/15
IPOP-ACTCMA-ES ros noiseless 3.9 (3)2.4 (2)1.7 (2)0.56 (0.3)0.82 (1)0.84 (0.6)0.85 (0.6)15/15
IPOP-CMA-ES ros noiseless 2.5 (2)2.3 (2)1.7 (1)0.55 (0.6)0.96 (0.6)0.94 (1)0.95 (1)15/15
MOS torre noiseless 1.6 (1)2.9 (1)2.6 (3)1.2 (0.9)1.2 (0.0)7.7 (0.8)7.7 (27)15/15
NBC-CMA preuss noiseless 3.0 (2)4.0 (3)1.3 (2)0.81 (2)0.86 (0.4)0.83 (2)0.83 (1)15/15
PM-AdapSS-DE fialho noiseless 3.9 (3)124 (284)55 (99)16 (25)20 (20)28 (53)27 (22)11/15
RCGA tran noiseless 2.4 (3)60 (59)49 (60)80 (51)351 (311)2e50/15
SPSA finck noiseless 550 (364)1367 (1242)594 (423)349 (506)695 (1292)5e50/15
oPOEMS kubalic noiseless 11 (6)14 (3)92 (282)56 (74)74 (72)68 (129)66 (62)9/15
pPOEMS kubalic noiseless 10 (6)52 (39)40 (17)53 (73)116 (108)113 (99)116 (126)9/15

Δ fopt
f17, 5-D
1e1
5.0
1e0
215
1e-1
899
1e-2
2861
1e-3
3669
1e-5
6351
1e-7
7934
#succ
15/15
1komma2 brockhoff noiseless 55 (178)54 (76)404 (363)5e40/15
1komma2mir brockhoff noiseless 6.9 (5)5.3 (10)6.2 (11)13 (8)64 (45)5e40/15
1komma2mirser brockhoff noiseless 5.5 (5)5.0 (10)13 (21)22 (16)5e40/15
1komma2ser brockhoff noiseless 55 (17)87 (69)397 (687)5e40/15
1komma4 brockhoff noiseless 120 (13)20 (8)18 (25)31 (37)5e40/15
1komma4mir brockhoff noiseless 21 (3)2.3 (4)4.1 (7)7.2 (15)90 (116)5e40/15
1komma4mirser brockhoff noiseless 5.3 (18)0.71 (0.8)4.5 (2)28 (28)5e40/15
1komma4ser brockhoff noiseless 4.3 (5)3.6 (3)19 (29)54 (88)5e40/15
1plus1 brockhoff noiseless 16 (9)25 (46)94 (115)5e40/15
1plus2mirser brockhoff noiseless 16 (47)17 (20)24 (19)5e40/15
ABC elabd noiseless 6.8 (8)15 (15)64 (38)1259 (1966)5e50/15
AVGNEWUOA ros noiseless 3.3 (3)42 (33)405 (410)6e40/15
CMAEGS finck noiseless 18 (14)3.3 (0.9)2.5 (2)40 (134)62 (133)1104 (2835)5e50/15
DE-F-AUC fialho noiseless 5.9 (3)3.8 (0.6)2.3 (0.4)1.2 (0.2)1.3 (0.1)1.3 (0.1)1.4 (0.1)15/15
DEuniform fialho noiseless 3.9 (6)4.3 (1.0)2.7 (0.2)1.4 (0.1)1.6 (0.1)1.5 (0.1)1.6 (0.0)15/15
IPOP-ACTCMA-ES ros noiseless 4.4 (4)0.89 (0.3)0.53 (0.1)0.59 (0.6)0.77 (0.5)1.00 (0.7)1.1 (0.5)15/15
IPOP-CMA-ES ros noiseless 5.0 (2)1.1 (0.5)0.97 (0.8)0.61 (0.5)0.77 (0.8)0.81 (0.5)1.0 (0.5)15/15
MOS torre noiseless 2.9 (3)5.8 (3)5.2 (9)3.9 (5)5.4 (16)3.9 (7)4.0 (0.9)15/15
NBC-CMA preuss noiseless 5.9 (3)2.2 (0.6)1.9 (2)0.74 (1)0.68 (0.9)1.6 (1)3.3 (2)15/15
PM-AdapSS-DE fialho noiseless 4.3 (10)4.0 (0.8)2.3 (0.2)1.2 (0.1)1.4 (0.1)1.3 (0.1)1.4 (0.0)15/15
RCGA tran noiseless 3.0 (2)56 (53)48 (30)35 (10)56 (38)173 (122)2e50/15
SPSA finck noiseless 5.1e4 (7e4)2096 (3501)2229 (1808)2447 (2578)5e50/15
oPOEMS kubalic noiseless 230 (187)17 (8)15 (3)8.2 (0.8)14 (0.7)98 (295)139 (378)9/15
pPOEMS kubalic noiseless 176 (144)22 (15)88 (15)57 (10)71 (6)73 (6)82 (9)15/15

Δ fopt
f18, 5-D
1e1
103
1e0
378
1e-1
3968
1e-2
8451
1e-3
9280
1e-5
10905
1e-7
12469
#succ
15/15
1komma2 brockhoff noiseless 36 (74)200 (196)5e40/15
1komma2mir brockhoff noiseless 3.7 (1)28 (50)23 (29)5e40/15
1komma2mirser brockhoff noiseless 8.2 (22)27 (63)21 (10)83 (90)5e40/15
1komma2ser brockhoff noiseless 29 (52)600 (785)5e40/15
1komma4 brockhoff noiseless 3.0 (1)31 (40)21 (50)84 (52)5e40/15
1komma4mir brockhoff noiseless 1.9 (4)5.9 (6)9.2 (10)19 (14)5e40/15
1komma4mirser brockhoff noiseless 3.1 (12)18 (35)6.4 (13)84 (143)5e40/15
1komma4ser brockhoff noiseless 8.8 (15)35 (17)20 (27)5e40/15
1plus1 brockhoff noiseless 8.6 (14)51 (67)87 (72)5e40/15
1plus2mirser brockhoff noiseless 16 (16)48 (41)33 (26)85 (104)5e40/15
ABC elabd noiseless 5.1 (3)27 (30)300 (340)5e50/15
AVGNEWUOA ros noiseless 10 (8)272 (508)2e50/15
CMAEGS finck noiseless 2.2 (0.9)7.2 (17)25 (64)122 (104)5e50/15
DE-F-AUC fialho noiseless 4.3 (1)3.8 (0.4)0.75 (0.1)0.55 (0.1)0.69 (0.1)0.88 (0.0)0.98 (0.1)15/15
DEuniform fialho noiseless 4.0 (3)4.3 (0.4)0.81 (0.1)0.58 (0.1)0.73 (0.1)0.95 (0.0)1.1 (0.0)15/15
IPOP-ACTCMA-ES ros noiseless 3.5 (0.6)1.6 (3)0.70 (1.0)0.69 (0.4)0.77 (0.4)0.80 (0.3)0.84 (0.1)15/15
IPOP-CMA-ES ros noiseless 1.2 (0.6)2.7 (0.2)0.87 (0.6)1.1 (0.4)1.0 (0.4)1.0 (0.3)0.99 (0.2)15/15
MOS torre noiseless 4.9 (3)6.7 (6)2.9 (1)1.7 (2)1.7 (1)1.6 (2)2.0 (1)15/15
NBC-CMA preuss noiseless 3.1 (1.0)3.0 (0.6)0.41 (0.0)0.48 (0.5)1.2 (1)6.2 (15)15 (20)10/15
PM-AdapSS-DE fialho noiseless 4.3 (1)4.1 (0.7)0.76 (0.0)0.54 (0.1)0.67 (0.1)0.89 (0.1)1.0 (0.1)15/15
RCGA tran noiseless 7.9 (11)88 (79)23 (9)35 (24)187 (277)2e50/15
SPSA finck noiseless 2.0e4 (2e4)1.9e4 (1e4)5e50/15
oPOEMS kubalic noiseless 19 (10)23 (9)33 (189)207 (267)449 (647)2e60/15
pPOEMS kubalic noiseless 18 (5)94 (44)34 (10)30 (3)39 (5)55 (5)69 (11)15/15

Δ fopt
f19, 5-D
1e1
1
1e0
1
1e-1
242
1e-2
1.0e5
1e-3
1.2e5
1e-5
1.2e5
1e-7
1.2e5
#succ
15/15
1komma2 brockhoff noiseless 31 (28)1.6e4 (3e4)5e40/15
1komma2mir brockhoff noiseless 62 (38)4556 (3027)946 (827)5e40/15
1komma2mirser brockhoff noiseless 22 (16)8527 (3e4)1394 (952)5e40/15
1komma2ser brockhoff noiseless 55 (108)2.5e4 (3e4)5e40/15
1komma4 brockhoff noiseless 21 (23)6463 (3e4)5e40/15
1komma4mir brockhoff noiseless 20 (19)8960 (5504)659 (780)5e40/15
1komma4mirser brockhoff noiseless 17 (14)3093 (1626)479 (643)7.0 (7)6.1 (7)6.0 (4)6.0 (5)1/15
1komma4ser brockhoff noiseless 25 (17)1.0e4 (2e4)5e40/15
1plus1 brockhoff noiseless 13 (13)5123 (1315)1483 (1419)5e40/15
1plus2mirser brockhoff noiseless 17 (12)6018 (5555)233 (273)5e40/15
ABC elabd noiseless 34 (46)2898 (1987)3826 (5084)69 (72)5e50/15
AVGNEWUOA ros noiseless 24 (3)1.6e4 (6e4)996 (898)5e50/15
CMAEGS finck noiseless 97 (50)5695 (7352)2018 (1286)33 (31)5e50/15
DE-F-AUC fialho noiseless 29 (14)2586 (2337)1728 (2430)10 (14)11 (13)11 (9)10 (7)5/15
DEuniform fialho noiseless 35 (26)3449 (1425)1632 (1653)15 (18)13 (8)13 (19)13 (19)4/15
IPOP-ACTCMA-ES ros noiseless 14 (10)1207 (606)124 (100)0.84 (0.8)0.95 (0.9)0.96 (0.8)0.96 (1.0)15/15
IPOP-CMA-ES ros noiseless 21 (24)1720 (2792)125 (74)1.2 (0.5)1.1 (0.7)1.1 (0.7)1.1 (0.6)15/15
MOS torre noiseless 27 (19)658 (122)108 (326)3.9 (4)4.8 (8)4.8 (4)4.8 (8)9/15
NBC-CMA preuss noiseless 39 (42)2946 (2348)2143 (3585)40 (59)35 (17)35 (74)35 (19)1/15
PM-AdapSS-DE fialho noiseless 37 (64)2000 (3018)2056 (2379)22 (31)19 (25)19 (25)29 (15)1/15
RCGA tran noiseless 33 (27)1019 (398)464 (383)2e50/15
SPSA finck noiseless 422 (616)2.1e5 (3e5)2.9e4 (4e4)5e50/15
oPOEMS kubalic noiseless 1047 (105)3.1e4 (1e5)1.1e4 (1e4)98 (172)87 (56)86 (172)86 (124)2/15
pPOEMS kubalic noiseless 982 (363)1.8e4 (2e4)1647 (3270)12 (11)27 (44)27 (19)27 (22)5/15

Δ fopt
f20, 5-D
1e1
16
1e0
851
1e-1
38111
1e-2
51362
1e-3
54470
1e-5
54861
1e-7
55313
#succ
14/15
1komma2 brockhoff noiseless 4.7 (5)19 (13)5e40/15
1komma2mir brockhoff noiseless 4.5 (3)11 (15)5e40/15
1komma2mirser brockhoff noiseless 4.7 (2)9.3 (13)18 (21)14 (12)13 (19)13 (15)13 (20)1/15
1komma2ser brockhoff noiseless 8.9 (6)14 (10)5e40/15
1komma4 brockhoff noiseless 3.3 (2)10 (17)9.4 (12)7.0 (9)6.6 (5)6.6 (9)6.5 (5)2/15
1komma4mir brockhoff noiseless 2.8 (1)6.9 (7)5e40/15
1komma4mirser brockhoff noiseless 2.6 (1)7.6 (9)5e40/15
1komma4ser brockhoff noiseless 2.8 (1)6.8 (6)5e40/15
1plus1 brockhoff noiseless 2.8 (2)10 (10)19 (33)14 (9)13 (9)13 (23)13 (6)1/15
1plus2mirser brockhoff noiseless 2.6 (1)5.4 (5)19 (18)14 (15)13 (16)13 (10)13 (12)1/15
ABC elabd noiseless 7.2 (3)1.5 (1)0.55 (0.5)0.48 (0.4)0.58 (0.4)1.5 (1)2.6 (3)15/15
AVGNEWUOA ros noiseless 1 (0)8.4 (9)12 (8)8.6 (9)8.2 (7)8.1 (4)8.0 (10)1/15
CMAEGS finck noiseless 9.2 (5)869 (1089)5e50/15
DE-F-AUC fialho noiseless 6.8 (4)7.6 (6)6.9 (10)5.1 (10)4.9 (9)4.8 (11)4.8 (9)10/15
DEuniform fialho noiseless 11 (7)10 (8)9.2 (16)6.8 (5)6.4 (12)6.4 (5)6.4 (5)9/15
IPOP-ACTCMA-ES ros noiseless 3.9 (2)10 (7)1.4 (2)1.1 (1.0)1.1 (0.8)1.1 (0.8)1.1 (0.9)15/15
IPOP-CMA-ES ros noiseless 3.9 (2)11 (5)1.4 (0.8)1.1 (0.7)1.1 (0.6)1.1 (1.0)1.1 (0.6)15/15
MOS torre noiseless 10 (6)2.7 (1)0.43 (0.2)0.49 (0.3)0.55 (0.2)1.0 (2)1.1 (0.6)15/15
NBC-CMA preuss noiseless 7.9 (1)5.0 (4)25 (30)19 (11)18 (22)18 (25)17 (23)4/15
PM-AdapSS-DE fialho noiseless 11 (6)14 (20)9.4 (7)7.0 (7)6.6 (14)6.6 (7)6.6 (9)8/15
RCGA tran noiseless 8.7 (7)439 (351)95 (57)2e50/15
SPSA finck noiseless 25 (22)5e50/15
oPOEMS kubalic noiseless 84 (7)8.4 (6)30 (21)22 (15)21 (38)21 (28)21 (15)9/15
pPOEMS kubalic noiseless 81 (14)17 (6)17 (30)13 (29)13 (7)14 (27)15 (27)11/15

Δ fopt
f21, 5-D
1e1
41
1e0
1157
1e-1
1674
1e-2
1692
1e-3
1705
1e-5
1729
1e-7
1757
#succ
14/15
1komma2 brockhoff noiseless 6.9 (13)8.6 (10)13 (9)13 (23)13 (13)12 (15)12 (16)14/15
1komma2mir brockhoff noiseless 5.7 (8)5.8 (4)9.0 (9)9.0 (15)8.9 (16)8.9 (21)8.8 (10)13/15
1komma2mirser brockhoff noiseless 2.4 (2)5.0 (4)10 (8)9.4 (8)9.4 (9)9.3 (9)9.2 (5)15/15
1komma2ser brockhoff noiseless 24 (22)14 (9)23 (22)23 (30)23 (27)23 (22)22 (25)11/15
1komma4 brockhoff noiseless 5.7 (14)2.9 (3)6.9 (12)6.8 (6)6.8 (13)6.8 (6)6.7 (4)14/15
1komma4mir brockhoff noiseless 3.5 (2)3.4 (4)6.1 (2)6.1 (11)6.1 (6)6.0 (2)6.0 (12)15/15
1komma4mirser brockhoff noiseless 1.2 (1)1.7 (1)3.1 (4)3.1 (5)3.1 (4)3.1 (3)3.1 (4)15/15
1komma4ser brockhoff noiseless 5.1 (1.0)4.3 (9)5.3 (8)5.3 (6)5.3 (6)5.2 (8)5.2 (6)15/15
1plus1 brockhoff noiseless 2.7 (6)3.4 (4)5.6 (9)5.5 (8)5.5 (7)5.5 (6)5.4 (6)15/15
1plus2mirser brockhoff noiseless 7.6 (23)3.8 (7)7.5 (9)7.4 (14)7.4 (9)7.3 (10)7.2 (10)14/15
ABC elabd noiseless 3.2 (2)1.8 (1)6.7 (10)10 (17)13 (12)84 (109)265 (254)8/15
AVGNEWUOA ros noiseless 1.7 (2)2.5 (3)3.6 (2)3.5 (4)3.5 (4)3.5 (5)3.5 (4)15/15
CMAEGS finck noiseless 3.4 (3)114 (210)217 (446)267 (582)287 (237)374 (832)458 (649)6/15
DE-F-AUC fialho noiseless 5.2 (8)1.7 (0.8)110 (75)109 (296)109 (74)107 (289)106 (356)11/15
DEuniform fialho noiseless 4.5 (4)33 (109)76 (0.6)76 (148)75 (147)74 (145)74 (72)12/15
IPOP-ACTCMA-ES ros noiseless 3.5 (0.8)7.3 (11)32 (36)33 (40)33 (25)33 (130)33 (63)14/15
IPOP-CMA-ES ros noiseless 6.3 (10)5.6 (6)30 (16)30 (109)31 (106)31 (73)31 (114)14/15
MOS torre noiseless 4.6 (4)69 (113)280 (694)478 (1176)485 (1751)483 (565)527 (1022)13/15
NBC-CMA preuss noiseless 2.5 (2)96 (283)119 (224)118 (337)117 (111)115 (157)114 (207)10/15
PM-AdapSS-DE fialho noiseless 4.0 (5)33 (109)201 (299)199 (887)198 (367)195 (506)192 (356)9/15
RCGA tran noiseless 2.5 (2)84 (71)105 (170)129 (177)129 (156)135 (221)140 (256)9/15
SPSA finck noiseless 34 (25)299 (423)1986 (4257)1967 (2681)1958 (1687)4055 (3399)3995 (4625)1/15
oPOEMS kubalic noiseless 25 (7)744 (1298)1429 (2587)1415 (1773)1405 (1644)1389 (6062)1370 (1707)6/15
pPOEMS kubalic noiseless 28 (17)11 (18)214 (675)238 (883)243 (447)263 (435)283 (431)12/15

Δ fopt
f22, 5-D
1e1
71
1e0
386
1e-1
938
1e-2
980
1e-3
1008
1e-5
1040
1e-7
1068
#succ
14/15
1komma2 brockhoff noiseless 18 (36)31 (21)31 (15)30 (37)30 (30)29 (30)29 (33)12/15
1komma2mir brockhoff noiseless 10 (9)11 (12)20 (30)19 (14)19 (31)18 (20)18 (14)14/15
1komma2mirser brockhoff noiseless 15 (7)21 (20)51 (101)49 (52)48 (79)47 (44)46 (39)9/15
1komma2ser brockhoff noiseless 23 (29)32 (17)49 (63)47 (51)46 (51)45 (66)44 (101)9/15
1komma4 brockhoff noiseless 6.9 (12)13 (17)16 (23)16 (35)15 (34)15 (20)15 (10)14/15
1komma4mir brockhoff noiseless 12 (21)10 (9)12 (17)12 (9)12 (11)12 (5)11 (31)14/15
1komma4mirser brockhoff noiseless 10 (32)12 (10)15 (13)15 (13)14 (16)14 (16)14 (11)15/15
1komma4ser brockhoff noiseless 16 (18)18 (24)12 (7)11 (9)11 (9)11 (8)11 (5)15/15
1plus1 brockhoff noiseless 3.7 (7)8.0 (9)8.5 (15)8.2 (14)8.0 (8)7.9 (8)7.8 (16)15/15
1plus2mirser brockhoff noiseless 3.1 (6)6.5 (5)4.9 (7)4.7 (3)4.6 (5)4.6 (5)4.5 (5)15/15
ABC elabd noiseless 5.1 (4)7.6 (5)35 (65)237 (395)374 (670)3312 (3198)6897 (8194)0/15
AVGNEWUOA ros noiseless 3.4 (13)2.6 (3)2.3 (2)2.3 (2)2.3 (2)2.4 (2)2.4 (2)15/15
CMAEGS finck noiseless 58 (200)337 (1135)1482 (1466)1421 (2564)1384 (3236)1933 (5173)1884 (1990)3/15
DE-F-AUC fialho noiseless 4.8 (4)203 (324)802 (667)768 (1276)747 (1241)725 (842)706 (937)6/15
DEuniform fialho noiseless 6.6 (4)203 (649)469 (1466)450 (638)438 (497)425 (722)414 (702)8/15
IPOP-ACTCMA-ES ros noiseless 8.8 (11)21 (22)65 (44)276 (100)270 (489)263 (489)256 (275)9/15
IPOP-CMA-ES ros noiseless 12 (18)48 (127)165 (295)165 (303)161 (115)158 (254)155 (296)11/15
MOS torre noiseless 3.7 (4)24 (19)299 (749)483 (1362)557 (851)550 (909)541 (1269)15/15
NBC-CMA preuss noiseless 3.0 (2)264 (444)288 (163)360 (625)350 (374)339 (586)330 (361)7/15
PM-AdapSS-DE fialho noiseless 4.1 (3)4.6 (1)469 (1333)449 (511)437 (744)424 (481)414 (586)8/15
RCGA tran noiseless 6.2 (19)154 (44)365 (361)857 (802)1697 (1612)1706 (2004)3409 (2399)0/15
SPSA finck noiseless 676 (324)1319 (1757)7821 (6798)5e50/15
oPOEMS kubalic noiseless 1137 (20)2349 (4859)2592 (3198)2485 (2296)2417 (2604)2349 (2886)2290 (2559)6/15
pPOEMS kubalic noiseless 29 (12)25 (25)268 (810)276 (768)284 (389)326 (733)362 (22)13/15

Δ fopt
f23, 5-D
1e1
3.0
1e0
518
1e-1
14249
1e-2
27890
1e-3
31654
1e-5
33030
1e-7
34256
#succ
15/15
1komma2 brockhoff noiseless 2.8 (5)101 (84)5e40/15
1komma2mir brockhoff noiseless 15 (36)37 (58)16 (20)13 (19)23 (28)22 (9)21 (20)0/15
1komma2mirser brockhoff noiseless 6.4 (12)23 (18)9.5 (9)26 (33)5e40/15
1komma2ser brockhoff noiseless 3.1 (2)105 (135)5e40/15
1komma4 brockhoff noiseless 5.7 (7)28 (13)7.0 (4)12 (17)11 (12)22 (30)21 (17)1/15
1komma4mir brockhoff noiseless 3.8 (4)12 (11)4.2 (4)5e40/15
1komma4mirser brockhoff noiseless 2.2 (2)8.8 (4)24 (27)25 (22)5e40/15
1komma4ser brockhoff noiseless 3.0 (4)23 (22)51 (68)5e40/15
1plus1 brockhoff noiseless 5.0 (3)5.4 (6)5.5 (3)12 (20)5e40/15
1plus2mirser brockhoff noiseless 4.7 (7)1.3 (2)9.3 (8)5e40/15
ABC elabd noiseless 2.2 (2)19 (24)5e50/15
AVGNEWUOA ros noiseless 6.0 (7)2.5 (4)14 (10)5e40/15
CMAEGS finck noiseless 15 (9)33 (21)5e50/15
DE-F-AUC fialho noiseless 2.4 (1)9.3 (3)2.3 (0.5)2.5 (0.3)3.4 (0.2)5.3 (0.4)6.9 (0.7)15/15
DEuniform fialho noiseless 2.0 (2)11 (5)2.5 (0.6)2.7 (0.4)3.6 (0.3)5.5 (0.4)7.2 (0.5)15/15
IPOP-ACTCMA-ES ros noiseless 1.6 (1)20 (21)76 (147)39 (77)34 (58)33 (38)32 (36)8/15
IPOP-CMA-ES ros noiseless 2.2 (2)26 (47)33 (64)17 (54)15 (28)14 (19)14 (51)11/15
MOS torre noiseless 2.2 (2)16 (16)4.1 (3)3.5 (2)3.8 (3)4.0 (16)3.9 (5)14/15
NBC-CMA preuss noiseless 1.4 (0.8)42 (54)299 (474)153 (234)135 (104)129 (166)124 (114)1/15
PM-AdapSS-DE fialho noiseless 1.8 (1)8.9 (4)12 (9)15 (18)14 (10)21 (31)27 (16)5/15
RCGA tran noiseless 2.2 (2)37 (48)119 (219)2e50/15
SPSA finck noiseless 309 (188)1778 (2991)5e50/15
oPOEMS kubalic noiseless 12 (23)21 (19)41 (0.2)63 (81)57 (61)55 (114)54 (22)7/15
pPOEMS kubalic noiseless 3.4 (12)71 (112)29 (6)43 (42)42 (48)47 (58)53 (48)8/15

Δ fopt
f24, 5-D
1e1
1622
1e0
2.2e5
1e-1
6.4e6
1e-2
9.6e6
1e-3
9.6e6
1e-5
1.3e7
1e-7
1.3e7
#succ
3/15
1komma2 brockhoff noiseless 40 (75)5e40/15
1komma2mir brockhoff noiseless 8.3 (4)5e40/15
1komma2mirser brockhoff noiseless 6.0 (5)5e40/15
1komma2ser brockhoff noiseless 49 (58)5e40/15
1komma4 brockhoff noiseless 5.3 (4)5e40/15
1komma4mir brockhoff noiseless 4.4 (5)5e40/15
1komma4mirser brockhoff noiseless 6.0 (6)3.3 (2)5e40/15
1komma4ser brockhoff noiseless 7.0 (12)5e40/15
1plus1 brockhoff noiseless 6.2 (5)5e40/15
1plus2mirser brockhoff noiseless 4.7 (5)3.3 (3)5e40/15
ABC elabd noiseless 13 (4)5e50/15
AVGNEWUOA ros noiseless 2.0 (4)2.2 (2)3e40/15
CMAEGS finck noiseless 30 (87)5e50/15
DE-F-AUC fialho noiseless 4.1 (2)3.7 (6)0.13 (0.1)0.15 (0.1)0.15 (0.3)0.11 (0.2)0.11 (0.1)4/15
DEuniform fialho noiseless 4.3 (2)3.7 (8)0.17 (0.3)0.15 (0.2)0.15 (0.1)0.11 (0.1)0.11 (0.1)4/15
IPOP-ACTCMA-ES ros noiseless 2.6 (2)41 (48)1e60/15
IPOP-CMA-ES ros noiseless 2.9 (2)18 (23)1.4 (1)0.94 (2)0.94 (2)0.70 (0.8)0.70 (0.6)2/15
MOS torre noiseless 2.2 (2)2.8 (5)0.52 (0.5)1.2 (1)1.2 (0.7)0.87 (1)0.87 (0.8)1/15
NBC-CMA preuss noiseless 15 (11)9.4 (9)3e50/15
PM-AdapSS-DE fialho noiseless 5.9 (8)6.8 (11)0.24 (0.2)0.36 (0.5)0.36 (0.2)0.27 (0.4)0.27 (0.1)2/15
RCGA tran noiseless 3.5 (2)8.2 (18)2e50/15
SPSA finck noiseless 4351 (5165)5e50/15
oPOEMS kubalic noiseless 72 (147)2e60/15
pPOEMS kubalic noiseless 39 (21)7.2 (11)2e60/15

Previous dimension | Dimension = 10 | Next dimension

Δ fopt
f1, 10-D
1e1
22
1e0
23
1e-1
23
1e-2
23
1e-3
23
1e-5
23
1e-7
23
#succ
15/15
1komma2 brockhoff noiseless 13 (4)20 (4)31 (8)40 (15)48 (12)67 (15)85 (14)15/15
1komma2mir brockhoff noiseless 6.5 (1)12 (4)17 (2)23 (4)28 (3)40 (6)52 (7)15/15
1komma2mirser brockhoff noiseless 5.9 (2)10 (2)15 (3)20 (3)25 (3)36 (5)45 (4)15/15
1komma2ser brockhoff noiseless 10 (3)19 (8)27 (8)35 (12)45 (11)62 (7)81 (18)15/15
1komma4 brockhoff noiseless 4.7 (1)10 (2)14 (3)20 (3)25 (6)36 (2)46 (5)15/15
1komma4mir brockhoff noiseless 4.1 (1)8.1 (2)12 (2)17 (2)21 (3)30 (4)39 (5)15/15
1komma4mirser brockhoff noiseless 3.6 (1)6.6 (2)10 (2)13 (2)16 (2)23 (2)29 (2)15/15
1komma4ser brockhoff noiseless 4.3 (0.9)8.2 (2)13 (2)16 (2)21 (3)29 (4)38 (6)15/15
1plus1 brockhoff noiseless 4.1 (0.6)8.0 (2)12 (1)15 (2)19 (2)27 (2)34 (4)15/15
1plus2mirser brockhoff noiseless 3.7 (1)6.7 (2)10 (2)13 (2)17 (2)24 (2)31 (3)15/15
ABC elabd noiseless 24 (14)55 (28)86 (42)114 (42)165 (26)238 (16)306 (21)15/15
AVGNEWUOA ros noiseless 1.7 (0)★21.7 (0.1)★41.7 (0.1)★41.7 (0.1)★41.7 (0.1)★41.7 (0.1)★41.7 (0.1)★415/15
CMAEGS finck noiseless 11 (4)19 (2)26 (3)34 (3)42 (4)57 (4)72 (4)15/15
DE-F-AUC fialho noiseless 37 (8)89 (4)137 (10)189 (12)239 (14)343 (10)443 (19)15/15
DEuniform fialho noiseless 48 (15)119 (10)197 (17)269 (18)344 (14)496 (18)649 (21)15/15
IPOP-ACTCMA-ES ros noiseless 6.2 (3)12 (3)19 (3)26 (3)32 (3)44 (3)58 (3)15/15
IPOP-CMA-ES ros noiseless 5.0 (4)11 (3)17 (2)24 (3)30 (2)43 (4)56 (3)15/15
MOS torre noiseless 19 (6)56 (4)71 (5)94 (7)124 (3)166 (20)214 (10)15/15
NBC-CMA preuss noiseless 16 (2)25 (3)34 (4)45 (4)54 (2)73 (4)93 (5)15/15
PM-AdapSS-DE fialho noiseless 41 (12)94 (13)157 (11)218 (15)275 (9)399 (18)518 (30)15/15
RCGA tran noiseless 33 (17)103 (43)206 (82)345 (118)1034 (432)2693 (229)3761 (137)15/15
SPSA finck noiseless 7.7 (1)10 (2)13 (2)16 (2)19 (2)25 (4)31 (7)15/15
oPOEMS kubalic noiseless 130 (9)241 (70)605 (132)1045 (139)1469 (159)2403 (121)3321 (51)15/15
pPOEMS kubalic noiseless 125 (20)248 (85)1029 (740)3154 (912)5744 (2285)1.1e4 (3667)1.6e4 (4044)15/15

Δ fopt
f2, 10-D
1e1
187
1e0
190
1e-1
191
1e-2
191
1e-3
193
1e-5
194
1e-7
195
#succ
15/15
1komma2 brockhoff noiseless 90 (17)93 (16)98 (11)101 (8)102 (15)106 (12)108 (8)15/15
1komma2mir brockhoff noiseless 46 (8)49 (5)50 (5)51 (3)52 (5)53 (4)54 (4)15/15
1komma2mirser brockhoff noiseless 38 (6)42 (4)43 (4)44 (3)44 (2)45 (2)47 (2)15/15
1komma2ser brockhoff noiseless 101 (26)107 (14)111 (18)114 (19)115 (10)119 (21)123 (18)15/15
1komma4 brockhoff noiseless 31 (8)35 (4)36 (3)36 (3)37 (4)38 (4)39 (3)15/15
1komma4mir brockhoff noiseless 27 (6)30 (5)31 (3)33 (2)33 (1)34 (1)35 (1)15/15
1komma4mirser brockhoff noiseless 21 (5)23 (2)23 (2)24 (1)24 (2)25 (2)26 (2)15/15
1komma4ser brockhoff noiseless 26 (4)29 (3)31 (3)32 (4)32 (3)33 (3)34 (3)15/15
1plus1 brockhoff noiseless 17 (3)21 (4)21 (3)22 (2)22 (2)23 (2)24 (3)15/15
1plus2mirser brockhoff noiseless 13 (4)16 (2)18 (3)18 (1)19 (1)20 (0.9)20 (1)★315/15
ABC elabd noiseless 11 (4)15 (4)22 (10)28 (7)38 (11)56 (7)68 (5)15/15
AVGNEWUOA ros noiseless 16 (17)39 (33)67 (32)90 (50)124 (68)184 (107)251 (112)15/15
CMAEGS finck noiseless 61 (8)66 (9)67 (5)68 (11)69 (7)71 (2)73 (4)15/15
DE-F-AUC fialho noiseless 29 (3)34 (2)40 (4)46 (4)52 (4)64 (4)75 (4)15/15
DEuniform fialho noiseless 39 (2)47 (1)55 (3)64 (0.8)73 (2)91 (2)109 (3)15/15
IPOP-ACTCMA-ES ros noiseless 14 (4)16 (2)18 (1)19 (1)20 (2)21 (0.9)23 (1)15/15
IPOP-CMA-ES ros noiseless 21 (4)25 (1)26 (0.9)26 (2)27 (1)28 (1)30 (1)15/15
MOS torre noiseless 30 (9)37 (12)43 (10)48 (10)53 (9)62 (7)71 (6)15/15
NBC-CMA preuss noiseless 32 (8)37 (7)41 (3)43 (3)44 (3)47 (2)49 (3)15/15
PM-AdapSS-DE fialho noiseless 32 (1)39 (2)46 (3)53 (1.0)59 (2)74 (2)87 (3)15/15
RCGA tran noiseless 94 (24)147 (37)233 (44)321 (29)393 (31)676 (20)1482 (2563)8/15
SPSA finck noiseless 1e60/15
oPOEMS kubalic noiseless 214 (41)267 (38)326 (21)369 (25)426 (34)532 (34)642 (34)15/15
pPOEMS kubalic noiseless 610 (161)1019 (396)1276 (364)1788 (186)2028 (339)2615 (486)3286 (349)15/15

Δ fopt
f3, 10-D
1e1
1739
1e0
3600
1e-1
3609
1e-2
3636
1e-3
3642
1e-5
3646
1e-7
3651
#succ
15/15
1komma2 brockhoff noiseless 1e50/15
1komma2mir brockhoff noiseless 274 (277)1e50/15
1komma2mirser brockhoff noiseless 390 (318)1e50/15
1komma2ser brockhoff noiseless 398 (448)1e50/15
1komma4 brockhoff noiseless 1e50/15
1komma4mir brockhoff noiseless 91 (119)1e50/15
1komma4mirser brockhoff noiseless 76 (89)1e50/15
1komma4ser brockhoff noiseless 376 (518)1e50/15
1plus1 brockhoff noiseless 838 (1323)1e50/15
1plus2mirser brockhoff noiseless 835 (733)1e50/15
ABC elabd noiseless 1.6 (0.5)2.2 (1)2.5 (0.8)2.8 (1)3.1 (1)3.8 (0.8)4.5 (0.5)15/15
AVGNEWUOA ros noiseless 7e40/15
CMAEGS finck noiseless 78 (20)3902 (3125)3893 (4365)3865 (5364)3859 (5424)3857 (3635)1e60/15
DE-F-AUC fialho noiseless 200 (57)1212 (2018)3964 (3533)3936 (3507)3930 (7139)3926 (3703)3922 (4725)1/15
DEuniform fialho noiseless 211 (35)4009 (3194)1e60/15
IPOP-ACTCMA-ES ros noiseless 5.6 (3)643 (607)2678 (3431)2659 (3333)2655 (2594)2654 (4266)2651 (1913)2/15
IPOP-CMA-ES ros noiseless 2.7 (1)1658 (3079)5796 (4020)5753 (5129)5744 (1e4)5738 (5978)5730 (7358)1/15
MOS torre noiseless 2.1 (0.3)3.0 (0.3)3.7 (1)4.0 (3)4.4 (3)4.9 (0.2)5.6 (4)15/15
NBC-CMA preuss noiseless 8.2 (9)1213 (708)3e50/15
PM-AdapSS-DE fialho noiseless 93 (27)508 (707)646 (980)1877 (3233)3944 (4530)1e60/15
RCGA tran noiseless 8.2 (3)133 (72)254 (134)330 (510)333 (190)336 (617)339 (521)5/15
SPSA finck noiseless 1e60/15
oPOEMS kubalic noiseless 6.8 (1)28 (31)54 (47)56 (31)58 (7)64 (31)70 (47)15/15
pPOEMS kubalic noiseless 8.2 (3)54 (17)134 (212)140 (417)154 (17)186 (22)227 (24)14/15

Δ fopt
f4, 10-D
1e1
2234
1e0
3626
1e-1
3660
1e-2
3695
1e-3
3707
1e-5
3744
1e-7
28767
#succ
12/15
1komma2 brockhoff noiseless 1e50/15
1komma2mir brockhoff noiseless 307 (302)1e50/15
1komma2mirser brockhoff noiseless 209 (273)1e50/15
1komma2ser brockhoff noiseless 1e50/15
1komma4 brockhoff noiseless 1e50/15
1komma4mir brockhoff noiseless 1e50/15
1komma4mirser brockhoff noiseless 311 (571)1e50/15
1komma4ser brockhoff noiseless 1e50/15
1plus1 brockhoff noiseless 317 (426)1e50/15
1plus2mirser brockhoff noiseless 1e50/15
ABC elabd noiseless 1.3 (0.5)3.2 (0.8)4.4 (2)★25.1 (1)5.7 (0.9)6.7 (4)0.99 (0.2)15/15
AVGNEWUOA ros noiseless 1e50/15
CMAEGS finck noiseless 362 (374)1e60/15
DE-F-AUC fialho noiseless 92 (24)1e60/15
DEuniform fialho noiseless 111 (39)1e60/15
IPOP-ACTCMA-ES ros noiseless 7.6 (4)1e60/15
IPOP-CMA-ES ros noiseless 7.5 (7)2e60/15
MOS torre noiseless 1.9 (0.1)6.8 (3)8.2 (0.7)8.6 (0.6)9.1 (3)10 (0.7)1.4 (0.3)15/15
NBC-CMA preuss noiseless 8.1 (12)3e50/15
PM-AdapSS-DE fialho noiseless 92 (62)1e60/15
RCGA tran noiseless 107 (112)5e50/15
SPSA finck noiseless 1e60/15
oPOEMS kubalic noiseless 6.6 (2)40 (36)114 (124)116 (128)120 (126)123 (79)17 (19)15/15
pPOEMS kubalic noiseless 10 (8)68 (28)285 (410)298 (213)316 (22)348 (603)51 (107)12/15

Δ fopt
f5, 10-D
1e1
20
1e0
20
1e-1
20
1e-2
20
1e-3
20
1e-5
20
1e-7
20
#succ
15/15
1komma2 brockhoff noiseless 5.8 (2)7.0 (4)7.2 (5)7.2 (2)7.2 (4)7.2 (2)7.2 (2)15/15
1komma2mir brockhoff noiseless 2.9 (1)3.5 (1)3.7 (1)3.8 (1)3.8 (2)3.8 (1)3.8 (2)15/15
1komma2mirser brockhoff noiseless 3.5 (2)4.0 (0.7)4.1 (2)4.1 (1)4.1 (2)4.1 (2)4.1 (2)15/15
1komma2ser brockhoff noiseless 6.4 (4)8.3 (8)8.4 (4)8.4 (8)8.4 (8)8.4 (6)8.4 (4)15/15
1komma4 brockhoff noiseless 4.3 (1)5.5 (3)5.6 (4)5.7 (5)5.7 (4)5.7 (4)5.7 (5)15/15
1komma4mir brockhoff noiseless 4.2 (1)5.2 (2)5.3 (2)5.4 (2)5.4 (2)5.4 (2)5.4 (2)15/15
1komma4mirser brockhoff noiseless 3.5 (1)4.1 (2)4.2 (2)4.2 (2)4.2 (2)4.2 (1)4.2 (0.9)15/15
1komma4ser brockhoff noiseless 3.1 (2)4.1 (2)4.1 (2)4.2 (2)4.2 (2)4.2 (2)4.2 (2)15/15
1plus1 brockhoff noiseless 2.8 (2)3.3 (1)3.4 (2)3.4 (1)3.5 (2)3.5 (1)3.5 (2)15/15
1plus2mirser brockhoff noiseless 2.1 (0.7)2.7 (0.7)3.0 (0.7)3.0 (0.9)3.0 (1)3.0 (1)3.0 (1)15/15
ABC elabd noiseless 52 (30)72 (46)76 (42)76 (48)76 (45)76 (47)76 (42)15/15
AVGNEWUOA ros noiseless 2.1 (0.3)2.3 (0.5)2.4 (0.4)2.4 (0.5)2.4 (0.2)2.4 (0.5)2.4 (0.4)15/15
CMAEGS finck noiseless 5.4 (1)6.2 (2)6.2 (1)6.2 (1)6.2 (1)6.2 (1)6.2 (0.9)15/15
DE-F-AUC fialho noiseless 31 (15)40 (11)44 (36)44 (16)44 (25)44 (33)44 (24)15/15
DEuniform fialho noiseless 43 (14)54 (25)56 (22)58 (23)58 (23)58 (23)58 (22)15/15
IPOP-ACTCMA-ES ros noiseless 5.3 (2)6.7 (2)6.9 (2)6.9 (2)6.9 (1)6.9 (1)6.9 (2)15/15
IPOP-CMA-ES ros noiseless 4.9 (0.9)6.0 (1)6.2 (1)6.3 (1)6.3 (2)6.3 (1)6.3 (0.9)15/15
MOS torre noiseless 35 (9)54 (3)54 (2)54 (2)54 (2)54 (2)54 (3)15/15
NBC-CMA preuss noiseless 36 (7)43 (13)43 (10)43 (13)43 (7)43 (11)43 (8)15/15
PM-AdapSS-DE fialho noiseless 39 (18)53 (9)54 (22)54 (22)54 (20)54 (22)54 (16)15/15
RCGA tran noiseless 395 (32)799 (62)1255 (115)1977 (263)3155 (576)5189 (365)7.5e4 (7e4)0/15
SPSA finck noiseless 6.2 (4)8.3 (6)8.7 (3)8.7 (5)8.7 (4)8.7 (5)8.7 (5)15/15
oPOEMS kubalic noiseless 200 (10)237 (33)265 (35)277 (29)280 (45)280 (39)280 (37)15/15
pPOEMS kubalic noiseless 198 (22)235 (39)255 (30)275 (44)278 (46)279 (40)279 (45)15/15

Δ fopt
f6, 10-D
1e1
412
1e0
623
1e-1
826
1e-2
1039
1e-3
1292
1e-5
1841
1e-7
2370
#succ
15/15
1komma2 brockhoff noiseless 7.1 (3)9.2 (4)12 (9)19 (20)21 (24)35 (28)90 (105)3/15
1komma2mir brockhoff noiseless 2.4 (0.3)2.2 (0.7)2.3 (0.6)2.4 (0.8)2.3 (0.8)2.4 (0.5)2.4 (1)15/15
1komma2mirser brockhoff noiseless 1.9 (0.5)1.9 (0.7)2.1 (0.7)2.0 (0.8)2.1 (0.6)2.2 (0.8)2.5 (2)15/15
1komma2ser brockhoff noiseless 10 (3)17 (21)35 (64)44 (68)55 (33)77 (48)597 (1308)0/15
1komma4 brockhoff noiseless 2.1 (1)2.3 (0.9)2.4 (0.5)2.5 (0.5)2.6 (1)2.7 (1)2.8 (0.5)15/15
1komma4mir brockhoff noiseless 1.6 (0.8)1.6 (0.5)1.7 (0.5)1.7 (0.6)1.8 (0.7)1.8 (0.4)1.7 (0.3)15/15
1komma4mirser brockhoff noiseless 1.1 (0.3)1.3 (0.5)1.3 (0.2)1.4 (0.4)1.4 (0.4)1.4 (0.3)1.5 (0.8)15/15
1komma4ser brockhoff noiseless 1.7 (0.6)2.2 (0.5)2.6 (2)2.8 (2)2.9 (2)4.2 (7)4.6 (0.8)15/15
1plus1 brockhoff noiseless 1.4 (0.4)5.9 (7)26 (33)78 (48)246 (318)1e50/15
1plus2mirser brockhoff noiseless 1.1 (0.3)2.6 (5)14 (8)75 (71)155 (309)1e50/15
ABC elabd noiseless 12 (14)232 (207)598 (621)2036 (2649)2248 (4053)7831 (4210)6289 (4220)1/15
AVGNEWUOA ros noiseless 0.97 (0.4)0.99 (0.4)1.0 (0.2)1.0 (0.4)1.1 (0.6)1.1 (0.3)1.1 (0.5)15/15
CMAEGS finck noiseless 35 (29)73 (70)188 (87)269 (318)240 (29)198 (140)209 (208)7/15
DE-F-AUC fialho noiseless 11 (0.8)12 (0.4)13 (0.9)13 (0.8)13 (0.6)12 (0.2)12 (0.3)15/15
DEuniform fialho noiseless 15 (1)16 (2)17 (1)17 (2)17 (0.5)16 (0.8)16 (0.5)15/15
IPOP-ACTCMA-ES ros noiseless 1.8 (0.4)1.9 (0.3)1.8 (0.3)1.8 (0.2)1.7 (0.2)1.6 (0.2)1.6 (0.1)15/15
IPOP-CMA-ES ros noiseless 1.9 (0.6)1.9 (0.3)1.9 (0.5)1.9 (0.4)1.8 (0.2)1.7 (0.4)1.7 (0.2)15/15
MOS torre noiseless 7.8 (2)7.1 (0.7)6.7 (0.8)6.4 (0.7)6.2 (0.6)5.5 (0.2)5.2 (0.5)15/15
NBC-CMA preuss noiseless 31 (8)21 (118)17 (89)14 (38)11 (3)8.4 (20)7.0 (1)15/15
PM-AdapSS-DE fialho noiseless 14 (0.5)14 (0.9)15 (0.6)15 (0.7)14 (0.6)13 (0.4)13 (0.6)15/15
RCGA tran noiseless 39 (30)83 (16)136 (24)313 (251)407 (290)5e50/15
SPSA finck noiseless 3.6e4 (4e4)1e60/15
oPOEMS kubalic noiseless 31 (2)39 (3)43 (3)45 (2)45 (1)44 (0.9)44 (1)15/15
pPOEMS kubalic noiseless 40 (20)71 (38)129 (77)138 (70)150 (47)156 (57)168 (48)15/15

Δ fopt
f7, 10-D
1e1
172
1e0
1611
1e-1
4195
1e-2
5099
1e-3
5141
1e-5
5141
1e-7
5389
#succ
15/15
1komma2 brockhoff noiseless 56 (30)1e50/15
1komma2mir brockhoff noiseless 12 (19)47 (69)164 (145)1e50/15
1komma2mirser brockhoff noiseless 8.8 (14)47 (24)1e50/15
1komma2ser brockhoff noiseless 102 (51)1e50/15
1komma4 brockhoff noiseless 5.1 (9)53 (45)1e50/15
1komma4mir brockhoff noiseless 3.6 (2)25 (24)337 (399)1e50/15
1komma4mirser brockhoff noiseless 4.9 (5)21 (27)161 (137)1e50/15
1komma4ser brockhoff noiseless 11 (11)75 (143)339 (203)1e50/15
1plus1 brockhoff noiseless 18 (27)6.4 (3)6.5 (8)10 (8)12 (14)12 (15)12 (14)12/15
1plus2mirser brockhoff noiseless 14 (11)5.6 (2)7.4 (1)13 (15)13 (22)13 (16)13 (16)11/15
ABC elabd noiseless 27 (16)512 (627)1627 (1367)1e60/15
AVGNEWUOA ros noiseless 16 (51)38 (78)1e50/15
CMAEGS finck noiseless 10 (7)2491 (1873)1e60/15
DE-F-AUC fialho noiseless 10 (3)2.1 (0.4)1.2 (0.2)1.3 (0.1)1.4 (0.1)1.4 (0.2)1.4 (0.3)15/15
DEuniform fialho noiseless 12 (2)2.8 (0.2)1.7 (0.1)1.9 (0.1)1.9 (0.1)1.9 (0.1)2.0 (0.1)15/15
IPOP-ACTCMA-ES ros noiseless 2.7 (3)1.2 (0.6)0.75 (0.5)0.77 (0.2)★20.77 (0.3)★20.77 (0.1)★20.75 (0.3)★215/15
IPOP-CMA-ES ros noiseless 2.6 (2)1.9 (0.8)1.5 (0.9)1.4 (0.6)1.4 (0.6)1.4 (0.6)1.4 (0.5)15/15
MOS torre noiseless 7.8 (2)3.0 (3)2.3 (2)2.1 (1)2.1 (0.5)2.1 (0.7)2.0 (0.9)15/15
NBC-CMA preuss noiseless 3.4 (0.6)1.5 (2)4.0 (3)13 (15)15 (19)15 (25)16 (13)14/15
PM-AdapSS-DE fialho noiseless 10 (2)2.4 (0.3)1.4 (0.1)1.5 (0.2)1.5 (0.1)1.5 (0.2)1.5 (0.1)15/15
RCGA tran noiseless 82 (187)81 (54)298 (307)5e50/15
SPSA finck noiseless 8.1e4 (1e5)1e60/15
oPOEMS kubalic noiseless 34 (5)12 (2)147 (113)123 (442)123 (147)123 (292)117 (279)13/15
pPOEMS kubalic noiseless 40 (11)35 (22)29 (11)43 (7)46 (10)46 (10)44 (10)15/15

Δ fopt
f8, 10-D
1e1
326
1e0
921
1e-1
1114
1e-2
1217
1e-3
1267
1e-5
1315
1e-7
1343
#succ
15/15
1komma2 brockhoff noiseless 10 (11)20 (16)19 (15)19 (10)19 (12)19 (13)19 (13)15/15
1komma2mir brockhoff noiseless 2.3 (0.3)7.6 (6)7.7 (4)7.7 (5)7.7 (5)7.7 (5)7.8 (4)15/15
1komma2mirser brockhoff noiseless 2.9 (1)6.8 (3)6.7 (4)6.6 (3)6.6 (3)6.7 (3)6.8 (6)15/15
1komma2ser brockhoff noiseless 8.4 (13)24 (27)23 (15)22 (16)22 (8)22 (9)22 (12)15/15
1komma4 brockhoff noiseless 3.0 (2)7.0 (6)6.8 (3)6.7 (4)6.6 (3)6.7 (4)6.8 (3)15/15
1komma4mir brockhoff noiseless 1.6 (0.9)6.1 (4)5.9 (3)5.8 (3)5.8 (3)5.8 (3)5.9 (3)15/15
1komma4mirser brockhoff noiseless 1.2 (0.5)5.3 (5)5.1 (4)4.9 (2)4.9 (3)4.9 (3)4.9 (0.5)15/15
1komma4ser brockhoff noiseless 3.3 (4)5.0 (3)5.0 (3)4.9 (2)4.9 (3)5.0 (1)5.1 (2)15/15
1plus1 brockhoff noiseless 2.2 (5)3.5 (2)3.5 (1)3.5 (1)3.5 (1)3.6 (1)3.8 (2)15/15
1plus2mirser brockhoff noiseless 1.9 (1)3.5 (2)3.4 (1)3.3 (2)3.3 (2)3.4 (2)3.6 (1)15/15
ABC elabd noiseless 7.2 (4)7.4 (4)19 (7)77 (115)549 (663)1e60/15
AVGNEWUOA ros noiseless 0.99 (0.4)0.88 (0.4)★30.84 (0.4)★40.83 (0.3)★40.82 (0.2)★40.82 (0.3)★40.82 (0.3)★415/15
CMAEGS finck noiseless 5.2 (14)8.4 (6)8.3 (8)8.4 (2)8.4 (7)9.1 (6)10 (13)14/15
DE-F-AUC fialho noiseless 14 (2)14 (2)15 (1)15 (2)15 (1)16 (2)18 (0.9)15/15
DEuniform fialho noiseless 20 (0.6)20 (4)21 (3)21 (1)22 (2)23 (2)26 (1)15/15
IPOP-ACTCMA-ES ros noiseless 2.7 (2)4.4 (0.5)4.4 (0.5)4.3 (0.5)4.3 (0.5)4.4 (0.8)4.6 (2)15/15
IPOP-CMA-ES ros noiseless 2.3 (2)3.7 (1.0)3.9 (0.9)4.0 (0.9)4.0 (0.4)4.2 (0.8)4.3 (0.9)15/15
MOS torre noiseless 6.7 (1)12 (0.9)12 (0.8)12 (2)12 (2)13 (1)13 (3)15/15
NBC-CMA preuss noiseless 3.1 (0.3)6.4 (1)7.1 (0.8)7.5 (0.9)7.6 (0.9)7.9 (0.9)8.1 (0.5)15/15
PM-AdapSS-DE fialho noiseless 16 (2)20 (2)21 (2)22 (4)22 (2)23 (3)25 (3)15/15
RCGA tran noiseless 102 (148)1999 (3141)6724 (6845)5e50/15
SPSA finck noiseless 8749 (1e4)1e60/15
oPOEMS kubalic noiseless 64 (12)706 (1231)1066 (1482)1469 (1283)2026 (1970)3e60/15
pPOEMS kubalic noiseless 162 (89)200 (65)200 (43)198 (43)207 (43)271 (118)378 (134)15/15

Δ fopt
f9, 10-D
1e1
200
1e0
648
1e-1
857
1e-2
993
1e-3
1065
1e-5
1138
1e-7
1185
#succ
15/15
1komma2 brockhoff noiseless 7.1 (3)27 (15)24 (12)22 (11)21 (9)21 (9)21 (9)15/15
1komma2mir brockhoff noiseless 5.0 (8)11 (7)10 (6)9.1 (3)8.8 (4)8.7 (4)8.7 (4)15/15
1komma2mirser brockhoff noiseless 5.0 (7)9.3 (6)8.5 (4)7.9 (6)7.7 (3)7.6 (4)7.5 (2)15/15
1komma2ser brockhoff noiseless 15 (12)30 (39)27 (16)25 (26)24 (14)23 (13)23 (15)15/15
1komma4 brockhoff noiseless 5.2 (4)9.2 (7)8.3 (6)7.7 (5)7.5 (6)7.3 (3)7.3 (6)15/15
1komma4mir brockhoff noiseless 5.2 (4)8.0 (5)7.2 (4)6.7 (2)6.5 (3)6.4 (3)6.3 (3)15/15
1komma4mirser brockhoff noiseless 3.1 (3)6.4 (3)5.7 (4)5.3 (4)5.1 (4)5.0 (2)5.0 (3)15/15
1komma4ser brockhoff noiseless 3.6 (2)6.2 (5)5.8 (6)5.4 (0.9)5.3 (1)5.3 (2)5.3 (3)15/15
1plus1 brockhoff noiseless 2.7 (1)7.2 (7)6.3 (5)5.7 (4)5.5 (3)5.5 (4)5.5 (3)15/15
1plus2mirser brockhoff noiseless 3.8 (4)5.8 (5)5.1 (4)4.6 (2)4.5 (3)4.5 (3)4.5 (3)15/15
ABC elabd noiseless 14 (11)997 (997)5682 (7018)1e60/15
AVGNEWUOA ros noiseless 1.3 (0.4)1.8 (0.3)1.5 (0.9)1.4 (0.1)★21.3 (0.8)★21.2 (1)★21.2 (0.1)★215/15
CMAEGS finck noiseless 8.8 (16)12 (4)12 (2)11 (2)11 (7)11 (7)11 (7)15/15
DE-F-AUC fialho noiseless 22 (2)21 (3)20 (2)19 (2)19 (2)20 (2)21 (2)15/15
DEuniform fialho noiseless 31 (2)29 (3)28 (3)27 (3)27 (3)28 (3)30 (2)15/15
IPOP-ACTCMA-ES ros noiseless 4.1 (0.5)5.2 (1)4.8 (1.0)4.5 (1)4.4 (0.7)4.4 (0.5)4.5 (0.4)15/15
IPOP-CMA-ES ros noiseless 3.2 (1)6.2 (2)5.8 (1)5.4 (0.9)5.3 (0.8)5.3 (0.6)5.4 (0.6)15/15
MOS torre noiseless 6.4 (0.4)12 (4)12 (3)11 (3)11 (2)11 (2)11 (1)15/15
NBC-CMA preuss noiseless 5.6 (0.8)12 (12)11 (5)11 (8)11 (7)11 (7)11 (0.7)15/15
PM-AdapSS-DE fialho noiseless 26 (2)31 (7)30 (5)29 (4)28 (4)29 (5)30 (4)15/15
RCGA tran noiseless 54 (28)5e50/15
SPSA finck noiseless 1.1e4 (7413)1e60/15
oPOEMS kubalic noiseless 113 (11)1062 (178)1615 (958)2928 (183)3e60/15
pPOEMS kubalic noiseless 327 (121)268 (108)313 (147)426 (128)561 (215)853 (361)1256 (679)14/15

Δ fopt
f10, 10-D
1e1
1835
1e0
2172
1e-1
2455
1e-2
2728
1e-3
2802
1e-5
4543
1e-7
4739
#succ
15/15
1komma2 brockhoff noiseless 9.4 (3)8.8 (1.0)8.1 (1)7.5 (1.0)7.4 (1)4.7 (0.7)4.6 (0.6)15/15
1komma2mir brockhoff noiseless 4.7 (0.9)4.3 (0.2)3.9 (0.3)3.6 (0.4)3.6 (0.2)2.3 (0.1)2.3 (0.1)15/15
1komma2mirser brockhoff noiseless 4.3 (0.5)3.8 (0.3)3.4 (0.2)3.1 (0.3)3.1 (0.2)2.0 (0.1)1.9 (0.1)15/15
1komma2ser brockhoff noiseless 8.5 (4)8.7 (0.8)8.1 (0.7)7.5 (0.7)7.5 (0.9)4.8 (0.5)4.8 (0.6)15/15
1komma4 brockhoff noiseless 2.9 (0.6)3.0 (0.3)2.8 (0.2)2.6 (0.2)2.6 (0.2)1.6 (0.1)1.6 (0.1)15/15
1komma4mir brockhoff noiseless 2.6 (0.5)2.6 (0.3)2.4 (0.3)2.3 (0.3)2.2 (0.2)1.4 (0.1)1.4 (0.1)15/15
1komma4mirser brockhoff noiseless 2.0 (0.4)2.0 (0.4)1.8 (0.2)1.7 (0.2)1.7 (0.2)1.1 (0.1)1.1 (0.1)15/15
1komma4ser brockhoff noiseless 2.5 (0.4)2.5 (0.3)2.3 (0.1)2.2 (0.3)2.2 (0.2)1.4 (0.1)1.4 (0.1)15/15
1plus1 brockhoff noiseless 1.8 (0.4)1.8 (0.1)1.7 (0.1)1.6 (0.1)1.6 (0.1)1.0 (0.0)1.0 (0.1)15/15
1plus2mirser brockhoff noiseless 1.4 (0.3)1.4 (0.2)1.4 (0.2)1.3 (0.1)1.3 (0.1)0.82 (0.1)★20.82 (0.1)★315/15
ABC elabd noiseless 1e60/15
AVGNEWUOA ros noiseless 1.9 (0.7)3.5 (1)5.4 (3)6.6 (3)9.0 (5)8.1 (2)10 (2)15/15
CMAEGS finck noiseless 6.2 (1)5.6 (0.8)5.2 (0.3)4.7 (0.3)4.7 (0.6)3.0 (0.1)2.9 (0.2)15/15
DE-F-AUC fialho noiseless 2.9 (0.2)3.0 (0.3)3.1 (0.2)3.3 (0.2)3.6 (0.2)2.7 (0.2)3.1 (0.1)15/15
DEuniform fialho noiseless 3.9 (0.3)4.1 (0.1)4.4 (0.2)4.6 (0.2)5.1 (0.2)3.9 (0.1)4.5 (0.2)15/15
IPOP-ACTCMA-ES ros noiseless 1.5 (0.3)1.4 (0.1)1.4 (0.2)1.3 (0.1)1.3 (0.0)0.89 (0.0)0.91 (0.0)15/15
IPOP-CMA-ES ros noiseless 2.0 (0.3)2.0 (0.2)2.0 (0.2)1.9 (0.1)1.9 (0.1)1.2 (0.1)1.2 (0.1)15/15
MOS torre noiseless 4.5 (1)4.4 (0.6)4.3 (0.5)4.1 (0.3)4.2 (0.4)2.7 (0.2)2.8 (0.2)15/15
NBC-CMA preuss noiseless 3.1 (0.7)3.2 (0.6)3.2 (0.7)3.1 (0.4)3.2 (0.3)2.1 (0.1)2.1 (0.2)15/15
PM-AdapSS-DE fialho noiseless 3.4 (0.2)3.4 (0.2)3.6 (0.2)3.8 (0.1)4.1 (0.1)3.2 (0.1)3.6 (0.1)15/15
RCGA tran noiseless 5e50/15
SPSA finck noiseless 1e60/15
oPOEMS kubalic noiseless 2.4e4 (2e4)3e60/15
pPOEMS kubalic noiseless 1202 (774)6015 (7587)8673 (2e4)3e60/15

Δ fopt
f11, 10-D
1e1
266
1e0
1041
1e-1
2602
1e-2
2954
1e-3
3338
1e-5
4092
1e-7
4843
#succ
15/15
1komma2 brockhoff noiseless 38 (13)12 (4)5.3 (1)5.1 (1)4.8 (1)4.1 (0.9)3.6 (0.4)15/15
1komma2mir brockhoff noiseless 25 (2)7.4 (0.7)3.3 (0.4)3.0 (0.3)2.8 (0.2)2.4 (0.2)2.1 (0.2)15/15
1komma2mirser brockhoff noiseless 23 (3)6.5 (0.9)2.8 (0.3)2.6 (0.3)2.4 (0.3)2.1 (0.2)1.8 (0.1)15/15
1komma2ser brockhoff noiseless 44 (13)13 (3)5.7 (2)5.5 (2)5.2 (2)4.6 (1)4.0 (1)15/15
1komma4 brockhoff noiseless 19 (2)5.5 (0.6)2.4 (0.1)2.3 (0.2)2.2 (0.1)1.9 (0.1)1.7 (0.1)15/15
1komma4mir brockhoff noiseless 20 (4)5.8 (2)2.5 (0.4)2.3 (0.4)2.1 (0.4)1.8 (0.1)1.6 (0.2)15/15
1komma4mirser brockhoff noiseless 13 (1)3.8 (0.4)1.7 (0.1)1.6 (0.1)1.4 (0.1)1.2 (0.1)1.1 (0.1)15/15
1komma4ser brockhoff noiseless 15 (2)4.5 (0.9)2.0 (0.3)1.8 (0.3)1.7 (0.2)1.5 (0.2)1.3 (0.2)15/15
1plus1 brockhoff noiseless 10 (2)4.2 (1.0)2.2 (0.2)2.1 (0.2)2.0 (0.2)1.7 (0.1)1.5 (0.1)15/15
1plus2mirser brockhoff noiseless 9.2 (4)3.7 (0.8)1.8 (0.3)1.8 (0.3)1.7 (0.2)1.5 (0.1)1.3 (0.1)15/15
ABC elabd noiseless 1e60/15
AVGNEWUOA ros noiseless 37 (12)18 (2)10 (2)12 (2)14 (2)15 (2)15 (2)15/15
CMAEGS finck noiseless 90 (20)96 (243)40 (10)36 (170)32 (159)27 (0.5)23 (0.4)14/15
DE-F-AUC fialho noiseless 9.2 (2)3.6 (0.2)1.9 (0.2)2.1 (0.2)2.2 (0.1)2.4 (0.1)2.5 (0.1)15/15
DEuniform fialho noiseless 11 (1)4.6 (0.3)2.5 (0.2)2.8 (0.1)3.0 (0.1)3.3 (0.2)3.5 (0.1)15/15
IPOP-ACTCMA-ES ros noiseless 7.0 (0.6)2.0 (0.1)★40.89 (0.0)★40.84 (0.0)★40.80 (0.0)★40.73 (0.0)★40.68 (0.0)★415/15
IPOP-CMA-ES ros noiseless 13 (1)3.9 (0.3)1.7 (0.2)1.6 (0.1)1.5 (0.1)1.3 (0.1)1.2 (0.0)15/15
MOS torre noiseless 27 (3)8.1 (1)3.6 (0.3)3.4 (0.4)3.1 (0.3)2.8 (0.2)2.5 (0.2)15/15
NBC-CMA preuss noiseless 158 (36)43 (54)17 (27)15 (15)14 (9)11 (17)10 (12)15/15
PM-AdapSS-DE fialho noiseless 10 (0.8)4.0 (0.3)2.1 (0.1)2.3 (0.1)2.5 (0.1)2.7 (0.1)2.8 (0.0)15/15
RCGA tran noiseless 3815 (2077)5e50/15
SPSA finck noiseless 1e60/15
oPOEMS kubalic noiseless 210 (248)204 (15)153 (44)182 (77)206 (70)246 (28)260 (25)15/15
pPOEMS kubalic noiseless 207 (109)169 (44)117 (18)150 (16)166 (41)196 (38)213 (53)15/15

Δ fopt
f12, 10-D
1e1
515
1e0
896
1e-1
1240
1e-2
1390
1e-3
1569
1e-5
3660
1e-7
5154
#succ
15/15
1komma2 brockhoff noiseless 21 (30)24 (21)22 (13)23 (15)23 (11)12 (4)9.1 (4)15/15
1komma2mir brockhoff noiseless 8.9 (8)10 (8)9.4 (6)10 (7)10 (7)5.0 (3)4.0 (2)15/15
1komma2mirser brockhoff noiseless 7.3 (6)7.8 (8)7.5 (8)7.8 (5)7.9 (3)4.2 (2)3.3 (2)15/15
1komma2ser brockhoff noiseless 20 (24)23 (23)24 (20)25 (11)25 (10)13 (6)10 (3)14/15
1komma4 brockhoff noiseless 5.0 (5)6.9 (5)7.1 (2)7.5 (4)7.5 (3)3.9 (2)3.1 (1)15/15
1komma4mir brockhoff noiseless 3.5 (5)5.0 (5)5.5 (3)5.8 (4)5.8 (4)3.1 (1)2.5 (1)15/15
1komma4mirser brockhoff noiseless 3.5 (5)4.8 (3)5.1 (3)5.4 (3)5.4 (2)2.9 (0.9)2.3 (0.8)15/15
1komma4ser brockhoff noiseless 7.3 (5)6.9 (6)6.7 (5)6.9 (4)6.8 (3)3.5 (1)2.8 (1)15/15
1plus1 brockhoff noiseless 5.6 (9)6.0 (11)6.4 (6)6.7 (4)6.9 (5)3.6 (2)3.1 (3)15/15
1plus2mirser brockhoff noiseless 4.5 (8)6.2 (6)6.5 (5)6.7 (6)6.6 (4)3.4 (2)2.8 (2)15/15
ABC elabd noiseless 45 (73)101 (77)631 (1142)5044 (3058)9119 (6692)1e60/15
AVGNEWUOA ros noiseless 4.7 (11)8.0 (6)10 (7)12 (6)12 (5)6.9 (2)10 (5)12/15
CMAEGS finck noiseless 21 (22)26 (49)27 (41)29 (22)28 (26)16 (9)16 (10)15/15
DE-F-AUC fialho noiseless 16 (1)12 (3)13 (3)14 (4)15 (5)8.9 (3)7.6 (1)15/15
DEuniform fialho noiseless 24 (2)16 (0.9)17 (4)19 (3)21 (6)13 (3)11 (4)15/15
IPOP-ACTCMA-ES ros noiseless 3.3 (3)3.4 (3)3.7 (2)4.0 (3)4.1 (2)2.3 (1)1.9 (0.9)15/15
IPOP-CMA-ES ros noiseless 2.0 (0.1)2.6 (2)3.7 (2)4.4 (2)4.6 (1.0)2.7 (0.9)2.2 (0.9)15/15
MOS torre noiseless 9.1 (0.7)9.4 (4)11 (6)11 (6)12 (4)6.3 (2)5.0 (2)15/15
NBC-CMA preuss noiseless 3.4 (0.1)5.6 (6)7.1 (6)8.6 (4)9.0 (3)5.1 (3)4.2 (2)15/15
PM-AdapSS-DE fialho noiseless 19 (0.7)14 (0.6)15 (7)17 (8)19 (6)13 (4)11 (2)15/15
RCGA tran noiseless 120 (14)261 (143)1179 (1415)2405 (2700)5e50/15
SPSA finck noiseless 4253 (8801)1e60/15
oPOEMS kubalic noiseless 3020 (4372)6771 (4186)3.4e4 (6e4)3e60/15
pPOEMS kubalic noiseless 992 (1538)3370 (1720)1.0e4 (1e4)3.1e4 (3e4)2.7e4 (5e4)3e60/15

Δ fopt
f13, 10-D
1e1
387
1e0
596
1e-1
797
1e-2
1014
1e-3
4587
1e-5
6208
1e-7
7779
#succ
15/15
1komma2 brockhoff noiseless 17 (9)29 (45)51 (30)91 (154)42 (57)233 (201)1e50/15
1komma2mir brockhoff noiseless 10 (12)26 (36)37 (46)53 (49)24 (17)108 (49)1e50/15
1komma2mirser brockhoff noiseless 4.1 (3)15 (15)20 (9)46 (38)26 (13)110 (113)182 (360)0/15
1komma2ser brockhoff noiseless 19 (15)45 (32)99 (105)188 (242)99 (123)1e50/15
1komma4 brockhoff noiseless 6.5 (4)15 (16)18 (9)17 (12)9.3 (11)20 (18)27 (32)6/15
1komma4mir brockhoff noiseless 5.0 (3)13 (12)14 (10)13 (5)5.5 (7)15 (12)39 (71)3/15
1komma4mirser brockhoff noiseless 3.9 (5)6.4 (4)12 (7)12 (10)4.3 (4)6.1 (5)19 (22)6/15
1komma4ser brockhoff noiseless 6.4 (5)14 (7)13 (12)16 (7)6.3 (9)11 (11)26 (28)4/15
1plus1 brockhoff noiseless 3.1 (2)6.5 (6)6.1 (3)10 (5)2.5 (2)4.0 (5)5.9 (7)11/15
1plus2mirser brockhoff noiseless 4.3 (6)6.0 (4)7.0 (7)8.8 (9)2.8 (2)2.7 (3)6.6 (5)11/15
ABC elabd noiseless 19 (8)202 (443)2452 (1723)1e60/15
AVGNEWUOA ros noiseless 3.0 (6)13 (19)30 (38)76 (106)32 (68)278 (156)1e50/15
CMAEGS finck noiseless 6.2 (6)21 (20)316 (860)887 (994)196 (164)448 (846)1804 (2604)1/15
DE-F-AUC fialho noiseless 12 (1)12 (0.4)12 (0.5)11 (0.5)3.0 (0.1)3.0 (0.1)2.9 (0.1)15/15
DEuniform fialho noiseless 17 (1)17 (0.9)17 (0.5)16 (0.4)4.4 (0.1)4.3 (0.1)4.3 (0.1)15/15
IPOP-ACTCMA-ES ros noiseless 2.4 (1)3.5 (1)3.2 (1)3.3 (3)1.00 (0.2)1.0 (0.4)1.1 (0.5)15/15
IPOP-CMA-ES ros noiseless 3.8 (2)5.0 (3)5.1 (4)4.4 (3)1.2 (0.3)1.5 (1)1.6 (0.6)15/15
MOS torre noiseless 7.3 (0.5)12 (9)15 (9)12 (7)3.2 (2)3.1 (1)3.0 (1)15/15
NBC-CMA preuss noiseless 4.4 (0.3)10 (7)11 (7)9.0 (5)2.8 (2)3.2 (0.7)3.5 (2)15/15
PM-AdapSS-DE fialho noiseless 14 (1)14 (0.5)13 (0.6)13 (0.3)3.5 (0.0)3.4 (0.1)3.4 (0.1)15/15
RCGA tran noiseless 158 (148)1231 (1679)2677 (2509)7128 (1e4)5e50/15
SPSA finck noiseless 1.2e4 (8405)1e60/15
oPOEMS kubalic noiseless 85 (17)3449 (3780)1.5e4 (7529)1.9e4 (2e4)3e60/15
pPOEMS kubalic noiseless 291 (130)813 (2638)3188 (4708)1.3e4 (2e4)9358 (2e4)7024 (4228)3e60/15

Δ fopt
f14, 10-D
1e1
37
1e0
98
1e-1
133
1e-2
205
1e-3
392
1e-5
687
1e-7
4305
#succ
15/15
1komma2 brockhoff noiseless 9.0 (9)6.7 (2)6.9 (3)7.6 (2)7.9 (1)12 (3)4.3 (0.4)15/15
1komma2mir brockhoff noiseless 4.2 (2)3.7 (1)3.9 (1)4.2 (1)4.4 (0.7)7.7 (1)2.5 (0.2)15/15
1komma2mirser brockhoff noiseless 3.4 (2)2.8 (0.6)3.0 (0.6)3.3 (0.6)3.6 (0.6)6.7 (1)2.1 (0.2)15/15
1komma2ser brockhoff noiseless 10 (10)6.7 (2)7.1 (2)7.7 (3)7.6 (2)13 (3)4.0 (0.9)15/15
1komma4 brockhoff noiseless 2.8 (1)2.8 (0.4)3.2 (0.8)3.7 (0.7)3.6 (1.0)6.1 (1)1.8 (0.3)15/15
1komma4mir brockhoff noiseless 2.3 (3)2.4 (1)2.7 (0.5)3.0 (0.4)3.1 (0.4)5.5 (0.6)1.6 (0.3)15/15
1komma4mirser brockhoff noiseless 2.1 (1)1.9 (0.8)2.2 (0.6)2.5 (0.5)2.6 (0.5)4.4 (0.6)1.3 (0.1)15/15
1komma4ser brockhoff noiseless 2.8 (2)2.6 (1)2.9 (0.6)3.1 (0.5)3.1 (0.9)4.8 (0.9)1.4 (0.2)15/15
1plus1 brockhoff noiseless 2.0 (0.8)1.9 (0.5)2.3 (0.6)2.4 (0.5)2.4 (0.7)4.9 (1)1.1 (0.2)15/15
1plus2mirser brockhoff noiseless 1.8 (0.6)1.6 (0.2)2.0 (0.4)2.1 (0.6)2.1 (0.3)3.7 (1)1.0 (0.2)15/15
ABC elabd noiseless 6.4 (6)17 (10)22 (8)35 (7)702 (1248)1e60/15
AVGNEWUOA ros noiseless 1.7 (0.6)1.3 (0.3)1.3 (0.2)★31.2 (0.3)★31.1 (0.3)★47.1 (0.5)64 (1)0/15
CMAEGS finck noiseless 9.2 (3)5.7 (2)6.0 (2)6.2 (1)8.4 (1)26 (7)64 (59)11/15
DE-F-AUC fialho noiseless 10 (10)18 (3)26 (3)24 (3)16 (1)13 (0.6)2.8 (0.2)15/15
DEuniform fialho noiseless 9.4 (7)25 (2)34 (1)33 (2)22 (0.8)19 (0.5)4.1 (0.1)15/15
IPOP-ACTCMA-ES ros noiseless 2.1 (1)2.8 (0.8)3.7 (0.2)3.8 (0.5)3.1 (0.3)3.5 (0.2)0.84 (0.1)★315/15
IPOP-CMA-ES ros noiseless 2.2 (1)2.9 (0.6)3.8 (0.6)4.2 (0.4)3.8 (0.2)5.0 (0.3)1.3 (0.2)15/15
MOS torre noiseless 7.5 (6)13 (0.8)14 (2)14 (0.9)13 (4)14 (2)3.2 (0.3)15/15
NBC-CMA preuss noiseless 5.2 (3)5.7 (0.9)6.5 (1)6.3 (0.8)5.1 (0.4)7.1 (0.4)1.9 (0.2)15/15
PM-AdapSS-DE fialho noiseless 12 (5)22 (2)29 (2)27 (1)19 (0.6)15 (0.5)3.2 (0.1)15/15
RCGA tran noiseless 5.5 (4)30 (12)44 (11)91 (49)1052 (2502)5e50/15
SPSA finck noiseless 96 (122)75 (80)61 (56)49 (53)53 (115)1046 (1634)1e60/15
oPOEMS kubalic noiseless 73 (12)53 (15)104 (12)142 (3)116 (6)1490 (608)3e60/15
pPOEMS kubalic noiseless 73 (11)61 (8)192 (113)496 (182)569 (210)987 (97)3e60/15

Δ fopt
f15, 10-D
1e1
4774
1e0
39246
1e-1
73643
1e-2
74669
1e-3
75790
1e-5
77814
1e-7
79834
#succ
12/15
1komma2 brockhoff noiseless 1e50/15
1komma2mir brockhoff noiseless 72 (68)1e50/15
1komma2mirser brockhoff noiseless 62 (93)1e50/15
1komma2ser brockhoff noiseless 1e50/15
1komma4 brockhoff noiseless 146 (117)1e50/15
1komma4mir brockhoff noiseless 55 (74)1e50/15
1komma4mirser brockhoff noiseless 24 (24)1e50/15
1komma4ser brockhoff noiseless 137 (178)1e50/15
1plus1 brockhoff noiseless 148 (209)1e50/15
1plus2mirser brockhoff noiseless 143 (162)1e50/15
ABC elabd noiseless 1e60/15
AVGNEWUOA ros noiseless 231 (183)7e40/15
CMAEGS finck noiseless 17 (3)370 (382)1e60/15
DE-F-AUC fialho noiseless 65 (16)110 (250)194 (109)191 (234)188 (201)183 (241)179 (188)1/15
DEuniform fialho noiseless 68 (34)50 (103)93 (174)92 (153)91 (52)88 (62)86 (107)2/15
IPOP-ACTCMA-ES ros noiseless 0.91 (0.6)1.0 (0.5)0.83 (0.8)0.84 (0.7)0.84 (0.5)0.85 (0.7)0.86 (0.6)15/15
IPOP-CMA-ES ros noiseless 1.3 (0.3)1.0 (0.6)0.82 (0.5)0.82 (0.2)0.83 (0.6)0.84 (0.8)0.85 (0.5)15/15
MOS torre noiseless 1.3 (1)1.7 (1)1.3 (0.6)1.3 (0.7)1.3 (0.3)1.3 (0.6)1.3 (0.7)15/15
NBC-CMA preuss noiseless 2.5 (2)108 (159)3e50/15
PM-AdapSS-DE fialho noiseless 72 (118)18 (37)17 (8)26 (32)59 (33)1e60/15
RCGA tran noiseless 17 (34)86 (92)98 (88)97 (72)96 (38)93 (148)91 (102)1/15
SPSA finck noiseless 1e60/15
oPOEMS kubalic noiseless 321 (629)3e60/15
pPOEMS kubalic noiseless 140 (18)3e60/15

Δ fopt
f16, 10-D
1e1
425
1e0
7029
1e-1
15779
1e-2
45669
1e-3
51151
1e-5
65798
1e-7
71570
#succ
15/15
1komma2 brockhoff noiseless 553 (536)1e50/15
1komma2mir brockhoff noiseless 26 (23)96 (91)1e50/15
1komma2mirser brockhoff noiseless 32 (30)96 (112)1e50/15
1komma2ser brockhoff noiseless 780 (1203)1e50/15
1komma4 brockhoff noiseless 22 (29)45 (37)1e50/15
1komma4mir brockhoff noiseless 11 (23)14 (32)91 (90)1e50/15
1komma4mirser brockhoff noiseless 12 (10)24 (35)1e50/15
1komma4ser brockhoff noiseless 27 (22)97 (50)1e50/15
1plus1 brockhoff noiseless 5.2 (11)46 (55)1e50/15
1plus2mirser brockhoff noiseless 4.2 (5)97 (89)1e50/15
ABC elabd noiseless 3.3 (3)149 (210)1e60/15
AVGNEWUOA ros noiseless 3.3 (3)41 (29)1e50/15
CMAEGS finck noiseless 14 (41)20 (42)89 (145)308 (339)1e60/15
DE-F-AUC fialho noiseless 71 (39)1e60/15
DEuniform fialho noiseless 104 (86)1e60/15
IPOP-ACTCMA-ES ros noiseless 1.6 (0.4)0.95 (0.7)1.2 (0.7)0.84 (2)1.1 (2)0.92 (1.0)0.87 (1)15/15
IPOP-CMA-ES ros noiseless 3.5 (2)1.2 (0.4)1.2 (0.7)0.87 (1.0)0.90 (0.9)0.75 (0.7)0.71 (0.2)15/15
MOS torre noiseless 2.6 (0.5)0.55 (0.1)0.99 (2)1.2 (2)1.4 (2)1.2 (1)1.2 (1.0)15/15
NBC-CMA preuss noiseless 9.4 (11)0.71 (0.7)1.3 (2)1.8 (2)2.9 (0.9)11 (10)19 (18)2/15
PM-AdapSS-DE fialho noiseless 70 (43)1e60/15
RCGA tran noiseless 7.9 (6)13 (16)38 (33)50 (46)142 (112)5e50/15
SPSA finck noiseless 1240 (762)2107 (1210)1e60/15
oPOEMS kubalic noiseless 11 (6)3.8 (1)130 (285)428 (542)382 (367)298 (399)274 (231)2/15
pPOEMS kubalic noiseless 16 (10)18 (12)89 (59)189 (312)243 (337)192 (262)178 (157)3/15

Δ fopt
f17, 10-D
1e1
26
1e0
429
1e-1
2203
1e-2
6329
1e-3
9851
1e-5
20190
1e-7
26503
#succ
15/15
1komma2 brockhoff noiseless 121 (225)3360 (2098)1e50/15
1komma2mir brockhoff noiseless 5.6 (16)55 (81)196 (124)229 (257)1e50/15
1komma2mirser brockhoff noiseless 31 (0.9)52 (80)326 (301)1e50/15
1komma2ser brockhoff noiseless 208 (152)3341 (3438)1e50/15
1komma4 brockhoff noiseless 9.5 (29)82 (114)1e50/15
1komma4mir brockhoff noiseless 3.1 (3)22 (33)324 (365)1e50/15
1komma4mirser brockhoff noiseless 2.6 (0.7)51 (28)214 (413)1e50/15
1komma4ser brockhoff noiseless 3.5 (6)121 (126)1e50/15
1plus1 brockhoff noiseless 17 (57)442 (674)1e50/15
1plus2mirser brockhoff noiseless 6.3 (11)717 (736)1e50/15
ABC elabd noiseless 11 (10)953 (1721)1e60/15
AVGNEWUOA ros noiseless 2.3 (1)987 (2119)3e50/15
CMAEGS finck noiseless 6.3 (3)1.4 (0.3)0.77 (1)0.74 (0.8)2.0 (1)70 (130)530 (680)1/15
DE-F-AUC fialho noiseless 7.5 (5)8.0 (1.0)3.2 (0.4)1.8 (0.1)1.6 (0.1)1.5 (0.1)1.5 (0.1)15/15
DEuniform fialho noiseless 5.5 (9)11 (1)4.6 (0.4)2.7 (0.3)2.4 (0.1)2.0 (0.1)2.0 (0.1)15/15
IPOP-ACTCMA-ES ros noiseless 2.4 (2)1.2 (0.7)1.8 (2)1.2 (1)1.3 (1.0)1.0 (0.4)1.0 (0.6)15/15
IPOP-CMA-ES ros noiseless 2.7 (0.8)2.6 (6)1.5 (2)0.83 (0.5)1.0 (0.5)0.88 (0.3)1.0 (0.3)15/15
MOS torre noiseless 3.3 (2)30 (104)10 (31)4.1 (11)3.3 (6)3.8 (4)3.3 (10)15/15
NBC-CMA preuss noiseless 3.0 (4)1.8 (0.3)0.72 (0.1)0.87 (0.1)1.6 (3)31 (53)3e50/15
PM-AdapSS-DE fialho noiseless 4.7 (5)8.5 (1)3.6 (0.4)2.0 (0.1)1.8 (0.1)1.5 (0.1)1.5 (0.1)15/15
RCGA tran noiseless 5.9 (7)16 (13)48 (35)36 (57)40 (42)111 (124)5e50/15
SPSA finck noiseless 3.5e4 (7e4)3.3e4 (3e4)1e60/15
oPOEMS kubalic noiseless 87 (27)24 (20)111 (341)42 (1)84 (153)178 (223)1591 (1217)1/15
pPOEMS kubalic noiseless 92 (22)32 (17)72 (11)54 (11)52 (4)44 (2)146 (170)8/15

Δ fopt
f18, 10-D
1e1
238
1e0
836
1e-1
7012
1e-2
15928
1e-3
27536
1e-5
37234
1e-7
42708
#succ
15/15
1komma2 brockhoff noiseless 138 (270)1e50/15
1komma2mir brockhoff noiseless 1.8 (0.8)171 (216)1e50/15
1komma2mirser brockhoff noiseless 7.6 (10)224 (331)1e50/15
1komma2ser brockhoff noiseless 297 (308)1e50/15
1komma4 brockhoff noiseless 61 (15)383 (723)1e50/15
1komma4mir brockhoff noiseless 13 (19)82 (75)205 (182)1e50/15
1komma4mirser brockhoff noiseless 6.4 (17)137 (140)1e50/15
1komma4ser brockhoff noiseless 39 (69)811 (1465)1e50/15
1plus1 brockhoff noiseless 93 (171)1e50/15
1plus2mirser brockhoff noiseless 63 (86)1e50/15
ABC elabd noiseless 63 (216)7919 (1e4)1e60/15
AVGNEWUOA ros noiseless 73 (81)9e50/15
CMAEGS finck noiseless 1.8 (0.5)4.7 (26)3.7 (16)4.3 (5)23 (35)1e60/15
DE-F-AUC fialho noiseless 7.6 (1)6.5 (0.6)1.4 (0.1)0.96 (0.1)0.76 (0.0)0.90 (0.0)0.99 (0.0)15/15
DEuniform fialho noiseless 9.5 (3)9.0 (0.6)2.0 (0.1)1.3 (0.1)1.0 (0.0)1.2 (0.1)1.4 (0.0)15/15
IPOP-ACTCMA-ES ros noiseless 1.2 (0.3)1.6 (2)0.82 (0.7)0.97 (0.4)0.78 (0.3)0.80 (0.4)0.88 (0.3)15/15
IPOP-CMA-ES ros noiseless 1.1 (0.3)1.7 (0.3)0.95 (0.7)0.95 (0.6)0.84 (0.4)0.97 (0.3)0.91 (0.3)15/15
MOS torre noiseless 5.4 (0.7)3.5 (0.2)0.85 (0.1)1.2 (2)0.87 (0.4)1.1 (0.6)1.3 (0.5)15/15
NBC-CMA preuss noiseless 2.0 (0.4)1.5 (0.2)0.54 (0.5)2.4 (3)9.1 (6)118 (173)3e50/15
PM-AdapSS-DE fialho noiseless 8.4 (3)7.4 (0.5)1.6 (0.1)1.1 (0.1)0.81 (0.1)0.95 (0.0)1.0 (0.0)15/15
RCGA tran noiseless 8.2 (4)114 (61)36 (27)48 (37)58 (50)5e50/15
SPSA finck noiseless 1e60/15
oPOEMS kubalic noiseless 20 (4)285 (8)162 (321)287 (283)439 (463)3e60/15
pPOEMS kubalic noiseless 20 (12)116 (35)42 (7)46 (50)54 (111)123 (143)230 (211)2/15

Δ fopt
f19, 10-D
1e1
1
1e0
1
1e-1
10609
1e-2
9.8e5
1e-3
1.4e6
1e-5
1.4e6
1e-7
1.4e6
#succ
15/15
1komma2 brockhoff noiseless 514 (720)7.3e5 (1e6)1e50/15
1komma2mir brockhoff noiseless 128 (76)1.5e5 (1e5)1e50/15
1komma2mirser brockhoff noiseless 164 (282)2.2e5 (5e5)1e50/15
1komma2ser brockhoff noiseless 239 (210)1.5e6 (2e6)1e50/15
1komma4 brockhoff noiseless 82 (53)2.0e5 (6e5)1e50/15
1komma4mir brockhoff noiseless 68 (13)4.5e4 (6e4)1e50/15
1komma4mirser brockhoff noiseless 57 (24)4.3e4 (7e4)1e50/15
1komma4ser brockhoff noiseless 79 (58)7.6e4 (5e4)1e50/15
1plus1 brockhoff noiseless 63 (18)6.6e4 (7e4)1e50/15
1plus2mirser brockhoff noiseless 54 (22)2.2e4 (4e4)1e50/15
ABC elabd noiseless 410 (356)4.2e6 (4e6)1e60/15
AVGNEWUOA ros noiseless 48 (8)7.1e5 (8e5)1e60/15
CMAEGS finck noiseless 223 (95)2.8e4 (1e4)422 (883)1e60/15
DE-F-AUC fialho noiseless 303 (118)4.0e5 (4e5)1e60/15
DEuniform fialho noiseless 390 (243)8.4e5 (6e5)1e60/15
IPOP-ACTCMA-ES ros noiseless 68 (29)9042 (4197)10 (11)0.61 (0.2)0.53 (0.2)0.53 (0.2)0.54 (0.2)15/15
IPOP-CMA-ES ros noiseless 56 (33)1.3e4 (2e4)8.9 (12)0.55 (0.4)0.53 (0.3)0.53 (0.3)0.53 (0.2)15/15
MOS torre noiseless 212 (228)5852 (5136)6.5 (5)1.2 (0.3)1.1 (0.6)1.1 (0.4)1.1 (1)9/15
NBC-CMA preuss noiseless 117 (27)2.1e6 (2e6)3e50/15
PM-AdapSS-DE fialho noiseless 256 (236)5.5e5 (5e5)1e60/15
RCGA tran noiseless 167 (52)7.1e4 (4e4)157 (178)5e50/15
SPSA finck noiseless 658 (512)6.6e6 (7e6)1e60/15
oPOEMS kubalic noiseless 2538 (390)5.2e5 (8e5)4011 (3605)3e60/15
pPOEMS kubalic noiseless 2624 (324)3.6e5 (8e4)4022 (3464)3e60/15

Δ fopt
f20, 10-D
1e1
32
1e0
15426
1e-1
5.5e5
1e-2
5.7e5
1e-3
5.7e5
1e-5
5.8e5
1e-7
5.9e5
#succ
15/15
1komma2 brockhoff noiseless 12 (6)10 (15)1e50/15
1komma2mir brockhoff noiseless 6.7 (2)5.6 (5)1e50/15
1komma2mirser brockhoff noiseless 5.9 (3)2.3 (4)1e50/15
1komma2ser brockhoff noiseless 12 (4)9.5 (12)1e50/15
1komma4 brockhoff noiseless 5.3 (2)2.6 (0.9)1e50/15
1komma4mir brockhoff noiseless 4.4 (1)2.3 (1)1e50/15
1komma4mirser brockhoff noiseless 3.9 (1.0)2.6 (3)1e50/15
1komma4ser brockhoff noiseless 4.4 (1)3.1 (7)1e50/15
1plus1 brockhoff noiseless 3.8 (2)3.9 (2)1e50/15
1plus2mirser brockhoff noiseless 2.8 (2)3.3 (2)1e50/15
ABC elabd noiseless 10 (5)0.18 (0.1)★21.3 (0.9)1.3 (0.9)1.3 (2)2.1 (1)6.0 (7)1/15
AVGNEWUOA ros noiseless 1.2 (0)★237 (43)8e40/15
CMAEGS finck noiseless 11 (2)1e60/15
DE-F-AUC fialho noiseless 28 (4)18 (4)26 (21)25 (23)25 (35)25 (22)24 (27)1/15
DEuniform fialho noiseless 38 (11)15 (4)5.4 (9)5.3 (5)5.2 (7)5.1 (3)5.1 (7)4/15
IPOP-ACTCMA-ES ros noiseless 4.3 (2)2.3 (1)0.84 (0.3)0.86 (0.4)0.87 (0.3)0.88 (0.3)0.89 (0.3)15/15
IPOP-CMA-ES ros noiseless 4.6 (3)2.8 (2)0.78 (0.5)0.79 (0.3)0.79 (0.5)0.80 (0.5)0.81 (0.5)15/15
MOS torre noiseless 21 (6)0.76 (0.6)0.14 (0.2)0.19 (0.2)0.26 (0.3)0.30 (0.3)0.42 (0.1)14/15
NBC-CMA preuss noiseless 12 (1)5.9 (3)3e50/15
PM-AdapSS-DE fialho noiseless 31 (9)23 (12)1e60/15
RCGA tran noiseless 14 (4)484 (770)5e50/15
SPSA finck noiseless 19 (7)1e60/15
oPOEMS kubalic noiseless 104 (20)1.1 (0.3)15 (14)15 (16)15 (12)14 (19)14 (9)4/15
pPOEMS kubalic noiseless 103 (22)3.4 (2)15 (14)15 (8)15 (24)15 (19)15 (22)4/15

Δ fopt
f21, 10-D
1e1
130
1e0
2236
1e-1
4392
1e-2
4487
1e-3
4618
1e-5
5074
1e-7
11329
#succ
15/15
1komma2 brockhoff noiseless 18 (39)14 (8)22 (14)21 (14)21 (29)19 (18)8.4 (8)10/15
1komma2mir brockhoff noiseless 8.5 (5)11 (7)14 (13)14 (14)13 (12)12 (15)5.5 (7)11/15
1komma2mirser brockhoff noiseless 4.3 (7)5.4 (5)7.3 (10)7.1 (7)7.0 (8)6.4 (9)2.9 (2)15/15
1komma2ser brockhoff noiseless 39 (51)20 (26)18 (22)18 (17)17 (17)16 (17)7.2 (11)11/15
1komma4 brockhoff noiseless 6.2 (10)6.4 (3)11 (8)11 (18)10 (10)10 (10)4.3 (8)13/15
1komma4mir brockhoff noiseless 4.2 (7)6.7 (7)4.7 (3)4.6 (5)4.5 (4)4.1 (5)1.9 (2)15/15
1komma4mirser brockhoff noiseless 4.8 (5)4.3 (7)3.6 (3)3.5 (2)3.4 (3)3.1 (3)1.4 (1)15/15
1komma4ser brockhoff noiseless 7.0 (6)6.4 (7)6.9 (5)6.8 (6)6.6 (5)6.0 (6)2.7 (2)15/15
1plus1 brockhoff noiseless 4.2 (1)6.3 (1)4.4 (5)4.3 (5)4.2 (4)3.8 (4)1.7 (2)15/15
1plus2mirser brockhoff noiseless 4.1 (5)6.5 (8)6.0 (5)5.8 (11)5.7 (10)5.2 (2)2.3 (0.9)14/15
ABC elabd noiseless 8.0 (6)2.9 (2)8.5 (15)10 (20)12 (19)39 (27)82 (91)7/15
AVGNEWUOA ros noiseless 3.2 (4)8.2 (9)4.7 (7)4.7 (6)4.5 (5)4.1 (6)1.9 (2)15/15
CMAEGS finck noiseless 13 (24)101 (224)60 (70)59 (29)58 (51)55 (86)25 (13)12/15
DE-F-AUC fialho noiseless 23 (10)114 (224)84 (114)83 (167)81 (271)73 (148)33 (66)11/15
DEuniform fialho noiseless 25 (11)115 (0.9)115 (114)113 (223)110 (55)101 (148)45 (66)10/15
IPOP-ACTCMA-ES ros noiseless 2.6 (1.0)31 (155)58 (76)57 (81)55 (111)50 (36)23 (59)11/15
IPOP-CMA-ES ros noiseless 5.9 (11)14 (18)52 (116)51 (28)50 (78)45 (70)21 (29)12/15
MOS torre noiseless 25 (23)347 (830)512 (583)503 (704)489 (494)447 (708)201 (428)10/15
NBC-CMA preuss noiseless 12 (33)275 (335)188 (239)184 (150)179 (211)163 (133)73 (146)4/15
PM-AdapSS-DE fialho noiseless 18 (9)226 (447)262 (456)256 (390)249 (325)227 (296)102 (132)6/15
RCGA tran noiseless 121 (464)120 (296)86 (95)86 (55)86 (54)82 (68)38 (64)10/15
SPSA finck noiseless 94 (31)1309 (1008)1543 (1651)1515 (1362)1488 (2545)2780 (2809)1272 (706)1/15
oPOEMS kubalic noiseless 3503 (2748)2668 (3690)1648 (1856)1615 (1320)1570 (1115)1431 (1513)642 (615)5/15
pPOEMS kubalic noiseless 38 (10)746 (683)980 (1196)1122 (1506)1317 (1945)1210 (1480)547 (530)5/15

Δ fopt
f22, 10-D
1e1
98
1e0
2839
1e-1
6353
1e-2
6620
1e-3
6798
1e-5
8296
1e-7
10351
#succ
15/15
1komma2 brockhoff noiseless 19 (27)9.2 (12)30 (63)29 (15)28 (25)23 (24)19 (15)6/15
1komma2mir brockhoff noiseless 18 (18)9.3 (15)18 (15)17 (12)16 (18)14 (9)11 (9)9/15
1komma2mirser brockhoff noiseless 20 (17)11 (14)25 (29)24 (16)24 (17)19 (24)16 (19)7/15
1komma2ser brockhoff noiseless 62 (180)12 (11)40 (76)39 (27)38 (55)31 (20)25 (33)5/15
1komma4 brockhoff noiseless 15 (29)7.0 (20)10 (4)9.3 (9)9.1 (11)7.5 (6)6.1 (12)12/15
1komma4mir brockhoff noiseless 12 (20)6.6 (11)12 (6)11 (10)11 (13)8.9 (4)7.2 (9)13/15
1komma4mirser brockhoff noiseless 8.2 (11)4.1 (1)14 (27)14 (6)14 (31)11 (5)8.9 (12)9/15
1komma4ser brockhoff noiseless 16 (27)8.4 (12)13 (11)13 (16)12 (8)10 (11)8.2 (11)11/15
1plus1 brockhoff noiseless 9.2 (10)4.5 (3)4.0 (5)3.8 (5)3.8 (3)3.1 (4)2.5 (5)14/15
1plus2mirser brockhoff noiseless 22 (23)4.5 (3)5.0 (7)4.8 (6)4.7 (7)3.9 (4)3.1 (4)14/15
ABC elabd noiseless 17 (19)4.3 (4)34 (34)364 (143)1e60/15
AVGNEWUOA ros noiseless 3.6 (4)2.6 (3)2.1 (2)2.1 (4)2.0 (4)1.7 (3)1.4 (1)14/15
CMAEGS finck noiseless 22 (34)417 (706)1024 (1338)982 (1020)957 (1140)784 (543)628 (1136)2/15
DE-F-AUC fialho noiseless 32 (18)706 (793)1e60/15
DEuniform fialho noiseless 31 (14)405 (881)2206 (4171)2117 (2379)2061 (3310)1689 (1989)1354 (1522)1/15
IPOP-ACTCMA-ES ros noiseless 44 (117)203 (281)663 (610)636 (780)620 (722)508 (427)407 (327)2/15
IPOP-CMA-ES ros noiseless 42 (10)90 (55)666 (433)640 (551)623 (757)511 (952)409 (510)2/15
MOS torre noiseless 170 (303)538 (978)1268 (2501)1218 (859)1187 (321)974 (1031)781 (587)5/15
NBC-CMA preuss noiseless 791 (828)221 (159)3e50/15
PM-AdapSS-DE fialho noiseless 28 (14)706 (616)1e60/15
RCGA tran noiseless 710 (625)205 (322)343 (504)520 (585)5e50/15
SPSA finck noiseless 2950 (1e4)831 (1489)1e60/15
oPOEMS kubalic noiseless 4767 (2e4)4231 (5812)3072 (2833)2949 (2492)2873 (3751)2357 (3074)1892 (4637)2/15
pPOEMS kubalic noiseless 2255 (2e4)363 (1055)424 (829)412 (455)404 (882)338 (271)276 (441)8/15

Δ fopt
f23, 10-D
1e1
3.0
1e0
915
1e-1
16425
1e-2
1.8e5
1e-3
2.0e5
1e-5
2.1e5
1e-7
2.1e5
#succ
15/15
1komma2 brockhoff noiseless 35 (67)1557 (738)1e50/15
1komma2mir brockhoff noiseless 4.4 (5)68 (39)1e50/15
1komma2mirser brockhoff noiseless 8.1 (19)70 (83)1e50/15
1komma2ser brockhoff noiseless 42 (150)797 (818)1e50/15
1komma4 brockhoff noiseless 7.0 (8)33 (28)1e50/15
1komma4mir brockhoff noiseless 5.3 (11)33 (50)1e50/15
1komma4mirser brockhoff noiseless 4.7 (13)15 (17)91 (62)1e50/15
1komma4ser brockhoff noiseless 5.4 (2)58 (102)1e50/15
1plus1 brockhoff noiseless 6.0 (6)4.5 (4)1e50/15
1plus2mirser brockhoff noiseless 4.8 (14)4.5 (4)1e50/15
ABC elabd noiseless 2.3 (2)33 (38)1e60/15
AVGNEWUOA ros noiseless 10 (6)2.6 (2)1e50/15
CMAEGS finck noiseless 32 (15)397 (337)1e60/15
DE-F-AUC fialho noiseless 2.2 (2)85 (52)160 (233)1e60/15
DEuniform fialho noiseless 1.4 (0.5)97 (90)278 (409)80 (197)72 (45)70 (178)69 (46)1/15
IPOP-ACTCMA-ES ros noiseless 1.6 (2)458 (622)2e60/15
IPOP-CMA-ES ros noiseless 2.2 (2)376 (552)308 (313)65 (78)59 (53)57 (93)56 (64)2/15
MOS torre noiseless 1.6 (2)24 (13)15 (13)4.0 (5)3.6 (3)3.6 (2)3.5 (4)11/15
NBC-CMA preuss noiseless 1.3 (0.7)692 (405)3e50/15
PM-AdapSS-DE fialho noiseless 1.5 (0.8)81 (44)1e60/15
RCGA tran noiseless 2.3 (2)162 (258)436 (198)5e50/15
SPSA finck noiseless 976 (664)3799 (4826)1e60/15
oPOEMS kubalic noiseless 8.5 (11)26 (20)50 (92)107 (110)3e60/15
pPOEMS kubalic noiseless 5.3 (8)161 (152)77 (10)111 (86)211 (291)3e60/15

Δ fopt
f24, 10-D
1e1
98761
1e0
1.0e6
1e-1
7.5e7
1e-2
7.5e7
1e-3
7.5e7
1e-5
7.5e7
1e-7
7.5e7
#succ
1/15
1komma2 brockhoff noiseless 1e50/15
1komma2mir brockhoff noiseless 1e50/15
1komma2mirser brockhoff noiseless 1e50/15
1komma2ser brockhoff noiseless 1e50/15
1komma4 brockhoff noiseless 15 (15)1e50/15
1komma4mir brockhoff noiseless 4.8 (6)1e50/15
1komma4mirser brockhoff noiseless 1e50/15
1komma4ser brockhoff noiseless 1e50/15
1plus1 brockhoff noiseless 1e50/15
1plus2mirser brockhoff noiseless 4.8 (6)1e50/15
ABC elabd noiseless 1e60/15
AVGNEWUOA ros noiseless 8e40/15
CMAEGS finck noiseless 3.6 (5)1e60/15
DE-F-AUC fialho noiseless 47 (41)1e60/15
DEuniform fialho noiseless 47 (18)1e60/15
IPOP-ACTCMA-ES ros noiseless 50 (88)33 (19)2e60/15
IPOP-CMA-ES ros noiseless 24 (26)6.9 (4)0.48 (1)0.48 (0.4)0.48 (0.4)0.48 (0.4)2e60/15
MOS torre noiseless 5.8 (11)2.9 (4)0.26 (0.4)0.26 (0.6)0.26 (0.3)0.26 (0.3)0.26 (0.2)1/15
NBC-CMA preuss noiseless 3e50/15
PM-AdapSS-DE fialho noiseless 69 (53)1e60/15
RCGA tran noiseless 37 (32)5e50/15
SPSA finck noiseless 1e60/15
oPOEMS kubalic noiseless 122 (197)3e60/15
pPOEMS kubalic noiseless 24 (53)3e60/15

Previous dimension | Dimension = 20 | Next dimension

Δ fopt
f1, 20-D
1e1
43
1e0
43
1e-1
43
1e-2
43
1e-3
43
1e-5
43
1e-7
43
#succ
15/15
1komma2 brockhoff noiseless 15 (3)25 (6)34 (4)44 (8)53 (7)72 (9)93 (13)15/15
1komma2mir brockhoff noiseless 8.9 (2)15 (1)20 (3)25 (4)30 (3)41 (3)52 (3)15/15
1komma2mirser brockhoff noiseless 8.1 (0.9)13 (1)18 (3)22 (2)27 (3)36 (3)47 (6)15/15
1komma2ser brockhoff noiseless 17 (3)26 (7)35 (6)44 (4)53 (7)72 (7)89 (11)15/15
1komma4 brockhoff noiseless 7.7 (2)13 (2)18 (3)23 (3)27 (4)38 (4)49 (5)15/15
1komma4mir brockhoff noiseless 6.2 (0.9)11 (2)15 (2)19 (2)24 (1)32 (2)42 (2)15/15
1komma4mirser brockhoff noiseless 4.7 (0.4)8.1 (0.8)11 (2)14 (2)18 (1)24 (2)31 (4)15/15
1komma4ser brockhoff noiseless 6.3 (1)11 (2)15 (1)19 (1)23 (2)31 (2)40 (2)15/15
1plus1 brockhoff noiseless 5.5 (0.9)10 (1)14 (1)18 (2)21 (2)29 (2)37 (2)15/15
1plus2mirser brockhoff noiseless 4.9 (2)8.5 (1)12 (2)15 (2)19 (1)26 (3)33 (3)15/15
ABC elabd noiseless 36 (25)66 (41)94 (48)136 (68)177 (73)292 (7)374 (27)15/15
AVGNEWUOA ros noiseless 2.3 (0.0)★42.3 (0.0)★42.3 (0.0)★42.3 (0.0)★42.3 (0.0)★42.3 (0.0)★42.3 (0.0)★415/15
CMAEGS finck noiseless 13 (0.9)19 (2)26 (2)33 (2)40 (2)54 (2)68 (2)15/15
DE-F-AUC fialho noiseless 93 (11)180 (19)265 (25)350 (18)431 (51)597 (41)763 (41)15/15
DEuniform fialho noiseless 146 (20)298 (20)442 (19)588 (21)734 (20)1027 (22)1319 (28)15/15
IPOP-ACTCMA-ES ros noiseless 7.9 (2)14 (1)20 (2)27 (1)33 (2)45 (2)58 (3)15/15
IPOP-CMA-ES ros noiseless 8.0 (1)14 (2)20 (2)26 (2)33 (2)46 (2)58 (2)15/15
MOS torre noiseless 34 (2)58 (2)68 (2)91 (4)123 (4)148 (10)200 (4)15/15
NBC-CMA preuss noiseless 13 (2)21 (0.8)30 (1)38 (2)46 (1)62 (2)79 (3)15/15
PM-AdapSS-DE fialho noiseless 101 (15)196 (4)291 (10)377 (15)465 (19)646 (20)827 (10)15/15
RCGA tran noiseless 55 (11)133 (26)868 (583)2715 (366)3825 (224)5435 (100)6380 (100)15/15
SPSA finck noiseless 12 (4)16 (5)20 (5)25 (12)29 (8)38 (11)46 (15)15/15
oPOEMS kubalic noiseless 183 (12)411 (83)853 (121)1372 (70)1783 (53)2828 (76)3744 (71)15/15
pPOEMS kubalic noiseless 196 (16)468 (58)1052 (337)1852 (1272)2567 (2048)4501 (1896)7123 (2659)15/15

Δ fopt
f2, 20-D
1e1
385
1e0
386
1e-1
387
1e-2
388
1e-3
390
1e-5
391
1e-7
393
#succ
15/15
1komma2 brockhoff noiseless 155 (25)168 (15)172 (16)175 (13)177 (10)181 (12)184 (13)15/15
1komma2mir brockhoff noiseless 71 (13)80 (4)82 (11)83 (4)84 (5)85 (4)86 (3)15/15
1komma2mirser brockhoff noiseless 61 (6)67 (3)69 (3)69 (2)70 (3)71 (2)72 (5)15/15
1komma2ser brockhoff noiseless 165 (30)183 (23)188 (16)193 (11)196 (15)200 (16)205 (17)15/15
1komma4 brockhoff noiseless 54 (8)62 (5)65 (6)67 (2)68 (3)69 (3)70 (3)15/15
1komma4mir brockhoff noiseless 45 (7)51 (5)54 (4)55 (2)56 (2)57 (3)58 (2)15/15
1komma4mirser brockhoff noiseless 34 (5)39 (4)41 (0.8)41 (4)42 (3)43 (0.9)43 (2)15/15
1komma4ser brockhoff noiseless 43 (11)51 (6)53 (6)54 (3)55 (3)57 (3)58 (3)15/15
1plus1 brockhoff noiseless 32 (3)38 (4)41 (4)42 (2)43 (2)44 (2)45 (3)15/15
1plus2mirser brockhoff noiseless 29 (3)33 (4)35 (3)35 (2)36 (1)37 (1.0)37 (2)15/15
ABC elabd noiseless 12 (3)★216 (4)★323 (6)30 (6)40 (5)56 (6)70 (6)15/15
AVGNEWUOA ros noiseless 21 (11)43 (17)63 (31)88 (35)115 (28)161 (16)199 (31)15/15
CMAEGS finck noiseless 73 (9)79 (4)82 (4)82 (4)83 (4)85 (5)86 (3)15/15
DE-F-AUC fialho noiseless 48 (4)58 (4)68 (6)77 (8)86 (9)105 (7)123 (8)15/15
DEuniform fialho noiseless 77 (2)92 (1.0)108 (3)124 (4)140 (3)172 (2)204 (3)15/15
IPOP-ACTCMA-ES ros noiseless 22 (3)27 (2)29 (3)30 (3)31 (1)★333 (2)★334 (2)★315/15
IPOP-CMA-ES ros noiseless 35 (7)41 (4)43 (3)44 (2)45 (2)47 (1)48 (2)15/15
MOS torre noiseless 44 (3)50 (26)57 (20)61 (23)67 (29)74 (24)82 (13)15/15
NBC-CMA preuss noiseless 58 (11)73 (10)82 (6)87 (8)90 (8)95 (5)98 (5)15/15
PM-AdapSS-DE fialho noiseless 52 (2)63 (1)73 (3)83 (2)93 (3)112 (3)132 (3)15/15
RCGA tran noiseless 384 (40)930 (1357)4442 (3893)4527 (9652)1.7e4 (2e4)1e60/15
SPSA finck noiseless 2e60/15
oPOEMS kubalic noiseless 247 (20)295 (24)345 (21)407 (28)450 (15)561 (25)663 (9)15/15
pPOEMS kubalic noiseless 305 (161)423 (307)512 (277)660 (308)744 (420)1214 (578)1405 (730)15/15

Δ fopt
f3, 20-D
1e1
5066
1e0
7626
1e-1
7635
1e-2
7637
1e-3
7643
1e-5
7646
1e-7
7651
#succ
15/15
1komma2 brockhoff noiseless 2e50/15
1komma2mir brockhoff noiseless 2e50/15
1komma2mirser brockhoff noiseless 2e50/15
1komma2ser brockhoff noiseless 2e50/15
1komma4 brockhoff noiseless 2e50/15
1komma4mir brockhoff noiseless 2e50/15
1komma4mirser brockhoff noiseless 2e50/15
1komma4ser brockhoff noiseless 2e50/15
1plus1 brockhoff noiseless 2e50/15
1plus2mirser brockhoff noiseless 2e50/15
ABC elabd noiseless 1.5 (0.7)2.7 (1)3.0 (0.6)3.2 (1)3.6 (1.0)4.1 (0.9)4.9 (2)15/15
AVGNEWUOA ros noiseless 2e50/15
CMAEGS finck noiseless 1214 (1393)2e60/15
DE-F-AUC fialho noiseless 2e60/15
DEuniform fialho noiseless 2e60/15
IPOP-ACTCMA-ES ros noiseless 10 (7)3e60/15
IPOP-CMA-ES ros noiseless 13 (10)3e60/15
MOS torre noiseless 4.7 (6)7.4 (5)8.9 (8)9.4 (9)10 (6)11 (8)12 (9)15/15
NBC-CMA preuss noiseless 839 (444)3e50/15
PM-AdapSS-DE fialho noiseless 2e60/15
RCGA tran noiseless 27 (5)1867 (393)1e60/15
SPSA finck noiseless 2e60/15
oPOEMS kubalic noiseless 10 (1)64 (5)135 (123)136 (18)140 (121)145 (139)151 (169)15/15
pPOEMS kubalic noiseless 13 (7)57 (47)105 (65)107 (56)109 (52)119 (50)132 (40)15/15

Δ fopt
f4, 20-D
1e1
4722
1e0
7628
1e-1
7666
1e-2
7686
1e-3
7700
1e-5
7758
1e-7
1.4e5
#succ
9/15
1komma2 brockhoff noiseless 2e50/15
1komma2mir brockhoff noiseless 2e50/15
1komma2mirser brockhoff noiseless 2e50/15
1komma2ser brockhoff noiseless 2e50/15
1komma4 brockhoff noiseless 2e50/15
1komma4mir brockhoff noiseless 2e50/15
1komma4mirser brockhoff noiseless 2e50/15
1komma4ser brockhoff noiseless 2e50/15
1plus1 brockhoff noiseless 2e50/15
1plus2mirser brockhoff noiseless 2e50/15
ABC elabd noiseless 2.0 (1)★34.2 (2)★45.6 (0.6)★26.0 (3)★26.3 (2)★27.3 (5)★20.45 (0.1)★215/15
AVGNEWUOA ros noiseless 3e50/15
CMAEGS finck noiseless 2e60/15
DE-F-AUC fialho noiseless 2e60/15
DEuniform fialho noiseless 2e60/15
IPOP-ACTCMA-ES ros noiseless 3e60/15
IPOP-CMA-ES ros noiseless 3e60/15
MOS torre noiseless 10 (5)12 (5)14 (5)14 (5)15 (6)16 (5)0.93 (0.3)15/15
NBC-CMA preuss noiseless 3e50/15
PM-AdapSS-DE fialho noiseless 2e60/15
RCGA tran noiseless 1e60/15
SPSA finck noiseless 2e60/15
oPOEMS kubalic noiseless 14 (3)109 (46)307 (260)308 (302)310 (273)313 (213)18 (13)15/15
pPOEMS kubalic noiseless 31 (21)254 (444)1043 (984)1054 (443)1056 (1231)1054 (1185)59 (64)7/15

Δ fopt
f5, 20-D
1e1
41
1e0
41
1e-1
41
1e-2
41
1e-3
41
1e-5
41
1e-7
41
#succ
15/15
1komma2 brockhoff noiseless 6.1 (2)7.0 (1)7.1 (2)7.1 (4)7.2 (4)7.2 (1)7.2 (5)15/15
1komma2mir brockhoff noiseless 3.5 (1)4.3 (1)4.4 (1)4.4 (1)4.4 (1)4.4 (1)4.4 (1)15/15
1komma2mirser brockhoff noiseless 3.3 (1)3.9 (1)4.1 (2)4.1 (2)4.1 (2)4.1 (0.7)4.1 (2)15/15
1komma2ser brockhoff noiseless 6.5 (2)7.6 (3)7.8 (2)8.2 (3)8.2 (3)8.2 (2)8.2 (1)15/15
1komma4 brockhoff noiseless 5.0 (2)6.1 (2)6.4 (1)6.4 (1)6.4 (3)6.4 (2)6.4 (2)15/15
1komma4mir brockhoff noiseless 3.7 (1)4.3 (0.8)4.5 (1)4.5 (1)4.5 (1)4.5 (1)4.5 (2)15/15
1komma4mirser brockhoff noiseless 2.6 (0.9)3.2 (1)3.3 (0.9)3.3 (0.9)3.3 (0.9)3.3 (0.8)3.3 (0.8)15/15
1komma4ser brockhoff noiseless 4.1 (2)4.9 (3)5.3 (2)5.3 (2)5.3 (2)5.3 (2)5.3 (2)15/15
1plus1 brockhoff noiseless 3.1 (0.8)3.6 (0.9)3.7 (0.9)3.7 (1)3.7 (1)3.7 (1)3.7 (1)15/15
1plus2mirser brockhoff noiseless 2.5 (1)3.0 (0.4)3.1 (0.4)3.2 (0.7)3.2 (0.7)3.2 (2)3.2 (1)15/15
ABC elabd noiseless 68 (17)89 (38)92 (27)92 (34)92 (41)92 (41)92 (43)15/15
AVGNEWUOA ros noiseless 2.7 (0.2)3.2 (0.7)3.3 (0.9)3.3 (0.3)3.3 (1)3.3 (0.5)3.3 (0.9)15/15
CMAEGS finck noiseless 5.2 (0.4)5.7 (1)5.9 (0.8)5.9 (0.7)5.9 (0.9)5.9 (0.3)5.9 (0.5)15/15
DE-F-AUC fialho noiseless 41 (14)52 (27)53 (8)53 (25)53 (14)53 (8)53 (21)15/15
DEuniform fialho noiseless 69 (29)83 (16)84 (29)85 (35)85 (30)85 (14)85 (28)15/15
IPOP-ACTCMA-ES ros noiseless 5.0 (0.3)6.1 (1)6.1 (1)6.2 (1)6.2 (1)6.2 (0.7)6.2 (0.8)15/15
IPOP-CMA-ES ros noiseless 5.7 (0.7)6.5 (1.0)6.6 (2)6.6 (1)6.6 (0.9)6.6 (0.9)6.6 (1)15/15
MOS torre noiseless 50 (2)52 (1)52 (1)52 (1)52 (1)52 (1)52 (1)15/15
NBC-CMA preuss noiseless 6509 (9406)1.3e4 (1e4)1.3e4 (2e4)1.3e4 (1e4)1.3e4 (1e4)1.3e4 (1e4)1.3e4 (1e4)6/15
PM-AdapSS-DE fialho noiseless 81 (28)91 (31)95 (21)95 (29)95 (15)95 (17)95 (15)15/15
RCGA tran noiseless 552 (66)3155 (307)5182 (138)6422 (106)7190 (98)9793 (55)1e60/15
SPSA finck noiseless 6.3 (2)7.8 (3)8.0 (4)8.1 (3)8.1 (3)8.1 (2)8.1 (3)15/15
oPOEMS kubalic noiseless 252 (23)307 (28)327 (3)340 (16)345 (24)349 (37)349 (32)15/15
pPOEMS kubalic noiseless 251 (25)305 (23)335 (25)345 (17)351 (48)357 (38)357 (31)15/15

Δ fopt
f6, 20-D
1e1
1296
1e0
2343
1e-1
3413
1e-2
4255
1e-3
5220
1e-5
6728
1e-7
8409
#succ
15/15
1komma2 brockhoff noiseless 8.9 (6)12 (13)26 (24)78 (79)567 (718)2e50/15
1komma2mir brockhoff noiseless 2.2 (0.3)1.8 (0.4)1.8 (0.5)2.1 (1)2.5 (2)3.5 (5)6.7 (7)13/15
1komma2mirser brockhoff noiseless 1.9 (0.5)1.6 (0.4)1.5 (0.3)1.5 (0.5)1.7 (0.3)2.1 (0.7)3.1 (2)12/15
1komma2ser brockhoff noiseless 15 (16)41 (48)133 (46)670 (682)2e50/15
1komma4 brockhoff noiseless 2.1 (0.3)1.9 (0.5)2.0 (0.5)2.2 (0.6)2.5 (0.8)3.6 (1)7.4 (10)13/15
1komma4mir brockhoff noiseless 2.0 (0.5)1.6 (0.4)1.6 (0.6)1.6 (0.3)1.5 (0.3)1.8 (0.3)2.2 (1.0)15/15
1komma4mirser brockhoff noiseless 1.3 (0.3)1.1 (0.2)1.0 (0.3)1.1 (0.2)1.2 (0.4)1.7 (0.5)2.5 (2)15/15
1komma4ser brockhoff noiseless 2.0 (0.7)2.0 (0.9)2.4 (1)3.1 (2)4.8 (2)22 (14)342 (363)0/15
1plus1 brockhoff noiseless 13 (20)92 (107)831 (1055)2e50/15
1plus2mirser brockhoff noiseless 12 (25)107 (97)846 (1113)2e50/15
ABC elabd noiseless 46 (13)453 (453)2587 (4835)2e60/15
AVGNEWUOA ros noiseless 1.00 (0.2)0.74 (0.2)★30.72 (0.2)★30.71 (0.1)★30.70 (0.1)★40.74 (0.0)★40.73 (0.1)★415/15
CMAEGS finck noiseless 3.7 (1)3.2 (0.7)3.7 (2)7.5 (11)45 (114)874 (820)1036 (889)3/15
DE-F-AUC fialho noiseless 19 (2)15 (1)14 (0.9)14 (1)14 (0.6)14 (0.5)14 (0.3)15/15
DEuniform fialho noiseless 29 (2)23 (1)20 (1)20 (1)20 (0.6)20 (0.5)20 (0.5)15/15
IPOP-ACTCMA-ES ros noiseless 1.6 (0.4)1.3 (0.3)1.1 (0.2)1.1 (0.2)1.1 (0.1)1.1 (0.1)1.1 (0.1)15/15
IPOP-CMA-ES ros noiseless 1.7 (0.3)1.3 (0.1)1.2 (0.1)1.2 (0.2)1.2 (0.2)1.2 (0.1)1.2 (0.1)15/15
MOS torre noiseless 5.5 (1.0)3.9 (0.2)3.4 (0.6)3.2 (0.4)3.0 (0.3)3.0 (0.4)2.8 (0.2)15/15
NBC-CMA preuss noiseless 50 (184)28 (39)19 (8)16 (22)13 (17)10 (14)8.6 (36)13/15
PM-AdapSS-DE fialho noiseless 20 (1)16 (1)15 (0.9)14 (0.9)14 (0.8)14 (0.6)14 (0.5)15/15
RCGA tran noiseless 52 (11)60 (3)56 (2)54 (2)51 (2)2128 (2081)1e60/15
SPSA finck noiseless 2e60/15
oPOEMS kubalic noiseless 32 (4)28 (2)26 (1)26 (1)26 (0.8)27 (0.7)27 (0.8)15/15
pPOEMS kubalic noiseless 36 (3)32 (2)32 (7)34 (1)34 (2)35 (4)38 (3)15/15

Δ fopt
f7, 20-D
1e1
1351
1e0
4274
1e-1
9503
1e-2
16523
1e-3
16524
1e-5
16524
1e-7
16969
#succ
15/15
1komma2 brockhoff noiseless 2e50/15
1komma2mir brockhoff noiseless 71 (71)2e50/15
1komma2mirser brockhoff noiseless 71 (78)2e50/15
1komma2ser brockhoff noiseless 2e50/15
1komma4 brockhoff noiseless 118 (143)2e50/15
1komma4mir brockhoff noiseless 23 (15)2e50/15
1komma4mirser brockhoff noiseless 37 (42)2e50/15
1komma4ser brockhoff noiseless 275 (315)2e50/15
1plus1 brockhoff noiseless 24 (10)41 (33)37 (43)177 (357)177 (151)177 (130)172 (189)1/15
1plus2mirser brockhoff noiseless 24 (10)54 (62)96 (107)181 (94)181 (148)181 (182)176 (262)1/15
ABC elabd noiseless 251 (121)2e60/15
AVGNEWUOA ros noiseless 101 (99)4e50/15
CMAEGS finck noiseless 21 (64)2e60/15
DE-F-AUC fialho noiseless 5.2 (0.4)3.1 (0.4)1.9 (0.2)1.6 (0.2)1.6 (0.1)1.6 (0.1)1.6 (0.1)15/15
DEuniform fialho noiseless 8.4 (0.5)5.2 (0.1)3.3 (0.1)2.6 (0.2)2.7 (0.2)2.7 (0.1)2.7 (0.1)15/15
IPOP-ACTCMA-ES ros noiseless 1.6 (1)2.7 (1)1.6 (0.5)0.99 (0.3)★30.99 (0.3)★30.99 (0.3)★31.0 (0.3)★315/15
IPOP-CMA-ES ros noiseless 1.9 (1)4.8 (2)2.7 (1)1.7 (0.7)1.7 (0.1)1.7 (1.0)1.6 (0.4)15/15
MOS torre noiseless 2.7 (0.8)6.0 (2)3.9 (1)2.4 (0.8)2.4 (0.7)2.4 (0.8)2.3 (0.3)15/15
NBC-CMA preuss noiseless 1.3 (0.7)31 (21)225 (166)3e50/15
PM-AdapSS-DE fialho noiseless 5.9 (0.4)3.4 (0.2)2.1 (0.1)1.6 (0.1)1.6 (0.1)1.6 (0.1)1.7 (0.1)15/15
RCGA tran noiseless 13 (9)1111 (1312)1e60/15
SPSA finck noiseless 2e60/15
oPOEMS kubalic noiseless 23 (6)1968 (1192)6e60/15
pPOEMS kubalic noiseless 22 (3)280 (715)1778 (1588)2412 (1646)2412 (2717)2412 (3183)2349 (3447)2/15

Δ fopt
f8, 20-D
1e1
2039
1e0
3871
1e-1
4040
1e-2
4148
1e-3
4219
1e-5
4371
1e-7
4484
#succ
15/15
1komma2 brockhoff noiseless 10 (5)19 (27)20 (16)20 (20)20 (8)20 (2)20 (13)14/15
1komma2mir brockhoff noiseless 5.3 (4)7.8 (4)8.2 (7)8.3 (6)8.3 (7)8.2 (5)8.1 (6)15/15
1komma2mirser brockhoff noiseless 3.6 (1)4.5 (2)4.8 (0.9)5.0 (2)5.0 (1.0)5.0 (0.8)5.0 (0.5)15/15
1komma2ser brockhoff noiseless 12 (3)17 (3)18 (26)18 (3)19 (3)19 (13)18 (0.9)14/15
1komma4 brockhoff noiseless 4.9 (1)7.7 (5)8.0 (4)8.0 (3)8.1 (3)8.0 (3)8.0 (4)15/15
1komma4mir brockhoff noiseless 3.6 (1)5.8 (4)6.0 (3)6.1 (3)6.1 (3)6.1 (3)6.1 (3)15/15
1komma4mirser brockhoff noiseless 3.3 (0.7)5.8 (8)5.9 (6)5.9 (4)5.9 (6)5.8 (4)5.8 (2)15/15
1komma4ser brockhoff noiseless 3.8 (2)5.9 (4)6.2 (0.8)6.2 (5)6.2 (0.9)6.2 (3)6.2 (3)15/15
1plus1 brockhoff noiseless 3.2 (1)4.8 (0.5)5.1 (2)5.2 (3)5.3 (0.6)5.3 (2)5.3 (2)15/15
1plus2mirser brockhoff noiseless 3.0 (2)5.4 (2)5.6 (3)5.6 (1)5.7 (3)5.7 (4)5.7 (4)15/15
ABC elabd noiseless 3.9 (2)5.9 (3)10 (6)37 (44)353 (522)2e60/15
AVGNEWUOA ros noiseless 0.96 (0.2)★30.97 (0.6)★31.0 (0.3)★31.0 (0.4)★41.0 (0.6)★41.0 (1.0)★40.99 (0.6)★415/15
CMAEGS finck noiseless 5.3 (4)6.5 (6)6.9 (6)7.1 (2)7.2 (2)7.3 (0.9)7.4 (6)15/15
DE-F-AUC fialho noiseless 23 (6)21 (3)23 (3)24 (3)24 (2)25 (3)26 (3)15/15
DEuniform fialho noiseless 34 (1)31 (3)33 (2)34 (4)35 (3)37 (3)39 (2)15/15
IPOP-ACTCMA-ES ros noiseless 3.5 (0.8)3.5 (1)3.7 (0.4)3.8 (0.5)3.9 (0.6)3.9 (0.5)4.0 (1)15/15
IPOP-CMA-ES ros noiseless 3.7 (0.4)3.9 (0.4)4.2 (0.6)4.3 (0.2)4.4 (0.2)4.4 (0.3)4.5 (0.4)15/15
MOS torre noiseless 11 (2)12 (8)13 (9)13 (4)13 (4)13 (8)13 (7)15/15
NBC-CMA preuss noiseless 6.3 (1)6.8 (0.9)7.7 (1)8.3 (0.8)8.6 (1.0)8.7 (0.9)8.8 (0.6)15/15
PM-AdapSS-DE fialho noiseless 35 (8)35 (5)38 (5)39 (5)39 (4)40 (2)41 (4)15/15
RCGA tran noiseless 1e60/15
SPSA finck noiseless 2e60/15
oPOEMS kubalic noiseless 500 (164)902 (957)1629 (748)2.2e4 (3e4)6e60/15
pPOEMS kubalic noiseless 103 (14)97 (36)109 (34)117 (27)121 (27)147 (49)188 (75)15/15

Δ fopt
f9, 20-D
1e1
1716
1e0
3102
1e-1
3277
1e-2
3379
1e-3
3455
1e-5
3594
1e-7
3727
#succ
15/15
1komma2 brockhoff noiseless 12 (6)24 (14)25 (13)25 (10)25 (14)24 (12)24 (10)15/15
1komma2mir brockhoff noiseless 5.8 (2)8.1 (1)8.5 (5)8.6 (5)8.6 (5)8.5 (4)8.4 (4)15/15
1komma2mirser brockhoff noiseless 4.5 (0.6)6.5 (2)6.8 (3)6.9 (1)6.9 (1)6.9 (3)6.8 (0.9)15/15
1komma2ser brockhoff noiseless 16 (6)22 (7)23 (11)23 (10)23 (13)23 (11)23 (12)15/15
1komma4 brockhoff noiseless 5.1 (2)6.0 (1)6.5 (0.7)6.6 (0.9)6.6 (1)6.6 (1)6.6 (0.8)15/15
1komma4mir brockhoff noiseless 4.6 (2)5.7 (2)6.1 (2)6.2 (4)6.2 (4)6.2 (3)6.1 (2)15/15
1komma4mirser brockhoff noiseless 3.3 (0.6)5.2 (2)5.4 (3)5.4 (3)5.4 (3)5.4 (1)5.3 (3)15/15
1komma4ser brockhoff noiseless 5.0 (3)7.2 (6)7.5 (6)7.5 (0.9)7.5 (3)7.4 (5)7.3 (5)15/15
1plus1 brockhoff noiseless 3.6 (2)6.2 (4)6.4 (4)6.5 (2)6.5 (3)6.5 (1)6.5 (2)15/15
1plus2mirser brockhoff noiseless 3.4 (2)6.9 (4)7.1 (6)7.1 (6)7.1 (2)7.1 (3)7.0 (3)15/15
ABC elabd noiseless 699 (483)2e60/15
AVGNEWUOA ros noiseless 1.0 (0.3)★31.2 (0.8)★31.2 (1)★31.3 (0.8)★41.3 (0.7)★41.2 (0.4)★41.2 (0.1)★415/15
CMAEGS finck noiseless 6.6 (3)10 (2)10 (11)10 (2)10 (20)11 (1)11 (10)15/15
DE-F-AUC fialho noiseless 26 (4)25 (1)27 (2)28 (2)29 (2)30 (2)31 (2)15/15
DEuniform fialho noiseless 41 (5)39 (4)41 (3)42 (1)43 (3)45 (3)46 (3)15/15
IPOP-ACTCMA-ES ros noiseless 4.1 (0.7)4.6 (2)4.9 (0.5)5.0 (2)5.0 (0.4)5.0 (0.5)5.0 (2)15/15
IPOP-CMA-ES ros noiseless 4.6 (0.9)5.7 (0.4)6.0 (0.3)6.1 (0.3)6.1 (4)6.1 (4)6.1 (2)15/15
MOS torre noiseless 10 (2)12 (2)15 (0.7)15 (16)15 (1)15 (15)15 (0.8)15/15
NBC-CMA preuss noiseless 7.1 (2)9.1 (1)10 (1)11 (1.0)11 (1)11 (4)11 (3)15/15
PM-AdapSS-DE fialho noiseless 37 (6)41 (5)43 (3)45 (5)45 (6)46 (6)47 (6)15/15
RCGA tran noiseless 1e60/15
SPSA finck noiseless 2e60/15
oPOEMS kubalic noiseless 1097 (208)6e60/15
pPOEMS kubalic noiseless 214 (54)328 (38)443 (49)680 (97)972 (168)2537 (2575)2.4e4 (2e4)0/15

Δ fopt
f10, 20-D
1e1
7413
1e0
8661
1e-1
10735
1e-2
13641
1e-3
14920
1e-5
17073
1e-7
17476
#succ
15/15
1komma2 brockhoff noiseless 7.9 (2)7.4 (2)6.4 (0.2)5.2 (0.3)4.9 (0.4)4.4 (0.2)4.3 (0.3)15/15
1komma2mir brockhoff noiseless 3.5 (0.4)3.5 (0.4)2.9 (0.2)2.4 (0.1)2.2 (0.1)2.0 (0.1)2.0 (0.1)15/15
1komma2mirser brockhoff noiseless 3.2 (0.2)3.0 (0.2)2.5 (0.1)2.0 (0.1)1.8 (0.1)1.6 (0.1)1.6 (0.0)15/15
1komma2ser brockhoff noiseless 9.0 (1)8.2 (1)6.9 (0.9)5.5 (0.4)5.1 (0.4)4.6 (0.6)4.6 (0.6)15/15
1komma4 brockhoff noiseless 2.8 (0.3)2.8 (0.3)2.4 (0.1)1.9 (0.1)1.8 (0.1)1.6 (0.1)1.6 (0.1)15/15
1komma4mir brockhoff noiseless 2.3 (0.4)2.2 (0.2)1.9 (0.2)1.6 (0.1)1.5 (0.1)1.3 (0.1)1.3 (0.0)15/15
1komma4mirser brockhoff noiseless 1.8 (0.2)1.7 (0.1)1.5 (0.1)1.2 (0.0)1.1 (0.0)0.98 (0.0)0.98 (0.0)15/15
1komma4ser brockhoff noiseless 2.4 (0.4)2.3 (0.3)2.0 (0.2)1.6 (0.1)1.5 (0.1)1.3 (0.1)1.3 (0.1)15/15
1plus1 brockhoff noiseless 1.7 (0.4)1.7 (0.3)1.4 (0.2)1.2 (0.1)1.1 (0.0)0.99 (0.1)0.99 (0.1)15/15
1plus2mirser brockhoff noiseless 1.3 (0.2)1.3 (0.2)1.2 (0.1)0.98 (0.1)0.91 (0.1)0.82 (0.1)0.82 (0.1)15/15
ABC elabd noiseless 2e60/15
AVGNEWUOA ros noiseless 1.5 (0.4)2.6 (0.7)3.1 (0.7)3.1 (0.5)3.6 (0.5)4.2 (0.5)5.0 (0.3)15/15
CMAEGS finck noiseless 3.9 (0.4)3.5 (0.3)2.9 (0.1)2.3 (0.1)2.2 (0.0)1.9 (0.0)1.9 (0.1)15/15
DE-F-AUC fialho noiseless 2.5 (0.2)2.6 (0.2)2.4 (0.1)2.2 (0.1)2.2 (0.1)2.4 (0.1)2.8 (0.2)15/15
DEuniform fialho noiseless 3.9 (0.1)4.1 (0.1)3.9 (0.0)3.5 (0.0)3.6 (0.1)3.9 (0.1)4.6 (0.1)15/15
IPOP-ACTCMA-ES ros noiseless 1.2 (0.2)1.2 (0.1)1.0 (0.1)★30.85 (0.0)★40.80 (0.0)★40.73 (0.0)★30.75 (0.0)★215/15
IPOP-CMA-ES ros noiseless 1.8 (0.4)1.8 (0.2)1.5 (0.2)1.3 (0.1)1.2 (0.1)1.1 (0.0)1.1 (0.0)15/15
MOS torre noiseless 3.4 (0.3)3.4 (0.3)3.0 (0.1)2.5 (0.1)2.3 (0.1)2.1 (0.1)2.2 (0.0)15/15
NBC-CMA preuss noiseless 3.1 (0.6)3.3 (0.7)3.0 (0.5)2.6 (0.4)2.5 (0.5)2.3 (0.3)2.3 (0.3)15/15
PM-AdapSS-DE fialho noiseless 2.7 (0.2)2.8 (0.2)2.6 (0.1)2.4 (0.1)2.4 (0.1)2.6 (0.0)3.0 (0.1)15/15
RCGA tran noiseless 1e60/15
SPSA finck noiseless 2e60/15
oPOEMS kubalic noiseless 6e60/15
pPOEMS kubalic noiseless 6e60/15

Δ fopt
f11, 20-D
1e1
1002
1e0
2228
1e-1
6278
1e-2
8586
1e-3
9762
1e-5
12285
1e-7
14831
#succ
15/15
1komma2 brockhoff noiseless 24 (6)12 (3)4.8 (0.9)3.8 (0.7)3.6 (0.6)3.2 (0.4)2.9 (0.2)15/15
1komma2mir brockhoff noiseless 18 (2)8.6 (0.9)3.3 (0.2)2.5 (0.1)2.3 (0.2)2.0 (0.2)1.7 (0.1)15/15
1komma2mirser brockhoff noiseless 16 (3)7.7 (1)2.9 (0.4)2.2 (0.3)2.0 (0.2)1.7 (0.0)1.5 (0.1)15/15
1komma2ser brockhoff noiseless 22 (4)12 (2)4.5 (0.7)3.7 (0.4)3.5 (0.6)3.2 (0.4)2.9 (0.4)15/15
1komma4 brockhoff noiseless 16 (6)8.0 (0.4)3.1 (0.2)2.4 (0.5)2.2 (0.6)1.9 (0.1)1.6 (0.1)15/15
1komma4mir brockhoff noiseless 16 (3)7.8 (0.4)2.9 (0.2)2.3 (0.2)2.1 (0.3)1.8 (0.1)1.5 (0.2)15/15
1komma4mirser brockhoff noiseless 13 (4)6.1 (2)2.3 (0.6)1.8 (0.4)1.6 (0.5)1.4 (0.3)1.2 (0.2)15/15
1komma4ser brockhoff noiseless 13 (1)6.3 (0.4)2.4 (0.3)1.9 (0.2)1.8 (0.3)1.5 (0.1)1.3 (0.2)15/15
1plus1 brockhoff noiseless 7.7 (2)5.9 (1)2.7 (0.3)2.6 (0.4)2.6 (0.6)2.4 (0.1)2.1 (0.2)15/15
1plus2mirser brockhoff noiseless 5.8 (1)4.3 (1)2.1 (0.4)1.9 (0.3)2.0 (0.3)1.9 (0.2)1.7 (0.1)15/15
ABC elabd noiseless 2e60/15
AVGNEWUOA ros noiseless 15 (10)11 (4)5.7 (2)5.1 (0.9)5.6 (1)5.8 (1)6.1 (1)15/15
CMAEGS finck noiseless 119 (144)94 (117)58 (7)60 (24)54 (62)45 (17)50 (14)12/15
DE-F-AUC fialho noiseless 7.3 (1.0)5.1 (0.5)2.4 (0.3)2.2 (0.2)2.3 (0.2)2.4 (0.1)2.5 (0.3)15/15
DEuniform fialho noiseless 11 (0.5)8.1 (0.4)3.8 (0.1)3.5 (0.1)3.8 (0.1)4.0 (0.1)4.2 (0.1)15/15
IPOP-ACTCMA-ES ros noiseless 4.5 (0.2)★22.3 (0.1)★40.87 (0.0)★40.68 (0.0)★40.64 (0.0)★40.56 (0.0)★40.50 (0.0)★415/15
IPOP-CMA-ES ros noiseless 11 (1)5.4 (0.7)2.1 (0.4)1.6 (0.2)1.4 (0.1)1.2 (0.2)1.1 (0.2)15/15
MOS torre noiseless 21 (5)10 (0.7)4.0 (0.4)3.1 (0.3)2.9 (0.2)2.5 (0.3)2.2 (0.2)15/15
NBC-CMA preuss noiseless 3e50/15
PM-AdapSS-DE fialho noiseless 8.7 (1.0)5.7 (0.3)2.6 (0.1)2.4 (0.1)2.5 (0.1)2.6 (0.1)2.7 (0.1)15/15
RCGA tran noiseless 1e60/15
SPSA finck noiseless 2e60/15
oPOEMS kubalic noiseless 483 (220)400 (110)218 (40)207 (30)220 (47)240 (21)258 (32)15/15
pPOEMS kubalic noiseless 111 (19)107 (31)84 (41)142 (20)358 (376)7059 (7814)6e60/15

Δ fopt
f12, 20-D
1e1
1042
1e0
1938
1e-1
2740
1e-2
3156
1e-3
4140
1e-5
12407
1e-7
13827
#succ
15/15
1komma2 brockhoff noiseless 24 (25)21 (14)19 (13)19 (10)16 (7)6.4 (4)6.7 (3)14/15
1komma2mir brockhoff noiseless 15 (12)13 (7)12 (4)11 (4)9.3 (3)3.6 (1)3.6 (1)15/15
1komma2mirser brockhoff noiseless 7.4 (5)8.0 (5)7.6 (4)7.5 (2)6.4 (2)2.6 (0.9)2.6 (0.6)15/15
1komma2ser brockhoff noiseless 23 (31)23 (17)21 (10)21 (11)18 (10)7.0 (2)7.5 (5)12/15
1komma4 brockhoff noiseless 8.8 (11)8.8 (6)8.5 (6)8.5 (6)7.2 (4)2.9 (0.9)2.9 (1)15/15
1komma4mir brockhoff noiseless 6.1 (3)6.7 (5)6.5 (3)6.7 (5)5.7 (2)2.3 (1)2.3 (0.7)15/15
1komma4mirser brockhoff noiseless 4.8 (5)5.1 (3)5.0 (3)5.1 (4)4.4 (3)1.8 (0.6)1.8 (0.5)15/15
1komma4ser brockhoff noiseless 7.1 (7)6.9 (4)6.7 (5)6.7 (4)5.7 (2)2.3 (1)2.3 (0.8)15/15
1plus1 brockhoff noiseless 6.6 (3)10 (15)10 (6)11 (2)9.1 (4)3.6 (2)3.7 (3)15/15
1plus2mirser brockhoff noiseless 6.3 (4)8.3 (6)8.2 (6)8.3 (6)6.9 (6)2.9 (2)3.1 (2)15/15
ABC elabd noiseless 26 (3)67 (120)429 (563)2184 (1583)7243 (8333)2e60/15
AVGNEWUOA ros noiseless 11 (20)15 (22)18 (18)24 (19)24 (13)12 (4)21 (12)9/15
CMAEGS finck noiseless 30 (37)37 (53)39 (34)39 (53)33 (29)13 (7)14 (11)15/15
DE-F-AUC fialho noiseless 27 (2)20 (13)19 (8)21 (10)20 (8)9.4 (2)10 (2)15/15
DEuniform fialho noiseless 44 (3)27 (0.7)25 (3)27 (3)26 (2)12 (1)13 (2)15/15
IPOP-ACTCMA-ES ros noiseless 2.6 (3)3.0 (2)3.2 (2)3.4 (1)3.1 (1)1.3 (0.4)1.4 (0.4)15/15
IPOP-CMA-ES ros noiseless 4.8 (4)5.3 (2)5.5 (4)5.9 (4)5.1 (1)2.1 (1)2.2 (0.8)15/15
MOS torre noiseless 7.1 (5)8.9 (5)14 (6)14 (27)12 (20)4.7 (4)4.7 (6)15/15
NBC-CMA preuss noiseless 6.2 (4)13 (10)14 (6)15 (7)13 (3)5.2 (2)5.2 (0.6)15/15
PM-AdapSS-DE fialho noiseless 29 (2)18 (0.6)20 (8)24 (10)24 (7)12 (2)13 (4)15/15
RCGA tran noiseless 222 (8)241 (263)519 (1096)1359 (1347)1e60/15
SPSA finck noiseless 2e60/15
oPOEMS kubalic noiseless 1557 (7)4720 (4644)6e60/15
pPOEMS kubalic noiseless 3374 (4347)3893 (5418)9257 (1e4)6e60/15

Δ fopt
f13, 20-D
1e1
652
1e0
2021
1e-1
2751
1e-2
3507
1e-3
18749
1e-5
24455
1e-7
30201
#succ
15/15
1komma2 brockhoff noiseless 20 (33)25 (20)41 (30)87 (98)47 (93)2e50/15
1komma2mir brockhoff noiseless 13 (21)12 (8)24 (20)36 (10)33 (17)55 (37)93 (104)0/15
1komma2mirser brockhoff noiseless 4.6 (4)6.9 (9)23 (25)37 (31)49 (27)116 (98)94 (174)1/15
1komma2ser brockhoff noiseless 13 (5)29 (27)41 (25)115 (119)36 (21)2e50/15
1komma4 brockhoff noiseless 8.3 (9)15 (21)25 (27)42 (58)21 (15)121 (153)2e50/15
1komma4mir brockhoff noiseless 6.4 (7)10 (8)16 (20)28 (34)8.0 (10)36 (39)2e50/15
1komma4mirser brockhoff noiseless 4.5 (6)6.6 (4)11 (10)26 (25)21 (20)56 (64)2e50/15
1komma4ser brockhoff noiseless 7.6 (8)4.9 (5)14 (11)23 (22)17 (14)57 (84)2e50/15
1plus1 brockhoff noiseless 6.5 (3)4.8 (7)10 (10)16 (14)4.1 (2)7.6 (10)13 (15)4/15
1plus2mirser brockhoff noiseless 4.9 (2)6.0 (8)7.7 (6)13 (8)3.3 (2)5.2 (5)18 (7)2/15
ABC elabd noiseless 25 (14)73 (123)627 (525)3931 (8135)1555 (1253)2e60/15
AVGNEWUOA ros noiseless 1.5 (1)5.3 (5)14 (15)30 (17)14 (10)172 (168)3e50/15
CMAEGS finck noiseless 6.8 (9)7.6 (18)37 (74)125 (204)108 (99)556 (655)2e60/15
DE-F-AUC fialho noiseless 25 (2)12 (0.9)11 (0.6)11 (0.8)2.4 (0.1)2.5 (0.2)2.5 (0.2)15/15
DEuniform fialho noiseless 43 (2)20 (0.4)19 (0.3)19 (0.3)4.1 (0.0)4.2 (0.0)4.2 (0.0)15/15
IPOP-ACTCMA-ES ros noiseless 3.6 (3)3.4 (3)3.7 (2)3.4 (2)0.80 (0.3)1.3 (0.7)1.3 (0.5)15/15
IPOP-CMA-ES ros noiseless 6.5 (5)4.8 (6)6.2 (5)5.1 (4)1.4 (0.8)1.7 (0.8)2.3 (1)15/15
MOS torre noiseless 10 (0.6)9.1 (6)12 (6)12 (5)2.8 (2)3.2 (0.6)3.0 (1)15/15
NBC-CMA preuss noiseless 4.7 (5)15 (42)29 (28)24 (16)5.7 (3)9.3 (4)45 (36)2/15
PM-AdapSS-DE fialho noiseless 28 (0.7)13 (0.4)12 (0.3)12 (0.5)2.6 (0.1)2.6 (0.1)2.6 (0.1)15/15
RCGA tran noiseless 232 (26)296 (260)825 (818)1228 (2637)1e60/15
SPSA finck noiseless 2e60/15
oPOEMS kubalic noiseless 6274 (6910)4.2e4 (6e4)6e60/15
pPOEMS kubalic noiseless 938 (4613)2244 (3042)6206 (4362)2.4e4 (3e4)4562 (5360)6e60/15

Δ fopt
f14, 20-D
1e1
75
1e0
239
1e-1
304
1e-2
451
1e-3
932
1e-5
1648
1e-7
15661
#succ
15/15
1komma2 brockhoff noiseless 16 (10)8.2 (3)8.2 (2)8.2 (0.9)7.8 (2)14 (4)4.8 (4)5/15
1komma2mir brockhoff noiseless 7.7 (2)3.8 (0.9)4.1 (0.8)4.2 (0.4)4.2 (0.3)8.1 (0.9)2.0 (0.6)15/15
1komma2mirser brockhoff noiseless 6.0 (2)3.1 (0.5)3.3 (0.8)3.5 (0.6)3.6 (0.6)6.6 (0.7)1.6 (0.2)14/15
1komma2ser brockhoff noiseless 14 (4)6.9 (2)7.4 (2)7.4 (1)6.9 (1)13 (1)5.7 (3)6/15
1komma4 brockhoff noiseless 5.7 (2)3.1 (0.8)3.6 (0.4)4.0 (0.9)3.9 (0.7)7.3 (1)1.6 (0.2)15/15
1komma4mir brockhoff noiseless 5.0 (2)2.8 (0.8)3.1 (0.6)3.3 (0.3)3.2 (0.4)6.4 (0.7)1.4 (0.1)15/15
1komma4mirser brockhoff noiseless 3.8 (1)2.1 (0.6)2.3 (0.4)2.6 (0.4)2.6 (0.3)5.0 (0.3)1.1 (0.1)15/15
1komma4ser brockhoff noiseless 4.7 (2)2.6 (0.5)2.9 (0.7)3.4 (0.5)3.2 (0.3)5.4 (0.6)1.3 (0.1)15/15
1plus1 brockhoff noiseless 2.9 (0.4)1.9 (0.2)2.3 (0.2)2.5 (0.1)2.2 (0.4)5.4 (0.5)1.2 (0.2)15/15
1plus2mirser brockhoff noiseless 2.3 (0.7)1.6 (0.3)1.9 (0.3)2.1 (0.3)1.9 (0.2)4.5 (0.8)0.97 (0.1)15/15
ABC elabd noiseless 18 (9)18 (7)28 (9)53 (8)3379 (4723)2e60/15
AVGNEWUOA ros noiseless 2.7 (0.8)1.5 (0.3)1.6 (0.3)1.6 (0.2)★31.3 (0.2)★39.3 (0.7)26 (0.9)0/15
CMAEGS finck noiseless 10 (2)4.7 (0.6)5.2 (0.5)5.7 (0.4)6.2 (0.8)22 (3)4.8 (0.8)13/15
DE-F-AUC fialho noiseless 33 (9)30 (2)38 (4)36 (4)23 (2)19 (2)2.8 (0.2)15/15
DEuniform fialho noiseless 53 (5)50 (3)64 (4)60 (4)38 (0.8)31 (0.7)4.2 (0.1)15/15
IPOP-ACTCMA-ES ros noiseless 3.6 (0.7)2.7 (0.2)3.5 (0.3)4.0 (0.3)3.2 (0.3)3.9 (0.2)0.67 (0.0)★415/15
IPOP-CMA-ES ros noiseless 3.7 (2)2.8 (0.7)3.6 (0.5)4.2 (0.5)3.9 (0.4)6.0 (0.4)1.2 (0.1)15/15
MOS torre noiseless 20 (3)10 (0.6)11 (1.0)13 (1)12 (0.4)14 (0.3)2.3 (0.1)15/15
NBC-CMA preuss noiseless 5.5 (1)3.7 (0.5)4.6 (0.5)5.3 (0.6)5.1 (1)9.0 (0.9)1.7 (0.1)15/15
PM-AdapSS-DE fialho noiseless 43 (6)34 (2)43 (2)40 (1)25 (2)20 (0.8)2.8 (0.2)15/15
RCGA tran noiseless 16 (4)26 (3)57 (29)298 (32)1503 (1890)1e60/15
SPSA finck noiseless 98 (47)51 (101)45 (86)39 (56)56 (22)1207 (843)2e60/15
oPOEMS kubalic noiseless 98 (24)65 (9)124 (15)165 (13)131 (10)6e60/15
pPOEMS kubalic noiseless 102 (23)72 (8)144 (67)423 (202)353 (110)4529 (4111)6e60/15

Δ fopt
f15, 20-D
1e1
30378
1e0
1.5e5
1e-1
3.1e5
1e-2
3.2e5
1e-3
3.2e5
1e-5
4.5e5
1e-7
4.6e5
#succ
15/15
1komma2 brockhoff noiseless 2e50/15
1komma2mir brockhoff noiseless 2e50/15
1komma2mirser brockhoff noiseless 2e50/15
1komma2ser brockhoff noiseless 2e50/15
1komma4 brockhoff noiseless 2e50/15
1komma4mir brockhoff noiseless 2e50/15
1komma4mirser brockhoff noiseless 2e50/15
1komma4ser brockhoff noiseless 2e50/15
1plus1 brockhoff noiseless 2e50/15
1plus2mirser brockhoff noiseless 2e50/15
ABC elabd noiseless 2e60/15
AVGNEWUOA ros noiseless 2e50/15
CMAEGS finck noiseless 280 (313)2e60/15
DE-F-AUC fialho noiseless 474 (346)2e60/15
DEuniform fialho noiseless 979 (1037)2e60/15
IPOP-ACTCMA-ES ros noiseless 0.82 (0.2)1.1 (0.3)0.71 (0.2)0.72 (0.2)0.72 (0.2)0.53 (0.2)0.54 (0.2)15/15
IPOP-CMA-ES ros noiseless 1.1 (0.6)1.1 (0.7)0.69 (0.3)0.70 (0.3)0.70 (0.4)0.52 (0.3)0.53 (0.3)15/15
MOS torre noiseless 1.5 (1)1.6 (0.5)0.98 (0.5)0.98 (0.5)0.99 (0.5)0.73 (0.3)0.73 (0.4)15/15
NBC-CMA preuss noiseless 3e50/15
PM-AdapSS-DE fialho noiseless 2e60/15
RCGA tran noiseless 6.3 (0.4)97 (148)1e60/15
SPSA finck noiseless 2e60/15
oPOEMS kubalic noiseless 6e60/15
pPOEMS kubalic noiseless 6e60/15

Δ fopt
f16, 20-D
1e1
1384
1e0
27265
1e-1
77015
1e-2
1.4e5
1e-3
1.9e5
1e-5
2.0e5
1e-7
2.2e5
#succ
15/15
1komma2 brockhoff noiseless 2e50/15
1komma2mir brockhoff noiseless 153 (66)2e50/15
1komma2mirser brockhoff noiseless 191 (277)2e50/15
1komma2ser brockhoff noiseless 2e50/15
1komma4 brockhoff noiseless 141 (58)2e50/15
1komma4mir brockhoff noiseless 34 (32)2e50/15
1komma4mirser brockhoff noiseless 49 (21)2e50/15
1komma4ser brockhoff noiseless 124 (115)2e50/15
1plus1 brockhoff noiseless 31 (61)2e50/15
1plus2mirser brockhoff noiseless 15 (9)2e50/15
ABC elabd noiseless 13 (10)2e60/15
AVGNEWUOA ros noiseless 3.6 (2)3e50/15
CMAEGS finck noiseless 4.6 (0.4)41 (70)179 (282)2e60/15
DE-F-AUC fialho noiseless 2e60/15
DEuniform fialho noiseless 2.1e4 (3e4)2e60/15
IPOP-ACTCMA-ES ros noiseless 2.8 (5)1.1 (0.5)0.88 (0.6)0.76 (0.5)0.80 (0.4)0.82 (0.3)0.76 (0.3)15/15
IPOP-CMA-ES ros noiseless 1.7 (1)0.81 (0.5)0.92 (0.9)0.85 (0.4)0.84 (0.3)1.1 (0.8)1.0 (0.6)15/15
MOS torre noiseless 1.8 (0.2)0.27 (0.3)★20.50 (0.3)2.9 (11)5.5 (5)5.6 (16)6.3 (11)11/15
NBC-CMA preuss noiseless 19 (20)1.8 (3)7.1 (12)3e50/15
PM-AdapSS-DE fialho noiseless 2.2e4 (2e4)2e60/15
RCGA tran noiseless 8.1 (3)4.6 (1)18 (39)102 (212)1e60/15
SPSA finck noiseless 4462 (4116)2e60/15
oPOEMS kubalic noiseless 14 (5)2.6 (1)508 (448)6e60/15
pPOEMS kubalic noiseless 26 (15)24 (58)1098 (2006)6e60/15

Δ fopt
f17, 20-D
1e1
63
1e0
1030
1e-1
4005
1e-2
12242
1e-3
30677
1e-5
56288
1e-7
80472
#succ
15/15
1komma2 brockhoff noiseless 403 (955)2e50/15
1komma2mir brockhoff noiseless 8.6 (2)2766 (3058)2e50/15
1komma2mirser brockhoff noiseless 6.7 (6)2880 (2961)2e50/15
1komma2ser brockhoff noiseless 462 (801)2e50/15
1komma4 brockhoff noiseless 73 (10)2771 (3010)2e50/15
1komma4mir brockhoff noiseless 5.1 (2)641 (343)2e50/15
1komma4mirser brockhoff noiseless 6.1 (5)1374 (1018)2e50/15
1komma4ser brockhoff noiseless 59 (190)2e50/15
1plus1 brockhoff noiseless 53 (14)2e50/15
1plus2mirser brockhoff noiseless 42 (195)2e50/15
ABC elabd noiseless 34 (30)2e60/15
AVGNEWUOA ros noiseless 2.4 (1)9e50/15
CMAEGS finck noiseless 7.2 (1)1.2 (0.3)1.1 (1)1.2 (0.7)1.1 (0.4)3.8 (2)12 (3)14/15
DE-F-AUC fialho noiseless 23 (12)13 (1)6.6 (1)3.4 (0.3)1.9 (0.2)1.9 (0.2)5.5 (0.1)13/15
DEuniform fialho noiseless 38 (16)19 (2)10 (0.4)5.4 (0.2)3.0 (0.1)3.2 (0.1)2.8 (0.1)15/15
IPOP-ACTCMA-ES ros noiseless 2.3 (2)0.89 (0.2)0.50 (0.1)1.3 (3)0.82 (0.1)0.83 (0.5)0.87 (0.3)15/15
IPOP-CMA-ES ros noiseless 2.1 (2)0.94 (0.3)1.2 (2)1.0 (0.7)0.76 (0.6)0.99 (0.3)1.0 (0.7)15/15
MOS torre noiseless 11 (5)8.2 (19)2.8 (9)1.5 (3)1.1 (0.5)1.2 (0.4)1.0 (0.3)15/15
NBC-CMA preuss noiseless 3.4 (2)1.2 (0.2)1.1 (1)1.3 (0.8)15 (16)3e50/15
PM-AdapSS-DE fialho noiseless 23 (12)13 (1)6.6 (0.4)3.4 (0.3)1.9 (0.1)1.8 (0.1)18 (25)7/15
RCGA tran noiseless 6.1 (3)13 (5)31 (4)23 (1)17 (25)1e60/15
SPSA finck noiseless 8.7e4 (1e5)2e60/15
oPOEMS kubalic noiseless 98 (22)27 (7)126 (4)188 (246)299 (342)6e60/15
pPOEMS kubalic noiseless 98 (21)31 (18)54 (30)115 (255)313 (782)6e60/15

Δ fopt
f18, 20-D
1e1
621
1e0
3972
1e-1
19561
1e-2
28555
1e-3
67569
1e-5
1.3e5
1e-7
1.5e5
#succ
15/15
1komma2 brockhoff noiseless 2e50/15
1komma2mir brockhoff noiseless 143 (161)2e50/15
1komma2mirser brockhoff noiseless 131 (243)2e50/15
1komma2ser brockhoff noiseless 2e50/15
1komma4 brockhoff noiseless 257 (452)2e50/15
1komma4mir brockhoff noiseless 67 (102)2e50/15
1komma4mirser brockhoff noiseless 34 (57)2e50/15
1komma4ser brockhoff noiseless 302 (803)2e50/15
1plus1 brockhoff noiseless 2e50/15
1plus2mirser brockhoff noiseless 4697 (4428)2e50/15
ABC elabd noiseless 4.6e4 (5e4)2e60/15
AVGNEWUOA ros noiseless 3215 (5151)1e60/15
CMAEGS finck noiseless 1.4 (0.2)0.97 (1)1.1 (0.3)2.0 (0.8)2.2 (2)31 (32)201 (222)1/15
DE-F-AUC fialho noiseless 11 (1)4.6 (0.6)1.7 (0.2)1.8 (0.3)3.2 (7)11 (23)28 (51)5/15
DEuniform fialho noiseless 18 (3)7.8 (0.5)2.8 (0.1)2.9 (0.1)1.7 (0.1)1.5 (0.1)1.6 (0.1)15/15
IPOP-ACTCMA-ES ros noiseless 1.2 (0.5)1.5 (2)0.75 (0.3)1.1 (1.0)0.91 (0.0)0.78 (0.4)0.83 (0.3)15/15
IPOP-CMA-ES ros noiseless 1.1 (0.4)1.8 (2)1.1 (1.0)1.5 (0.9)0.97 (0.7)1.0 (0.4)1.1 (0.5)15/15
MOS torre noiseless 4.0 (0.4)1.6 (0.1)1.1 (1)1.8 (0.8)1.3 (0.9)1.3 (0.7)1.2 (0.5)15/15
NBC-CMA preuss noiseless 1.5 (0.3)0.76 (0.5)1.1 (1)35 (27)3e50/15
PM-AdapSS-DE fialho noiseless 13 (2)5.4 (0.4)1.9 (0.1)1.9 (0.2)8.4 (0.0)6.5 (12)7.8 (7)7/15
RCGA tran noiseless 7.5 (2)20 (9)23 (38)62 (36)1e60/15
SPSA finck noiseless 2e60/15
oPOEMS kubalic noiseless 21 (3)125 (7)275 (308)2948 (5253)6e60/15
pPOEMS kubalic noiseless 21 (4)51 (29)106 (83)1394 (1261)6e60/15

Δ fopt
f19, 20-D
1e1
1
1e0
1
1e-1
3.4e5
1e-2
4.7e6
1e-3
6.2e6
1e-5
6.7e6
1e-7
6.7e6
#succ
15/15
1komma2 brockhoff noiseless 2312 (2216)2e50/15
1komma2mir brockhoff noiseless 657 (776)2e50/15
1komma2mirser brockhoff noiseless 409 (198)2e50/15
1komma2ser brockhoff noiseless 3531 (3804)2e50/15
1komma4 brockhoff noiseless 440 (311)2e50/15
1komma4mir brockhoff noiseless 256 (134)1.4e6 (1e6)2e50/15
1komma4mirser brockhoff noiseless 226 (85)2.8e6 (3e6)2e50/15
1komma4ser brockhoff noiseless 334 (253)2.8e6 (6e6)2e50/15
1plus1 brockhoff noiseless 289 (203)2.9e6 (4e6)2e50/15
1plus2mirser brockhoff noiseless 851 (82)2e50/15
ABC elabd noiseless 2292 (898)2e60/15
AVGNEWUOA ros noiseless 210 (208)8.0e6 (2e7)2e60/15
CMAEGS finck noiseless 412 (105)4.4e4 (3e4)2e60/15
DE-F-AUC fialho noiseless 1315 (478)9.5e6 (1e7)2e60/15
DEuniform fialho noiseless 2846 (618)9.5e6 (1e7)2e60/15
IPOP-ACTCMA-ES ros noiseless 166 (45)2.9e4 (1e4)0.63 (0.6)0.46 (0.1)0.43 (0.2)0.44 (0.2)0.44 (0.2)15/15
IPOP-CMA-ES ros noiseless 161 (67)2.7e4 (1e4)0.71 (0.3)0.45 (0.2)0.38 (0.1)0.41 (0.2)0.41 (0.2)15/15
MOS torre noiseless 1233 (224)2.1e4 (4388)2.9 (6)3.2 (4)2e60/15
NBC-CMA preuss noiseless 255 (126)3e50/15
PM-AdapSS-DE fialho noiseless 1839 (372)2e60/15
RCGA tran noiseless 311 (41)4.1e5 (2e5)6.9 (7)1e60/15
SPSA finck noiseless 5211 (1657)2e60/15
oPOEMS kubalic noiseless 6058 (618)6.1e6 (1e7)6e60/15
pPOEMS kubalic noiseless 6256 (436)1.4e6 (3e6)6e60/15

Δ fopt
f20, 20-D
1e1
82
1e0
46150
1e-1
3.1e6
1e-2
5.5e6
1e-3
5.5e6
1e-5
5.6e6
1e-7
5.6e6
#succ
14/15
1komma2 brockhoff noiseless 13 (3)30 (38)2e50/15
1komma2mir brockhoff noiseless 6.5 (1)30 (30)2e50/15
1komma2mirser brockhoff noiseless 5.2 (0.9)2e50/15
1komma2ser brockhoff noiseless 11 (1)15 (16)2e50/15
1komma4 brockhoff noiseless 5.1 (1)61 (36)2e50/15
1komma4mir brockhoff noiseless 4.6 (0.4)31 (15)2e50/15
1komma4mirser brockhoff noiseless 3.5 (0.7)11 (7)2e50/15
1komma4ser brockhoff noiseless 4.4 (0.9)7.3 (5)2e50/15
1plus1 brockhoff noiseless 3.3 (0.8)20 (20)2e50/15
1plus2mirser brockhoff noiseless 2.9 (0.7)18 (16)2e50/15
ABC elabd noiseless 16 (5)0.12 (0.1)★22e60/15
AVGNEWUOA ros noiseless 1.3 (0.2)★4107 (150)3e50/15
CMAEGS finck noiseless 7.9 (1)2e60/15
DE-F-AUC fialho noiseless 40 (6)643 (1094)2e60/15
DEuniform fialho noiseless 76 (12)2e60/15
IPOP-ACTCMA-ES ros noiseless 4.7 (1)3.2 (1.0)0.83 (0.4)0.58 (0.2)0.58 (0.2)0.59 (0.2)0.60 (0.2)15/15
IPOP-CMA-ES ros noiseless 4.6 (1)6.4 (2)0.65 (0.2)0.57 (0.2)0.57 (0.2)0.58 (0.2)0.58 (0.2)15/15
MOS torre noiseless 21 (0.6)0.97 (0.5)0.08 (0.0)0.05 (7e-3)0.06 (6e-3)0.06 (5e-3)0.07 (0.0)15/15
NBC-CMA preuss noiseless 7.3 (2)91 (91)3e50/15
PM-AdapSS-DE fialho noiseless 46 (5)2e60/15
RCGA tran noiseless 10 (2)1e60/15
SPSA finck noiseless 16 (6)2e60/15
oPOEMS kubalic noiseless 117 (16)2.4 (0.2)8.6 (5)6e60/15
pPOEMS kubalic noiseless 133 (42)1.8 (1.0)6e60/15

Δ fopt
f21, 20-D
1e1
561
1e0
6541
1e-1
14103
1e-2
14318
1e-3
14643
1e-5
15567
1e-7
17589
#succ
15/15
1komma2 brockhoff noiseless 13 (16)8.3 (7)10 (11)10 (10)11 (10)10 (12)9.1 (7)11/15
1komma2mir brockhoff noiseless 6.0 (8)3.3 (2)3.6 (5)3.5 (4)3.4 (4)3.3 (4)2.9 (4)15/15
1komma2mirser brockhoff noiseless 7.2 (8)4.9 (3)4.0 (2)4.0 (7)3.9 (5)3.7 (2)3.3 (4)14/15
1komma2ser brockhoff noiseless 6.8 (8)9.3 (18)9.1 (16)9.0 (6)8.9 (7)8.4 (9)7.4 (15)11/15
1komma4 brockhoff noiseless 2.1 (2)3.6 (3)4.7 (6)4.6 (4)4.5 (6)4.3 (5)3.8 (5)14/15
1komma4mir brockhoff noiseless 3.9 (6)4.7 (7)4.8 (2)4.7 (7)4.7 (6)4.4 (3)3.9 (7)14/15
1komma4mirser brockhoff noiseless 2.4 (2)1.7 (1)1.8 (2)1.8 (2)1.7 (1)1.6 (1)1.5 (1)15/15
1komma4ser brockhoff noiseless 3.8 (8)2.3 (2)2.6 (3)2.6 (5)2.5 (2)2.4 (4)2.1 (2)15/15
1plus1 brockhoff noiseless 3.5 (7)5.5 (4)5.4 (6)5.3 (6)5.2 (5)4.9 (3)4.4 (5)14/15
1plus2mirser brockhoff noiseless 3.3 (4)4.6 (6)3.9 (3)3.8 (2)3.8 (2)3.6 (7)3.2 (4)14/15
ABC elabd noiseless 5.0 (2)22 (43)25 (24)26 (7)27 (63)35 (24)85 (97)8/15
AVGNEWUOA ros noiseless 3.2 (8)5.7 (5)3.5 (3)3.5 (4)3.4 (6)3.3 (3)2.9 (5)14/15
CMAEGS finck noiseless 1.9 (0.2)211 (159)217 (348)214 (73)210 (176)197 (359)175 (171)6/15
DE-F-AUC fialho noiseless 12 (3)613 (765)568 (461)560 (664)547 (273)515 (386)456 (711)3/15
DEuniform fialho noiseless 21 (8)461 (612)568 (603)560 (1292)548 (239)516 (674)457 (483)3/15
IPOP-ACTCMA-ES ros noiseless 1.9 (4)81 (111)66 (114)65 (114)64 (115)60 (63)54 (74)9/15
IPOP-CMA-ES ros noiseless 3.7 (5)139 (299)110 (179)108 (234)106 (243)100 (88)88 (111)7/15
MOS torre noiseless 11 (8)262 (147)285 (239)281 (361)275 (220)260 (297)231 (589)8/15
NBC-CMA preuss noiseless 84 (0.9)69 (46)59 (101)58 (105)56 (82)53 (53)47 (43)4/15
PM-AdapSS-DE fialho noiseless 12 (3)351 (383)568 (567)560 (454)547 (1024)515 (1477)456 (370)3/15
RCGA tran noiseless 119 (3)103 (186)85 (59)85 (59)86 (115)96 (115)87 (100)7/15
SPSA finck noiseless 598 (28)1240 (1691)2e60/15
oPOEMS kubalic noiseless 1.1e4 (1e4)5970 (1e4)6e60/15
pPOEMS kubalic noiseless 137 (221)1172 (905)956 (1790)1185 (952)1160 (823)1093 (857)974 (853)4/15

Δ fopt
f22, 20-D
1e1
467
1e0
5580
1e-1
23491
1e-2
24163
1e-3
24948
1e-5
26847
1e-7
1.3e5
#succ
12/15
1komma2 brockhoff noiseless 10 (12)27 (90)124 (181)120 (116)116 (130)108 (104)22 (34)1/15
1komma2mir brockhoff noiseless 8.8 (13)13 (20)21 (15)20 (21)20 (26)18 (21)3.7 (4)5/15
1komma2mirser brockhoff noiseless 8.2 (7)13 (7)17 (6)16 (25)16 (23)15 (17)3.0 (2)6/15
1komma2ser brockhoff noiseless 35 (29)22 (46)37 (24)36 (20)35 (30)33 (44)6.6 (4)3/15
1komma4 brockhoff noiseless 18 (32)6.6 (7)11 (13)11 (17)11 (13)10 (8)2.0 (3)8/15
1komma4mir brockhoff noiseless 5.6 (7)7.7 (13)16 (24)16 (16)15 (24)14 (22)2.9 (4)6/15
1komma4mirser brockhoff noiseless 9.0 (5)5.0 (8)28 (23)27 (21)26 (28)24 (14)4.9 (8)4/15
1komma4ser brockhoff noiseless 4.7 (9)13 (36)27 (38)26 (16)25 (24)24 (15)4.7 (5)4/15
1plus1 brockhoff noiseless 17 (30)9.4 (5)15 (14)14 (18)14 (11)13 (17)2.6 (3)7/15
1plus2mirser brockhoff noiseless 10 (7)4.4 (2)10 (13)10 (19)9.2 (5)8.6 (16)1.7 (2)8/15
ABC elabd noiseless 10 (9)47 (72)77 (102)578 (796)2e60/15
AVGNEWUOA ros noiseless 2.0 (2)5.6 (6)14 (4)13 (20)13 (25)12 (13)2.4 (2)6/15
CMAEGS finck noiseless 675 (1082)546 (905)2e60/15
DE-F-AUC fialho noiseless 674 (6)1436 (1613)2e60/15
DEuniform fialho noiseless 1579 (2143)989 (1434)2e60/15
IPOP-ACTCMA-ES ros noiseless 462 (1382)264 (231)1e60/15
IPOP-CMA-ES ros noiseless 445 (1420)287 (405)1e60/15
MOS torre noiseless 535 (3289)797 (1166)677 (727)659 (1001)638 (652)594 (1073)118 (221)3/15
NBC-CMA preuss noiseless 323 (322)350 (323)3e50/15
PM-AdapSS-DE fialho noiseless 1571 (2145)2332 (2240)2e60/15
RCGA tran noiseless 1185 (1794)1200 (941)1e60/15
SPSA finck noiseless 1072 (1717)1439 (1077)2e60/15
oPOEMS kubalic noiseless 6451 (9651)6994 (6183)6e60/15
pPOEMS kubalic noiseless 2021 (3430)1439 (1921)1680 (1796)1634 (2306)1584 (3792)1474 (2802)294 (367)2/15

Δ fopt
f23, 20-D
1e1
3.0
1e0
1614
1e-1
67457
1e-2
3.7e5
1e-3
4.9e5
1e-5
8.1e5
1e-7
8.4e5
#succ
15/15
1komma2 brockhoff noiseless 364 (629)1833 (2014)2e50/15
1komma2mir brockhoff noiseless 34 (96)138 (206)2e50/15
1komma2mirser brockhoff noiseless 53 (50)387 (414)2e50/15
1komma2ser brockhoff noiseless 205 (223)2e50/15
1komma4 brockhoff noiseless 48 (77)107 (116)2e50/15
1komma4mir brockhoff noiseless 20 (20)45 (38)2e50/15
1komma4mirser brockhoff noiseless 18 (34)122 (168)2e50/15
1komma4ser brockhoff noiseless 24 (53)138 (207)2e50/15
1plus1 brockhoff noiseless 19 (7)8.1 (8)2e50/15
1plus2mirser brockhoff noiseless 8.4 (6)6.0 (7)2e50/15
ABC elabd noiseless 1.2 (0.4)78 (56)2e60/15
AVGNEWUOA ros noiseless 16 (18)4.7 (7)4e50/15
CMAEGS finck noiseless 59 (27)2e60/15
DE-F-AUC fialho noiseless 1.6 (0.8)2385 (2356)440 (311)2e60/15
DEuniform fialho noiseless 3.2 (3)6010 (3223)2e60/15
IPOP-ACTCMA-ES ros noiseless 4.4 (5)2.3e4 (2e4)3e60/15
IPOP-CMA-ES ros noiseless 4.6 (5)2.3e4 (1e4)3e60/15
MOS torre noiseless 2.3 (2)56 (20)8.9 (31)14 (15)2e60/15
NBC-CMA preuss noiseless 2.0 (2)3e50/15
PM-AdapSS-DE fialho noiseless 1.6 (1)8492 (2e4)2e60/15
RCGA tran noiseless 2.9 (4)572 (10)106 (131)1e60/15
SPSA finck noiseless 2475 (2284)2e60/15
oPOEMS kubalic noiseless 31 (33)48 (3)47 (178)6e60/15
pPOEMS kubalic noiseless 5.2 (18)320 (46)36 (44)6e60/15

Δ fopt
f24, 20-D
1e1
1.3e6
1e0
7.5e6
1e-1
5.2e7
1e-2
5.2e7
1e-3
5.2e7
1e-5
5.2e7
1e-7
5.2e7
#succ
3/15
1komma2 brockhoff noiseless 2e50/15
1komma2mir brockhoff noiseless 2e50/15
1komma2mirser brockhoff noiseless 2e50/15
1komma2ser brockhoff noiseless 2e50/15
1komma4 brockhoff noiseless 2e50/15
1komma4mir brockhoff noiseless 2e50/15
1komma4mirser brockhoff noiseless 2e50/15
1komma4ser brockhoff noiseless 2e50/15
1plus1 brockhoff noiseless 2e50/15
1plus2mirser brockhoff noiseless 2e50/15
ABC elabd noiseless 2e60/15
AVGNEWUOA ros noiseless 2e50/15
CMAEGS finck noiseless 4.3 (6)2e60/15
DE-F-AUC fialho noiseless 2e60/15
DEuniform fialho noiseless 2e60/15
IPOP-ACTCMA-ES ros noiseless 25 (40)4.5 (3)5e60/15
IPOP-CMA-ES ros noiseless 5e60/15
MOS torre noiseless 1.7 (3)2e60/15
NBC-CMA preuss noiseless 3e50/15
PM-AdapSS-DE fialho noiseless 2e60/15
RCGA tran noiseless 1.7 (1)1e60/15
SPSA finck noiseless 2e60/15
oPOEMS kubalic noiseless 6e60/15
pPOEMS kubalic noiseless 64 (121)6e60/15

Previous dimension | Dimension = 40 | First dimension

Δ fopt
f1, 40-D
1e1
83
1e0
83
1e-1
83
1e-2
83
1e-3
83
1e-5
83
1e-7
83
#succ
15/15
1plus1 brockhoff noiseless 7.1 (0.9)11 (1)15 (1.0)19 (1)23 (1)31 (1)39 (1)15/15
1plus2mirser brockhoff noiseless 6.1 (0.8)10 (0.7)13 (0.8)17 (0.7)20 (0.9)27 (1)35 (0.7)15/15
AVGNEWUOA ros noiseless 3.2 (0)★43.2 (0)★43.2 (0)★43.2 (0)★43.2 (0)★43.2 (0)★43.2 (0)★415/15
CMAEGS finck noiseless 15 (1.0)22 (1)30 (1)37 (2)44 (1)59 (2)74 (1)15/15
DE-F-AUC fialho noiseless 205 (18)383 (34)594 (107)823 (78)1086 (215)1573 (298)2016 (342)15/15
DEuniform fialho noiseless 376 (20)642 (27)898 (31)1164 (53)1442 (37)1982 (44)2502 (40)15/15
IPOP-ACTCMA-ES ros noiseless 10 (1)16 (1)21 (1)28 (1)34 (3)46 (3)58 (2)15/15
IPOP-CMA-ES ros noiseless 9.4 (0.9)16 (0.5)21 (1)27 (1)33 (0.5)45 (0.9)57 (2)15/15
MOS torre noiseless 50 (1)58 (2)65 (2)76 (2)106 (8)134 (3)162 (9)15/15
NBC-CMA preuss noiseless 12 (1)19 (0.4)26 (2)32 (1)38 (2)52 (1)66 (1)15/15
PM-AdapSS-DE fialho noiseless 212 (28)364 (67)524 (16)694 (55)871 (124)1252 (152)1643 (298)15/15
RCGA tran noiseless 72 (18)1089 (802)4155 (302)5781 (271)7051 (203)8768 (158)9840 (59)15/15
SPSA finck noiseless 15 (2)20 (19)24 (4)29 (29)33 (4)41 (14)50 (9)15/15

Δ fopt
f2, 40-D
1e1
796
1e0
797
1e-1
799
1e-2
799
1e-3
800
1e-5
802
1e-7
804
#succ
15/15
1plus1 brockhoff noiseless 59 (10)70 (10)76 (5)80 (5)82 (5)85 (4)86 (4)15/15
1plus2mirser brockhoff noiseless 45 (5)55 (5)61 (8)64 (5)68 (6)70 (3)71 (3)15/15
AVGNEWUOA ros noiseless 36 (17)62 (17)79 (28)99 (20)117 (27)145 (29)179 (22)15/15
CMAEGS finck noiseless 118 (9)129 (7)135 (7)140 (8)144 (4)146 (1)148 (2)15/15
DE-F-AUC fialho noiseless 115 (18)149 (29)176 (23)201 (28)230 (38)284 (39)335 (47)15/15
DEuniform fialho noiseless 152 (7)180 (10)209 (10)237 (5)265 (6)321 (10)376 (8)15/15
IPOP-ACTCMA-ES ros noiseless 37 (3)43 (2)48 (4)51 (3)54 (3)57 (2)★458 (3)★415/15
IPOP-CMA-ES ros noiseless 61 (3)70 (3)77 (5)82 (2)85 (3)88 (3)90 (2)15/15
MOS torre noiseless 95 (48)110 (59)120 (74)130 (71)138 (51)146 (110)155 (72)15/15
NBC-CMA preuss noiseless 121 (13)146 (13)165 (17)182 (9)194 (17)213 (10)226 (12)15/15
PM-AdapSS-DE fialho noiseless 111 (13)155 (55)185 (103)216 (126)246 (64)294 (83)339 (72)15/15
RCGA tran noiseless 2e60/15
SPSA finck noiseless 4e60/15

Δ fopt
f3, 40-D
1e1
15526
1e0
15602
1e-1
15612
1e-2
15641
1e-3
15646
1e-5
15651
1e-7
15656
#succ
15/15
1plus1 brockhoff noiseless 4e50/15
1plus2mirser brockhoff noiseless 4e50/15
AVGNEWUOA ros noiseless 6e50/15
CMAEGS finck noiseless 4e60/15
DE-F-AUC fialho noiseless 4e60/15
DEuniform fialho noiseless 4e60/15
IPOP-ACTCMA-ES ros noiseless 6e60/15
IPOP-CMA-ES ros noiseless 6e60/15
MOS torre noiseless 46 (74)54 (88)56 (45)58 (100)59 (90)63 (89)66 (124)14/15
NBC-CMA preuss noiseless 3e50/15
PM-AdapSS-DE fialho noiseless 4e60/15
RCGA tran noiseless 2e60/15
SPSA finck noiseless 4e60/15

Δ fopt
f4, 40-D
1e1
15536
1e0
15601
1e-1
15659
1e-2
15678
1e-3
15703
1e-5
15733
1e-7
2.8e5
#succ
6/15
1plus1 brockhoff noiseless 4e50/15
1plus2mirser brockhoff noiseless 4e50/15
AVGNEWUOA ros noiseless 1e60/15
CMAEGS finck noiseless 4e60/15
DE-F-AUC fialho noiseless 4e60/15
DEuniform fialho noiseless 4e60/15
IPOP-ACTCMA-ES ros noiseless 6e60/15
IPOP-CMA-ES ros noiseless 6e60/15
MOS torre noiseless 116 (324)118 (154)152 (167)154 (386)155 (471)157 (54)8.9 (14)11/15
NBC-CMA preuss noiseless 3e50/15
PM-AdapSS-DE fialho noiseless 4e60/15
RCGA tran noiseless 2e60/15
SPSA finck noiseless 4e60/15

Δ fopt
f5, 40-D
1e1
98
1e0
116
1e-1
120
1e-2
121
1e-3
121
1e-5
121
1e-7
121
#succ
15/15
1plus1 brockhoff noiseless 2.8 (0.8)2.6 (0.6)2.7 (0.6)2.7 (0.8)2.7 (0.7)2.7 (0.5)2.7 (0.6)15/15
1plus2mirser brockhoff noiseless 2.8 (0.9)2.6 (0.6)2.6 (0.5)2.6 (0.7)2.6 (0.8)2.6 (0.5)2.6 (0.8)15/15
AVGNEWUOA ros noiseless 3.1 (0.5)3.2 (1)3.4 (1)3.4 (0.8)3.4 (0.6)3.4 (1)3.4 (0.9)15/15
CMAEGS finck noiseless 4.4 (1)4.1 (0.7)4.1 (0.5)4.1 (0.7)4.1 (0.7)4.1 (0.4)4.1 (0.7)15/15
DE-F-AUC fialho noiseless 73 (19)71 (11)71 (12)70 (9)70 (15)70 (24)70 (19)15/15
DEuniform fialho noiseless 96 (25)88 (26)86 (26)86 (25)86 (21)86 (19)86 (23)15/15
IPOP-ACTCMA-ES ros noiseless 4.8 (0.5)4.6 (0.7)4.5 (0.5)4.5 (0.5)4.5 (0.6)4.5 (0.5)4.5 (0.7)15/15
IPOP-CMA-ES ros noiseless 4.9 (0.9)4.7 (0.4)4.7 (0.8)4.6 (0.4)4.6 (0.5)4.7 (1.0)4.7 (0.8)15/15
MOS torre noiseless 41 (0.9)36 (0.8)35 (0.9)34 (0.8)34 (0.7)34 (0.9)34 (1)15/15
NBC-CMA preuss noiseless 3e50/15
PM-AdapSS-DE fialho noiseless 135 (34)123 (32)119 (35)118 (35)118 (15)118 (13)118 (29)15/15
RCGA tran noiseless 3930 (345)5215 (154)6169 (75)6823 (34)7275 (21)3.3e4 (3e4)2e60/15
SPSA finck noiseless 5.2 (2)5.0 (2)5.0 (2)5.0 (2)5.0 (2)5.0 (2)5.0 (2)15/15

Δ fopt
f6, 40-D
1e1
3507
1e0
5523
1e-1
7168
1e-2
9470
1e-3
11538
1e-5
15007
1e-7
19222
#succ
15/15
1plus1 brockhoff noiseless 298 (264)4e50/15
1plus2mirser brockhoff noiseless 1605 (3393)4e50/15
AVGNEWUOA ros noiseless 1.3 (0.2)1.3 (0.3)1.2 (0.1)1.2 (0.1)1.1 (0.1)★21.1 (0.1)1.1 (0.1)★215/15
CMAEGS finck noiseless 4.0 (0.8)3.7 (0.8)3.8 (0.9)3.7 (1)4.0 (1.0)5.1 (2)12 (21)15/15
DE-F-AUC fialho noiseless 32 (3)30 (3)32 (1)30 (6)30 (2)30 (2)30 (6)15/15
DEuniform fialho noiseless 58 (2)51 (2)50 (5)46 (3)44 (0.9)45 (3)43 (3)15/15
IPOP-ACTCMA-ES ros noiseless 1.5 (0.1)1.4 (0.2)1.4 (0.1)1.3 (0.1)1.3 (0.1)1.3 (0.1)1.3 (0.1)15/15
IPOP-CMA-ES ros noiseless 1.7 (0.2)1.5 (0.3)1.5 (0.1)1.4 (0.1)1.4 (0.1)1.4 (0.1)1.4 (0.1)15/15
MOS torre noiseless 4.4 (0.5)3.7 (0.4)3.4 (0.3)3.1 (0.2)3.0 (0.0)2.8 (0.2)2.7 (0.1)15/15
NBC-CMA preuss noiseless 32 (27)21 (42)16 (12)13 (11)11 (20)8.8 (13)7.5 (13)12/15
PM-AdapSS-DE fialho noiseless 38 (5)35 (6)35 (8)34 (5)35 (8)38 (3)39 (6)15/15
RCGA tran noiseless 128 (207)107 (124)105 (71)88 (1.0)79 (0.8)147 (134)1505 (2081)0/15
SPSA finck noiseless 4e60/15

Δ fopt
f7, 40-D
1e1
10698
1e0
17839
1e-1
41037
1e-2
66294
1e-3
66294
1e-5
66294
1e-7
68145
#succ
15/15
1plus1 brockhoff noiseless 48 (40)4e50/15
1plus2mirser brockhoff noiseless 35 (35)4e50/15
AVGNEWUOA ros noiseless 2e60/15
CMAEGS finck noiseless 308 (203)4e60/15
DE-F-AUC fialho noiseless 3.3 (1)279 (419)636 (950)406 (825)406 (734)406 (513)395 (284)2/15
DEuniform fialho noiseless 5.2 (0.3)5.5 (0.5)3.3 (0.4)2.8 (0.3)2.8 (0.3)2.8 (0.2)2.9 (0.2)15/15
IPOP-ACTCMA-ES ros noiseless 1.2 (0.5)2.5 (0.2)★31.5 (0.3)★20.99 (0.4)★30.99 (0.3)★30.99 (0.3)★30.97 (0.3)★315/15
IPOP-CMA-ES ros noiseless 1.6 (1.0)5.5 (1)2.6 (1)1.7 (0.1)1.7 (0.4)1.7 (0.1)1.7 (0.8)15/15
MOS torre noiseless 1.9 (1)8.2 (4)4.1 (1)2.7 (0.9)2.7 (0.8)2.7 (0.8)2.6 (0.5)15/15
NBC-CMA preuss noiseless 1.6 (3)3e50/15
PM-AdapSS-DE fialho noiseless 3.0 (0.3)20 (57)67 (147)57 (94)57 (76)57 (94)55 (59)8/15
RCGA tran noiseless 29 (7)2e60/15
SPSA finck noiseless 4e60/15

Δ fopt
f8, 40-D
1e1
7080
1e0
10655
1e-1
11012
1e-2
11265
1e-3
11430
1e-5
11701
1e-7
11969
#succ
15/15
1plus1 brockhoff noiseless 8.4 (1)11 (5)11 (5)11 (5)11 (6)11 (5)11 (4)15/15
1plus2mirser brockhoff noiseless 6.9 (3)8.1 (4)8.4 (3)8.4 (5)8.4 (2)8.5 (2)8.5 (4)15/15
AVGNEWUOA ros noiseless 1.2 (0.3)★31.6 (0.7)★21.6 (0.8)★21.6 (1)★21.6 (2)★31.6 (0.8)★31.6 (0.9)★315/15
CMAEGS finck noiseless 8.4 (1)10 (7)11 (7)11 (1)11 (10)11 (10)11 (4)15/15
DE-F-AUC fialho noiseless 78 (14)128 (99)129 (191)129 (276)130 (96)130 (6)130 (88)13/15
DEuniform fialho noiseless 107 (13)119 (10)122 (6)122 (9)123 (94)124 (5)125 (89)14/15
IPOP-ACTCMA-ES ros noiseless 5.2 (0.3)4.5 (0.2)4.6 (0.4)4.7 (1)4.7 (0.7)4.7 (0.6)4.7 (0.1)15/15
IPOP-CMA-ES ros noiseless 6.9 (0.7)6.3 (0.4)6.5 (0.4)6.5 (0.4)6.5 (0.5)6.6 (0.4)6.5 (0.4)15/15
MOS torre noiseless 18 (7)17 (5)17 (5)17 (8)17 (5)17 (7)17 (6)15/15
NBC-CMA preuss noiseless 13 (2)14 (10)15 (14)16 (3)16 (6)16 (0.6)16 (9)14/15
PM-AdapSS-DE fialho noiseless 156 (24)139 (15)144 (15)146 (12)148 (18)150 (15)150 (18)15/15
RCGA tran noiseless 2e60/15
SPSA finck noiseless 4e60/15

Δ fopt
f9, 40-D
1e1
6122
1e0
12982
1e-1
13300
1e-2
13496
1e-3
13651
1e-5
13909
1e-7
14142
#succ
15/15
1plus1 brockhoff noiseless 9.3 (4)6.8 (5)7.1 (4)7.2 (5)7.2 (0.9)7.3 (1)7.4 (2)15/15
1plus2mirser brockhoff noiseless 7.4 (2)6.0 (4)6.2 (2)6.3 (3)6.3 (4)6.4 (2)6.5 (4)15/15
AVGNEWUOA ros noiseless 1.4 (0.1)★41.1 (0.7)★41.1 (0.6)★41.2 (0.9)★41.2 (0.4)★41.2 (0.8)★41.2 (0.4)★415/15
CMAEGS finck noiseless 11 (2)9.1 (8)9.4 (10)9.4 (5)9.5 (8)10 (6)10 (0.5)15/15
DE-F-AUC fialho noiseless 97 (14)61 (4)64 (5)66 (6)67 (7)69 (6)70 (7)15/15
DEuniform fialho noiseless 121 (7)75 (2)78 (4)80 (5)81 (4)83 (2)85 (2)15/15
IPOP-ACTCMA-ES ros noiseless 6.3 (0.7)5.8 (3)5.9 (5)6.0 (5)6.0 (3)6.0 (3)6.0 (7)15/15
IPOP-CMA-ES ros noiseless 8.1 (0.5)5.7 (3)5.9 (0.2)5.9 (0.3)6.0 (0.2)6.0 (2)6.0 (0.2)15/15
MOS torre noiseless 20 (8)14 (8)14 (8)14 (8)14 (8)14 (8)14 (3)15/15
NBC-CMA preuss noiseless 15 (1)14 (7)19 (17)19 (17)19 (28)20 (22)19 (16)11/15
PM-AdapSS-DE fialho noiseless 192 (18)142 (93)146 (13)149 (228)150 (3)151 (84)152 (81)14/15
RCGA tran noiseless 2e60/15
SPSA finck noiseless 4e60/15

Δ fopt
f10, 40-D
1e1
25536
1e0
29762
1e-1
35676
1e-2
51579
1e-3
56007
1e-5
65128
1e-7
70824
#succ
15/15
1plus1 brockhoff noiseless 1.7 (0.1)1.8 (0.1)1.7 (0.3)1.2 (0.1)1.2 (0.1)1.0 (0.0)0.98 (0.0)15/15
1plus2mirser brockhoff noiseless 1.4 (0.2)1.4 (0.1)1.3 (0.2)0.98 (0.1)0.95 (0.1)0.85 (0.0)0.79 (0.0)15/15
AVGNEWUOA ros noiseless 1.4 (0.5)1.9 (0.5)1.9 (0.2)1.7 (0.3)1.8 (0.3)1.9 (0.2)2.1 (0.2)15/15
CMAEGS finck noiseless 3.5 (0.2)3.4 (0.1)3.0 (0.2)2.1 (0.1)2.0 (0.1)1.8 (0.0)1.7 (0.0)15/15
DE-F-AUC fialho noiseless 3.6 (0.8)4.1 (0.8)4.1 (0.9)3.3 (0.5)3.4 (0.7)3.5 (0.5)3.8 (0.6)15/15
DEuniform fialho noiseless 4.5 (0.1)4.6 (0.2)4.5 (0.2)3.5 (0.1)3.7 (0.1)3.8 (0.0)4.2 (0.1)15/15
IPOP-ACTCMA-ES ros noiseless 1.1 (0.1)1.1 (0.0)★21.1 (0.1)★30.80 (0.1)★30.77 (0.0)★40.70 (0.0)★40.67 (0.0)★415/15
IPOP-CMA-ES ros noiseless 1.9 (0.2)1.9 (0.1)1.8 (0.2)1.3 (0.1)1.2 (0.1)1.1 (0.0)1.0 (0.0)15/15
MOS torre noiseless 4.1 (1)4.1 (1)3.7 (1)2.7 (0.7)2.6 (0.6)2.3 (0.7)2.2 (0.4)15/15
NBC-CMA preuss noiseless 3.8 (0.6)4.0 (0.6)3.8 (0.4)2.9 (0.5)2.8 (0.3)2.6 (0.2)2.6 (0.2)15/15
PM-AdapSS-DE fialho noiseless 3.2 (0.5)3.6 (0.5)3.7 (0.9)3.0 (0.9)3.2 (0.7)3.5 (1.0)3.7 (1)15/15
RCGA tran noiseless 2e60/15
SPSA finck noiseless 4e60/15

Δ fopt
f11, 40-D
1e1
2368
1e0
4855
1e-1
11681
1e-2
25315
1e-3
29749
1e-5
38949
1e-7
48211
#succ
15/15
1plus1 brockhoff noiseless 7.8 (0.9)5.9 (0.6)3.3 (0.4)2.0 (0.2)2.1 (0.5)2.3 (0.3)2.4 (0.4)15/15
1plus2mirser brockhoff noiseless 6.0 (2)4.6 (0.8)2.7 (0.5)1.6 (0.3)1.7 (0.3)1.8 (0.2)1.9 (0.2)15/15
AVGNEWUOA ros noiseless 3.9 (0.8)★22.8 (0.6)1.5 (0.3)0.89 (0.1)0.91 (0.1)0.91 (0.1)0.90 (0.1)15/15
CMAEGS finck noiseless 557 (457)361 (186)181 (378)235 (198)922 (1503)1464 (2003)1184 (954)1/15
DE-F-AUC fialho noiseless 11 (1)9.2 (1)5.5 (0.6)3.3 (0.5)3.5 (0.4)3.8 (0.3)3.9 (0.8)15/15
DEuniform fialho noiseless 19 (1)14 (0.7)7.6 (0.3)4.4 (0.1)4.5 (0.1)4.6 (0.1)4.6 (0.1)15/15
IPOP-ACTCMA-ES ros noiseless 5.0 (0.3)2.7 (0.1)1.2 (0.1)★40.58 (0.0)★40.51 (0.0)★40.43 (0.0)★40.37 (9e-3)★415/15
IPOP-CMA-ES ros noiseless 15 (2)7.7 (0.9)3.4 (0.2)1.6 (0.1)1.4 (0.1)1.2 (0.1)0.98 (0.1)15/15
MOS torre noiseless 29 (3)16 (6)7.2 (4)3.5 (0.6)3.1 (1)2.6 (1)2.2 (0.8)15/15
NBC-CMA preuss noiseless 3e50/15
PM-AdapSS-DE fialho noiseless 12 (1)8.6 (0.9)4.8 (0.5)2.9 (0.4)3.0 (0.3)3.2 (0.5)3.3 (0.2)15/15
RCGA tran noiseless 1.2e4 (3e4)2e60/15
SPSA finck noiseless 4e60/15

Δ fopt
f12, 40-D
1e1
4169
1e0
7452
1e-1
9174
1e-2
10751
1e-3
13146
1e-5
22758
1e-7
25192
#succ
15/15
1plus1 brockhoff noiseless 1.9 (1)3.2 (1)4.4 (5)4.8 (4)4.9 (3)4.1 (3)4.4 (2)14/15
1plus2mirser brockhoff noiseless 1.7 (3)2.5 (1)3.6 (2)4.0 (3)4.2 (3)3.5 (3)4.1 (3)15/15
AVGNEWUOA ros noiseless 21 (25)24 (17)31 (8)38 (9)42 (4)39 (12)86 (84)3/5
CMAEGS finck noiseless 5.8 (0.7)7.4 (4)9.3 (17)10 (9)9.4 (4)7.9 (13)9.3 (12)15/15
DE-F-AUC fialho noiseless 41 (21)36 (44)40 (31)40 (26)39 (38)30 (22)31 (10)15/15
DEuniform fialho noiseless 41 (1)29 (9)35 (16)38 (13)39 (11)32 (8)34 (4)15/15
IPOP-ACTCMA-ES ros noiseless 1.1 (0.4)1.3 (1.0)1.7 (0.6)1.9 (0.6)1.8 (0.3)1.3 (0.3)1.3 (0.3)15/15
IPOP-CMA-ES ros noiseless 2.3 (1)2.5 (2)2.8 (2)2.9 (2)2.8 (2)2.1 (0.5)2.2 (0.8)15/15
MOS torre noiseless 4.3 (0.0)6.6 (10)7.1 (7)7.5 (7)6.8 (6)4.9 (2)5.0 (3)15/15
NBC-CMA preuss noiseless 4.2 (11)5.9 (7)7.0 (8)8.8 (6)9.1 (3)6.6 (2)6.7 (0.6)15/15
PM-AdapSS-DE fialho noiseless 26 (3)30 (0.9)37 (23)43 (21)48 (18)45 (17)51 (13)15/15
RCGA tran noiseless 194 (1)172 (269)328 (382)2683 (3767)2e60/15
SPSA finck noiseless 4e60/15

Δ fopt
f13, 40-D
1e1
2029
1e0
6916
1e-1
8734
1e-2
11861
1e-3
71936
1e-5
98467
1e-7
1.2e5
#succ
15/15
1plus1 brockhoff noiseless 3.1 (2)5.4 (3)10 (10)25 (12)10 (11)14 (16)23 (30)2/15
1plus2mirser brockhoff noiseless 2.8 (2)3.2 (1)7.2 (9)14 (11)7.0 (7)29 (32)4e50/15
CMAEGS finck noiseless 2.7 (3)4.2 (3)37 (27)215 (117)780 (765)570 (965)4e60/15
DE-F-AUC fialho noiseless 37 (8)17 (2)18 (2)17 (1)3.3 (0.6)3.2 (0.3)3.3 (0.4)15/15
DEuniform fialho noiseless 54 (2)22 (0.5)23 (0.8)20 (0.8)4.0 (0.1)3.8 (0.0)3.9 (0.1)15/15
IPOP-ACTCMA-ES ros noiseless 1.6 (0.2)2.1 (1)4.7 (4)5.9 (5)1.3 (1)1.6 (0.7)1.9 (0.9)15/15
IPOP-CMA-ES ros noiseless 2.8 (0.3)3.5 (5)6.6 (9)10 (13)2.3 (2)2.7 (2)2.9 (1)15/15
MOS torre noiseless 6.4 (5)7.0 (10)11 (9)15 (10)3.1 (2)3.2 (1)3.6 (0.9)15/15
NBC-CMA preuss noiseless 2.5 (3)5.0 (4)16 (36)26 (40)10 (6)3e50/15
PM-AdapSS-DE fialho noiseless 34 (6)15 (3)16 (2)15 (3)3.1 (0.6)3.2 (0.6)3.3 (0.6)15/15
RCGA tran noiseless 319 (11)177 (147)724 (687)1169 (1475)402 (452)2e60/15
SPSA finck noiseless 1.5e4 (8929)8631 (9979)6843 (1e4)4e60/15

Δ fopt
f14, 40-D
1e1
304
1e0
616
1e-1
777
1e-2
1105
1e-3
2207
1e-5
4825
1e-7
57711
#succ
15/15
1plus1 brockhoff noiseless 1.7 (0.4)1.6 (0.2)1.8 (0.2)2.1 (0.2)2.0 (0.2)5.1 (0.5)1.0 (0.1)15/15
1plus2mirser brockhoff noiseless 1.7 (0.2)1.5 (0.1)1.7 (0.2)1.9 (0.1)1.9 (0.2)4.2 (0.4)0.85 (0.1)15/15
CMAEGS finck noiseless 5.4 (0.5)3.8 (0.3)4.3 (0.3)5.1 (0.4)6.3 (1)19 (3)4.3 (0.3)15/15
DE-F-AUC fialho noiseless 38 (5)46 (5)63 (4)68 (10)47 (8)34 (7)4.0 (0.3)15/15
DEuniform fialho noiseless 72 (8)80 (3)99 (4)95 (3)61 (1)40 (1)4.5 (0.1)15/15
IPOP-ACTCMA-ES ros noiseless 2.5 (0.5)2.4 (0.3)3.0 (0.2)3.7 (0.3)3.4 (0.3)3.9 (0.3)0.57 (0.0)★415/15
IPOP-CMA-ES ros noiseless 2.7 (0.4)2.5 (0.4)3.0 (0.3)3.9 (0.5)4.3 (0.4)6.7 (0.3)1.1 (0.1)15/15
MOS torre noiseless 12 (0.5)7.8 (0.3)7.7 (0.6)10 (0.6)12 (1)19 (6)2.7 (0.6)15/15
NBC-CMA preuss noiseless 2.9 (0.7)2.6 (0.2)3.2 (0.2)4.4 (1)5.3 (0.2)11 (0.5)1.8 (0.1)15/15
PM-AdapSS-DE fialho noiseless 44 (3)47 (4)59 (6)60 (10)41 (5)30 (6)3.7 (0.6)15/15
RCGA tran noiseless 12 (2)28 (7)366 (63)483 (24)1403 (1812)2e60/15
SPSA finck noiseless 58 (57)41 (27)36 (33)33 (34)41 (37)6065 (4712)4e60/15

Δ fopt
f15, 40-D
1e1
1.9e5
1e0
7.9e5
1e-1
1.0e6
1e-2
1.1e6
1e-3
1.1e6
1e-5
1.1e6
1e-7
1.1e6
#succ
15/15
1plus1 brockhoff noiseless 4e50/15
1plus2mirser brockhoff noiseless 4e50/15
CMAEGS finck noiseless 4e60/15
DE-F-AUC fialho noiseless 4e60/15
DEuniform fialho noiseless 4e60/15
IPOP-ACTCMA-ES ros noiseless 0.76 (0.3)0.55 (0.3)0.64 (0.4)0.64 (0.2)0.65 (0.4)0.66 (0.4)0.67 (0.4)15/15
IPOP-CMA-ES ros noiseless 0.80 (0.3)0.60 (0.2)0.70 (0.1)0.70 (0.2)0.71 (0.2)0.72 (0.2)0.73 (0.2)15/15
MOS torre noiseless 1.9 (1)1.1 (0.3)1.3 (0.7)1.3 (0.5)1.3 (0.7)1.3 (0.6)1.3 (0.5)15/15
NBC-CMA preuss noiseless 3e50/15
PM-AdapSS-DE fialho noiseless 4e60/15
RCGA tran noiseless 76 (47)2e60/15
SPSA finck noiseless 4e60/15

Δ fopt
f16, 40-D
1e1
5244
1e0
72122
1e-1
3.2e5
1e-2
7.1e5
1e-3
1.4e6
1e-5
2.0e6
1e-7
2.0e6
#succ
15/15
1plus1 brockhoff noiseless 346 (638)4e50/15
1plus2mirser brockhoff noiseless 146 (136)4e50/15
CMAEGS finck noiseless 5.9 (2)48 (38)4e60/15
DE-F-AUC fialho noiseless 4e60/15
DEuniform fialho noiseless 4e60/15
IPOP-ACTCMA-ES ros noiseless 0.89 (0.3)0.91 (0.6)0.91 (0.7)0.74 (0.8)0.46 (0.2)0.96 (2)1.0 (2)15/15
IPOP-CMA-ES ros noiseless 0.94 (0.2)1.2 (1)1.0 (1)0.71 (0.4)0.46 (0.3)0.38 (0.2)0.39 (0.1)15/15
MOS torre noiseless 0.88 (0.1)0.17 (0.1)★40.97 (0.3)2.0 (1)5.7 (3)5.5 (5)5.4 (4)5/15
NBC-CMA preuss noiseless 413 (315)30 (46)3e50/15
PM-AdapSS-DE fialho noiseless 4e60/15
RCGA tran noiseless 19 (6)5.7 (0.6)4.2 (3)8.8 (15)2e60/15
SPSA finck noiseless 1031 (2713)4e60/15

Δ fopt
f17, 40-D
1e1
399
1e0
4220
1e-1
14158
1e-2
34948
1e-3
51958
1e-5
1.3e5
1e-7
2.7e5
#succ
14/15
1plus1 brockhoff noiseless 58 (38)4e50/15
1plus2mirser brockhoff noiseless 234 (294)4e50/15
CMAEGS finck noiseless 2.8 (0.5)0.68 (0.1)1.2 (0.1)1.5 (1.0)2.0 (0.4)3.7 (0.6)7.0 (3)14/15
DE-F-AUC fialho noiseless 18 (3)12 (3)13 (10)322 (201)4e60/15
DEuniform fialho noiseless 42 (11)20 (2)13 (2)8.3 (1)8.0 (1)17 (38)34 (53)3/15
IPOP-ACTCMA-ES ros noiseless 1.0 (0.4)0.51 (0.1)1.1 (1)1.1 (0.3)1.2 (0.4)1.00 (0.5)0.79 (0.3)15/15
IPOP-CMA-ES ros noiseless 1.1 (0.3)0.50 (0.1)1.0 (1)1.1 (0.1)1.1 (0.6)0.99 (0.3)0.84 (0.3)15/15
MOS torre noiseless 8.0 (2)1.4 (0.1)1.0 (0.1)0.87 (0.9)1.2 (0.7)1.2 (0.6)1.1 (0.8)15/15
NBC-CMA preuss noiseless 1.0 (0.1)0.77 (0.3)1.1 (1)60 (69)3e50/15
PM-AdapSS-DE fialho noiseless 21 (2)13 (7)30 (74)82 (86)505 (577)4e60/15
RCGA tran noiseless 2.0 (1)7.0 (2)32 (2)18 (0.4)15 (0.1)104 (199)2e60/15
SPSA finck noiseless 4e60/15

Δ fopt
f18, 40-D
1e1
1442
1e0
16998
1e-1
47068
1e-2
1.3e5
1e-3
1.9e5
1e-5
6.7e5
1e-7
9.5e5
#succ
15/15
1plus1 brockhoff noiseless 4e50/15
1plus2mirser brockhoff noiseless 4e50/15
CMAEGS finck noiseless 1.4 (0.3)0.49 (0.7)1.4 (0.7)1.1 (0.2)1.3 (0.6)3.1 (2)6.8 (4)3/15
DE-F-AUC fialho noiseless 19 (5)5.2 (2)18 (1.0)442 (338)4e60/15
DEuniform fialho noiseless 35 (3)7.5 (0.7)4.8 (0.4)2.7 (0.2)2.5 (0.4)13 (15)28 (27)2/15
IPOP-ACTCMA-ES ros noiseless 1.0 (0.4)0.62 (0.5)0.98 (0.4)0.69 (0.4)0.70 (0.2)0.49 (0.4)0.51 (0.7)15/15
IPOP-CMA-ES ros noiseless 0.97 (0.3)0.66 (1.0)1.1 (0.5)0.85 (0.3)0.86 (0.0)0.74 (0.6)1.4 (3)14/15
MOS torre noiseless 3.5 (1)0.84 (0.0)1.1 (0.6)0.95 (0.5)1.1 (0.3)1.0 (0.7)1.1 (0.5)14/15
NBC-CMA preuss noiseless 1.3 (0.3)0.58 (0.3)3e50/15
PM-AdapSS-DE fialho noiseless 20 (2)4.5 (0.8)3.4 (2)29 (48)4e60/15
RCGA tran noiseless 6.6 (2)19 (2)12 (0.1)5.8 (0.1)14 (13)2e60/15
SPSA finck noiseless 4e60/15

Δ fopt
f19, 40-D
1e1
1
1e0
1
1e-1
1.4e6
1e-2
1.7e7
1e-3
2.6e7
1e-5
4.5e7
1e-7
4.5e7
#succ
8/15
1plus1 brockhoff noiseless 5510 (1e4)4e50/15
1plus2mirser brockhoff noiseless 7249 (1e4)4e50/15
CMAEGS finck noiseless 934 (147)1.2e5 (8e4)4e60/15
DE-F-AUC fialho noiseless 5034 (718)4e60/15
DEuniform fialho noiseless 1.3e4 (2790)4e60/15
IPOP-ACTCMA-ES ros noiseless 458 (105)5.0e4 (2e4)0.57 (0.4)0.38 (0.1)0.33 (0.1)0.20 (0.1)0.21 (0.1)15/15
IPOP-CMA-ES ros noiseless 442 (105)6.8e4 (7e4)0.64 (0.5)0.38 (0.1)0.31 (0.1)0.21 (0.1)0.22 (0.1)14/15
MOS torre noiseless 3026 (0)6.4e4 (6e4)2.6 (2)4e60/15
NBC-CMA preuss noiseless 624 (184)3e50/15
PM-AdapSS-DE fialho noiseless 6161 (1331)4e60/15
RCGA tran noiseless 416 (20)1.9e6 (9e5)2e60/15
SPSA finck noiseless 1.5e4 (1e4)4e60/15

Δ fopt
f20, 40-D
1e1
222
1e0
1.3e5
1e-1
1.6e8
1e-2
1e-3
1e-5
1e-7
#succ
0/15
1plus1 brockhoff noiseless 2.6 (0.4)    0/15
1plus2mirser brockhoff noiseless 2.5 (0.3)    0/15
CMAEGS finck noiseless 7.0 (0.9)    0/15
DE-F-AUC fialho noiseless 52 (3)    0/15
DEuniform fialho noiseless 116 (11)    0/15
IPOP-ACTCMA-ES ros noiseless 3.7 (0.4)8.4 (2)0.19 (0.1)    0/15
IPOP-CMA-ES ros noiseless 4.1 (0.6)15 (3)0.33 (0.3)    0/15
MOS torre noiseless 16 (0.6)3.8 (3)9.5e-3 (4e-3)1.8e6 (1e6) 1.9e6 (9e5) 2.3e6 (9e5) 2.5e6 (1e6) 14/15
NBC-CMA preuss noiseless 5.1 (0.5)    0/15
PM-AdapSS-DE fialho noiseless 58 (5)    0/15
RCGA tran noiseless 8.5 (2)    0/15
SPSA finck noiseless 10 (1)    0/15

Δ fopt
f21, 40-D
1e1
1044
1e0
21144
1e-1
1.0e5
1e-2
1.0e5
1e-3
1.0e5
1e-5
1.0e5
1e-7
1.0e5
#succ
26/30
1plus1 brockhoff noiseless 5.0 (9)1.9 (2)0.97 (0.5)0.97 (2)0.97 (1)0.97 (0.6)0.97 (1)14/15
1plus2mirser brockhoff noiseless 2.4 (9)2.3 (10)1.1 (3)1.1 (1)1.1 (1)1.1 (2)1.1 (1)14/15
CMAEGS finck noiseless 14 (17)107 (147)62 (179)62 (99)62 (70)62 (89)62 (49)6/15
DE-F-AUC fialho noiseless 293 (3)758 (662)258 (328)258 (297)257 (405)256 (373)255 (342)2/15
DEuniform fialho noiseless 36 (4)287 (567)557 (983)555 (762)553 (385)550 (795)548 (801)1/15
IPOP-ACTCMA-ES ros noiseless 9.2 (17)161 (211)118 (110)118 (81)118 (264)117 (117)116 (290)3/15
IPOP-CMA-ES ros noiseless 10 (8)166 (73)83 (121)83 (181)83 (82)82 (68)82 (67)4/15
MOS torre noiseless 15 (41)224 (110)101 (95)101 (45)101 (139)100 (162)100 (113)5/15
NBC-CMA preuss noiseless 73 (216)199 (170)42 (49)42 (42)41 (58)41 (42)41 (54)1/15
PM-AdapSS-DE fialho noiseless 295 (965)1231 (1277)4e60/15
RCGA tran noiseless 7.7 (7)89 (60)31 (45)33 (27)33 (28)34 (23)35 (42)7/15
SPSA finck noiseless 880 (1625)2650 (2081)4e60/15

Δ fopt
f22, 40-D
1e1
3090
1e0
35442
1e-1
6.5e5
1e-2
6.5e5
1e-3
6.5e5
1e-5
6.5e5
1e-7
6.5e5
#succ
8/30
1plus1 brockhoff noiseless 9.1 (10)6.2 (7)2.0 (1)2.0 (3)2.0 (2)2.0 (2)2.0 (2)4/15
1plus2mirser brockhoff noiseless 1.9 (3)4.9 (8)9.0 (7)8.9 (20)8.9 (8)8.9 (19)8.9 (11)1/15
CMAEGS finck noiseless 326 (652)226 (311)4e60/15
DE-F-AUC fialho noiseless 478 (1619)312 (197)4e60/15
DEuniform fialho noiseless 661 (649)453 (451)4e60/15
IPOP-ACTCMA-ES ros noiseless 295 (723)174 (258)3e60/15
IPOP-CMA-ES ros noiseless 367 (747)133 (150)3e60/15
MOS torre noiseless 490 (1180)205 (512)5e60/15
NBC-CMA preuss noiseless 49 (97)23 (28)3e50/15
PM-AdapSS-DE fialho noiseless 654 (1295)1581 (1044)4e60/15
RCGA tran noiseless 335 (486)101 (89)2e60/15
SPSA finck noiseless 769 (675)737 (735)4e60/15

Δ fopt
f23, 40-D
1e1
7.0
1e0
11925
1e-1
75453
1e-2
6.6e5
1e-3
1.3e6
1e-5
3.2e6
1e-7
3.4e6
#succ
15/15
1plus1 brockhoff noiseless 9.1 (11)10 (15)4e50/15
1plus2mirser brockhoff noiseless 9.1 (6)12 (11)4e50/15
CMAEGS finck noiseless 63 (20)4e60/15
DE-F-AUC fialho noiseless 1.7 (2)4e60/15
DEuniform fialho noiseless 0.76 (0.9)4e60/15
IPOP-ACTCMA-ES ros noiseless 8.4 (10)4e60/15
IPOP-CMA-ES ros noiseless 8.1 (6)4e60/15
MOS torre noiseless 1.1 (0.4)41 (40)18 (43)19 (14)46 (116)4e60/15
NBC-CMA preuss noiseless 1.9 (1)3e50/15
PM-AdapSS-DE fialho noiseless 1.9 (2)4e60/15
RCGA tran noiseless 1.2 (1)149 (31)40 (40)44 (26)2e60/15
SPSA finck noiseless 2053 (779)4e60/15

Δ fopt
f24, 40-D
1e1
5.8e6
1e0
9.8e7
1e-1
3.0e8
1e-2
3.0e8
1e-3
3.0e8
1e-5
3.0e8
1e-7
3.0e8
#succ
1/15
1plus1 brockhoff noiseless 4e50/15
1plus2mirser brockhoff noiseless 4e50/15
CMAEGS finck noiseless 4.6 (5)4e60/15
DE-F-AUC fialho noiseless 4e60/15
DEuniform fialho noiseless 4e60/15
IPOP-ACTCMA-ES ros noiseless 9e60/15
IPOP-CMA-ES ros noiseless 9e60/15
MOS torre noiseless 2.4 (2)4e60/15
NBC-CMA preuss noiseless 3e50/15
PM-AdapSS-DE fialho noiseless 4e60/15
RCGA tran noiseless 2e60/15
SPSA finck noiseless 4e60/15

Average runtime (aRT in number of function evaluations) divided by the respective best aRT measured during BBOB-2009 in different dimensions. The aRT and in braces, as dispersion measure, the half difference between 10 and 90%-tile of bootstrapped run lengths appear for each algorithm and target, the corresponding reference aRT  in the first row. The different target ∆f-values are shown in the top row. #succ is the number of trials that reached the (final) target fopt+ 10−8. The median number of conducted function evaluations is additionally given in italics, if the target in the last column was never reached. Entries, succeeded by a star, are statistically significantly better (according to the rank-sum test) when compared to all other algorithms of the table, with p = 0.05 or p = 10−k when the number k following the star is larger than 1, with Bonferroni correction by the number of functions (24). A ↓ indicates the same tested against the best algorithm from BBOB 2009. Best results are printed in bold.
Data produced with COCO v2.0.760