Overview page

Table showing the aRT in number of function evaluations divided by the best aRT measured during BBOB-2009

Last dimension | Dimension = 2 | Next dimension

Δ fopt
f1, 2-D
1e1
2.0
1e0
6.0
1e-1
6.0
1e-2
6.0
1e-3
6.0
1e-5
6.0
1e-7
6.0
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1.3 (0.2)3.7 (4)25 (11)370 (344)3217 (5462)2.6e5 (2e5)2e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1.4 (1)3.9 (3)39 (37)597 (769)3271 (4949)5.1e5 (6e5)2e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 1.7 (0.8)4.6 (4)36 (21)700 (609)6477 (6747)3.8e5 (5e5)2.3e7 (2e7)1/15
CMAES-APOP-Nguyen 2.5 (1)2.9 (0.5)7.4 (5)13 (6)18 (6)26 (5)38 (5)15/15
DTS-CMA-ES-Pitra 1.7 (1)2.1 (1)3.5 (0.8)4.2 (2)5.4 (0.8)★37.2 (0.5)★48.9 (1)★415/15
EvoSpace-PSO-GA-Garcia-Valdez 55 (48)25 (8)28 (13)99 (122)398 (300)983 (590)1524 (421)15/15
KL-BIPOP-CMA-ES-Yamaguchi 4.5 (5)4.6 (4)8.6 (4)14 (6)19 (6)30 (7)40 (6)15/15
KL-IPOP-CMA-ES-Yamaguchi 3.4 (5)3.6 (2)8.0 (6)14 (7)18 (7)31 (6)40 (5)15/15
KL-Restart-CMA-ES-Yamaguchi 10 (10)10 (9)19 (18)37 (10)49 (10)75 (10)102 (14)15/15
Ord-H-DTS-CMA-ES-Pitra 2.3 (4)2.4 (0.7)3.9 (2)7.2 (3)12 (3)19 (9)37 (28)9/15
Ord-N-DTS-CMA-ES-Pitra 2.4 (3)2.2 (1)3.9 (1)6.0 (0.8)8.5 (4)17 (4)30 (20)11/15
Ord-Q-DTS-CMA-ES-Pitra 2.2 (4)2.7 (0.9)4.5 (2)6.4 (2)10 (4)18 (9)31 (19)8/15
SSEABC-Aydin 1.5 (0.5)6.6 (6)13 (5)20 (2)25 (5)36 (3)45 (4)15/15

Δ fopt
f2, 2-D
1e1
16
1e0
19
1e-1
25
1e-2
25
1e-3
26
1e-5
28
1e-7
29
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 172 (102)968 (1805)1.1e4 (1e4)5.7e4 (2e4)6.6e5 (8e5)2e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 201 (183)1711 (918)7846 (4497)8.8e4 (9e4)1.1e6 (2e6)1.0e7 (6e6)2e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 276 (165)1416 (2977)1.1e4 (1e4)1.3e5 (2e5)7.4e5 (6e5)2e70/15
CMAES-APOP-Nguyen 13 (8)19 (9)17 (3)19 (2)20 (2)20 (4)22 (2)15/15
DTS-CMA-ES-Pitra 2.8 (1.0)3.0 (0.5)★22.6 (0.4)★42.8 (0.4)★42.9 (0.3)★43.1 (0.3)★43.4 (0.4)★415/15
EvoSpace-PSO-GA-Garcia-Valdez 283 (201)331 (189)321 (106)349 (25)364 (94)433 (67)470 (67)15/15
KL-BIPOP-CMA-ES-Yamaguchi 18 (13)21 (7)19 (4)20 (4)20 (3)21 (3)22 (3)15/15
KL-IPOP-CMA-ES-Yamaguchi 20 (14)21 (9)19 (6)21 (4)21 (6)22 (3)23 (5)15/15
KL-Restart-CMA-ES-Yamaguchi 18 (10)24 (4)22 (3)25 (3)28 (4)31 (4)36 (3)15/15
Ord-H-DTS-CMA-ES-Pitra 10 (6)27 (22)38 (38)60 (50)57 (93)2010/15
Ord-N-DTS-CMA-ES-Pitra 7.4 (14)22 (11)39 (52)59 (41)114 (106)2010/15
Ord-Q-DTS-CMA-ES-Pitra 11 (11)17 (17)37 (40)59 (49)57 (66)2010/15
SSEABC-Aydin 17 (9)22 (11)19 (5)22 (3)22 (6)23 (3)25 (2)15/15

Δ fopt
f3, 2-D
1e1
15
1e0
271
1e-1
445
1e-2
446
1e-3
450
1e-5
454
1e-7
464
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 7.3 (7)47 (89)410 (455)2156 (2122)1.7e4 (1e4)6.4e5 (7e5)2e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 7.9 (8)40 (31)323 (329)3104 (1906)3.1e4 (3e4)2e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 6.0 (6)55 (52)604 (698)4464 (6933)3.7e4 (4e4)6.3e5 (4e5)2e70/15
CMAES-APOP-Nguyen 2.8 (1)2.4 (2)5.0 (4)8.3 (6)9.4 (8)11 (9)11 (11)15/15
DTS-CMA-ES-Pitra 2.5 (0.7)2.1 (7)14 (20)14 (9)14 (18)14 (8)14 (10)4/15
EvoSpace-PSO-GA-Garcia-Valdez 12 (4)14 (5)13 (10)19 (3)22 (4)26 (5)31 (7)15/15
KL-BIPOP-CMA-ES-Yamaguchi 3.1 (2)3.4 (1)8.1 (6)13 (17)13 (9)13 (17)13 (18)15/15
KL-IPOP-CMA-ES-Yamaguchi 2.9 (4)2.5 (2)4.8 (8)5.8 (5)6.0 (4)6.6 (12)6.8 (7)15/15
KL-Restart-CMA-ES-Yamaguchi 5.4 (5)2.6 (2)5.1 (5)5.4 (5)5.6 (6)5.9 (11)6.1 (3)15/15
Ord-H-DTS-CMA-ES-Pitra 2.7 (2)2.4 (1)2010/15
Ord-N-DTS-CMA-ES-Pitra 3.7 (4)2.4 (4)6.4 (4)6.4 (7)2020/15
Ord-Q-DTS-CMA-ES-Pitra 2.8 (3)3.4 (2)2010/15
SSEABC-Aydin 4.9 (2)1.8 (2)5.5 (5)8.4 (8)9.1 (4)14 (22)16 (11)14/15

Δ fopt
f4, 2-D
1e1
22
1e0
344
1e-1
459
1e-2
496
1e-3
523
1e-5
544
1e-7
566
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 7.8 (11)51 (57)424 (355)4970 (8152)3.6e4 (4e4)2e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 10 (15)71 (94)560 (591)6199 (4920)6.0e4 (6e4)2e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 11 (8)104 (97)992 (938)7237 (4772)3.7e4 (3e4)5.3e5 (6e5)2e70/15
CMAES-APOP-Nguyen 2.2 (1)12 (7)62 (58)98 (68)98 (62)101 (31)101 (65)15/15
DTS-CMA-ES-Pitra 1.4 (0.3)3.3 (2)4.9 (8)6.3 (4)7.3 (7)7.1 (9)6.9 (8)5/15
EvoSpace-PSO-GA-Garcia-Valdez 7.3 (3)10 (10)15 (9)19 (2)28 (31)33 (4)36 (64)14/15
KL-BIPOP-CMA-ES-Yamaguchi 2.1 (1)2.7 (4)36 (51)48 (36)48 (44)48 (71)47 (94)15/15
KL-IPOP-CMA-ES-Yamaguchi 3.5 (3)6.9 (3)54 (80)118 (142)274 (344)284 (344)285 (175)15/15
KL-Restart-CMA-ES-Yamaguchi 4.4 (3)6.0 (4)49 (45)57 (47)54 (35)53 (71)51 (59)15/15
Ord-H-DTS-CMA-ES-Pitra 1.7 (2)2010/15
Ord-N-DTS-CMA-ES-Pitra 2.2 (2)8.6 (6)2010/15
Ord-Q-DTS-CMA-ES-Pitra 2.8 (3)8.7 (15)2010/15
SSEABC-Aydin 3.3 (3)3.8 (3)18 (17)23 (36)36 (39)40 (54)49 (60)6/15

Δ fopt
f5, 2-D
1e1
4.0
1e0
4.0
1e-1
4.0
1e-2
4.0
1e-3
4.0
1e-5
4.0
1e-7
4.0
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 2e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 21 (21)2e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 3.3 (0.9)676 (920)4.2e4 (6e4)2.6e6 (1e6)2e70/15
CMAES-APOP-Nguyen 3.8 (2)6.8 (4)7.4 (4)7.4 (5)7.4 (3)7.4 (4)7.4 (5)15/15
DTS-CMA-ES-Pitra 2.5 (2)4.0 (0.5)4.5 (1)4.7 (0.9)4.7 (1)4.7 (1)4.7 (1)15/15
EvoSpace-PSO-GA-Garcia-Valdez 43 (14)66 (36)141 (71)158 (48)158 (46)158 (19)158 (45)15/15
KL-BIPOP-CMA-ES-Yamaguchi 2.3 (4)5.3 (4)6.0 (5)6.1 (4)6.1 (5)6.1 (3)6.1 (5)15/15
KL-IPOP-CMA-ES-Yamaguchi 3.5 (4)6.0 (3)6.2 (2)6.4 (5)6.4 (5)6.4 (3)6.4 (3)15/15
KL-Restart-CMA-ES-Yamaguchi 7.7 (0.6)14 (7)16 (5)16 (5)16 (8)16 (5)16 (5)15/15
Ord-H-DTS-CMA-ES-Pitra 1.9 (2)4.2 (1)4.4 (2)4.4 (2)4.4 (2)4.4 (0.7)4.4 (1)15/15
Ord-N-DTS-CMA-ES-Pitra 2.7 (2)4.7 (2)5.0 (1)5.0 (4)5.0 (0.7)5.0 (0.6)5.0 (4)15/15
Ord-Q-DTS-CMA-ES-Pitra 2.6 (1)4.0 (0.8)4.1 (0.7)4.1 (0.6)4.1 (1)4.1 (0.2)4.1 (0.6)15/15
SSEABC-Aydin 2.8 (1)8.4 (2)9.2 (3)9.2 (4)9.2 (5)9.2 (3)9.2 (2)15/15

Δ fopt
f6, 2-D
1e1
13
1e0
23
1e-1
41
1e-2
54
1e-3
67
1e-5
95
1e-7
124
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1.9 (2)12 (11)69 (40)501 (314)8247 (9933)6.8e5 (1e6)2e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1.7 (2)15 (3)94 (85)610 (337)5395 (3699)5.5e5 (3e5)2e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 2.8 (3)16 (8)98 (69)1104 (1130)1.7e4 (1e4)1.5e6 (3e6)2e70/15
CMAES-APOP-Nguyen 1.5 (1)2.6 (2)3.2 (0.7)3.5 (2)3.6 (1)3.9 (1)3.8 (0.7)15/15
DTS-CMA-ES-Pitra 1.5 (1)1.7 (1)2.3 (2)2.7 (2)2.7 (2)2.6 (1)2.6 (0.6)15/15
EvoSpace-PSO-GA-Garcia-Valdez 11 (4)46 (103)66 (51)98 (55)112 (26)102 (18)128 (27)15/15
KL-BIPOP-CMA-ES-Yamaguchi 2.8 (2)4.1 (3)3.7 (2)4.0 (1)4.4 (1)4.2 (0.6)4.2 (0.6)15/15
KL-IPOP-CMA-ES-Yamaguchi 2.8 (1)3.7 (1)3.5 (2)4.1 (2)4.4 (1.0)4.4 (1)4.5 (0.8)15/15
KL-Restart-CMA-ES-Yamaguchi 3.8 (1)7.9 (5)9.4 (3)9.5 (2)10 (3)11 (2)12 (0.9)15/15
Ord-H-DTS-CMA-ES-Pitra 1.8 (1)7.0 (7)36 (20)55 (59)2010/15
Ord-N-DTS-CMA-ES-Pitra 1.2 (1)6.0 (8)12 (11)55 (39)2010/15
Ord-Q-DTS-CMA-ES-Pitra 2.0 (1)5.9 (10)6.8 (6)2010/15
SSEABC-Aydin 3.5 (4)5.4 (1)4.4 (1)4.7 (0.8)4.8 (1)4.9 (0.6)5.0 (0.8)15/15

Δ fopt
f7, 2-D
1e1
3.0
1e0
21
1e-1
60
1e-2
193
1e-3
217
1e-5
217
1e-7
241
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 6.9 (15)4.4 (5)20 (18)17 (16)43 (40)43 (23)459 (548)15/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 3.6 (3)2.6 (3)27 (29)36 (33)202 (240)202 (141)718 (1166)15/15
RANDOMSEARCH-5-1e7D-Brockhoff 5.2 (6)2.7 (2)32 (25)62 (72)207 (277)207 (140)672 (1277)15/15
CMAES-APOP-Nguyen 4.2 (4)2.8 (0.8)2.5 (3)1.4 (0.9)1.6 (0.9)1.6 (0.6)1.8 (1.0)15/15
DTS-CMA-ES-Pitra 4.7 (2)1.2 (0.3)1.2 (1)0.62 (1)0.72 (0.3)0.72 (1)0.81 (0.9)14/15
EvoSpace-PSO-GA-Garcia-Valdez 29 (30)5.0 (2)46 (47)20 (19)23 (17)23 (16)26 (16)15/15
KL-BIPOP-CMA-ES-Yamaguchi 3.6 (2)2.9 (2)3.5 (2)1.5 (0.6)1.5 (3)1.5 (1)1.4 (0.8)15/15
KL-IPOP-CMA-ES-Yamaguchi 2.7 (3)3.2 (6)2.9 (4)1.3 (1)1.3 (0.7)1.3 (0.7)1.2 (0.8)15/15
KL-Restart-CMA-ES-Yamaguchi 7.2 (8)3.7 (4)3.4 (2)1.4 (0.6)1.4 (0.4)1.4 (0.6)1.2 (0.5)15/15
Ord-H-DTS-CMA-ES-Pitra 4.4 (4)2.7 (4)2.1 (2)1.0 (0.7)1.2 (0.6)1.2 (1)1.8 (2)1/15
Ord-N-DTS-CMA-ES-Pitra 6.9 (4)3.6 (5)3.9 (4)1.7 (2)1.9 (2)1.9 (3)2.1 (3)4/15
Ord-Q-DTS-CMA-ES-Pitra 4.6 (5)2.7 (3)2.3 (0.8)1.1 (2)2.4 (2)2.4 (3)2.8 (4)2/15
SSEABC-Aydin 4.3 (2)4.6 (6)3.6 (3)1.4 (1)1.4 (1.0)1.4 (1.0)1.4 (1)15/15

Δ fopt
f8, 2-D
1e1
5.0
1e0
12
1e-1
37
1e-2
46
1e-3
86
1e-5
94
1e-7
112
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 5.7 (4)24 (27)66 (53)512 (149)2789 (2529)1.9e5 (2e5)1.3e6 (9e5)0/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 5.9 (4)23 (34)60 (36)627 (212)3339 (1835)3.2e5 (3e5)2e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 5.5 (3)15 (15)59 (70)625 (729)2184 (2380)3.6e5 (4e5)2e70/15
CMAES-APOP-Nguyen 4.4 (4)6.3 (3)5.8 (6)6.4 (2)4.1 (4)4.6 (4)4.4 (2)15/15
DTS-CMA-ES-Pitra 5.0 (2)3.6 (2)2.2 (0.8)2.1 (0.8)★21.2 (0.4)★21.3 (0.4)★31.2 (0.3)★315/15
EvoSpace-PSO-GA-Garcia-Valdez 27 (11)67 (87)98 (87)150 (45)104 (21)157 (51)196 (30)15/15
KL-BIPOP-CMA-ES-Yamaguchi 4.5 (3)5.3 (6)7.6 (3)8.2 (3)5.0 (2)5.5 (1)5.2 (0.9)15/15
KL-IPOP-CMA-ES-Yamaguchi 5.1 (2)7.8 (2)6.3 (5)8.2 (3)5.3 (2)5.6 (1)5.3 (2)15/15
KL-Restart-CMA-ES-Yamaguchi 6.5 (6)12 (6)11 (5)16 (9)10 (3)11 (2)11 (2)15/15
Ord-H-DTS-CMA-ES-Pitra 6.4 (10)12 (13)25 (45)65 (153)2010/15
Ord-N-DTS-CMA-ES-Pitra 6.0 (10)8.6 (6)17 (13)31 (62)17 (12)32 (28)2010/15
Ord-Q-DTS-CMA-ES-Pitra 4.0 (3)8.6 (18)8.5 (8)32 (47)34 (34)31 (35)27 (33)1/15
SSEABC-Aydin 10 (6)21 (28)11 (8)12 (10)7.0 (4)7.0 (1)6.6 (4)15/15

Δ fopt
f9, 2-D
1e1
1
1e0
18
1e-1
30
1e-2
44
1e-3
68
1e-5
81
1e-7
92
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 37 (44)10 (10)65 (29)416 (294)3313 (2587)3.0e5 (5e5)3.2e6 (3e6)0/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 36 (28)11 (13)117 (107)738 (703)3620 (4364)3.6e5 (4e5)2e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 48 (52)21 (8)115 (128)674 (748)3542 (3475)4.9e5 (4e5)2e70/15
CMAES-APOP-Nguyen 1 (0)★24.1 (7)7.5 (7)7.6 (4)6.0 (3)5.9 (2)5.9 (2)15/15
DTS-CMA-ES-Pitra 19 (9)2.1 (1)2.4 (1)2.1 (0.8)★21.5 (0.2)★31.4 (0.4)★41.4 (0.4)★415/15
EvoSpace-PSO-GA-Garcia-Valdez 119 (50)42 (72)97 (94)151 (63)127 (69)159 (30)209 (54)15/15
KL-BIPOP-CMA-ES-Yamaguchi 37 (7)7.2 (3)10 (5)8.8 (8)6.7 (2)6.7 (0.4)6.6 (6)15/15
KL-IPOP-CMA-ES-Yamaguchi 21 (17)6.8 (11)11 (7)9.5 (2)6.9 (3)6.8 (4)6.7 (2)15/15
KL-Restart-CMA-ES-Yamaguchi 31 (36)7.6 (6)18 (12)17 (11)13 (5)14 (5)14 (4)15/15
Ord-H-DTS-CMA-ES-Pitra 29 (76)5.5 (9)17 (16)22 (17)44 (31)2010/15
Ord-N-DTS-CMA-ES-Pitra 18 (13)3.6 (1)12 (7)65 (53)2010/15
Ord-Q-DTS-CMA-ES-Pitra 14 (9)2.9 (1)12 (12)13 (12)43 (56)37 (40)2010/15
SSEABC-Aydin 34 (31)5.9 (4)9.1 (7)9.2 (4)7.1 (3)7.0 (2)7.0 (2)15/15

Δ fopt
f10, 2-D
1e1
30
1e0
46
1e-1
54
1e-2
61
1e-3
68
1e-5
82
1e-7
98
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 89 (48)222 (152)4390 (4384)2.3e4 (1e4)1.4e5 (3e5)2e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 38 (38)467 (112)4723 (7467)3.8e4 (5e4)5.7e5 (6e5)2e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 154 (104)821 (1306)5855 (5750)4.4e4 (2e4)3.2e5 (5e5)2e70/15
CMAES-APOP-Nguyen 5.7 (5)6.5 (3)6.8 (3)6.8 (2)6.5 (1)6.5 (0.5)6.0 (0.6)15/15
DTS-CMA-ES-Pitra 1.5 (0.5)1.2 (0.3)★31.1 (0.1)★31.1 (0.2)★41.1 (0.1)★41.0 (0.1)★41.0 (0.1)★415/15
EvoSpace-PSO-GA-Garcia-Valdez 261 (220)404 (865)714 (765)808 (733)993 (793)1574 (1159)2175 (1661)8/15
KL-BIPOP-CMA-ES-Yamaguchi 10 (6)9.5 (4)8.7 (3)8.4 (2)8.1 (2)7.6 (1.0)6.7 (0.7)15/15
KL-IPOP-CMA-ES-Yamaguchi 9.2 (6)8.6 (1)8.2 (1.0)8.2 (1)7.8 (0.9)7.2 (1)6.7 (0.7)15/15
KL-Restart-CMA-ES-Yamaguchi 9.2 (6)9.3 (3)10 (1)10 (2)10 (0.7)10 (0.7)10 (2)15/15
Ord-H-DTS-CMA-ES-Pitra 4.9 (9)11 (10)26 (29)2010/15
Ord-N-DTS-CMA-ES-Pitra 6.0 (9)8.5 (9)13 (16)24 (23)22 (28)37 (20)2010/15
Ord-Q-DTS-CMA-ES-Pitra 5.4 (7)8.3 (7)8.9 (8)12 (13)22 (34)36 (29)2010/15
SSEABC-Aydin 9.3 (7)9.0 (4)10 (3)9.3 (1)8.9 (0.8)8.2 (1)7.6 (0.7)15/15

Δ fopt
f11, 2-D
1e1
35
1e0
45
1e-1
50
1e-2
62
1e-3
67
1e-5
81
1e-7
97
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 44 (80)296 (306)4792 (3090)4.1e4 (4e4)2.2e5 (1e5)2e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 65 (86)524 (826)5393 (3812)5.2e4 (5e4)3.7e5 (7e5)3.6e6 (2e6)2e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 71 (48)795 (1128)8644 (5615)6.2e4 (3e4)4.7e5 (6e5)2e70/15
CMAES-APOP-Nguyen 5.8 (5)7.9 (3)8.6 (3)7.6 (1)7.4 (1)6.9 (1)6.3 (0.9)15/15
DTS-CMA-ES-Pitra 1.3 (0.5)1.3 (0.3)★21.3 (0.2)★41.1 (0.2)★41.1 (0.2)★41.1 (0.2)★41.0 (0.1)★415/15
EvoSpace-PSO-GA-Garcia-Valdez 164 (118)314 (54)504 (234)681 (291)828 (489)1280 (308)1585 (2518)11/15
KL-BIPOP-CMA-ES-Yamaguchi 7.4 (5)8.9 (5)9.2 (2)8.0 (3)7.9 (2)7.3 (1)6.7 (1)15/15
KL-IPOP-CMA-ES-Yamaguchi 7.6 (6)8.5 (4)9.3 (2)8.3 (2)8.0 (1)7.4 (0.9)6.9 (1)15/15
KL-Restart-CMA-ES-Yamaguchi 7.6 (4)10 (4)11 (3)10 (1)11 (1)11 (0.7)10 (0.2)15/15
Ord-H-DTS-CMA-ES-Pitra 5.5 (7)21 (22)59 (70)2010/15
Ord-N-DTS-CMA-ES-Pitra 11 (10)15 (11)19 (18)24 (18)22 (24)37 (43)31 (30)0/15
Ord-Q-DTS-CMA-ES-Pitra 3.0 (0.9)5.4 (9)7.9 (5)6.5 (7)11 (14)37 (50)2010/15
SSEABC-Aydin 10 (6)10 (2)10 (1)8.9 (0.9)8.9 (1)8.1 (1)7.5 (1)15/15

Δ fopt
f12, 2-D
1e1
35
1e0
46
1e-1
75
1e-2
94
1e-3
105
1e-5
153
1e-7
195
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 86 (145)494 (506)2730 (3284)2.1e4 (3e4)1.8e5 (3e5)2e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 82 (226)512 (358)2931 (2656)2.0e4 (1e4)3.4e5 (5e5)2e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 54 (53)613 (620)4572 (4267)1.7e4 (2e4)2.0e5 (3e5)2e70/15
CMAES-APOP-Nguyen 5.9 (3)10 (7)7.5 (8)6.7 (7)7.1 (6)6.1 (6)5.5 (2)15/15
DTS-CMA-ES-Pitra 2.1 (2)3.5 (4)3.1 (4)3.0 (3)3.0 (4)2.5 (2)2.2 (1)15/15
EvoSpace-PSO-GA-Garcia-Valdez 114 (120)208 (59)213 (295)225 (255)302 (308)334 (284)407 (313)12/15
KL-BIPOP-CMA-ES-Yamaguchi 5.2 (4)11 (12)11 (17)11 (8)10 (12)8.8 (13)8.0 (6)15/15
KL-IPOP-CMA-ES-Yamaguchi 11 (3)16 (4)13 (15)12 (26)11 (2)9.4 (19)8.2 (10)15/15
KL-Restart-CMA-ES-Yamaguchi 11 (4)11 (3)8.3 (2)8.0 (2)8.7 (1)7.5 (1)7.1 (1)15/15
Ord-H-DTS-CMA-ES-Pitra 5.3 (5)12 (7)13 (12)2010/15
Ord-N-DTS-CMA-ES-Pitra 3.9 (7)11 (20)40 (31)32 (68)2010/15
Ord-Q-DTS-CMA-ES-Pitra 5.5 (9)19 (34)20 (49)2010/15
SSEABC-Aydin 6.2 (6)8.0 (4)6.7 (2)6.5 (0.8)7.0 (2)6.2 (2)6.5 (6)15/15

Δ fopt
f13, 2-D
1e1
23
1e0
35
1e-1
46
1e-2
60
1e-3
71
1e-5
95
1e-7
122
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 10 (11)279 (325)3926 (2036)1.0e5 (1e5)4.0e6 (8e6)2e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 13 (13)210 (546)8638 (1e4)1.6e5 (2e5)2e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 12 (13)376 (845)1.3e4 (1e4)2.4e5 (2e5)4.0e6 (3e6)2e70/15
CMAES-APOP-Nguyen 3.6 (6)6.2 (3)7.1 (3)6.7 (3)6.6 (2)7.2 (1)7.3 (1.0)15/15
DTS-CMA-ES-Pitra 1.4 (0.8)1.3 (0.2)★21.4 (0.3)1.2 (0.2)★41.2 (0.2)★41.2 (0.1)★41.2 (0.2)★415/15
EvoSpace-PSO-GA-Garcia-Valdez 35 (112)132 (101)198 (44)449 (984)923 (689)3642 (3543)1e50/15
KL-BIPOP-CMA-ES-Yamaguchi 5.7 (3)6.8 (4)7.0 (2)6.9 (3)7.5 (2)7.4 (1)10 (12)15/15
KL-IPOP-CMA-ES-Yamaguchi 4.0 (3)6.1 (4)6.6 (1)6.8 (1)6.9 (1.0)7.2 (1)7.1 (1.0)15/15
KL-Restart-CMA-ES-Yamaguchi 6.4 (4)7.4 (3)10 (2)9.4 (2)10 (0.8)10 (1)10 (0.7)15/15
Ord-H-DTS-CMA-ES-Pitra 2.8 (3)3.9 (2)6.0 (5)16 (21)42 (81)2010/15
Ord-N-DTS-CMA-ES-Pitra 1.4 (0.9)5.1 (7)9.3 (11)12 (5)21 (29)2010/15
Ord-Q-DTS-CMA-ES-Pitra 2.6 (4)3.7 (2)4.4 (3)4.6 (7)8.1 (8)2010/15
SSEABC-Aydin 5.4 (7)6.3 (3)8.7 (4)8.0 (2)7.9 (0.8)7.5 (0.5)8.2 (1)15/15

Δ fopt
f14, 2-D
1e1
1
1e0
7.0
1e-1
16
1e-2
24
1e-3
38
1e-5
67
1e-7
90
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 2.5 (1)3.9 (6)27 (31)444 (456)4781 (5649)2e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2.1 (2)2.7 (2)32 (25)637 (533)8967 (9694)9.6e5 (1e6)2e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 3.1 (2)2.8 (3)32 (20)504 (400)6170 (9247)1.3e6 (8e5)2e70/15
CMAES-APOP-Nguyen 1.7 (2)0.72 (1)2.5 (2)3.9 (2)4.6 (1)5.8 (2)6.6 (1)15/15
DTS-CMA-ES-Pitra 3.1 (2)2.3 (2)1.9 (0.4)1.7 (0.4)1.5 (0.2)★31.2 (0.1)★41.2 (0.1)★415/15
EvoSpace-PSO-GA-Garcia-Valdez 100 (97)20 (8)28 (34)173 (138)224 (13)219 (70)1167 (1056)1/15
KL-BIPOP-CMA-ES-Yamaguchi 3.9 (4)2.7 (2)3.5 (3)4.6 (1)5.1 (2)6.4 (1)7.2 (1)15/15
KL-IPOP-CMA-ES-Yamaguchi 2.3 (2)2.7 (3)3.5 (0.9)4.8 (0.8)5.0 (2)6.5 (2)7.1 (2)15/15
KL-Restart-CMA-ES-Yamaguchi 3.1 (2)4.6 (6)9.2 (5)11 (5)10 (1)10 (1)10 (2)15/15
Ord-H-DTS-CMA-ES-Pitra 4.0 (5)2.4 (0.8)1.9 (0.3)2.8 (1)4.9 (2)22 (6)2010/15
Ord-N-DTS-CMA-ES-Pitra 3.7 (6)2.0 (2)2.0 (1.0)2.5 (1)3.8 (3)6.1 (5)2010/15
Ord-Q-DTS-CMA-ES-Pitra 3.6 (4)2.6 (1)1.6 (0.4)2.7 (0.9)3.7 (3)14 (10)2010/15
SSEABC-Aydin 3.0 (2)4.7 (5)5.5 (2)6.2 (4)6.5 (3)8.2 (0.8)8.2 (0.5)15/15

Δ fopt
f15, 2-D
1e1
37
1e0
291
1e-1
1033
1e-2
1066
1e-3
1113
1e-5
1231
1e-7
1412
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1.9 (3)50 (53)93 (58)1366 (1147)1.1e4 (3036)2e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1.7 (2)62 (33)198 (180)1041 (865)1.0e4 (9347)2.3e5 (2e5)2e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 3.4 (2)53 (69)188 (322)2950 (2135)2.8e4 (3e4)2e70/15
CMAES-APOP-Nguyen 1.0 (1)1.7 (2)1.6 (1)1.9 (2)2.3 (0.6)2.3 (2)2.2 (2)15/15
DTS-CMA-ES-Pitra 0.93 (0.4)3.2 (3)2.5 (2)3.0 (2)3.5 (6)3.2 (5)2.8 (3)6/15
EvoSpace-PSO-GA-Garcia-Valdez 4.1 (3)15 (14)7.9 (3)10 (3)10 (4)13 (2)14 (2)15/15
KL-BIPOP-CMA-ES-Yamaguchi 1.3 (1)1.6 (1)2.5 (5)2.6 (2)2.6 (2)2.4 (8)2.2 (2)15/15
KL-IPOP-CMA-ES-Yamaguchi 1.1 (0.6)2.0 (2)1.7 (1)2.2 (3)2.2 (2)2.1 (3)1.9 (2)15/15
KL-Restart-CMA-ES-Yamaguchi 2.4 (2)3.7 (2)1.7 (0.6)1.8 (2)1.8 (2)1.7 (0.8)1.6 (1)15/15
Ord-H-DTS-CMA-ES-Pitra 1.1 (1)2020/15
Ord-N-DTS-CMA-ES-Pitra 0.98 (2)4.9 (6)2010/15
Ord-Q-DTS-CMA-ES-Pitra 0.71 (0.3)3.1 (4)2010/15
SSEABC-Aydin 1.8 (1)2.6 (1)2.4 (2)3.4 (3)3.4 (3)4.3 (2)4.5 (6)15/15

Δ fopt
f16, 2-D
1e1
9.0
1e0
50
1e-1
174
1e-2
326
1e-3
358
1e-5
409
1e-7
538
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 2.8 (2)3.6 (5)17 (16)101 (101)1007 (1310)1.2e5 (6e4)2e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2.2 (1)2.6 (1)15 (24)87 (93)830 (1850)1.2e5 (2e5)2e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 1.6 (0.8)3.7 (4)26 (18)159 (144)1042 (1212)8.0e4 (1e5)2e70/15
CMAES-APOP-Nguyen 3.1 (2)7.4 (11)6.6 (9)7.2 (14)24 (46)62 (205)48 (128)14/15
DTS-CMA-ES-Pitra 1.6 (1)5.2 (13)1.7 (1)0.99 (0.9)1.3 (4)1.2 (2)0.96 (0.6)14/15
EvoSpace-PSO-GA-Garcia-Valdez 14 (6)10 (4)22 (15)23 (23)26 (22)31 (16)31 (11)15/15
KL-BIPOP-CMA-ES-Yamaguchi 1.5 (2)5.9 (16)4.3 (9)2.5 (4)2.9 (3)2.8 (2)2.2 (2)15/15
KL-IPOP-CMA-ES-Yamaguchi 1.9 (2)6.6 (2)5.0 (11)3.1 (3)3.1 (7)3.0 (6)2.4 (3)15/15
KL-Restart-CMA-ES-Yamaguchi 2.7 (3)3.3 (2)3.7 (8)3.2 (2)3.5 (0.8)3.5 (3)2.9 (2)15/15
Ord-H-DTS-CMA-ES-Pitra 3.4 (3)3.8 (5)3.9 (8)4.6 (8)8.3 (6)2010/15
Ord-N-DTS-CMA-ES-Pitra 2.7 (3)5.8 (4)8.2 (10)2020/15
Ord-Q-DTS-CMA-ES-Pitra 2.4 (2)2.7 (3)17 (32)2010/15
SSEABC-Aydin 3.0 (1)5.3 (10)5.3 (6)6.1 (8)8.8 (7)8.5 (9)9.5 (10)14/15

Δ fopt
f17, 2-D
1e1
3.0
1e0
61
1e-1
133
1e-2
275
1e-3
396
1e-5
1086
1e-7
1657
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1.4 (1)5.6 (4)83 (80)7379 (1e4)3.5e5 (5e5)2e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1.6 (1)3.7 (5)159 (169)7053 (2993)3.4e5 (2e5)2e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 2.5 (2)2.7 (4)205 (370)6468 (9945)7.6e5 (1e6)2e70/15
CMAES-APOP-Nguyen 1.1 (1)1.5 (3)1.7 (3)1.5 (2)1.6 (2)1.5 (1.0)1.5 (0.8)15/15
DTS-CMA-ES-Pitra 2.1 (3)0.63 (0.2)0.50 (0.2)0.54 (0.5)0.91 (1)3.8 (5)3.9 (4)4/15
EvoSpace-PSO-GA-Garcia-Valdez 30 (25)2.9 (2)30 (25)27 (10)25 (9)15 (3)14 (0.9)15/15
KL-BIPOP-CMA-ES-Yamaguchi 2.7 (0.9)0.94 (0.5)1.8 (1)8.2 (0.2)131 (0.6)2300 (3223)2594 (1889)5/15
KL-IPOP-CMA-ES-Yamaguchi 3.3 (4)0.98 (0.4)2.2 (2)1.4 (1)149 (1)2106 (1843)1812 (3925)6/15
KL-Restart-CMA-ES-Yamaguchi 6.4 (8)2.0 (2)2.7 (0.5)2.0 (0.3)1.9 (0.3)1.1 (0.1)1.0 (0.1)15/15
Ord-H-DTS-CMA-ES-Pitra 3.1 (3)1.00 (1)3.1 (3)11 (13)2010/15
Ord-N-DTS-CMA-ES-Pitra 2.7 (4)1.6 (2)4.0 (3)2010/15
Ord-Q-DTS-CMA-ES-Pitra 2.4 (2)1.7 (4)2.5 (3)5.2 (3)2010/15
SSEABC-Aydin 2.3 (3)2.5 (4)2.6 (3)1.8 (1.0)1.6 (0.7)2.9 (4)15 (18)6/15

Δ fopt
f18, 2-D
1e1
19
1e0
134
1e-1
666
1e-2
1249
1e-3
1708
1e-5
2438
1e-7
2858
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 3.0 (5)12 (16)312 (55)8096 (1e4)2e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 3.0 (3)19 (22)261 (196)1.9e4 (3e4)2e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 2.5 (1)20 (27)482 (210)2.1e4 (4e4)1.7e5 (1e5)2e70/15
CMAES-APOP-Nguyen 1.4 (1)4.1 (4)1.6 (0.9)1.2 (0.7)1.1 (0.4)1.2 (0.2)1.3 (0.2)15/15
DTS-CMA-ES-Pitra 1.2 (1.0)1.3 (0.6)0.42 (0.5)0.37 (0.3)0.47 (0.7)1.0 (0.5)1.1 (2)7/15
EvoSpace-PSO-GA-Garcia-Valdez 6.2 (2)26 (22)11 (6)10 (5)10 (5)15 (3)17 (5)15/15
KL-BIPOP-CMA-ES-Yamaguchi 2.3 (3)5.4 (3)2.2 (2)1.4 (1)23 (63)225 (249)193 (350)12/15
KL-IPOP-CMA-ES-Yamaguchi 1.8 (2)3.6 (5)1.3 (1.0)0.89 (0.4)0.73 (0.5)129 (0.3)617 (1239)8/15
KL-Restart-CMA-ES-Yamaguchi 3.2 (5)2.1 (0.4)0.78 (0.1)0.62 (0.1)0.65 (0.1)0.68 (0.0)0.73 (0.0)15/15
Ord-H-DTS-CMA-ES-Pitra 1.0 (0.9)2.1 (3)2010/15
Ord-N-DTS-CMA-ES-Pitra 1.4 (0.6)2.3 (4)2010/15
Ord-Q-DTS-CMA-ES-Pitra 1.4 (0.8)1.6 (2)2010/15
SSEABC-Aydin 4.8 (0.9)5.4 (4)1.6 (0.7)1.0 (0.5)1.1 (0.4)8.9 (10)48 (49)2/15

Δ fopt
f19, 2-D
1e1
1
1e0
1
1e-1
26
1e-2
216
1e-3
227
1e-5
252
1e-7
276
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 3.3 (3)24 (42)13 (11)18 (13)58 (118)886 (1100)3.2e4 (2e4)6/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 3.7 (6)38 (37)23 (13)39 (36)122 (85)1234 (1766)1.9e4 (2e4)2/15
RANDOMSEARCH-5-1e7D-Brockhoff 6.3 (6)26 (29)26 (21)45 (32)143 (125)978 (2292)3.7e4 (3e4)4/15
CMAES-APOP-Nguyen 1 (0)1 (0)★222 (37)12 (6)13 (9)16 (17)21 (9)15/15
DTS-CMA-ES-Pitra 6.6 (11)36 (87)11 (21)40 (58)124 (64)112 (141)20050/15
EvoSpace-PSO-GA-Garcia-Valdez 70 (48)107 (9)27 (39)63 (24)67 (25)72 (10)83 (205)14/15
KL-BIPOP-CMA-ES-Yamaguchi 5.7 (0.8)26 (15)13 (37)14 (14)15 (10)18 (30)17 (20)15/15
KL-IPOP-CMA-ES-Yamaguchi 6.8 (2)95 (18)8.3 (6)18 (16)18 (10)20 (28)19 (27)15/15
KL-Restart-CMA-ES-Yamaguchi 4.1 (2)46 (24)8.2 (6)16 (28)19 (17)18 (18)17 (17)15/15
Ord-H-DTS-CMA-ES-Pitra 4.5 (3)30 (52)5.1 (11)1.9 (2)2.8 (2)2020/15
Ord-N-DTS-CMA-ES-Pitra 3.3 (4)38 (42)6.4 (4)13 (13)2020/15
Ord-Q-DTS-CMA-ES-Pitra 6.8 (8)19 (19)8.4 (16)6.5 (12)13 (12)2020/15
SSEABC-Aydin 9.5 (15)50 (55)9.5 (12)17 (10)21 (23)57 (56)103 (83)7/15

Δ fopt
f20, 2-D
1e1
4.0
1e0
61
1e-1
365
1e-2
366
1e-3
366
1e-5
370
1e-7
375
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1.4 (0.9)16 (31)32 (33)732 (470)5576 (5239)3.7e5 (4e5)2e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1.9 (2)17 (8)71 (36)441 (786)5266 (7116)8.0e5 (1e6)2e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 2.9 (3)16 (19)99 (95)807 (885)6414 (5128)3.9e5 (3e5)2e70/15
CMAES-APOP-Nguyen 1.7 (0.9)14 (9)13 (14)14 (9)16 (10)18 (16)20 (15)15/15
DTS-CMA-ES-Pitra 2.6 (2)3.0 (5)2.9 (5)3.6 (5)3.6 (4)3.6 (7)3.6 (8)11/15
EvoSpace-PSO-GA-Garcia-Valdez 35 (14)32 (43)15 (9)19 (12)25 (8)31 (3)36 (12)15/15
KL-BIPOP-CMA-ES-Yamaguchi 3.2 (2)13 (19)8.2 (9)8.7 (8)8.8 (9)9.1 (7)9.2 (5)15/15
KL-IPOP-CMA-ES-Yamaguchi 2.2 (3)14 (9)7.1 (7)12 (8)13 (15)13 (11)14 (16)15/15
KL-Restart-CMA-ES-Yamaguchi 6.7 (6)11 (8)8.2 (3)8.9 (14)9.4 (3)10 (8)10 (6)15/15
Ord-H-DTS-CMA-ES-Pitra 1.6 (2)11 (28)2010/15
Ord-N-DTS-CMA-ES-Pitra 2.0 (2)15 (14)8.2 (6)2010/15
Ord-Q-DTS-CMA-ES-Pitra 3.4 (4)23 (22)2020/15
SSEABC-Aydin 3.2 (0.8)14 (17)13 (3)23 (33)33 (42)61 (78)75 (83)8/15

Δ fopt
f21, 2-D
1e1
2.0
1e0
51
1e-1
174
1e-2
276
1e-3
290
1e-5
324
1e-7
330
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 0.93 (0.9)0.61 (0.6)0.78 (0.9)1.7 (2)3.7 (4)39 (40)521 (301)15/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 0.87 (0.5)1.3 (2)1.4 (0.3)2.2 (1)8.9 (7)61 (56)497 (895)15/15
RANDOMSEARCH-5-1e7D-Brockhoff 0.87 (0.5)1.6 (2)1.3 (1)2.3 (2)5.0 (9)113 (74)470 (205)15/15
CMAES-APOP-Nguyen 1.2 (0.8)4.9 (6)2.5 (2)2.1 (1)2.3 (2)2.7 (2)2.9 (2)15/15
DTS-CMA-ES-Pitra 1.2 (0.4)4.0 (8)3.6 (7)4.5 (5)8.3 (13)7.7 (12)9.0 (6)7/15
EvoSpace-PSO-GA-Garcia-Valdez 50 (28)2.6 (0.7)1.3 (1)2.4 (4)4.2 (3)10 (10)17 (5)15/15
KL-BIPOP-CMA-ES-Yamaguchi 1.5 (2)11 (6)7.3 (8)6.0 (8)5.9 (5)5.4 (5)5.6 (5)15/15
KL-IPOP-CMA-ES-Yamaguchi 1.1 (0.6)4.5 (11)3.1 (3)2.3 (4)3.8 (3)5.1 (2)5.3 (12)15/15
KL-Restart-CMA-ES-Yamaguchi 1.4 (1)12 (21)10 (8)6.8 (8)7.5 (11)9.0 (20)9.2 (19)15/15
Ord-H-DTS-CMA-ES-Pitra 1.5 (2)2.9 (2)1.4 (2)1.4 (3)3.0 (7)8.8 (4)8.8 (7)1/15
Ord-N-DTS-CMA-ES-Pitra 1.2 (0.5)1.9 (2)2.3 (4)3.3 (3)3.2 (2)9.3 (11)9.1 (11)0/15
Ord-Q-DTS-CMA-ES-Pitra 1.1 (2)1.9 (2)1.2 (1)1.5 (2)4.9 (4)2020/15
SSEABC-Aydin 1.5 (2)2.9 (8)8.0 (6)6.9 (4)10 (12)15 (33)17 (27)14/15

Δ fopt
f22, 2-D
1e1
5.0
1e0
27
1e-1
168
1e-2
218
1e-3
249
1e-5
289
1e-7
306
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1.5 (4)2.4 (3)1.6 (1)3.8 (5)6.8 (17)47 (66)436 (301)15/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 0.80 (0.7)1.8 (2)1.3 (2)2.6 (3)5.4 (13)65 (52)676 (320)15/15
RANDOMSEARCH-5-1e7D-Brockhoff 1.7 (2)2.2 (1)1.6 (2)2.1 (2)5.9 (6)45 (32)530 (536)15/15
CMAES-APOP-Nguyen 8.4 (28)5.4 (12)10 (31)9.4 (37)17 (37)62 (346)59 (179)14/15
DTS-CMA-ES-Pitra 2.5 (2)12 (15)7.0 (11)10 (16)9.1 (11)12 (16)12 (12)6/15
EvoSpace-PSO-GA-Garcia-Valdez 21 (15)18 (47)10 (14)12 (12)13 (12)18 (13)24 (10)15/15
KL-BIPOP-CMA-ES-Yamaguchi 7.9 (38)22 (21)5.7 (6)10 (35)9.0 (17)8.4 (5)8.1 (5)15/15
KL-IPOP-CMA-ES-Yamaguchi 7.0 (1)8.3 (18)50 (7)40 (3)37 (2)33 (112)32 (2)15/15
KL-Restart-CMA-ES-Yamaguchi 1.5 (1)2.5 (3)4.1 (3)4.9 (8)4.5 (6)4.9 (8)5.0 (7)15/15
Ord-H-DTS-CMA-ES-Pitra 4.9 (2)3.5 (5)3.6 (6)6.5 (7)5.7 (5)2010/15
Ord-N-DTS-CMA-ES-Pitra 1.6 (3)4.4 (6)1.8 (4)2.3 (3)3.8 (5)5.1 (4)4.9 (5)2/15
Ord-Q-DTS-CMA-ES-Pitra 2.0 (1)5.9 (10)2.9 (4)3.0 (2)3.6 (3)10 (9)10 (20)1/15
SSEABC-Aydin 0.85 (0.6)5.9 (13)4.2 (5)16 (24)16 (19)21 (18)22 (53)13/15

Δ fopt
f23, 2-D
1e1
8.0
1e0
193
1e-1
234
1e-2
263
1e-3
299
1e-5
348
1e-7
379
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1.6 (2)12 (10)1689 (2209)3.3e5 (2e5)2e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1.9 (1)10 (15)1458 (1716)2.4e5 (5e5)2e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 1.3 (1)12 (8)879 (805)3.5e5 (3e5)2e70/15
CMAES-APOP-Nguyen 2.1 (1)6.3 (8)610 (864)879 (1147)774 (1179)665 (1015)611 (799)7/15
DTS-CMA-ES-Pitra 8.3 (0.8)8.3 (7)57 (69)51 (42)45 (114)39 (56)35 (32)2/15
EvoSpace-PSO-GA-Garcia-Valdez 14 (4)19 (14)226 (219)245 (205)287 (195)276 (185)287 (291)10/15
KL-BIPOP-CMA-ES-Yamaguchi 1.5 (2)5.7 (6)12 (9)13 (5)12 (12)11 (7)11 (10)15/15
KL-IPOP-CMA-ES-Yamaguchi 2.0 (2)10 (11)15 (8)14 (15)20 (14)17 (30)17 (5)15/15
KL-Restart-CMA-ES-Yamaguchi 2.8 (2)8.1 (10)17 (5)18 (3)16 (13)15 (7)15 (8)15/15
Ord-H-DTS-CMA-ES-Pitra 2.5 (5)4.4 (4)2020/15
Ord-N-DTS-CMA-ES-Pitra 1.8 (2)16 (22)2020/15
Ord-Q-DTS-CMA-ES-Pitra 1.9 (2)3.1 (4)2020/15
SSEABC-Aydin 1.9 (2)11 (20)20 (18)19 (21)17 (38)20 (51)19 (30)13/15

Δ fopt
f24, 2-D
1e1
18
1e0
857
1e-1
8515
1e-2
23399
1e-3
24113
1e-5
24721
1e-7
24721
#succ
5/15
RANDOMSEARCH-4-1e7D-Brockhoff 2.3 (3)4.4 (5)79 (97)475 (788)1.2e4 (2e4)2e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1.7 (1)16 (13)212 (297)785 (1123)5624 (1e4)2e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 1.2 (2)31 (28)149 (266)3735 (4060)2e70/15
CMAES-APOP-Nguyen 1.3 (1)158 (177)21 (12)11 (15)20 (29)117 (89)2e50/15
DTS-CMA-ES-Pitra 1.4 (1.0)16 (16)20030/15
EvoSpace-PSO-GA-Garcia-Valdez 6.3 (3)238 (674)25 (26)13 (14)13 (19)13 (25)13 (27)4/15
KL-BIPOP-CMA-ES-Yamaguchi 2.1 (2)10 (23)24 (74)41 (74)43 (41)42 (34)42 (57)13/15
KL-IPOP-CMA-ES-Yamaguchi 1.2 (1.0)245 (541)246 (261)173 (143)169 (125)166 (191)166 (140)6/15
KL-Restart-CMA-ES-Yamaguchi 3.4 (2)20 (24)7.9 (12)20 (43)21 (42)20 (63)20 (4)13/15
Ord-H-DTS-CMA-ES-Pitra 1.7 (1)2010/15
Ord-N-DTS-CMA-ES-Pitra 2.2 (1)2020/15
Ord-Q-DTS-CMA-ES-Pitra 2.0 (2)2010/15
SSEABC-Aydin 2.1 (2)106 (140)2e40/15

Previous dimension | Dimension = 3 | Next dimension

Δ fopt
f1, 3-D
1e1
4.0
1e0
8.0
1e-1
8.0
1e-2
8.0
1e-3
8.0
1e-5
8.0
1e-7
8.0
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1.7 (2)20 (16)720 (1551)1.1e4 (8507)3.7e5 (8e5)3e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1.6 (2)21 (10)618 (189)1.3e4 (7725)4.4e5 (4e5)3e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 2.0 (1)35 (40)878 (968)3.5e4 (2e4)1.0e6 (1e6)3e70/15
CMAES-APOP-Nguyen 2.0 (2)4.2 (3)10 (3)16 (4)21 (3)32 (2)43 (7)15/15
DTS-CMA-ES-Pitra 2.3 (2)3.1 (0.7)4.0 (0.8)5.7 (0.5)★27.1 (0.6)★410 (0.6)★412 (1)★415/15
EvoSpace-PSO-GA-Garcia-Valdez 45 (2)25 (13)57 (16)121 (31)356 (293)1189 (58)1484 (285)15/15
KL-BIPOP-CMA-ES-Yamaguchi 2.8 (2)5.8 (3)10 (4)16 (4)24 (3)35 (6)46 (5)15/15
KL-IPOP-CMA-ES-Yamaguchi 2.9 (2)6.3 (3)11 (3)16 (6)23 (7)35 (7)46 (6)15/15
KL-Restart-CMA-ES-Yamaguchi 5.2 (2)17 (10)35 (9)54 (2)70 (7)103 (9)137 (13)15/15
Ord-H-DTS-CMA-ES-Pitra 2.5 (1)3.0 (1)5.7 (2)10 (3)16 (7)37 (50)65 (49)6/15
Ord-N-DTS-CMA-ES-Pitra 1.7 (1)2.7 (2)5.8 (1)11 (5)15 (9)32 (19)72 (94)5/15
Ord-Q-DTS-CMA-ES-Pitra 2.7 (3)3.6 (2)6.4 (2)11 (4)20 (6)34 (90)41 (31)11/15
SSEABC-Aydin 3.9 (3)10 (2)16 (3)23 (5)28 (3)41 (3)56 (7)15/15

Δ fopt
f2, 3-D
1e1
38
1e0
42
1e-1
43
1e-2
44
1e-3
45
1e-5
47
1e-7
48
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 4286 (1249)7.6e4 (7e4)1.6e6 (3e6)3e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 5953 (6726)1.6e5 (4e5)4.9e6 (3e6)3e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 6396 (4247)2.1e5 (4e5)2.2e6 (2e6)3e70/15
CMAES-APOP-Nguyen 13 (7)15 (6)17 (5)18 (2)19 (2)20 (2)22 (1)15/15
DTS-CMA-ES-Pitra 2.0 (0.7)★22.4 (0.5)★22.5 (0.4)★42.7 (0.4)★42.8 (0.6)★43.2 (0.4)★43.6 (0.4)★415/15
EvoSpace-PSO-GA-Garcia-Valdez 132 (109)170 (53)214 (56)230 (32)276 (16)333 (64)411 (71)15/15
KL-BIPOP-CMA-ES-Yamaguchi 10 (5)16 (6)17 (5)19 (2)19 (2)21 (2)22 (2)15/15
KL-IPOP-CMA-ES-Yamaguchi 14 (6)17 (5)19 (2)19 (3)20 (2)21 (2)23 (2)15/15
KL-Restart-CMA-ES-Yamaguchi 15 (4)19 (4)22 (4)25 (3)27 (3)31 (3)37 (4)15/15
Ord-H-DTS-CMA-ES-Pitra 16 (14)102 (122)102 (65)100 (77)3010/15
Ord-N-DTS-CMA-ES-Pitra 12 (8)20 (24)51 (66)101 (51)100 (69)3010/15
Ord-Q-DTS-CMA-ES-Pitra 14 (12)25 (22)50 (63)102 (139)100 (127)3010/15
SSEABC-Aydin 16 (6)20 (4)21 (4)22 (3)23 (2)24 (2)26 (3)15/15

Δ fopt
f3, 3-D
1e1
38
1e0
822
1e-1
830
1e-2
835
1e-3
842
1e-5
847
1e-7
853
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 29 (42)1762 (1800)1.2e5 (1e5)3e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 64 (31)2429 (2848)1.6e5 (2e5)5.4e5 (7e5)3e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 100 (96)4215 (4100)8.0e4 (2e5)3e70/15
CMAES-APOP-Nguyen 2.7 (1)5.0 (3)23 (26)33 (26)40 (32)41 (26)42 (38)15/15
DTS-CMA-ES-Pitra 4.8 (12)5.0 (4)30050/15
EvoSpace-PSO-GA-Garcia-Valdez 8.1 (3)5.0 (3)9.4 (4)14 (2)16 (2)19 (4)24 (2)15/15
KL-BIPOP-CMA-ES-Yamaguchi 6.4 (8)2.7 (3)16 (22)16 (7)16 (9)16 (9)16 (8)15/15
KL-IPOP-CMA-ES-Yamaguchi 3.8 (2)2.8 (2)37 (66)47 (68)49 (52)51 (7)53 (48)15/15
KL-Restart-CMA-ES-Yamaguchi 8.7 (3)2.5 (2)12 (16)12 (16)12 (15)13 (6)13 (16)15/15
Ord-H-DTS-CMA-ES-Pitra 2.3 (2)3010/15
Ord-N-DTS-CMA-ES-Pitra 4.6 (5)3020/15
Ord-Q-DTS-CMA-ES-Pitra 5.6 (4)3010/15
SSEABC-Aydin 4.3 (1)4.2 (1.0)16 (33)30 (37)34 (44)43 (32)85 (97)2/15

Δ fopt
f4, 3-D
1e1
40
1e0
808
1e-1
866
1e-2
921
1e-3
952
1e-5
1015
1e-7
1044
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 104 (75)9151 (6454)3e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 213 (128)1.0e4 (9919)5.0e5 (2e5)3e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 201 (156)2.1e4 (3e4)5.1e5 (7e5)3e70/15
CMAES-APOP-Nguyen 3.5 (1)202 (258)3e50/15
DTS-CMA-ES-Pitra 4.4 (7)6.4 (6)23 (25)22 (33)21 (44)20 (30)20 (23)2/15
EvoSpace-PSO-GA-Garcia-Valdez 11 (17)6.7 (5)13 (12)17 (5)18 (4)22 (6)26 (5)15/15
KL-BIPOP-CMA-ES-Yamaguchi 9.3 (9)239 (429)2323 (1315)2388 (2095)2402 (1767)2253 (1837)2191 (877)12/15
KL-IPOP-CMA-ES-Yamaguchi 6.6 (2)590 (836)1.4e4 (3e4)2.1e4 (3e4)2.0e4 (3e4)1.9e4 (2e4)1.9e4 (3e4)2/15
KL-Restart-CMA-ES-Yamaguchi 12 (7)67 (62)558 (501)525 (711)508 (502)477 (662)464 (521)15/15
Ord-H-DTS-CMA-ES-Pitra 34 (26)3010/15
Ord-N-DTS-CMA-ES-Pitra 20 (31)3010/15
Ord-Q-DTS-CMA-ES-Pitra 13 (9)3010/15
SSEABC-Aydin 11 (13)165 (122)3e40/15

Δ fopt
f5, 3-D
1e1
7.0
1e0
7.0
1e-1
7.0
1e-2
7.0
1e-3
7.0
1e-5
7.0
1e-7
7.0
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 3e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1025 (1637)3e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 30 (29)2.5e4 (2e4)6.3e7 (9e7)3e70/15
CMAES-APOP-Nguyen 2.9 (1)4.9 (4)5.1 (3)5.2 (4)5.2 (1)5.2 (1)5.2 (2)15/15
DTS-CMA-ES-Pitra 2.1 (0.2)2.7 (0.5)3.3 (0.6)3.3 (0.9)3.4 (1.0)3.5 (0.6)3.5 (1)15/15
EvoSpace-PSO-GA-Garcia-Valdez 27 (8)86 (31)115 (40)125 (42)125 (23)125 (40)125 (64)15/15
KL-BIPOP-CMA-ES-Yamaguchi 3.9 (3)5.6 (2)5.9 (3)5.9 (3)5.9 (2)5.9 (3)5.9 (3)15/15
KL-IPOP-CMA-ES-Yamaguchi 2.6 (2)4.9 (2)5.1 (3)5.2 (3)5.2 (2)5.2 (3)5.2 (4)15/15
KL-Restart-CMA-ES-Yamaguchi 6.8 (5)12 (5)14 (6)14 (5)14 (9)14 (3)14 (6)15/15
Ord-H-DTS-CMA-ES-Pitra 2.5 (0.9)3.6 (2)3.7 (0.2)3.7 (2)3.7 (0.5)3.7 (2)3.7 (1)15/15
Ord-N-DTS-CMA-ES-Pitra 2.4 (0.6)2.9 (1)3.0 (0.8)3.0 (0.5)3.0 (0.7)3.0 (0.6)3.0 (0.6)15/15
Ord-Q-DTS-CMA-ES-Pitra 2.4 (0.2)2.8 (0.5)2.8 (0.3)2.8 (0.5)2.8 (0.5)2.8 (0.6)2.8 (0.5)15/15
SSEABC-Aydin 3.5 (2)6.7 (3)6.8 (4)6.8 (3)6.8 (3)6.8 (2)6.8 (3)15/15

Δ fopt
f6, 3-D
1e1
34
1e0
56
1e-1
90
1e-2
117
1e-3
149
1e-5
215
1e-7
265
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 5.4 (4)84 (114)2244 (2822)1.0e5 (7e4)3e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 8.2 (5)164 (227)3193 (2387)9.0e4 (9e4)3e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 10 (4)158 (165)3088 (3651)2.6e5 (2e5)2.9e6 (4e6)3e70/15
CMAES-APOP-Nguyen 1.9 (1)2.6 (1)2.6 (0.8)2.9 (0.6)2.9 (0.6)2.9 (0.1)2.9 (0.3)15/15
DTS-CMA-ES-Pitra 2.2 (1)2.9 (2)4.4 (3)6.3 (2)6.8 (6)6.7 (4)7.2 (1)12/15
EvoSpace-PSO-GA-Garcia-Valdez 6.9 (2)33 (32)55 (36)65 (18)74 (35)79 (16)86 (10)15/15
KL-BIPOP-CMA-ES-Yamaguchi 2.0 (2)2.8 (1)3.0 (0.8)3.1 (1.0)3.3 (0.9)3.1 (0.6)3.4 (0.4)15/15
KL-IPOP-CMA-ES-Yamaguchi 2.3 (1.0)3.1 (1)2.9 (1)3.1 (0.6)3.1 (0.6)3.2 (0.3)3.3 (0.6)15/15
KL-Restart-CMA-ES-Yamaguchi 5.2 (2)8.4 (4)8.7 (2)9.4 (1.0)10 (1)9.4 (0.6)10 (0.7)15/15
Ord-H-DTS-CMA-ES-Pitra 2.6 (5)14 (20)3010/15
Ord-N-DTS-CMA-ES-Pitra 1.8 (1.0)24 (12)3010/15
Ord-Q-DTS-CMA-ES-Pitra 2.0 (2)9.1 (6)49 (103)3010/15
SSEABC-Aydin 3.0 (2)3.6 (1)3.6 (0.4)3.6 (0.4)3.5 (0.6)3.2 (0.5)3.4 (0.3)15/15

Δ fopt
f7, 3-D
1e1
11
1e0
65
1e-1
342
1e-2
464
1e-3
482
1e-5
482
1e-7
535
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 5.7 (2)16 (33)128 (102)2499 (2915)5184 (7929)5184 (8918)3.4e4 (1e4)4/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2.2 (1)26 (12)106 (131)2003 (2236)8623 (1e4)8623 (3803)3.1e4 (5e4)2/15
RANDOMSEARCH-5-1e7D-Brockhoff 4.8 (2)33 (29)152 (127)3160 (6505)1.1e4 (1e4)1.1e4 (9643)6.3e4 (6e4)3/15
CMAES-APOP-Nguyen 1.6 (2)3.0 (5)1.6 (1)2.0 (0.5)2.1 (1)2.1 (1)2.1 (1)15/15
DTS-CMA-ES-Pitra 2.4 (1)1.1 (0.1)0.38 (0.6)0.46 (0.6)0.54 (0.6)0.54 (0.7)0.68 (0.6)11/15
EvoSpace-PSO-GA-Garcia-Valdez 13 (5)19 (27)14 (10)14 (8)16 (9)16 (8)16 (6)15/15
KL-BIPOP-CMA-ES-Yamaguchi 2.2 (0.8)2.7 (0.8)1.2 (0.6)1.1 (0.8)1.3 (0.5)1.3 (0.5)1.2 (0.5)15/15
KL-IPOP-CMA-ES-Yamaguchi 4.4 (1)3.6 (3)1.5 (2)1.3 (0.5)1.2 (1.0)1.2 (0.8)1.1 (0.9)15/15
KL-Restart-CMA-ES-Yamaguchi 7.3 (9)3.9 (2)1.3 (0.4)1.3 (0.1)1.4 (0.3)1.4 (0.2)1.3 (0.1)15/15
Ord-H-DTS-CMA-ES-Pitra 2.4 (3)2.3 (2)0.94 (0.7)1.0 (1)1.3 (2)1.3 (1.0)1.5 (2)1/15
Ord-N-DTS-CMA-ES-Pitra 2.1 (0.9)1.9 (2)2.3 (3)3020/15
Ord-Q-DTS-CMA-ES-Pitra 3.5 (0.9)3.4 (4)1.2 (1)1.7 (2)2.1 (5)2.1 (2)8.3 (5)0/15
SSEABC-Aydin 4.0 (3)2.8 (3)1.1 (1)1.4 (1)1.4 (0.9)1.4 (1)1.7 (1)15/15

Δ fopt
f8, 3-D
1e1
27
1e0
45
1e-1
152
1e-2
179
1e-3
188
1e-5
198
1e-7
208
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 46 (65)373 (427)5018 (5125)1.5e5 (2e5)2.4e6 (3e6)3e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 68 (96)1094 (964)9424 (9962)1.6e5 (1e5)3e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 56 (43)1352 (751)7469 (7471)4.0e5 (3e5)2.2e6 (5e6)3e70/15
CMAES-APOP-Nguyen 2.6 (1)5.8 (9)3.8 (3)3.9 (5)4.1 (4)4.5 (0.9)4.8 (3)15/15
DTS-CMA-ES-Pitra 1.9 (0.7)2.3 (1)1.7 (0.5)★21.7 (3)2.1 (4)2.1 (8)2.1 (4)14/15
EvoSpace-PSO-GA-Garcia-Valdez 12 (9)109 (91)152 (300)194 (64)246 (67)333 (73)431 (146)14/15
KL-BIPOP-CMA-ES-Yamaguchi 3.3 (2)7.0 (4)3.7 (2)4.0 (2)4.3 (0.6)4.6 (0.9)4.9 (1)15/15
KL-IPOP-CMA-ES-Yamaguchi 2.3 (2)7.4 (3)4.0 (3)4.3 (1)4.5 (1)4.9 (1)5.1 (2)15/15
KL-Restart-CMA-ES-Yamaguchi 8.3 (5)15 (7)8.8 (2)9.2 (2)10 (2)11 (2)12 (2)15/15
Ord-H-DTS-CMA-ES-Pitra 2.0 (1)11 (5)29 (16)3010/15
Ord-N-DTS-CMA-ES-Pitra 2.0 (0.7)17 (20)3010/15
Ord-Q-DTS-CMA-ES-Pitra 1.8 (0.6)11 (15)14 (23)3010/15
SSEABC-Aydin 4.0 (2)6.6 (1)3.9 (1)4.1 (2)4.5 (1)4.9 (1.0)5.2 (1.0)15/15

Δ fopt
f9, 3-D
1e1
21
1e0
65
1e-1
127
1e-2
149
1e-3
159
1e-5
169
1e-7
178
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 40 (25)371 (440)7762 (9540)3.8e5 (6e5)3e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 47 (83)602 (591)8653 (1e4)1.6e5 (2e5)3e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 69 (25)844 (689)1.5e4 (2e4)2.8e5 (3e5)2.8e6 (4e6)3e70/15
CMAES-APOP-Nguyen 2.4 (1)4.7 (8)4.6 (4)4.9 (3)5.1 (2)5.5 (1)5.8 (2)15/15
DTS-CMA-ES-Pitra 2.2 (0.9)1.7 (1)1.1 (0.5)★31.1 (0.8)★31.1 (0.8)★31.2 (0.4)★31.2 (0.5)★315/15
EvoSpace-PSO-GA-Garcia-Valdez 13 (8)91 (73)119 (324)163 (192)228 (253)348 (178)437 (216)14/15
KL-BIPOP-CMA-ES-Yamaguchi 4.3 (2)5.4 (6)5.2 (2)5.4 (2)5.6 (2)6.1 (1)6.3 (2)15/15
KL-IPOP-CMA-ES-Yamaguchi 5.0 (0.9)5.7 (9)5.0 (8)5.3 (2)5.4 (3)6.0 (2)6.3 (2)15/15
KL-Restart-CMA-ES-Yamaguchi 9.1 (7)11 (6)11 (2)12 (2)12 (6)13 (4)14 (3)15/15
Ord-H-DTS-CMA-ES-Pitra 2.4 (2)7.3 (17)35 (40)3010/15
Ord-N-DTS-CMA-ES-Pitra 2.7 (1)12 (9)3010/15
Ord-Q-DTS-CMA-ES-Pitra 2.4 (0.8)3.9 (5)12 (20)3010/15
SSEABC-Aydin 5.9 (3)6.2 (3)5.6 (3)6.1 (1)6.2 (3)6.6 (1.0)6.9 (2)15/15

Δ fopt
f10, 3-D
1e1
114
1e0
152
1e-1
168
1e-2
180
1e-3
194
1e-5
218
1e-7
242
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1274 (494)2.9e4 (3e4)8.1e5 (8e5)3e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2390 (1645)4.1e4 (3e4)1.2e6 (8e5)3e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 2049 (4354)3.8e4 (6e4)5.4e5 (3e5)3e70/15
CMAES-APOP-Nguyen 4.0 (1)4.4 (2)4.4 (1)4.6 (0.6)4.5 (0.5)4.5 (0.3)4.4 (0.4)15/15
DTS-CMA-ES-Pitra 0.66 (0.2)★40.63 (0.1)★40.66 (0.1)★40.67 (0.1)★40.68 (0.1)★40.70 (0.1)★40.73 (0.1)★415/15
EvoSpace-PSO-GA-Garcia-Valdez 416 (688)1801 (2412)2753 (1525)4776 (1e4)1.3e4 (2e4)1.2e4 (2e4)2e50/15
KL-BIPOP-CMA-ES-Yamaguchi 4.2 (2)4.3 (1)4.4 (0.9)4.5 (0.3)4.4 (0.5)4.4 (0.6)4.3 (0.3)15/15
KL-IPOP-CMA-ES-Yamaguchi 4.4 (3)4.3 (1)4.6 (0.9)4.6 (0.9)4.5 (0.4)4.4 (0.4)4.4 (0.6)15/15
KL-Restart-CMA-ES-Yamaguchi 5.8 (1)5.4 (0.7)5.9 (0.9)6.4 (0.5)6.6 (0.9)7.2 (0.5)7.5 (0.4)15/15
Ord-H-DTS-CMA-ES-Pitra 7.0 (7)29 (23)27 (39)3010/15
Ord-N-DTS-CMA-ES-Pitra 5.0 (5)15 (12)3010/15
Ord-Q-DTS-CMA-ES-Pitra 5.7 (5)29 (65)26 (44)3010/15
SSEABC-Aydin 5.0 (4)5.3 (2)5.6 (0.4)5.6 (0.6)5.5 (0.1)5.3 (0.7)5.2 (0.6)15/15

Δ fopt
f11, 3-D
1e1
67
1e0
105
1e-1
227
1e-2
263
1e-3
277
1e-5
302
1e-7
327
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 92 (94)1714 (5750)1.3e4 (2e4)3.8e5 (4e5)3e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 114 (48)1280 (648)2.3e4 (2e4)2.7e5 (3e5)3e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 142 (225)2259 (2697)3.7e4 (5e4)7.7e5 (6e5)1.5e6 (2e6)3e70/15
CMAES-APOP-Nguyen 9.2 (4)7.7 (0.7)3.9 (0.7)3.6 (0.6)3.6 (0.6)3.6 (0.4)3.6 (0.4)15/15
DTS-CMA-ES-Pitra 1.2 (0.3)0.95 (0.3)★40.49 (0.1)★40.48 (0.1)★40.48 (0.1)★40.51 (0.1)★40.53 (0.1)★415/15
EvoSpace-PSO-GA-Garcia-Valdez 92 (43)336 (235)288 (178)427 (219)537 (768)872 (636)1525 (2156)6/15
KL-BIPOP-CMA-ES-Yamaguchi 8.3 (2)7.0 (2)3.6 (0.2)3.4 (0.5)3.4 (0.5)3.4 (0.1)3.5 (0.4)15/15
KL-IPOP-CMA-ES-Yamaguchi 8.5 (2)6.8 (1)3.5 (0.7)3.2 (0.4)3.3 (0.3)3.3 (0.2)3.3 (0.3)15/15
KL-Restart-CMA-ES-Yamaguchi 8.1 (3)6.9 (1)4.1 (0.8)4.1 (0.5)4.4 (0.4)4.9 (0.5)5.4 (0.2)15/15
Ord-H-DTS-CMA-ES-Pitra 20 (24)3010/15
Ord-N-DTS-CMA-ES-Pitra 3.5 (2)6.4 (4)20 (45)17 (34)3010/15
Ord-Q-DTS-CMA-ES-Pitra 21 (34)42 (39)20 (37)17 (13)16 (12)3010/15
SSEABC-Aydin 10 (6)8.8 (2)4.5 (0.5)4.1 (0.7)4.1 (0.5)4.1 (0.3)4.1 (0.5)15/15

Δ fopt
f12, 3-D
1e1
65
1e0
168
1e-1
338
1e-2
401
1e-3
445
1e-5
696
1e-7
790
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 6.9e4 (3e4)1.3e6 (1e6)3e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 6.7e4 (7e4)8.0e5 (7e5)3e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 1.5e5 (1e5)1.3e6 (9e5)3e70/15
CMAES-APOP-Nguyen 5.7 (2)4.0 (2)3.2 (3)3.4 (1)3.5 (2)2.9 (3)4.1 (6)15/15
DTS-CMA-ES-Pitra 6.7 (1)3.0 (6)1.8 (5)1.7 (4)1.7 (0.8)1.2 (3)1.2 (0.3)14/15
EvoSpace-PSO-GA-Garcia-Valdez 835 (832)1474 (1877)1390 (1911)4140 (5169)3937 (2470)1e50/15
KL-BIPOP-CMA-ES-Yamaguchi 8.9 (4)6.5 (7)5.0 (7)5.1 (6)5.1 (8)4.1 (2)4.2 (6)15/15
KL-IPOP-CMA-ES-Yamaguchi 10 (5)7.3 (8)5.4 (6)5.6 (4)5.7 (5)4.5 (3)4.5 (3)15/15
KL-Restart-CMA-ES-Yamaguchi 12 (3)8.4 (9)6.5 (5)6.7 (6)7.1 (8)6.1 (5)6.4 (5)15/15
Ord-H-DTS-CMA-ES-Pitra 4.9 (2)3.8 (2)13 (19)3010/15
Ord-N-DTS-CMA-ES-Pitra 6.4 (8)8.3 (6)13 (13)3010/15
Ord-Q-DTS-CMA-ES-Pitra 4.9 (8)5.9 (3)6.3 (6)11 (12)10 (7)3010/15
SSEABC-Aydin 8.8 (7)6.7 (5)4.3 (6)4.1 (5)4.1 (5)8.4 (10)10 (22)13/15

Δ fopt
f13, 3-D
1e1
49
1e0
85
1e-1
108
1e-2
136
1e-3
215
1e-5
281
1e-7
365
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 485 (714)1.2e5 (1e5)3e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 479 (600)9.7e4 (6e4)3e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 1113 (636)1.6e5 (1e5)3e70/15
CMAES-APOP-Nguyen 4.9 (5)5.3 (3)5.9 (2)5.9 (0.8)4.4 (1)4.7 (0.7)4.7 (0.9)15/15
DTS-CMA-ES-Pitra 2.0 (4)1.5 (0.2)★21.4 (0.1)★21.4 (0.2)★20.98 (1.0)★20.93 (0.2)★20.82 (0.1)★215/15
EvoSpace-PSO-GA-Garcia-Valdez 105 (125)209 (598)1277 (498)4960 (7924)1e50/15
KL-BIPOP-CMA-ES-Yamaguchi 3.3 (2)4.4 (3)5.8 (2)5.8 (1)4.3 (1)4.5 (0.5)4.2 (0.3)15/15
KL-IPOP-CMA-ES-Yamaguchi 4.5 (3)5.7 (2)6.8 (1)6.0 (1)4.5 (0.7)4.7 (0.7)592 (0.5)12/15
KL-Restart-CMA-ES-Yamaguchi 8.7 (1)7.7 (1)8.7 (0.6)8.7 (0.6)6.5 (0.4)6.8 (0.4)6.6 (0.2)15/15
Ord-H-DTS-CMA-ES-Pitra 6.6 (6)12 (7)41 (31)3010/15
Ord-N-DTS-CMA-ES-Pitra 3.5 (5)6.5 (3)20 (7)16 (29)3010/15
Ord-Q-DTS-CMA-ES-Pitra 3.5 (5)6.4 (5)10 (7)11 (7)21 (15)3010/15
SSEABC-Aydin 5.2 (4)6.7 (4)7.3 (2)7.4 (1)5.3 (0.7)5.4 (0.5)5.0 (0.1)15/15

Δ fopt
f14, 3-D
1e1
2.0
1e0
17
1e-1
28
1e-2
43
1e-3
71
1e-5
110
1e-7
194
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 2.0 (2)5.3 (4)248 (267)6823 (6640)3.4e5 (3e5)3e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1.6 (1)4.8 (6)381 (568)8771 (4578)4.1e5 (3e5)3e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 2.4 (3)12 (18)489 (447)1.9e4 (1e4)6.8e5 (6e5)3e70/15
CMAES-APOP-Nguyen 1.6 (0.5)1.3 (2)2.8 (1)3.8 (0.9)4.2 (1)6.5 (0.8)5.7 (0.8)15/15
DTS-CMA-ES-Pitra 4.1 (4)1.9 (0.3)1.7 (0.4)1.6 (0.3)1.4 (0.2)★21.4 (0.2)★41.0 (0.1)★415/15
EvoSpace-PSO-GA-Garcia-Valdez 38 (49)12 (10)20 (10)103 (83)138 (36)222 (75)2461 (4100)3/15
KL-BIPOP-CMA-ES-Yamaguchi 4.0 (4)2.7 (2)4.1 (1)4.3 (1)4.3 (0.9)6.9 (2)5.8 (1.0)15/15
KL-IPOP-CMA-ES-Yamaguchi 3.4 (4)2.4 (3)4.1 (2)4.4 (1)4.3 (0.7)6.6 (2)5.5 (0.8)15/15
KL-Restart-CMA-ES-Yamaguchi 1.3 (0.9)6.9 (5)10 (6)11 (4)10 (2)10 (0.9)8.1 (0.6)15/15
Ord-H-DTS-CMA-ES-Pitra 3.5 (4)2.1 (2)2.6 (1)6.1 (10)10 (6)3010/15
Ord-N-DTS-CMA-ES-Pitra 2.9 (5)1.7 (0.7)2.1 (1)3.3 (2)19 (24)3010/15
Ord-Q-DTS-CMA-ES-Pitra 3.5 (3)1.7 (0.8)2.0 (0.7)2.7 (2)3.1 (2)13 (28)3010/15
SSEABC-Aydin 2.0 (4)4.9 (2)5.5 (0.9)6.1 (0.9)5.9 (0.9)7.4 (2)6.2 (0.9)15/15

Δ fopt
f15, 3-D
1e1
121
1e0
1372
1e-1
6285
1e-2
8282
1e-3
8429
1e-5
8787
1e-7
9041
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 20 (9)792 (452)8182 (2e4)3e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 19 (15)1996 (1534)1.2e4 (2e4)5.3e4 (5e4)5.2e4 (3e4)3e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 27 (27)3150 (3956)7.1e4 (8e4)3e70/15
CMAES-APOP-Nguyen 0.89 (0.4)1.7 (1)0.67 (0.1)0.68 (0.6)0.73 (0.3)0.77 (0.7)0.81 (0.4)15/15
DTS-CMA-ES-Pitra 1.2 (2)1.6 (1)0.84 (0.7)0.76 (0.7)0.75 (0.7)0.72 (1)0.70 (0.8)6/15
EvoSpace-PSO-GA-Garcia-Valdez 3.2 (2)17 (6)47 (65)36 (34)35 (24)34 (54)34 (34)4/15
KL-BIPOP-CMA-ES-Yamaguchi 1.2 (1)1.8 (2)1.1 (0.8)0.84 (1)0.83 (0.7)0.83 (0.9)0.83 (0.9)15/15
KL-IPOP-CMA-ES-Yamaguchi 1.3 (0.5)1.8 (2)0.94 (0.5)0.74 (0.8)0.74 (0.4)0.75 (0.6)0.76 (0.6)15/15
KL-Restart-CMA-ES-Yamaguchi 2.5 (0.7)1.4 (1)0.81 (0.9)0.63 (0.3)0.64 (0.6)0.64 (0.6)0.65 (0.6)15/15
Ord-H-DTS-CMA-ES-Pitra 1.0 (0.5)3010/15
Ord-N-DTS-CMA-ES-Pitra 1.4 (1.0)3010/15
Ord-Q-DTS-CMA-ES-Pitra 1.4 (1)1.6 (2)3010/15
SSEABC-Aydin 1.2 (0.5)1.3 (0.4)1.0 (1)0.91 (0.7)1.1 (1)1.5 (1)3.6 (4)5/15

Δ fopt
f16, 3-D
1e1
41
1e0
319
1e-1
582
1e-2
789
1e-3
1864
1e-5
3204
1e-7
3361
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1.4 (0.7)13 (12)186 (210)5847 (7524)3.9e4 (5e4)3e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1.0 (1)7.3 (7)243 (201)4429 (6913)7.0e4 (6e4)3e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 1.8 (1)12 (13)277 (347)8011 (1e4)3.1e4 (3e4)3e70/15
CMAES-APOP-Nguyen 1.7 (2)5.1 (4)36 (85)60 (50)36 (28)22 (35)22 (18)14/15
DTS-CMA-ES-Pitra 1.4 (2)4.1 (3)5.9 (8)5.3 (7)2.3 (2)1.6 (3)1.6 (2)6/15
EvoSpace-PSO-GA-Garcia-Valdez 3.0 (1)9.0 (6)43 (217)92 (160)41 (29)26 (25)36 (32)9/15
KL-BIPOP-CMA-ES-Yamaguchi 1.9 (2)1.2 (2)2.3 (4)1.9 (2)0.86 (1)0.58 (0.4)0.62 (0.6)15/15
KL-IPOP-CMA-ES-Yamaguchi 1.8 (3)3.9 (7)3.9 (2)4.4 (5)2.0 (2)1.2 (1)1.2 (1)15/15
KL-Restart-CMA-ES-Yamaguchi 1.5 (0.2)3.9 (1)3.1 (4)2.5 (1)1.2 (1)0.78 (0.3)0.82 (0.2)15/15
Ord-H-DTS-CMA-ES-Pitra 1.0 (2)14 (14)3020/15
Ord-N-DTS-CMA-ES-Pitra 1.3 (2)14 (17)3020/15
Ord-Q-DTS-CMA-ES-Pitra 1.3 (1)4.3 (4)7.5 (10)3020/15
SSEABC-Aydin 1.7 (2)3.4 (3)4.9 (6)4.3 (5)2.0 (5)2.0 (2)5.8 (6)11/15

Δ fopt
f17, 3-D
1e1
4.0
1e0
78
1e-1
282
1e-2
491
1e-3
1134
1e-5
2347
1e-7
3469
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1.2 (1)16 (13)4055 (8687)3e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2.2 (0.6)27 (32)2911 (4748)3e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 1.9 (2)37 (25)1.2e4 (9137)3e70/15
CMAES-APOP-Nguyen 1.2 (0.8)1.2 (0.5)0.75 (0.1)0.69 (0.1)0.97 (0.7)1.8 (0.7)1.5 (0.9)15/15
DTS-CMA-ES-Pitra 3.0 (2)1.5 (2)0.85 (2)0.70 (0.5)0.35 (0.4)0.85 (1)0.88 (1)9/15
EvoSpace-PSO-GA-Garcia-Valdez 31 (24)7.6 (10)17 (13)18 (9)19 (24)18 (2)19 (43)12/15
KL-BIPOP-CMA-ES-Yamaguchi 4.0 (6)6.4 (10)2.5 (3)2.2 (2)190 (1)640 (1918)989 (1514)7/15
KL-IPOP-CMA-ES-Yamaguchi 14 (4)3.6 (1)1.5 (1)1.2 (1)190 (662)1462 (3836)2380 (5407)4/15
KL-Restart-CMA-ES-Yamaguchi 9.2 (13)4.2 (2)2.4 (0.6)2.1 (0.3)1.2 (0.1)0.95 (0.1)0.86 (0.1)15/15
Ord-H-DTS-CMA-ES-Pitra 2.8 (3)1.6 (2)2.7 (4)3010/15
Ord-N-DTS-CMA-ES-Pitra 1.4 (2)1.2 (0.6)4.9 (4)3010/15
Ord-Q-DTS-CMA-ES-Pitra 1.8 (1)1.8 (0.8)7.5 (10)3010/15
SSEABC-Aydin 2.2 (3)1.8 (0.7)0.99 (0.2)0.92 (0.3)0.89 (0.8)3.3 (5)9.0 (13)9/15

Δ fopt
f18, 3-D
1e1
40
1e0
145
1e-1
1289
1e-2
3084
1e-3
3523
1e-5
4738
1e-7
5527
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 4.0 (2)190 (90)5.0e4 (4e4)3e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 3.8 (5)326 (133)3.9e4 (2e4)3e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 4.2 (10)537 (492)7.6e4 (7e4)3e70/15
CMAES-APOP-Nguyen 0.97 (0.4)5.6 (7)2.4 (1)1.4 (0.6)1.5 (0.3)1.5 (0.3)1.5 (0.6)15/15
DTS-CMA-ES-Pitra 1.2 (2)1.2 (2)0.56 (0.9)0.28 (0.1)0.31 (0.3)1.0 (2)1.1 (2)6/15
EvoSpace-PSO-GA-Garcia-Valdez 4.2 (2)32 (27)23 (27)44 (27)192 (128)302 (211)1e50/15
KL-BIPOP-CMA-ES-Yamaguchi 1.2 (0.8)12 (8)3.2 (3)2.6 (2)3.0 (2)2.5 (2)41 (1)14/15
KL-IPOP-CMA-ES-Yamaguchi 1.1 (0.3)1.9 (3)0.62 (0.3)45 (0.4)177 (361)272 (476)406 (543)9/15
KL-Restart-CMA-ES-Yamaguchi 4.4 (4)3.6 (2)0.69 (0.1)0.44 (0.1)0.51 (0.0)0.55 (0.0)0.61 (0.1)15/15
Ord-H-DTS-CMA-ES-Pitra 1.1 (0.7)2.0 (1)1.7 (2)3010/15
Ord-N-DTS-CMA-ES-Pitra 1.3 (0.9)3010/15
Ord-Q-DTS-CMA-ES-Pitra 1.5 (2)3.0 (2)3.5 (2)3010/15
SSEABC-Aydin 2.2 (2)2.7 (0.3)1.4 (1)1.2 (0.8)1.9 (3)12 (17)13 (14)5/15

Δ fopt
f19, 3-D
1e1
1
1e0
1
1e-1
109
1e-2
6764
1e-3
7367
1e-5
7399
1e-7
7441
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 6.3 (6)364 (341)239 (229)252 (315)1392 (211)2.9e4 (3e4)3e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 5.4 (4)314 (274)495 (216)199 (148)1042 (682)3e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 6.3 (6)920 (1142)350 (318)385 (479)1370 (804)3e70/15
CMAES-APOP-Nguyen 1 (0)1 (0)★436 (12)1.5 (0.7)2.0 (0.8)2.4 (0.9)2.7 (0.5)15/15
DTS-CMA-ES-Pitra 4.7 (2)347 (182)114 (325)30020/15
EvoSpace-PSO-GA-Garcia-Valdez 110 (97)801 (1567)157 (255)14 (46)28 (17)29 (33)32 (31)6/15
KL-BIPOP-CMA-ES-Yamaguchi 7.5 (6)430 (129)122 (164)5.5 (4)6.6 (7)6.6 (7)6.6 (9)15/15
KL-IPOP-CMA-ES-Yamaguchi 12 (10)195 (141)178 (221)9.1 (5)8.4 (3)8.5 (8)8.5 (13)15/15
KL-Restart-CMA-ES-Yamaguchi 13 (14)177 (120)189 (299)7.3 (8)11 (24)11 (20)11 (14)15/15
Ord-H-DTS-CMA-ES-Pitra 8.5 (8)174 (198)39 (17)3010/15
Ord-N-DTS-CMA-ES-Pitra 11 (9)170 (202)3020/15
Ord-Q-DTS-CMA-ES-Pitra 8.8 (8)190 (238)41 (31)3020/15
SSEABC-Aydin 8.3 (4)517 (1579)50 (55)3.8 (3)4.3 (5)4.3 (7)4.9 (3)8/15

Δ fopt
f20, 3-D
1e1
8.0
1e0
385
1e-1
2291
1e-2
2398
1e-3
2481
1e-5
2573
1e-7
2776
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 3.1 (2)44 (32)747 (533)2.6e4 (3e4)3e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4.0 (2)61 (59)827 (1029)5.7e4 (7e4)3e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 4.3 (6)56 (37)1308 (1713)5.6e4 (5e4)3e70/15
CMAES-APOP-Nguyen 1.4 (0.3)6.8 (6)5.3 (4)6.2 (4)6.7 (4)7.1 (3)6.9 (3)15/15
DTS-CMA-ES-Pitra 2.1 (1)1.5 (1.0)3.9 (6)8.2 (22)8.0 (13)7.7 (9)7.1 (9)2/15
EvoSpace-PSO-GA-Garcia-Valdez 21 (6)10 (10)7.4 (1)8.0 (12)8.5 (2)10 (3)10 (0.9)14/15
KL-BIPOP-CMA-ES-Yamaguchi 2.6 (2)6.0 (6)6.1 (5)6.1 (3)6.0 (5)6.0 (3)5.6 (5)15/15
KL-IPOP-CMA-ES-Yamaguchi 2.4 (3)2.7 (2)4.9 (3)4.9 (2)4.8 (8)4.8 (2)4.7 (3)15/15
KL-Restart-CMA-ES-Yamaguchi 7.4 (6)5.1 (5)4.4 (6)4.4 (2)4.3 (4)4.3 (5)4.0 (6)15/15
Ord-H-DTS-CMA-ES-Pitra 2.2 (4)11 (10)3010/15
Ord-N-DTS-CMA-ES-Pitra 2.5 (1)3010/15
Ord-Q-DTS-CMA-ES-Pitra 2.1 (2)3010/15
SSEABC-Aydin 4.7 (5)4.4 (5)8.9 (11)11 (14)20 (33)55 (66)157 (246)1/15

Δ fopt
f21, 3-D
1e1
6.0
1e0
184
1e-1
425
1e-2
439
1e-3
458
1e-5
469
1e-7
482
#succ
14/15
RANDOMSEARCH-4-1e7D-Brockhoff 1.3 (1)1.5 (2)2.7 (2)23 (35)108 (97)1775 (1865)1.5e5 (1e5)1/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 0.79 (0.6)1.7 (2)2.6 (4)26 (21)97 (73)5162 (6526)2.7e5 (2e5)1/15
RANDOMSEARCH-5-1e7D-Brockhoff 1.4 (1)2.2 (2)10 (2)38 (42)163 (194)6528 (5653)2.7e5 (4e5)2/15
CMAES-APOP-Nguyen 1.7 (2)3.1 (3)3.1 (3)13 (8)20 (108)26 (77)36 (3)15/15
DTS-CMA-ES-Pitra 2.0 (3)7.1 (6)6.6 (5)9.4 (10)9.0 (11)13 (18)43 (59)1/15
EvoSpace-PSO-GA-Garcia-Valdez 24 (13)2.6 (3)3.6 (5)6.4 (8)9.0 (8)15 (8)19 (10)15/15
KL-BIPOP-CMA-ES-Yamaguchi 1.8 (2)7.6 (35)5.9 (3)7.0 (13)6.8 (9)6.9 (14)6.9 (9)15/15
KL-IPOP-CMA-ES-Yamaguchi 1.8 (2)6.4 (4)8.1 (11)8.2 (11)8.2 (11)8.5 (12)8.6 (6)15/15
KL-Restart-CMA-ES-Yamaguchi 1.9 (2)7.0 (7)3.9 (6)6.5 (3)6.5 (11)6.6 (8)6.9 (3)15/15
Ord-H-DTS-CMA-ES-Pitra 0.91 (0.8)1.7 (2)3.1 (4)3.1 (3)4.5 (8)4.5 (7)4.5 (6)2/15
Ord-N-DTS-CMA-ES-Pitra 1.5 (2)1.8 (3)5.1 (10)10 (10)3020/15
Ord-Q-DTS-CMA-ES-Pitra 1.8 (3)2.9 (3)2.3 (2)4.8 (4)9.4 (13)9.3 (13)9.1 (24)1/15
SSEABC-Aydin 1.2 (1)10 (17)8.7 (13)17 (24)22 (49)28 (36)27 (8)12/15

Δ fopt
f22, 3-D
1e1
18
1e0
170
1e-1
354
1e-2
362
1e-3
384
1e-5
401
1e-7
414
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1.7 (2)2.9 (3)5.7 (4)48 (40)134 (111)1559 (956)1.4e5 (1e5)1/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1.2 (0.9)2.6 (4)7.3 (5)41 (59)166 (81)4522 (3128)1.7e5 (3e5)0/15
RANDOMSEARCH-5-1e7D-Brockhoff 1.6 (1)2.7 (6)7.1 (7)54 (41)132 (130)7987 (1e4)2.2e5 (4e5)1/15
CMAES-APOP-Nguyen 1.3 (1)3.2 (3)16 (21)22 (12)89 (68)146 (46)142 (39)13/15
DTS-CMA-ES-Pitra 1.2 (1)2.4 (1)5.2 (3)7.8 (13)7.5 (4)7.5 (8)14 (32)2/15
EvoSpace-PSO-GA-Garcia-Valdez 5.9 (1)8.5 (29)8.4 (12)15 (12)20 (21)27 (29)34 (13)15/15
KL-BIPOP-CMA-ES-Yamaguchi 10 (20)7.2 (9)11 (15)12 (11)11 (11)11 (13)11 (13)15/15
KL-IPOP-CMA-ES-Yamaguchi 7.2 (1)7.1 (16)14 (21)28 (33)29 (48)43 (71)59 (132)15/15
KL-Restart-CMA-ES-Yamaguchi 2.4 (4)14 (16)17 (14)19 (20)18 (19)17 (12)17 (14)15/15
Ord-H-DTS-CMA-ES-Pitra 3.3 (1)2.1 (3)12 (6)12 (5)11 (13)11 (19)11 (10)1/15
Ord-N-DTS-CMA-ES-Pitra 2.2 (2)2.3 (1)6.0 (10)5.9 (11)11 (10)11 (10)11 (15)1/15
Ord-Q-DTS-CMA-ES-Pitra 3.1 (1)2.6 (3)13 (16)3010/15
SSEABC-Aydin 5.4 (0.5)4.6 (3)38 (97)55 (76)63 (41)76 (38)74 (55)8/15

Δ fopt
f23, 3-D
1e1
3.0
1e0
407
1e-1
906
1e-2
1215
1e-3
2214
1e-5
2293
1e-7
2393
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 3.6 (4)22 (24)1.8e4 (1e4)3e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 3.3 (6)24 (11)1.3e4 (9739)3e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 3.4 (3)14 (18)1.2e4 (1e4)3e70/15
CMAES-APOP-Nguyen 1.3 (1)10 (16)2316 (2245)3e50/15
DTS-CMA-ES-Pitra 4.4 (4)6.7 (14)5.4 (5)4.7 (3)2.6 (2)2.5 (2)2.4 (4)6/15
EvoSpace-PSO-GA-Garcia-Valdez 25 (16)26 (21)116 (147)161 (182)117 (70)118 (46)119 (97)5/15
KL-BIPOP-CMA-ES-Yamaguchi 4.8 (5)8.9 (9)15 (16)11 (13)6.3 (6)6.2 (7)6.1 (7)15/15
KL-IPOP-CMA-ES-Yamaguchi 4.9 (3)7.0 (8)8.2 (7)7.9 (10)4.5 (4)4.5 (2)4.4 (3)15/15
KL-Restart-CMA-ES-Yamaguchi 4.1 (5)11 (5)14 (7)11 (16)6.1 (5)6.2 (5)6.2 (4)15/15
Ord-H-DTS-CMA-ES-Pitra 3.8 (5)10 (7)3020/15
Ord-N-DTS-CMA-ES-Pitra 5.2 (2)11 (15)3020/15
Ord-Q-DTS-CMA-ES-Pitra 4.6 (4)5.1 (4)3020/15
SSEABC-Aydin 3.0 (2)8.2 (12)15 (23)16 (29)11 (11)12 (20)14 (17)8/15

Δ fopt
f24, 3-D
1e1
97
1e0
10391
1e-1
1.0e5
1e-2
3.6e5
1e-3
3.6e5
1e-5
3.6e5
1e-7
3.6e5
#succ
2/15
RANDOMSEARCH-4-1e7D-Brockhoff 7.6 (7)194 (131)3e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 9.1 (20)382 (224)3e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 12 (9)297 (475)3e70/15
CMAES-APOP-Nguyen 4.0 (5)189 (232)3e50/15
DTS-CMA-ES-Pitra 1.3 (2)30020/15
EvoSpace-PSO-GA-Garcia-Valdez 7.0 (4)21 (38)14 (15)1e50/15
KL-BIPOP-CMA-ES-Yamaguchi 3.8 (18)10 (25)32 (37)18 (24)19 (13)19 (15)19 (25)5/15
KL-IPOP-CMA-ES-Yamaguchi 1.5 (1)376 (455)88 (90)37 (57)37 (37)37 (36)37 (43)3/15
KL-Restart-CMA-ES-Yamaguchi 3.3 (3)5.7 (3)11 (24)11 (9)11 (10)11 (8)11 (17)8/15
Ord-H-DTS-CMA-ES-Pitra 2.6 (2)3020/15
Ord-N-DTS-CMA-ES-Pitra 2.1 (2)3010/15
Ord-Q-DTS-CMA-ES-Pitra 2.5 (2)3020/15
SSEABC-Aydin 2.2 (1)41 (49)3e40/15

Previous dimension | Dimension = 5 | Next dimension

Δ fopt
f1, 5-D
1e1
11
1e0
12
1e-1
12
1e-2
12
1e-3
12
1e-5
12
1e-7
12
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 3.2 (4)1037 (4718)1.9e5 (3e5)2.7e7 (3e7)5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4.8 (9)765 (669)2.4e5 (4e5)2.8e7 (2e7)5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 12 (23)1633 (685)3.4e5 (1e6)5e70/15
CMAES-APOP-Nguyen 2.3 (2)6.0 (3)14 (3)19 (3)26 (3)39 (5)52 (4)15/15
DTS-CMA-ES-Pitra 2.1 (1.0)3.6 (0.8)5.1 (0.5)★37.1 (0.5)★38.8 (0.9)★412 (2)★416 (1)★415/15
EvoSpace-PSO-GA-Garcia-Valdez 16 (9)36 (41)98 (50)212 (162)519 (369)1391 (218)1838 (168)15/15
KL-BIPOP-CMA-ES-Yamaguchi 2.5 (2)9.2 (3)15 (4)22 (8)30 (5)44 (4)57 (7)15/15
KL-IPOP-CMA-ES-Yamaguchi 4.0 (2)10 (5)16 (2)23 (3)30 (4)43 (5)57 (5)15/15
KL-Restart-CMA-ES-Yamaguchi 9.4 (7)36 (12)60 (10)81 (9)106 (4)150 (12)198 (12)15/15
Ord-H-DTS-CMA-ES-Pitra 2.4 (0.9)5.2 (2)10 (3)19 (16)56 (82)150 (181)619 (877)0/15
Ord-N-DTS-CMA-ES-Pitra 2.1 (0.4)4.0 (1)9.3 (3)23 (16)52 (54)306 (501)625 (512)0/15
Ord-Q-DTS-CMA-ES-Pitra 2.1 (1)4.8 (0.9)11 (16)19 (4)30 (14)57 (44)122 (95)1/15
SSEABC-Aydin 5.9 (3)12 (2)18 (2)26 (5)32 (2)45 (4)56 (3)15/15

Δ fopt
f2, 5-D
1e1
83
1e0
87
1e-1
88
1e-2
89
1e-3
90
1e-5
92
1e-7
94
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 4.2e6 (5e6)5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 8.8e6 (1e7)5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 5e70/15
CMAES-APOP-Nguyen 14 (5)17 (0.8)17 (1)18 (0.7)19 (2)20 (1)22 (0.8)15/15
DTS-CMA-ES-Pitra 2.3 (0.6)★42.8 (0.4)★43.0 (0.5)★43.2 (0.4)★43.4 (0.3)★43.7 (0.3)★44.0 (0.4)★415/15
EvoSpace-PSO-GA-Garcia-Valdez 94 (55)147 (10)182 (67)212 (76)258 (68)344 (83)445 (53)15/15
KL-BIPOP-CMA-ES-Yamaguchi 15 (4)17 (3)18 (1.0)19 (1)20 (1)21 (2)22 (1)15/15
KL-IPOP-CMA-ES-Yamaguchi 14 (4)16 (3)18 (2)19 (3)19 (2)21 (2)22 (2)15/15
KL-Restart-CMA-ES-Yamaguchi 18 (3)22 (3)25 (0.8)28 (3)31 (3)36 (2)41 (3)15/15
Ord-H-DTS-CMA-ES-Pitra 89 (89)5010/15
Ord-N-DTS-CMA-ES-Pitra 29 (29)5010/15
Ord-Q-DTS-CMA-ES-Pitra 88 (72)5010/15
SSEABC-Aydin 15 (4)18 (3)19 (2)20 (2)21 (1)22 (2)23 (2)15/15

Δ fopt
f3, 5-D
1e1
716
1e0
1622
1e-1
1637
1e-2
1642
1e-3
1646
1e-5
1650
1e-7
1654
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 3791 (2269)5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 3003 (4953)5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 8061 (1e4)5e70/15
CMAES-APOP-Nguyen 1.3 (3)40 (29)164 (269)166 (45)167 (108)167 (185)168 (121)12/15
DTS-CMA-ES-Pitra 0.90 (3)50040/15
EvoSpace-PSO-GA-Garcia-Valdez 1.6 (1.0)8.2 (8)15 (10)18 (7)21 (8)29 (9)34 (7)15/15
KL-BIPOP-CMA-ES-Yamaguchi 1.2 (0.2)15 (19)328 (930)327 (154)326 (925)326 (235)326 (293)15/15
KL-IPOP-CMA-ES-Yamaguchi 1.2 (1)69 (8)4835 (4182)6104 (6092)6090 (6840)6076 (6070)6061 (1e4)5/15
KL-Restart-CMA-ES-Yamaguchi 2.0 (0.8)10 (13)43 (29)43 (47)43 (34)43 (46)44 (53)15/15
Ord-H-DTS-CMA-ES-Pitra 2.4 (4)4.5 (6)4.6 (9)5010/15
Ord-N-DTS-CMA-ES-Pitra 10 (12)5010/15
Ord-Q-DTS-CMA-ES-Pitra 3.4 (3)5020/15
SSEABC-Aydin 1.2 (0.3)9.2 (7)49 (46)74 (58)132 (127)132 (178)210 (189)2/15

Δ fopt
f4, 5-D
1e1
809
1e0
1633
1e-1
1688
1e-2
1758
1e-3
1817
1e-5
1886
1e-7
1903
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 8949 (9812)5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1.1e4 (1e4)5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 2.2e4 (2e4)5e70/15
CMAES-APOP-Nguyen 4.1 (4)5e50/15
DTS-CMA-ES-Pitra 2.2 (0.9)50050/15
EvoSpace-PSO-GA-Garcia-Valdez 1.8 (1)10 (6)18 (6)21 (10)22 (4)31 (7)36 (8)15/15
KL-BIPOP-CMA-ES-Yamaguchi 2.5 (1.0)5236 (5150)4.2e4 (5e4)4.1e4 (3e4)3.9e4 (4e4)3.8e4 (3e4)3.8e4 (3e4)1/15
KL-IPOP-CMA-ES-Yamaguchi 1.8 (1)5e60/15
KL-Restart-CMA-ES-Yamaguchi 2.5 (0.9)4255 (9061)2.0e4 (9631)1.9e4 (3e4)1.9e4 (2e4)1.8e4 (2e4)1.8e4 (1e4)2/15
Ord-H-DTS-CMA-ES-Pitra 5010/15
Ord-N-DTS-CMA-ES-Pitra 5010/15
Ord-Q-DTS-CMA-ES-Pitra 5010/15
SSEABC-Aydin 2.7 (4)5e40/15

Δ fopt
f5, 5-D
1e1
10
1e0
10
1e-1
10
1e-2
10
1e-3
10
1e-5
10
1e-7
10
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 2608 (2498)5e70/15
CMAES-APOP-Nguyen 5.8 (2)7.3 (2)7.4 (3)7.5 (2)7.5 (3)7.5 (3)7.5 (3)15/15
DTS-CMA-ES-Pitra 2.7 (0.5)3.5 (1)4.6 (2)4.7 (2)4.7 (2)4.7 (2)4.7 (2)15/15
EvoSpace-PSO-GA-Garcia-Valdez 38 (13)128 (126)186 (33)189 (91)189 (85)189 (149)189 (51)15/15
KL-BIPOP-CMA-ES-Yamaguchi 4.7 (3)6.1 (3)6.3 (2)6.3 (3)6.3 (1)6.3 (2)6.3 (1)15/15
KL-IPOP-CMA-ES-Yamaguchi 4.7 (1)6.5 (2)6.8 (2)6.8 (2)6.8 (2)6.8 (2)6.8 (2)15/15
KL-Restart-CMA-ES-Yamaguchi 15 (7)20 (4)21 (5)21 (4)21 (4)21 (4)21 (5)15/15
Ord-H-DTS-CMA-ES-Pitra 2.4 (0.3)3.5 (0.9)3.8 (2)3.8 (2)3.8 (2)3.8 (2)3.8 (2)15/15
Ord-N-DTS-CMA-ES-Pitra 2.5 (0.4)3.8 (1)4.1 (2)4.1 (2)4.1 (1)4.1 (2)4.1 (2)15/15
Ord-Q-DTS-CMA-ES-Pitra 2.5 (1)4.0 (3)4.4 (4)4.6 (2)4.6 (3)4.6 (2)4.6 (1)15/15
SSEABC-Aydin 6.6 (3)22 (28)34 (17)41 (13)46 (61)51 (55)51 (50)15/15

Δ fopt
f6, 5-D
1e1
114
1e0
214
1e-1
281
1e-2
404
1e-3
580
1e-5
1038
1e-7
1332
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 3.3e4 (4796)4.4e4 (1e5)5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 137 (138)2.2e4 (3e4)5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 89 (123)3.4e4 (3e4)5e70/15
CMAES-APOP-Nguyen 1.7 (0.6)1.8 (0.4)2.0 (0.5)1.9 (0.4)1.6 (0.2)1.2 (0.2)1.2 (0.1)15/15
DTS-CMA-ES-Pitra 4.0 (2)34 (36)77 (62)183 (152)50060/15
EvoSpace-PSO-GA-Garcia-Valdez 16 (23)42 (18)65 (9)69 (17)67 (11)60 (5)71 (6)15/15
KL-BIPOP-CMA-ES-Yamaguchi 2.1 (1)1.9 (0.8)2.1 (0.6)1.8 (0.4)1.6 (0.2)1.2 (0.1)1.2 (0.2)15/15
KL-IPOP-CMA-ES-Yamaguchi 2.3 (0.9)2.1 (0.4)2.2 (0.3)2.0 (0.2)1.7 (0.2)1.3 (0.2)1.3 (0.1)15/15
KL-Restart-CMA-ES-Yamaguchi 8.3 (3)7.5 (2)7.9 (1)7.1 (0.3)6.1 (0.3)4.5 (0.5)4.6 (0.3)15/15
Ord-H-DTS-CMA-ES-Pitra 3.8 (5)11 (10)5010/15
Ord-N-DTS-CMA-ES-Pitra 3.4 (4)5020/15
Ord-Q-DTS-CMA-ES-Pitra 3.4 (5)34 (29)5020/15
SSEABC-Aydin 2.0 (0.7)1.9 (0.5)2.0 (0.5)1.8 (0.2)1.6 (0.3)1.2 (0.1)1.2 (0.1)15/15

Δ fopt
f7, 5-D
1e1
24
1e0
324
1e-1
1171
1e-2
1451
1e-3
1572
1e-5
1572
1e-7
1597
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 82 (124)742 (447)3.1e4 (2e4)5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 67 (101)894 (1405)3.0e4 (5e4)5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 56 (106)851 (1832)8.8e4 (1e5)5e70/15
CMAES-APOP-Nguyen 3.2 (2)2.2 (2)1.7 (0.9)1.9 (1)1.9 (0.6)1.9 (0.1)2.0 (0.2)15/15
DTS-CMA-ES-Pitra 3.3 (0.6)0.93 (1)0.48 (0.4)0.50 (0.2)0.58 (0.6)0.58 (0.4)0.93 (0.1)13/15
EvoSpace-PSO-GA-Garcia-Valdez 11 (4)28 (19)32 (30)34 (21)38 (6)38 (37)38 (38)12/15
KL-BIPOP-CMA-ES-Yamaguchi 4.8 (3)1.2 (0.6)1.1 (0.7)1.1 (0.3)1.2 (0.6)1.2 (0.5)1.2 (0.8)15/15
KL-IPOP-CMA-ES-Yamaguchi 4.4 (2)1.7 (1)1.4 (0.7)1.3 (0.8)1.2 (0.6)1.2 (0.8)1.2 (0.7)15/15
KL-Restart-CMA-ES-Yamaguchi 13 (11)2.3 (0.8)0.95 (0.2)1.00 (0.2)0.98 (0.2)0.98 (0.1)0.96 (0.1)15/15
Ord-H-DTS-CMA-ES-Pitra 6.9 (11)5.2 (3)5010/15
Ord-N-DTS-CMA-ES-Pitra 2.9 (2)1.4 (1)6.2 (7)5010/15
Ord-Q-DTS-CMA-ES-Pitra 3.7 (6)2.4 (2)1.9 (1.0)5.0 (11)4.6 (3)4.6 (4)4.6 (6)1/15
SSEABC-Aydin 5.9 (2)1.9 (2)1.4 (0.8)1.4 (1.0)1.4 (0.8)1.4 (0.7)1.4 (0.9)15/15

Δ fopt
f8, 5-D
1e1
73
1e0
273
1e-1
336
1e-2
372
1e-3
391
1e-5
410
1e-7
422
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 5300 (5394)1.3e6 (2e6)5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1.5e4 (7271)2.6e6 (3e6)5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 1.7e4 (3e4)5e70/15
CMAES-APOP-Nguyen 2.6 (0.3)4.4 (0.8)5.4 (0.5)5.6 (7)5.8 (7)6.1 (14)6.4 (8)15/15
DTS-CMA-ES-Pitra 1.2 (0.3)★21.0 (0.2)★21.1 (0.2)★21.1 (0.1)★31.1 (0.1)★31.2 (0.4)★31.2 (0.3)15/15
EvoSpace-PSO-GA-Garcia-Valdez 19 (14)94 (61)243 (149)420 (268)645 (148)3289 (3265)1.3e4 (1e4)1/15
KL-BIPOP-CMA-ES-Yamaguchi 3.5 (2)3.0 (1)3.8 (2)4.1 (2)4.2 (2)4.5 (1)4.8 (1)15/15
KL-IPOP-CMA-ES-Yamaguchi 5.9 (6)6.9 (5)7.3 (2)7.2 (6)7.2 (4)7.4 (4)7.6 (2)15/15
KL-Restart-CMA-ES-Yamaguchi 11 (2)8.9 (2)10 (1)11 (1)11 (0.8)12 (2)13 (1)15/15
Ord-H-DTS-CMA-ES-Pitra 4.0 (5)26 (25)5010/15
Ord-N-DTS-CMA-ES-Pitra 4.7 (4)5010/15
Ord-Q-DTS-CMA-ES-Pitra 2.5 (0.8)27 (21)22 (27)5010/15
SSEABC-Aydin 4.7 (0.9)5.6 (8)8.7 (3)14 (51)14 (0.4)14 (31)14 (0.8)15/15

Δ fopt
f9, 5-D
1e1
35
1e0
127
1e-1
214
1e-2
263
1e-3
300
1e-5
335
1e-7
369
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1.7e4 (5e4)5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1.9e4 (3e4)5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 5.6e4 (6e4)5e70/15
CMAES-APOP-Nguyen 4.9 (2)6.6 (3)6.2 (2)5.9 (1)5.6 (1.0)5.6 (1.0)5.5 (1)15/15
DTS-CMA-ES-Pitra 2.6 (1)1.9 (0.6)★41.5 (0.3)★41.4 (0.3)★41.4 (0.2)★41.3 (0.2)★41.3 (0.3)★415/15
EvoSpace-PSO-GA-Garcia-Valdez 41 (13)304 (114)644 (1172)1153 (574)2855 (2139)7033 (7552)6498 (6980)2/15
KL-BIPOP-CMA-ES-Yamaguchi 6.5 (3)9.3 (3)7.7 (5)7.2 (4)6.8 (1)6.7 (3)6.6 (3)15/15
KL-IPOP-CMA-ES-Yamaguchi 6.6 (1)7.3 (6)6.6 (4)6.3 (1)6.0 (1)5.9 (1)5.8 (2)15/15
KL-Restart-CMA-ES-Yamaguchi 22 (4)19 (2)16 (1)15 (1)15 (0.9)15 (1)15 (1.0)15/15
Ord-H-DTS-CMA-ES-Pitra 6.0 (8)5010/15
Ord-N-DTS-CMA-ES-Pitra 17 (44)5010/15
Ord-Q-DTS-CMA-ES-Pitra 5.1 (1)58 (55)5010/15
SSEABC-Aydin 9.0 (2)11 (9)9.0 (1.0)14 (2)15 (2)14 (28)13 (26)15/15

Δ fopt
f10, 5-D
1e1
349
1e0
500
1e-1
574
1e-2
607
1e-3
626
1e-5
829
1e-7
880
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 2.1e6 (2e6)5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1.0e6 (6e5)5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 2.0e6 (3e6)5e70/15
CMAES-APOP-Nguyen 3.1 (0.7)2.7 (0.6)2.7 (0.4)2.7 (0.3)2.7 (0.3)2.2 (0.2)2.3 (0.2)15/15
DTS-CMA-ES-Pitra 0.55 (0.2)★40.48 (0.1)★40.46 (0.1)★40.46 (0.1)★40.48 (0.0)★40.41 (0.0)★40.43 (0.1)★415/15
EvoSpace-PSO-GA-Garcia-Valdez 505 (459)854 (693)6370 (1e4)6456 (7188)3e50/15
KL-BIPOP-CMA-ES-Yamaguchi 3.7 (0.6)2.9 (0.7)2.8 (0.2)2.8 (0.2)2.9 (0.2)2.3 (0.2)2.4 (0.2)15/15
KL-IPOP-CMA-ES-Yamaguchi 3.3 (0.9)3.0 (0.6)2.8 (0.7)2.8 (0.3)2.9 (0.3)2.4 (0.3)2.4 (0.2)15/15
KL-Restart-CMA-ES-Yamaguchi 4.7 (0.5)3.9 (0.4)4.0 (0.3)4.2 (0.3)4.5 (0.5)4.1 (0.2)4.5 (0.3)15/15
Ord-H-DTS-CMA-ES-Pitra 21 (18)5010/15
Ord-N-DTS-CMA-ES-Pitra 11 (17)15 (18)5010/15
Ord-Q-DTS-CMA-ES-Pitra 5010/15
SSEABC-Aydin 3.5 (0.9)3.1 (0.7)3.0 (0.4)3.0 (0.5)3.1 (0.4)2.5 (0.2)2.5 (0.2)15/15

Δ fopt
f11, 5-D
1e1
143
1e0
202
1e-1
763
1e-2
977
1e-3
1177
1e-5
1467
1e-7
1673
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 444 (213)3.6e4 (6e4)9.5e5 (6e5)5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 311 (264)4.2e4 (5e4)5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 664 (957)7.3e4 (7e4)5e70/15
CMAES-APOP-Nguyen 7.8 (1)6.9 (0.9)2.1 (0.3)1.7 (0.2)1.5 (0.2)1.3 (0.2)1.2 (0.1)15/15
DTS-CMA-ES-Pitra 1.2 (0.5)★31.1 (0.3)★40.32 (0.1)★40.27 (0.1)★40.24 (0.0)★40.22 (0.0)★40.22 (0.0)★415/15
EvoSpace-PSO-GA-Garcia-Valdez 151 (217)832 (1036)454 (562)717 (816)1146 (941)4e50/15
KL-BIPOP-CMA-ES-Yamaguchi 9.1 (2)7.3 (1)2.1 (0.3)1.8 (0.2)1.5 (0.1)1.4 (0.1)1.3 (0.1)15/15
KL-IPOP-CMA-ES-Yamaguchi 8.5 (2)7.2 (2)2.2 (0.3)1.8 (0.2)1.6 (0.1)1.4 (0.2)1.3 (0.2)15/15
KL-Restart-CMA-ES-Yamaguchi 8.2 (2)7.8 (2)2.5 (0.2)2.2 (0.2)2.1 (0.1)2.1 (0.1)2.2 (0.1)15/15
Ord-H-DTS-CMA-ES-Pitra 5010/15
Ord-N-DTS-CMA-ES-Pitra 52 (66)5020/15
Ord-Q-DTS-CMA-ES-Pitra 16 (15)5020/15
SSEABC-Aydin 8.5 (0.7)7.2 (0.9)2.1 (0.2)1.8 (0.1)1.6 (0.2)1.4 (0.1)1.3 (0.2)15/15

Δ fopt
f12, 5-D
1e1
108
1e0
268
1e-1
371
1e-2
413
1e-3
461
1e-5
1303
1e-7
1494
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 5e70/15
CMAES-APOP-Nguyen 8.0 (7)5.1 (6)5.9 (4)6.3 (5)6.6 (5)3.1 (2)3.2 (2)15/15
DTS-CMA-ES-Pitra 26 (49)12 (19)9.1 (27)11 (16)10 (6)3.7 (2)3.3 (3)9/15
EvoSpace-PSO-GA-Garcia-Valdez 288 (243)497 (579)1806 (2494)1630 (1756)3119 (4612)1e50/15
KL-BIPOP-CMA-ES-Yamaguchi 11 (5)7.6 (8)7.5 (7)7.6 (5)7.6 (5)3.3 (2)3.3 (0.7)15/15
KL-IPOP-CMA-ES-Yamaguchi 11 (0.5)8.4 (9)8.7 (11)8.8 (13)8.8 (10)3.9 (5)3.8 (4)15/15
KL-Restart-CMA-ES-Yamaguchi 18 (2)10 (3)10 (3)11 (3)12 (4)5.5 (2)5.7 (2)15/15
Ord-H-DTS-CMA-ES-Pitra 8.7 (5)14 (18)5010/15
Ord-N-DTS-CMA-ES-Pitra 5010/15
Ord-Q-DTS-CMA-ES-Pitra 7.2 (8)9.2 (14)20 (15)5010/15
SSEABC-Aydin 7.2 (6)7.4 (9)11 (7)13 (19)17 (14)8.3 (8)11 (17)12/15

Δ fopt
f13, 5-D
1e1
132
1e0
195
1e-1
250
1e-2
319
1e-3
1310
1e-5
1752
1e-7
2255
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 5.7e6 (7e6)5e70/15
CMAES-APOP-Nguyen 2.7 (1.0)4.4 (1)5.9 (1)5.4 (0.9)1.5 (0.3)1.5 (0.2)1.6 (0.2)15/15
DTS-CMA-ES-Pitra 3.8 (0.8)3.0 (13)2.7 (0.5)2.2 (0.2)0.60 (0.1)0.53 (1)0.48 (0.0)14/15
EvoSpace-PSO-GA-Garcia-Valdez 142 (235)1147 (1947)1e50/15
KL-BIPOP-CMA-ES-Yamaguchi 3.2 (2)3.7 (2)5.2 (2)5.0 (1)1.5 (0.4)1.5 (0.4)1.7 (0.4)14/15
KL-IPOP-CMA-ES-Yamaguchi 4.7 (3)4.5 (1)5.1 (0.6)5.0 (2)1.5 (0.3)1.6 (0.5)1.6 (0.7)15/15
KL-Restart-CMA-ES-Yamaguchi 8.2 (0.8)8.3 (0.4)8.7 (0.5)8.4 (0.3)2.5 (0.1)2.4 (0.1)2.4 (0.1)15/15
Ord-H-DTS-CMA-ES-Pitra 7.8 (14)38 (51)5010/15
Ord-N-DTS-CMA-ES-Pitra 5.2 (6)5010/15
Ord-Q-DTS-CMA-ES-Pitra 3.8 (4)7.0 (9)30 (36)5010/15
SSEABC-Aydin 3.8 (3)5.9 (3)6.5 (3)6.7 (1)1.9 (0.3)1.8 (0.3)1.8 (0.2)15/15

Δ fopt
f14, 5-D
1e1
10
1e0
41
1e-1
58
1e-2
90
1e-3
139
1e-5
251
1e-7
476
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 0.97 (1.0)88 (93)3.8e4 (5e4)8.3e6 (1e7)5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1.7 (2)86 (155)5.8e4 (8e4)8.1e6 (2e7)5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 1.7 (2)190 (150)1.2e5 (7e4)5e70/15
CMAES-APOP-Nguyen 0.64 (0.5)1.8 (2)3.2 (0.5)3.5 (0.6)4.4 (1)5.0 (0.9)4.2 (0.4)15/15
DTS-CMA-ES-Pitra 1.7 (1)1.3 (0.5)1.5 (0.3)★21.4 (0.3)★31.3 (0.1)★41.2 (0.1)★40.89 (0.1)★415/15
EvoSpace-PSO-GA-Garcia-Valdez 17 (0.4)11 (5)23 (13)108 (60)137 (54)681 (549)3e50/15
KL-BIPOP-CMA-ES-Yamaguchi 1.9 (2)2.7 (1)3.9 (1)3.9 (1)4.4 (0.6)5.1 (0.5)4.2 (0.4)15/15
KL-IPOP-CMA-ES-Yamaguchi 2.3 (3)3.2 (1)4.1 (0.8)4.3 (0.9)5.0 (2)5.4 (0.5)4.5 (0.4)15/15
KL-Restart-CMA-ES-Yamaguchi 4.0 (4)10 (2)13 (2)12 (3)11 (1)10 (0.8)6.7 (0.6)15/15
Ord-H-DTS-CMA-ES-Pitra 1.2 (1)2.2 (1)6.0 (6)19 (17)53 (57)5010/15
Ord-N-DTS-CMA-ES-Pitra 1.6 (1)2.2 (2)4.0 (2)19 (20)27 (29)5010/15
Ord-Q-DTS-CMA-ES-Pitra 2.2 (2)1.5 (0.7)2.5 (1)8.7 (8)26 (18)5010/15
SSEABC-Aydin 3.0 (3)3.7 (0.7)4.4 (0.4)4.4 (0.7)4.8 (0.7)5.7 (0.7)4.6 (0.3)15/15

Δ fopt
f15, 5-D
1e1
511
1e0
9310
1e-1
19369
1e-2
19743
1e-3
20073
1e-5
20769
1e-7
21359
#succ
14/15
RANDOMSEARCH-4-1e7D-Brockhoff 4443 (6760)5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4586 (4707)5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 7112 (9159)5e70/15
CMAES-APOP-Nguyen 1.5 (2)1.2 (0.3)0.66 (0.3)0.70 (0.1)0.73 (0.1)0.77 (0.1)0.80 (0.2)15/15
DTS-CMA-ES-Pitra 0.37 (0.1)★28.0 (7)50040/15
EvoSpace-PSO-GA-Garcia-Valdez 31 (66)1e50/15
KL-BIPOP-CMA-ES-Yamaguchi 2.1 (2)1.7 (0.7)1.6 (0.9)1.6 (1)1.6 (1.0)1.6 (0.8)1.6 (1.0)15/15
KL-IPOP-CMA-ES-Yamaguchi 0.91 (0.5)0.89 (0.4)0.69 (0.3)0.70 (0.3)0.70 (0.3)0.71 (0.4)0.72 (0.3)15/15
KL-Restart-CMA-ES-Yamaguchi 2.9 (1)0.46 (0.4)0.53 (0.3)0.54 (0.5)0.54 (0.6)0.55 (0.2)0.56 (0.5)15/15
Ord-H-DTS-CMA-ES-Pitra 4.6 (5)5010/15
Ord-N-DTS-CMA-ES-Pitra 5020/15
Ord-Q-DTS-CMA-ES-Pitra 3.3 (4)5020/15
SSEABC-Aydin 1.2 (0.2)0.93 (0.6)1.0 (0.9)1.1 (0.8)1.7 (1)7.9 (8)10 (21)1/15

Δ fopt
f16, 5-D
1e1
120
1e0
612
1e-1
2662
1e-2
10163
1e-3
10449
1e-5
11644
1e-7
12095
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 4.7 (10)535 (336)3.8e4 (2e4)5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2.2 (3)597 (432)4.5e4 (5e4)5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 3.2 (2)428 (427)5.9e4 (9e4)5e70/15
CMAES-APOP-Nguyen 2.0 (1)34 (39)34 (78)9.5 (17)14 (8)13 (34)13 (23)13/15
DTS-CMA-ES-Pitra 2.1 (4)6.5 (9)8.1 (5)3.4 (6)3.3 (2)3.0 (4)2.9 (3)2/15
EvoSpace-PSO-GA-Garcia-Valdez 1.8 (0.8)19 (15)26 (49)22 (28)54 (43)51 (64)78 (74)2/15
KL-BIPOP-CMA-ES-Yamaguchi 2.1 (2)2.5 (2)1.5 (2)0.93 (0.4)0.95 (0.4)0.97 (0.7)0.96 (0.6)15/15
KL-IPOP-CMA-ES-Yamaguchi 2.2 (1)2.1 (2)1.2 (0.6)0.51 (0.3)0.65 (0.7)0.62 (0.6)0.62 (0.9)15/15
KL-Restart-CMA-ES-Yamaguchi 2.8 (2)4.7 (2)2.3 (3)1.1 (0.6)1.1 (1)1.0 (1)1.0 (1)15/15
Ord-H-DTS-CMA-ES-Pitra 2.6 (5)5020/15
Ord-N-DTS-CMA-ES-Pitra 1.9 (2)5030/15
Ord-Q-DTS-CMA-ES-Pitra 3.7 (5)5020/15
SSEABC-Aydin 2.8 (2)2.0 (4)4.1 (6)1.4 (1)1.9 (2)3.8 (3)18 (7)3/15

Δ fopt
f17, 5-D
1e1
5.0
1e0
215
1e-1
899
1e-2
2861
1e-3
3669
1e-5
6351
1e-7
7934
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1.7 (2)289 (386)5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1.7 (1)671 (418)5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 6.2 (3)957 (1860)5e70/15
CMAES-APOP-Nguyen 1.7 (2)0.95 (1)1.3 (3)1.1 (1)1.6 (1)1.4 (0.9)1.6 (0.9)15/15
DTS-CMA-ES-Pitra 4.4 (3)0.69 (0.6)1.3 (0.9)0.63 (0.5)0.69 (0.6)1.3 (2)1.7 (2)5/15
EvoSpace-PSO-GA-Garcia-Valdez 36 (0.9)10 (5)23 (27)30 (36)45 (37)80 (126)101 (129)0/15
KL-BIPOP-CMA-ES-Yamaguchi 4.9 (6)1.0 (0.3)1.9 (4)22 (1)155 (215)368 (690)602 (739)9/15
KL-IPOP-CMA-ES-Yamaguchi 3.5 (5)0.86 (0.2)0.49 (0.2)0.59 (0.7)341 (682)690 (1181)1734 (1576)4/15
KL-Restart-CMA-ES-Yamaguchi 8.8 (9)3.1 (0.6)1.5 (0.2)0.77 (0.1)0.80 (0.1)0.71 (0.0)0.75 (0.0)15/15
Ord-H-DTS-CMA-ES-Pitra 5.7 (8)2.3 (3)5010/15
Ord-N-DTS-CMA-ES-Pitra 3.5 (3)2.5 (3)5010/15
Ord-Q-DTS-CMA-ES-Pitra 3.7 (3)1.6 (2)1.9 (2)5010/15
SSEABC-Aydin 4.4 (2)1.1 (0.3)1.4 (0.3)1.2 (0.7)1.2 (1)20 (25)90 (148)1/15

Δ fopt
f18, 5-D
1e1
103
1e0
378
1e-1
3968
1e-2
8451
1e-3
9280
1e-5
10905
1e-7
12469
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 8.2 (5)7.8e4 (2e5)5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 6.6 (6)7.4e4 (7e4)5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 16 (16)1.2e5 (2e5)5e70/15
CMAES-APOP-Nguyen 0.73 (0.6)0.80 (0.2)0.67 (0.8)0.82 (0.3)0.99 (0.2)1.2 (0.2)1.2 (0.2)15/15
DTS-CMA-ES-Pitra 0.60 (0.1)1.4 (1)0.46 (0.9)0.41 (0.4)0.49 (0.3)0.80 (0.6)1.9 (2)3/15
EvoSpace-PSO-GA-Garcia-Valdez 2.9 (2)35 (42)47 (69)182 (193)1e50/15
KL-BIPOP-CMA-ES-Yamaguchi 1.2 (1)2.6 (4)0.70 (0.7)1.1 (1)6.7 (15)18 (83)46 (6)14/15
KL-IPOP-CMA-ES-Yamaguchi 1.2 (0.4)2.4 (0.4)0.64 (1)56 (0.6)51 (270)83 (344)159 (401)11/15
KL-Restart-CMA-ES-Yamaguchi 3.3 (2)2.7 (0.3)0.46 (0.0)0.32 (0.0)0.37 (0.0)0.47 (0.0)29 (0.0)14/15
Ord-H-DTS-CMA-ES-Pitra 1.4 (0.6)19 (23)5010/15
Ord-N-DTS-CMA-ES-Pitra 1.5 (2)19 (30)5010/15
Ord-Q-DTS-CMA-ES-Pitra 1.2 (1)6.0 (8)5020/15
SSEABC-Aydin 1.5 (0.7)2.2 (2)0.89 (1)0.89 (0.5)1.4 (0.8)21 (22)29 (34)2/15

Δ fopt
f19, 5-D
1e1
1
1e0
1
1e-1
242
1e-2
1.0e5
1e-3
1.2e5
1e-5
1.2e5
1e-7
1.2e5
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 25 (17)5.1e4 (9e4)1.5e6 (2e6)5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 16 (15)6.2e4 (6e4)6.7e5 (6e5)5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 34 (26)1.6e5 (2e5)3.0e6 (3e6)5e70/15
CMAES-APOP-Nguyen 1 (0)★21 (0)★490 (71)0.41 (0.1)0.40 (0.1)0.43 (0.1)0.45 (0.1)15/15
DTS-CMA-ES-Pitra 24 (13)1054 (1019)136 (129)50010/15
EvoSpace-PSO-GA-Garcia-Valdez 159 (54)1.1e4 (9844)3921 (4014)1e50/15
KL-BIPOP-CMA-ES-Yamaguchi 23 (16)2110 (1983)1001 (1350)5.1 (4)4.6 (4)4.6 (1)4.6 (3)15/15
KL-IPOP-CMA-ES-Yamaguchi 16 (12)1.3e4 (4638)406 (333)2.5 (1)2.3 (0.9)2.3 (0.7)2.3 (0.4)15/15
KL-Restart-CMA-ES-Yamaguchi 43 (40)1384 (697)305 (613)1.8 (1)2.6 (4)2.6 (2)2.6 (2)15/15
Ord-H-DTS-CMA-ES-Pitra 24 (11)3579 (3773)5020/15
Ord-N-DTS-CMA-ES-Pitra 21 (16)3587 (2889)5020/15
Ord-Q-DTS-CMA-ES-Pitra 25 (22)2197 (3569)5020/15
SSEABC-Aydin 47 (44)2379 (3819)158 (116)3.4 (7)6.0 (7)6.0 (4)5.9 (5)0/15

Δ fopt
f20, 5-D
1e1
16
1e0
851
1e-1
38111
1e-2
51362
1e-3
54470
1e-5
54861
1e-7
55313
#succ
14/15
RANDOMSEARCH-4-1e7D-Brockhoff 8.4 (7)3014 (3674)5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 16 (17)6891 (8271)5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 24 (21)9011 (1e4)5e70/15
CMAES-APOP-Nguyen 1.5 (2)16 (5)1.1 (1)0.88 (0.3)0.89 (0.6)0.93 (0.6)0.97 (0.6)15/15
DTS-CMA-ES-Pitra 2.0 (0.3)24 (51)50060/15
EvoSpace-PSO-GA-Garcia-Valdez 12 (3)11 (8)6.2 (5)4.8 (6)4.6 (4)4.8 (6)4.9 (5)5/15
KL-BIPOP-CMA-ES-Yamaguchi 2.7 (1)15 (12)2.6 (1)1.9 (0.4)1.9 (0.5)1.9 (0.7)1.9 (0.6)15/15
KL-IPOP-CMA-ES-Yamaguchi 3.4 (2)8.9 (7)1.9 (2)1.4 (1)1.4 (1)1.4 (1)1.5 (1)15/15
KL-Restart-CMA-ES-Yamaguchi 12 (9)8.1 (13)4.3 (7)3.2 (4)3.0 (2)3.0 (3)3.0 (3)15/15
Ord-H-DTS-CMA-ES-Pitra 2.6 (0.9)5010/15
Ord-N-DTS-CMA-ES-Pitra 2.7 (2)5010/15
Ord-Q-DTS-CMA-ES-Pitra 2.7 (0.9)5010/15
SSEABC-Aydin 6.9 (2)12 (6)18 (23)14 (37)13 (17)13 (20)13 (30)1/15

Δ fopt
f21, 5-D
1e1
41
1e0
1157
1e-1
1674
1e-2
1692
1e-3
1705
1e-5
1729
1e-7
1757
#succ
14/15
RANDOMSEARCH-4-1e7D-Brockhoff 2.0 (5)8.0 (10)105 (111)1501 (1942)1.2e4 (1e4)5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4.6 (3)12 (4)168 (225)2298 (1938)3.5e4 (4e4)5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 4.9 (4)19 (12)175 (202)2549 (3263)2.6e4 (3e4)5e70/15
CMAES-APOP-Nguyen 1.8 (1)11 (24)27 (84)27 (84)29 (1)28 (12)28 (1.0)14/15
DTS-CMA-ES-Pitra 4.5 (1)5.2 (4)4.6 (6)4.6 (6)4.6 (5)5.6 (7)5.5 (4)5/15
EvoSpace-PSO-GA-Garcia-Valdez 4.8 (2)23 (18)32 (33)34 (34)36 (50)40 (30)42 (30)11/15
KL-BIPOP-CMA-ES-Yamaguchi 1.2 (1)6.1 (7)10 (7)10 (13)10 (16)10 (12)10 (12)15/15
KL-IPOP-CMA-ES-Yamaguchi 1.7 (0.4)38 (70)129 (60)129 (402)129 (247)128 (345)128 (244)15/15
KL-Restart-CMA-ES-Yamaguchi 3.8 (2)3.6 (3)5.6 (9)5.6 (8)5.7 (4)5.8 (8)5.9 (6)15/15
Ord-H-DTS-CMA-ES-Pitra 3.4 (4)1.5 (1)4.3 (2)4.3 (3)4.3 (6)4.3 (4)5010/15
Ord-N-DTS-CMA-ES-Pitra 4.8 (9)2.9 (2)2.1 (1)2.1 (2)2.2 (2)4.3 (3)4.3 (6)1/15
Ord-Q-DTS-CMA-ES-Pitra 3.4 (3)1.4 (1)1.0 (0.9)4.2 (7)4.2 (4)4.2 (6)4.2 (3)1/15
SSEABC-Aydin 2.1 (1)5.0 (2)13 (13)13 (14)13 (12)13 (18)15 (14)12/15

Δ fopt
f22, 5-D
1e1
71
1e0
386
1e-1
938
1e-2
980
1e-3
1008
1e-5
1040
1e-7
1068
#succ
14/15
RANDOMSEARCH-4-1e7D-Brockhoff 3.8 (5)39 (17)284 (354)1985 (2517)2.3e4 (4e4)5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 3.1 (6)42 (58)239 (171)6586 (6030)6.6e4 (9e4)5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 5.7 (7)50 (26)372 (482)5337 (7377)1.2e5 (2e5)5e70/15
CMAES-APOP-Nguyen 6.6 (6)43 (55)253 (401)441 (915)430 (684)418 (383)407 (246)9/15
DTS-CMA-ES-Pitra 5.9 (16)13 (7)32 (43)31 (50)30 (27)29 (35)28 (36)2/15
EvoSpace-PSO-GA-Garcia-Valdez 4.9 (3)34 (134)53 (110)58 (94)66 (106)83 (107)98 (96)11/15
KL-BIPOP-CMA-ES-Yamaguchi 5.3 (8)9.2 (16)26 (14)25 (49)25 (60)25 (48)25 (26)15/15
KL-IPOP-CMA-ES-Yamaguchi 1.5 (0.6)57 (48)113 (270)132 (259)134 (185)133 (208)132 (205)15/15
KL-Restart-CMA-ES-Yamaguchi 7.7 (19)11 (15)25 (21)26 (24)26 (27)25 (27)25 (26)15/15
Ord-H-DTS-CMA-ES-Pitra 3.5 (7)3.0 (3)4.0 (3)5010/15
Ord-N-DTS-CMA-ES-Pitra 2.4 (1)10 (7)5010/15
Ord-Q-DTS-CMA-ES-Pitra 3.2 (3)4.0 (5)7.8 (10)7.6 (6)7.4 (3)7.2 (8)5010/15
SSEABC-Aydin 3.2 (10)40 (52)51 (38)60 (69)68 (79)81 (52)93 (79)6/15

Δ fopt
f23, 5-D
1e1
3.0
1e0
518
1e-1
14249
1e-2
27890
1e-3
31654
1e-5
33030
1e-7
34256
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 2.0 (2)51 (46)5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2.7 (4)56 (74)5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 2.3 (2)39 (35)5e70/15
CMAES-APOP-Nguyen 2.4 (2)24 (39)493 (467)5e50/15
DTS-CMA-ES-Pitra 1.9 (1)11 (9)50070/15
EvoSpace-PSO-GA-Garcia-Valdez 36 (33)23 (22)15 (6)18 (23)17 (18)18 (13)19 (18)3/15
KL-BIPOP-CMA-ES-Yamaguchi 2.1 (3)13 (32)5.5 (5)3.7 (3)3.4 (2)3.5 (1)3.4 (2)15/15
KL-IPOP-CMA-ES-Yamaguchi 2.6 (3)8.9 (6)4.3 (8)3.2 (3)2.8 (6)2.8 (4)2.7 (2)15/15
KL-Restart-CMA-ES-Yamaguchi 3.4 (3)25 (4)4.0 (2)2.5 (2)2.2 (1)2.1 (1)2.1 (1)15/15
Ord-H-DTS-CMA-ES-Pitra 2.0 (4)5020/15
Ord-N-DTS-CMA-ES-Pitra 2.6 (3)5020/15
Ord-Q-DTS-CMA-ES-Pitra 2.6 (2)5010/15
SSEABC-Aydin 2.6 (2)10 (13)6.1 (6)25 (20)22 (18)21 (17)21 (24)1/15

Δ fopt
f24, 5-D
1e1
1622
1e0
2.2e5
1e-1
6.4e6
1e-2
9.6e6
1e-3
9.6e6
1e-5
1.3e7
1e-7
1.3e7
#succ
3/15
RANDOMSEARCH-4-1e7D-Brockhoff 502 (539)5e70/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1718 (1354)5e70/15
RANDOMSEARCH-5-1e7D-Brockhoff 2515 (2890)5e70/15
CMAES-APOP-Nguyen 2.4 (2)34 (21)5e50/15
DTS-CMA-ES-Pitra 6.8 (8)50020/15
EvoSpace-PSO-GA-Garcia-Valdez 25 (31)7.4 (12)1e50/15
KL-BIPOP-CMA-ES-Yamaguchi 1.9 (2)6.3 (7)3.5 (5)5e60/15
KL-IPOP-CMA-ES-Yamaguchi 2.2 (2)64 (58)5e60/15
KL-Restart-CMA-ES-Yamaguchi 2.3 (2)1.1 (0.7)2.6 (1)7.4 (15)7.3 (13)5.5 (5)5.5 (4)1/15
Ord-H-DTS-CMA-ES-Pitra 5010/15
Ord-N-DTS-CMA-ES-Pitra 5020/15
Ord-Q-DTS-CMA-ES-Pitra 5010/15
SSEABC-Aydin 2.8 (4)5e40/15

Previous dimension | Dimension = 10 | Next dimension

Δ fopt
f1, 10-D
1e1
22
1e0
23
1e-1
23
1e-2
23
1e-3
23
1e-5
23
1e-7
23
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 673 (1062)8.3e6 (8e6)1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 813 (1052)6.5e7 (8e7)1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 1155 (1588)1e80/15
CMAES-APOP-Nguyen 3.8 (2)10 (1)16 (1)23 (2)29 (3)41 (3)54 (5)15/15
DTS-CMA-ES-Pitra 3.5 (0.6)5.5 (0.8)★37.3 (0.5)★410 (0.7)★412 (0.7)★416 (0.5)★420 (0.9)★415/15
EvoSpace-PSO-GA-Garcia-Valdez 28 (6)84 (21)159 (38)265 (52)1070 (660)2564 (343)3652 (636)15/15
KL-BIPOP-CMA-ES-Yamaguchi 5.9 (3)12 (2)18 (3)24 (3)30 (3)44 (5)57 (5)15/15
KL-IPOP-CMA-ES-Yamaguchi 5.5 (2)12 (3)19 (2)25 (3)32 (2)45 (3)58 (2)15/15
KL-Restart-CMA-ES-Yamaguchi 39 (7)72 (8)104 (9)138 (6)171 (13)235 (18)306 (14)15/15
Ord-H-DTS-CMA-ES-Pitra 4.2 (1)10 (11)21 (22)41 (34)74 (58)10020/15
Ord-N-DTS-CMA-ES-Pitra 4.5 (0.9)10 (7)21 (8)39 (30)633 (588)10020/15
Ord-Q-DTS-CMA-ES-Pitra 4.0 (1)8.2 (4)18 (13)36 (16)70 (27)10020/15
SSEABC-Aydin 8.2 (1)14 (1)20 (2)28 (3)34 (3)47 (3)61 (3)15/15

Δ fopt
f2, 10-D
1e1
187
1e0
190
1e-1
191
1e-2
191
1e-3
193
1e-5
194
1e-7
195
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 1e80/15
CMAES-APOP-Nguyen 21 (5)23 (3)25 (2)25 (2)26 (3)28 (2)29 (2)15/15
DTS-CMA-ES-Pitra 4.6 (1.0)★35.5 (0.6)5.8 (0.4)6.2 (0.4)6.5 (0.4)7.0 (0.5)7.5 (0.3)15/15
EvoSpace-PSO-GA-Garcia-Valdez 184 (59)248 (13)327 (97)442 (30)511 (88)669 (65)821 (111)15/15
KL-BIPOP-CMA-ES-Yamaguchi 20 (5)23 (5)26 (3)27 (2)28 (2)29 (3)30 (1)15/15
KL-IPOP-CMA-ES-Yamaguchi 21 (5)23 (3)25 (2)27 (2)27 (1)29 (0.8)30 (2)15/15
KL-Restart-CMA-ES-Yamaguchi 30 (2)34 (5)38 (4)42 (4)46 (4)53 (4)61 (4)15/15
Ord-H-DTS-CMA-ES-Pitra 10020/15
Ord-N-DTS-CMA-ES-Pitra 10020/11
Ord-Q-DTS-CMA-ES-Pitra 10020/15
SSEABC-Aydin 22 (4)26 (3)29 (3)30 (2)31 (2)32 (2)34 (3)15/15

Δ fopt
f3, 10-D
1e1
1739
1e0
3600
1e-1
3609
1e-2
3636
1e-3
3642
1e-5
3646
1e-7
3651
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 1e80/15
CMAES-APOP-Nguyen 12 (10)119 (54)364 (301)362 (370)362 (262)362 (647)362 (309)8/15
DTS-CMA-ES-Pitra 6.5 (17)1e40/15
EvoSpace-PSO-GA-Garcia-Valdez 3.4 (1)11 (5)19 (6)25 (7)31 (6)41 (5)49 (4)15/15
KL-BIPOP-CMA-ES-Yamaguchi 3.2 (1)297 (329)2369 (5029)2352 (1835)2349 (3258)2347 (3336)2344 (3424)11/15
KL-IPOP-CMA-ES-Yamaguchi 3.1 (1)7656 (9738)3.9e4 (3e4)3.9e4 (3e4)3.8e4 (6e4)3.8e4 (5e4)3.8e4 (6e4)1/15
KL-Restart-CMA-ES-Yamaguchi 4.5 (0.8)48 (41)638 (354)634 (744)633 (481)632 (582)632 (733)15/15
Ord-H-DTS-CMA-ES-Pitra 10020/15
Ord-N-DTS-CMA-ES-Pitra 10020/6
Ord-Q-DTS-CMA-ES-Pitra 10020/15
SSEABC-Aydin 4.6 (6)398 (312)1e50/15

Δ fopt
f4, 10-D
1e1
2234
1e0
3626
1e-1
3660
1e-2
3695
1e-3
3707
1e-5
3744
1e-7
28767
#succ
12/15
RANDOMSEARCH-4-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 1e80/15
CMAES-APOP-Nguyen 11 (2)1e60/15
DTS-CMA-ES-Pitra 64 (115)1e40/15
EvoSpace-PSO-GA-Garcia-Valdez 2.1 (0.6)12 (8)21 (9)29 (7)35 (10)47 (12)7.6 (1)15/15
KL-BIPOP-CMA-ES-Yamaguchi 6.1 (4)1e70/15
KL-IPOP-CMA-ES-Yamaguchi 6.7 (2)1e70/15
KL-Restart-CMA-ES-Yamaguchi 6.7 (6)1e70/15
Ord-H-DTS-CMA-ES-Pitra 10020/15
Ord-N-DTS-CMA-ES-Pitra 10020/8
Ord-Q-DTS-CMA-ES-Pitra 10020/15
SSEABC-Aydin 9.3 (8)1e50/15

Δ fopt
f5, 10-D
1e1
20
1e0
20
1e-1
20
1e-2
20
1e-3
20
1e-5
20
1e-7
20
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 1e80/15
CMAES-APOP-Nguyen 4.8 (0.8)6.1 (1)6.3 (1)6.3 (3)6.3 (1)6.3 (2)6.3 (2)15/15
DTS-CMA-ES-Pitra 5.2 (1)7.4 (1)8.6 (2)8.7 (2)9.0 (2)9.2 (3)9.2 (2)15/15
EvoSpace-PSO-GA-Garcia-Valdez 98 (22)192 (57)226 (38)230 (72)230 (43)230 (84)230 (38)15/15
KL-BIPOP-CMA-ES-Yamaguchi 4.7 (1)6.0 (1)6.2 (1)6.2 (2)6.2 (2)6.2 (0.7)6.2 (2)15/15
KL-IPOP-CMA-ES-Yamaguchi 5.3 (1)6.7 (1)6.7 (1)6.7 (1)6.7 (1)6.7 (1)6.7 (2)15/15
KL-Restart-CMA-ES-Yamaguchi 19 (7)25 (4)25 (5)25 (2)25 (4)25 (3)25 (4)15/15
Ord-H-DTS-CMA-ES-Pitra 5.7 (2)11 (4)15 (8)15 (7)15 (10)15 (10)15 (10)15/15
Ord-N-DTS-CMA-ES-Pitra 5.1 (3)14 (7)15 (5)15 (8)15 (3)15 (8)15 (7)15/15
Ord-Q-DTS-CMA-ES-Pitra 4.9 (1)15 (11)16 (9)17 (10)17 (11)17 (7)17 (11)15/15
SSEABC-Aydin 13 (3)39 (34)60 (51)76 (18)92 (19)120 (46)142 (42)15/15

Δ fopt
f6, 10-D
1e1
412
1e0
623
1e-1
826
1e-2
1039
1e-3
1292
1e-5
1841
1e-7
2370
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1.1e6 (1e6)1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 1e80/15
CMAES-APOP-Nguyen 1.8 (0.6)1.8 (0.3)1.8 (0.5)1.9 (0.4)1.8 (0.2)1.7 (0.2)1.7 (0.2)15/15
DTS-CMA-ES-Pitra 344 (401)1e40/15
EvoSpace-PSO-GA-Garcia-Valdez 21 (17)68 (37)120 (41)146 (37)167 (41)176 (33)187 (21)15/15
KL-BIPOP-CMA-ES-Yamaguchi 1.7 (0.3)1.8 (0.2)1.8 (0.4)1.8 (0.2)1.8 (0.1)1.7 (0.2)1.6 (0.1)15/15
KL-IPOP-CMA-ES-Yamaguchi 1.8 (0.6)1.8 (0.4)1.9 (0.3)1.8 (0.3)1.8 (0.3)1.7 (0.1)1.6 (0.2)15/15
KL-Restart-CMA-ES-Yamaguchi 14 (3)12 (2)12 (3)11 (0.6)11 (1.0)10 (0.6)9.1 (0.4)15/15
Ord-H-DTS-CMA-ES-Pitra 10020/15
Ord-N-DTS-CMA-ES-Pitra 10020/3
Ord-Q-DTS-CMA-ES-Pitra 10020/15
SSEABC-Aydin 1.6 (0.3)1.8 (0.3)1.9 (0.2)1.9 (0.2)1.8 (0.3)1.7 (0.2)1.7 (0.1)15/15

Δ fopt
f7, 10-D
1e1
172
1e0
1611
1e-1
4195
1e-2
5099
1e-3
5141
1e-5
5141
1e-7
5389
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 2.9e4 (5e4)1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4.5e4 (5e4)1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 5.6e4 (5e4)1e80/15
CMAES-APOP-Nguyen 2.3 (0.9)2.5 (2)1.9 (0.1)2.0 (0.1)2.0 (0.2)2.0 (0.2)2.0 (0.1)15/15
DTS-CMA-ES-Pitra 1.1 (0.9)★20.83 (0.6)0.56 (0.3)0.66 (0.6)0.91 (1.0)0.91 (1)1.2 (2)10/15
EvoSpace-PSO-GA-Garcia-Valdez 32 (7)54 (33)94 (75)122 (120)126 (61)126 (123)120 (164)4/15
KL-BIPOP-CMA-ES-Yamaguchi 2.4 (0.5)2.0 (2)1.6 (1)1.6 (0.9)1.6 (1)1.6 (1)1.6 (1)15/15
KL-IPOP-CMA-ES-Yamaguchi 2.5 (0.5)1.3 (1.0)1.2 (0.4)1.1 (0.6)1.1 (0.9)1.1 (0.4)1.1 (0.8)15/15
KL-Restart-CMA-ES-Yamaguchi 9.0 (1.0)1.6 (0.1)0.83 (0.0)0.88 (0.0)0.89 (0.1)0.89 (0.1)0.85 (0.1)15/15
Ord-H-DTS-CMA-ES-Pitra 10 (15)10020/15
Ord-N-DTS-CMA-ES-Pitra 12 (11)10020/11
Ord-Q-DTS-CMA-ES-Pitra 5.1 (5)9.0 (4)10020/15
SSEABC-Aydin 2.7 (0.9)1.4 (1)1.4 (2)1.2 (0.7)1.2 (1)1.2 (1)1.2 (1)15/15

Δ fopt
f8, 10-D
1e1
326
1e0
921
1e-1
1114
1e-2
1217
1e-3
1267
1e-5
1315
1e-7
1343
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 1e80/15
CMAES-APOP-Nguyen 2.6 (3)6.6 (18)6.6 (1)6.5 (9)6.5 (0.6)6.7 (0.6)6.8 (8)15/15
DTS-CMA-ES-Pitra 0.81 (0.1)★31.3 (0.2)1.3 (0.2)1.3 (0.2)1.3 (0.1)1.3 (0.1)1.4 (0.1)15/15
EvoSpace-PSO-GA-Garcia-Valdez 56 (53)340 (239)527 (113)2925 (1665)4476 (6974)8e50/15
KL-BIPOP-CMA-ES-Yamaguchi 2.3 (2)5.2 (5)5.2 (0.7)5.1 (0.4)5.2 (2)5.3 (3)5.5 (4)15/15
KL-IPOP-CMA-ES-Yamaguchi 2.6 (0.6)5.8 (3)5.7 (2)5.6 (0.6)5.6 (0.4)5.7 (0.7)5.9 (2)15/15
KL-Restart-CMA-ES-Yamaguchi 11 (1)13 (0.9)13 (0.5)13 (0.8)13 (0.5)14 (0.4)15 (0.5)15/15
Ord-H-DTS-CMA-ES-Pitra 5.6 (4)10020/15
Ord-N-DTS-CMA-ES-Pitra 19 (25)10020/13
Ord-Q-DTS-CMA-ES-Pitra 2.8 (3)10020/15
SSEABC-Aydin 2.5 (1)12 (0.9)11 (0.7)10 (11)10 (10)10 (10)10 (10)15/15

Δ fopt
f9, 10-D
1e1
200
1e0
648
1e-1
857
1e-2
993
1e-3
1065
1e-5
1138
1e-7
1185
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 1e80/15
CMAES-APOP-Nguyen 3.0 (0.2)8.8 (11)8.0 (0.8)7.5 (0.6)7.3 (0.8)7.2 (0.7)7.2 (0.3)15/15
DTS-CMA-ES-Pitra 1.4 (0.2)1.8 (0.1)1.6 (0.3)1.5 (0.2)1.5 (0.2)1.5 (0.1)1.5 (0.2)15/15
EvoSpace-PSO-GA-Garcia-Valdez 169 (130)1113 (1095)7e50/15
KL-BIPOP-CMA-ES-Yamaguchi 3.3 (0.4)7.5 (5)6.9 (4)6.4 (2)6.3 (3)6.2 (3)6.3 (2)15/15
KL-IPOP-CMA-ES-Yamaguchi 3.0 (0.6)6.6 (1)6.1 (3)5.7 (2)5.6 (0.3)5.6 (0.5)5.7 (4)15/15
KL-Restart-CMA-ES-Yamaguchi 17 (2)18 (0.9)17 (1)16 (0.9)16 (1)16 (0.9)17 (1.0)15/15
Ord-H-DTS-CMA-ES-Pitra 17 (10)10020/15
Ord-N-DTS-CMA-ES-Pitra 15 (31)10020/3
Ord-Q-DTS-CMA-ES-Pitra 14 (11)10020/15
SSEABC-Aydin 4.2 (0.9)12 (20)10 (8)9.2 (13)8.9 (0.6)8.6 (6)8.6 (0.6)15/15

Δ fopt
f10, 10-D
1e1
1835
1e0
2172
1e-1
2455
1e-2
2728
1e-3
2802
1e-5
4543
1e-7
4739
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 1e80/15
CMAES-APOP-Nguyen 2.0 (0.5)2.0 (0.2)1.9 (0.1)1.8 (0.1)1.8 (0.1)1.2 (0.0)1.2 (0.1)15/15
DTS-CMA-ES-Pitra 0.49 (0.1)★20.49 (0.1)0.47 (0.1)0.46 (0.0)0.46 (0.0)0.31 (0.0)0.32 (0.0)15/15
EvoSpace-PSO-GA-Garcia-Valdez 6e50/15
KL-BIPOP-CMA-ES-Yamaguchi 2.0 (0.3)2.0 (0.3)2.0 (0.2)1.9 (0.1)1.9 (0.1)1.2 (0.0)1.3 (0.1)15/15
KL-IPOP-CMA-ES-Yamaguchi 2.1 (0.4)2.0 (0.2)2.0 (0.2)1.9 (0.1)1.9 (0.2)1.2 (0.1)1.2 (0.1)15/15
KL-Restart-CMA-ES-Yamaguchi 2.9 (0.3)3.0 (0.3)3.0 (0.2)3.0 (0.1)3.2 (0.2)2.3 (0.1)2.5 (0.1)15/15
Ord-H-DTS-CMA-ES-Pitra 10020/15
Ord-N-DTS-CMA-ES-Pitra 10020/9
Ord-Q-DTS-CMA-ES-Pitra 10020/15
SSEABC-Aydin 2.1 (0.3)2.2 (0.2)2.1 (0.2)2.0 (0.2)2.1 (0.1)1.3 (0.1)1.4 (0.1)15/15

Δ fopt
f11, 10-D
1e1
266
1e0
1041
1e-1
2602
1e-2
2954
1e-3
3338
1e-5
4092
1e-7
4843
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 7.7e4 (2e5)1.4e6 (2e6)1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 6.9e4 (8e4)1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2.2e5 (7e4)1e80/15
CMAES-APOP-Nguyen 13 (2)3.9 (0.3)1.7 (0.1)1.6 (0.1)1.4 (0.1)1.3 (0.0)1.2 (0.0)15/15
DTS-CMA-ES-Pitra 2.8 (0.6)★30.83 (0.2)★30.37 (0.1)★30.35 (0.1)0.33 (0.1)0.30 (0.1)0.27 (0.1)15/15
EvoSpace-PSO-GA-Garcia-Valdez 711 (432)705 (371)4409 (6653)8e50/15
KL-BIPOP-CMA-ES-Yamaguchi 13 (2)3.8 (0.3)1.7 (0.2)1.6 (0.1)1.5 (0.1)1.3 (0.1)1.2 (0.1)15/15
KL-IPOP-CMA-ES-Yamaguchi 13 (2)3.9 (0.5)1.7 (0.1)1.6 (0.1)1.5 (0.1)1.3 (0.1)1.2 (0.0)15/15
KL-Restart-CMA-ES-Yamaguchi 15 (2)4.8 (0.3)2.3 (0.1)2.3 (0.2)2.2 (0.1)2.2 (0.1)2.2 (0.1)15/15
Ord-H-DTS-CMA-ES-Pitra 10020/15
Ord-N-DTS-CMA-ES-Pitra 10020/14
Ord-Q-DTS-CMA-ES-Pitra 10020/15
SSEABC-Aydin 13 (1)3.9 (0.3)1.7 (0.1)1.6 (0.1)1.5 (0.1)1.3 (0.0)1.2 (0.0)15/15

Δ fopt
f12, 10-D
1e1
515
1e0
896
1e-1
1240
1e-2
1390
1e-3
1569
1e-5
3660
1e-7
5154
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 1e80/15
CMAES-APOP-Nguyen 3.1 (2)4.1 (4)4.8 (3)5.2 (3)5.4 (3)3.0 (1)2.4 (1)15/15
DTS-CMA-ES-Pitra 1.2 (0.7)★21.1 (0.7)1.2 (0.6)1.3 (0.6)1.4 (0.5)0.80 (0.2)0.67 (0.2)15/15
EvoSpace-PSO-GA-Garcia-Valdez 243 (11)584 (551)1e50/15
KL-BIPOP-CMA-ES-Yamaguchi 3.0 (2)4.4 (3)4.7 (3)5.2 (3)5.4 (2)3.0 (1)2.4 (0.5)15/15
KL-IPOP-CMA-ES-Yamaguchi 5.1 (4)6.2 (4)6.3 (3)6.4 (3)6.4 (2)3.3 (2)2.7 (1)15/15
KL-Restart-CMA-ES-Yamaguchi 13 (2)10 (7)10 (4)11 (2)12 (5)6.8 (3)5.7 (1)15/15
Ord-H-DTS-CMA-ES-Pitra 10020/15
Ord-N-DTS-CMA-ES-Pitra 10020/15
Ord-Q-DTS-CMA-ES-Pitra 10 (5)8.4 (13)10020/15
SSEABC-Aydin 3.4 (2)4.3 (3)5.0 (6)5.4 (5)6.6 (5)7.9 (10)10 (15)10/15

Δ fopt
f13, 10-D
1e1
387
1e0
596
1e-1
797
1e-2
1014
1e-3
4587
1e-5
6208
1e-7
7779
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 1e80/15
CMAES-APOP-Nguyen 3.5 (3)5.2 (3)6.0 (9)6.5 (0.9)1.7 (2)2.2 (2)2.9 (2)15/15
DTS-CMA-ES-Pitra 1.0 (0.6)★33.9 (9)3.6 (6)2.9 (8)0.68 (0.6)0.72 (0.5)0.62 (1)13/15
EvoSpace-PSO-GA-Garcia-Valdez 166 (175)338 (314)1046 (628)1e50/15
KL-BIPOP-CMA-ES-Yamaguchi 2.4 (0.3)5.0 (3)4.8 (4)6.0 (2)1.5 (0.6)1.9 (1)94 (322)13/15
KL-IPOP-CMA-ES-Yamaguchi 2.8 (1)5.0 (2)5.4 (2)5.3 (6)1.5 (0.8)1.8 (0.7)200 (965)11/15
KL-Restart-CMA-ES-Yamaguchi 9.4 (0.6)8.8 (0.2)8.6 (0.6)8.4 (0.3)2.2 (0.1)2.2 (0.1)2.1 (0.1)15/15
Ord-H-DTS-CMA-ES-Pitra 9.3 (8)10020/15
Ord-N-DTS-CMA-ES-Pitra 10020/10
Ord-Q-DTS-CMA-ES-Pitra 5.8 (3)10020/15
SSEABC-Aydin 3.1 (0.9)4.8 (3)5.7 (2)6.8 (2)1.6 (0.6)2.6 (3)7.9 (6)5/15

Δ fopt
f14, 10-D
1e1
37
1e0
98
1e-1
133
1e-2
205
1e-3
392
1e-5
687
1e-7
4305
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 14 (7)2.7e5 (2e5)1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 8.6 (8)2.9e5 (2e5)1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 14 (10)1.1e6 (7e5)1e80/15
CMAES-APOP-Nguyen 1.1 (0.5)2.3 (0.7)3.2 (0.7)3.7 (0.4)3.5 (0.3)5.0 (0.4)1.3 (0.1)15/15
DTS-CMA-ES-Pitra 2.2 (0.8)1.7 (0.4)1.8 (0.3)★31.8 (0.4)★31.5 (0.3)★31.6 (0.3)0.36 (0.0)15/15
EvoSpace-PSO-GA-Garcia-Valdez 11 (0.3)22 (4)34 (13)182 (59)254 (83)7e50/15
KL-BIPOP-CMA-ES-Yamaguchi 1.9 (1.0)3.0 (0.6)3.7 (0.4)4.1 (0.5)4.0 (1)4.9 (0.4)1.3 (0.1)15/15
KL-IPOP-CMA-ES-Yamaguchi 1.9 (2)2.9 (0.5)3.8 (0.5)4.1 (0.4)3.9 (0.6)5.2 (0.6)1.4 (0.2)15/15
KL-Restart-CMA-ES-Yamaguchi 10 (8)17 (4)20 (2)19 (2)13 (1)11 (0.7)2.3 (0.1)15/15
Ord-H-DTS-CMA-ES-Pitra 2.2 (0.3)4.2 (2)11 (10)72 (90)10020/15
Ord-N-DTS-CMA-ES-Pitra 2.5 (0.3)4.0 (1)11 (4)10020/10
Ord-Q-DTS-CMA-ES-Pitra 2.5 (0.7)3.1 (2)7.2 (6)24 (32)10020/15
SSEABC-Aydin 3.4 (2)3.4 (0.6)4.0 (0.5)4.4 (0.8)3.9 (0.5)5.4 (0.5)1.5 (0.1)15/15

Δ fopt
f15, 10-D
1e1
4774
1e0
39246
1e-1
73643
1e-2
74669
1e-3
75790
1e-5
77814
1e-7
79834
#succ
12/15
RANDOMSEARCH-4-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 1e80/15
CMAES-APOP-Nguyen 3.3 (2)0.72 (0.2)0.50 (0.1)0.51 (0.4)0.52 (0.2)0.53 (0.1)0.53 (0.4)15/15
DTS-CMA-ES-Pitra 2.1 (3)1e40/15
EvoSpace-PSO-GA-Garcia-Valdez 318 (457)1e50/15
KL-BIPOP-CMA-ES-Yamaguchi 0.96 (1)1.7 (0.9)1.3 (0.4)1.3 (0.5)1.3 (0.4)1.3 (0.5)1.3 (0.6)15/15
KL-IPOP-CMA-ES-Yamaguchi 1.1 (1)0.95 (0.6)0.70 (0.3)0.71 (0.3)0.71 (0.3)0.72 (0.1)0.73 (0.3)15/15
KL-Restart-CMA-ES-Yamaguchi 1.5 (0.3)0.59 (0.4)0.66 (0.6)0.66 (0.7)0.66 (0.6)0.66 (0.6)0.66 (0.8)15/15
Ord-H-DTS-CMA-ES-Pitra 10020/15
Ord-N-DTS-CMA-ES-Pitra 10020/14
Ord-Q-DTS-CMA-ES-Pitra 3.1 (5)10020/15
SSEABC-Aydin 1.00 (0.7)12 (11)1e50/15

Δ fopt
f16, 10-D
1e1
425
1e0
7029
1e-1
15779
1e-2
45669
1e-3
51151
1e-5
65798
1e-7
71570
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 46 (36)1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 76 (72)1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 71 (29)1e80/15
CMAES-APOP-Nguyen 2.9 (2)28 (28)16 (16)5.9 (6)5.3 (5)4.2 (5)3.9 (4)15/15
DTS-CMA-ES-Pitra 3.3 (4)6.3 (4)9.1 (15)3.2 (2)1e40/15
EvoSpace-PSO-GA-Garcia-Valdez 11 (10)22 (16)136 (130)1e50/15
KL-BIPOP-CMA-ES-Yamaguchi 2.6 (0.8)1.2 (1)1.9 (0.8)1.0 (0.3)1.2 (2)1.0 (1)0.99 (1)15/15
KL-IPOP-CMA-ES-Yamaguchi 2.7 (2)0.88 (0.8)1.00 (0.4)1.1 (1)1.0 (0.9)0.90 (0.8)0.86 (0.7)15/15
KL-Restart-CMA-ES-Yamaguchi 15 (10)1.3 (0.4)0.99 (2)0.46 (0.3)0.61 (0.8)0.52 (0.4)0.50 (0.4)15/15
Ord-H-DTS-CMA-ES-Pitra 10030/15
Ord-N-DTS-CMA-ES-Pitra 15 (21)10020/14
Ord-Q-DTS-CMA-ES-Pitra 16 (31)10030/15
SSEABC-Aydin 2.3 (0.7)0.92 (2)2.1 (4)2.9 (2)6.2 (8)10 (18)20 (31)1/15

Δ fopt
f17, 10-D
1e1
26
1e0
429
1e-1
2203
1e-2
6329
1e-3
9851
1e-5
20190
1e-7
26503
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 2.0 (0.9)1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 3.0 (3)3.4e6 (5e6)1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 6.1 (11)1e80/15
CMAES-APOP-Nguyen 0.86 (1.0)0.86 (0.4)0.85 (0.1)1.7 (2)2.0 (1)1.4 (0.3)1.2 (0.2)15/15
DTS-CMA-ES-Pitra 2.2 (1)0.87 (0.2)1.2 (2)1.2 (0.6)1.5 (1)1e40/15
EvoSpace-PSO-GA-Garcia-Valdez 13 (4)49 (45)91 (39)86 (84)1e50/15
KL-BIPOP-CMA-ES-Yamaguchi 2.4 (2)1.1 (0.2)0.59 (0.1)0.74 (0.6)56 (0.9)444 (502)646 (1417)6/15
KL-IPOP-CMA-ES-Yamaguchi 2.3 (2)1.1 (0.3)0.96 (0.8)0.89 (0.7)0.79 (0.6)1363 (1734)1510 (1038)3/15
KL-Restart-CMA-ES-Yamaguchi 7.9 (16)5.2 (1)2.0 (0.1)1.0 (0.1)0.87 (0.1)0.66 (0.0)0.66 (0.0)15/15
Ord-H-DTS-CMA-ES-Pitra 2.1 (1)17 (32)10020/15
Ord-N-DTS-CMA-ES-Pitra 2.2 (1)10 (17)10020/14
Ord-Q-DTS-CMA-ES-Pitra 2.0 (0.8)4.8 (6)10010/15
SSEABC-Aydin 2.5 (2)1.3 (0.6)0.73 (1)1.5 (1)7.2 (3)74 (58)1e50/15

Δ fopt
f18, 10-D
1e1
238
1e0
836
1e-1
7012
1e-2
15928
1e-3
27536
1e-5
37234
1e-7
42708
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1123 (962)1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1770 (1807)1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 5253 (3420)1e80/15
CMAES-APOP-Nguyen 0.89 (0.3)2.1 (4)1.6 (1)1.4 (0.1)0.93 (0.1)0.89 (0.1)0.91 (0.3)15/15
DTS-CMA-ES-Pitra 0.68 (0.2)2.0 (2)1.4 (0.7)9.4 (5)1e40/15
EvoSpace-PSO-GA-Garcia-Valdez 5.4 (1)133 (111)285 (161)1e50/15
KL-BIPOP-CMA-ES-Yamaguchi 0.93 (0.4)1.4 (4)0.77 (1)1.9 (0.7)19 (0.8)30 (61)27 (43)15/15
KL-IPOP-CMA-ES-Yamaguchi 1.3 (0.3)3.0 (4)0.64 (0.5)46 (157)92 (182)68 (67)118 (117)10/15
KL-Restart-CMA-ES-Yamaguchi 5.7 (2)4.2 (0.4)0.81 (0.1)0.50 (0.0)0.37 (0.0)0.41 (0.0)17 (0.0)14/15
Ord-H-DTS-CMA-ES-Pitra 2.7 (1)10020/15
Ord-N-DTS-CMA-ES-Pitra 3.0 (4)10020/14
Ord-Q-DTS-CMA-ES-Pitra 1.6 (3)8.9 (7)10020/15
SSEABC-Aydin 1.5 (0.6)1.2 (0.2)1.3 (1)3.8 (4)53 (32)39 (26)35 (44)0/15

Δ fopt
f19, 10-D
1e1
1
1e0
1
1e-1
10609
1e-2
9.8e5
1e-3
1.4e6
1e-5
1.4e6
1e-7
1.4e6
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 89 (94)1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 396 (379)1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 837 (1414)1e80/15
CMAES-APOP-Nguyen 1 (0)★41 (0)★410 (1.0)0.22 (0.1)0.20 (0.1)0.21 (0.2)0.21 (0.3)15/15
DTS-CMA-ES-Pitra 77 (7)8832 (8848)1e40/15
EvoSpace-PSO-GA-Garcia-Valdez 398 (105)2.4e5 (1e5)2e50/15
KL-BIPOP-CMA-ES-Yamaguchi 62 (38)9703 (6101)81 (87)2.5 (1)2.1 (2)2.1 (0.6)2.1 (0.9)15/15
KL-IPOP-CMA-ES-Yamaguchi 58 (33)4.6e4 (1e5)34 (34)1.1 (0.4)0.84 (0.7)0.84 (0.3)0.84 (0.1)15/15
KL-Restart-CMA-ES-Yamaguchi 274 (110)1.3e4 (6489)7.7 (9)4.2 (4)14 (11)14 (16)14 (5)6/15
Ord-H-DTS-CMA-ES-Pitra 67 (27)10030/15
Ord-N-DTS-CMA-ES-Pitra 60 (31)10020/15
Ord-Q-DTS-CMA-ES-Pitra 74 (44)10020/15
SSEABC-Aydin 180 (42)2.3e4 (3e4)31 (75)0.70 (0.6)1.0 (1)1.0 (0.6)1.0 (1.0)1/15

Δ fopt
f20, 10-D
1e1
32
1e0
15426
1e-1
5.5e5
1e-2
5.7e5
1e-3
5.7e5
1e-5
5.8e5
1e-7
5.9e5
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 786 (800)1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1800 (2402)1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 8415 (7186)1e80/15
CMAES-APOP-Nguyen 3.2 (2)5.2 (2)0.46 (0.5)0.47 (0.2)0.48 (0.2)0.48 (0.3)0.48 (0.4)15/15
DTS-CMA-ES-Pitra 2.7 (0.4)1e40/15
EvoSpace-PSO-GA-Garcia-Valdez 30 (10)1.6 (2)5.3 (8)5.1 (2)5.2 (4)5.1 (3)5.2 (3)1/15
KL-BIPOP-CMA-ES-Yamaguchi 4.8 (2)3.3 (2)1.2 (0.6)1.2 (0.8)1.2 (0.6)1.2 (0.6)1.2 (0.6)15/15
KL-IPOP-CMA-ES-Yamaguchi 5.0 (2)2.1 (1)1.0 (0.5)1.1 (0.4)1.1 (0.5)1.1 (0.4)1.1 (0.4)15/15
KL-Restart-CMA-ES-Yamaguchi 27 (10)2.6 (3)60 (66)58 (60)57 (72)56 (43)56 (64)4/15
Ord-H-DTS-CMA-ES-Pitra 4.4 (1)10020/15
Ord-N-DTS-CMA-ES-Pitra 4.2 (2)10020/15
Ord-Q-DTS-CMA-ES-Pitra 4.0 (2)10020/15
SSEABC-Aydin 8.4 (1.0)12 (11)1e50/15

Δ fopt
f21, 10-D
1e1
130
1e0
2236
1e-1
4392
1e-2
4487
1e-3
4618
1e-5
5074
1e-7
11329
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 242 (76)1.1e4 (1e4)1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 450 (493)3.2e4 (6e4)1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 942 (905)3.2e4 (2e4)1e80/15
CMAES-APOP-Nguyen 3.4 (8)160 (449)112 (108)110 (125)107 (121)98 (164)44 (44)11/15
DTS-CMA-ES-Pitra 4.5 (0.2)9.1 (8)15 (20)15 (14)14 (19)13 (16)5.8 (6)2/15
EvoSpace-PSO-GA-Garcia-Valdez 11 (4)24 (58)19 (24)21 (38)24 (18)26 (26)15 (10)9/15
KL-BIPOP-CMA-ES-Yamaguchi 4.5 (7)12 (29)18 (32)17 (23)17 (20)15 (14)7.0 (8)15/15
KL-IPOP-CMA-ES-Yamaguchi 6.3 (10)36 (111)149 (102)147 (141)143 (417)131 (380)59 (157)15/15
KL-Restart-CMA-ES-Yamaguchi 16 (5)11 (15)16 (39)15 (26)15 (29)14 (33)6.3 (7)15/15
Ord-H-DTS-CMA-ES-Pitra 3.2 (5)3.2 (2)3.3 (4)3.2 (4)3.2 (3)10020/15
Ord-N-DTS-CMA-ES-Pitra 3.1 (10)10020/13
Ord-Q-DTS-CMA-ES-Pitra 6.4 (10)6.5 (6)3.4 (6)10020/15
SSEABC-Aydin 7.9 (15)13 (7)17 (20)16 (22)16 (22)15 (29)7.7 (6)10/15

Δ fopt
f22, 10-D
1e1
98
1e0
2839
1e-1
6353
1e-2
6620
1e-3
6798
1e-5
8296
1e-7
10351
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1105 (920)8669 (1e4)1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1331 (1419)2.3e4 (1e4)1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2473 (3084)3.5e4 (4e4)1e80/15
CMAES-APOP-Nguyen 34 (20)456 (733)2254 (2283)2163 (2568)2107 (1839)1727 (3014)1384 (1763)1/15
DTS-CMA-ES-Pitra 118 (204)49 (33)22 (29)21 (40)21 (19)17 (12)14 (40)1/15
EvoSpace-PSO-GA-Garcia-Valdez 23 (6)29 (17)55 (71)56 (69)60 (36)61 (51)59 (78)4/15
KL-BIPOP-CMA-ES-Yamaguchi 16 (15)11 (11)14 (10)13 (12)13 (13)11 (13)8.8 (10)15/15
KL-IPOP-CMA-ES-Yamaguchi 18 (33)164 (299)158 (158)152 (150)148 (161)122 (116)99 (97)15/15
KL-Restart-CMA-ES-Yamaguchi 39 (61)184 (82)333 (426)319 (204)311 (444)255 (264)204 (486)14/15
Ord-H-DTS-CMA-ES-Pitra 15 (11)2.5 (3)10020/15
Ord-N-DTS-CMA-ES-Pitra 10 (8)4.7 (5)10020/14
Ord-Q-DTS-CMA-ES-Pitra 7.5 (5)5.1 (5)10020/15
SSEABC-Aydin 26 (39)35 (57)1e50/15

Δ fopt
f23, 10-D
1e1
3.0
1e0
915
1e-1
16425
1e-2
1.8e5
1e-3
2.0e5
1e-5
2.1e5
1e-7
2.1e5
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 2.0 (3)545 (1136)1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2.8 (1)557 (1365)1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 1.8 (0.6)553 (377)1e80/15
CMAES-APOP-Nguyen 2.3 (2)176 (113)1e60/15
DTS-CMA-ES-Pitra 1.4 (1)162 (120)1e40/15
EvoSpace-PSO-GA-Garcia-Valdez 77 (64)49 (31)192 (213)2e50/15
KL-BIPOP-CMA-ES-Yamaguchi 1.5 (3)15 (21)11 (10)17 (32)17 (24)16 (17)16 (13)14/15
KL-IPOP-CMA-ES-Yamaguchi 3.1 (5)23 (34)9.4 (12)32 (35)29 (48)28 (51)28 (25)11/15
KL-Restart-CMA-ES-Yamaguchi 2.2 (2)78 (46)16 (15)6.2 (4)6.1 (5)6.0 (8)5.9 (5)15/15
Ord-H-DTS-CMA-ES-Pitra 1.8 (2)10030/15
Ord-N-DTS-CMA-ES-Pitra 1.4 (1)10020/15
Ord-Q-DTS-CMA-ES-Pitra 2.4 (6)10030/15
SSEABC-Aydin 1.5 (2)39 (70)27 (56)1e50/15

Δ fopt
f24, 10-D
1e1
98761
1e0
1.0e6
1e-1
7.5e7
1e-2
7.5e7
1e-3
7.5e7
1e-5
7.5e7
1e-7
7.5e7
#succ
1/15
RANDOMSEARCH-4-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 1e80/15
CMAES-APOP-Nguyen 151 (142)1e60/15
DTS-CMA-ES-Pitra 1e40/15
EvoSpace-PSO-GA-Garcia-Valdez 1e50/15
KL-BIPOP-CMA-ES-Yamaguchi 3.9 (18)13 (11)0.94 (0.8)0.94 (1)0.94 (1.0)0.94 (1)0.94 (0.7)2/15
KL-IPOP-CMA-ES-Yamaguchi 203 (278)135 (160)1e70/15
KL-Restart-CMA-ES-Yamaguchi 15 (11)6.6 (3)1e70/15
Ord-H-DTS-CMA-ES-Pitra 10020/15
Ord-N-DTS-CMA-ES-Pitra 10020/14
Ord-Q-DTS-CMA-ES-Pitra 10020/15
SSEABC-Aydin 1e50/15

Previous dimension | Dimension = 20 | Next dimension

Δ fopt
f1, 20-D
1e1
43
1e0
43
1e-1
43
1e-2
43
1e-3
43
1e-5
43
1e-7
43
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2e80/15
CMAES-APOP-Nguyen 6.3 (0.9)12 (1)18 (2)24 (3)31 (2)43 (2)56 (2)15/15
DTS-CMA-ES-Pitra 4.5 (0.4)★37.1 (0.9)★410 (0.7)★413 (0.6)15 (0.8)21 (0.8)27 (0.7)15/15
EvoSpace-PSO-GA-Garcia-Valdez 46 (11)105 (17)189 (21)950 (136)1972 (565)5040 (832)8034 (664)15/15
KL-BIPOP-CMA-ES-Yamaguchi 8.0 (1)14 (2)20 (1)26 (3)32 (4)46 (4)58 (4)15/15
KL-IPOP-CMA-ES-Yamaguchi 7.2 (0.8)14 (1)20 (2)27 (2)33 (2)46 (3)59 (2)15/15
KL-Restart-CMA-ES-Yamaguchi 75 (11)121 (5)165 (15)210 (13)249 (9)338 (20)427 (25)15/15
Ord-H-DTS-CMA-ES-Pitra 6.9 (2)86 (91)5020/15
Ord-N-DTS-CMA-ES-Pitra 6.5 (1)43 (21)5020/15
Ord-Q-DTS-CMA-ES-Pitra 8.6 (2)15 (2)21 (1)264 (370)10100/45
SSEABC-Aydin 9.4 (0.9)16 (1)22 (2)28 (2)34 (3)48 (2)61 (1)15/15

Δ fopt
f2, 20-D
1e1
385
1e0
386
1e-1
387
1e-2
388
1e-3
390
1e-5
391
1e-7
393
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2e80/15
CMAES-APOP-Nguyen 33 (3)39 (4)43 (3)45 (2)46 (2)47 (2)49 (2)15/15
DTS-CMA-ES-Pitra 14 (2)17 (1.0)19 (2)20 (1)20 (1)21 (2)21 (1.0)15/15
EvoSpace-PSO-GA-Garcia-Valdez 278 (53)439 (76)622 (90)805 (74)971 (61)1343 (49)1709 (110)15/15
KL-BIPOP-CMA-ES-Yamaguchi 35 (3)41 (3)43 (4)45 (2)46 (2)48 (1)49 (2)15/15
KL-IPOP-CMA-ES-Yamaguchi 36 (4)42 (4)44 (2)46 (2)46 (2)48 (2)49 (2)15/15
KL-Restart-CMA-ES-Yamaguchi 51 (5)58 (5)64 (2)69 (3)74 (3)83 (3)93 (3)15/15
Ord-H-DTS-CMA-ES-Pitra 5020/15
Ord-N-DTS-CMA-ES-Pitra 5020/15
Ord-Q-DTS-CMA-ES-Pitra 10100/45
SSEABC-Aydin 37 (5)44 (7)52 (16)101 (99)242 (320)1031 (1183)2e50/15

Δ fopt
f3, 20-D
1e1
5066
1e0
7626
1e-1
7635
1e-2
7637
1e-3
7643
1e-5
7646
1e-7
7651
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2e80/15
CMAES-APOP-Nguyen 24 (16)2e60/15
DTS-CMA-ES-Pitra 2e40/15
EvoSpace-PSO-GA-Garcia-Valdez 9.1 (8)17 (7)30 (7)40 (5)50 (6)69 (8)88 (9)15/15
KL-BIPOP-CMA-ES-Yamaguchi 17 (11)2e70/15
KL-IPOP-CMA-ES-Yamaguchi 13 (3)2e70/15
KL-Restart-CMA-ES-Yamaguchi 7.5 (2)1.1e4 (5105)2e70/15
Ord-H-DTS-CMA-ES-Pitra 5020/15
Ord-N-DTS-CMA-ES-Pitra 5020/15
Ord-Q-DTS-CMA-ES-Pitra 10100/45
SSEABC-Aydin 28 (18)2e50/15

Δ fopt
f4, 20-D
1e1
4722
1e0
7628
1e-1
7666
1e-2
7686
1e-3
7700
1e-5
7758
1e-7
1.4e5
#succ
9/15
RANDOMSEARCH-4-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2e80/15
CMAES-APOP-Nguyen 2e60/15
DTS-CMA-ES-Pitra 2e40/15
EvoSpace-PSO-GA-Garcia-Valdez 8.5 (2)20 (6)34 (8)49 (7)63 (6)90 (9)6.4 (0.4)15/15
KL-BIPOP-CMA-ES-Yamaguchi 2.0e4 (1e4)2e70/15
KL-IPOP-CMA-ES-Yamaguchi 2e70/15
KL-Restart-CMA-ES-Yamaguchi 5352 (8001)2e70/15
Ord-H-DTS-CMA-ES-Pitra 5020/15
Ord-N-DTS-CMA-ES-Pitra 5020/15
Ord-Q-DTS-CMA-ES-Pitra 10100/45
SSEABC-Aydin 2e50/15

Δ fopt
f5, 20-D
1e1
41
1e0
41
1e-1
41
1e-2
41
1e-3
41
1e-5
41
1e-7
41
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2e80/15
CMAES-APOP-Nguyen 5.1 (0.6)6.3 (1)6.6 (0.9)6.6 (1)6.6 (1)6.6 (0.8)6.6 (1)15/15
DTS-CMA-ES-Pitra 6.1 (0.9)8.2 (1)9.4 (1)10 (2)10 (1)10 (0.8)10 (2)15/15
EvoSpace-PSO-GA-Garcia-Valdez 134 (32)284 (177)326 (178)329 (248)329 (253)329 (122)329 (195)15/15
KL-BIPOP-CMA-ES-Yamaguchi 5.7 (1)6.6 (2)6.8 (1)6.9 (1)6.9 (2)6.9 (1)6.9 (0.7)15/15
KL-IPOP-CMA-ES-Yamaguchi 5.4 (1)6.3 (0.6)6.4 (0.8)6.4 (0.7)6.4 (1)6.4 (0.9)6.4 (0.7)15/15
KL-Restart-CMA-ES-Yamaguchi 31 (5)34 (6)34 (6)34 (4)34 (5)34 (5)34 (4)15/15
Ord-H-DTS-CMA-ES-Pitra 5010/15
Ord-N-DTS-CMA-ES-Pitra 89 (43)5010/15
Ord-Q-DTS-CMA-ES-Pitra 17 (9)70 (55)155 (160)218 (475)218 (148)218 (229)218 (210)5/45
SSEABC-Aydin 25 (10)74 (33)107 (65)145 (51)190 (131)245 (194)282 (112)15/15

Δ fopt
f6, 20-D
1e1
1296
1e0
2343
1e-1
3413
1e-2
4255
1e-3
5220
1e-5
6728
1e-7
8409
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2e80/15
CMAES-APOP-Nguyen 1.6 (0.2)1.3 (0.1)1.1 (0.2)1.1 (0.2)1.1 (0.2)1.1 (0.1)1.1 (0.1)15/15
DTS-CMA-ES-Pitra 68 (46)2e40/15
EvoSpace-PSO-GA-Garcia-Valdez 39 (20)118 (71)180 (59)225 (54)244 (59)776 (801)2e60/15
KL-BIPOP-CMA-ES-Yamaguchi 1.6 (0.3)1.2 (0.1)1.1 (0.1)1.1 (0.2)1.1 (0.1)1.2 (0.2)1.2 (0.2)15/15
KL-IPOP-CMA-ES-Yamaguchi 1.7 (0.3)1.3 (0.2)1.2 (0.2)1.2 (0.2)1.1 (0.2)1.2 (0.1)1.2 (0.1)15/15
KL-Restart-CMA-ES-Yamaguchi 28 (6)18 (4)14 (2)12 (2)11 (2)10 (0.8)10 (0.5)15/15
Ord-H-DTS-CMA-ES-Pitra 5020/15
Ord-N-DTS-CMA-ES-Pitra 5010/15
Ord-Q-DTS-CMA-ES-Pitra 10100/45
SSEABC-Aydin 1.3 (0.2)1.2 (0.2)1.1 (0.1)1.1 (0.1)1.1 (0.1)1.1 (0.1)1.1 (0.1)15/15

Δ fopt
f7, 20-D
1e1
1351
1e0
4274
1e-1
9503
1e-2
16523
1e-3
16524
1e-5
16524
1e-7
16969
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2e80/15
CMAES-APOP-Nguyen 1.4 (3)4.9 (0.1)2.4 (0.1)1.6 (0.1)1.6 (0.1)1.6 (0.1)1.5 (0.1)15/15
DTS-CMA-ES-Pitra 1.3 (0.7)1.6 (0.7)1.1 (0.4)0.80 (0.8)0.93 (1.0)0.93 (1)1.1 (2)9/15
EvoSpace-PSO-GA-Garcia-Valdez 189 (45)3480 (1989)1e60/15
KL-BIPOP-CMA-ES-Yamaguchi 1.5 (1)5.8 (4)4.5 (3)2.7 (2)2.7 (0.5)2.7 (2)2.6 (0.4)15/15
KL-IPOP-CMA-ES-Yamaguchi 1.8 (1)4.1 (1)2.6 (1)1.6 (0.9)1.6 (0.7)1.6 (0.4)1.6 (0.6)15/15
KL-Restart-CMA-ES-Yamaguchi 4.2 (0.3)2.0 (0.2)1.2 (0.1)0.81 (0.1)0.81 (0.1)0.81 (0.1)0.79 (0.0)15/15
Ord-H-DTS-CMA-ES-Pitra 5010/15
Ord-N-DTS-CMA-ES-Pitra 5020/15
Ord-Q-DTS-CMA-ES-Pitra 3.7 (3)10100/45
SSEABC-Aydin 0.94 (0.3)5.0 (3)3.4 (0.7)2.1 (0.1)2.1 (0.1)2.1 (0.3)2.1 (0.3)15/15

Δ fopt
f8, 20-D
1e1
2039
1e0
3871
1e-1
4040
1e-2
4148
1e-3
4219
1e-5
4371
1e-7
4484
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2e80/15
CMAES-APOP-Nguyen 3.6 (0.6)6.5 (0.8)7.0 (11)7.1 (11)7.2 (11)7.2 (0.2)7.3 (0.3)15/15
DTS-CMA-ES-Pitra 2.0 (0.5)2.1 (2)2.2 (0.5)2.3 (1)2.3 (0.7)2.3 (0.5)2.3 (0.6)14/15
EvoSpace-PSO-GA-Garcia-Valdez 379 (187)2559 (2680)2592 (2558)5428 (4284)2e60/15
KL-BIPOP-CMA-ES-Yamaguchi 3.9 (0.9)4.9 (4)5.2 (3)5.3 (2)5.4 (2)5.4 (3)5.4 (0.5)15/15
KL-IPOP-CMA-ES-Yamaguchi 3.7 (1)4.0 (0.4)4.3 (0.2)4.4 (0.4)4.5 (0.4)4.5 (0.6)4.6 (0.6)15/15
KL-Restart-CMA-ES-Yamaguchi 15 (0.8)14 (0.5)15 (0.5)15 (0.4)16 (0.3)16 (0.4)16 (0.3)15/15
Ord-H-DTS-CMA-ES-Pitra 5010/15
Ord-N-DTS-CMA-ES-Pitra 5010/15
Ord-Q-DTS-CMA-ES-Pitra 10100/45
SSEABC-Aydin 4.1 (0.3)5.7 (7)5.9 (4)8.4 (12)12 (27)34 (26)68 (111)7/15

Δ fopt
f9, 20-D
1e1
1716
1e0
3102
1e-1
3277
1e-2
3379
1e-3
3455
1e-5
3594
1e-7
3727
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2e80/15
CMAES-APOP-Nguyen 4.0 (1.0)4.6 (0.8)5.0 (1.0)5.1 (0.4)5.2 (0.4)5.2 (0.9)5.2 (0.4)15/15
DTS-CMA-ES-Pitra 2.3 (0.9)2.4 (0.4)2.6 (0.2)2.7 (0.4)2.7 (0.2)2.7 (0.3)2.7 (0.2)15/15
EvoSpace-PSO-GA-Garcia-Valdez 1e60/15
KL-BIPOP-CMA-ES-Yamaguchi 5.2 (2)5.9 (0.9)6.2 (2)6.3 (4)6.4 (1)6.4 (0.8)6.3 (0.2)15/15
KL-IPOP-CMA-ES-Yamaguchi 5.1 (0.9)7.3 (4)7.5 (2)7.6 (2)7.6 (4)7.6 (4)7.5 (4)15/15
KL-Restart-CMA-ES-Yamaguchi 18 (1)17 (0.7)18 (0.4)19 (0.4)19 (0.5)19 (0.3)20 (0.5)15/15
Ord-H-DTS-CMA-ES-Pitra 5010/15
Ord-N-DTS-CMA-ES-Pitra 5020/15
Ord-Q-DTS-CMA-ES-Pitra 10100/45
SSEABC-Aydin 4.6 (0.9)6.1 (0.6)6.5 (0.5)12 (4)17 (15)38 (73)70 (104)4/15

Δ fopt
f10, 20-D
1e1
7413
1e0
8661
1e-1
10735
1e-2
13641
1e-3
14920
1e-5
17073
1e-7
17476
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2e80/15
CMAES-APOP-Nguyen 1.8 (0.3)1.8 (0.1)1.6 (0.1)1.3 (0.1)1.2 (0.0)1.1 (0.0)1.1 (0.0)15/15
DTS-CMA-ES-Pitra 0.84 (0.1)0.82 (0.1)0.72 (0.1)0.59 (0.1)0.56 (0.1)0.50 (0.0)0.51 (0.0)15/15
EvoSpace-PSO-GA-Garcia-Valdez 1e60/15
KL-BIPOP-CMA-ES-Yamaguchi 1.8 (0.1)1.8 (0.1)1.6 (0.0)1.3 (0.1)1.2 (0.0)1.1 (0.0)1.1 (0.0)15/15
KL-IPOP-CMA-ES-Yamaguchi 1.8 (0.3)1.8 (0.2)1.6 (0.1)1.3 (0.1)1.2 (0.1)1.1 (0.1)1.1 (0.0)15/15
KL-Restart-CMA-ES-Yamaguchi 2.8 (0.4)2.7 (0.2)2.4 (0.2)2.0 (0.1)2.0 (0.1)2.0 (0.1)2.1 (0.1)15/15
Ord-H-DTS-CMA-ES-Pitra 5020/15
Ord-N-DTS-CMA-ES-Pitra 5010/15
Ord-Q-DTS-CMA-ES-Pitra 10100/45
SSEABC-Aydin 1.8 (0.3)1.9 (0.1)1.7 (0.1)1.7 (0.1)3.7 (7)13 (10)80 (83)0/15

Δ fopt
f11, 20-D
1e1
1002
1e0
2228
1e-1
6278
1e-2
8586
1e-3
9762
1e-5
12285
1e-7
14831
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2e80/15
CMAES-APOP-Nguyen 10 (1.0)5.0 (0.4)1.9 (0.1)1.5 (0.1)1.4 (0.0)1.2 (0.0)1.0 (0.0)15/15
DTS-CMA-ES-Pitra 3.3 (0.3)1.8 (0.2)0.73 (0.1)0.58 (0.1)0.55 (0.1)0.48 (0.0)0.43 (0.0)15/15
EvoSpace-PSO-GA-Garcia-Valdez 1320 (706)2e60/15
KL-BIPOP-CMA-ES-Yamaguchi 10 (0.5)5.2 (0.2)2.0 (0.1)1.5 (0.0)1.4 (0.0)1.2 (0.0)1.0 (0.0)15/15
KL-IPOP-CMA-ES-Yamaguchi 10 (0.8)5.1 (0.5)1.9 (0.1)1.5 (0.0)1.4 (0.0)1.2 (0.0)1.0 (0.0)15/15
KL-Restart-CMA-ES-Yamaguchi 13 (1)7.0 (0.4)2.8 (0.1)2.3 (0.1)2.2 (0.1)2.1 (0.1)2.0 (0.1)15/15
Ord-H-DTS-CMA-ES-Pitra 5020/15
Ord-N-DTS-CMA-ES-Pitra 5020/15
Ord-Q-DTS-CMA-ES-Pitra 10100/45
SSEABC-Aydin 10 (0.8)5.0 (0.3)1.9 (0.1)1.5 (0.0)1.4 (0.0)1.2 (0.0)1.0 (0.0)15/15

Δ fopt
f12, 20-D
1e1
1042
1e0
1938
1e-1
2740
1e-2
3156
1e-3
4140
1e-5
12407
1e-7
13827
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2e80/15
CMAES-APOP-Nguyen 2.6 (1)3.2 (3)4.5 (2)4.9 (3)4.4 (2)1.9 (0.5)2.0 (0.6)15/15
DTS-CMA-ES-Pitra 1.3 (0.1)1.4 (0.9)1.7 (1)1.8 (0.9)1.8 (0.9)0.83 (0.2)0.90 (0.2)15/15
EvoSpace-PSO-GA-Garcia-Valdez 271 (20)634 (265)1169 (746)4641 (3644)1e60/15
KL-BIPOP-CMA-ES-Yamaguchi 3.8 (5)4.0 (2)4.2 (2)4.7 (3)4.2 (2)1.8 (0.5)1.9 (0.7)15/15
KL-IPOP-CMA-ES-Yamaguchi 3.1 (3)3.9 (2)4.2 (2)4.5 (1)4.1 (3)1.8 (0.8)1.8 (0.9)15/15
KL-Restart-CMA-ES-Yamaguchi 18 (3)12 (4)10 (4)11 (4)11 (1)4.9 (0.7)5.3 (0.6)15/15
Ord-H-DTS-CMA-ES-Pitra 5020/15
Ord-N-DTS-CMA-ES-Pitra 5020/15
Ord-Q-DTS-CMA-ES-Pitra 10100/45
SSEABC-Aydin 2.6 (0.1)3.3 (3)3.9 (2)5.2 (9)6.0 (6)6.3 (10)19 (19)6/15

Δ fopt
f13, 20-D
1e1
652
1e0
2021
1e-1
2751
1e-2
3507
1e-3
18749
1e-5
24455
1e-7
30201
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2e80/15
CMAES-APOP-Nguyen 8.3 (11)8.0 (7)8.8 (5)8.8 (7)2.8 (2)3.4 (2)3.3 (1)15/15
DTS-CMA-ES-Pitra 2.0 (1)2.5 (2)2.8 (1)2.6 (2)0.59 (0.5)0.59 (0.7)0.69 (0.4)9/15
EvoSpace-PSO-GA-Garcia-Valdez 519 (827)1173 (1113)2543 (4289)2051 (1698)398 (427)1e60/15
KL-BIPOP-CMA-ES-Yamaguchi 3.9 (2)6.7 (4)6.3 (5)8.0 (11)2.6 (2)3.8 (7)105 (2)13/15
KL-IPOP-CMA-ES-Yamaguchi 3.9 (4)6.4 (4)7.6 (4)7.6 (5)1.7 (0.9)2.0 (1)50 (1.0)14/15
KL-Restart-CMA-ES-Yamaguchi 16 (1.0)7.2 (0.5)7.3 (0.9)7.8 (1)1.8 (0.2)1.7 (0.1)1.7 (0.1)13/15
Ord-H-DTS-CMA-ES-Pitra 5020/15
Ord-N-DTS-CMA-ES-Pitra 5020/15
Ord-Q-DTS-CMA-ES-Pitra 10100/45
SSEABC-Aydin 4.0 (0.1)5.6 (3)22 (29)31 (28)15 (9)2e50/15

Δ fopt
f14, 20-D
1e1
75
1e0
239
1e-1
304
1e-2
451
1e-3
932
1e-5
1648
1e-7
15661
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1.4e4 (2e4)2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2.4e4 (4e4)2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 8.2e4 (1e5)2e80/15
CMAES-APOP-Nguyen 2.6 (0.5)2.5 (0.5)3.2 (0.3)4.0 (0.5)4.0 (0.5)6.0 (0.7)1.2 (0.1)15/15
DTS-CMA-ES-Pitra 2.5 (0.4)1.5 (0.3)★41.8 (0.2)2.1 (0.4)1.9 (0.1)2.9 (0.2)0.56 (0.0)15/15
EvoSpace-PSO-GA-Garcia-Valdez 17 (4)25 (7)67 (35)338 (71)789 (131)1e60/15
KL-BIPOP-CMA-ES-Yamaguchi 3.4 (2)2.7 (0.5)3.5 (0.4)4.3 (0.4)4.1 (0.2)6.1 (0.7)1.2 (0.1)15/15
KL-IPOP-CMA-ES-Yamaguchi 4.3 (2)3.0 (0.6)3.7 (0.6)4.6 (0.7)4.3 (0.4)6.1 (0.4)1.3 (0.3)15/15
KL-Restart-CMA-ES-Yamaguchi 36 (5)23 (2)27 (2)25 (2)16 (1)14 (0.6)2.1 (0.0)15/15
Ord-H-DTS-CMA-ES-Pitra 3.5 (0.7)5020/15
Ord-N-DTS-CMA-ES-Pitra 4.2 (3)5020/15
Ord-Q-DTS-CMA-ES-Pitra 4.0 (2)2.9 (0.4)7.0 (2)10100/45
SSEABC-Aydin 5.2 (1)3.2 (0.3)4.0 (0.4)4.5 (0.5)4.3 (0.5)6.4 (0.5)3.8 (3)0/15

Δ fopt
f15, 20-D
1e1
30378
1e0
1.5e5
1e-1
3.1e5
1e-2
3.2e5
1e-3
3.2e5
1e-5
4.5e5
1e-7
4.6e5
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2e80/15
CMAES-APOP-Nguyen 2.8 (0.1)0.61 (0.0)0.29 (0.0)0.29 (0.0)0.29 (0.0)0.21 (0.0)0.21 (0.0)15/15
DTS-CMA-ES-Pitra 2e40/15
EvoSpace-PSO-GA-Garcia-Valdez 1e60/15
KL-BIPOP-CMA-ES-Yamaguchi 1.3 (0.8)2.0 (0.3)1.2 (0.3)1.2 (0.2)1.2 (0.3)0.86 (0.3)0.86 (0.3)15/15
KL-IPOP-CMA-ES-Yamaguchi 0.96 (0.6)0.95 (0.6)0.55 (0.4)0.56 (0.2)0.56 (0.3)0.42 (0.2)0.43 (0.2)15/15
KL-Restart-CMA-ES-Yamaguchi 0.67 (0.1)1.7 (2)3.2 (5)3.1 (1)3.1 (2)2.2 (6)2.2 (0.8)15/15
Ord-H-DTS-CMA-ES-Pitra 5020/15
Ord-N-DTS-CMA-ES-Pitra 5010/15
Ord-Q-DTS-CMA-ES-Pitra 10100/45
SSEABC-Aydin 0.61 (0.5)2e50/15

Δ fopt
f16, 20-D
1e1
1384
1e0
27265
1e-1
77015
1e-2
1.4e5
1e-3
1.9e5
1e-5
2.0e5
1e-7
2.2e5
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 3.3e4 (3e4)2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 7.4e4 (1e5)2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 4.6e4 (6e4)2e80/15
CMAES-APOP-Nguyen 22 (75)19 (20)8.1 (2)4.5 (4)3.4 (1)3.9 (1)3.5 (2)14/15
DTS-CMA-ES-Pitra 0.41 (0.1)1.8 (1)3.7 (3)2e40/15
EvoSpace-PSO-GA-Garcia-Valdez 10 (5)534 (908)1e60/15
KL-BIPOP-CMA-ES-Yamaguchi 2.4 (3)1.1 (0.9)1.2 (0.8)1.1 (0.6)1.4 (1)1.9 (1)1.7 (1)15/15
KL-IPOP-CMA-ES-Yamaguchi 2.4 (0.7)0.78 (0.3)0.97 (0.3)0.92 (0.7)1.0 (0.8)1.2 (0.6)1.2 (1)15/15
KL-Restart-CMA-ES-Yamaguchi 17 (8)1.1 (0.4)0.67 (0.4)0.79 (1)1.2 (0.6)1.2 (1)1.1 (1)15/15
Ord-H-DTS-CMA-ES-Pitra 5020/15
Ord-N-DTS-CMA-ES-Pitra 5020/15
Ord-Q-DTS-CMA-ES-Pitra 33 (39)10100/45
SSEABC-Aydin 1.3 (0.3)0.40 (0.9)4.9 (3)2e50/15

Δ fopt
f17, 20-D
1e1
63
1e0
1030
1e-1
4005
1e-2
12242
1e-3
30677
1e-5
56288
1e-7
80472
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 79 (60)2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 44 (67)2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 78 (197)2e80/15
CMAES-APOP-Nguyen 1.3 (1)0.84 (0.3)1.3 (0.1)2.5 (2)1.6 (0.2)1.2 (0.2)0.97 (0.1)15/15
DTS-CMA-ES-Pitra 2.0 (0.3)1.1 (2)2.0 (3)2.1 (3)4.9 (3)2e40/15
EvoSpace-PSO-GA-Garcia-Valdez 8.2 (2)4175 (1e4)1e60/15
KL-BIPOP-CMA-ES-Yamaguchi 2.0 (1)0.94 (0.4)0.72 (0.1)1.1 (1.0)55 (26)295 (313)518 (1491)5/15
KL-IPOP-CMA-ES-Yamaguchi 2.6 (1)0.91 (0.3)0.98 (2)0.97 (0.5)47 (163)238 (355)285 (249)5/15
KL-Restart-CMA-ES-Yamaguchi 20 (11)6.6 (0.9)2.9 (0.1)1.4 (0.1)0.73 (0.0)0.62 (0.0)0.55 (0.0)15/15
Ord-H-DTS-CMA-ES-Pitra 2.3 (0.8)5020/15
Ord-N-DTS-CMA-ES-Pitra 2.4 (2)5010/15
Ord-Q-DTS-CMA-ES-Pitra 2.1 (1)1.6 (1)10100/45
SSEABC-Aydin 3.1 (0.6)0.95 (0.2)1.3 (1)1.8 (2)16 (12)50 (103)2e50/15

Δ fopt
f18, 20-D
1e1
621
1e0
3972
1e-1
19561
1e-2
28555
1e-3
67569
1e-5
1.3e5
1e-7
1.5e5
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 4.6e6 (5e6)2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2e80/15
CMAES-APOP-Nguyen 0.88 (0.2)3.0 (5)1.8 (1)1.8 (0.1)0.85 (0.1)0.57 (0.1)0.62 (0.2)15/15
DTS-CMA-ES-Pitra 0.57 (0.2)★21.2 (1.0)1.8 (2)10 (18)2e40/15
EvoSpace-PSO-GA-Garcia-Valdez 46 (15)3675 (2140)1e60/15
KL-BIPOP-CMA-ES-Yamaguchi 1.0 (0.4)1.4 (2)0.98 (1)2.2 (0.6)1.8 (1.0)1.6 (0.6)1.6 (0.6)15/15
KL-IPOP-CMA-ES-Yamaguchi 1.0 (0.5)0.73 (2)1.0 (0.3)1.2 (0.5)0.87 (0.5)24 (38)22 (68)13/15
KL-Restart-CMA-ES-Yamaguchi 7.4 (1.0)2.5 (0.1)0.78 (0.1)0.74 (0.1)0.40 (0.0)5.2 (18)4.7 (16)15/15
Ord-H-DTS-CMA-ES-Pitra 12 (11)5020/15
Ord-N-DTS-CMA-ES-Pitra 12 (17)5020/15
Ord-Q-DTS-CMA-ES-Pitra 1.1 (0.2)10100/45
SSEABC-Aydin 1.1 (0.3)0.76 (2)1.1 (0.9)31 (53)20 (26)2e50/15

Δ fopt
f19, 20-D
1e1
1
1e0
1
1e-1
3.4e5
1e-2
4.7e6
1e-3
6.2e6
1e-5
6.7e6
1e-7
6.7e6
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1.1e4 (2e4)2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 7.1e4 (4e4)2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 3.5e5 (5e5)2e80/15
CMAES-APOP-Nguyen 1 (0)★41 (0)★40.91 (0.1)0.40 (0.3)0.50 (0.3)0.91 (0.7)0.91 (1)4/15
DTS-CMA-ES-Pitra 135 (22)4193 (5674)2e40/15
EvoSpace-PSO-GA-Garcia-Valdez 859 (122)1e60/15
KL-BIPOP-CMA-ES-Yamaguchi 167 (50)4.5e4 (2e4)7.6 (6)2.1 (0.7)3.6 (5)3.4 (6)3.4 (3)9/15
KL-IPOP-CMA-ES-Yamaguchi 188 (78)3.2e4 (3e4)3.1 (1)0.85 (0.5)0.68 (0.4)0.66 (0.4)0.66 (0.4)15/15
KL-Restart-CMA-ES-Yamaguchi 1767 (454)3.8e4 (7708)0.78 (0.1)62 (63)2e70/15
Ord-H-DTS-CMA-ES-Pitra 193 (68)5020/15
Ord-N-DTS-CMA-ES-Pitra 185 (65)5020/15
Ord-Q-DTS-CMA-ES-Pitra 215 (88)10100/45
SSEABC-Aydin 329 (60)4.7e4 (6e4)2e50/15

Δ fopt
f20, 20-D
1e1
82
1e0
46150
1e-1
3.1e6
1e-2
5.5e6
1e-3
5.5e6
1e-5
5.6e6
1e-7
5.6e6
#succ
14/15
RANDOMSEARCH-4-1e7D-Brockhoff 3.3e6 (3e6)2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2e80/15
CMAES-APOP-Nguyen 3.7 (0.4)12 (3)0.34 (0.2)0.46 (0.2)0.46 (0.8)0.46 (0.6)0.46 (0.7)9/15
DTS-CMA-ES-Pitra 2.8 (0.7)2e40/15
EvoSpace-PSO-GA-Garcia-Valdez 34 (11)1.3 (0.8)1e60/15
KL-BIPOP-CMA-ES-Yamaguchi 5.1 (1.0)9.0 (3)1.1 (0.4)3.7 (3)3.6 (2)3.6 (3)3.6 (4)10/15
KL-IPOP-CMA-ES-Yamaguchi 4.6 (0.8)4.6 (0.8)0.57 (0.1)0.73 (0.3)0.73 (0.4)0.73 (0.4)0.73 (0.3)15/15
KL-Restart-CMA-ES-Yamaguchi 36 (6)44 (37)2e70/15
Ord-H-DTS-CMA-ES-Pitra 4.9 (3)5020/15
Ord-N-DTS-CMA-ES-Pitra 4.2 (0.9)5020/15
Ord-Q-DTS-CMA-ES-Pitra 5.4 (1)10100/45
SSEABC-Aydin 6.9 (0.7)62 (73)2e50/15

Δ fopt
f21, 20-D
1e1
561
1e0
6541
1e-1
14103
1e-2
14318
1e-3
14643
1e-5
15567
1e-7
17589
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1.2e6 (2e6)2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2e80/15
CMAES-APOP-Nguyen 4.0 (13)229 (383)138 (180)136 (105)133 (76)125 (198)111 (285)8/15
DTS-CMA-ES-Pitra 18 (62)12 (12)20 (17)20 (26)19 (22)18 (16)16 (8)1/15
EvoSpace-PSO-GA-Garcia-Valdez 11 (14)83 (52)85 (194)85 (73)88 (106)92 (69)89 (127)7/15
KL-BIPOP-CMA-ES-Yamaguchi 3.8 (4)10 (10)12 (25)12 (25)11 (7)11 (23)10 (5)15/15
KL-IPOP-CMA-ES-Yamaguchi 5.7 (11)152 (313)157 (137)155 (211)151 (311)143 (258)127 (243)15/15
KL-Restart-CMA-ES-Yamaguchi 29 (48)351 (1168)165 (187)162 (53)159 (392)149 (443)132 (398)14/15
Ord-H-DTS-CMA-ES-Pitra 2.4 (2)5020/15
Ord-N-DTS-CMA-ES-Pitra 1.2 (0.9)5020/15
Ord-Q-DTS-CMA-ES-Pitra 2.2 (2)6.9 (7)10100/45
SSEABC-Aydin 4.6 (11)29 (49)203 (433)200 (220)195 (365)184 (164)163 (216)1/15

Δ fopt
f22, 20-D
1e1
467
1e0
5580
1e-1
23491
1e-2
24163
1e-3
24948
1e-5
26847
1e-7
1.3e5
#succ
12/15
RANDOMSEARCH-4-1e7D-Brockhoff 3.0e6 (2e6)2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2e80/15
CMAES-APOP-Nguyen 82 (73)2342 (4212)2e60/15
DTS-CMA-ES-Pitra 38 (96)23 (54)2e40/15
EvoSpace-PSO-GA-Garcia-Valdez 9.5 (8)126 (92)1e60/15
KL-BIPOP-CMA-ES-Yamaguchi 5.7 (4)12 (17)47 (90)45 (41)44 (58)41 (41)8.1 (12)15/15
KL-IPOP-CMA-ES-Yamaguchi 6.9 (14)763 (1410)1334 (3034)1297 (1082)1256 (1180)1168 (1218)233 (278)7/15
KL-Restart-CMA-ES-Yamaguchi 13 (27)1338 (3586)2e70/15
Ord-H-DTS-CMA-ES-Pitra 5.0 (4)5020/15
Ord-N-DTS-CMA-ES-Pitra 2.0 (2)5020/15
Ord-Q-DTS-CMA-ES-Pitra 4.8 (4)8.1 (6)10100/45
SSEABC-Aydin 70 (164)77 (105)2e50/15

Δ fopt
f23, 20-D
1e1
3.0
1e0
1614
1e-1
67457
1e-2
3.7e5
1e-3
4.9e5
1e-5
8.1e5
1e-7
8.4e5
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 3.3 (3)6.2e4 (9e4)2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2.0 (2)9.5e4 (5e4)2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2.0 (2)8.1e4 (7e4)2e80/15
CMAES-APOP-Nguyen 1.6 (1)279 (867)416 (668)2e60/15
DTS-CMA-ES-Pitra 2.1 (0.9)19 (37)3.9 (6)2e40/15
EvoSpace-PSO-GA-Garcia-Valdez 59 (65)72 (47)1e60/15
KL-BIPOP-CMA-ES-Yamaguchi 4.8 (9)21 (27)2.7 (4)21 (34)33 (34)22 (28)21 (24)10/15
KL-IPOP-CMA-ES-Yamaguchi 4.0 (8)22 (13)7.5 (19)27 (43)41 (93)25 (41)24 (22)9/15
KL-Restart-CMA-ES-Yamaguchi 5.1 (4)141 (33)6.2 (5)7.3 (7)19 (36)12 (12)11 (19)13/15
Ord-H-DTS-CMA-ES-Pitra 2.6 (2)5010/15
Ord-N-DTS-CMA-ES-Pitra 2.5 (3)5020/15
Ord-Q-DTS-CMA-ES-Pitra 2.2 (2)10100/45
SSEABC-Aydin 2.1 (1)31 (55)4.9 (6)2e50/15

Δ fopt
f24, 20-D
1e1
1.3e6
1e0
7.5e6
1e-1
5.2e7
1e-2
5.2e7
1e-3
5.2e7
1e-5
5.2e7
1e-7
5.2e7
#succ
3/15
RANDOMSEARCH-4-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 2e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2e80/15
CMAES-APOP-Nguyen 2e60/15
DTS-CMA-ES-Pitra 2e40/15
EvoSpace-PSO-GA-Garcia-Valdez 1e60/15
KL-BIPOP-CMA-ES-Yamaguchi 3.4 (11)2e70/15
KL-IPOP-CMA-ES-Yamaguchi 41 (41)20 (25)2e70/15
KL-Restart-CMA-ES-Yamaguchi 2.3 (3)2e70/15
Ord-H-DTS-CMA-ES-Pitra 5020/15
Ord-N-DTS-CMA-ES-Pitra 5010/15
Ord-Q-DTS-CMA-ES-Pitra 10100/45
SSEABC-Aydin 2e50/15

Previous dimension | Dimension = 40 | First dimension

Δ fopt
f1, 40-D
1e1
83
1e0
83
1e-1
83
1e-2
83
1e-3
83
1e-5
83
1e-7
83
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 4e80/15
CMAES-APOP-Nguyen 8.4 (1)★314 (1.0)★320 (1)★326 (0.9)★332 (1)★244 (1.0)★256 (1)★215/15
SSEABC-Aydin 10 (0.9)17 (1)23 (0.5)29 (0.3)34 (0.6)46 (2)58 (2)15/15

Δ fopt
f2, 40-D
1e1
796
1e0
797
1e-1
799
1e-2
799
1e-3
800
1e-5
802
1e-7
804
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 4e80/15
CMAES-APOP-Nguyen 59 (8)★469 (6)★476 (5)★481 (5)★484 (5)★488 (3)★490 (3)★415/15
SSEABC-Aydin 3630 (7098)4e50/15

Δ fopt
f3, 40-D
1e1
15526
1e0
15602
1e-1
15612
1e-2
15641
1e-3
15646
1e-5
15651
1e-7
15656
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 4e80/15
CMAES-APOP-Nguyen 4e60/15
SSEABC-Aydin 4e50/15

Δ fopt
f4, 40-D
1e1
15536
1e0
15601
1e-1
15659
1e-2
15678
1e-3
15703
1e-5
15733
1e-7
2.8e5
#succ
6/15
RANDOMSEARCH-4-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 4e80/15
CMAES-APOP-Nguyen 4e60/15
SSEABC-Aydin 4e50/15

Δ fopt
f5, 40-D
1e1
98
1e0
116
1e-1
120
1e-2
121
1e-3
121
1e-5
121
1e-7
121
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 4e80/15
CMAES-APOP-Nguyen 4.5 (0.4)★44.3 (0.3)★44.2 (0.4)★44.2 (0.4)★44.2 (0.3)★44.2 (0.3)★44.2 (0.3)★415/15
SSEABC-Aydin 26 (5)66 (17)113 (128)131 (120)158 (43)236 (330)266 (148)15/15

Δ fopt
f6, 40-D
1e1
3507
1e0
5523
1e-1
7168
1e-2
9470
1e-3
11538
1e-5
15007
1e-7
19222
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 4e80/15
CMAES-APOP-Nguyen 1.5 (0.2)1.4 (0.2)1.4 (0.2)1.3 (0.1)1.3 (0.1)1.4 (0.1)1.3 (0.0)15/15
SSEABC-Aydin 1.3 (0.1)1.3 (0.1)1.3 (0.1)1.2 (0.1)★21.2 (0.1)1.3 (0.1)1.2 (0.1)15/15

Δ fopt
f7, 40-D
1e1
10698
1e0
17839
1e-1
41037
1e-2
66294
1e-3
66294
1e-5
66294
1e-7
68145
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 4e80/15
CMAES-APOP-Nguyen 2.8 (2)2.8 (0.6)★31.4 (0.2)★30.98 (0.2)★30.98 (0.1)★30.98 (0.1)★30.96 (0.1)★315/15
SSEABC-Aydin 3.5 (1)17 (11)11 (7)7.2 (5)7.2 (7)7.2 (8)7.0 (8)9/15

Δ fopt
f8, 40-D
1e1
7080
1e0
10655
1e-1
11012
1e-2
11265
1e-3
11430
1e-5
11701
1e-7
11969
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 4e80/15
CMAES-APOP-Nguyen 7.4 (0.4)★443 (44)43 (92)43 (44)42 (43)42 (91)41 (85)15/15
SSEABC-Aydin 4e50/15

Δ fopt
f9, 40-D
1e1
6122
1e0
12982
1e-1
13300
1e-2
13496
1e-3
13651
1e-5
13909
1e-7
14142
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 4e80/15
CMAES-APOP-Nguyen 7.8 (0.9)★415 (0.3)★416 (40)★416 (40)★416 (0.2)★416 (78)★416 (39)★415/15
SSEABC-Aydin 4e50/15

Δ fopt
f10, 40-D
1e1
25536
1e0
29762
1e-1
35676
1e-2
51579
1e-3
56007
1e-5
65128
1e-7
70824
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 4e80/15
CMAES-APOP-Nguyen 1.8 (0.1)★41.9 (0.2)★41.7 (0.1)★41.3 (0.1)★41.2 (0.1)★41.1 (0.0)★41.0 (0.0)★415/15
SSEABC-Aydin 229 (443)4e50/15

Δ fopt
f11, 40-D
1e1
2368
1e0
4855
1e-1
11681
1e-2
25315
1e-3
29749
1e-5
38949
1e-7
48211
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 4e80/15
CMAES-APOP-Nguyen 14 (1)7.4 (0.4)3.2 (0.1)1.6 (0.0)1.4 (0.0)★21.1 (0.0)★40.95 (0.0)★415/15
SSEABC-Aydin 13 (0.5)★27.1 (0.2)3.2 (0.1)1.6 (0.8)94 (76)4e50/15

Δ fopt
f12, 40-D
1e1
4169
1e0
7452
1e-1
9174
1e-2
10751
1e-3
13146
1e-5
22758
1e-7
25192
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 4e80/15
CMAES-APOP-Nguyen 1.1 (1)0.93 (0.4)1.5 (1)1.8 (0.6)1.9 (0.5)1.5 (0.4)1.7 (0.2)15/15
SSEABC-Aydin 1.2 (0.6)1.3 (0.9)1.8 (1)2.3 (0.7)3.1 (4)5.2 (4)13 (7)6/15

Δ fopt
f13, 40-D
1e1
2029
1e0
6916
1e-1
8734
1e-2
11861
1e-3
71936
1e-5
98467
1e-7
1.2e5
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 4e80/15
CMAES-APOP-Nguyen 1.9 (1)5.4 (5)8.4 (4)20 (9)3.9 (2)3.5 (1)★24.1 (1)15/15
SSEABC-Aydin 3.2 (2)3.8 (5)10 (7)51 (49)17 (22)57 (54)4e50/15

Δ fopt
f14, 40-D
1e1
304
1e0
616
1e-1
777
1e-2
1105
1e-3
2207
1e-5
4825
1e-7
57711
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 4e80/15
CMAES-APOP-Nguyen 1.9 (0.4)★32.1 (0.2)★22.7 (0.2)3.6 (0.3)4.3 (0.4)6.6 (0.5)1.1 (0.0)★415/15
SSEABC-Aydin 2.6 (0.1)2.4 (0.2)2.9 (0.2)3.8 (0.5)4.5 (0.3)7.1 (0.5)4e50/15

Δ fopt
f15, 40-D
1e1
1.9e5
1e0
7.9e5
1e-1
1.0e6
1e-2
1.1e6
1e-3
1.1e6
1e-5
1.1e6
1e-7
1.1e6
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 4e80/15
CMAES-APOP-Nguyen 1.7 (0.2)0.40 (0.1)★40.31 (0.0)★40.30 (0.0)★40.30 (0.0)★40.30 (0.0)★40.29 (0.0)★415/15
SSEABC-Aydin 3.5 (8)4e50/15

Δ fopt
f16, 40-D
1e1
5244
1e0
72122
1e-1
3.2e5
1e-2
7.1e5
1e-3
1.4e6
1e-5
2.0e6
1e-7
2.0e6
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 4e80/15
CMAES-APOP-Nguyen 0.90 (0.2)21 (7)4.7 (1)2.1 (0.7)1.1 (0.3)1.1 (0.6)1.0 (0.5)14/15
SSEABC-Aydin 0.59 (0.1)★40.40 (0.0)★44e50/15

Δ fopt
f17, 40-D
1e1
399
1e0
4220
1e-1
14158
1e-2
34948
1e-3
51958
1e-5
1.3e5
1e-7
2.7e5
#succ
14/15
RANDOMSEARCH-4-1e7D-Brockhoff 1827 (1021)4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 3779 (3303)4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 2.2e4 (5e4)4e80/15
CMAES-APOP-Nguyen 0.66 (0.3)★20.49 (0.1)4.0 (5)3.8 (0.5)2.8 (0.5)1.6 (0.6)★20.98 (0.5)★315/15
SSEABC-Aydin 1.1 (0.2)0.45 (0.1)0.52 (2)1.5 (1)★47.7 (10)21 (28)4e50/15

Δ fopt
f18, 40-D
1e1
1442
1e0
16998
1e-1
47068
1e-2
1.3e5
1e-3
1.9e5
1e-5
6.7e5
1e-7
9.5e5
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 4e80/15
CMAES-APOP-Nguyen 0.83 (0.1)1.8 (1)2.5 (0.3)1.1 (0.1)0.83 (0.1)1.0 (2)0.92 (2)13/15
SSEABC-Aydin 0.88 (0.2)0.41 (0.1)1.3 (0.2)★42.4 (2)6.7 (7)4e50/15

Δ fopt
f19, 40-D
1e1
1
1e0
1
1e-1
1.4e6
1e-2
1.7e7
1e-3
2.6e7
1e-5
4.5e7
1e-7
4.5e7
#succ
8/15
RANDOMSEARCH-4-1e7D-Brockhoff 3.8e7 (3e7)4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1.9e9 (2e9)4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 4e80/15
CMAES-APOP-Nguyen 1 (0)★41 (0)★40.73 (0.1)0.28 (0.4)0.29 (0.3)0.27 (0.1)0.27 (0.3)4/15
SSEABC-Aydin 672 (107)2.3e5 (3e5)4e50/15

Δ fopt
f20, 40-D
1e1
222
1e0
1.3e5
1e-1
1.6e8
1e-2
1e-3
1e-5
1e-7
#succ
0/15
RANDOMSEARCH-4-1e7D-Brockhoff     0/15
RANDOMSEARCH-4p5-1e7D-Brockhoff     0/15
RANDOMSEARCH-5-1e7D-Brockhoff     0/15
CMAES-APOP-Nguyen 3.4 (0.6)★317 (2)    0/15
SSEABC-Aydin 4.7 (0.4)    0/15

Δ fopt
f21, 40-D
1e1
1044
1e0
21144
1e-1
1.0e5
1e-2
1.0e5
1e-3
1.0e5
1e-5
1.0e5
1e-7
1.0e5
#succ
26/30
RANDOMSEARCH-4-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 4e80/15
CMAES-APOP-Nguyen 4.1 (13)291 (284)81 (70)81 (119)81 (117)80 (88)80 (78)5/15
SSEABC-Aydin 0.88 (0.2)19 (74)26 (42)26 (29)26 (37)26 (27)26 (24)2/15

Δ fopt
f22, 40-D
1e1
3090
1e0
35442
1e-1
6.5e5
1e-2
6.5e5
1e-3
6.5e5
1e-5
6.5e5
1e-7
6.5e5
#succ
8/30
RANDOMSEARCH-4-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 4e80/15
CMAES-APOP-Nguyen 206 (647)454 (820)4e60/15
SSEABC-Aydin 34 (5)46 (66)4e50/15

Δ fopt
f23, 40-D
1e1
7.0
1e0
11925
1e-1
75453
1e-2
6.6e5
1e-3
1.3e6
1e-5
3.2e6
1e-7
3.4e6
#succ
15/15
RANDOMSEARCH-4-1e7D-Brockhoff 1.5 (1)4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 1.0 (0.5)4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 1.8 (2)4e80/15
CMAES-APOP-Nguyen 1.5 (2)3.6 (2)345 (650)4e60/15
SSEABC-Aydin 1.2 (1)7.3 (7)2.0 (2)★24e50/15

Δ fopt
f24, 40-D
1e1
5.8e6
1e0
9.8e7
1e-1
3.0e8
1e-2
3.0e8
1e-3
3.0e8
1e-5
3.0e8
1e-7
3.0e8
#succ
1/15
RANDOMSEARCH-4-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-4p5-1e7D-Brockhoff 4e80/15
RANDOMSEARCH-5-1e7D-Brockhoff 4e80/15
CMAES-APOP-Nguyen 4e60/15
SSEABC-Aydin 4e50/15

Average runtime (aRT in number of function evaluations) divided by the respective best aRT measured during BBOB-2009 in different dimensions. The aRT and in braces, as dispersion measure, the half difference between 10 and 90%-tile of bootstrapped run lengths appear for each algorithm and target, the corresponding reference aRT  in the first row. The different target ∆f-values are shown in the top row. #succ is the number of trials that reached the (final) target fopt+ 10−8. The median number of conducted function evaluations is additionally given in italics, if the target in the last column was never reached. Entries, succeeded by a star, are statistically significantly better (according to the rank-sum test) when compared to all other algorithms of the table, with p = 0.05 or p = 10−k when the number k following the star is larger than 1, with Bonferroni correction by the number of functions (24). A ↓ indicates the same tested against the best algorithm from BBOB 2009. Best results are printed in bold.
Data produced with COCO v2.0.760