Overview page

Table showing the ERT in number of evaluations divided by the best ERT of the reference algorithm

Last dimension | Dimension = 2 | Next dimension

Δ fopt
f1, 2-D
1e1
2.0
1e0
6.0
1e-1
6.0
1e-2
6.0
1e-3
6.0
1e-5
6.0
1e-7
6.0
#succ
15/15
ACOR liao 1.3 (1)4.1 (5)11 (9)22 (8)32 (8)52 (4)74 (9)15/15
BIPOPaCMA loshchilov 3.0 (5)3.6 (3)7.5 (6)14 (4)18 (6)27 (7)36 (6)15/15
BIPOPsaACM loshchilov 4.9 (6)4.8 (5)7.9 (4)11 (2)13 (1)16 (3)20 (3)15/15
CMAES posik 3.4 (5)4.6 (4)9.0 (5)15 (5)19 (6)30 (5)41 (5)15/15
CMA brockhoff 2.6 (2)4.1 (3)9.4 (3)14 (4)18 (5)28 (7)38 (7)15/15
CMAa brockhoff 3.1 (5)3.0 (3)7.7 (4)11 (8)18 (6)27 (6)39 (8)15/15
CMAm brockhoff 2.8 (4)3.1 (3)6.0 (5)11 (5)15 (4)23 (4)31 (5)15/15
CMAma brockhoff 2.7 (4)3.6 (3)7.3 (4)11 (5)15 (5)23 (7)30 (7)15/15
CMAmah brockhoff 3.1 (3)3.1 (2)5.7 (3)9.2 (4)13 (4)20 (5)28 (5)15/15
CMAmh brockhoff 3.7 (5)2.5 (2)5.9 (3)9.2 (2)12 (4)21 (5)29 (3)15/15
DBRCGA chuang 1.6 (1)4.5 (3)14 (10)26 (9)37 (6)56 (10)79 (13)15/15
DE-AUTO voglis 1.4 (1)3.2 (4)8.3 (4)10 (0.2)10 (0.2)10 (0.2)10 (0.2)15/15
DE-BFGS voglis 2.6 (2)3.9 (2)8.7 (1)9.4 (0.2)9.4 (0.2)9.4 (0.2)9.4 (0.2)15/15
DE-ROLL voglis 1.9 (1)2.4 (3)11 (4)13 (2)13 (1)13 (1)13 (1)15/15
DE-SIMPLEX voglis 2.6 (2)4.9 (4)10 (5)12 (2)14 (2)16 (2)18 (2)15/15
DEAE posik 1.9 (2)5.0 (4)14 (8)25 (9)35 (10)53 (15)75 (13)15/15
DE posik 1.7 (2)3.4 (4)12 (7)22 (9)33 (11)51 (13)70 (20)15/15
DEb posik 1.7 (2)3.4 (4)12 (7)22 (9)33 (11)51 (13)70 (20)15/15
DEctpb posik 2.3 (2)4.4 (5)13 (7)24 (8)37 (8)54 (7)75 (8)15/15
IPOPsaACM loshchilov 2.8 (2)3.4 (3)6.6 (5)10 (3)12 (1)15 (2)19 (2)15/15
JADE posik 2.1 (2)3.8 (4)8.7 (5)14 (7)23 (7)37 (6)53 (7)15/15
JADEb posik 2.0 (3)2.5 (2)8.2 (3)12 (6)17 (6)30 (10)41 (9)15/15
JADEctpb posik 2.1 (2)3.8 (4)8.7 (5)14 (7)23 (7)37 (6)53 (7)15/15
MVDE melo 2.0 (3)3.5 (3)19 (16)45 (28)81 (23)134 (30)181 (41)15/15
NBIPOPaCMA loshchilov 4.3 (5)3.8 (4)7.2 (5)12 (6)16 (7)28 (5)38 (6)15/15
NIPOPaCMA loshchilov 2.3 (3)3.5 (4)7.2 (4)12 (4)17 (5)27 (4)35 (7)15/15
PSO-BFGS voglis 1.7 (3)5.0 (4)8.6 (3)9.4 (0.2)10 (0.2)10 (0.2)10 (0.2)15/15
SNES schaul 5.9 (6)4.2 (3)6.7 (6)13 (7)19 (9)40 (6)53 (13)15/15
xNES schaul 3.8 (4)3.9 (4)6.9 (6)10 (7)18 (8)33 (7)46 (8)15/15
xNESas schaul 5.9 (8)4.1 (5)7.5 (7)13 (8)19 (9)29 (9)42 (10)15/15

Δ fopt
f2, 2-D
1e1
16
1e0
19
1e-1
25
1e-2
25
1e-3
26
1e-5
28
1e-7
29
#succ
15/15
ACOR liao 13 (4)14 (2)13 (2)15 (2)17 (3)20 (2)24 (3)15/15
BIPOPaCMA loshchilov 14 (10)16 (9)14 (5)15 (3)16 (3)17 (3)18 (3)15/15
BIPOPsaACM loshchilov 6.5 (2)7.0 (2)5.7 (2)6.2 (1)6.4 (1)6.8 (1)7.3 (0.9)15/15
CMAES posik 18 (12)22 (7)20 (3)21 (4)21 (4)23 (3)24 (3)15/15
CMA brockhoff 13 (10)18 (9)17 (4)19 (3)20 (3)21 (3)22 (2)15/15
CMAa brockhoff 13 (9)15 (6)14 (2)15 (3)15 (3)16 (2)17 (2)15/15
CMAm brockhoff 12 (12)20 (10)17 (8)19 (4)19 (5)20 (4)21 (3)15/15
CMAma brockhoff 13 (9)19 (4)15 (2)17 (3)17 (3)17 (2)19 (2)15/15
CMAmah brockhoff 19 (14)23 (12)20 (3)21 (3)21 (3)21 (3)22 (3)15/15
CMAmh brockhoff 23 (15)27 (15)26 (3)27 (3)27 (3)27 (2)28 (3)15/15
DBRCGA chuang 11 (8)15 (8)16 (6)18 (5)19 (6)23 (4)29 (6)15/15
DE-AUTO voglis 4.4 (0.3)3.8 (0.2)3.0 (0.2)3.1 (0.2)3.2 (0.3)3.3 (0.3)3.4 (0.5)15/15
DE-BFGS voglis 4.1 (0.3)3.7 (0.3)3.0 (0.2)3.2 (0.3)3.2 (0.4)3.2 (0.3)3.3 (0.3)15/15
DE-ROLL voglis 5.1 (4)4.5 (3)3.5 (2)3.7 (2)3.7 (2)3.8 (2)4.1 (2)15/15
DE-SIMPLEX voglis 5.2 (1)5.3 (1)4.2 (1)4.6 (1.0)4.7 (0.9)4.9 (0.9)5.2 (0.8)15/15
DEAE posik 11 (5)12 (4)13 (2)15 (3)17 (3)21 (2)24 (3)15/15
DE posik 11 (3)12 (2)11 (3)13 (3)15 (3)18 (3)21 (4)15/15
DEb posik 11 (3)12 (2)11 (3)13 (3)15 (3)18 (3)21 (4)15/15
DEctpb posik 11 (5)12 (4)12 (3)14 (3)16 (3)19 (4)22 (5)15/15
IPOPsaACM loshchilov 5.2 (3)5.7 (2)5.3 (1)5.7 (0.7)5.9 (0.8)6.1 (0.9)6.7 (0.9)15/15
JADE posik 7.6 (3)9.4 (2)9.3 (2)11 (3)12 (2)15 (3)17 (2)15/15
JADEb posik 6.6 (1)7.6 (3)7.1 (2)8.1 (2)9.0 (2)11 (2)13 (2)15/15
JADEctpb posik 7.6 (3)9.4 (2)9.3 (2)11 (3)12 (2)15 (3)17 (2)15/15
MVDE melo 23 (8)28 (10)28 (7)35 (3)39 (6)50 (7)59 (5)15/15
NBIPOPaCMA loshchilov 14 (10)18 (6)15 (3)16 (3)17 (3)17 (4)19 (3)15/15
NIPOPaCMA loshchilov 11 (8)15 (7)14 (4)16 (2)16 (2)17 (2)19 (2)15/15
PSO-BFGS voglis 4.3 (0.3)3.8 (0.4)3.0 (0.4)3.2 (0.4)3.1 (0.4)3.1 (0.4)3.2 (0.4)15/15
SNES schaul 11 (7)12 (6)11 (3)13 (3)14 (3)17 (2)19 (2)15/15
xNES schaul 6.7 (6)11 (7)11 (4)12 (4)13 (3)15 (4)17 (4)15/15
xNESas schaul 9.2 (8)19 (20)17 (18)19 (19)27 (22)38 (19)42 (22)15/15

Δ fopt
f3, 2-D
1e1
15
1e0
271
1e-1
445
1e-2
446
1e-3
450
1e-5
454
1e-7
464
#succ
15/15
ACOR liao 5.0 (4)1.8 (2)17 (58)18 (58)18 (58)18 (57)18 (56)15/15
BIPOPaCMA loshchilov 3.3 (2)3.9 (3)7.6 (9)7.8 (9)7.9 (9)8.1 (9)8.2 (8)15/15
BIPOPsaACM loshchilov 6.1 (3)1.9 (2)5.0 (6)6.4 (7)6.8 (6)6.8 (6)7.1 (6)15/15
CMAES posik 3.8 (4)4.2 (4)10 (11)10 (11)10 (11)10 (11)10 (11)15/15
CMA brockhoff 3.9 (5)5.5 (5)8.0 (7)8.4 (8)8.5 (8)8.8 (8)9.0 (8)15/15
CMAa brockhoff 2.5 (3)3.2 (3)5.2 (4)5.6 (5)5.7 (5)5.9 (5)6.0 (5)15/15
CMAm brockhoff 2.7 (2)3.2 (3)5.9 (8)6.3 (8)6.6 (9)6.9 (9)7.0 (9)15/15
CMAma brockhoff 2.4 (2)2.8 (3)6.0 (7)9.1 (9)10 (10)10 (10)11 (10)15/15
CMAmah brockhoff 5.4 (5)5.2 (4)6.1 (4)6.3 (4)6.7 (4)6.9 (4)7.1 (4)15/15
CMAmh brockhoff 6.6 (16)3.9 (4)6.4 (7)7.5 (8)7.9 (8)8.2 (8)8.3 (8)15/15
DBRCGA chuang 2.8 (2)2.0 (0.7)2.4 (2)2.6 (2)2.8 (2)3.1 (2)3.7 (2)15/15
DE-AUTO voglis 3.5 (2)3.7 (5)5.8 (6)5.9 (6)5.9 (6)5.8 (6)5.7 (6)15/15
DE-BFGS voglis 6.3 (8)1.6 (1)1.7 (0.8)1.7 (0.9)1.7 (0.9)1.7 (0.9)1.7 (0.9)15/15
DE-ROLL voglis 4.4 (3)0.50 (0.4)1.5 (2)1.5 (2)1.5 (2)1.5 (2)1.5 (2)15/15
DE-SIMPLEX voglis 8.7 (8)2.7 (2)2.6 (2)2.7 (2)2.7 (2)2.7 (2)2.7 (2)15/15
DEAE posik 3.7 (3)1.9 (1)2.7 (3)2.9 (3)3.0 (3)3.3 (3)3.5 (3)15/15
DE posik 3.8 (3)0.96 (0.3)1.9 (3)2.0 (3)2.1 (3)2.3 (3)2.5 (3)15/15
DEb posik 3.8 (3)0.96 (0.3)1.9 (3)2.0 (3)2.1 (3)2.3 (3)2.5 (3)15/15
DEctpb posik 4.0 (3)1.3 (0.7)1.4 (0.7)1.6 (0.7)1.9 (0.8)2.3 (0.7)2.6 (0.6)15/15
IPOPsaACM loshchilov 3.1 (3)3.0 (3)5.2 (3)6.4 (7)7.0 (7)7.2 (9)7.2 (9)15/15
JADE posik 3.1 (2)0.96 (0.6)0.76 (0.4)1.0 (0.3)1.3 (0.4)1.5 (0.3)1.7 (0.3)15/15
JADEb posik 3.9 (2)1.3 (2)3.4 (3)3.5 (3)3.5 (3)3.7 (3)3.7 (3)15/15
JADEctpb posik 3.1 (2)0.96 (0.6)0.76 (0.4)1.0 (0.3)1.3 (0.4)1.5 (0.3)1.7 (0.3)15/15
MVDE melo 6.2 (4)1.9 (0.8)1.7 (0.6)2.1 (0.4)2.4 (0.3)3.3 (0.3)4.0 (0.5)15/15
NBIPOPaCMA loshchilov 5.8 (3)2.4 (4)8.8 (9)9.2 (9)10 (9)10 (9)10 (9)15/15
NIPOPaCMA loshchilov 3.3 (2)3.1 (4)10 (12)14 (23)16 (26)16 (27)17 (27)15/15
PSO-BFGS voglis 6.8 (6)1.6 (2)3.0 (3)3.0 (3)3.0 (3)2.9 (3)2.9 (3)15/15
SNES schaul 12 (6)5.8 (8)21 (29)34 (48)34 (47)34 (47)33 (46)15/15
xNES schaul 13 (2)13 (15)23 (27)24 (27)24 (27)24 (27)23 (26)15/15
xNESas schaul 13 (37)6.6 (7)20 (28)20 (28)20 (28)20 (27)20 (27)15/15

Δ fopt
f4, 2-D
1e1
22
1e0
344
1e-1
459
1e-2
496
1e-3
523
1e-5
544
1e-7
566
#succ
15/15
ACOR liao 4.4 (2)22 (75)92 (110)86 (102)82 (97)79 (93)76 (89)15/15
BIPOPaCMA loshchilov 4.0 (2)8.1 (15)41 (48)40 (48)39 (50)39 (51)38 (51)15/15
BIPOPsaACM loshchilov 3.7 (2)6.3 (7)34 (46)73 (89)92 (93)229 (387)224 (369)15/15
CMAES posik 4.5 (2)4.4 (5)42 (30)41 (32)42 (39)40 (38)39 (36)15/15
CMA brockhoff 2.6 (2)6.7 (9)50 (44)79 (51)95 (110)104 (119)105 (121)15/15
CMAa brockhoff 2.1 (1)11 (10)66 (50)108 (122)140 (231)151 (257)154 (262)15/15
CMAm brockhoff 2.1 (1)8.2 (10)74 (80)120 (118)163 (130)175 (134)178 (134)15/15
CMAma brockhoff 2.1 (2)10 (11)112 (91)208 (205)218 (210)241 (232)243 (234)15/15
CMAmah brockhoff 6.6 (13)7.3 (12)56 (53)117 (232)133 (246)144 (262)144 (261)15/15
CMAmh brockhoff 3.6 (3)7.0 (11)71 (93)135 (213)144 (209)161 (261)162 (259)15/15
DBRCGA chuang 3.6 (3)1.8 (1)2.7 (2)2.8 (2)2.7 (2)2.9 (2)3.1 (2)15/15
DE-AUTO voglis 2.6 (0.7)4.0 (8)8.4 (8)7.8 (7)7.4 (7)7.1 (6)6.8 (6)15/15
DE-BFGS voglis 3.4 (3)1.6 (1)2.7 (4)2.5 (3)2.4 (3)2.4 (3)2.3 (3)15/15
DE-ROLL voglis 2.3 (2)1.1 (1)2.4 (2)2.3 (2)2.2 (2)2.1 (2)2.0 (2)15/15
DE-SIMPLEX voglis 4.7 (3)1.9 (1)4.2 (7)3.9 (6)3.7 (6)3.6 (6)3.5 (6)15/15
DEAE posik 3.9 (3)2.8 (3)5.0 (4)4.8 (4)4.8 (4)4.8 (4)4.9 (3)15/15
DE posik 3.1 (2)2.1 (2)3.8 (5)3.6 (4)3.6 (4)4.0 (4)4.0 (4)15/15
DEb posik 3.1 (2)2.1 (2)3.8 (5)3.6 (4)3.6 (4)4.0 (4)4.0 (4)15/15
DEctpb posik 4.2 (1)1.2 (0.7)2.2 (3)2.2 (3)2.3 (2)2.6 (3)2.8 (2)15/15
IPOPsaACM loshchilov 2.5 (2)4.5 (4)69 (84)98 (71)283 (188)1074 (1459)1130 (1399)14/15
JADE posik 2.6 (2)1.1 (0.5)1.4 (2)1.4 (1)1.5 (1)1.7 (1)1.8 (1)15/15
JADEb posik 4.4 (2)2.6 (4)6.9 (6)6.5 (5)6.2 (5)6.1 (5)6.0 (5)15/15
JADEctpb posik 2.6 (2)1.1 (0.5)1.4 (2)1.4 (1)1.5 (1)1.7 (1)1.8 (1)15/15
MVDE melo 5.6 (4)1.7 (0.7)1.7 (0.5)2.1 (0.4)2.4 (0.5)3.0 (0.3)3.5 (0.4)15/15
NBIPOPaCMA loshchilov 2.4 (2)8.0 (6)67 (64)73 (75)71 (71)71 (85)69 (84)15/15
NIPOPaCMA loshchilov 3.8 (2)5.7 (7)120 (232)162 (223)177 (271)178 (264)175 (255)15/15
PSO-BFGS voglis 4.4 (5)2.1 (2)4.5 (4)4.1 (4)3.9 (4)3.8 (4)4.4 (6)15/15
SNES schaul 8.4 (2)12 (20)47 (49)44 (45)44 (43)42 (41)41 (39)15/15
xNES schaul 8.5 (2)20 (20)64 (58)60 (53)57 (51)55 (49)53 (47)15/15
xNESas schaul 11 (30)11 (12)46 (72)46 (67)44 (63)42 (61)41 (58)15/15

Δ fopt
f5, 2-D
1e1
4.0
1e0
4.0
1e-1
4.0
1e-2
4.0
1e-3
4.0
1e-5
4.0
1e-7
4.0
#succ
15/15
ACOR liao 3.6 (1)15 (1)17 (1)17 (1)17 (1)17 (1)17 (1)15/15
BIPOPaCMA loshchilov 2.6 (2)5.8 (5)6.2 (5)6.2 (5)6.2 (5)6.2 (5)6.2 (5)15/15
BIPOPsaACM loshchilov 3.6 (3)6.3 (4)7.1 (4)7.1 (4)7.1 (4)7.1 (4)7.1 (4)15/15
CMAES posik 2.8 (2)6.4 (4)6.7 (4)6.7 (4)6.8 (4)6.8 (4)6.8 (4)15/15
CMA brockhoff 3.5 (4)8.5 (8)9.2 (8)9.2 (8)9.2 (8)9.2 (8)9.2 (8)15/15
CMAa brockhoff 4.3 (4)6.7 (5)6.8 (5)6.9 (5)6.9 (5)6.9 (5)6.9 (5)15/15
CMAm brockhoff 2.5 (2)4.6 (2)5.0 (3)5.1 (3)5.1 (3)5.1 (3)5.1 (3)15/15
CMAma brockhoff 2.7 (2)4.7 (3)4.9 (3)4.9 (3)5.2 (3)5.2 (3)5.2 (3)15/15
CMAmah brockhoff 3.0 (2)5.2 (4)5.6 (4)5.7 (4)5.7 (4)5.7 (4)5.7 (4)15/15
CMAmh brockhoff 2.0 (2)3.5 (3)3.9 (3)3.9 (3)3.9 (3)3.9 (3)3.9 (3)15/15
DBRCGA chuang 3.1 (2)10 (5)12 (5)12 (5)12 (5)12 (5)12 (5)15/15
DE-AUTO voglis 3.3 (2)10 (4)11 (4)11 (4)11 (4)11 (4)11 (4)15/15
DE-BFGS voglis 5.4 (2)14 (3)14 (1)14 (1)14 (1)14 (1)14 (1)15/15
DE-ROLL voglis 3.3 (3)10 (3)12 (3)12 (3)12 (3)13 (3)13 (3)15/15
DE-SIMPLEX voglis 4.5 (2)9.0 (2)12 (7)13 (8)13 (8)15 (11)40 (67)15/15
DEAE posik 2.9 (2)10 (8)11 (9)12 (9)12 (9)12 (9)12 (9)15/15
DE posik 3.1 (3)8.4 (6)8.9 (7)8.9 (7)8.9 (7)8.9 (7)8.9 (7)15/15
DEb posik 3.1 (3)8.4 (6)8.9 (7)8.9 (7)8.9 (7)8.9 (7)8.9 (7)15/15
DEctpb posik 4.2 (4)10 (9)11 (9)12 (8)12 (8)12 (8)12 (8)15/15
IPOPsaACM loshchilov 2.8 (2)6.7 (6)7.5 (6)7.5 (6)7.5 (6)7.5 (6)7.5 (6)15/15
JADE posik 2.8 (2)10 (9)12 (8)12 (8)12 (8)12 (8)12 (8)15/15
JADEb posik 3.2 (3)7.0 (5)8.4 (6)8.6 (6)8.6 (6)8.6 (6)8.6 (6)15/15
JADEctpb posik 2.8 (2)10 (9)12 (8)12 (8)12 (8)12 (8)12 (8)15/15
MVDE melo 4.8 (6)37 (12)49 (16)49 (16)49 (16)49 (16)49 (16)15/15
NBIPOPaCMA loshchilov 3.7 (3)6.5 (4)7.0 (3)7.0 (3)7.0 (3)7.0 (3)7.0 (3)15/15
NIPOPaCMA loshchilov 2.9 (2)5.4 (3)5.9 (3)5.9 (3)5.9 (3)5.9 (3)5.9 (3)15/15
PSO-BFGS voglis 5.8 (6)15 (0.4)15 (0.4)15 (0.4)15 (0.4)15 (0.4)15 (0.4)15/15
SNES schaul 4.8 (3)11 (7)13 (8)13 (8)13 (8)13 (8)13 (8)15/15
xNES schaul 6.3 (3)15 (14)16 (13)16 (13)16 (13)16 (13)16 (13)15/15
xNESas schaul 5.4 (4)21 (32)22 (32)22 (33)22 (33)22 (33)22 (33)15/15

Δ fopt
f6, 2-D
1e1
13
1e0
23
1e-1
41
1e-2
54
1e-3
67
1e-5
95
1e-7
124
#succ
15/15
ACOR liao 2.1 (2)6.1 (3)6.0 (3)7.3 (1)8.1 (2)8.3 (2)8.9 (2)15/15
BIPOPaCMA loshchilov 1.9 (2)3.4 (3)3.1 (1)3.4 (0.8)3.5 (1)3.7 (1.0)3.8 (0.9)15/15
BIPOPsaACM loshchilov 2.2 (1)3.0 (1)3.1 (0.7)3.3 (1)4.0 (2)4.0 (2)4.2 (2)15/15
CMAES posik 2.6 (2)4.0 (4)4.3 (2)4.2 (2)4.3 (1)4.2 (1)4.3 (0.9)15/15
CMA brockhoff 2.1 (3)3.8 (3)4.1 (2)4.1 (1)3.9 (0.9)4.1 (0.9)4.1 (0.9)15/15
CMAa brockhoff 2.9 (4)4.3 (3)3.2 (3)4.0 (2)3.9 (1)3.9 (1)3.9 (0.7)15/15
CMAm brockhoff 3.9 (6)5.5 (2)4.3 (2)4.3 (2)4.4 (1.0)4.5 (2)4.6 (1)15/15
CMAma brockhoff 2.0 (3)3.7 (3)4.0 (2)4.1 (2)4.0 (2)4.1 (0.8)4.3 (0.7)15/15
CMAmah brockhoff 2.3 (2)3.6 (2)2.8 (1)2.7 (1)3.0 (0.6)2.9 (0.5)2.9 (0.4)15/15
CMAmh brockhoff 2.4 (2)3.3 (3)3.2 (2)3.3 (2)3.4 (1)3.2 (1)3.3 (0.8)15/15
DBRCGA chuang 2.0 (2)6.4 (3)6.7 (3)6.9 (3)7.4 (2)7.4 (2)8.1 (2)15/15
DE-AUTO voglis 1.5 (2)3.0 (1)2.3 (1)2.1 (0.8)1.9 (0.7)1.7 (0.7)1.5 (0.5)15/15
DE-BFGS voglis 1.9 (2)3.1 (2)2.4 (0.8)2.0 (0.5)1.8 (0.5)1.5 (0.3)1.6 (0.6)15/15
DE-ROLL voglis 1.4 (1)9.4 (7)22 (49)20 (45)18 (36)50 (52)136 (306)14/15
DE-SIMPLEX voglis 2.0 (2)3.0 (1)2.2 (0.4)2.0 (0.5)1.9 (0.8)1.6 (0.5)1.6 (0.7)15/15
DEAE posik 2.9 (3)5.3 (3)5.4 (3)5.9 (2)6.5 (1)6.4 (1)6.7 (2)15/15
DE posik 2.8 (2)4.7 (3)6.2 (2)7.0 (2)7.5 (2)8.0 (1)8.4 (2)15/15
DEb posik 2.8 (2)4.7 (3)6.2 (2)7.0 (2)7.5 (2)8.0 (1)8.4 (2)15/15
DEctpb posik 3.4 (3)5.9 (3)6.3 (3)8.0 (3)8.9 (2)8.9 (1)9.4 (2)15/15
IPOPsaACM loshchilov 2.5 (2)3.3 (2)4.2 (4)3.9 (3)3.8 (2)3.8 (2)3.9 (1)15/15
JADE posik 1.7 (1)3.6 (2)3.4 (2)4.3 (2)4.5 (1)4.8 (0.9)5.1 (0.6)15/15
JADEb posik 2.3 (3)3.0 (2)3.2 (2)3.5 (0.8)3.8 (1)4.3 (1)4.4 (1)15/15
JADEctpb posik 1.7 (1)3.6 (2)3.4 (2)4.3 (2)4.5 (1)4.8 (0.9)5.1 (0.6)15/15
MVDE melo 1.9 (2)8.5 (8)12 (5)17 (6)22 (9)28 (6)30 (8)15/15
NBIPOPaCMA loshchilov 2.7 (4)3.8 (3)3.5 (2)3.9 (2)3.9 (1)4.0 (1)4.0 (0.8)15/15
NIPOPaCMA loshchilov 3.9 (4)3.9 (3)3.2 (2)3.6 (1)3.8 (0.9)3.8 (0.6)3.9 (0.4)15/15
PSO-BFGS voglis 3.1 (3)3.8 (1)2.7 (0.7)2.3 (0.5)2.1 (0.5)1.7 (0.3)1.6 (0.4)15/15
SNES schaul 2.6 (3)3.3 (2)3.4 (2)4.1 (1)4.8 (2)5.0 (1)5.3 (2)15/15
xNES schaul 5.0 (4)4.6 (2)4.5 (4)5.7 (4)5.8 (3)5.5 (4)5.2 (3)15/15
xNESas schaul 5.4 (6)6.1 (4)14 (2)13 (3)11 (3)9.3 (2)8.5 (2)15/15

Δ fopt
f7, 2-D
1e1
3.0
1e0
21
1e-1
60
1e-2
193
1e-3
217
1e-5
217
1e-7
241
#succ
15/15
ACOR liao 5.0 (5)4.1 (4)3.8 (2)2.0 (2)2.0 (1)2.0 (1)2.5 (2)15/15
BIPOPaCMA loshchilov 6.7 (6)5.6 (6)3.2 (2)1.9 (1)1.9 (1)1.9 (1)1.9 (1)15/15
BIPOPsaACM loshchilov 4.7 (4)2.8 (3)2.5 (2)1.1 (0.7)1.2 (1.0)1.2 (1.0)1.2 (0.9)15/15
CMAES posik 5.6 (6)2.8 (4)2.6 (2)1.5 (3)1.6 (3)1.6 (3)2.2 (2)15/15
CMA brockhoff 3.4 (2)2.2 (3)1.8 (2)1.3 (1)1.4 (1)1.4 (1)1.8 (2)15/15
CMAa brockhoff 5.4 (7)2.6 (2)2.1 (2)1.1 (1)1.2 (0.9)1.2 (0.9)1.3 (0.8)15/15
CMAm brockhoff 5.7 (9)3.7 (5)2.1 (2)1.2 (1)1.1 (1)1.1 (1)1.2 (1)15/15
CMAma brockhoff 6.9 (8)3.6 (3)3.1 (3)1.2 (1.0)1.2 (1)1.2 (1)1.4 (1.0)15/15
CMAmah brockhoff 3.4 (4)2.1 (3)2.7 (3)1.1 (1.0)1.7 (1)1.7 (1)1.9 (1)15/15
CMAmh brockhoff 2.7 (2)2.4 (3)4.5 (4)1.8 (2)1.7 (1)1.7 (1)2.0 (2)15/15
DBRCGA chuang 4.6 (5)3.1 (3)2.9 (3)1.8 (1)2.9 (2)2.9 (2)3.7 (4)15/15
DE-AUTO voglis 3.3 (4)4.5 (10)12 (13)6.3 (7)9.2 (7)9.2 (7)8.4 (7)15/15
DE-BFGS voglis 3.6 (3)12 (4)6.0 (2)2.3 (1.0)2.3 (0.8)2.3 (0.8)5.4 (5)15/15
DE-ROLL voglis 5.4 (7)7.0 (7)6.5 (8)2.8 (3)3.7 (3)3.7 (3)4.1 (3)15/15
DE-SIMPLEX voglis 5.0 (6)2.7 (2)2.2 (1)1.0 (0.7)1.1 (0.9)1.1 (0.9)1.2 (0.9)15/15
DEAE posik 5.8 (9)3.5 (3)3.0 (2)1.4 (0.7)1.6 (0.7)1.6 (0.7)1.7 (0.4)15/15
DE posik 5.5 (7)3.0 (3)2.9 (1)1.3 (0.7)1.7 (1)1.7 (1)1.9 (1)15/15
DEb posik 5.5 (7)3.0 (3)2.9 (1)1.3 (0.7)1.7 (1)1.7 (1)1.9 (1)15/15
DEctpb posik 9.2 (11)3.8 (3)3.4 (1.0)1.7 (0.8)1.7 (0.8)1.7 (0.8)2.1 (0.9)15/15
IPOPsaACM loshchilov 4.8 (3)5.1 (6)3.7 (3)1.5 (0.9)1.3 (0.8)1.3 (0.8)1.6 (0.8)15/15
JADE posik 6.2 (9)2.6 (2)2.0 (1.0)0.90 (0.3)0.97 (0.2)0.97 (0.2)1.1 (0.3)15/15
JADEb posik 2.6 (3)1.8 (2)4.1 (0.6)1.5 (0.7)34 (6)34 (6)31 (5)14/15
JADEctpb posik 6.2 (9)2.6 (2)2.0 (1.0)0.90 (0.3)0.97 (0.2)0.97 (0.2)1.1 (0.3)15/15
MVDE melo 6.6 (6)4.3 (4)5.6 (4)3.0 (2)4.0 (2)4.0 (2)5.1 (2)15/15
NBIPOPaCMA loshchilov 6.3 (3)3.6 (3)3.2 (3)1.6 (1)1.7 (1)1.7 (1)1.8 (2)15/15
NIPOPaCMA loshchilov 4.8 (6)3.0 (3)3.6 (3)1.7 (1)1.6 (1)1.6 (1)1.6 (1)15/15
PSO-BFGS voglis 19 (30)54 (113)79 (103)27 (32)27 (29)27 (29)90 (116)12/15
SNES schaul 7.0 (6)34 (95)21 (34)11 (21)11 (19)11 (19)22 (36)13/15
xNES schaul 51 (7)39 (50)28 (33)9.0 (10)12 (16)12 (16)11 (17)15/15
xNESas schaul 5.5 (5)38 (96)26 (34)8.2 (11)7.4 (9)7.4 (9)7.8 (8)15/15

Δ fopt
f8, 2-D
1e1
5.0
1e0
12
1e-1
37
1e-2
46
1e-3
86
1e-5
94
1e-7
112
#succ
15/15
ACOR liao 6.4 (6)12 (8)12 (3)19 (8)17 (4)32 (7)39 (6)15/15
BIPOPaCMA loshchilov 4.7 (4)8.9 (8)8.0 (5)8.6 (4)5.3 (2)5.6 (2)5.2 (2)15/15
BIPOPsaACM loshchilov 5.2 (5)6.2 (8)3.8 (3)4.0 (3)2.5 (1)2.6 (1)2.4 (1)15/15
CMAES posik 7.1 (7)12 (19)9.5 (6)10 (7)6.1 (4)6.5 (3)6.0 (2)15/15
CMA brockhoff 6.7 (7)12 (17)7.4 (7)8.6 (5)5.4 (3)5.8 (3)5.4 (2)15/15
CMAa brockhoff 7.6 (4)13 (14)8.1 (8)8.8 (6)5.2 (4)5.5 (3)5.2 (3)15/15
CMAm brockhoff 5.2 (4)8.0 (12)10 (7)10 (7)6.1 (3)6.5 (3)5.9 (2)15/15
CMAma brockhoff 7.2 (8)8.4 (10)5.7 (6)6.9 (6)4.5 (3)4.7 (3)4.5 (2)15/15
CMAmah brockhoff 4.0 (5)6.4 (10)7.2 (6)8.6 (4)5.3 (2)5.4 (2)5.1 (2)15/15
CMAmh brockhoff 4.4 (4)14 (22)9.3 (11)12 (6)7.2 (4)7.3 (4)6.6 (3)15/15
DBRCGA chuang 4.8 (5)7.1 (5)12 (22)17 (24)15 (14)18 (15)19 (14)15/15
DE-AUTO voglis 5.8 (5)6.5 (4)3.0 (1)2.7 (1.0)1.6 (0.5)1.5 (0.5)1.3 (0.4)15/15
DE-BFGS voglis 5.9 (6)8.6 (3)3.6 (0.9)3.3 (0.7)1.8 (0.4)1.7 (0.3)1.5 (0.3)15/15
DE-ROLL voglis 33 (5)49 (86)103 (141)218 (205)209 (117)312 (117)1189 (1075)6/15
DE-SIMPLEX voglis 5.5 (5)6.3 (6)3.2 (2)2.9 (1)1.7 (0.7)1.7 (0.6)1.5 (0.5)15/15
DEAE posik 6.6 (8)11 (10)8.2 (5)10 (5)6.8 (3)7.7 (2)7.4 (2)15/15
DE posik 7.4 (6)9.5 (8)7.3 (4)9.3 (5)6.2 (2)8.7 (3)9.4 (3)15/15
DEb posik 7.4 (6)9.5 (8)7.3 (4)9.3 (5)6.2 (2)8.7 (3)9.4 (3)15/15
DEctpb posik 11 (14)18 (22)12 (12)14 (10)8.7 (7)12 (5)13 (4)15/15
IPOPsaACM loshchilov 6.2 (5)11 (14)6.4 (5)6.4 (4)3.8 (2)3.8 (2)3.4 (2)15/15
JADE posik 4.2 (5)7.0 (6)6.7 (5)10 (5)6.0 (3)7.1 (3)7.2 (2)15/15
JADEb posik 5.2 (4)11 (16)7.8 (8)8.8 (6)5.4 (4)6.0 (3)6.1 (3)15/15
JADEctpb posik 4.2 (5)7.0 (6)6.7 (5)10 (5)6.0 (3)7.1 (3)7.2 (2)15/15
MVDE melo 10 (7)20 (13)20 (20)34 (15)22 (8)32 (10)36 (9)15/15
NBIPOPaCMA loshchilov 4.3 (4)11 (13)7.7 (7)8.6 (6)5.2 (3)5.5 (3)5.1 (3)15/15
NIPOPaCMA loshchilov 5.3 (4)10 (8)7.5 (7)8.5 (5)5.2 (3)5.4 (2)5.0 (2)15/15
PSO-BFGS voglis 8.7 (7)10 (2)4.1 (0.9)3.6 (0.7)2.0 (0.4)1.9 (0.3)1.6 (0.3)15/15
SNES schaul 6.9 (5)881 (1273)572 (1246)824 (1240)731 (707)1282 (1085)1523 (906)13/15
xNES schaul 6.9 (8)15 (18)21 (13)22 (16)13 (10)13 (10)12 (8)15/15
xNESas schaul 4.0 (4)17 (20)16 (32)18 (27)11 (14)11 (14)10 (12)15/15

Δ fopt
f9, 2-D
1e1
1
1e0
18
1e-1
30
1e-2
44
1e-3
68
1e-5
81
1e-7
92
#succ
15/15
ACOR liao 28 (18)4.9 (4)7.8 (5)11 (5)12 (8)21 (12)26 (18)15/15
BIPOPaCMA loshchilov 28 (30)3.2 (2)7.1 (4)7.2 (3)5.3 (2)5.3 (1)5.4 (1)15/15
BIPOPsaACM loshchilov 19 (14)5.9 (6)7.5 (5)6.6 (4)4.6 (2)4.2 (2)3.9 (2)15/15
CMAES posik 21 (20)5.7 (9)9.0 (8)9.1 (6)6.5 (4)6.7 (3)6.5 (3)15/15
CMA brockhoff 40 (24)7.8 (5)11 (8)10 (6)7.6 (4)7.4 (3)7.2 (2)15/15
CMAa brockhoff 26 (28)6.8 (9)10 (8)9.1 (5)6.7 (3)6.5 (3)6.3 (3)15/15
CMAm brockhoff 25 (20)6.6 (11)10 (10)9.1 (7)6.8 (5)6.7 (4)6.4 (3)15/15
CMAma brockhoff 19 (21)4.9 (5)8.4 (8)7.5 (6)5.8 (4)5.6 (3)5.5 (2)15/15
CMAmah brockhoff 39 (24)5.6 (2)8.8 (6)8.5 (5)6.4 (2)6.2 (2)6.2 (2)15/15
CMAmh brockhoff 44 (15)10 (15)13 (11)13 (8)9.2 (5)8.6 (4)8.2 (4)15/15
DBRCGA chuang 31 (28)6.1 (4)12 (12)18 (21)18 (15)18 (12)18 (13)15/15
DE-AUTO voglis 35 (27)5.8 (2)4.8 (2)3.6 (1)2.5 (0.7)2.1 (0.6)1.9 (0.5)15/15
DE-BFGS voglis 22 (28)4.9 (2)3.8 (2)3.1 (1)2.1 (0.7)1.9 (0.6)1.7 (0.5)15/15
DE-ROLL voglis 23 (23)32 (65)95 (135)158 (138)206 (149)296 (172)1543 (2411)9/15
DE-SIMPLEX voglis 37 (21)4.0 (2)3.4 (2)2.7 (1)1.9 (0.8)1.8 (0.7)1.7 (0.6)15/15
DEAE posik 26 (28)5.7 (4)7.4 (4)8.6 (4)7.0 (2)7.3 (2)7.9 (2)15/15
DE posik 45 (42)7.7 (6)10 (7)10 (8)8.4 (6)10 (3)12 (3)15/15
DEb posik 45 (42)7.7 (6)10 (7)10 (8)8.4 (6)10 (3)12 (3)15/15
DEctpb posik 38 (27)8.5 (6)15 (8)16 (6)12 (5)14 (5)16 (4)15/15
IPOPsaACM loshchilov 19 (20)6.3 (7)7.8 (6)6.4 (3)4.5 (3)4.2 (2)3.8 (2)15/15
JADE posik 31 (21)3.9 (2)6.3 (3)6.1 (2)5.7 (2)6.9 (2)7.3 (1)15/15
JADEb posik 26 (27)5.5 (7)8.3 (11)7.8 (8)6.2 (5)6.3 (4)6.5 (3)15/15
JADEctpb posik 31 (21)3.9 (2)6.3 (3)6.1 (2)5.7 (2)6.9 (2)7.3 (1)15/15
MVDE melo 30 (41)11 (8)22 (13)33 (18)28 (14)37 (15)44 (16)15/15
NBIPOPaCMA loshchilov 25 (25)7.1 (6)9.0 (7)8.9 (5)6.5 (3)6.4 (3)6.2 (3)15/15
NIPOPaCMA loshchilov 27 (14)6.6 (11)8.8 (8)7.7 (6)5.8 (3)5.9 (3)5.8 (3)15/15
PSO-BFGS voglis 42 (30)4.2 (2)3.6 (1)2.9 (0.6)2.0 (0.4)1.8 (0.3)1.6 (0.3)15/15
SNES schaul 16 (15)14 (18)175 (126)375 (309)442 (427)739 (791)1052 (1009)13/15
xNES schaul 18 (16)10 (14)16 (17)20 (29)16 (20)15 (23)14 (20)15/15
xNESas schaul 27 (31)4.7 (5)14 (20)16 (23)12 (17)11 (15)10 (13)15/15

Δ fopt
f10, 2-D
1e1
30
1e0
46
1e-1
54
1e-2
61
1e-3
68
1e-5
82
1e-7
98
#succ
15/15
ACOR liao 79 (125)140 (184)281 (344)447 (418)557 (397)759 (518)871 (630)15/15
BIPOPaCMA loshchilov 7.0 (6)6.6 (3)6.6 (2)6.2 (2)6.0 (1)5.7 (1)5.4 (0.9)15/15
BIPOPsaACM loshchilov 3.5 (1)2.5 (0.7)2.4 (0.6)2.4 (0.3)2.3 (0.5)2.2 (0.3)2.0 (0.3)15/15
CMAES posik 10 (6)8.1 (3)7.6 (2)7.4 (2)7.3 (2)6.9 (1)6.5 (1)15/15
CMA brockhoff 8.7 (6)8.2 (3)7.9 (2)7.6 (1)7.2 (1)6.7 (1)6.3 (1)15/15
CMAa brockhoff 5.9 (5)5.8 (3)6.1 (2)6.0 (2)5.9 (1)5.6 (1)5.3 (0.8)15/15
CMAm brockhoff 7.1 (6)7.3 (4)8.3 (2)8.2 (1)7.7 (1)7.0 (1)6.3 (0.8)15/15
CMAma brockhoff 6.4 (4)6.2 (3)6.2 (1)6.0 (1)5.8 (1)5.4 (0.9)5.0 (1)15/15
CMAmah brockhoff 10 (8)10 (2)9.1 (2)8.5 (2)8.3 (2)7.4 (1)6.7 (1)15/15
CMAmh brockhoff 13 (10)11 (7)12 (1)11 (1)11 (2)9.3 (1)8.4 (1.0)15/15
DBRCGA chuang 7.8 (3)17 (16)23 (32)29 (29)28 (26)27 (21)28 (18)15/15
DE-AUTO voglis 2.3 (0.1)1.6 (0.1)1.4 (0.1)1.3 (0.1)1.2 (0.2)1.1 (0.1)1.9 (0.2)15/15
DE-BFGS voglis 2.2 (0.3)1.6 (0.2)1.4 (0.2)1.3 (0.2)1.3 (0.3)1.1 (0.3)1.1 (0.4)15/15
DE-ROLL voglis 29 (34)83 (101)234 (149)307 (182)343 (208)439 (136)1260 (664)5/15
DE-SIMPLEX voglis 2.8 (0.7)2.1 (0.4)1.9 (0.4)1.9 (0.2)1.8 (0.2)1.7 (0.2)1.5 (0.1)15/15
DEAE posik 5.9 (2)5.0 (1)5.4 (2)6.2 (1)6.5 (0.8)6.6 (1)7.5 (1.0)15/15
DE posik 11 (9)11 (6)12 (4)14 (6)15 (6)16 (5)17 (4)15/15
DEb posik 11 (9)11 (6)12 (4)14 (6)15 (6)16 (5)17 (4)15/15
DEctpb posik 11 (8)11 (4)12 (3)13 (3)14 (3)15 (3)16 (2)15/15
IPOPsaACM loshchilov 3.3 (1)2.6 (1)2.8 (1)2.8 (0.9)2.7 (0.9)2.5 (0.7)2.3 (0.6)15/15
JADE posik 4.8 (3)5.4 (3)5.7 (2)6.2 (1)6.7 (2)7.2 (1)7.3 (1)15/15
JADEb posik 5.7 (3)6.8 (6)7.4 (4)8.0 (4)8.1 (4)7.9 (3)7.4 (3)15/15
JADEctpb posik 4.8 (3)5.4 (3)5.7 (2)6.2 (1)6.7 (2)7.2 (1)7.3 (1)15/15
MVDE melo 21 (18)27 (13)33 (13)40 (9)44 (5)53 (9)56 (8)15/15
NBIPOPaCMA loshchilov 6.4 (5)5.6 (4)5.7 (2)5.6 (2)5.6 (1)5.4 (0.9)5.2 (1.0)15/15
NIPOPaCMA loshchilov 7.7 (6)7.0 (3)7.0 (2)6.6 (1.0)6.4 (0.8)6.2 (1)5.8 (0.8)15/15
PSO-BFGS voglis 2.4 (0.4)1.6 (0.2)1.4 (0.2)1.3 (0.2)1.2 (0.3)1.1 (0.2)1.2 (0.6)15/15
SNES schaul 273 (68)363 (242)1546 (1465)4289 (4797)1.4e4 (2e4)2e50/15
xNES schaul 5.7 (3)5.7 (2)5.5 (2)5.8 (2)6.1 (1)5.9 (1)5.8 (0.9)15/15
xNESas schaul 3.5 (2)4.8 (2)5.0 (1)5.4 (3)5.7 (4)8.3 (3)7.7 (3)15/15

Δ fopt
f11, 2-D
1e1
35
1e0
45
1e-1
50
1e-2
62
1e-3
67
1e-5
81
1e-7
97
#succ
15/15
ACOR liao 83 (103)196 (216)320 (299)445 (434)603 (475)810 (447)883 (503)15/15
BIPOPaCMA loshchilov 6.6 (4)6.5 (3)7.3 (1)6.3 (1)6.3 (1.0)5.9 (0.8)5.5 (0.8)15/15
BIPOPsaACM loshchilov 2.6 (0.8)2.5 (0.5)2.5 (0.3)2.2 (0.2)2.2 (0.3)2.1 (0.2)1.9 (0.2)15/15
CMAES posik 6.7 (6)7.8 (3)8.4 (2)7.3 (1)7.4 (1)6.9 (0.6)6.5 (0.7)15/15
CMA brockhoff 7.2 (6)9.2 (3)9.2 (2)7.9 (2)7.8 (2)7.1 (1)6.4 (1)15/15
CMAa brockhoff 4.4 (3)5.9 (3)6.8 (0.9)6.1 (0.9)6.1 (0.8)5.9 (0.8)5.6 (0.6)15/15
CMAm brockhoff 7.2 (6)8.6 (5)8.9 (2)7.8 (2)7.6 (2)6.9 (1)6.3 (1)15/15
CMAma brockhoff 4.6 (4)6.7 (3)6.8 (2)5.9 (1)5.8 (1)5.5 (1)5.1 (0.9)15/15
CMAmah brockhoff 8.3 (6)9.3 (5)10 (2)8.7 (1)8.6 (1)7.6 (1)6.9 (0.9)15/15
CMAmh brockhoff 7.2 (8)8.8 (7)13 (2)11 (1)11 (1)9.5 (0.8)8.4 (0.7)15/15
DBRCGA chuang 8.0 (4)10 (11)13 (11)13 (8)15 (8)17 (9)20 (9)15/15
DE-AUTO voglis 2.0 (0.2)1.6 (0.2)1.5 (0.2)1.3 (0.1)1.2 (0.1)1.1 (0.1)1.4 (0.2)15/15
DE-BFGS voglis 1.9 (0.2)1.5 (0.1)1.4 (0.1)1.2 (0.1)1.2 (0.1)1.0 (0.1)0.92 (0.1)15/15
DE-ROLL voglis 195 (319)207 (316)313 (266)319 (227)416 (254)485 (312)1585 (1647)7/15
DE-SIMPLEX voglis 2.4 (0.6)2.2 (0.5)2.1 (0.3)1.9 (0.2)1.9 (0.2)1.7 (0.2)1.6 (0.1)15/15
DEAE posik 5.0 (2)5.4 (2)6.1 (1)6.0 (1)6.2 (0.7)6.9 (1.0)6.9 (0.9)15/15
DE posik 7.2 (3)9.4 (4)11 (4)13 (7)13 (7)15 (6)15 (4)15/15
DEb posik 7.2 (3)9.4 (4)11 (4)13 (7)13 (7)15 (6)15 (4)15/15
DEctpb posik 8.6 (4)9.5 (3)12 (4)12 (2)13 (2)15 (2)15 (2)15/15
IPOPsaACM loshchilov 2.8 (1)2.9 (0.8)2.9 (0.9)2.5 (0.7)2.5 (0.6)2.2 (0.5)2.2 (0.5)15/15
JADE posik 4.4 (2)5.4 (2)6.2 (1)6.1 (1)6.5 (1)7.1 (1)6.9 (1)15/15
JADEb posik 4.6 (4)7.2 (6)7.9 (6)7.1 (5)7.5 (5)7.6 (4)7.5 (3)15/15
JADEctpb posik 4.4 (2)5.4 (2)6.2 (1)6.1 (1)6.5 (1)7.1 (1)6.9 (1)15/15
MVDE melo 16 (12)28 (15)34 (12)37 (12)42 (7)49 (9)53 (10)15/15
NBIPOPaCMA loshchilov 5.7 (5)6.7 (4)7.2 (2)6.3 (1)6.3 (1)5.9 (1)5.4 (1)15/15
NIPOPaCMA loshchilov 5.2 (4)6.8 (3)6.8 (3)6.3 (2)6.3 (2)5.8 (1)5.4 (1)15/15
PSO-BFGS voglis 1.9 (0.2)1.6 (0.1)1.5 (0.1)1.3 (0.1)1.2 (0.1)1.1 (0.1)1.0 (0.1)15/15
SNES schaul 28 (30)808 (1635)1484 (1833)2579 (3900)5307 (5479)1.7e4 (2e4)2.9e4 (3e4)1/15
xNES schaul 4.8 (4)6.3 (5)7.1 (4)6.4 (3)6.5 (3)6.6 (3)6.3 (2)15/15
xNESas schaul 6.7 (7)6.9 (6)7.6 (5)7.1 (4)7.5 (3)7.3 (3)6.9 (3)15/15

Δ fopt
f12, 2-D
1e1
35
1e0
46
1e-1
75
1e-2
94
1e-3
105
1e-5
153
1e-7
195
#succ
15/15
ACOR liao 12 (4)48 (84)54 (106)98 (158)140 (256)177 (311)184 (277)15/15
BIPOPaCMA loshchilov 4.7 (4)6.7 (5)6.9 (5)7.4 (7)7.2 (7)6.4 (7)6.0 (6)15/15
BIPOPsaACM loshchilov 3.1 (1)3.2 (2)6.3 (1)6.4 (8)6.2 (7)5.1 (5)4.3 (4)15/15
CMAES posik 7.2 (4)6.9 (3)5.4 (3)5.3 (2)5.6 (1)4.9 (1.0)4.6 (1)15/15
CMA brockhoff 9.1 (9)15 (16)15 (16)14 (16)14 (16)11 (13)10 (12)15/15
CMAa brockhoff 4.9 (4)12 (19)11 (18)11 (16)11 (15)10 (12)8.5 (11)15/15
CMAm brockhoff 4.9 (5)7.1 (4)7.8 (4)7.5 (4)7.5 (5)7.2 (7)6.9 (7)15/15
CMAma brockhoff 7.7 (8)12 (18)10 (14)10 (13)9.3 (12)7.6 (9)6.8 (8)15/15
CMAmah brockhoff 13 (15)21 (23)18 (19)16 (18)15 (17)12 (14)11 (13)15/15
CMAmh brockhoff 10 (8)11 (7)8.8 (4)8.7 (1)8.5 (2)7.6 (5)7.2 (7)15/15
DBRCGA chuang 5.6 (3)30 (12)33 (28)40 (44)41 (44)41 (57)39 (54)15/15
DE-AUTO voglis 1.8 (0.7)1.6 (0.3)1.2 (0.4)1.1 (0.6)1.1 (0.7)1.1 (0.9)1.0 (1.0)15/15
DE-BFGS voglis 2.0 (0.4)1.8 (0.3)1.5 (0.8)1.3 (0.9)1.3 (0.9)1.1 (0.8)1.0 (0.7)15/15
DE-ROLL voglis 16 (31)47 (65)48 (65)56 (68)68 (80)110 (124)311 (504)12/15
DE-SIMPLEX voglis 2.4 (0.7)3.0 (2)2.6 (3)2.6 (3)2.5 (3)2.1 (2)1.9 (2)15/15
DEAE posik 7.4 (4)11 (8)11 (13)11 (15)11 (13)11 (10)11 (9)15/15
DE posik 10 (8)18 (28)19 (30)20 (31)21 (32)19 (25)18 (21)15/15
DEb posik 10 (8)18 (28)19 (30)20 (31)21 (32)19 (25)18 (21)15/15
DEctpb posik 16 (5)25 (7)22 (13)22 (15)25 (17)23 (18)23 (16)15/15
IPOPsaACM loshchilov 5.2 (4)6.1 (6)4.7 (5)4.4 (5)4.2 (4)3.4 (3)3.2 (3)15/15
JADE posik 5.3 (3)5.9 (2)5.0 (2)6.6 (4)7.5 (5)7.9 (5)7.6 (6)15/15
JADEb posik 12 (21)19 (37)19 (34)20 (33)20 (30)16 (22)15 (19)15/15
JADEctpb posik 5.3 (3)5.9 (2)5.0 (2)6.6 (4)7.5 (5)7.9 (5)7.6 (6)15/15
MVDE melo 17 (12)29 (18)25 (18)789 (23)712 (21)504 (38)408 (55)14/15
NBIPOPaCMA loshchilov 5.9 (4)7.7 (3)5.6 (2)5.1 (1)5.0 (1)4.1 (1)3.6 (0.9)15/15
NIPOPaCMA loshchilov 9.4 (5)13 (20)12 (20)11 (17)10 (15)8.6 (11)7.7 (8)15/15
PSO-BFGS voglis 3.1 (3)4.0 (5)3.4 (4)3.1 (4)2.9 (4)2.3 (3)2.1 (3)15/15
SNES schaul 23 (29)128 (135)504 (1043)884 (1752)2203 (3361)2625 (3275)2062 (3083)5/15
xNES schaul 5.9 (5)17 (28)25 (75)27 (77)29 (76)24 (56)22 (46)15/15
xNESas schaul 3.8 (2)9.2 (12)14 (17)15 (14)19 (41)21 (44)27 (51)15/15

Δ fopt
f13, 2-D
1e1
23
1e0
35
1e-1
46
1e-2
60
1e-3
71
1e-5
95
1e-7
122
#succ
15/15
ACOR liao 4.8 (4)16 (15)53 (52)112 (106)277 (266)1.4e4 (2e4)3.3e5 (6e5)1/15
BIPOPaCMA loshchilov 4.5 (3)4.9 (3)5.1 (2)5.1 (1)5.8 (2)5.7 (1)5.5 (0.9)15/15
BIPOPsaACM loshchilov 2.4 (2)2.8 (1)2.9 (1)2.7 (0.8)2.8 (1.0)2.7 (0.9)2.7 (0.7)15/15
CMAES posik 3.8 (4)7.1 (5)7.3 (3)7.3 (2)7.3 (2)7.7 (2)7.5 (1)15/15
CMA brockhoff 5.2 (5)6.2 (3)6.0 (2)6.3 (2)6.6 (2)7.1 (1)6.7 (1)15/15
CMAa brockhoff 4.5 (3)5.1 (3)5.7 (2)5.5 (1)5.6 (1)5.5 (0.6)5.4 (0.7)15/15
CMAm brockhoff 7.1 (6)9.1 (4)9.1 (5)8.5 (3)8.2 (2)8.0 (2)7.9 (1)15/15
CMAma brockhoff 4.5 (5)5.1 (4)6.5 (3)5.9 (1)6.4 (2)6.1 (1)5.9 (1)15/15
CMAmah brockhoff 7.8 (10)10 (6)10 (4)9.2 (3)9.3 (3)9.0 (2)8.4 (2)15/15
CMAmh brockhoff 6.5 (9)9.3 (8)10 (7)10 (7)11 (7)12 (6)13 (5)15/15
DBRCGA chuang 4.0 (2)6.5 (2)9.4 (2)12 (8)14 (7)25 (24)42 (34)15/15
DE-AUTO voglis 2.7 (1)2.2 (0.2)1.8 (0.1)1.5 (0.1)1.3 (0.1)1.1 (0.1)1.6 (2)15/15
DE-BFGS voglis 2.8 (0.3)2.1 (0.2)1.7 (0.2)1.5 (0.2)1.3 (0.2)1.1 (0.1)1.4 (1)15/15
DE-ROLL voglis 10 (11)30 (31)43 (30)47 (28)54 (24)57 (18)176 (116)14/15
DE-SIMPLEX voglis 2.1 (1)2.3 (0.6)2.1 (0.5)1.8 (0.4)1.7 (0.3)1.5 (0.3)1.4 (0.2)15/15
DEAE posik 3.5 (3)5.7 (2)6.5 (2)6.2 (0.9)6.7 (1)6.8 (1)6.7 (0.9)15/15
DE posik 5.8 (3)7.5 (3)9.4 (3)15 (3)20 (24)20 (18)23 (16)15/15
DEb posik 5.8 (3)7.5 (3)9.4 (3)15 (3)20 (24)20 (18)23 (16)15/15
DEctpb posik 4.4 (5)8.6 (3)11 (2)12 (5)14 (2)15 (3)15 (3)15/15
IPOPsaACM loshchilov 2.8 (1)3.0 (0.9)3.3 (1)3.0 (1)2.8 (0.9)2.7 (0.5)2.5 (0.6)15/15
JADE posik 2.6 (1)4.2 (2)5.2 (2)5.9 (1)6.4 (0.9)7.0 (1.0)6.8 (0.7)15/15
JADEb posik 3.6 (2)4.8 (4)5.3 (4)5.3 (3)6.3 (3)8.3 (6)9.2 (6)15/15
JADEctpb posik 2.6 (1)4.2 (2)5.2 (2)5.9 (1)6.4 (0.9)7.0 (1.0)6.8 (0.7)15/15
MVDE melo 7.8 (6)19 (6)26 (13)37 (15)42 (9)49 (13)55 (9)15/15
NBIPOPaCMA loshchilov 3.7 (2)4.5 (2)4.7 (2)4.8 (2)5.7 (1)5.7 (1)5.4 (1.0)15/15
NIPOPaCMA loshchilov 3.8 (5)5.4 (3)5.8 (3)5.3 (2)5.4 (1)5.8 (1.0)5.6 (0.7)15/15
PSO-BFGS voglis 3.0 (0.2)2.2 (0.3)1.9 (0.3)1.6 (0.2)1.4 (0.2)1.2 (0.3)1.3 (0.6)15/15
SNES schaul 20 (45)71 (196)322 (460)819 (1218)1596 (1266)5282 (4445)2.4e4 (2e4)0/15
xNES schaul 7.5 (4)7.4 (8)7.4 (5)7.0 (4)7.1 (3)6.9 (4)6.6 (3)15/15
xNESas schaul 3.5 (2)4.6 (2)5.7 (4)5.9 (2)6.8 (5)7.1 (4)8.5 (3)15/15

Δ fopt
f14, 2-D
1e1
1
1e0
7.0
1e-1
16
1e-2
24
1e-3
38
1e-5
67
1e-7
90
#succ
15/15
ACOR liao 1.3 (0.5)2.8 (3)7.0 (2)8.3 (2)10 (2)49 (50)870 (886)15/15
BIPOPaCMA loshchilov 3.6 (6)2.4 (2)3.1 (2)4.1 (2)4.3 (2)5.4 (0.9)5.6 (1)15/15
BIPOPsaACM loshchilov 3.0 (4)3.0 (3)3.2 (2)4.1 (1)3.5 (0.8)2.8 (0.7)3.0 (0.9)15/15
CMAES posik 2.9 (4)2.6 (3)3.5 (2)4.0 (1)4.7 (2)6.5 (2)7.5 (1)15/15
CMA brockhoff 3.3 (6)3.8 (4)3.7 (2)4.4 (2)4.8 (2)6.4 (2)6.7 (1)15/15
CMAa brockhoff 4.4 (4)3.7 (2)4.0 (2)4.8 (2)4.8 (2)5.4 (1)5.7 (2)15/15
CMAm brockhoff 3.5 (4)3.1 (4)3.2 (3)4.1 (2)4.0 (2)5.9 (2)7.2 (1)15/15
CMAma brockhoff 2.9 (4)3.4 (3)4.2 (2)4.2 (2)5.5 (2)5.5 (1)6.1 (0.8)15/15
CMAmah brockhoff 2.8 (3)1.8 (2)2.3 (0.9)3.1 (1)4.1 (2)6.4 (1)8.0 (0.8)15/15
CMAmh brockhoff 2.7 (2)2.6 (2)2.8 (1)4.1 (1)5.8 (3)9.0 (3)10 (4)15/15
DBRCGA chuang 1.7 (0.5)3.1 (3)6.8 (5)8.6 (2)8.8 (2)12 (6)21 (15)15/15
DE-AUTO voglis 2.3 (2)3.9 (4)3.5 (1)2.8 (0.3)2.0 (0.3)1.4 (0.2)6.1 (5)15/15
DE-BFGS voglis 3.3 (2)3.0 (2)3.7 (0.3)2.8 (0.3)2.0 (0.2)1.4 (0.1)2.7 (3)15/15
DE-ROLL voglis 1.8 (2)2.9 (3)5.3 (2)6.0 (3)58 (79)148 (97)446 (670)14/15
DE-SIMPLEX voglis 1.5 (1)4.0 (4)3.8 (0.3)3.0 (0.4)2.3 (0.3)1.7 (0.3)1.5 (0.2)15/15
DEAE posik 4.4 (5)2.8 (3)5.8 (4)9.0 (3)7.3 (2)7.1 (1)7.5 (0.9)15/15
DE posik 2.1 (2)3.1 (3)5.1 (4)8.5 (4)9.1 (2)10 (4)12 (3)15/15
DEb posik 2.1 (2)3.1 (3)5.1 (4)8.5 (4)9.1 (2)10 (4)12 (3)15/15
DEctpb posik 2.7 (2)4.2 (3)7.4 (4)8.4 (4)9.0 (3)11 (3)12 (3)15/15
IPOPsaACM loshchilov 6.9 (10)4.9 (4)3.5 (2)3.9 (2)3.8 (1)3.1 (0.9)3.0 (0.7)15/15
JADE posik 2.8 (3)2.3 (2)4.1 (2)4.8 (2)5.5 (2)6.2 (2)6.7 (2)15/15
JADEb posik 3.5 (2)4.6 (4)3.9 (2)4.5 (2)5.0 (2)5.1 (1)6.0 (3)15/15
JADEctpb posik 2.8 (3)2.3 (2)4.1 (2)4.8 (2)5.5 (2)6.2 (2)6.7 (2)15/15
MVDE melo 2.2 (2)5.2 (4)14 (6)20 (5)21 (6)31 (7)41 (12)15/15
NBIPOPaCMA loshchilov 4.3 (4)2.5 (2)3.4 (3)4.2 (2)4.5 (2)5.6 (0.9)6.1 (1.0)15/15
NIPOPaCMA loshchilov 3.7 (4)3.1 (3)3.1 (3)4.5 (2)4.7 (2)5.0 (0.9)5.6 (1)15/15
PSO-BFGS voglis 2.5 (2)4.9 (4)4.1 (0.4)3.0 (0.4)2.2 (0.2)1.5 (0.1)13 (1)15/15
SNES schaul 5.8 (9)3.5 (4)2.9 (2)4.8 (3)19 (25)1976 (2885)7551 (1e4)1/15
xNES schaul 5.3 (9)3.4 (2)3.8 (2)6.2 (4)5.8 (3)5.9 (2)6.2 (2)15/15
xNESas schaul 1.8 (2)2.4 (4)2.7 (2)5.0 (1)4.6 (1)5.1 (1)5.3 (2)15/15

Δ fopt
f15, 2-D
1e1
37
1e0
291
1e-1
1033
1e-2
1066
1e-3
1113
1e-5
1231
1e-7
1412
#succ
15/15
ACOR liao 2.1 (2)2.3 (1)11 (26)11 (25)11 (24)10 (22)9.0 (19)15/15
BIPOPaCMA loshchilov 1.4 (1)1.8 (2)2.7 (2)2.7 (2)2.6 (2)2.5 (2)2.2 (2)15/15
BIPOPsaACM loshchilov 2.4 (5)2.0 (1)2.8 (3)2.7 (3)2.7 (3)2.5 (2)2.2 (2)15/15
CMAES posik 1.1 (1.0)2.6 (3)3.8 (4)3.7 (4)3.6 (4)3.3 (4)2.9 (3)15/15
CMA brockhoff 0.93 (0.7)2.5 (4)2.9 (1)3.0 (2)2.9 (1)2.8 (1)2.5 (1)15/15
CMAa brockhoff 1.4 (0.8)2.0 (2)2.0 (3)2.0 (3)2.0 (3)1.9 (3)1.7 (2)15/15
CMAm brockhoff 1.2 (1.0)1.8 (1)1.9 (2)2.5 (2)2.4 (2)2.3 (2)2.1 (2)15/15
CMAma brockhoff 1.3 (1)3.1 (4)2.4 (2)2.6 (2)2.6 (2)2.5 (2)2.2 (2)15/15
CMAmah brockhoff 1.2 (1)2.9 (4)2.7 (2)2.8 (2)2.7 (2)2.6 (2)2.4 (2)15/15
CMAmh brockhoff 2.6 (7)3.8 (4)2.6 (2)2.8 (2)2.7 (2)2.6 (2)2.4 (2)15/15
DBRCGA chuang 1.8 (2)2.4 (3)1.8 (2)1.8 (2)1.8 (2)1.8 (2)1.6 (1)15/15
DE-AUTO voglis 7.5 (12)10 (9)6.9 (6)6.7 (6)6.4 (6)5.8 (5)5.1 (4)15/15
DE-BFGS voglis 1.4 (0.7)0.71 (0.7)0.46 (0.4)↑10.45 (0.4)↑10.44 (0.4)↑00.41 (0.4)↑00.36 (0.3)↑015/15
DE-ROLL voglis 3.5 (1.0)4.5 (7)7.3 (6)7.2 (6)6.9 (6)6.3 (5)5.6 (5)15/15
DE-SIMPLEX voglis 2.7 (5)1.7 (1)2.8 (4)2.7 (3)2.6 (3)2.4 (3)2.1 (3)15/15
DEAE posik 1.8 (2)1.8 (1)1.4 (2)1.4 (2)1.4 (2)1.3 (1)1.3 (1)15/15
DE posik 2.6 (2)1.9 (1)1.8 (3)1.9 (3)1.9 (3)1.8 (2)1.7 (2)15/15
DEb posik 2.6 (2)1.9 (1)1.8 (3)1.9 (3)1.9 (3)1.8 (2)1.7 (2)15/15
DEctpb posik 2.3 (2)2.6 (1)1.2 (0.7)1.5 (0.6)1.6 (0.4)1.7 (0.7)1.7 (0.5)15/15
IPOPsaACM loshchilov 1.3 (1)2.6 (3)1.4 (1)1.9 (2)1.8 (2)1.7 (2)1.5 (2)15/15
JADE posik 1.1 (0.7)1.4 (0.5)0.95 (0.8)1.0 (0.9)1.1 (0.8)1.1 (0.7)1.1 (0.6)15/15
JADEb posik 1.3 (0.9)3.4 (4)3.4 (3)3.4 (3)3.3 (3)3.0 (3)2.7 (2)15/15
JADEctpb posik 1.1 (0.7)1.4 (0.5)0.95 (0.8)1.0 (0.9)1.1 (0.8)1.1 (0.7)1.1 (0.6)15/15
MVDE melo 2.7 (2)4.9 (2)244 (485)237 (470)227 (450)206 (407)180 (355)12/15
NBIPOPaCMA loshchilov 1.4 (0.9)2.6 (4)2.8 (4)3.1 (4)3.0 (4)2.8 (3)2.6 (3)15/15
NIPOPaCMA loshchilov 1.7 (1)3.7 (3)2.8 (3)2.8 (3)2.9 (3)2.7 (3)2.4 (3)15/15
PSO-BFGS voglis 2.0 (1)2.8 (2)2.0 (2)2.0 (2)1.9 (2)1.7 (1)1.5 (1)15/15
SNES schaul 1.5 (2)5.9 (7)10 (13)10 (12)10 (12)8.9 (11)7.8 (9)15/15
xNES schaul 13 (28)9.5 (10)15 (17)18 (21)17 (20)15 (18)13 (16)15/15
xNESas schaul 0.81 (0.7)4.0 (4)4.4 (4)4.5 (4)4.4 (4)4.0 (3)3.6 (3)15/15

Δ fopt
f16, 2-D
1e1
9.0
1e0
50
1e-1
174
1e-2
326
1e-3
358
1e-5
409
1e-7
538
#succ
15/15
ACOR liao 2.7 (5)4.6 (4)5.1 (5)17 (20)36 (29)43 (26)33 (20)15/15
BIPOPaCMA loshchilov 1.5 (2)2.6 (0.9)2.8 (3)2.3 (2)2.8 (2)2.7 (2)2.2 (1)15/15
BIPOPsaACM loshchilov 3.2 (2)4.4 (7)5.1 (3)3.6 (3)4.4 (5)4.7 (4)3.8 (3)15/15
CMAES posik 4.7 (7)7.4 (11)3.6 (6)2.7 (3)2.6 (3)2.4 (2)1.9 (2)15/15
CMA brockhoff 5.2 (8)8.5 (13)4.2 (4)3.7 (4)3.5 (3)3.3 (3)2.6 (2)15/15
CMAa brockhoff 4.7 (4)11 (13)6.3 (8)3.8 (4)3.8 (4)4.0 (4)3.2 (3)15/15
CMAm brockhoff 2.5 (2)5.8 (9)4.6 (7)3.1 (4)3.4 (4)3.5 (3)2.8 (3)15/15
CMAma brockhoff 8.9 (9)10 (10)4.4 (3)3.1 (3)4.2 (3)4.1 (3)3.3 (2)15/15
CMAmah brockhoff 4.0 (5)6.5 (11)5.6 (8)10 (6)11 (6)10 (5)8.2 (4)15/15
CMAmh brockhoff 10 (4)13 (11)6.9 (6)4.5 (5)4.6 (4)4.6 (4)3.7 (3)15/15
DBRCGA chuang 2.3 (4)2.4 (3)5.4 (7)4.6 (4)6.2 (6)8.4 (9)6.7 (7)15/15
DE-AUTO voglis 3.2 (3)33 (53)32 (39)24 (35)25 (32)38 (33)34 (63)15/15
DE-BFGS voglis 2.7 (1)6.1 (10)4.5 (4)4.9 (1)5.4 (2)6.5 (1)14 (8)14/15
DE-ROLL voglis 3.2 (3)26 (35)33 (45)27 (35)41 (39)47 (49)115 (187)12/15
DE-SIMPLEX voglis 1.3 (1)5.4 (7)2.8 (4)2.2 (3)2.1 (2)2.2 (2)1.8 (2)15/15
DEAE posik 4.6 (5)5.7 (4)2.7 (2)1.9 (1)2.4 (2)3.2 (3)2.6 (2)15/15
DE posik 4.1 (4)4.8 (4)5.4 (7)3.4 (4)3.5 (4)3.5 (3)3.4 (3)15/15
DEb posik 4.1 (4)4.8 (4)5.4 (7)3.4 (4)3.5 (4)3.5 (3)3.4 (3)15/15
DEctpb posik 3.4 (3)3.8 (3)5.1 (3)4.9 (3)13 (8)19 (7)16 (6)15/15
IPOPsaACM loshchilov 3.8 (6)6.6 (8)4.3 (4)3.0 (3)3.0 (3)3.1 (2)2.9 (2)15/15
JADE posik 2.9 (2)3.8 (3)3.8 (2)2.6 (1)2.8 (2)3.2 (2)2.8 (1)15/15
JADEb posik 2.1 (3)4.3 (4)2.7 (5)2.1 (2)2.0 (2)2.0 (2)1.7 (2)15/15
JADEctpb posik 2.9 (2)3.8 (3)3.8 (2)2.6 (1)2.8 (2)3.2 (2)2.8 (1)15/15
MVDE melo 2.4 (2)2.4 (2)6.2 (6)225 (4)207 (4)183 (4)141 (3)14/15
NBIPOPaCMA loshchilov 3.3 (3)6.8 (11)4.0 (6)3.4 (5)3.5 (4)3.3 (4)2.6 (3)15/15
NIPOPaCMA loshchilov 3.4 (4)6.2 (8)4.0 (5)2.4 (3)2.5 (3)2.4 (3)2.0 (2)15/15
PSO-BFGS voglis 5.3 (7)9.4 (12)7.7 (8)10 (11)14 (13)22 (29)106 (130)12/15
SNES schaul 1.8 (2)5.1 (5)4.7 (7)4.4 (7)6.7 (8)12 (19)12 (20)14/15
xNES schaul 3.4 (4)13 (23)6.5 (12)5.0 (6)5.4 (6)5.0 (5)3.9 (4)15/15
xNESas schaul 3.2 (4)5.4 (11)3.8 (4)3.9 (5)3.7 (4)4.4 (6)4.6 (5)15/15

Δ fopt
f17, 2-D
1e1
3.0
1e0
61
1e-1
133
1e-2
275
1e-3
396
1e-5
1086
1e-7
1657
#succ
15/15
ACOR liao 1.2 (1)0.94 (0.8)2.1 (0.7)1.7 (0.5)1.8 (0.3)1.1 (0.2)0.98 (0.2)15/15
BIPOPaCMA loshchilov 17 (12)3.4 (5)2.8 (3)1.9 (1)1.6 (1)1.6 (1)1.4 (0.8)15/15
BIPOPsaACM loshchilov 2.8 (3)1.2 (0.7)2.1 (2)2.0 (1)2.2 (1)2.4 (1)1.7 (1)15/15
CMAES posik 2.1 (2)1.5 (1)2.3 (3)2.0 (2)2.0 (4)2.9 (3)2.7 (3)15/15
CMA brockhoff 3.0 (2)1.8 (1)1.9 (3)1.4 (1)2.1 (1)1.6 (1)1.3 (0.6)15/15
CMAa brockhoff 1.7 (2)0.78 (0.6)1.7 (2)1.8 (2)1.7 (1)1.4 (0.6)1.1 (0.5)15/15
CMAm brockhoff 3.8 (4)1.4 (1)3.0 (3)1.9 (1)1.7 (1)1.3 (0.9)0.99 (0.7)15/15
CMAma brockhoff 1.6 (2)1.3 (0.6)1.6 (2)1.2 (1)1.3 (0.9)1.1 (0.9)0.82 (0.7)15/15
CMAmah brockhoff 1.9 (2)3.9 (5)2.8 (4)2.1 (2)2.0 (2)1.7 (1)1.3 (0.8)15/15
CMAmh brockhoff 3.2 (3)5.2 (9)3.1 (4)2.1 (2)2.3 (2)1.8 (1)1.6 (0.8)15/15
DBRCGA chuang 1.5 (1)2.1 (1)2.6 (1)2.3 (0.9)3.2 (4)5.0 (7)3.5 (4)15/15
DE-AUTO voglis 1.2 (1)6.9 (9)9.0 (11)10 (13)10 (12)7.6 (5)5.0 (3)15/15
DE-BFGS voglis 1.8 (2)2.2 (2)3.9 (2)3.6 (1)4.1 (0.8)2.5 (0.5)4.1 (3)15/15
DE-ROLL voglis 2.1 (2)3.7 (5)6.2 (4)5.9 (3)5.4 (3)4.4 (1)3.0 (1)15/15
DE-SIMPLEX voglis 1.6 (1)6.5 (6)6.7 (5)4.7 (3)3.9 (3)2.1 (1)337 (362)3/15
DEAE posik 2.3 (2)1.7 (1)1.8 (0.7)1.6 (0.6)1.8 (0.5)2.5 (3)1.9 (2)15/15
DE posik 2.7 (3)1.5 (1)3.1 (0.9)2.2 (0.8)2.5 (0.5)2.1 (2)1.6 (1)15/15
DEb posik 2.7 (3)1.5 (1)3.1 (0.9)2.2 (0.8)2.5 (0.5)2.1 (2)1.6 (1)15/15
DEctpb posik 1.6 (2)2.1 (1)2.6 (1.0)2.3 (0.5)2.3 (0.6)1.6 (0.4)1.4 (0.4)15/15
IPOPsaACM loshchilov 3.8 (7)1.5 (0.7)2.0 (2)2.1 (2)2.1 (1)2.0 (0.9)1.7 (1)15/15
JADE posik 2.4 (2)1.2 (0.6)1.5 (0.5)1.2 (0.4)1.3 (0.2)1.2 (0.8)0.95 (0.6)15/15
JADEb posik 1.5 (2)1.0 (0.7)1.0 (0.3)0.83 (0.2)19 (1)8.7 (2)5.8 (2)14/15
JADEctpb posik 2.4 (2)1.2 (0.6)1.5 (0.5)1.2 (0.4)1.3 (0.2)1.2 (0.8)0.95 (0.6)15/15
MVDE melo 1.4 (0.8)2.1 (2)5.4 (2)5.0 (2)5.7 (1)69 (1.0)47 (0.9)14/15
NBIPOPaCMA loshchilov 3.7 (4)1.7 (0.5)1.4 (0.4)0.97 (0.2)1.2 (1)1.4 (1)1.1 (0.8)15/15
NIPOPaCMA loshchilov 1.7 (2)1.7 (0.8)1.4 (0.5)1.00 (0.4)1.4 (1)1.2 (0.6)1.1 (0.9)15/15
PSO-BFGS voglis 1.5 (1)10 (8)12 (7)8.3 (5)9.0 (3)5.8 (1)16 (18)12/15
SNES schaul 6.5 (14)3.6 (2)3.4 (7)3.1 (4)2.5 (3)5.9 (10)6.4 (8)15/15
xNES schaul 11 (28)8.0 (17)6.2 (8)5.9 (7)6.7 (8)15 (23)13 (14)15/15
xNESas schaul 3.7 (5)7.9 (17)4.3 (8)6.8 (8)12 (20)25 (17)25 (22)15/15

Δ fopt
f18, 2-D
1e1
19
1e0
134
1e-1
666
1e-2
1249
1e-3
1708
1e-5
2438
1e-7
2858
#succ
15/15
ACOR liao 1.6 (2)2.6 (2)1.5 (1)1.4 (0.9)1.9 (1)2.4 (1)3.0 (2)15/15
BIPOPaCMA loshchilov 2.1 (2)4.4 (6)2.2 (3)1.6 (1)1.3 (0.8)1.1 (0.6)1.2 (1)15/15
BIPOPsaACM loshchilov 3.3 (2)1.8 (2)0.84 (0.7)0.61 (1.0)0.71 (0.7)1.4 (1)1.7 (2)15/15
CMAES posik 1.5 (1)5.1 (7)2.0 (2)1.6 (2)1.5 (1)9.1 (12)10 (10)14/15
CMA brockhoff 1.4 (2)3.8 (4)1.6 (1)1.0 (0.8)0.84 (0.6)0.91 (0.4)0.91 (0.4)15/15
CMAa brockhoff 1.3 (1)2.7 (3)1.4 (1)0.90 (0.8)0.93 (0.6)0.92 (0.4)0.91 (0.3)15/15
CMAm brockhoff 3.2 (1)6.3 (7)2.1 (1)1.4 (0.8)1.3 (0.5)1.4 (0.9)1.3 (0.8)15/15
CMAma brockhoff 3.3 (1)5.3 (7)1.6 (1)1.1 (0.6)0.98 (0.5)1.0 (0.4)1.00 (0.4)15/15
CMAmah brockhoff 1.3 (1)5.3 (5)1.9 (2)1.4 (0.8)1.4 (0.4)1.2 (0.4)1.1 (0.3)15/15
CMAmh brockhoff 1.2 (1)7.7 (8)2.6 (2)1.9 (0.8)1.6 (0.6)1.3 (0.3)1.2 (0.3)15/15
DBRCGA chuang 1.5 (2)1.8 (1)1.7 (2)4.3 (6)7.7 (18)18 (20)16 (17)15/15
DE-AUTO voglis 1.8 (1)12 (23)6.6 (8)6.0 (5)5.6 (4)5.7 (2)4.9 (2)15/15
DE-BFGS voglis 2.5 (5)5.8 (4)1.9 (0.7)1.6 (0.8)1.6 (0.5)1.8 (0.4)8.6 (11)4/15
DE-ROLL voglis 2.3 (1)4.5 (5)2.7 (2)2.9 (1)2.9 (1)5.1 (2)24 (42)11/15
DE-SIMPLEX voglis 3.2 (5)9.2 (7)2.9 (1)2.1 (0.6)1.9 (0.7)1.8 (0.8)103 (107)1/15
DEAE posik 2.0 (2)1.5 (0.6)0.56 (0.2)↑00.63 (0.2)↑10.60 (0.1)↑11.0 (0.9)0.99 (0.8)15/15
DE posik 3.1 (3)3.1 (2)1.4 (1)1.4 (2)2.3 (2)3.8 (4)3.5 (4)15/15
DEb posik 3.1 (3)3.1 (2)1.4 (1)1.4 (2)2.3 (2)3.8 (4)3.5 (4)15/15
DEctpb posik 1.9 (2)1.7 (1.0)0.93 (0.2)0.84 (0.2)0.85 (0.2)1.1 (0.2)1.2 (0.6)15/15
IPOPsaACM loshchilov 2.0 (2)3.0 (3)1.4 (1)0.90 (0.7)0.83 (0.6)1.1 (0.6)1.4 (1)15/15
JADE posik 2.1 (1)1.5 (0.4)0.63 (0.3)↑10.47 (0.2)↑00.47 (0.1)↑00.68 (0.5)0.69 (0.4)15/15
JADEb posik 1.5 (1)1.4 (0.7)11 (0.7)6.5 (1)5.0 (0.9)18 (22)15 (18)11/15
JADEctpb posik 2.1 (1)1.5 (0.4)0.63 (0.3)↑10.47 (0.2)↑00.47 (0.1)↑00.68 (0.5)0.69 (0.4)15/15
MVDE melo 3.3 (3)3.7 (3)2.1 (0.6)59 (1)44 (0.9)32 (1)28 (0.8)14/15
NBIPOPaCMA loshchilov 4.9 (3)4.6 (3)2.6 (2)1.6 (1)1.4 (1)1.3 (0.8)1.3 (0.7)15/15
NIPOPaCMA loshchilov 1.8 (1)2.6 (3)0.72 (0.6)1.0 (0.9)0.88 (0.7)0.84 (0.4)0.82 (0.3)15/15
PSO-BFGS voglis 6.8 (11)11 (12)4.5 (3)3.7 (1.0)3.8 (2)5.0 (1)24 (19)2/15
SNES schaul 1.5 (2)11 (15)18 (24)44 (55)81 (95)181 (213)156 (181)5/15
xNES schaul 1.7 (1)13 (16)4.9 (4)3.8 (5)3.9 (4)12 (13)18 (17)14/15
xNESas schaul 28 (82)13 (15)5.3 (6)5.5 (5)7.0 (5)12 (12)17 (14)14/15

Δ fopt
f19, 2-D
1e1
1
1e0
1
1e-1
26
1e-2
216
1e-3
227
1e-5
252
1e-7
276
#succ
15/15
ACOR liao 3.6 (4)38 (28)7.0 (9)72 (258)72 (246)70 (229)68 (209)15/15
BIPOPaCMA loshchilov 5.3 (6)21 (23)7.6 (6)21 (22)21 (22)21 (20)20 (19)15/15
BIPOPsaACM loshchilov 5.0 (4)24 (16)11 (17)12 (21)16 (22)23 (24)21 (22)15/15
CMAES posik 5.6 (6)198 (508)25 (23)19 (22)22 (21)20 (19)19 (17)15/15
CMA brockhoff 5.4 (6)58 (41)5.2 (6)7.8 (7)12 (13)11 (12)11 (12)15/15
CMAa brockhoff 10 (11)42 (31)11 (8)10 (15)10 (15)11 (13)11 (12)15/15
CMAm brockhoff 4.5 (4)77 (44)14 (21)7.6 (6)12 (12)15 (14)14 (14)15/15
CMAma brockhoff 4.5 (6)137 (380)15 (24)15 (21)25 (35)24 (33)24 (30)15/15
CMAmah brockhoff 3.5 (2)48 (46)8.3 (16)21 (29)22 (28)30 (26)29 (24)15/15
CMAmh brockhoff 7.1 (6)78 (48)17 (22)7.7 (11)9.0 (11)8.5 (10)8.1 (9)15/15
DBRCGA chuang 3.9 (2)33 (33)6.3 (5)13 (14)15 (18)15 (17)15 (16)15/15
DE-AUTO voglis 3.3 (2)86 (34)54 (58)84 (108)81 (102)76 (92)70 (84)15/15
DE-BFGS voglis 4.3 (4)61 (80)11 (10)25 (53)24 (50)21 (45)31 (41)15/15
DE-ROLL voglis 2.9 (2)76 (127)12 (9)64 (123)65 (117)66 (104)160 (173)11/15
DE-SIMPLEX voglis 4.3 (4)77 (104)17 (18)43 (133)41 (126)37 (114)34 (104)15/15
DEAE posik 3.5 (2)54 (54)10 (7)234 (348)223 (441)202 (299)185 (182)10/15
DE posik 3.4 (2)55 (38)10 (8)125 (233)120 (225)109 (202)100 (184)12/15
DEb posik 3.4 (2)55 (38)10 (8)125 (234)120 (224)109 (204)100 (184)12/15
DEctpb posik 4.0 (4)73 (86)9.3 (9)76 (232)75 (221)69 (199)66 (182)13/15
IPOPsaACM loshchilov 4.7 (7)33 (34)7.9 (4)9.5 (9)10 (9)17 (13)16 (13)15/15
JADE posik 3.6 (4)34 (26)6.7 (5)119 (232)115 (220)104 (203)96 (182)12/15
JADEb posik 4.3 (4)25 (30)5.5 (4)120 (236)116 (223)105 (204)96 (185)12/15
JADEctpb posik 3.6 (4)34 (26)6.7 (5)119 (232)115 (221)104 (199)96 (182)12/15
MVDE melo 8.6 (11)68 (70)12 (14)3244 (4631)3432 (6608)3095 (2979)3183 (3623)8/15
NBIPOPaCMA loshchilov 5.7 (5)32 (43)25 (32)27 (46)31 (43)31 (39)28 (36)15/15
NIPOPaCMA loshchilov 7.0 (7)93 (45)15 (23)32 (28)34 (26)36 (24)34 (22)15/15
PSO-BFGS voglis 7.2 (8)91 (76)21 (27)13 (12)13 (11)12 (10)27 (26)15/15
SNES schaul 5.7 (8)24 (20)7.6 (7)12 (14)16 (36)51 (101)168 (262)14/15
xNES schaul 4.1 (4)31 (37)11 (9)31 (25)33 (32)40 (59)37 (54)15/15
xNESas schaul 5.9 (8)38 (40)15 (18)50 (57)65 (81)69 (75)64 (66)15/15

Δ fopt
f20, 2-D
1e1
4.0
1e0
61
1e-1
365
1e-2
366
1e-3
366
1e-5
370
1e-7
375
#succ
15/15
ACOR liao 1.0 (2)3.7 (3)57 (70)58 (70)58 (70)58 (70)57 (69)15/15
BIPOPaCMA loshchilov 3.8 (5)6.9 (6)7.8 (8)12 (14)13 (15)13 (15)13 (15)15/15
BIPOPsaACM loshchilov 3.6 (3)7.0 (8)5.3 (5)5.8 (6)5.9 (6)5.9 (6)6.0 (6)15/15
CMAES posik 2.3 (2)17 (19)21 (24)23 (24)23 (24)23 (24)23 (23)15/15
CMA brockhoff 4.1 (4)11 (14)8.2 (6)11 (19)11 (19)12 (21)12 (21)15/15
CMAa brockhoff 2.4 (3)9.5 (7)10 (11)12 (16)13 (23)14 (24)14 (24)15/15
CMAm brockhoff 2.2 (2)19 (19)16 (17)17 (17)17 (18)18 (19)19 (19)15/15
CMAma brockhoff 3.9 (5)14 (18)9.3 (11)11 (11)12 (12)12 (12)13 (12)15/15
CMAmah brockhoff 2.4 (2)14 (13)9.1 (6)11 (10)14 (11)14 (11)15 (11)15/15
CMAmh brockhoff 2.2 (2)12 (18)11 (11)12 (12)13 (12)13 (12)13 (12)15/15
DBRCGA chuang 2.2 (3)6.8 (6)4.8 (5)5.1 (5)5.2 (5)5.5 (5)5.8 (5)15/15
DE-AUTO voglis 1.7 (1)14 (26)42 (68)42 (67)42 (67)42 (67)41 (66)15/15
DE-BFGS voglis 3.4 (2)4.9 (3)12 (23)12 (23)12 (23)12 (22)12 (22)15/15
DE-ROLL voglis 1.6 (3)13 (19)30 (77)30 (76)30 (76)30 (76)30 (75)15/15
DE-SIMPLEX voglis 2.9 (2)5.0 (6)21 (15)21 (15)21 (15)21 (15)21 (15)15/15
DEAE posik 3.5 (3)5.6 (10)7.3 (9)7.4 (8)7.6 (9)7.8 (8)8.1 (8)15/15
DE posik 2.2 (3)5.1 (3)7.3 (7)7.5 (7)7.6 (7)8.0 (7)8.2 (7)15/15
DEb posik 2.2 (3)5.1 (3)7.3 (7)7.5 (7)7.6 (7)8.0 (7)8.2 (7)15/15
DEctpb posik 1.5 (2)2.7 (2)2.2 (3)2.6 (3)3.1 (3)3.6 (3)4.1 (3)15/15
IPOPsaACM loshchilov 2.4 (3)8.1 (11)6.9 (8)12 (13)13 (15)13 (15)13 (15)15/15
JADE posik 2.9 (3)3.8 (2)2.6 (4)2.9 (4)3.2 (4)3.6 (4)3.8 (4)15/15
JADEb posik 2.7 (4)7.7 (9)3.1 (3)3.2 (3)3.3 (3)3.5 (3)3.7 (3)15/15
JADEctpb posik 2.9 (3)3.8 (2)2.6 (4)2.9 (4)3.2 (4)3.6 (4)3.8 (4)15/15
MVDE melo 3.5 (5)7.3 (7)916 (1371)997 (1367)998 (2051)989 (1352)977 (1334)11/15
NBIPOPaCMA loshchilov 2.6 (3)8.1 (13)5.6 (6)7.1 (9)7.5 (9)7.6 (9)7.7 (9)15/15
NIPOPaCMA loshchilov 3.0 (4)12 (15)10 (9)11 (10)11 (10)13 (10)14 (10)15/15
PSO-BFGS voglis 6.1 (7)8.6 (9)4.9 (7)4.9 (7)4.9 (7)4.9 (7)4.8 (7)15/15
SNES schaul 5.3 (5)34 (50)18 (19)25 (24)29 (26)29 (26)29 (25)15/15
xNES schaul 6.1 (4)28 (34)22 (24)22 (23)22 (24)22 (23)22 (23)15/15
xNESas schaul 3.5 (3)27 (32)21 (26)21 (26)23 (26)23 (26)23 (25)15/15

Δ fopt
f21, 2-D
1e1
2.0
1e0
51
1e-1
174
1e-2
276
1e-3
290
1e-5
324
1e-7
330
#succ
15/15
ACOR liao 1.3 (1)1.1 (1)0.93 (0.7)1.1 (0.8)1.4 (0.6)1.6 (0.4)1.8 (0.5)15/15
BIPOPaCMA loshchilov 1.7 (2)5.5 (6)8.4 (11)6.6 (7)21 (7)22 (6)27 (6)15/15
BIPOPsaACM loshchilov 1.4 (1)3.9 (4)5.1 (6)3.6 (4)3.6 (4)5.0 (5)5.1 (5)15/15
CMAES posik 0.80 (0.5)10 (13)8.3 (12)5.3 (7)5.1 (7)4.7 (6)4.7 (6)15/15
CMA brockhoff 0.97 (1)6.1 (7)7.2 (7)4.8 (5)4.8 (5)4.7 (4)4.9 (4)15/15
CMAa brockhoff 0.77 (0.2)5.0 (7)3.8 (8)2.5 (5)2.6 (5)2.5 (5)2.6 (5)15/15
CMAm brockhoff 2.0 (2)7.2 (7)5.9 (9)4.0 (6)3.9 (5)3.7 (5)3.8 (5)15/15
CMAma brockhoff 1.2 (0.8)8.6 (15)8.0 (13)7.6 (16)7.7 (16)10 (15)21 (16)15/15
CMAmah brockhoff 1.7 (2)7.1 (7)6.9 (9)4.5 (5)4.4 (5)4.2 (5)4.2 (5)15/15
CMAmh brockhoff 1.1 (0.8)6.0 (10)3.5 (4)2.2 (2)2.2 (2)2.1 (2)3.0 (2)15/15
DBRCGA chuang 1.3 (1)1.3 (2)0.84 (0.8)0.78 (0.5)0.97 (0.4)1.2 (0.3)1.5 (0.4)15/15
DE-AUTO voglis 1 (0.5)19 (40)20 (19)13 (12)12 (11)11 (10)11 (10)15/15
DE-BFGS voglis 1.1 (0.8)2.3 (4)10 (11)6.2 (7)5.9 (7)5.4 (6)5.9 (6)15/15
DE-ROLL voglis 1.1 (0.8)15 (25)24 (55)15 (35)15 (33)14 (30)18 (30)15/15
DE-SIMPLEX voglis 1.1 (0.8)3.8 (6)19 (41)12 (26)11 (24)10 (22)10 (22)15/15
DEAE posik 1.3 (1)1.6 (2)2.6 (4)1.8 (3)1.9 (2)1.9 (2)2.1 (2)15/15
DE posik 0.90 (0.8)3.8 (2)4.4 (6)2.9 (4)3.0 (4)3.0 (3)3.2 (3)15/15
DEb posik 0.90 (0.8)3.8 (2)4.4 (6)2.9 (4)3.0 (4)3.0 (3)3.2 (3)15/15
DEctpb posik 1.2 (1)4.2 (6)2.8 (5)2.0 (3)2.3 (3)2.4 (3)2.8 (3)15/15
IPOPsaACM loshchilov 1.1 (1)6.7 (9)5.6 (8)4.0 (5)10 (6)10 (6)11 (6)15/15
JADE posik 0.90 (0.5)1.1 (1)4.0 (8)2.7 (5)2.8 (5)2.9 (4)3.1 (4)15/15
JADEb posik 1.2 (0.8)2.4 (2)3.6 (5)2.4 (3)2.3 (3)2.2 (3)2.3 (3)15/15
JADEctpb posik 0.90 (0.5)1.1 (1)4.0 (8)2.7 (5)2.8 (5)2.9 (4)3.1 (4)15/15
MVDE melo 1.1 (1)1.8 (2)384 (2)243 (1)248 (2)224 (2)221 (3)14/15
NBIPOPaCMA loshchilov 1 (0.5)22 (39)10 (11)9.0 (12)8.6 (11)7.8 (10)7.8 (10)15/15
NIPOPaCMA loshchilov 0.63 (0.2)13 (13)68 (34)45 (21)43 (21)39 (19)38 (20)15/15
PSO-BFGS voglis 1.0 (0.8)3.3 (4)2.6 (4)1.7 (2)1.6 (2)1.5 (2)16 (28)15/15
SNES schaul 0.93 (0.5)43 (59)23 (40)14 (25)14 (24)13 (22)13 (21)15/15
xNES schaul 1.1 (1)29 (42)21 (28)14 (18)14 (17)14 (15)14 (15)15/15
xNESas schaul 1.2 (1)19 (37)17 (38)11 (24)10 (23)9.4 (20)9.4 (20)15/15

Δ fopt
f22, 2-D
1e1
5.0
1e0
27
1e-1
168
1e-2
218
1e-3
249
1e-5
289
1e-7
306
#succ
15/15
ACOR liao 1.4 (1)2.2 (2)42 (151)34 (120)30 (105)28 (90)28 (88)15/15
BIPOPaCMA loshchilov 3.3 (4)16 (12)5.3 (10)5.6 (8)5.7 (7)5.2 (6)5.1 (6)15/15
BIPOPsaACM loshchilov 5.3 (2)10 (15)5.4 (8)4.8 (6)6.3 (6)6.8 (9)6.5 (8)15/15
CMAES posik 1.6 (2)8.2 (12)4.9 (4)5.3 (7)4.9 (6)4.4 (5)4.3 (5)15/15
CMA brockhoff 1.8 (2)6.4 (12)6.8 (12)16 (23)14 (22)62 (109)108 (228)14/15
CMAa brockhoff 1.4 (2)11 (12)7.5 (16)8.2 (16)7.9 (17)8.8 (16)11 (17)14/15
CMAm brockhoff 1.7 (2)19 (45)11 (8)8.7 (6)8.3 (6)8.9 (9)9.0 (9)15/15
CMAma brockhoff 8.4 (2)14 (21)6.7 (8)7.2 (7)7.9 (12)12 (16)12 (17)15/15
CMAmah brockhoff 6.6 (1)8.6 (17)11 (14)8.9 (11)7.9 (10)26 (31)129 (370)14/15
CMAmh brockhoff 1.6 (1)14 (17)10 (16)16 (25)40 (27)49 (81)104 (211)15/15
DBRCGA chuang 0.93 (0.8)2.3 (3)0.96 (0.9)1.1 (0.9)1.3 (0.9)1.4 (0.9)1.9 (1)15/15
DE-AUTO voglis 1.3 (1)8.7 (20)15 (7)11 (5)10 (5)8.6 (4)9.3 (4)15/15
DE-BFGS voglis 1.4 (2)2.2 (2)0.63 (0.6)0.61 (0.4)0.58 (0.3)↑10.53 (0.3)↑11.7 (2)15/15
DE-ROLL voglis 0.89 (1)8.2 (15)15 (24)14 (19)14 (18)23 (26)55 (56)15/15
DE-SIMPLEX voglis 1.5 (2)2.4 (4)2.8 (2)2.3 (1)2.1 (1)1.9 (1)1.8 (1)15/15
DEAE posik 2.3 (2)10 (20)2.5 (4)2.1 (3)2.0 (3)2.1 (3)2.2 (2)15/15
DE posik 1.1 (1)6.4 (5)4.5 (7)3.9 (5)3.7 (4)3.6 (4)3.8 (4)15/15
DEb posik 1.1 (1)6.4 (5)4.5 (7)3.9 (5)3.7 (4)3.6 (4)3.8 (4)15/15
DEctpb posik 1.4 (1)3.5 (3)2.1 (5)2.1 (3)2.1 (3)2.5 (3)2.8 (3)15/15
IPOPsaACM loshchilov 1.5 (2)10 (16)3.0 (5)2.9 (4)3.4 (4)6.3 (4)16 (3)15/15
JADE posik 1.2 (0.9)2.0 (2)1.7 (3)1.5 (3)1.5 (2)1.6 (2)1.9 (2)15/15
JADEb posik 1.2 (1)2.0 (2)5.7 (6)4.8 (5)4.3 (4)3.9 (3)3.9 (3)15/15
JADEctpb posik 1.2 (0.9)2.0 (2)1.7 (3)1.5 (3)1.5 (2)1.6 (2)1.9 (2)15/15
MVDE melo 1.1 (1)3.4 (3)2.0 (1)2.1 (1)3.3 (3)5.0 (3)5.8 (3)15/15
NBIPOPaCMA loshchilov 1.3 (0.7)10 (11)11 (11)10 (9)9.1 (8)8.2 (7)8.0 (6)15/15
NIPOPaCMA loshchilov 2.4 (2)55 (122)12 (20)10 (17)13 (29)12 (25)11 (24)15/15
PSO-BFGS voglis 1.3 (1)2.4 (2)1.1 (1)0.95 (1.0)0.85 (0.9)0.80 (0.8)17 (25)15/15
SNES schaul 2.5 (3)70 (94)40 (79)73 (64)105 (142)107 (132)141 (171)15/15
xNES schaul 2.0 (2)71 (110)27 (32)22 (25)20 (22)23 (27)21 (25)15/15
xNESas schaul 4.5 (3)45 (86)21 (27)20 (21)21 (21)18 (18)17 (17)15/15

Δ fopt
f23, 2-D
1e1
8.0
1e0
193
1e-1
234
1e-2
263
1e-3
299
1e-5
348
1e-7
379
#succ
15/15
ACOR liao 1.4 (2)10 (9)1019 (808)5.7e5 (6e5)1e70/15
BIPOPaCMA loshchilov 3.5 (3)5.6 (4)8.7 (11)8.0 (10)7.4 (9)6.8 (7)6.7 (7)15/15
BIPOPsaACM loshchilov 2.3 (2)7.9 (12)12 (14)11 (13)10 (11)11 (12)10 (11)15/15
CMAES posik 3.9 (4)6.3 (7)14 (10)13 (9)12 (10)11 (8)10 (8)15/15
CMA brockhoff 1.5 (1)4.1 (4)10 (9)10 (8)8.8 (7)8.2 (6)8.0 (6)15/15
CMAa brockhoff 1.4 (2)5.5 (7)22 (20)23 (17)20 (15)18 (14)17 (13)15/15
CMAm brockhoff 2.5 (2)7.5 (8)60 (23)123 (20)109 (18)94 (16)87 (15)14/15
CMAma brockhoff 2.5 (3)5.0 (6)15 (21)14 (19)12 (17)11 (15)11 (14)15/15
CMAmah brockhoff 2.4 (3)5.9 (7)13 (13)12 (11)11 (10)10 (9)10 (8)15/15
CMAmh brockhoff 2.4 (3)5.6 (6)17 (19)15 (18)14 (16)12 (14)12 (13)15/15
DBRCGA chuang 1.6 (2)9.4 (6)58 (68)68 (69)61 (61)53 (52)50 (48)15/15
DE-AUTO voglis 2.0 (3)1.4 (1)3.1 (3)3.3 (3)3.1 (2)2.9 (2)2.8 (1)15/15
DE-BFGS voglis 1.9 (2)2.4 (2)4.0 (4)4.9 (4)5.8 (5)12 (3)348 (584)2/15
DE-ROLL voglis 1.6 (2)5.2 (4)22 (22)28 (21)34 (25)36 (32)265 (628)10/15
DE-SIMPLEX voglis 1.3 (1)0.84 (0.6)0.78 (0.5)0.76 (0.5)0.72 (0.4)9.4 (3)500 (443)3/15
DEAE posik 7.4 (9)13 (11)63 (77)67 (72)60 (63)52 (58)49 (53)15/15
DE posik 2.8 (3)9.5 (12)30 (23)29 (21)26 (18)24 (16)24 (22)15/15
DEb posik 2.8 (3)9.5 (12)30 (23)29 (21)26 (18)24 (16)24 (22)15/15
DEctpb posik 2.2 (3)18 (23)229 (387)652 (627)1504 (2056)2016 (2609)1861 (2016)1/15
IPOPsaACM loshchilov 2.1 (3)7.4 (8)9.0 (9)9.5 (10)8.6 (9)8.5 (8)8.0 (7)15/15
JADE posik 2.3 (2)5.1 (6)48 (79)49 (76)50 (67)43 (58)40 (53)15/15
JADEb posik 2.1 (2)4.9 (5)18 (15)26 (13)23 (12)21 (10)20 (9)15/15
JADEctpb posik 2.3 (2)5.1 (6)48 (79)49 (76)50 (67)43 (58)40 (53)15/15
MVDE melo 0.97 (0.8)6.3 (4)2166 (2143)7640 (9506)6728 (5857)5787 (9343)5318 (1e4)5/15
NBIPOPaCMA loshchilov 1.8 (2)6.2 (8)12 (9)11 (8)11 (11)10 (9)9.3 (9)15/15
NIPOPaCMA loshchilov 2.3 (2)9.0 (8)16 (10)17 (9)15 (8)14 (7)13 (7)15/15
PSO-BFGS voglis 3.4 (4)1.9 (2)3.3 (4)3.6 (4)4.2 (4)44 (40)2e50/15
SNES schaul 2.0 (3)11 (12)305 (417)404 (710)461 (631)399 (422)477 (543)8/15
xNES schaul 1.4 (2)18 (19)95 (91)86 (80)79 (69)82 (73)79 (67)15/15
xNESas schaul 2.5 (4)15 (16)95 (128)109 (104)100 (89)87 (76)159 (160)0/15

Δ fopt
f24, 2-D
1e1
18
1e0
857
1e-1
8515
1e-2
23399
1e-3
24113
1e-5
24721
1e-7
24721
#succ
5/15
ACOR liao 2.1 (2)546 (779)59 (79)22 (29)21 (28)21 (27)21 (27)15/15
BIPOPaCMA loshchilov 1.3 (2)12 (13)28 (44)16 (17)15 (17)18 (17)18 (17)15/15
BIPOPsaACM loshchilov 1.5 (1)23 (39)10 (12)11 (8)19 (33)34 (35)34 (35)14/15
CMAES posik 1.9 (1)6.9 (9)5.9 (7)8.6 (8)8.4 (12)8.2 (7)8.2 (8)6/15
CMA brockhoff 4.3 (1)52 (71)130 (129)240 (317)233 (162)227 (292)227 (247)1/15
CMAa brockhoff 1.0 (1.0)119 (264)132 (154)113 (107)110 (107)107 (96)107 (134)2/15
CMAm brockhoff 1.7 (3)106 (382)95 (95)35 (52)46 (87)45 (45)45 (61)4/15
CMAma brockhoff 2.0 (2)73 (172)307 (435)240 (450)4e50/15
CMAmah brockhoff 1.6 (1)56 (137)130 (154)112 (107)109 (108)106 (89)106 (118)2/15
CMAmh brockhoff 1.2 (0.8)98 (178)133 (153)116 (98)113 (125)110 (101)110 (122)2/15
DBRCGA chuang 1.2 (2)4.8 (5)4.2 (6)5.0 (5)5.0 (5)4.9 (5)4.9 (5)12/15
DE-AUTO voglis 1.4 (2)79 (115)10 (12)4.1 (5)4.0 (5)3.9 (4)3.9 (4)11/15
DE-BFGS voglis 1.6 (2)41 (57)4.2 (6)1.6 (2)1.5 (2)1.5 (2)1.5 (2)15/15
DE-ROLL voglis 8.7 (1)314 (507)33 (51)12 (17)12 (12)12 (16)12 (12)7/15
DE-SIMPLEX voglis 1.1 (0.9)79 (64)8.1 (6)3.0 (2)2.9 (2)2.8 (2)2.8 (2)15/15
DEAE posik 1.6 (2)7.7 (8)5.0 (7)3.7 (5)3.6 (3)3.5 (3)3.5 (3)11/15
DE posik 2.0 (2)18 (16)3.1 (3)2.4 (2)2.4 (3)2.3 (2)2.3 (3)13/15
DEb posik 2.0 (2)18 (16)3.1 (3)2.4 (2)2.4 (3)2.3 (2)2.3 (2)13/15
DEctpb posik 1.5 (2)124 (198)15 (19)5.4 (7)5.3 (6)5.2 (6)5.2 (7)8/15
IPOPsaACM loshchilov 1.8 (2)58 (96)258 (411)365 (449)573 (726)559 (648)559 (514)2/15
JADE posik 2.1 (2)5.3 (12)1.9 (2)0.81 (0.8)0.80 (0.7)0.78 (0.7)0.79 (0.7)15/15
JADEb posik 2.2 (2)5.7 (4)2.9 (4)3.0 (3)3.0 (2)2.9 (3)2.9 (3)12/15
JADEctpb posik 2.1 (2)5.3 (12)1.9 (2)0.81 (0.8)0.80 (0.7)0.78 (0.7)0.79 (0.7)15/15
MVDE melo 1.8 (1)4670 (4377)470 (910)278 (299)270 (394)263 (273)263 (263)2/15
NBIPOPaCMA loshchilov 4.8 (2)6.9 (10)14 (28)7.5 (10)7.9 (10)7.8 (9)7.8 (9)15/15
NIPOPaCMA loshchilov 1.7 (1)38 (27)23 (28)21 (38)22 (38)22 (37)22 (37)14/15
PSO-BFGS voglis 1.4 (2)3.2 (2)0.97 (0.8)0.55 (0.5)0.53 (0.5)0.52 (0.5)0.52 (0.5)15/15
SNES schaul 16 (0.8)4.5 (7)4.9 (7)5.6 (6)13 (10)15 (12)15 (12)6/15
xNES schaul 3.7 (2)5.8 (7)10 (10)15 (22)20 (23)19 (18)19 (18)4/15
xNESas schaul 2.2 (1)7.7 (16)13 (14)21 (22)28 (30)27 (24)27 (30)4/15

Previous dimension | Dimension = 3 | Next dimension

Δ fopt
f1, 3-D
1e1
4.0
1e0
8.0
1e-1
8.0
1e-2
8.0
1e-3
8.0
1e-5
8.0
1e-7
8.0
#succ
15/15
ACOR liao 1.7 (2)6.8 (6)17 (6)28 (13)40 (7)59 (7)82 (7)15/15
BIPOPaCMA loshchilov 3.5 (4)4.7 (2)11 (3)17 (4)21 (4)32 (4)42 (6)15/15
BIPOPsaACM loshchilov 2.8 (3)4.0 (3)7.9 (2)10 (1)12 (0.8)15 (1)19 (1)15/15
CMAES posik 3.0 (3)5.4 (4)11 (4)18 (4)25 (5)36 (4)46 (6)15/15
CMA brockhoff 1.9 (2)5.6 (3)10 (3)16 (4)22 (5)33 (6)46 (3)15/15
CMAa brockhoff 2.6 (3)4.2 (3)9.0 (4)15 (4)20 (5)30 (7)41 (4)15/15
CMAm brockhoff 2.1 (2)4.4 (4)9.2 (3)13 (4)17 (3)25 (5)34 (4)15/15
CMAma brockhoff 2.9 (3)5.0 (3)9.5 (3)13 (4)18 (4)26 (5)35 (5)15/15
CMAmah brockhoff 2.5 (3)3.8 (3)7.0 (4)11 (2)15 (3)22 (3)30 (4)15/15
CMAmh brockhoff 2.0 (2)3.6 (2)7.7 (2)11 (3)16 (3)24 (5)33 (5)15/15
DBRCGA chuang 1.6 (2)15 (12)34 (22)61 (20)79 (27)129 (31)171 (34)15/15
DE-AUTO voglis 1.7 (2)5.8 (3)8.1 (0.1)8.1 (0.1)8.1 (0.1)8.1 (0.1)8.1 (0.1)15/15
DE-BFGS voglis 2.0 (2)5.8 (3)7.3 (0.2)7.3 (0.2)7.3 (0.2)7.3 (0.2)7.3 (0.2)15/15
DE-ROLL voglis 2.4 (2)10 (15)13 (12)13 (11)13 (11)13 (11)13 (11)15/15
DE-SIMPLEX voglis 2.5 (2)8.6 (4)12 (3)13 (3)15 (3)18 (3)21 (3)15/15
DEAE posik 2.3 (4)11 (6)22 (9)36 (14)54 (10)80 (13)107 (14)15/15
DE posik 2.1 (2)11 (4)21 (14)36 (9)49 (8)77 (11)102 (11)15/15
DEb posik 2.1 (2)11 (4)21 (14)36 (9)49 (8)77 (11)102 (11)15/15
DEctpb posik 3.2 (3)13 (6)27 (6)42 (11)58 (10)84 (12)116 (10)15/15
IPOPsaACM loshchilov 2.9 (3)5.5 (3)9.3 (1)11 (1)12 (2)16 (2)19 (2)15/15
JADE posik 3.1 (3)8.4 (6)18 (7)29 (5)42 (8)65 (8)87 (11)15/15
JADEb posik 2.1 (2)6.8 (5)14 (4)22 (7)28 (4)48 (5)64 (7)15/15
JADEctpb posik 3.1 (3)8.4 (6)18 (7)29 (5)42 (8)65 (8)87 (11)15/15
MVDE melo 1.4 (1)15 (12)49 (17)87 (16)125 (17)197 (26)285 (18)15/15
NBIPOPaCMA loshchilov 2.5 (3)5.0 (4)11 (5)16 (4)21 (4)33 (6)42 (8)15/15
NIPOPaCMA loshchilov 3.5 (4)5.7 (5)10 (6)17 (4)22 (7)34 (7)44 (7)15/15
PSO-BFGS voglis 1.6 (1)7.0 (0.2)7.4 (0.2)7.4 (0.2)7.4 (0.2)7.4 (0.2)7.4 (0.2)15/15
SNES schaul 3.5 (4)4.8 (3)9.2 (2)17 (6)27 (6)44 (6)62 (6)15/15
xNES schaul 3.5 (4)5.1 (2)12 (4)20 (4)29 (6)49 (7)67 (7)15/15
xNESas schaul 4.9 (4)5.7 (3)12 (4)20 (6)28 (4)45 (7)57 (7)15/15

Δ fopt
f2, 3-D
1e1
38
1e0
42
1e-1
43
1e-2
44
1e-3
45
1e-5
47
1e-7
48
#succ
15/15
ACOR liao 8.1 (2)9.3 (1)11 (0.8)12 (1)14 (1)17 (0.9)20 (1)15/15
BIPOPaCMA loshchilov 11 (4)12 (4)14 (3)15 (3)15 (3)17 (3)18 (3)15/15
BIPOPsaACM loshchilov 4.4 (1)4.4 (1)4.9 (0.9)5.2 (1)5.3 (0.9)5.6 (1)6.2 (1)15/15
CMAES posik 12 (5)17 (4)18 (3)19 (2)20 (2)21 (2)23 (2)15/15
CMA brockhoff 14 (4)16 (6)19 (2)19 (2)20 (2)21 (2)23 (2)15/15
CMAa brockhoff 11 (4)13 (2)14 (2)15 (1)16 (2)17 (2)18 (2)15/15
CMAm brockhoff 14 (6)17 (5)18 (3)19 (2)20 (2)20 (2)21 (2)15/15
CMAma brockhoff 11 (6)13 (5)14 (2)15 (2)16 (2)16 (2)18 (2)15/15
CMAmah brockhoff 16 (6)19 (2)19 (3)19 (2)20 (3)20 (2)21 (2)15/15
CMAmh brockhoff 21 (10)24 (6)26 (4)26 (4)26 (4)27 (4)28 (4)15/15
DBRCGA chuang 15 (4)20 (4)24 (6)26 (5)31 (7)37 (7)45 (7)15/15
DE-AUTO voglis 2.1 (0.2)2.0 (0.1)2.1 (0.2)2.2 (0.2)2.2 (0.2)2.4 (0.8)2.6 (0.8)15/15
DE-BFGS voglis 2.1 (0.2)2.0 (0.2)2.1 (0.3)2.1 (0.2)2.2 (0.3)2.3 (0.3)2.4 (0.3)15/15
DE-ROLL voglis 3.9 (3)3.7 (3)3.8 (3)3.7 (3)3.8 (3)4.0 (2)4.3 (2)15/15
DE-SIMPLEX voglis 2.7 (0.9)3.3 (1)3.8 (0.8)4.1 (0.7)4.2 (0.7)4.5 (0.7)4.9 (0.6)15/15
DEAE posik 11 (3)12 (1)15 (2)17 (2)19 (3)23 (4)27 (3)15/15
DE posik 9.5 (2)11 (2)13 (2)16 (2)18 (3)21 (2)28 (4)15/15
DEb posik 9.5 (2)11 (2)13 (2)16 (2)18 (3)21 (2)28 (4)15/15
DEctpb posik 10 (3)12 (2)15 (2)17 (2)19 (2)23 (1)28 (3)15/15
IPOPsaACM loshchilov 4.2 (1)4.3 (0.8)4.7 (1)4.9 (0.9)5.1 (1)5.6 (1)6.1 (1)15/15
JADE posik 7.8 (2)10 (2)12 (1)14 (1)15 (1)19 (2)23 (2)15/15
JADEb posik 6.3 (2)7.2 (2)8.5 (2)10 (1)11 (2)14 (2)17 (2)15/15
JADEctpb posik 7.8 (2)10 (2)12 (1)14 (1)15 (1)19 (2)23 (2)15/15
MVDE melo 23 (4)27 (5)33 (4)40 (6)46 (4)58 (5)70 (5)15/15
NBIPOPaCMA loshchilov 9.3 (4)11 (4)14 (4)15 (2)15 (2)17 (2)18 (2)15/15
NIPOPaCMA loshchilov 11 (6)13 (3)14 (2)15 (2)15 (3)17 (2)18 (2)15/15
PSO-BFGS voglis 2.1 (0.2)2.0 (0.3)2.1 (0.3)2.1 (0.3)2.2 (0.5)2.3 (0.5)2.5 (0.6)15/15
SNES schaul 6.8 (2)8.0 (2)9.4 (2)11 (2)11 (1)15 (2)17 (1)15/15
xNES schaul 10 (3)13 (4)14 (4)19 (7)21 (7)25 (6)28 (5)15/15
xNESas schaul 8.5 (3)10 (3)11 (4)12 (3)13 (3)15 (4)17 (3)15/15

Δ fopt
f3, 3-D
1e1
38
1e0
822
1e-1
830
1e-2
835
1e-3
842
1e-5
847
1e-7
853
#succ
15/15
ACOR liao 5.0 (2)11 (1)113 (122)113 (122)112 (121)112 (120)111 (119)15/15
BIPOPaCMA loshchilov 3.1 (1)4.3 (5)12 (17)12 (17)12 (17)12 (17)12 (18)15/15
BIPOPsaACM loshchilov 2.6 (1)2.1 (2)13 (17)13 (17)13 (17)13 (17)13 (17)15/15
CMAES posik 6.1 (5)5.3 (6)21 (16)21 (16)21 (15)21 (15)21 (15)15/15
CMA brockhoff 10 (16)4.0 (4)21 (23)39 (67)41 (69)42 (70)43 (71)15/15
CMAa brockhoff 7.7 (12)2.8 (2)23 (43)29 (50)30 (51)31 (53)32 (54)15/15
CMAm brockhoff 5.4 (11)2.2 (2)18 (13)20 (15)21 (15)21 (15)22 (15)15/15
CMAma brockhoff 3.2 (2)4.2 (7)11 (12)12 (13)12 (13)12 (13)13 (13)15/15
CMAmah brockhoff 7.2 (11)2.7 (3)27 (28)29 (29)33 (31)34 (32)34 (32)15/15
CMAmh brockhoff 4.4 (4)3.4 (2)30 (44)81 (115)86 (122)89 (126)90 (128)15/15
DBRCGA chuang 7.9 (3)1.9 (0.8)3.3 (2)3.6 (2)3.8 (2)4.1 (2)4.5 (2)15/15
DE-AUTO voglis 7.6 (12)3.1 (3)6.8 (6)6.8 (6)6.7 (6)6.7 (6)6.7 (6)15/15
DE-BFGS voglis 8.2 (9)1.4 (0.6)2.9 (3)2.9 (3)2.9 (3)2.9 (2)2.9 (2)15/15
DE-ROLL voglis 5.9 (6)1.4 (1)3.6 (2)3.6 (2)3.6 (2)3.6 (2)3.5 (2)15/15
DE-SIMPLEX voglis 11 (9)3.1 (2)8.7 (14)8.7 (14)8.6 (14)8.6 (14)8.6 (14)15/15
DEAE posik 6.3 (4)2.3 (2)6.3 (8)6.4 (8)6.5 (8)6.7 (8)6.9 (8)15/15
DE posik 4.8 (3)0.65 (0.3)↑01.6 (2)1.7 (2)1.8 (2)2.1 (2)2.3 (2)15/15
DEb posik 4.8 (3)0.65 (0.3)↑01.6 (2)1.7 (2)1.8 (2)2.1 (2)2.3 (2)15/15
DEctpb posik 4.7 (2)0.96 (0.5)1.3 (0.3)1.7 (0.4)1.9 (0.4)2.3 (0.3)2.6 (0.3)15/15
IPOPsaACM loshchilov 5.2 (3)3.4 (4)17 (21)57 (113)76 (116)76 (117)77 (117)15/15
JADE posik 3.4 (2)0.78 (0.3)1.2 (0.4)1.4 (0.2)1.5 (0.2)1.8 (0.3)2.1 (0.4)15/15
JADEb posik 3.5 (2)0.81 (1)4.1 (5)4.2 (5)4.2 (5)4.4 (5)4.5 (5)15/15
JADEctpb posik 3.4 (2)0.78 (0.3)1.2 (0.4)1.4 (0.2)1.5 (0.2)1.8 (0.3)2.1 (0.4)15/15
MVDE melo 8.8 (4)1.5 (0.3)1.8 (0.4)2.3 (0.3)2.8 (0.4)3.5 (0.3)4.2 (0.3)15/15
NBIPOPaCMA loshchilov 3.8 (2)6.8 (7)37 (37)42 (37)43 (36)43 (36)43 (36)15/15
NIPOPaCMA loshchilov 5.0 (3)3.9 (3)13 (13)43 (14)43 (14)43 (15)43 (15)15/15
PSO-BFGS voglis 14 (16)4.8 (4)9.0 (7)8.9 (7)8.9 (7)8.8 (7)8.8 (7)15/15
SNES schaul 4.3 (4)10 (9)47 (51)47 (51)46 (50)46 (50)46 (50)15/15
xNES schaul 3.0 (3)11 (11)69 (98)69 (98)69 (97)68 (96)68 (96)15/15
xNESas schaul 11 (23)7.1 (7)66 (59)65 (59)65 (58)65 (58)64 (57)15/15

Δ fopt
f4, 3-D
1e1
40
1e0
808
1e-1
866
1e-2
921
1e-3
952
1e-5
1015
1e-7
1044
#succ
15/15
ACOR liao 7.2 (4)81 (95)218 (147)205 (138)199 (134)187 (126)182 (122)15/15
BIPOPaCMA loshchilov 4.1 (3)183 (415)2702 (3647)3755 (3378)3633 (6248)3408 (4543)3313 (4311)8/15
BIPOPsaACM loshchilov 6.0 (4)47 (57)3273 (4207)3201 (2503)3097 (4313)2905 (3525)2825 (3492)9/15
CMAES posik 8.4 (13)19 (17)134 (118)126 (158)122 (109)114 (112)111 (109)11/15
CMA brockhoff 7.2 (5)390 (657)6e50/15
CMAa brockhoff 9.2 (14)621 (875)6e50/15
CMAm brockhoff 6.6 (11)538 (835)4728 (4391)6e50/15
CMAma brockhoff 6.7 (12)788 (1013)6e50/15
CMAmah brockhoff 10 (13)1039 (969)8694 (1e4)5e50/15
CMAmh brockhoff 15 (11)653 (997)5e50/15
DBRCGA chuang 9.0 (5)3.1 (2)5.9 (4)5.8 (3)5.7 (3)5.6 (3)5.7 (3)15/15
DE-AUTO voglis 19 (20)6.1 (5)16 (19)15 (17)14 (17)13 (16)13 (15)15/15
DE-BFGS voglis 13 (10)1.6 (0.7)5.6 (9)5.3 (9)5.2 (8)4.9 (8)4.8 (8)15/15
DE-ROLL voglis 5.7 (4)3.1 (2)6.1 (5)5.8 (5)5.6 (4)5.3 (4)5.2 (4)15/15
DE-SIMPLEX voglis 24 (17)5.3 (7)9.0 (7)8.5 (7)8.2 (7)7.7 (6)7.6 (6)15/15
DEAE posik 12 (8)6.9 (8)18 (12)18 (12)17 (11)16 (11)16 (10)15/15
DE posik 5.8 (2)1.5 (2)2.9 (2)2.9 (2)2.9 (2)3.0 (2)3.1 (2)15/15
DEb posik 5.8 (2)1.5 (2)2.9 (2)2.9 (2)2.9 (2)3.0 (2)3.1 (2)15/15
DEctpb posik 6.8 (3)1.6 (0.6)2.0 (2)2.2 (2)2.4 (2)2.6 (2)2.8 (2)15/15
IPOPsaACM loshchilov 8.6 (7)240 (357)1.6e4 (2e4)1.5e4 (1e4)1.5e4 (2e4)1.4e4 (1e4)1.3e4 (1e4)3/15
JADE posik 4.5 (2)1.7 (0.4)2.2 (2)2.3 (2)2.3 (2)2.5 (2)2.6 (2)15/15
JADEb posik 4.1 (2)2.9 (3)8.4 (9)8.0 (8)7.8 (8)7.5 (7)7.5 (7)15/15
JADEctpb posik 4.5 (2)1.7 (0.4)2.2 (2)2.3 (2)2.3 (2)2.5 (2)2.6 (2)15/15
MVDE melo 13 (4)2.1 (0.4)180 (577)170 (543)165 (525)155 (493)151 (479)13/15
NBIPOPaCMA loshchilov 10 (17)29 (27)243 (391)229 (367)221 (356)208 (333)202 (324)15/15
NIPOPaCMA loshchilov 3.9 (2)254 (377)1.1e4 (1e4)1.4e4 (2e4)1.3e4 (1e4)1.3e4 (2e4)1.2e4 (2e4)3/15
PSO-BFGS voglis 28 (31)11 (11)49 (49)46 (47)44 (45)42 (42)41 (41)15/15
SNES schaul 14 (38)28 (32)140 (133)132 (125)128 (121)120 (113)117 (110)14/15
xNES schaul 6.1 (4)37 (50)285 (276)268 (160)259 (324)244 (298)237 (255)9/15
xNESas schaul 5.0 (3)31 (31)136 (208)128 (196)124 (190)116 (178)113 (173)14/15

Δ fopt
f5, 3-D
1e1
7.0
1e0
7.0
1e-1
7.0
1e-2
7.0
1e-3
7.0
1e-5
7.0
1e-7
7.0
#succ
15/15
ACOR liao 6.9 (3)11 (2)12 (2)12 (3)12 (3)12 (3)12 (3)15/15
BIPOPaCMA loshchilov 3.2 (2)4.9 (2)5.0 (2)5.0 (2)5.0 (2)5.0 (2)5.0 (2)15/15
BIPOPsaACM loshchilov 4.0 (3)5.8 (3)6.0 (3)6.0 (3)6.0 (3)6.0 (3)6.0 (3)15/15
CMAES posik 3.5 (2)5.6 (3)5.8 (3)5.9 (3)5.9 (3)5.9 (3)5.9 (3)15/15
CMA brockhoff 2.7 (2)4.2 (3)4.7 (2)4.7 (2)4.7 (2)4.7 (2)4.7 (2)15/15
CMAa brockhoff 4.7 (2)6.3 (3)6.5 (2)6.5 (2)6.5 (2)6.5 (2)6.5 (2)15/15
CMAm brockhoff 2.8 (2)5.0 (2)5.2 (2)5.3 (2)5.3 (2)5.3 (2)5.3 (2)15/15
CMAma brockhoff 3.1 (1)4.3 (2)4.5 (2)4.5 (2)4.5 (2)4.5 (2)4.5 (2)15/15
CMAmah brockhoff 2.3 (1)3.9 (2)4.1 (2)4.1 (2)4.1 (2)4.1 (2)4.1 (2)15/15
CMAmh brockhoff 2.2 (1)3.6 (1)4.0 (1)4.1 (1)4.1 (1)4.1 (1)4.1 (1)15/15
DBRCGA chuang 5.2 (4)16 (9)17 (9)18 (8)18 (8)18 (8)18 (8)15/15
DE-AUTO voglis 5.4 (3)8.7 (0.4)8.7 (0.4)8.7 (0.4)8.7 (0.4)8.7 (0.4)8.7 (0.4)15/15
DE-BFGS voglis 4.8 (2)8.2 (2)8.4 (2)8.4 (2)8.4 (2)8.4 (2)8.4 (2)15/15
DE-ROLL voglis 4.8 (2)7.9 (2)8.3 (0.6)8.3 (0.6)8.3 (0.6)8.3 (0.6)8.3 (0.6)15/15
DE-SIMPLEX voglis 3.6 (2)16 (7)23 (9)31 (14)43 (20)82 (51)91 (50)15/15
DEAE posik 4.5 (3)8.6 (3)9.1 (4)9.1 (4)9.1 (4)9.1 (4)9.1 (4)15/15
DE posik 3.9 (2)7.7 (5)8.6 (4)8.6 (4)8.6 (4)8.6 (4)8.6 (4)15/15
DEb posik 3.9 (2)7.7 (5)8.6 (4)8.6 (4)8.6 (4)8.6 (4)8.6 (4)15/15
DEctpb posik 4.8 (3)11 (4)13 (5)13 (5)13 (5)13 (5)13 (5)15/15
IPOPsaACM loshchilov 3.8 (1)5.5 (3)5.8 (3)5.9 (3)5.9 (3)5.9 (3)5.9 (3)15/15
JADE posik 5.7 (3)14 (9)15 (10)16 (10)16 (10)16 (10)16 (10)15/15
JADEb posik 4.1 (2)8.4 (5)9.3 (5)9.5 (6)9.5 (6)9.5 (6)9.5 (6)15/15
JADEctpb posik 5.7 (3)14 (9)15 (10)16 (10)16 (10)16 (10)16 (10)15/15
MVDE melo 17 (11)48 (13)57 (17)59 (17)59 (17)59 (17)59 (17)15/15
NBIPOPaCMA loshchilov 3.3 (2)5.8 (3)6.1 (3)6.2 (3)6.2 (3)6.2 (3)6.2 (3)15/15
NIPOPaCMA loshchilov 3.7 (2)5.5 (3)6.0 (3)6.0 (3)6.0 (3)6.0 (3)6.0 (3)15/15
PSO-BFGS voglis 7.3 (3)10 (0.6)10 (0.6)10 (0.6)10 (0.6)10 (0.6)10 (0.6)15/15
SNES schaul 6.5 (4)11 (4)12 (4)12 (4)12 (4)12 (4)12 (4)15/15
xNES schaul 6.7 (5)11 (6)12 (7)12 (7)12 (7)12 (7)12 (7)15/15
xNESas schaul 5.4 (3)10 (5)10 (5)10 (5)10 (5)10 (5)10 (5)15/15

Δ fopt
f6, 3-D
1e1
34
1e0
56
1e-1
90
1e-2
117
1e-3
149
1e-5
215
1e-7
265
#succ
15/15
ACOR liao 2.4 (2)5.3 (2)5.7 (1)6.4 (1)6.6 (2)6.6 (1)7.2 (2)15/15
BIPOPaCMA loshchilov 2.8 (2)2.8 (1)2.8 (1)2.8 (0.8)2.7 (0.8)2.7 (0.4)2.8 (0.5)15/15
BIPOPsaACM loshchilov 2.5 (1)3.3 (2)2.9 (2)3.4 (2)3.1 (2)3.1 (1)3.2 (1)15/15
CMAES posik 2.2 (2)3.1 (2)3.1 (1)3.2 (0.8)3.3 (0.6)3.1 (0.6)3.2 (0.5)15/15
CMA brockhoff 2.2 (2)3.1 (1)3.0 (1)3.1 (0.7)3.0 (0.4)2.9 (0.4)2.9 (0.4)15/15
CMAa brockhoff 2.1 (2)3.0 (1.0)2.9 (0.5)3.0 (0.6)3.0 (0.7)2.8 (0.7)3.0 (0.5)15/15
CMAm brockhoff 2.1 (2)3.1 (2)3.1 (1)3.1 (1)3.1 (1)3.1 (0.6)3.3 (0.7)15/15
CMAma brockhoff 2.9 (2)3.1 (1.0)2.8 (0.9)2.9 (0.6)2.9 (0.6)2.9 (0.6)3.1 (0.4)15/15
CMAmah brockhoff 2.1 (2)2.8 (1)2.6 (2)2.5 (0.9)2.4 (0.8)2.2 (0.6)2.3 (0.4)15/15
CMAmh brockhoff 2.0 (2)2.6 (2)2.4 (0.9)2.5 (0.8)2.6 (0.6)2.3 (0.5)2.4 (0.5)15/15
DBRCGA chuang 5.0 (3)9.5 (5)10 (3)11 (4)11 (3)10 (2)10 (3)15/15
DE-AUTO voglis 2.4 (1)2.2 (0.7)1.6 (0.4)1.5 (0.5)1.3 (0.4)1.2 (0.5)1.5 (0.9)15/15
DE-BFGS voglis 2.7 (2)2.7 (0.8)2.2 (0.8)2.0 (0.8)1.7 (0.6)1.6 (0.8)2.1 (2)15/15
DE-ROLL voglis 27 (30)28 (37)25 (24)32 (40)28 (31)35 (59)51 (97)15/15
DE-SIMPLEX voglis 3.2 (2)2.8 (2)2.4 (1)2.0 (0.9)1.8 (0.9)1.6 (0.7)1.5 (0.6)15/15
DEAE posik 3.8 (2)5.8 (2)5.9 (2)6.3 (2)6.7 (1)6.7 (0.7)7.5 (2)15/15
DE posik 3.8 (3)7.3 (3)7.7 (2)8.6 (3)8.7 (2)8.9 (3)10 (4)15/15
DEb posik 3.8 (3)7.3 (3)7.7 (2)8.6 (3)8.7 (2)8.9 (3)10 (4)15/15
DEctpb posik 5.4 (3)7.8 (3)8.2 (3)8.9 (3)8.8 (3)9.2 (3)10 (3)15/15
IPOPsaACM loshchilov 2.8 (2)3.3 (1)2.9 (1)3.4 (2)3.4 (2)3.2 (2)3.6 (2)15/15
JADE posik 2.5 (1)4.7 (2)5.0 (1)5.4 (0.9)5.4 (1)5.5 (0.9)5.9 (0.9)15/15
JADEb posik 2.3 (2)3.6 (1)4.0 (1)4.5 (1)4.7 (0.9)4.9 (1)5.1 (1)15/15
JADEctpb posik 2.5 (1)4.7 (2)5.0 (1)5.4 (0.9)5.4 (1)5.5 (0.9)5.9 (0.9)15/15
MVDE melo 8.1 (4)14 (5)19 (6)24 (8)27 (8)35 (9)40 (10)15/15
NBIPOPaCMA loshchilov 2.3 (2)3.3 (2)3.0 (0.9)2.9 (0.8)2.9 (0.6)2.8 (0.4)2.9 (0.5)15/15
NIPOPaCMA loshchilov 2.9 (2)3.4 (1)3.0 (0.7)3.1 (0.6)3.0 (0.4)2.8 (0.4)2.9 (0.4)15/15
PSO-BFGS voglis 2.8 (1)2.8 (0.7)2.0 (0.4)1.8 (0.6)1.6 (0.5)1.5 (0.7)2.7 (1)15/15
SNES schaul 1.3 (1)2.7 (1)3.0 (0.8)3.3 (1)3.6 (1)5.1 (2)24 (3)15/15
xNES schaul 2.5 (3)3.3 (2)3.0 (1.0)3.8 (2)4.1 (1)4.3 (0.8)4.4 (0.6)15/15
xNESas schaul 2.4 (1)2.9 (1)3.1 (1)3.3 (0.7)3.2 (0.7)3.6 (0.7)3.8 (0.7)15/15

Δ fopt
f7, 3-D
1e1
11
1e0
65
1e-1
342
1e-2
464
1e-3
482
1e-5
482
1e-7
535
#succ
15/15
ACOR liao 3.9 (4)2.6 (1)5.6 (2)4.8 (1)4.8 (2)4.8 (2)4.7 (4)15/15
BIPOPaCMA loshchilov 3.3 (2)1.7 (1)0.74 (0.4)0.80 (0.4)0.85 (0.4)0.85 (0.4)0.89 (0.5)15/15
BIPOPsaACM loshchilov 3.3 (2)3.9 (5)1.4 (1)1.4 (1.0)1.5 (1)1.5 (1)1.4 (0.9)15/15
CMAES posik 3.3 (2)2.3 (1)1.0 (0.6)1.1 (1)1.5 (2)1.5 (2)1.6 (1)15/15
CMA brockhoff 2.7 (2)1.8 (1)1.2 (0.7)1.0 (0.5)1.0 (0.5)1.0 (0.5)1.0 (0.5)15/15
CMAa brockhoff 2.7 (1)1.6 (1)1.0 (0.5)0.95 (0.5)1.00 (0.4)1.00 (0.4)1.00 (0.3)15/15
CMAm brockhoff 3.8 (4)2.5 (2)1.4 (0.9)1.2 (0.6)1.4 (0.7)1.4 (0.7)1.4 (0.7)15/15
CMAma brockhoff 3.9 (4)1.7 (1)0.87 (0.7)0.78 (0.6)0.82 (0.5)0.82 (0.5)0.79 (0.5)15/15
CMAmah brockhoff 7.8 (3)3.3 (4)1.3 (2)1.2 (1)1.4 (1)1.4 (1)1.3 (1.0)15/15
CMAmh brockhoff 2.8 (3)2.9 (3)2.1 (1)1.8 (1.0)1.8 (0.9)1.8 (0.9)1.7 (0.9)15/15
DBRCGA chuang 5.7 (8)4.1 (3)2.0 (0.8)3.2 (4)3.6 (3)3.6 (3)3.8 (3)15/15
DE-AUTO voglis 3.2 (3)13 (17)6.0 (4)6.4 (5)7.4 (6)7.4 (6)6.7 (6)15/15
DE-BFGS voglis 5.5 (9)8.9 (22)2.2 (4)2.0 (3)2.2 (3)2.2 (3)11 (9)15/15
DE-ROLL voglis 4.6 (3)10 (9)4.6 (3)4.6 (3)5.3 (2)5.3 (2)7.3 (5)15/15
DE-SIMPLEX voglis 4.3 (4)4.3 (3)2.2 (0.7)1.8 (0.6)2.0 (0.6)2.0 (0.6)1.8 (0.5)15/15
DEAE posik 5.5 (5)2.5 (1)0.91 (0.4)0.97 (0.3)1.1 (0.4)1.1 (0.4)1.1 (0.3)15/15
DE posik 3.6 (4)3.4 (2)1.4 (0.9)25 (1)24 (1)24 (1)22 (1)14/15
DEb posik 3.6 (4)3.4 (2)1.4 (0.9)25 (1)24 (1)24 (1)22 (1)14/15
DEctpb posik 2.9 (3)3.4 (3)1.6 (0.9)1.8 (0.9)2.0 (1.0)2.0 (1.0)2.2 (1.0)15/15
IPOPsaACM loshchilov 2.7 (2)2.3 (3)0.89 (0.9)0.94 (1)1.1 (1.0)1.1 (1.0)1.1 (0.8)15/15
JADE posik 3.0 (2)2.0 (0.8)0.90 (0.3)1.1 (0.3)1.3 (0.4)1.3 (0.4)1.3 (0.3)15/15
JADEb posik 3.3 (4)1.8 (0.8)32 (0.4)81 (162)79 (156)79 (156)71 (140)12/15
JADEctpb posik 3.0 (2)2.0 (0.8)0.90 (0.3)1.1 (0.3)1.3 (0.4)1.3 (0.4)1.3 (0.3)15/15
MVDE melo 6.1 (5)5.2 (3)2.6 (1)3.8 (2)4.6 (2)4.6 (2)5.0 (1)15/15
NBIPOPaCMA loshchilov 3.9 (5)2.9 (2)0.88 (0.7)0.83 (0.7)0.92 (0.7)0.92 (0.7)1.0 (0.5)15/15
NIPOPaCMA loshchilov 2.9 (2)1.9 (1)0.99 (1)0.85 (1.0)0.87 (0.9)0.87 (0.9)1.0 (0.8)15/15
PSO-BFGS voglis 37 (51)110 (151)160 (258)130 (190)147 (192)147 (192)319 (642)6/15
SNES schaul 3.2 (2)18 (24)24 (34)22 (25)42 (38)42 (38)46 (66)15/15
xNES schaul 3.4 (3)14 (24)5.8 (9)4.5 (7)4.4 (6)4.4 (6)4.0 (6)15/15
xNESas schaul 3.0 (2)14 (46)8.1 (9)8.5 (13)9.1 (13)9.1 (13)8.4 (11)15/15

Δ fopt
f8, 3-D
1e1
27
1e0
45
1e-1
152
1e-2
179
1e-3
188
1e-5
198
1e-7
208
#succ
15/15
ACOR liao 5.9 (3)10 (4)18 (4)33 (9)54 (11)95 (16)129 (28)15/15
BIPOPaCMA loshchilov 3.0 (2)6.9 (5)3.7 (1)3.8 (2)4.0 (2)4.3 (1)4.5 (1)15/15
BIPOPsaACM loshchilov 4.1 (1)6.3 (7)2.5 (2)2.3 (2)2.4 (2)2.7 (2)2.7 (2)15/15
CMAES posik 3.7 (2)6.4 (5)3.8 (3)4.2 (2)4.4 (2)4.9 (2)5.2 (2)15/15
CMA brockhoff 3.5 (2)8.3 (13)4.7 (4)4.8 (3)4.9 (3)5.3 (3)5.5 (3)15/15
CMAa brockhoff 3.0 (2)6.7 (5)3.6 (2)3.8 (2)4.1 (2)4.4 (1)4.6 (1)15/15
CMAm brockhoff 2.9 (2)6.1 (5)3.7 (1)4.0 (1)4.2 (1)4.6 (1)4.8 (1)15/15
CMAma brockhoff 3.1 (2)7.3 (9)3.5 (3)3.6 (3)3.9 (3)4.1 (2)4.3 (2)15/15
CMAmah brockhoff 3.6 (3)11 (10)5.4 (3)5.6 (3)5.8 (2)6.0 (2)6.0 (2)15/15
CMAmh brockhoff 5.4 (11)15 (23)6.8 (7)6.7 (6)6.8 (6)7.0 (6)7.0 (5)15/15
DBRCGA chuang 7.2 (4)12 (8)8.5 (2)12 (6)16 (8)21 (10)25 (10)15/15
DE-AUTO voglis 2.4 (0.2)8.7 (2)2.7 (0.7)2.4 (0.6)2.4 (0.5)2.3 (0.5)2.2 (0.5)15/15
DE-BFGS voglis 3.0 (0.7)3.3 (2)1.2 (0.5)1.1 (0.5)1.1 (0.5)1.1 (0.4)1.1 (0.4)15/15
DE-ROLL voglis 3.7 (0.8)28 (48)46 (46)90 (67)120 (66)174 (57)646 (583)8/15
DE-SIMPLEX voglis 2.1 (0.3)3.5 (3)1.4 (0.8)1.4 (0.6)1.4 (0.6)1.4 (0.5)1.5 (0.5)15/15
DEAE posik 7.0 (4)12 (5)6.2 (2)6.4 (2)6.8 (2)7.5 (2)8.1 (2)15/15
DE posik 7.8 (5)12 (11)7.6 (4)10 (4)11 (4)14 (4)18 (4)15/15
DEb posik 7.8 (5)12 (11)7.6 (4)10 (4)11 (4)14 (4)18 (4)15/15
DEctpb posik 7.1 (3)12 (6)8.6 (4)11 (5)13 (5)17 (5)21 (5)15/15
IPOPsaACM loshchilov 3.3 (2)5.8 (4)2.5 (1)2.4 (1)2.4 (1)2.4 (1)2.4 (1)15/15
JADE posik 5.6 (2)8.6 (4)6.8 (3)8.2 (2)9.1 (3)10 (3)11 (3)15/15
JADEb posik 4.1 (1)13 (18)6.7 (5)6.8 (5)7.0 (4)7.9 (4)8.8 (3)15/15
JADEctpb posik 5.6 (2)8.6 (4)6.8 (3)8.2 (2)9.1 (3)10 (3)11 (3)15/15
MVDE melo 11 (5)24 (7)18 (10)31 (12)43 (14)65 (10)87 (16)15/15
NBIPOPaCMA loshchilov 3.7 (3)7.3 (5)3.8 (2)3.8 (1)3.9 (2)4.3 (1)4.5 (1)15/15
NIPOPaCMA loshchilov 3.1 (2)8.6 (10)4.4 (3)4.4 (2)4.5 (2)4.8 (2)5.0 (2)15/15
PSO-BFGS voglis 3.4 (2)4.7 (2)1.6 (0.6)1.5 (0.5)1.5 (0.5)1.4 (0.5)1.4 (0.4)15/15
SNES schaul 2.8 (1)210 (448)157 (139)318 (124)517 (118)931 (123)1493 (751)2/15
xNES schaul 2.8 (2)5.1 (4)5.8 (7)6.9 (8)11 (12)12 (16)13 (18)15/15
xNESas schaul 2.5 (1)7.7 (8)5.9 (4)6.4 (4)6.9 (6)7.4 (6)7.7 (6)15/15

Δ fopt
f9, 3-D
1e1
21
1e0
65
1e-1
127
1e-2
149
1e-3
159
1e-5
169
1e-7
178
#succ
15/15
ACOR liao 5.6 (4)6.2 (4)15 (10)36 (25)60 (39)111 (64)154 (97)15/15
BIPOPaCMA loshchilov 3.5 (2)3.3 (2)3.4 (1)3.8 (1)3.9 (1)4.2 (0.9)4.6 (0.9)15/15
BIPOPsaACM loshchilov 3.2 (0.8)4.4 (3)3.1 (2)3.0 (2)3.0 (2)3.0 (1)3.0 (1)15/15
CMAES posik 3.4 (2)7.3 (6)6.0 (4)6.2 (4)6.3 (4)6.7 (3)7.0 (3)15/15
CMA brockhoff 4.0 (3)6.0 (6)5.3 (4)5.6 (3)5.6 (3)6.0 (3)6.3 (3)15/15
CMAa brockhoff 3.5 (1)4.1 (2)3.9 (2)3.9 (1)4.1 (1)4.4 (1)4.8 (1)15/15
CMAm brockhoff 4.0 (1)4.6 (2)4.8 (1)5.2 (1.0)5.4 (1)5.7 (1)5.9 (1)15/15
CMAma brockhoff 2.9 (2)4.6 (3)4.3 (2)4.6 (2)4.7 (1)5.0 (1)5.2 (1)15/15
CMAmah brockhoff 2.6 (1)3.6 (4)4.2 (2)4.5 (2)4.7 (2)5.0 (2)5.2 (2)15/15
CMAmh brockhoff 5.1 (2)7.4 (10)6.7 (5)6.7 (5)6.8 (5)7.2 (4)7.2 (4)15/15
DBRCGA chuang 10 (4)12 (9)16 (18)21 (20)25 (23)34 (23)38 (22)15/15
DE-AUTO voglis 3.0 (0.5)1.9 (1)1.2 (0.7)1.1 (0.6)1.1 (0.5)1.1 (0.5)1.1 (0.5)15/15
DE-BFGS voglis 3.7 (1)2.2 (1.0)1.4 (0.6)1.3 (0.5)1.3 (0.4)1.3 (0.4)1.2 (0.4)15/15
DE-ROLL voglis 5.2 (2)41 (34)52 (63)110 (51)144 (70)213 (64)1142 (1692)4/15
DE-SIMPLEX voglis 3.1 (0.4)2.3 (2)1.6 (0.8)1.5 (0.7)1.5 (0.7)1.6 (0.6)1.7 (0.6)15/15
DEAE posik 7.3 (6)8.5 (6)7.5 (4)8.0 (4)8.2 (4)9.2 (3)10 (3)15/15
DE posik 8.8 (7)9.3 (9)8.6 (7)10 (7)12 (5)15 (4)20 (4)15/15
DEb posik 8.8 (7)9.3 (9)8.6 (7)10 (7)12 (5)15 (4)20 (4)15/15
DEctpb posik 8.5 (5)10 (3)11 (7)13 (6)15 (6)19 (7)23 (8)15/15
IPOPsaACM loshchilov 3.9 (2)3.1 (2)2.6 (2)2.6 (1)2.6 (1)2.6 (1)2.7 (1)15/15
JADE posik 5.6 (3)6.8 (2)7.4 (2)8.9 (2)9.4 (2)11 (3)12 (2)15/15
JADEb posik 5.0 (2)5.8 (7)5.6 (4)6.3 (3)6.8 (3)7.8 (2)8.7 (2)15/15
JADEctpb posik 5.6 (3)6.8 (2)7.4 (2)8.9 (2)9.4 (2)11 (3)12 (2)15/15
MVDE melo 15 (11)14 (9)22 (15)37 (28)48 (32)71 (28)92 (28)15/15
NBIPOPaCMA loshchilov 3.5 (2)4.9 (5)4.5 (3)4.6 (3)4.7 (3)5.1 (2)5.3 (2)15/15
NIPOPaCMA loshchilov 3.1 (0.8)3.4 (2)3.8 (1)4.1 (1)4.2 (0.9)4.5 (0.8)4.7 (0.8)15/15
PSO-BFGS voglis 4.9 (1)2.5 (1)1.6 (0.6)1.5 (0.5)1.5 (0.5)1.4 (0.4)1.4 (0.4)15/15
SNES schaul 2.8 (1)4.9 (3)112 (71)312 (198)564 (341)1076 (658)2173 (2178)6/15
xNES schaul 3.2 (2)4.8 (2)4.6 (2)5.3 (2)5.7 (2)6.2 (3)6.6 (3)15/15
xNESas schaul 3.7 (2)6.7 (4)8.7 (9)9.1 (12)12 (23)13 (22)14 (21)15/15

Δ fopt
f10, 3-D
1e1
114
1e0
152
1e-1
168
1e-2
180
1e-3
194
1e-5
218
1e-7
242
#succ
15/15
ACOR liao 94 (148)499 (587)1011 (1206)1343 (1544)1793 (2024)2280 (2343)1.1e4 (2e4)9/15
BIPOPaCMA loshchilov 3.4 (2)3.6 (1)3.6 (0.8)3.6 (0.8)3.6 (0.8)3.7 (0.7)3.7 (0.6)15/15
BIPOPsaACM loshchilov 1.4 (0.3)1.3 (0.2)1.3 (0.2)1.3 (0.2)1.3 (0.2)1.3 (0.2)1.3 (0.2)15/15
CMAES posik 4.6 (3)4.7 (2)4.7 (1)4.8 (0.8)4.7 (0.7)4.6 (0.6)4.5 (0.5)15/15
CMA brockhoff 5.3 (2)4.8 (0.9)4.7 (0.4)4.7 (0.5)4.6 (0.3)4.5 (0.3)4.4 (0.3)15/15
CMAa brockhoff 3.5 (2)3.4 (0.6)3.3 (0.7)3.5 (0.5)3.5 (0.5)3.5 (0.6)3.6 (0.5)15/15
CMAm brockhoff 5.1 (3)4.9 (2)5.0 (0.8)4.9 (0.8)4.8 (0.7)4.6 (0.6)4.5 (0.5)15/15
CMAma brockhoff 3.7 (2)3.5 (1)3.6 (0.5)3.7 (0.4)3.6 (0.4)3.5 (0.3)3.5 (0.2)15/15
CMAmah brockhoff 4.3 (2)4.7 (2)4.8 (0.7)4.7 (0.7)4.5 (0.7)4.3 (0.6)4.2 (0.5)15/15
CMAmh brockhoff 6.2 (3)6.5 (0.9)6.5 (0.6)6.3 (0.5)6.0 (0.4)5.7 (0.4)5.4 (0.4)15/15
DBRCGA chuang 14 (23)67 (81)89 (186)117 (178)152 (176)227 (250)258 (230)15/15
DE-AUTO voglis 0.70 (0.1)↑00.54 (0.1)↑00.51 (0.1)↑00.50 (0.1)↑00.49 (0.0)↑00.47 (0.0)↑00.47 (0.1)↑015/15
DE-BFGS voglis 0.76 (0.1)↑10.60 (0.1)↑10.56 (0.1)↑10.55 (0.1)↑10.55 (0.1)↑10.54 (0.1)↑10.53 (0.1)↑015/15
DE-ROLL voglis 58 (59)100 (64)158 (67)176 (68)207 (89)263 (74)1345 (1976)4/15
DE-SIMPLEX voglis 1.4 (0.7)1.5 (1)1.4 (0.9)1.4 (0.8)1.4 (0.7)1.4 (0.7)1.3 (0.6)15/15
DEAE posik 3.1 (1)3.1 (0.7)3.5 (0.6)3.9 (0.8)4.1 (0.6)4.6 (0.5)5.0 (0.6)15/15
DE posik 9.4 (4)11 (3)13 (3)15 (2)17 (3)20 (3)22 (3)15/15
DEb posik 9.4 (4)11 (3)13 (3)15 (2)17 (3)20 (3)22 (3)15/15
DEctpb posik 11 (5)12 (3)14 (3)16 (4)18 (3)22 (4)25 (3)15/15
IPOPsaACM loshchilov 1.4 (0.3)1.3 (0.4)1.3 (0.4)1.3 (0.4)1.3 (0.3)1.3 (0.3)1.3 (0.2)15/15
JADE posik 5.2 (2)5.1 (2)5.5 (1)6.1 (1)6.3 (1)7.0 (0.9)7.2 (0.9)15/15
JADEb posik 5.5 (4)5.4 (3)6.3 (2)6.4 (2)6.7 (2)6.9 (2)7.1 (2)15/15
JADEctpb posik 5.2 (2)5.1 (2)5.5 (1)6.1 (1)6.3 (1)7.0 (0.9)7.2 (0.9)15/15
MVDE melo 33 (16)51 (20)63 (13)75 (21)86 (17)105 (24)122 (18)15/15
NBIPOPaCMA loshchilov 3.6 (1)3.3 (1)3.4 (1.0)3.3 (1.0)3.4 (0.8)3.5 (0.6)3.5 (0.5)15/15
NIPOPaCMA loshchilov 3.7 (2)3.6 (1.0)3.7 (0.4)3.6 (0.5)3.7 (0.5)3.7 (0.4)3.7 (0.3)15/15
PSO-BFGS voglis 0.69 (0.1)↑00.57 (0.1)↑00.54 (0.1)↑00.53 (0.1)↑00.53 (0.1)↑00.53 (0.1)↑00.57 (0.1)↑115/15
SNES schaul 356 (534)654 (683)2450 (3884)4897 (7858)6436 (8506)3e50/15
xNES schaul 3.2 (3)4.7 (3)7.8 (4)12 (6)12 (6)13 (5)13 (5)15/15
xNESas schaul 3.8 (2)3.9 (2)4.3 (2)4.5 (2)4.5 (2)4.6 (2)4.7 (2)15/15

Δ fopt
f11, 3-D
1e1
67
1e0
105
1e-1
227
1e-2
263
1e-3
277
1e-5
302
1e-7
327
#succ
15/15
ACOR liao 115 (112)193 (170)180 (143)242 (144)282 (137)381 (167)489 (222)15/15
BIPOPaCMA loshchilov 5.2 (3)4.2 (2)2.4 (0.6)2.3 (0.4)2.4 (0.4)2.5 (0.4)2.5 (0.3)15/15
BIPOPsaACM loshchilov 2.3 (0.6)1.8 (0.3)0.91 (0.2)0.85 (0.1)↑10.84 (0.1)↑10.87 (0.1)↑10.90 (0.1)15/15
CMAES posik 9.2 (5)7.4 (2)3.9 (0.8)3.6 (0.7)3.6 (0.6)3.7 (0.4)3.7 (0.5)15/15
CMA brockhoff 8.7 (4)7.0 (2)3.8 (0.4)3.5 (0.4)3.6 (0.4)3.6 (0.4)3.6 (0.3)15/15
CMAa brockhoff 5.9 (3)5.2 (0.9)2.6 (0.3)2.5 (0.3)2.5 (0.3)2.6 (0.3)2.7 (0.3)15/15
CMAm brockhoff 9.3 (5)9.0 (1)4.4 (0.6)4.0 (0.5)3.9 (0.4)3.9 (0.4)3.8 (0.4)15/15
CMAma brockhoff 6.2 (3)5.4 (1)2.8 (0.5)2.6 (0.3)2.6 (0.3)2.6 (0.3)2.6 (0.3)15/15
CMAmah brockhoff 10 (3)8.2 (1)4.2 (0.3)3.8 (0.3)3.7 (0.4)3.6 (0.3)3.5 (0.3)15/15
CMAmh brockhoff 13 (8)12 (3)5.8 (1)5.1 (0.9)5.0 (0.8)4.8 (0.7)4.6 (0.7)15/15
DBRCGA chuang 7.4 (4)39 (60)43 (52)79 (133)93 (128)147 (199)257 (373)12/15
DE-AUTO voglis 1.1 (0.1)3.5 (0.1)1.6 (0.0)1.4 (0.0)1.4 (0.0)1.3 (0.0)1.6 (3)15/15
DE-BFGS voglis 1.1 (0.1)0.73 (0.1)↑00.37 (0.0)↑00.34 (0.0)↑00.34 (0.0)↑00.34 (0.0)↑00.44 (0.2)↑115/15
DE-ROLL voglis 73 (79)148 (123)116 (39)138 (58)157 (66)218 (67)1748 (1971)2/15
DE-SIMPLEX voglis 3.6 (3)3.1 (2)1.8 (0.8)1.6 (0.7)1.6 (0.6)1.5 (0.6)1.5 (0.6)15/15
DEAE posik 3.9 (2)3.8 (1)2.3 (0.2)2.5 (0.3)2.7 (0.3)3.2 (0.4)3.7 (0.6)15/15
DE posik 11 (6)13 (9)8.1 (5)8.9 (4)10 (4)13 (4)15 (5)15/15
DEb posik 11 (6)13 (9)8.1 (5)8.9 (4)10 (4)13 (4)15 (5)15/15
DEctpb posik 10 (8)13 (6)8.1 (4)10 (3)11 (4)14 (3)16 (4)15/15
IPOPsaACM loshchilov 2.2 (0.8)1.8 (0.3)0.91 (0.1)0.84 (0.1)↑00.85 (0.1)↑00.90 (0.1)0.92 (0.1)15/15
JADE posik 7.0 (3)6.4 (2)4.0 (1)4.1 (1)4.4 (0.9)5.0 (1.0)5.6 (0.9)15/15
JADEb posik 8.3 (8)8.3 (8)4.9 (5)4.7 (4)4.8 (4)5.2 (3)5.5 (3)15/15
JADEctpb posik 7.0 (3)6.4 (2)4.0 (1)4.1 (1)4.4 (0.9)5.0 (1.0)5.6 (0.9)15/15
MVDE melo 21 (15)35 (17)26 (12)38 (12)48 (13)67 (12)79 (15)15/15
NBIPOPaCMA loshchilov 6.2 (3)5.1 (1)2.7 (0.5)2.5 (0.4)2.6 (0.4)2.7 (0.3)2.8 (0.4)15/15
NIPOPaCMA loshchilov 5.6 (3)5.2 (2)2.7 (0.8)2.5 (0.6)2.5 (0.5)2.7 (0.6)2.8 (0.5)15/15
PSO-BFGS voglis 1.2 (0.3)0.85 (0.2)0.42 (0.1)↑00.38 (0.1)↑00.38 (0.1)↑00.38 (0.1)↑00.42 (0.1)↑015/15
SNES schaul 152 (214)2288 (2804)6040 (7356)1.6e4 (2e4)3e50/15
xNES schaul 4.4 (3)4.6 (4)2.5 (2)2.5 (2)2.7 (2)3.5 (2)4.6 (1)15/15
xNESas schaul 4.8 (3)6.6 (2)6.9 (2)6.5 (4)6.4 (4)6.2 (4)6.2 (3)15/15

Δ fopt
f12, 3-D
1e1
65
1e0
168
1e-1
338
1e-2
401
1e-3
445
1e-5
696
1e-7
790
#succ
15/15
ACOR liao 150 (98)1635 (3355)1935 (2488)3190 (3266)5410 (5404)1.0e4 (1e4)3.7e4 (3e4)2/15
BIPOPaCMA loshchilov 7.3 (6)5.5 (5)3.8 (3)3.7 (3)3.8 (3)3.0 (2)3.1 (2)15/15
BIPOPsaACM loshchilov 2.9 (2)2.5 (2)2.0 (2)4.1 (6)4.3 (6)5.2 (9)28 (74)15/15
CMAES posik 10 (11)7.2 (6)5.5 (4)5.4 (4)5.4 (4)4.7 (3)4.8 (3)15/15
CMA brockhoff 11 (18)9.1 (12)6.5 (7)6.3 (7)6.2 (7)4.8 (5)4.8 (5)15/15
CMAa brockhoff 10 (11)7.6 (8)5.1 (5)5.0 (5)5.0 (4)4.2 (3)4.3 (2)15/15
CMAm brockhoff 9.1 (11)9.3 (8)7.1 (5)6.9 (5)6.9 (5)5.4 (4)5.5 (4)15/15
CMAma brockhoff 7.9 (8)6.5 (6)4.7 (4)4.5 (4)4.5 (3)3.6 (3)3.6 (3)15/15
CMAmah brockhoff 10 (12)8.6 (8)6.0 (3)5.8 (4)5.8 (4)4.5 (3)4.4 (3)15/15
CMAmh brockhoff 16 (19)12 (14)9.0 (8)8.9 (7)8.5 (7)6.6 (5)6.6 (5)15/15
DBRCGA chuang 121 (157)182 (196)166 (163)184 (198)191 (177)169 (183)205 (173)13/15
DE-AUTO voglis 4.6 (8)2.4 (3)1.4 (1)1.5 (1)1.5 (1)1.2 (0.8)1.2 (0.8)15/15
DE-BFGS voglis 2.1 (2)1.1 (1)0.73 (0.6)0.75 (0.5)0.75 (0.5)0.59 (0.4)0.59 (0.4)↑115/15
DE-ROLL voglis 79 (31)55 (32)53 (45)66 (58)104 (89)136 (87)671 (922)2/15
DE-SIMPLEX voglis 2.5 (1)2.0 (2)1.4 (1)1.4 (1)1.4 (0.9)1.1 (0.7)1.1 (0.7)15/15
DEAE posik 14 (7)11 (13)7.7 (9)7.6 (9)7.6 (9)6.0 (6)6.0 (5)15/15
DE posik 42 (72)34 (44)26 (26)26 (23)26 (22)21 (16)22 (15)15/15
DEb posik 42 (72)34 (44)26 (26)26 (23)26 (22)21 (16)22 (15)15/15
DEctpb posik 22 (11)18 (10)16 (10)19 (16)21 (15)19 (13)20 (12)15/15
IPOPsaACM loshchilov 4.4 (4)3.1 (3)2.1 (3)2.2 (3)2.2 (3)1.8 (2)1.8 (2)15/15
JADE posik 11 (4)8.7 (6)6.1 (4)6.1 (3)6.2 (3)5.0 (2)5.0 (2)15/15
JADEb posik 9.1 (7)10 (8)7.5 (6)7.3 (6)7.4 (5)5.7 (4)5.7 (3)15/15
JADEctpb posik 11 (4)8.7 (6)6.1 (4)6.1 (3)6.2 (3)5.0 (2)5.0 (2)15/15
MVDE melo 75 (49)101 (92)97 (139)109 (119)118 (111)109 (85)116 (86)15/15
NBIPOPaCMA loshchilov 6.0 (3)5.3 (4)4.2 (4)4.3 (4)4.4 (4)3.3 (3)3.6 (4)15/15
NIPOPaCMA loshchilov 8.5 (7)6.0 (6)4.4 (3)4.3 (3)4.3 (3)3.4 (2)3.4 (2)15/15
PSO-BFGS voglis 1.8 (0.8)0.95 (0.6)0.57 (0.4)↑10.55 (0.3)↑10.57 (0.3)↑10.53 (0.3)↑10.66 (0.6)15/15
SNES schaul 20 (24)81 (65)221 (411)755 (556)2439 (2542)6447 (5391)3e50/15
xNES schaul 17 (37)19 (22)17 (46)16 (38)23 (43)18 (42)17 (38)15/15
xNESas schaul 17 (19)22 (37)33 (66)32 (64)30 (58)26 (40)35 (51)15/15

Δ fopt
f13, 3-D
1e1
49
1e0
85
1e-1
108
1e-2
136
1e-3
215
1e-5
281
1e-7
365
#succ
15/15
ACOR liao 11 (7)133 (141)1488 (2826)3314 (4242)4705 (4188)8.5e4 (9e4)4.0e5 (5e5)1/15
BIPOPaCMA loshchilov 3.1 (1)3.7 (1)3.9 (1)4.5 (2)3.3 (1)3.5 (0.7)3.4 (0.5)15/15
BIPOPsaACM loshchilov 2.1 (0.4)1.8 (0.5)1.8 (0.5)1.7 (0.5)1.3 (0.2)1.3 (0.3)1.2 (0.2)15/15
CMAES posik 3.5 (2)5.3 (3)6.0 (2)6.1 (1)4.3 (0.6)4.5 (0.7)4.5 (1)15/15
CMA brockhoff 3.1 (1)5.3 (3)5.2 (2)5.4 (2)4.0 (1.0)4.1 (0.9)4.3 (0.6)15/15
CMAa brockhoff 3.0 (2)3.4 (0.8)4.0 (0.6)4.0 (0.6)3.1 (0.7)3.5 (0.9)3.4 (0.7)15/15
CMAm brockhoff 4.2 (2)4.9 (3)6.4 (3)6.1 (2)4.5 (2)4.7 (1)5.0 (2)15/15
CMAma brockhoff 3.4 (2)4.3 (2)4.8 (2)4.7 (1)3.6 (0.8)3.8 (0.7)3.5 (0.5)15/15
CMAmah brockhoff 4.5 (6)5.0 (5)6.6 (4)7.1 (3)5.5 (2)6.7 (2)5.8 (1)15/15
CMAmh brockhoff 7.7 (9)8.6 (6)9.0 (5)10 (4)9.3 (4)8.1 (2)8.0 (4)15/15
DBRCGA chuang 8.3 (2)14 (9)18 (15)29 (23)46 (49)81 (46)572 (838)8/15
DE-AUTO voglis 1.8 (0.2)1.2 (0.2)1.1 (0.1)1.0 (0.1)0.73 (0.1)↑01.9 (2)3.6 (0.7)15/15
DE-BFGS voglis 1.7 (0.3)1.2 (0.2)1.1 (0.1)1.0 (0.1)0.73 (0.1)↑05.9 (5)862 (852)0/15
DE-ROLL voglis 48 (78)51 (77)75 (59)79 (50)53 (33)55 (26)148 (146)13/15
DE-SIMPLEX voglis 3.0 (1)2.9 (1)2.8 (1)2.5 (0.5)1.7 (0.3)1.6 (0.4)1.9 (1)15/15
DEAE posik 5.0 (2)5.0 (0.8)5.9 (0.8)6.1 (0.7)4.6 (0.6)4.8 (0.5)4.7 (0.5)15/15
DE posik 9.3 (2)12 (4)14 (5)18 (6)16 (5)19 (5)22 (7)15/15
DEb posik 9.3 (2)12 (4)14 (5)18 (6)16 (5)19 (5)22 (7)15/15
DEctpb posik 9.2 (4)13 (4)17 (6)20 (5)18 (4)21 (5)22 (3)15/15
IPOPsaACM loshchilov 2.4 (1)1.8 (0.6)1.9 (0.6)1.9 (0.7)1.4 (0.5)1.4 (0.3)1.3 (0.2)15/15
JADE posik 6.0 (2)7.2 (2)8.8 (2)9.3 (2)7.4 (1)7.4 (0.5)6.7 (0.5)15/15
JADEb posik 4.8 (2)5.0 (2)6.1 (2)7.9 (4)6.4 (3)7.1 (2)6.8 (2)15/15
JADEctpb posik 6.0 (2)7.2 (2)8.8 (2)9.3 (2)7.4 (1)7.4 (0.5)6.7 (0.5)15/15
MVDE melo 18 (12)31 (8)55 (23)75 (26)75 (20)98 (19)114 (13)15/15
NBIPOPaCMA loshchilov 3.9 (1)3.7 (1.0)4.6 (1)4.4 (1)3.3 (0.7)3.6 (0.6)3.4 (0.4)15/15
NIPOPaCMA loshchilov 3.8 (1)3.8 (1)4.4 (1)4.4 (1.0)3.4 (1.0)3.6 (0.7)3.4 (0.5)15/15
PSO-BFGS voglis 1.7 (0.1)1.2 (0.2)1.1 (0.1)1.00 (0.1)0.72 (0.1)↑095 (58)1.2e4 (2e4)0/15
SNES schaul 25 (35)83 (86)229 (315)606 (654)1781 (2577)1.6e4 (2e4)3e50/15
xNES schaul 4.8 (3)4.3 (2)4.5 (1)4.6 (1)3.5 (0.8)3.7 (0.5)3.6 (0.3)15/15
xNESas schaul 12 (2)8.0 (0.9)7.6 (0.9)6.9 (0.9)4.9 (0.9)4.8 (0.5)4.5 (0.4)15/15

Δ fopt
f14, 3-D
1e1
2.0
1e0
17
1e-1
28
1e-2
43
1e-3
71
1e-5
110
1e-7
194
#succ
15/15
ACOR liao 2.1 (2)3.8 (2)6.2 (2)7.3 (2)7.3 (2)77 (62)1805 (1768)11/15
BIPOPaCMA loshchilov 3.2 (4)2.8 (2)3.5 (2)4.4 (1)4.1 (1.0)4.9 (0.8)4.1 (0.4)15/15
BIPOPsaACM loshchilov 2.0 (2)2.3 (2)3.3 (0.8)3.0 (0.7)2.5 (0.5)2.5 (0.5)1.9 (0.3)15/15
CMAES posik 2.9 (3)2.8 (2)3.7 (2)4.4 (2)4.7 (2)6.6 (0.5)5.8 (0.8)15/15
CMA brockhoff 3.0 (3)3.1 (2)4.4 (1)4.6 (1)4.1 (1)6.9 (1)5.8 (0.8)15/15
CMAa brockhoff 4.3 (4)2.8 (3)4.1 (2)4.4 (0.9)4.3 (0.7)4.8 (0.9)4.2 (0.5)15/15
CMAm brockhoff 3.1 (4)2.5 (2)3.5 (2)4.0 (2)3.6 (1)6.1 (2)5.7 (1)15/15
CMAma brockhoff 4.0 (4)3.1 (2)3.9 (2)4.1 (1)4.1 (1)5.2 (0.9)4.4 (0.9)15/15
CMAmah brockhoff 3.9 (5)2.2 (2)2.8 (1)3.1 (0.8)3.6 (2)6.7 (2)6.1 (0.7)15/15
CMAmh brockhoff 2.6 (3)2.1 (2)2.5 (1)2.8 (2)4.3 (1)7.8 (2)7.6 (2)15/15
DBRCGA chuang 2.1 (2)6.1 (5)13 (6)16 (3)15 (3)45 (51)371 (580)14/15
DE-AUTO voglis 2.5 (3)3.2 (2)2.8 (0.5)2.1 (0.2)1.4 (0.2)1.2 (0.1)4.9 (5)15/15
DE-BFGS voglis 2.1 (2)1.9 (2)2.5 (0.3)1.9 (0.3)1.3 (0.2)1.1 (0.1)2.1 (2)15/15
DE-ROLL voglis 2.5 (2)6.4 (2)7.2 (6)6.0 (4)20 (18)195 (81)846 (906)1/15
DE-SIMPLEX voglis 1.9 (2)5.0 (1)4.0 (1)3.3 (1.0)2.3 (0.6)2.0 (0.6)1.4 (0.3)15/15
DEAE posik 3.5 (8)5.5 (4)8.0 (3)9.4 (2)7.7 (2)7.8 (1)6.0 (0.7)15/15
DE posik 2.2 (2)4.2 (3)6.6 (4)8.3 (1)9.1 (2)14 (3)16 (4)15/15
DEb posik 2.2 (2)4.2 (3)6.6 (4)8.3 (1)9.1 (2)14 (3)16 (4)15/15
DEctpb posik 2.0 (2)4.2 (3)8.7 (2)10 (4)10 (2)17 (5)18 (5)15/15
IPOPsaACM loshchilov 3.7 (5)2.5 (2)3.3 (0.9)3.1 (0.7)2.4 (0.6)2.4 (0.4)1.8 (0.3)15/15
JADE posik 2.3 (3)4.4 (3)5.9 (2)7.3 (2)7.1 (2)9.1 (1)7.9 (1)15/15
JADEb posik 2.5 (3)3.1 (1)4.6 (2)5.4 (1)5.3 (2)7.2 (2)7.1 (2)15/15
JADEctpb posik 2.3 (3)4.4 (3)5.9 (2)7.3 (2)7.1 (2)9.1 (1)7.9 (1)15/15
MVDE melo 2.2 (2)6.1 (5)17 (8)24 (4)26 (7)57 (26)76 (21)15/15
NBIPOPaCMA loshchilov 2.7 (3)2.0 (2)3.1 (2)3.8 (1)3.7 (0.7)4.6 (0.8)4.0 (0.4)15/15
NIPOPaCMA loshchilov 2.8 (3)2.1 (2)3.3 (1)3.7 (2)4.1 (0.9)4.9 (0.5)4.2 (0.5)15/15
PSO-BFGS voglis 2.4 (2)3.2 (2)2.7 (0.4)2.0 (0.2)1.4 (0.2)1.1 (0.1)24 (47)10/15
SNES schaul 7.5 (7)3.3 (2)3.7 (2)5.1 (1)14 (11)4803 (5569)3e50/15
xNES schaul 4.1 (6)2.9 (2)3.7 (2)4.6 (2)4.4 (0.8)5.0 (0.8)3.9 (0.3)15/15
xNESas schaul 4.7 (4)2.7 (3)3.4 (1)4.6 (1)4.4 (1)7.0 (1)5.3 (0.9)15/15

Δ fopt
f15, 3-D
1e1
121
1e0
1372
1e-1
6285
1e-2
8282
1e-3
8429
1e-5
8787
1e-7
9041
#succ
15/15
ACOR liao 1.7 (0.6)8.1 (20)10 (13)7.6 (10)7.5 (9)7.2 (9)7.1 (9)15/15
BIPOPaCMA loshchilov 1.4 (0.7)1.5 (1)1.4 (1)1.2 (1)1.2 (1)1.2 (1)1.2 (1)15/15
BIPOPsaACM loshchilov 1.2 (0.8)1.2 (1)0.97 (0.7)0.76 (0.6)0.76 (0.6)0.74 (0.6)0.73 (0.5)15/15
CMAES posik 0.97 (0.5)2.1 (2)1.6 (0.9)1.2 (0.7)1.2 (0.7)1.2 (0.7)1.2 (0.6)15/15
CMA brockhoff 1.0 (0.6)1.7 (1)1.1 (1)0.92 (1)0.92 (1)0.92 (1)0.92 (1)15/15
CMAa brockhoff 1.2 (1.0)1.3 (1)0.97 (0.8)0.76 (0.6)0.76 (0.6)0.76 (0.6)0.77 (0.6)15/15
CMAm brockhoff 0.92 (0.8)1.6 (1)1.2 (0.7)0.92 (0.6)0.93 (0.6)0.92 (0.5)0.93 (0.5)15/15
CMAma brockhoff 0.96 (0.4)1.5 (1.0)1.3 (2)1.0 (1)1.0 (1)1.0 (1)1.1 (1)15/15
CMAmah brockhoff 2.4 (4)2.0 (2)0.92 (0.5)0.77 (0.4)0.78 (0.4)0.78 (0.4)0.78 (0.4)15/15
CMAmh brockhoff 2.6 (4)1.3 (1)0.88 (0.9)0.69 (0.7)0.70 (0.7)0.70 (0.7)0.71 (0.7)15/15
DBRCGA chuang 2.8 (1)3.8 (3)2.1 (2)1.7 (2)1.7 (2)1.6 (2)1.6 (2)15/15
DE-AUTO voglis 8.2 (12)5.4 (6)4.0 (4)3.1 (3)3.0 (3)2.9 (3)2.8 (3)15/15
DE-BFGS voglis 1.3 (0.9)1.0 (0.4)0.98 (0.9)0.74 (0.7)0.73 (0.7)0.70 (0.7)0.68 (0.6)15/15
DE-ROLL voglis 6.9 (10)7.5 (6)5.1 (6)3.8 (4)3.8 (4)3.6 (4)3.5 (4)15/15
DE-SIMPLEX voglis 5.3 (4)2.3 (1.0)1.8 (2)1.4 (1)1.4 (1)1.3 (1)1.3 (1)15/15
DEAE posik 1.9 (0.8)1.8 (2)1.3 (1)1.0 (1)1.0 (1)1.0 (1)1.0 (1.0)15/15
DE posik 2.2 (1)2.5 (2)1.8 (2)1.4 (2)1.4 (2)1.4 (1)1.3 (1)15/15
DEb posik 2.2 (1)2.5 (2)1.8 (2)1.4 (2)1.4 (2)1.4 (1)1.3 (1)15/15
DEctpb posik 2.0 (2)2.5 (2)1.4 (2)1.1 (1)1.2 (1)1.2 (1)1.2 (1)15/15
IPOPsaACM loshchilov 0.90 (0.5)1.2 (1)0.97 (0.8)0.79 (0.6)0.79 (0.6)0.77 (0.6)0.76 (0.6)15/15
JADE posik 1.8 (0.5)1.6 (0.7)0.94 (1.0)0.77 (0.7)0.80 (0.7)0.82 (0.7)0.82 (0.7)15/15
JADEb posik 1.4 (0.8)3.1 (5)3.8 (5)2.9 (4)2.9 (3)2.8 (3)2.7 (3)15/15
JADEctpb posik 1.8 (0.5)1.6 (0.7)0.94 (1.0)0.77 (0.7)0.80 (0.7)0.82 (0.7)0.82 (0.7)15/15
MVDE melo 2.9 (1)56 (3)26 (80)20 (60)20 (60)19 (57)19 (56)13/15
NBIPOPaCMA loshchilov 1.0 (0.5)1.8 (2)2.8 (2)2.3 (2)2.2 (2)2.2 (2)2.3 (2)15/15
NIPOPaCMA loshchilov 0.94 (0.5)1.8 (1)1.1 (0.7)0.90 (0.5)0.91 (0.6)0.90 (0.6)0.92 (0.6)15/15
PSO-BFGS voglis 5.1 (5)3.4 (3)1.9 (2)1.4 (1)1.4 (1)1.4 (1)1.3 (1)15/15
SNES schaul 1.3 (0.9)5.5 (5)10 (16)8.0 (12)7.8 (12)7.5 (12)7.3 (11)15/15
xNES schaul 2.8 (2)10 (11)10 (11)7.7 (8)7.6 (8)7.3 (8)7.1 (7)14/15
xNESas schaul 1.2 (0.6)5.5 (8)5.1 (5)3.9 (4)3.8 (4)3.7 (4)3.6 (4)15/15

Δ fopt
f16, 3-D
1e1
41
1e0
319
1e-1
582
1e-2
789
1e-3
1864
1e-5
3204
1e-7
3361
#succ
15/15
ACOR liao 1.7 (1)10 (8)63 (101)65 (75)31 (39)18 (23)17 (22)15/15
BIPOPaCMA loshchilov 1.5 (2)2.6 (3)4.1 (6)4.1 (6)1.8 (3)1.1 (2)1.1 (2)15/15
BIPOPsaACM loshchilov 1.0 (2)2.9 (4)2.4 (2)3.1 (3)1.4 (1)0.92 (0.7)0.94 (0.7)15/15
CMAES posik 1.5 (1)2.9 (5)4.9 (5)4.7 (6)3.1 (6)2.2 (3)2.1 (3)15/15
CMA brockhoff 1.4 (1)2.7 (3)2.3 (2)2.2 (2)1.4 (1)0.95 (0.9)0.96 (0.8)15/15
CMAa brockhoff 1.7 (2)2.8 (3)2.7 (4)3.4 (3)1.6 (1)1.1 (1)1.2 (1)15/15
CMAm brockhoff 1.7 (2)3.0 (4)3.1 (3)2.8 (2)1.3 (1)1.2 (0.6)1.2 (0.6)15/15
CMAma brockhoff 4.2 (3)3.6 (4)3.5 (3)3.5 (3)1.6 (2)1.1 (1)1.1 (1)15/15
CMAmah brockhoff 6.7 (14)3.5 (3)3.6 (4)3.4 (3)1.6 (0.7)0.98 (0.4)0.98 (0.4)15/15
CMAmh brockhoff 1.6 (1)3.7 (3)5.3 (7)4.6 (5)2.7 (3)1.8 (2)1.7 (2)15/15
DBRCGA chuang 1.7 (2)5.6 (11)8.3 (9)20 (26)15 (15)15 (18)15 (17)15/15
DE-AUTO voglis 11 (15)26 (38)38 (29)71 (35)37 (21)26 (15)35 (34)14/15
DE-BFGS voglis 1.5 (2)3.6 (4)34 (27)29 (36)13 (15)7.8 (9)54 (73)4/15
DE-ROLL voglis 0.90 (0.7)23 (31)69 (30)115 (201)58 (110)38 (49)74 (76)5/15
DE-SIMPLEX voglis 2.0 (3)2.6 (2)3.2 (3)2.8 (3)1.7 (1)1.9 (0.7)7.6 (5)15/15
DEAE posik 0.92 (1)2.6 (2)4.2 (2)4.5 (4)2.0 (2)1.3 (0.9)1.3 (0.9)15/15
DE posik 2.2 (2)4.8 (3)5.1 (3)7.1 (8)3.2 (4)2.1 (2)2.1 (2)15/15
DEb posik 2.2 (2)4.8 (3)5.1 (3)7.1 (8)3.2 (4)2.1 (2)2.1 (2)15/15
DEctpb posik 1.9 (2)6.3 (5)8.9 (4)13 (9)7.0 (4)8.8 (4)12 (23)13/15
IPOPsaACM loshchilov 2.7 (1)3.9 (6)2.8 (4)2.3 (3)1.1 (1)0.81 (0.9)0.84 (0.9)15/15
JADE posik 1.2 (0.7)3.5 (3)6.2 (5)8.7 (8)4.4 (3)3.0 (3)4.8 (3)15/15
JADEb posik 1.2 (1)2.1 (1)2.2 (0.5)2.1 (2)1.8 (3)1.3 (1)1.4 (1)15/15
JADEctpb posik 1.2 (0.7)3.5 (3)6.2 (5)8.7 (8)4.4 (3)3.0 (3)4.8 (3)15/15
MVDE melo 1.0 (0.8)5.3 (4)15 (7)109 (14)204 (271)120 (157)115 (225)11/15
NBIPOPaCMA loshchilov 1.5 (2)2.4 (3)2.2 (2)2.3 (2)1.1 (1)0.74 (0.8)0.74 (0.7)15/15
NIPOPaCMA loshchilov 1.5 (1)2.6 (2)2.8 (3)2.2 (2)0.99 (0.9)0.71 (0.6)0.72 (0.5)15/15
PSO-BFGS voglis 3.4 (4)4.4 (5)9.2 (7)15 (14)14 (11)11 (11)59 (58)6/15
SNES schaul 1.9 (2)3.0 (5)5.0 (5)7.7 (11)11 (21)15 (19)35 (46)12/15
xNES schaul 1.4 (2)2.6 (5)4.3 (4)3.8 (6)1.8 (3)1.2 (2)1.1 (2)15/15
xNESas schaul 0.92 (1)2.8 (4)3.2 (3)2.6 (3)1.1 (1)0.71 (0.6)0.73 (0.6)15/15

Δ fopt
f17, 3-D
1e1
4.0
1e0
78
1e-1
282
1e-2
491
1e-3
1134
1e-5
2347
1e-7
3469
#succ
15/15
ACOR liao 2.1 (2)2.0 (0.7)1.5 (0.3)1.5 (0.4)6.0 (0.2)3.2 (0.1)4.6 (13)15/15
BIPOPaCMA loshchilov 3.8 (6)1.8 (1)1.5 (2)1.3 (1)0.89 (0.6)1.0 (0.8)0.81 (0.6)15/15
BIPOPsaACM loshchilov 3.0 (5)1.3 (0.6)1.9 (3)2.6 (2)1.3 (1)1.6 (1)1.4 (0.9)15/15
CMAES posik 4.0 (3)1.1 (0.5)1.6 (2)1.7 (2)1.1 (0.8)2.6 (4)3.3 (4)15/15
CMA brockhoff 2.6 (4)2.1 (0.5)1.1 (0.3)1.6 (2)1.00 (0.7)0.66 (0.4)0.72 (0.7)15/15
CMAa brockhoff 4.0 (5)2.4 (1)1.4 (2)1.6 (2)0.94 (0.9)0.96 (0.8)0.84 (0.6)15/15
CMAm brockhoff 3.3 (3)3.4 (7)1.3 (2)1.4 (1)0.88 (0.6)1.0 (0.5)0.94 (0.5)15/15
CMAma brockhoff 4.5 (5)1.7 (0.7)1.7 (2)1.5 (1)0.98 (0.6)0.80 (0.8)0.78 (0.6)15/15
CMAmah brockhoff 3.3 (4)2.4 (0.6)4.0 (4)3.1 (2)2.0 (1)1.3 (0.3)1.2 (0.4)15/15
CMAmh brockhoff 4.7 (4)10 (26)4.7 (7)4.1 (4)2.5 (2)1.6 (0.9)1.3 (0.6)15/15
DBRCGA chuang 1.8 (2)3.7 (1)3.1 (0.8)3.1 (0.5)3.2 (5)4.4 (5)8.1 (13)15/15
DE-AUTO voglis 2.2 (2)31 (41)22 (13)27 (17)16 (10)13 (6)16 (10)15/15
DE-BFGS voglis 2.8 (2)5.5 (5)4.0 (3)4.7 (2)2.7 (1)2.0 (0.5)50 (76)3/15
DE-ROLL voglis 17 (3)15 (18)24 (16)29 (13)19 (11)15 (10)127 (125)5/15
DE-SIMPLEX voglis 2.4 (3)9.0 (6)5.8 (2)6.4 (3)3.7 (0.8)3.1 (0.6)242 (325)0/15
DEAE posik 1.9 (2)2.8 (1)1.9 (0.6)1.8 (0.3)1.1 (0.2)1.1 (0.7)1.3 (0.7)15/15
DE posik 1.6 (1)2.7 (1)2.3 (0.8)2.3 (0.7)1.4 (0.3)1.4 (0.4)1.8 (2)15/15
DEb posik 1.6 (1)2.7 (1)2.3 (0.8)2.3 (0.7)1.4 (0.3)1.4 (0.4)1.8 (2)15/15
DEctpb posik 1.7 (2)3.1 (2)2.5 (0.7)2.8 (1)1.8 (0.4)1.6 (0.3)1.6 (0.5)15/15
IPOPsaACM loshchilov 2.2 (3)1.2 (0.8)1.3 (2)1.6 (2)1.3 (0.9)1.1 (0.9)0.97 (0.5)15/15
JADE posik 1.7 (2)1.7 (0.9)1.8 (0.5)1.9 (0.4)1.2 (0.3)0.99 (0.2)0.92 (0.1)15/15
JADEb posik 1.8 (2)1.4 (0.9)1.2 (0.4)2.3 (4)1.3 (2)1.4 (1)3.6 (6)15/15
JADEctpb posik 1.7 (2)1.7 (0.9)1.8 (0.5)1.9 (0.4)1.2 (0.3)0.99 (0.2)0.92 (0.1)15/15
MVDE melo 1.6 (2)4.7 (2)5.2 (2)6.3 (2)4.9 (1)4.5 (1)4.4 (1)15/15
NBIPOPaCMA loshchilov 2.8 (3)2.2 (0.6)1.3 (2)1.4 (1)0.99 (0.7)1.0 (0.2)1.3 (1.0)15/15
NIPOPaCMA loshchilov 3.0 (4)3.1 (7)1.4 (2)1.5 (2)0.87 (0.7)0.98 (0.5)0.92 (0.7)15/15
PSO-BFGS voglis 1.9 (2)11 (13)14 (6)11 (4)6.6 (2)4.9 (0.8)63 (71)1/15
SNES schaul 6.2 (8)4.0 (1.0)2.9 (6)2.1 (3)1.7 (2)6.3 (4)8.0 (9)14/15
xNES schaul 5.0 (6)1.6 (1)2.4 (5)2.3 (3)1.9 (3)3.1 (3)3.0 (3)15/15
xNESas schaul 4.8 (5)3.4 (1)1.7 (1)2.6 (5)1.3 (2)3.3 (3)2.8 (2)15/15

Δ fopt
f18, 3-D
1e1
40
1e0
145
1e-1
1289
1e-2
3084
1e-3
3523
1e-5
4738
1e-7
5527
#succ
15/15
ACOR liao 2.2 (1)3.0 (1)23 (60)12 (25)15 (27)29 (38)31 (39)15/15
BIPOPaCMA loshchilov 1.3 (1)2.3 (0.3)0.95 (2)0.66 (0.7)0.69 (0.6)0.70 (0.5)0.75 (0.5)15/15
BIPOPsaACM loshchilov 1.2 (0.8)2.2 (0.8)0.97 (0.8)0.58 (0.7)0.62 (0.6)1.1 (0.4)1.0 (0.4)15/15
CMAES posik 1.3 (0.9)3.1 (5)2.5 (3)2.5 (3)3.4 (3)6.5 (7)11 (14)13/15
CMA brockhoff 3.6 (1)2.0 (1)1.0 (1)0.86 (0.8)0.83 (0.7)0.85 (0.4)0.86 (0.4)15/15
CMAa brockhoff 1.3 (1)2.5 (1)1.0 (1)0.88 (0.7)0.93 (0.6)0.87 (0.3)0.90 (0.3)15/15
CMAm brockhoff 1.5 (0.8)2.3 (0.4)1.2 (1)0.99 (1)1.4 (1)1.3 (0.8)1.3 (0.8)15/15
CMAma brockhoff 1.2 (0.9)4.3 (7)1.6 (2)0.97 (0.6)0.90 (0.5)0.85 (0.4)0.83 (0.3)15/15
CMAmah brockhoff 6.1 (10)4.8 (4)1.8 (2)1.2 (0.9)1.3 (0.5)1.2 (0.4)1.2 (0.5)15/15
CMAmh brockhoff 2.9 (1)5.2 (8)2.8 (4)1.5 (2)1.6 (1.0)1.4 (0.6)1.3 (0.6)15/15
DBRCGA chuang 2.7 (2)3.5 (1)4.1 (6)8.3 (11)22 (21)32 (43)60 (90)9/15
DE-AUTO voglis 22 (24)37 (33)10 (11)12 (7)15 (5)16 (5)24 (28)13/15
DE-BFGS voglis 2.3 (2)9.0 (7)2.2 (1)1.8 (2)2.2 (2)2.2 (2)91 (110)0/15
DE-ROLL voglis 16 (36)34 (39)14 (10)11 (6)17 (8)23 (19)188 (178)0/15
DE-SIMPLEX voglis 9.5 (9)27 (33)10 (13)5.3 (6)5.1 (5)4.7 (5)170 (204)0/15
DEAE posik 2.3 (2)2.4 (0.5)0.52 (0.1)↑00.76 (0.9)1.1 (2)1.2 (1)1.2 (1)15/15
DE posik 2.7 (2)3.9 (2)1.0 (0.5)0.87 (0.5)1.2 (1)1.7 (1)3.4 (5)15/15
DEb posik 2.7 (2)3.9 (2)1.0 (0.5)0.87 (0.5)1.2 (1)1.7 (1)3.4 (5)15/15
DEctpb posik 2.6 (1)4.1 (2)1.2 (0.5)0.96 (0.3)1.2 (0.3)1.9 (2)5.8 (6)14/15
IPOPsaACM loshchilov 1.4 (1)4.0 (6)1.3 (0.9)0.84 (0.7)0.91 (0.6)1.1 (0.4)1.3 (0.6)15/15
JADE posik 1.9 (0.7)2.8 (1.0)0.74 (0.2)↑10.50 (0.1)↑00.57 (0.1)↑00.65 (0.1)↑00.76 (0.1)↑115/15
JADEb posik 1.3 (1.0)1.8 (2)1.8 (5)1.4 (2)2.7 (6)6.8 (9)13 (14)13/15
JADEctpb posik 1.9 (0.7)2.8 (1.0)0.74 (0.2)↑10.50 (0.1)↑00.57 (0.1)↑00.65 (0.1)↑00.76 (0.1)↑115/15
MVDE melo 3.5 (2)8.0 (2)3.3 (1)3.0 (1)3.9 (1)5.5 (1)6.4 (2)15/15
NBIPOPaCMA loshchilov 3.0 (2)3.0 (4)1.0 (0.7)0.92 (1)0.89 (1.0)0.91 (0.6)1.1 (0.6)15/15
NIPOPaCMA loshchilov 1.5 (1)5.2 (8)1.6 (2)1.1 (0.8)1.1 (0.5)1.0 (0.4)0.95 (0.4)15/15
PSO-BFGS voglis 7.8 (8)24 (20)20 (40)10 (17)10 (15)12 (13)243 (315)0/15
SNES schaul 1.7 (1)3.6 (3)5.5 (6)9.5 (9)71 (106)443 (491)390 (394)2/15
xNES schaul 1.7 (1)5.9 (11)1.5 (2)0.83 (1.0)1.3 (2)2.8 (3)3.8 (3)15/15
xNESas schaul 1.1 (0.9)2.4 (0.9)0.72 (0.8)0.43 (0.5)0.61 (0.4)1.5 (2)2.4 (3)15/15

Δ fopt
f19, 3-D
1e1
1
1e0
1
1e-1
109
1e-2
6764
1e-3
7367
1e-5
7399
1e-7
7441
#succ
15/15
ACOR liao 4.3 (2)170 (119)31 (38)3.8 (5)13 (18)14 (19)15 (20)15/15
BIPOPaCMA loshchilov 10 (11)140 (118)38 (47)2.7 (3)3.9 (4)3.9 (4)3.9 (4)15/15
BIPOPsaACM loshchilov 8.4 (16)424 (684)31 (21)1.6 (3)1.8 (2)1.8 (2)1.8 (2)15/15
CMAES posik 10 (9)312 (638)50 (38)3.4 (4)7.6 (10)7.6 (10)7.6 (11)13/15
CMA brockhoff 7.7 (6)203 (364)132 (226)9.1 (9)8.4 (9)8.5 (9)8.5 (9)15/15
CMAa brockhoff 7.3 (7)109 (98)88 (141)4.4 (5)4.4 (4)4.5 (4)4.5 (4)15/15
CMAm brockhoff 10 (8)493 (560)154 (290)9.1 (8)8.9 (8)8.9 (8)8.9 (8)15/15
CMAma brockhoff 5.7 (4)382 (911)60 (38)5.3 (9)5.6 (8)5.6 (8)5.6 (8)15/15
CMAmah brockhoff 5.3 (6)168 (185)228 (386)6.3 (8)6.1 (7)6.2 (7)6.2 (7)15/15
CMAmh brockhoff 6.4 (6)325 (178)102 (160)3.5 (5)4.5 (5)4.5 (5)4.5 (5)15/15
DBRCGA chuang 12 (15)235 (140)38 (33)10 (13)19 (32)19 (21)19 (23)12/15
DE-AUTO voglis 4.1 (4)1701 (1930)81 (76)4.9 (6)15 (21)15 (20)19 (25)12/15
DE-BFGS voglis 18 (18)310 (238)19 (21)1.7 (1)11 (18)11 (17)18 (19)7/15
DE-ROLL voglis 10 (10)879 (1802)72 (83)12 (16)22 (24)22 (26)35 (34)6/15
DE-SIMPLEX voglis 12 (18)685 (1100)32 (33)3.1 (3)9.4 (14)9.4 (14)9.3 (14)14/15
DEAE posik 5.6 (8)253 (151)25 (22)6.4 (11)10 (11)10 (20)10 (16)11/15
DE posik 14 (16)276 (230)36 (37)2.5 (2)5.1 (7)5.2 (7)5.2 (7)14/15
DEb posik 14 (16)276 (230)36 (37)2.5 (2)5.1 (7)5.2 (7)5.2 (7)14/15
DEctpb posik 10 (8)279 (250)24 (12)1.3 (0.6)1.6 (0.5)2.1 (1)2.2 (1)15/15
IPOPsaACM loshchilov 8.1 (7)268 (375)138 (142)4.5 (5)5.3 (8)5.4 (8)5.4 (8)15/15
JADE posik 13 (16)166 (172)27 (21)2.9 (2)3.0 (2)3.2 (1)3.3 (1)14/15
JADEb posik 12 (14)159 (148)20 (19)1.4 (2)4.0 (10)4.7 (10)4.7 (10)13/15
JADEctpb posik 13 (16)166 (172)27 (21)2.9 (2)3.0 (2)3.2 (1)3.3 (1)14/15
MVDE melo 10 (9)387 (328)30 (28)25 (74)70 (170)71 (136)71 (102)10/15
NBIPOPaCMA loshchilov 9.2 (8)174 (152)41 (50)2.9 (4)3.4 (4)3.4 (4)3.4 (4)15/15
NIPOPaCMA loshchilov 11 (12)114 (86)110 (168)10 (16)13 (17)13 (18)13 (18)15/15
PSO-BFGS voglis 8.4 (8)491 (938)41 (31)2.6 (3)2.9 (4)2.9 (4)14 (23)9/15
SNES schaul 9.1 (8)264 (399)28 (29)3.3 (3)8.1 (7)16 (10)23 (13)11/15
xNES schaul 7.5 (9)137 (132)41 (47)3.3 (4)5.5 (4)5.8 (5)5.8 (5)15/15
xNESas schaul 8.3 (8)526 (250)63 (79)8.6 (11)10 (9)14 (9)14 (9)14/15

Δ fopt
f20, 3-D
1e1
8.0
1e0
385
1e-1
2291
1e-2
2398
1e-3
2481
1e-5
2573
1e-7
2776
#succ
15/15
ACOR liao 4.2 (4)1.5 (0.9)2.3 (0.3)2.4 (0.4)2.3 (0.4)2.3 (0.4)2.2 (0.3)15/15
BIPOPaCMA loshchilov 1.4 (1)5.6 (8)6.0 (8)6.3 (8)6.2 (7)6.1 (7)5.8 (7)15/15
BIPOPsaACM loshchilov 3.0 (3)2.7 (3)3.7 (4)3.7 (4)3.6 (4)3.5 (4)3.3 (4)15/15
CMAES posik 2.6 (3)7.1 (8)17 (19)17 (18)16 (17)16 (17)14 (15)15/15
CMA brockhoff 2.9 (3)5.5 (7)5.2 (4)5.5 (4)5.5 (4)5.5 (4)5.3 (4)15/15
CMAa brockhoff 3.1 (2)6.5 (7)6.7 (4)6.8 (4)6.7 (4)6.7 (4)6.4 (4)15/15
CMAm brockhoff 3.2 (4)7.3 (8)6.0 (4)6.1 (4)6.1 (4)6.1 (4)5.8 (4)15/15
CMAma brockhoff 1.9 (2)7.3 (6)6.7 (4)7.1 (4)7.1 (4)7.1 (4)6.8 (3)15/15
CMAmah brockhoff 2.0 (2)5.9 (7)6.7 (3)7.0 (3)7.0 (3)7.0 (3)6.7 (3)15/15
CMAmh brockhoff 2.3 (2)6.0 (7)7.0 (7)7.1 (8)7.2 (8)7.2 (8)6.8 (8)15/15
DBRCGA chuang 5.6 (8)2.2 (1)4.5 (5)4.4 (5)4.4 (4)4.4 (4)4.2 (4)15/15
DE-AUTO voglis 2.9 (3)6.1 (7)13 (16)12 (16)12 (15)12 (15)11 (14)15/15
DE-BFGS voglis 5.3 (2)2.0 (2)14 (12)13 (11)12 (11)12 (11)11 (10)15/15
DE-ROLL voglis 4.1 (2)4.3 (5)29 (47)28 (45)27 (44)26 (42)24 (39)14/15
DE-SIMPLEX voglis 3.6 (4)3.6 (4)41 (50)39 (48)38 (46)36 (45)34 (41)15/15
DEAE posik 3.0 (3)2.1 (1)3.6 (4)3.5 (4)3.4 (3)3.4 (3)3.2 (3)15/15
DE posik 5.0 (5)1.6 (0.7)1.5 (2)1.6 (2)1.6 (2)1.6 (2)1.6 (2)15/15
DEb posik 5.0 (5)1.6 (0.7)1.5 (2)1.6 (2)1.6 (2)1.6 (2)1.6 (2)15/15
DEctpb posik 3.1 (5)1.7 (0.8)1.4 (1)1.5 (1)1.5 (1)1.7 (1)1.7 (1)15/15
IPOPsaACM loshchilov 2.3 (2)3.0 (4)2.4 (2)2.6 (2)2.6 (2)2.5 (2)2.3 (2)15/15
JADE posik 3.1 (3)1.1 (0.6)1.2 (1)1.4 (1)1.4 (1)1.4 (1)1.4 (1)15/15
JADEb posik 3.0 (2)1.7 (2)2.0 (2)2.0 (2)1.9 (2)1.9 (2)1.8 (2)15/15
JADEctpb posik 3.1 (3)1.1 (0.6)1.2 (1)1.4 (1)1.4 (1)1.4 (1)1.4 (1)15/15
MVDE melo 5.6 (6)2.2 (1)110 (218)106 (209)103 (202)99 (292)93 (180)12/15
NBIPOPaCMA loshchilov 3.7 (3)3.2 (2)8.0 (10)8.0 (10)8.0 (10)7.9 (10)7.6 (9)15/15
NIPOPaCMA loshchilov 3.0 (2)3.4 (4)6.6 (9)6.6 (9)6.7 (9)6.6 (8)6.4 (8)15/15
PSO-BFGS voglis 6.2 (4)2.4 (2)7.9 (11)7.6 (11)7.3 (11)7.1 (10)6.6 (9)15/15
SNES schaul 1.9 (2)8.9 (11)10 (11)10 (11)9.3 (10)9.0 (10)8.4 (9)15/15
xNES schaul 2.0 (2)14 (16)19 (20)21 (19)20 (19)20 (18)18 (17)15/15
xNESas schaul 3.1 (3)7.6 (8)12 (13)14 (20)14 (19)13 (19)12 (17)15/15

Δ fopt
f21, 3-D
1e1
6.0
1e0
184
1e-1
425
1e-2
439
1e-3
458
1e-5
469
1e-7
482
#succ
14/15
ACOR liao 1.5 (2)112 (143)57 (62)56 (60)54 (57)53 (56)52 (54)15/15
BIPOPaCMA loshchilov 1.3 (1)7.9 (12)11 (16)11 (16)16 (21)16 (21)16 (20)15/15
BIPOPsaACM loshchilov 2.3 (2)3.4 (4)7.2 (15)7.4 (14)7.5 (17)7.5 (17)7.4 (17)15/15
CMAES posik 1.8 (3)9.1 (11)11 (13)11 (13)10 (12)10 (12)10 (12)15/15
CMA brockhoff 1.3 (1)7.3 (12)6.1 (8)6.7 (8)6.6 (8)7.1 (9)7.0 (8)15/15
CMAa brockhoff 2.3 (2)4.0 (6)5.5 (6)7.1 (6)15 (26)15 (27)15 (28)15/15
CMAm brockhoff 1.2 (1)10 (12)49 (14)48 (14)46 (13)46 (14)45 (14)14/15
CMAma brockhoff 1.2 (0.9)8.3 (19)8.3 (12)12 (13)12 (13)12 (15)12 (15)15/15
CMAmah brockhoff 0.96 (1)6.0 (11)8.0 (9)8.2 (9)7.9 (8)8.8 (8)8.8 (8)15/15
CMAmh brockhoff 1.5 (2)4.7 (6)13 (14)14 (15)13 (15)14 (15)14 (15)15/15
DBRCGA chuang 1.4 (0.9)3.4 (6)4.4 (6)5.0 (6)5.1 (6)5.7 (6)6.1 (5)15/15
DE-AUTO voglis 1.8 (2)30 (46)71 (128)69 (124)66 (119)65 (116)63 (113)15/15
DE-BFGS voglis 1.1 (0.8)2.7 (3)8.1 (9)7.9 (9)7.6 (8)7.5 (8)17 (33)15/15
DE-ROLL voglis 1.7 (1)27 (44)48 (57)47 (55)45 (53)44 (52)43 (51)15/15
DE-SIMPLEX voglis 1.3 (1)11 (24)9.1 (20)9.0 (19)8.7 (18)8.5 (18)8.3 (17)15/15
DEAE posik 1.2 (0.9)5.5 (9)7.8 (6)8.0 (7)7.9 (7)8.0 (7)8.0 (7)15/15
DE posik 1.8 (2)3.5 (4)4.1 (6)4.4 (6)4.3 (5)4.7 (5)5.1 (5)15/15
DEb posik 1.8 (2)3.5 (4)4.1 (6)4.4 (6)4.3 (5)4.7 (5)5.1 (5)15/15
DEctpb posik 2.4 (2)1.8 (3)2.0 (2)2.5 (2)2.9 (2)3.6 (2)4.2 (2)15/15
IPOPsaACM loshchilov 1.4 (1)3.0 (4)6.7 (5)23 (11)38 (12)38 (12)37 (12)15/15
JADE posik 1.3 (1)4.5 (9)2.7 (4)3.0 (4)3.2 (3)3.6 (4)3.8 (3)15/15
JADEb posik 1.8 (2)8.1 (7)10 (16)9.4 (15)9.2 (15)9.2 (14)9.1 (14)15/15
JADEctpb posik 1.3 (1)4.5 (9)2.7 (4)3.0 (4)3.2 (3)3.6 (4)3.8 (3)15/15
MVDE melo 1.2 (1)4.2 (3)3.1 (2)4.7 (3)5.9 (5)10 (5)11 (5)15/15
NBIPOPaCMA loshchilov 2.1 (2)11 (13)24 (38)24 (36)23 (35)22 (34)22 (33)15/15
NIPOPaCMA loshchilov 1.8 (2)21 (31)193 (284)193 (275)185 (264)182 (258)178 (251)15/15
PSO-BFGS voglis 1.5 (2)2.5 (4)3.7 (5)3.6 (5)3.5 (4)3.5 (4)45 (64)14/15
SNES schaul 1.9 (2)20 (44)18 (26)17 (25)17 (24)16 (23)16 (23)15/15
xNES schaul 1.4 (2)16 (32)36 (50)35 (48)34 (46)33 (45)33 (44)15/15
xNESas schaul 1.5 (1)43 (84)41 (72)39 (70)38 (67)37 (66)36 (64)15/15

Δ fopt
f22, 3-D
1e1
18
1e0
170
1e-1
354
1e-2
362
1e-3
384
1e-5
401
1e-7
414
#succ
15/15
ACOR liao 2.1 (2)141 (297)175 (216)173 (210)165 (198)159 (190)156 (183)15/15
BIPOPaCMA loshchilov 4.6 (3)4.3 (3)32 (24)32 (24)30 (22)29 (21)28 (20)15/15
BIPOPsaACM loshchilov 2.3 (1)4.1 (6)11 (25)12 (24)11 (23)11 (22)11 (21)15/15
CMAES posik 0.76 (0.7)9.5 (10)14 (14)14 (13)13 (13)13 (12)13 (12)15/15
CMA brockhoff 1.6 (1)2.8 (3)47 (29)232 (320)335 (372)415 (576)481 (939)9/15
CMAa brockhoff 4.6 (3)14 (19)32 (53)137 (176)315 (619)461 (603)447 (502)9/15
CMAm brockhoff 4.1 (3)13 (12)60 (53)74 (119)128 (266)335 (375)325 (364)10/15
CMAma brockhoff 4.8 (5)12 (19)60 (53)189 (395)198 (351)406 (608)395 (545)10/15
CMAmah brockhoff 3.7 (3)11 (12)24 (42)102 (170)234 (372)288 (509)282 (493)11/15
CMAmh brockhoff 3.3 (2)3.9 (4)17 (26)34 (70)57 (76)175 (258)246 (375)11/15
DBRCGA chuang 1.6 (2)1.8 (1)3.2 (5)4.0 (5)4.3 (4)5.2 (4)6.1 (4)15/15
DE-AUTO voglis 1.2 (1)16 (15)105 (262)102 (257)96 (242)93 (232)91 (224)15/15
DE-BFGS voglis 1.0 (0.7)3.2 (6)2.7 (3)2.7 (3)2.6 (3)2.6 (3)19 (29)15/15
DE-ROLL voglis 1.5 (1)11 (17)90 (74)89 (72)85 (68)87 (69)123 (126)14/15
DE-SIMPLEX voglis 1.4 (2)18 (25)20 (21)20 (20)18 (19)18 (18)17 (18)15/15
DEAE posik 1.8 (2)3.0 (1)4.5 (4)5.0 (4)4.9 (4)5.2 (4)5.3 (4)15/15
DE posik 2.0 (2)2.1 (1)4.5 (9)4.8 (8)5.2 (8)5.7 (8)6.2 (8)15/15
DEb posik 2.0 (2)2.1 (1)4.5 (9)4.8 (8)5.2 (8)5.7 (8)6.2 (8)15/15
DEctpb posik 1.7 (2)2.2 (2)6.8 (10)7.9 (11)8.0 (10)9.2 (9)10 (9)15/15
IPOPsaACM loshchilov 1.4 (1)5.3 (6)17 (29)37 (40)101 (237)100 (227)98 (222)15/15
JADE posik 1.5 (2)4.5 (9)4.4 (4)4.8 (5)4.8 (5)5.3 (4)5.8 (5)15/15
JADEb posik 15 (42)5.1 (7)5.6 (5)5.7 (5)5.5 (5)5.5 (5)5.8 (4)15/15
JADEctpb posik 1.5 (2)4.5 (9)4.4 (4)4.8 (5)4.8 (5)5.3 (4)5.8 (5)15/15
MVDE melo 1.1 (0.9)2.0 (2)2.5 (3)5.0 (4)6.8 (6)11 (5)16 (6)15/15
NBIPOPaCMA loshchilov 12 (26)21 (35)16 (17)19 (26)18 (25)17 (24)17 (23)15/15
NIPOPaCMA loshchilov 8.1 (24)19 (19)207 (209)211 (210)210 (198)205 (197)202 (198)15/15
PSO-BFGS voglis 4.5 (7)2.2 (2)2.7 (4)2.7 (4)2.5 (3)2.7 (3)65 (79)12/15
SNES schaul 13 (3)25 (35)39 (45)45 (43)50 (42)69 (55)90 (68)15/15
xNES schaul 18 (2)28 (43)36 (63)37 (62)35 (58)33 (56)33 (54)15/15
xNESas schaul 14 (2)29 (31)68 (101)74 (99)70 (93)67 (89)65 (87)15/15

Δ fopt
f23, 3-D
1e1
3.0
1e0
407
1e-1
906
1e-2
1215
1e-3
2214
1e-5
2293
1e-7
2393
#succ
15/15
ACOR liao 3.6 (3)19 (15)2.2e4 (2e4)1e70/15
BIPOPaCMA loshchilov 4.1 (6)4.4 (7)5.2 (5)4.5 (4)2.6 (2)2.6 (2)2.9 (2)15/15
BIPOPsaACM loshchilov 6.8 (8)5.9 (6)5.8 (4)5.8 (3)4.9 (6)4.8 (6)5.1 (5)15/15
CMAES posik 2.4 (2)7.0 (6)14 (14)12 (10)6.5 (6)6.8 (9)6.6 (8)15/15
CMA brockhoff 4.2 (4)8.0 (8)13 (17)10 (13)5.8 (7)5.8 (7)5.7 (7)15/15
CMAa brockhoff 2.1 (2)8.5 (9)11 (12)8.8 (10)4.9 (5)5.0 (5)5.0 (5)15/15
CMAm brockhoff 4.3 (7)5.9 (7)113 (333)84 (248)46 (137)45 (132)43 (126)13/15
CMAma brockhoff 5.1 (6)5.3 (7)7.6 (5)5.8 (4)3.3 (2)3.4 (2)3.4 (2)15/15
CMAmah brockhoff 4.1 (3)5.0 (6)60 (17)45 (13)25 (7)24 (7)23 (7)14/15
CMAmh brockhoff 4.1 (5)13 (15)16 (17)12 (13)6.9 (7)8.4 (10)8.3 (10)15/15
DBRCGA chuang 3.5 (3)9.3 (9)102 (104)96 (87)53 (47)52 (46)50 (45)14/15
DE-AUTO voglis 2.2 (2)2.5 (3)4.4 (6)3.9 (4)2.9 (4)2.8 (4)2.8 (4)15/15
DE-BFGS voglis 1.9 (2)1.9 (2)3.4 (2)3.6 (3)3.1 (4)6.1 (7)281 (414)2/15
DE-ROLL voglis 3.0 (2)3.2 (6)17 (22)49 (37)32 (30)33 (28)126 (140)1/15
DE-SIMPLEX voglis 1.8 (2)0.66 (0.5)1.2 (2)0.98 (1)0.66 (0.6)5.9 (4)354 (470)1/15
DEAE posik 2.4 (2)16 (13)64 (40)49 (40)34 (35)33 (34)32 (33)13/15
DE posik 3.0 (3)20 (16)80 (99)63 (70)35 (39)42 (50)40 (41)11/15
DEb posik 3.0 (3)20 (16)80 (86)63 (74)35 (41)42 (35)40 (36)11/15
DEctpb posik 3.2 (4)21 (13)353 (331)2e50/15
IPOPsaACM loshchilov 4.8 (4)7.5 (7)11 (10)8.0 (7)4.5 (4)4.5 (4)4.4 (4)15/15
JADE posik 2.4 (2)10 (6)22 (20)16 (15)10 (9)10 (8)10 (8)15/15
JADEb posik 2.8 (2)7.3 (8)25 (22)28 (36)21 (21)21 (20)20 (19)14/15
JADEctpb posik 2.4 (2)10 (6)22 (20)16 (15)10 (9)10 (8)10 (8)15/15
MVDE melo 3.6 (4)11 (13)1018 (1650)1.2e4 (1e4)6369 (8582)6156 (7633)5902 (5746)1/15
NBIPOPaCMA loshchilov 4.0 (5)4.2 (3)4.6 (6)3.7 (4)2.1 (2)2.4 (2)3.2 (3)15/15
NIPOPaCMA loshchilov 3.7 (5)11 (8)10 (10)8.6 (7)4.8 (4)4.9 (4)4.9 (4)15/15
PSO-BFGS voglis 3.1 (4)1.4 (2)4.4 (4)6.9 (5)8.8 (13)88 (131)3e50/15
SNES schaul 3.2 (2)13 (18)80 (160)302 (298)380 (448)525 (523)503 (583)3/15
xNES schaul 3.6 (4)16 (16)280 (360)440 (631)328 (370)318 (424)437 (520)3/15
xNESas schaul 4.3 (6)16 (19)271 (344)229 (229)186 (200)217 (285)256 (294)0/15

Δ fopt
f24, 3-D
1e1
97
1e0
10391
1e-1
1.0e5
1e-2
3.6e5
1e-3
3.6e5
1e-5
3.6e5
1e-7
3.6e5
#succ
2/15
ACOR liao 2.9 (2)341 (508)37 (63)12 (16)12 (17)12 (17)12 (13)13/15
BIPOPaCMA loshchilov 1.6 (2)3.1 (4)11 (9)4.3 (3)4.8 (4)4.8 (5)5.7 (6)12/15
BIPOPsaACM loshchilov 1.6 (1)6.8 (10)7.2 (9)5.6 (5)5.6 (6)5.7 (5)5.9 (8)11/15
CMAES posik 3.5 (1)3.5 (4)6.1 (8)2.8 (4)2.8 (2)2.8 (3)2.8 (3)2/15
CMA brockhoff 1.5 (1)117 (145)6e50/15
CMAa brockhoff 1.7 (1)116 (130)6e50/15
CMAm brockhoff 2.6 (2)67 (87)38 (66)11 (19)11 (11)11 (13)11 (11)2/15
CMAma brockhoff 2.4 (2)232 (188)6e50/15
CMAmah brockhoff 1.1 (0.7)88 (73)38 (59)6e50/15
CMAmh brockhoff 2.9 (5)160 (202)6e50/15
DBRCGA chuang 3.9 (4)4.6 (5)5.9 (5)3e50/15
DE-AUTO voglis 26 (42)64 (46)6.8 (7)2.0 (2)2.0 (2)2.0 (2)2.0 (2)5/15
DE-BFGS voglis 2.5 (2)8.4 (8)0.89 (0.8)0.26 (0.2)↑10.26 (0.2)↑10.26 (0.2)↑10.26 (0.2)↑114/15
DE-ROLL voglis 33 (56)62 (61)6.9 (6)2.0 (2)2.0 (2)2.0 (2)2.6 (3)4/15
DE-SIMPLEX voglis 3.4 (5)21 (46)2.2 (4)0.65 (0.8)0.65 (0.8)0.65 (0.8)0.65 (1.0)10/15
DEAE posik 2.5 (2)3.5 (4)2.9 (2)2.8 (3)2.8 (3)2.8 (4)2.8 (3)2/15
DE posik 3.2 (3)5.3 (6)6.6 (7)6.3 (7)6.3 (4)6.3 (7)6.3 (7)1/15
DEb posik 3.2 (3)5.3 (6)6.6 (7)6.3 (5)6.3 (6)6.3 (7)6.3 (5)1/15
DEctpb posik 3.0 (2)21 (19)4.6 (5)2.9 (3)2.9 (3)3.0 (4)3.0 (3)2/15
IPOPsaACM loshchilov 2.3 (2)402 (448)433 (490)3e60/15
JADE posik 2.7 (2)2.2 (3)1.1 (1.0)0.66 (0.8)0.66 (0.7)0.66 (0.6)0.66 (0.6)7/15
JADEb posik 4.5 (2)1.4 (1)2.3 (3)3.0 (2)3.0 (3)3.0 (3)3.0 (3)2/15
JADEctpb posik 2.7 (2)2.2 (3)1.1 (2)0.66 (1.0)0.66 (0.9)0.66 (0.9)0.66 (0.6)7/15
MVDE melo 4.4 (3)1348 (1251)137 (117)1e60/15
NBIPOPaCMA loshchilov 1.4 (0.7)7.1 (16)5.9 (7)4.3 (7)4.3 (5)4.3 (6)4.3 (7)12/15
NIPOPaCMA loshchilov 3.9 (4)35 (68)5.6 (7)3.7 (6)3.9 (5)3.9 (5)3.9 (6)12/15
PSO-BFGS voglis 1.4 (0.9)1.3 (2)0.44 (0.4)0.24 (0.2)↑00.24 (0.2)↑00.24 (0.2)↑00.24 (0.2)↑015/15
SNES schaul 1.9 (2)4.0 (4)13 (18)3e50/15
xNES schaul 2.6 (2)3.0 (3)7.6 (8)2e50/15
xNESas schaul 1.6 (1)4.7 (4)29 (28)18 (18)18 (19)18 (22)18 (14)1/15

Previous dimension | Dimension = 5 | Next dimension

Δ fopt
f1, 5-D
1e1
11
1e0
12
1e-1
12
1e-2
12
1e-3
12
1e-5
12
1e-7
12
#succ
15/15
ACOR liao 4.7 (5)15 (3)26 (4)36 (4)47 (6)69 (4)92 (6)15/15
BIPOPaCMA loshchilov 3.4 (2)8.3 (3)16 (3)22 (4)29 (3)41 (5)54 (5)15/15
BIPOPsaACM loshchilov 2.7 (2)6.6 (2)8.9 (0.7)10 (1)12 (1)16 (1)19 (2)15/15
CMAES posik 2.3 (2)8.7 (3)15 (5)22 (5)28 (5)41 (4)53 (6)15/15
CMA brockhoff 2.6 (3)10 (4)16 (4)21 (4)28 (5)41 (5)55 (6)15/15
CMAa brockhoff 2.5 (2)8.2 (4)15 (4)21 (5)26 (5)39 (4)52 (8)15/15
CMAm brockhoff 2.8 (2)7.7 (2)12 (3)17 (4)22 (4)31 (5)42 (5)15/15
CMAma brockhoff 2.7 (3)7.4 (4)11 (4)17 (3)22 (4)31 (5)40 (7)15/15
CMAmah brockhoff 1.7 (1)5.0 (1)8.2 (2)12 (2)16 (2)24 (2)31 (4)15/15
CMAmh brockhoff 1.8 (1)5.2 (3)9.3 (3)13 (3)17 (3)25 (4)32 (4)15/15
DBRCGA chuang 5.1 (7)50 (33)97 (27)146 (22)201 (21)306 (33)423 (44)15/15
DE-AUTO voglis 3.3 (2)5.9 (0.7)6.0 (0.3)6.1 (0.2)6.1 (0.2)6.1 (0.2)6.1 (0.2)15/15
DE-BFGS voglis 3.3 (2)5.0 (0.2)5.0 (0.2)5.0 (0.2)5.0 (0.2)5.0 (0.2)5.0 (0.2)15/15
DE-ROLL voglis 3.3 (2)18 (21)19 (22)19 (22)19 (22)19 (21)19 (21)15/15
DE-SIMPLEX voglis 2.8 (3)6.8 (2)10 (5)12 (4)15 (3)19 (2)23 (3)15/15
DEAE posik 5.1 (6)23 (10)43 (10)65 (9)83 (6)126 (8)169 (9)15/15
DE posik 5.0 (4)21 (8)39 (8)61 (11)83 (8)124 (9)167 (8)15/15
DEb posik 5.0 (4)21 (8)39 (8)61 (11)83 (8)124 (9)167 (8)15/15
DEctpb posik 5.8 (5)26 (9)46 (9)70 (12)93 (10)141 (12)186 (13)15/15
IPOPsaACM loshchilov 3.0 (2)7.0 (2)8.8 (0.9)10 (1)12 (2)15 (2)18 (1)15/15
JADE posik 4.1 (3)18 (6)37 (7)57 (8)78 (7)117 (11)157 (11)15/15
JADEb posik 3.4 (3)14 (6)27 (5)36 (4)51 (6)77 (7)105 (10)15/15
JADEctpb posik 4.1 (3)18 (6)37 (7)57 (8)78 (7)117 (11)157 (11)15/15
MVDE melo 6.4 (8)46 (20)104 (13)160 (21)224 (20)334 (26)458 (21)15/15
NBIPOPaCMA loshchilov 2.4 (2)8.5 (3)15 (2)21 (3)28 (4)39 (3)51 (4)15/15
NIPOPaCMA loshchilov 2.7 (2)7.5 (3)14 (3)20 (4)26 (3)37 (2)51 (4)15/15
PSO-BFGS voglis 3.1 (3)5.2 (0.2)5.2 (0.2)5.2 (0.2)5.2 (0.2)5.2 (0.2)5.2 (0.2)15/15
SNES schaul 4.3 (3)8.0 (3)15 (5)24 (4)34 (5)51 (4)69 (5)15/15
xNES schaul 3.0 (3)6.4 (4)21 (3)34 (10)50 (6)82 (8)111 (7)15/15
xNESas schaul 2.9 (2)6.7 (3)16 (6)28 (8)38 (8)61 (12)79 (17)15/15

Δ fopt
f2, 5-D
1e1
83
1e0
87
1e-1
88
1e-2
89
1e-3
90
1e-5
92
1e-7
94
#succ
15/15
ACOR liao 6.1 (0.6)7.5 (0.6)8.7 (0.8)10 (0.9)12 (1)14 (0.8)17 (1)15/15
BIPOPaCMA loshchilov 10 (3)12 (3)13 (1)14 (1)15 (2)16 (1)18 (1)15/15
BIPOPsaACM loshchilov 3.2 (0.7)3.5 (0.7)3.7 (0.5)3.9 (0.7)4.1 (0.7)4.6 (0.6)4.9 (0.6)15/15
CMAES posik 16 (4)17 (3)18 (3)19 (2)20 (2)21 (2)22 (2)15/15
CMA brockhoff 14 (4)16 (4)17 (4)19 (3)20 (3)22 (3)23 (2)15/15
CMAa brockhoff 11 (3)12 (2)13 (2)14 (2)14 (1)16 (2)17 (1)15/15
CMAm brockhoff 13 (6)16 (4)17 (4)18 (3)19 (2)20 (1)21 (1.0)15/15
CMAma brockhoff 11 (3)13 (3)14 (2)15 (1)15 (2)16 (2)17 (1)15/15
CMAmah brockhoff 13 (3)15 (3)15 (2)16 (2)16 (2)17 (2)17 (2)15/15
CMAmh brockhoff 16 (5)18 (4)21 (3)21 (2)21 (2)22 (2)23 (2)15/15
DBRCGA chuang 27 (4)33 (4)41 (5)47 (5)54 (6)67 (6)81 (6)15/15
DE-AUTO voglis 1.4 (0.2)1.5 (0.2)1.6 (0.4)1.6 (0.4)1.8 (0.4)1.9 (0.5)2.1 (0.5)15/15
DE-BFGS voglis 1.4 (0.3)1.4 (0.3)1.6 (0.3)1.6 (0.3)1.7 (0.3)1.9 (0.3)2.0 (0.3)15/15
DE-ROLL voglis 5.1 (6)5.3 (6)5.4 (6)5.5 (6)5.5 (6)5.8 (6)5.9 (6)15/15
DE-SIMPLEX voglis 6.1 (4)10 (7)11 (7)11 (7)11 (7)12 (6)12 (6)15/15
DEAE posik 12 (3)14 (2)17 (3)19 (4)22 (3)27 (3)32 (3)15/15
DE posik 11 (1)13 (2)16 (2)18 (1)21 (2)27 (2)31 (2)15/15
DEb posik 11 (1)13 (2)16 (2)18 (1)21 (2)27 (2)31 (2)15/15
DEctpb posik 13 (1.0)16 (1)19 (2)21 (2)24 (2)30 (2)35 (2)15/15
IPOPsaACM loshchilov 3.6 (1)3.7 (0.8)4.1 (0.8)4.4 (0.8)4.6 (1.0)5.0 (0.9)5.3 (0.9)15/15
JADE posik 10 (2)12 (2)15 (2)18 (2)20 (2)26 (2)31 (2)15/15
JADEb posik 6.8 (1)8.5 (2)10 (2)12 (2)14 (2)18 (2)22 (3)15/15
JADEctpb posik 10 (2)12 (2)15 (2)18 (2)20 (2)26 (2)31 (2)15/15
MVDE melo 27 (3)34 (4)43 (2)49 (2)56 (4)70 (4)84 (3)15/15
NBIPOPaCMA loshchilov 11 (3)12 (3)14 (2)15 (2)15 (2)17 (2)18 (2)15/15
NIPOPaCMA loshchilov 10 (3)12 (2)13 (2)14 (2)14 (2)16 (2)17 (2)15/15
PSO-BFGS voglis 1.7 (0.7)1.7 (0.7)1.8 (0.7)1.9 (0.7)1.9 (0.7)2.1 (0.7)2.3 (0.8)15/15
SNES schaul 5.0 (1)5.9 (0.9)7.0 (0.9)8.1 (0.6)9.2 (0.6)11 (0.6)13 (0.6)15/15
xNES schaul 8.7 (2)11 (2)12 (1)14 (2)16 (1)20 (1)23 (1)15/15
xNESas schaul 11 (5)14 (9)19 (18)25 (32)39 (62)43 (63)49 (93)15/15

Δ fopt
f3, 5-D
1e1
716
1e0
1622
1e-1
1637
1e-2
1642
1e-3
1646
1e-5
1650
1e-7
1654
#succ
15/15
ACOR liao 1.7 (0.8)30 (38)241 (167)240 (166)240 (166)239 (165)239 (165)15/15
BIPOPaCMA loshchilov 1.6 (2)12 (11)190 (397)190 (396)190 (395)190 (394)189 (393)15/15
BIPOPsaACM loshchilov 1.1 (1.0)5.3 (5)264 (474)264 (473)263 (472)263 (470)264 (464)15/15
CMAES posik 1.7 (2)23 (26)293 (382)292 (477)292 (255)291 (406)290 (278)6/15
CMA brockhoff 1.4 (2)7.9 (6)718 (856)716 (825)715 (731)713 (725)712 (725)6/15
CMAa brockhoff 0.91 (0.6)30 (7)1333 (1450)1329 (1552)1326 (2491)1324 (1778)1321 (1770)4/15
CMAm brockhoff 1.1 (1)7.0 (10)960 (1619)957 (1210)955 (1530)953 (866)951 (1122)5/15
CMAma brockhoff 0.74 (1)39 (10)556 (691)555 (482)554 (852)553 (708)552 (467)7/15
CMAmah brockhoff 2.4 (2)5.9 (6)3146 (3266)3136 (2802)3129 (3848)3121 (2750)3114 (4697)2/15
CMAmh brockhoff 1.7 (2)100 (220)1004 (1157)1001 (1926)999 (1200)997 (1248)995 (1095)5/15
DBRCGA chuang 2.3 (1.0)8.0 (4)11 (6)11 (6)11 (6)12 (6)12 (6)15/15
DE-AUTO voglis 1.3 (1)11 (5)21 (9)20 (9)20 (9)20 (9)20 (9)15/15
DE-BFGS voglis 2.0 (1)3.7 (3)7.7 (5)7.6 (5)7.6 (5)7.6 (5)7.6 (5)15/15
DE-ROLL voglis 2.2 (1)4.4 (2)6.6 (4)6.6 (4)6.6 (4)6.6 (4)6.6 (4)15/15
DE-SIMPLEX voglis 4.1 (3)10 (8)19 (13)19 (14)19 (14)19 (14)19 (13)15/15
DEAE posik 2.4 (1)11 (11)70 (80)70 (79)70 (81)70 (93)70 (102)13/15
DE posik 1.1 (0.4)1.4 (0.2)2.5 (2)2.7 (2)2.8 (2)3.1 (2)3.4 (2)15/15
DEb posik 1.1 (0.4)1.4 (0.2)2.5 (2)2.7 (2)2.8 (2)3.1 (2)3.4 (2)15/15
DEctpb posik 1.3 (0.5)2.1 (0.7)2.5 (0.5)2.9 (0.5)3.2 (0.5)3.6 (0.5)3.9 (0.4)15/15
IPOPsaACM loshchilov 1.1 (1)30 (90)1790 (2123)1785 (2417)1780 (2394)1776 (2551)1772 (2013)12/15
JADE posik 1.1 (0.5)1.6 (0.3)2.2 (0.4)2.5 (0.3)2.7 (0.3)3.0 (0.3)3.4 (0.3)15/15
JADEb posik 0.80 (0.2)↑11.9 (2)6.6 (7)6.7 (7)6.8 (7)7.1 (7)7.3 (7)15/15
JADEctpb posik 1.1 (0.5)1.6 (0.3)2.2 (0.4)2.5 (0.3)2.7 (0.3)3.0 (0.3)3.4 (0.3)15/15
MVDE melo 2.2 (0.6)2.4 (0.3)2.9 (0.2)3.4 (0.3)3.8 (0.2)4.6 (0.2)5.5 (0.2)15/15
NBIPOPaCMA loshchilov 0.87 (0.3)13 (18)473 (727)472 (725)471 (723)471 (722)470 (720)15/15
NIPOPaCMA loshchilov 1.4 (1)29 (12)799 (1357)797 (1352)795 (1349)793 (1346)792 (1342)15/15
PSO-BFGS voglis 9.4 (10)26 (38)121 (159)120 (148)120 (171)120 (172)120 (150)13/15
SNES schaul 4.4 (7)91 (146)785 (728)783 (689)781 (922)779 (704)777 (942)8/15
xNES schaul 3.0 (1)92 (114)415 (417)413 (577)412 (407)412 (870)411 (422)9/15
xNESas schaul 1.5 (0.7)69 (80)454 (362)453 (396)452 (489)451 (450)450 (418)13/15

Δ fopt
f4, 5-D
1e1
809
1e0
1633
1e-1
1688
1e-2
1758
1e-3
1817
1e-5
1886
1e-7
1903
#succ
15/15
ACOR liao 2.0 (1)784 (1075)2.5e4 (4e4)2.4e4 (3e4)2.3e4 (2e4)2.2e4 (2e4)2.2e4 (3e4)3/15
BIPOPaCMA loshchilov 1.6 (1)1.4e4 (1e4)5e60/15
BIPOPsaACM loshchilov 1.3 (0.9)6336 (3955)5e60/15
CMAES posik 2.2 (1)216 (144)3e50/15
CMA brockhoff 2.7 (3)9e50/15
CMAa brockhoff 1.7 (2)9e50/15
CMAm brockhoff 2.9 (3)9e50/15
CMAma brockhoff 1.7 (2)9e50/15
CMAmah brockhoff 2.5 (2)9e50/15
CMAmh brockhoff 1.8 (2)9e50/15
DBRCGA chuang 2.6 (1)11 (7)17 (10)16 (10)16 (10)16 (9)16 (9)15/15
DE-AUTO voglis 1.8 (2)16 (9)28 (22)27 (21)26 (21)25 (20)25 (20)15/15
DE-BFGS voglis 3.8 (2)9.0 (6)20 (17)19 (16)19 (15)18 (15)18 (15)15/15
DE-ROLL voglis 1.6 (2)4.7 (3)11 (10)11 (9)10 (9)10 (9)10 (8)15/15
DE-SIMPLEX voglis 6.8 (3)14 (7)24 (16)23 (15)23 (14)22 (14)22 (14)15/15
DEAE posik 4.1 (3)47 (26)323 (359)310 (325)300 (307)290 (280)287 (197)6/15
DE posik 1.2 (0.3)1.7 (0.3)9.4 (14)9.2 (14)9.0 (13)9.0 (13)9.2 (13)15/15
DEb posik 1.2 (0.3)1.7 (0.3)9.4 (14)9.2 (14)9.0 (13)9.0 (13)9.2 (13)15/15
DEctpb posik 1.4 (0.4)2.6 (0.4)4.9 (3)5.1 (3)5.2 (3)5.4 (3)5.7 (3)15/15
IPOPsaACM loshchilov 1.0 (0.8)4.3e4 (5e4)5e60/15
JADE posik 1.4 (0.4)2.0 (0.5)3.9 (3)4.1 (3)4.1 (3)4.4 (3)4.7 (3)15/15
JADEb posik 0.80 (0.4)4.7 (5)25 (28)24 (27)24 (26)23 (25)23 (25)15/15
JADEctpb posik 1.4 (0.4)2.0 (0.5)3.9 (3)4.1 (3)4.1 (3)4.4 (3)4.7 (3)15/15
MVDE melo 2.4 (0.4)3.0 (0.6)95 (296)91 (284)89 (275)86 (265)86 (263)13/15
NBIPOPaCMA loshchilov 1.7 (1)738 (708)3819 (4160)3667 (3263)3548 (2170)3418 (3088)3388 (3033)9/15
NIPOPaCMA loshchilov 2.8 (3)2.2e4 (2e4)5e60/15
PSO-BFGS voglis 14 (12)120 (118)410 (567)394 (373)381 (372)367 (325)364 (593)7/15
SNES schaul 3.2 (6)443 (383)3934 (4186)3777 (2587)3654 (4736)3521 (2692)3490 (4808)2/15
xNES schaul 4.5 (6)599 (561)5871 (8302)5637 (3941)5454 (6886)5255 (4568)5208 (4892)1/15
xNESas schaul 3.8 (5)381 (423)9998 (1e4)9600 (1e4)9288 (9478)8949 (1e4)8869 (1e4)1/15

Δ fopt
f5, 5-D
1e1
10
1e0
10
1e-1
10
1e-2
10
1e-3
10
1e-5
10
1e-7
10
#succ
15/15
ACOR liao 8.5 (1)12 (2)13 (3)13 (3)13 (3)13 (3)13 (3)15/15
BIPOPaCMA loshchilov 5.7 (3)6.9 (3)6.9 (3)6.9 (3)6.9 (3)6.9 (3)6.9 (3)15/15
BIPOPsaACM loshchilov 4.7 (2)5.8 (2)6.2 (3)6.2 (3)6.2 (3)6.2 (3)6.2 (3)15/15
CMAES posik 4.3 (2)5.8 (2)5.8 (2)5.9 (2)5.9 (2)5.9 (2)5.9 (2)15/15
CMA brockhoff 4.4 (2)6.5 (2)6.7 (2)6.7 (2)6.7 (2)6.7 (2)6.7 (2)15/15
CMAa brockhoff 4.2 (2)6.0 (2)6.3 (2)6.4 (2)6.4 (2)6.4 (2)6.4 (2)15/15
CMAm brockhoff 3.9 (2)5.1 (2)5.3 (1)5.4 (1)5.4 (1)5.4 (1)5.4 (1)15/15
CMAma brockhoff 3.4 (0.8)4.7 (1)4.8 (2)4.8 (2)4.8 (2)4.8 (2)4.8 (2)15/15
CMAmah brockhoff 3.3 (2)4.2 (2)4.7 (2)4.8 (2)4.8 (2)4.8 (2)4.8 (2)15/15
CMAmh brockhoff 2.9 (1)3.9 (0.9)4.0 (1)4.1 (1)4.1 (1)4.1 (1)4.1 (1)15/15
DBRCGA chuang 31 (33)50 (38)54 (40)54 (40)54 (40)54 (40)54 (40)15/15
DE-AUTO voglis 5.8 (0.4)6.3 (0.4)6.4 (0.3)6.4 (0.3)6.4 (0.3)6.4 (0.3)6.4 (0.3)15/15
DE-BFGS voglis 6.5 (2)8.8 (3)9.0 (2)9.0 (2)9.0 (2)9.0 (2)9.0 (2)15/15
DE-ROLL voglis 5.9 (0.3)6.4 (0.4)6.5 (0.4)6.6 (0.5)6.7 (0.5)6.9 (0.5)7.1 (0.5)15/15
DE-SIMPLEX voglis 29 (13)122 (119)266 (171)322 (104)324 (99)336 (123)369 (138)15/15
DEAE posik 8.0 (4)12 (7)13 (7)13 (7)13 (7)13 (7)13 (7)15/15
DE posik 8.3 (3)12 (4)12 (3)13 (3)13 (3)13 (3)13 (3)15/15
DEb posik 8.3 (3)12 (4)12 (3)13 (3)13 (3)13 (3)13 (3)15/15
DEctpb posik 11 (5)16 (4)17 (4)18 (2)18 (2)18 (2)18 (2)15/15
IPOPsaACM loshchilov 4.3 (3)6.1 (3)6.2 (3)6.3 (2)6.3 (2)6.3 (2)6.3 (2)15/15
JADE posik 11 (6)20 (8)21 (7)21 (7)21 (7)21 (7)21 (7)15/15
JADEb posik 8.4 (4)14 (4)15 (4)15 (4)15 (4)15 (4)15 (4)15/15
JADEctpb posik 11 (6)20 (8)21 (7)21 (7)21 (7)21 (7)21 (7)15/15
MVDE melo 48 (10)90 (16)99 (20)101 (20)101 (20)101 (20)101 (20)15/15
NBIPOPaCMA loshchilov 4.2 (2)5.6 (2)5.9 (2)5.9 (2)5.9 (2)5.9 (2)5.9 (2)15/15
NIPOPaCMA loshchilov 4.1 (2)5.9 (3)6.1 (3)6.1 (3)6.1 (3)6.1 (3)6.1 (3)15/15
PSO-BFGS voglis 6.8 (0.3)8.8 (0.3)8.8 (0.6)8.8 (0.6)8.9 (0.6)8.9 (0.6)8.9 (0.6)15/15
SNES schaul 7.8 (3)12 (4)12 (4)12 (4)12 (4)12 (4)12 (4)15/15
xNES schaul 9.5 (4)15 (6)15 (6)16 (6)16 (6)16 (6)16 (6)15/15
xNESas schaul 10 (4)15 (9)16 (9)16 (8)16 (8)16 (8)16 (8)15/15

Δ fopt
f6, 5-D
1e1
114
1e0
214
1e-1
281
1e-2
404
1e-3
580
1e-5
1038
1e-7
1332
#succ
15/15
ACOR liao 3.4 (1)3.6 (0.8)4.1 (0.9)3.9 (0.5)3.4 (0.4)2.6 (0.4)2.7 (0.3)15/15
BIPOPaCMA loshchilov 2.0 (1)1.9 (0.8)2.2 (0.5)1.9 (0.4)1.6 (0.3)1.2 (0.2)1.2 (0.1)15/15
BIPOPsaACM loshchilov 1.9 (0.7)1.8 (0.6)2.1 (0.9)1.9 (0.6)1.8 (0.9)1.3 (0.5)1.4 (0.5)15/15
CMAES posik 2.4 (0.7)2.0 (0.5)2.2 (0.5)2.0 (0.4)1.7 (0.4)1.3 (0.3)1.3 (0.2)15/15
CMA brockhoff 2.5 (0.9)2.1 (0.4)2.2 (0.3)2.0 (0.3)1.7 (0.2)1.3 (0.1)1.2 (0.1)15/15
CMAa brockhoff 2.0 (0.6)1.9 (0.4)2.0 (0.3)1.7 (0.2)1.5 (0.2)1.2 (0.1)1.1 (0.1)15/15
CMAm brockhoff 2.2 (1)2.0 (0.8)2.1 (0.6)1.9 (0.5)1.7 (0.5)1.3 (0.2)1.3 (0.2)15/15
CMAma brockhoff 2.4 (1)2.1 (0.9)2.2 (0.9)1.9 (0.7)1.6 (0.4)1.2 (0.2)1.2 (0.2)15/15
CMAmah brockhoff 1.7 (1.0)1.5 (0.5)1.7 (0.5)1.5 (0.4)1.3 (0.4)0.94 (0.3)0.92 (0.2)15/15
CMAmh brockhoff 1.8 (0.9)1.7 (0.8)1.8 (0.9)1.7 (0.5)1.5 (0.4)1.1 (0.2)1.1 (0.2)15/15
DBRCGA chuang 7.4 (3)10 (3)12 (4)12 (3)10 (2)8.0 (2)8.2 (1)15/15
DE-AUTO voglis 1.3 (0.7)1.0 (0.4)1.00 (0.3)0.83 (0.2)0.79 (0.4)0.73 (0.4)0.79 (0.2)15/15
DE-BFGS voglis 5.1 (2)3.0 (1)2.5 (0.9)2.0 (0.7)1.5 (0.6)1.3 (2)2.8 (3)15/15
DE-ROLL voglis 13 (19)13 (19)19 (27)15 (19)18 (23)13 (20)53 (66)14/15
DE-SIMPLEX voglis 5.5 (9)5.6 (5)6.2 (4)5.6 (6)5.6 (5)5.9 (6)12 (12)15/15
DEAE posik 3.7 (2)4.8 (1)5.7 (0.9)5.2 (0.9)4.6 (0.5)3.8 (0.4)3.9 (0.3)15/15
DE posik 5.4 (1)6.6 (2)8.4 (2)8.6 (2)8.0 (2)6.3 (1)6.7 (2)15/15
DEb posik 5.4 (1)6.6 (2)8.4 (2)8.6 (2)8.0 (2)6.3 (1)6.7 (2)15/15
DEctpb posik 6.0 (3)6.6 (1)8.2 (2)7.9 (1)6.9 (1)5.6 (1)5.8 (1.0)15/15
IPOPsaACM loshchilov 2.3 (1)2.1 (0.9)2.6 (1)2.4 (1)1.9 (0.8)1.5 (0.5)1.7 (0.7)15/15
JADE posik 4.1 (2)4.5 (1.0)5.4 (0.9)5.0 (0.8)4.4 (0.5)3.6 (0.4)3.7 (0.5)15/15
JADEb posik 2.6 (1)3.4 (1)4.5 (1)4.6 (1.0)4.4 (0.9)3.7 (0.9)4.0 (2)15/15
JADEctpb posik 4.1 (2)4.5 (1.0)5.4 (0.9)5.0 (0.8)4.4 (0.5)3.6 (0.4)3.7 (0.5)15/15
MVDE melo 6.5 (3)13 (4)18 (4)20 (4)21 (4)21 (8)25 (8)15/15
NBIPOPaCMA loshchilov 2.1 (1)1.9 (0.6)2.0 (0.6)1.8 (0.3)1.5 (0.3)1.1 (0.2)1.1 (0.2)15/15
NIPOPaCMA loshchilov 2.0 (0.8)1.7 (0.5)1.9 (0.3)1.7 (0.3)1.5 (0.2)1.2 (0.1)1.2 (0.1)15/15
PSO-BFGS voglis 6.4 (9)3.8 (5)3.1 (4)2.4 (3)1.9 (2)1.5 (2)54 (98)11/15
SNES schaul 1.5 (1)1.7 (0.6)2.2 (0.5)2.2 (0.5)2.0 (0.6)10 (15)23 (51)15/15
xNES schaul 1.6 (1)2.0 (0.5)2.5 (0.3)2.4 (0.3)2.2 (0.3)1.8 (0.1)1.8 (0.1)15/15
xNESas schaul 1.5 (1)2.1 (0.6)2.4 (0.6)2.3 (0.4)2.0 (0.2)1.5 (0.2)1.6 (0.2)15/15

Δ fopt
f7, 5-D
1e1
24
1e0
324
1e-1
1171
1e-2
1451
1e-3
1572
1e-5
1572
1e-7
1597
#succ
15/15
ACOR liao 6.4 (3)2.1 (1)32 (25)26 (20)25 (18)25 (18)25 (18)15/15
BIPOPaCMA loshchilov 6.8 (4)1.3 (1)1.0 (0.9)0.98 (0.8)0.93 (0.7)0.93 (0.7)0.95 (0.7)15/15
BIPOPsaACM loshchilov 4.4 (3)1.4 (1)0.83 (0.5)0.88 (0.8)0.91 (0.7)0.91 (0.7)0.93 (0.7)15/15
CMAES posik 5.0 (3)1.1 (0.9)2.0 (2)2.1 (2)2.6 (3)2.6 (3)2.6 (3)15/15
CMA brockhoff 4.7 (3)1.5 (1)0.88 (0.4)0.89 (0.5)0.92 (0.7)0.92 (0.7)0.94 (0.7)15/15
CMAa brockhoff 7.2 (3)1.1 (1)0.88 (0.6)0.79 (0.5)0.77 (0.5)0.77 (0.5)0.79 (0.5)15/15
CMAm brockhoff 3.8 (2)1.1 (1.0)1.3 (1)1.4 (1)1.3 (1)1.3 (1)1.4 (1)15/15
CMAma brockhoff 5.0 (3)1.4 (1)0.84 (0.6)0.80 (0.5)0.76 (0.5)0.76 (0.5)0.82 (0.5)15/15
CMAmah brockhoff 3.9 (3)1.5 (1)1.4 (0.7)1.3 (0.6)1.2 (0.6)1.2 (0.6)1.2 (0.6)15/15
CMAmh brockhoff 4.5 (4)2.1 (2)1.4 (0.9)1.5 (0.7)1.4 (0.6)1.4 (0.6)1.4 (0.7)15/15
DBRCGA chuang 16 (14)4.1 (2)4.9 (6)5.7 (5)7.9 (7)7.9 (7)8.0 (8)15/15
DE-AUTO voglis 40 (63)13 (10)6.9 (3)8.1 (3)9.1 (3)9.1 (3)14 (9)15/15
DE-BFGS voglis 8.8 (5)3.4 (5)10 (22)9.0 (18)9.2 (17)9.2 (17)41 (64)10/15
DE-ROLL voglis 29 (39)11 (11)8.4 (7)8.3 (6)8.3 (5)8.3 (5)8.5 (5)15/15
DE-SIMPLEX voglis 10 (11)7.9 (7)5.1 (7)4.6 (6)4.7 (5)4.7 (5)4.9 (5)15/15
DEAE posik 7.7 (5)1.4 (0.4)0.68 (0.1)↑00.83 (0.2)0.87 (0.2)0.87 (0.2)0.94 (0.2)15/15
DE posik 12 (11)3.4 (2)1.9 (0.6)2.5 (0.7)2.5 (0.7)2.5 (0.7)2.7 (0.8)15/15
DEb posik 12 (11)3.4 (2)1.9 (0.6)2.5 (0.7)2.5 (0.7)2.5 (0.7)2.7 (0.8)15/15
DEctpb posik 10 (7)3.3 (1)2.1 (0.9)2.7 (0.9)2.7 (0.8)2.7 (0.8)3.0 (0.9)15/15
IPOPsaACM loshchilov 3.7 (2)1.2 (1)0.68 (0.5)0.70 (0.9)0.77 (0.9)0.77 (0.9)0.90 (0.9)15/15
JADE posik 8.2 (5)2.0 (0.7)1.3 (0.4)1.4 (0.4)1.4 (0.3)1.4 (0.3)1.6 (0.3)15/15
JADEb posik 6.0 (3)57 (0.7)54 (107)64 (130)81 (80)81 (160)80 (157)10/15
JADEctpb posik 8.2 (5)2.0 (0.7)1.3 (0.4)1.4 (0.4)1.4 (0.3)1.4 (0.3)1.6 (0.3)15/15
MVDE melo 18 (7)7.0 (4)5.0 (2)7.2 (3)8.7 (4)8.7 (4)9.4 (4)15/15
NBIPOPaCMA loshchilov 4.7 (2)1.3 (1)0.86 (0.9)0.89 (0.7)0.86 (0.6)0.86 (0.6)0.88 (0.6)15/15
NIPOPaCMA loshchilov 5.9 (3)1.3 (1)0.93 (0.9)1.0 (0.8)0.99 (0.7)0.99 (0.7)1.1 (0.7)15/15
PSO-BFGS voglis 579 (924)458 (446)930 (523)1588 (2155)2363 (2106)2363 (4171)2326 (3069)1/15
SNES schaul 3.5 (3)37 (76)51 (56)81 (82)212 (257)212 (257)237 (253)14/15
xNES schaul 4.5 (2)2.9 (0.5)2.7 (4)2.3 (3)3.0 (6)3.0 (6)3.0 (6)15/15
xNESas schaul 4.3 (3)0.81 (0.3)3.2 (4)2.7 (4)2.6 (3)2.6 (3)2.6 (3)15/15

Δ fopt
f8, 5-D
1e1
73
1e0
273
1e-1
336
1e-2
372
1e-3
391
1e-5
410
1e-7
422
#succ
15/15
ACOR liao 5.5 (0.9)11 (2)43 (4)82 (6)120 (11)199 (10)278 (10)15/15
BIPOPaCMA loshchilov 3.0 (1)5.9 (5)6.2 (4)6.2 (4)6.2 (4)6.4 (4)6.7 (4)15/15
BIPOPsaACM loshchilov 2.2 (0.6)2.5 (2)2.5 (2)2.5 (2)2.5 (2)2.5 (1)2.5 (1)15/15
CMAES posik 4.3 (4)3.6 (1)4.4 (1)4.6 (1)4.7 (1)5.0 (1)5.2 (1)15/15
CMA brockhoff 3.4 (1.0)5.1 (5)5.7 (4)5.7 (4)5.8 (4)6.0 (4)6.3 (4)15/15
CMAa brockhoff 2.8 (1.0)4.5 (5)5.0 (5)5.0 (4)5.1 (4)5.3 (4)5.5 (4)15/15
CMAm brockhoff 2.6 (0.8)4.3 (5)4.9 (4)5.1 (4)5.2 (3)5.4 (3)5.6 (3)15/15
CMAma brockhoff 2.7 (1)3.2 (2)3.7 (2)3.9 (1)4.0 (1)4.2 (1)4.4 (1)15/15
CMAmah brockhoff 1.8 (0.6)3.5 (3)4.0 (3)4.2 (3)4.3 (2)4.4 (2)4.5 (2)15/15
CMAmh brockhoff 2.5 (1)4.5 (4)5.1 (4)5.3 (3)5.3 (3)5.5 (3)5.6 (3)15/15
DBRCGA chuang 18 (5)16 (7)24 (16)36 (18)43 (16)56 (22)75 (30)15/15
DE-AUTO voglis 1.6 (0.4)2.4 (4)2.1 (4)2.0 (3)1.9 (3)1.9 (3)1.8 (3)15/15
DE-BFGS voglis 2.8 (2)1.2 (0.6)1.1 (0.5)1.1 (0.4)1.1 (0.4)1.1 (0.4)1.1 (0.4)15/15
DE-ROLL voglis 4.6 (6)13 (10)40 (33)59 (40)83 (51)120 (38)1134 (1304)5/15
DE-SIMPLEX voglis 1.9 (0.8)2.2 (3)2.2 (2)2.1 (2)2.1 (2)2.2 (2)2.2 (2)15/15
DEAE posik 8.7 (3)10 (12)11 (10)11 (9)11 (8)11 (8)12 (8)15/15
DE posik 9.4 (4)14 (5)21 (8)26 (7)30 (8)40 (7)49 (8)15/15
DEb posik 9.4 (4)14 (5)21 (8)26 (7)30 (8)40 (7)49 (8)15/15
DEctpb posik 11 (2)10 (4)22 (9)28 (8)32 (8)44 (7)54 (8)15/15
IPOPsaACM loshchilov 2.3 (1)1.9 (0.7)2.0 (0.6)2.0 (0.5)2.0 (0.5)2.0 (0.5)2.1 (0.5)15/15
JADE posik 7.5 (3)7.3 (3)10 (3)11 (2)12 (2)13 (1)14 (1)15/15
JADEb posik 5.0 (1)11 (12)12 (10)12 (9)12 (9)13 (8)14 (8)15/15
JADEctpb posik 7.5 (3)7.3 (3)10 (3)11 (2)12 (2)13 (1)14 (1)15/15
MVDE melo 21 (8)20 (16)64 (69)134 (96)196 (117)388 (152)590 (194)15/15
NBIPOPaCMA loshchilov 2.9 (0.9)4.1 (4)4.6 (4)4.7 (3)4.8 (3)5.1 (3)5.3 (3)15/15
NIPOPaCMA loshchilov 4.1 (3)4.4 (5)4.8 (4)5.0 (4)5.0 (4)5.2 (4)5.5 (4)15/15
PSO-BFGS voglis 3.0 (2)1.8 (1)1.6 (0.8)1.5 (0.8)1.5 (0.7)1.5 (0.7)1.4 (0.7)15/15
SNES schaul 3.7 (1)87 (92)219 (164)424 (327)667 (328)1770 (1252)4065 (4449)4/15
xNES schaul 4.1 (2)3.9 (1)5.8 (3)7.0 (4)7.3 (4)7.7 (4)8.3 (4)15/15
xNESas schaul 3.4 (2)6.8 (3)8.7 (4)10 (9)16 (13)16 (13)16 (12)15/15

Δ fopt
f9, 5-D
1e1
35
1e0
127
1e-1
214
1e-2
263
1e-3
300
1e-5
335
1e-7
369
#succ
15/15
ACOR liao 12 (3)21 (8)59 (26)148 (82)251 (139)467 (266)655 (376)15/15
BIPOPaCMA loshchilov 7.8 (4)10 (10)7.7 (6)7.1 (5)6.6 (5)6.4 (4)6.3 (4)15/15
BIPOPsaACM loshchilov 4.2 (1)4.1 (4)3.1 (2)2.8 (2)2.6 (2)2.5 (2)2.3 (1)15/15
CMAES posik 5.5 (1)7.1 (3)6.5 (2)6.2 (1)5.8 (1)5.8 (1.0)5.7 (0.9)15/15
CMA brockhoff 6.9 (3)9.0 (11)7.7 (7)7.1 (5)6.8 (5)6.7 (5)6.5 (4)15/15
CMAa brockhoff 6.1 (2)6.5 (2)5.9 (1)5.6 (1)5.2 (1)5.2 (1.0)5.2 (0.9)15/15
CMAm brockhoff 5.4 (4)6.5 (2)6.2 (1)5.8 (1)5.6 (1.0)5.5 (0.8)5.3 (0.8)15/15
CMAma brockhoff 5.8 (2)6.9 (4)6.0 (2)5.8 (2)5.4 (2)5.3 (1)5.1 (1)15/15
CMAmah brockhoff 4.3 (1)9.4 (8)7.5 (5)6.8 (4)6.3 (3)6.1 (3)5.8 (3)15/15
CMAmh brockhoff 5.0 (2)11 (9)9.0 (5)8.2 (4)7.6 (4)7.4 (3)7.0 (3)15/15
DBRCGA chuang 34 (10)37 (26)42 (30)58 (45)72 (51)109 (77)129 (74)15/15
DE-AUTO voglis 3.6 (1)7.1 (6)4.5 (4)3.7 (3)3.3 (2)3.0 (2)2.8 (2)15/15
DE-BFGS voglis 4.2 (0.7)2.7 (2)1.9 (0.9)1.6 (0.8)1.5 (0.7)1.3 (0.6)1.2 (0.5)15/15
DE-ROLL voglis 8.0 (6)17 (10)71 (43)99 (62)124 (58)165 (67)361 (334)13/15
DE-SIMPLEX voglis 5.8 (4)4.4 (4)3.2 (2)2.8 (2)2.6 (2)2.5 (1)2.4 (1)15/15
DEAE posik 16 (5)13 (4)11 (4)10 (3)10 (3)10 (3)11 (3)15/15
DE posik 22 (8)37 (7)36 (10)39 (8)40 (11)50 (14)58 (17)15/15
DEb posik 22 (8)37 (7)36 (10)39 (8)40 (11)50 (14)58 (17)15/15
DEctpb posik 22 (11)29 (7)37 (9)41 (12)43 (11)53 (16)62 (19)15/15
IPOPsaACM loshchilov 5.0 (2)3.1 (1)2.5 (0.6)2.3 (0.5)2.1 (0.5)2.0 (0.5)2.0 (0.4)15/15
JADE posik 14 (2)24 (7)22 (5)20 (6)19 (5)19 (4)18 (4)15/15
JADEb posik 11 (2)20 (33)16 (20)15 (16)15 (13)15 (12)15 (11)15/15
JADEctpb posik 14 (2)24 (7)22 (5)20 (6)19 (5)19 (4)18 (4)15/15
MVDE melo 48 (12)79 (49)197 (94)263 (107)304 (85)454 (164)614 (232)15/15
NBIPOPaCMA loshchilov 5.2 (1)6.2 (3)5.6 (2)5.3 (1)5.0 (0.9)5.0 (1.0)5.0 (0.9)15/15
NIPOPaCMA loshchilov 5.6 (1)5.4 (2)5.0 (1)4.7 (1.0)4.6 (0.8)4.6 (0.8)4.6 (0.8)15/15
PSO-BFGS voglis 4.0 (1)2.2 (1)1.6 (0.9)1.4 (0.7)1.3 (0.6)1.2 (0.5)1.1 (0.5)15/15
SNES schaul 5.2 (2)69 (48)211 (80)507 (381)1482 (1916)2067 (1569)5488 (8269)4/15
xNES schaul 7.0 (2)8.2 (3)8.7 (4)8.8 (5)8.4 (5)8.3 (4)8.4 (4)15/15
xNESas schaul 6.3 (2)13 (4)12 (3)12 (5)11 (6)11 (6)11 (6)15/15

Δ fopt
f10, 5-D
1e1
349
1e0
500
1e-1
574
1e-2
607
1e-3
626
1e-5
829
1e-7
880
#succ
15/15
ACOR liao 663 (774)1847 (1728)3068 (1663)3981 (1793)5251 (2230)5799 (2317)9643 (7594)1/15
BIPOPaCMA loshchilov 2.6 (0.9)2.2 (0.6)2.1 (0.3)2.1 (0.3)2.2 (0.3)1.9 (0.1)2.0 (0.1)15/15
BIPOPsaACM loshchilov 0.76 (0.1)↑10.59 (0.1)↑00.58 (0.1)↑00.58 (0.1)↑00.60 (0.1)↑00.51 (0.1)↑00.53 (0.1)↑015/15
CMAES posik 3.6 (0.7)2.9 (0.5)2.7 (0.4)2.8 (0.3)2.8 (0.3)2.3 (0.2)2.3 (0.2)15/15
CMA brockhoff 2.8 (1)2.7 (0.8)2.6 (0.6)2.7 (0.4)2.8 (0.4)2.3 (0.3)2.3 (0.3)15/15
CMAa brockhoff 2.6 (0.8)2.2 (0.4)2.1 (0.2)2.1 (0.2)2.2 (0.2)1.8 (0.2)1.9 (0.2)15/15
CMAm brockhoff 3.9 (0.9)3.2 (0.7)3.0 (0.3)3.0 (0.3)3.0 (0.3)2.4 (0.2)2.4 (0.2)15/15
CMAma brockhoff 2.5 (0.8)2.2 (0.5)2.1 (0.3)2.1 (0.2)2.2 (0.2)1.8 (0.2)1.8 (0.2)15/15
CMAmah brockhoff 2.9 (1)2.5 (0.5)2.4 (0.3)2.3 (0.3)2.3 (0.3)1.9 (0.2)1.9 (0.2)15/15
CMAmh brockhoff 4.1 (1)3.4 (0.9)3.3 (0.3)3.2 (0.3)3.2 (0.3)2.5 (0.2)2.5 (0.2)15/15
DBRCGA chuang 59 (46)194 (275)407 (299)692 (554)1183 (890)1630 (1809)4069 (3835)2/15
DE-AUTO voglis 2.6 (4)1.9 (3)1.6 (3)1.6 (3)1.5 (2)1.2 (2)1.1 (2)15/15
DE-BFGS voglis 0.75 (0.7)0.54 (0.4)0.49 (0.4)0.48 (0.4)↑10.48 (0.4)↑10.39 (0.3)↑10.50 (0.9)15/15
DE-ROLL voglis 93 (102)121 (86)129 (82)153 (63)176 (66)178 (43)1865 (1899)1/15
DE-SIMPLEX voglis 2.9 (3)2.7 (2)2.5 (1)2.4 (1)2.4 (1)1.9 (1.0)2.0 (2)15/15
DEAE posik 3.0 (0.4)2.5 (0.3)2.6 (0.4)2.9 (0.2)3.2 (0.2)3.0 (0.3)3.4 (0.2)15/15
DE posik 27 (8)28 (6)32 (6)36 (7)43 (8)42 (6)49 (7)15/15
DEb posik 27 (8)28 (6)32 (6)36 (7)43 (8)42 (6)49 (7)15/15
DEctpb posik 32 (7)32 (6)37 (8)43 (5)52 (6)51 (5)61 (6)15/15
IPOPsaACM loshchilov 0.77 (0.2)↑10.61 (0.1)↑00.57 (0.1)↑00.58 (0.1)↑00.60 (0.1)↑00.51 (0.1)↑00.53 (0.1)↑015/15
JADE posik 6.1 (1)5.1 (0.8)5.0 (0.8)5.2 (0.6)5.4 (0.7)4.8 (0.5)5.1 (0.5)15/15
JADEb posik 6.7 (2)5.7 (2)6.0 (1)6.4 (2)6.6 (2)5.8 (2)6.1 (1)15/15
JADEctpb posik 6.1 (1)5.1 (0.8)5.0 (0.8)5.2 (0.6)5.4 (0.7)4.8 (0.5)5.1 (0.5)15/15
MVDE melo 137 (86)198 (73)332 (134)535 (191)780 (257)996 (230)2755 (3501)1/15
NBIPOPaCMA loshchilov 2.8 (0.8)2.2 (0.5)2.1 (0.2)2.1 (0.2)2.2 (0.2)1.8 (0.2)1.9 (0.2)15/15
NIPOPaCMA loshchilov 2.7 (0.7)2.3 (0.3)2.1 (0.3)2.1 (0.3)2.2 (0.3)1.8 (0.2)1.9 (0.2)15/15
PSO-BFGS voglis 1.3 (1)0.94 (1)0.84 (0.9)0.81 (0.9)0.79 (0.8)0.62 (0.6)1.7 (0.6)15/15
SNES schaul 3423 (3287)5372 (5128)1e60/15
xNES schaul 2.1 (0.6)1.9 (0.3)1.9 (0.2)2.0 (0.2)2.3 (0.2)2.2 (0.2)2.5 (0.2)15/15
xNESas schaul 2.0 (0.8)1.8 (0.7)1.8 (0.6)1.9 (0.5)2.0 (0.5)1.9 (0.4)2.0 (0.3)15/15

Δ fopt
f11, 5-D
1e1
143
1e0
202
1e-1
763
1e-2
977
1e-3
1177
1e-5
1467
1e-7
1673
#succ
15/15
ACOR liao 129 (102)257 (72)118 (34)122 (22)130 (26)152 (30)177 (34)15/15
BIPOPaCMA loshchilov 5.0 (2)4.6 (1)1.4 (0.2)1.2 (0.2)1.1 (0.2)0.94 (0.1)0.91 (0.1)↑015/15
BIPOPsaACM loshchilov 2.1 (0.3)1.6 (0.2)0.47 (0.1)↑00.39 (0.0)↑00.34 (0.0)↑00.30 (0.0)↑00.29 (0.0)↑015/15
CMAES posik 9.1 (1)7.7 (1)2.3 (0.3)1.9 (0.2)1.6 (0.2)1.4 (0.2)1.3 (0.1)15/15
CMA brockhoff 8.7 (2)7.6 (1)2.2 (0.4)1.9 (0.3)1.6 (0.2)1.4 (0.2)1.3 (0.2)15/15
CMAa brockhoff 5.2 (1.0)4.6 (0.7)1.4 (0.2)1.2 (0.1)1.1 (0.1)0.95 (0.1)0.93 (0.1)15/15
CMAm brockhoff 8.4 (3)7.8 (1)2.3 (0.3)1.9 (0.2)1.7 (0.2)1.4 (0.2)1.3 (0.1)15/15
CMAma brockhoff 5.1 (1)4.4 (0.8)1.3 (0.2)1.1 (0.1)1.0 (0.1)0.88 (0.1)↑00.84 (0.1)↑015/15
CMAmah brockhoff 6.4 (2)6.2 (1)1.8 (0.3)1.5 (0.2)1.3 (0.2)1.1 (0.1)1.0 (0.1)15/15
CMAmh brockhoff 12 (4)10 (2)3.0 (0.3)2.4 (0.2)2.1 (0.2)1.7 (0.1)1.6 (0.1)15/15
DBRCGA chuang 18 (9)106 (110)77 (75)80 (70)100 (79)140 (85)177 (186)11/15
DE-AUTO voglis 2.5 (0.1)1.9 (0.1)0.51 (0.0)↑10.41 (0.0)↑10.35 (0.0)↑10.29 (0.0)↑10.61 (1)15/15
DE-BFGS voglis 0.69 (0.2)↑10.53 (0.1)↑00.15 (0.0)↑00.13 (0.0)↑00.11 (0.0)↑00.11 (0.0)↑00.12 (0.1)↑015/15
DE-ROLL voglis 76 (76)163 (111)63 (26)79 (18)81 (14)92 (14)2107 (2249)0/15
DE-SIMPLEX voglis 4.5 (4)5.3 (3)1.7 (0.5)1.5 (0.8)1.3 (0.6)1.1 (0.5)0.97 (0.4)15/15
DEAE posik 4.4 (1)4.9 (1)1.7 (0.3)1.6 (0.3)1.5 (0.2)1.5 (0.2)1.6 (0.2)15/15
DE posik 32 (23)42 (19)16 (5)17 (5)17 (4)19 (4)23 (4)15/15
DEb posik 32 (23)42 (19)16 (5)17 (5)17 (4)19 (4)23 (4)15/15
DEctpb posik 26 (18)44 (17)18 (5)19 (4)21 (5)24 (6)27 (6)15/15
IPOPsaACM loshchilov 2.0 (0.4)1.6 (0.3)0.46 (0.1)↑00.39 (0.1)↑00.34 (0.1)↑00.30 (0.1)↑00.29 (0.0)↑015/15
JADE posik 8.0 (3)8.9 (1)2.8 (0.4)2.5 (0.4)2.3 (0.3)2.2 (0.2)2.3 (0.2)15/15
JADEb posik 9.0 (4)12 (6)4.0 (1)3.4 (1)3.0 (0.9)2.8 (0.8)2.7 (0.7)15/15
JADEctpb posik 8.0 (3)8.9 (1)2.8 (0.4)2.5 (0.4)2.3 (0.3)2.2 (0.2)2.3 (0.2)15/15
MVDE melo 43 (32)195 (124)123 (53)190 (97)267 (143)383 (201)795 (992)6/15
NBIPOPaCMA loshchilov 6.1 (1)5.0 (0.8)1.5 (0.2)1.2 (0.2)1.1 (0.1)0.97 (0.1)0.94 (0.1)15/15
NIPOPaCMA loshchilov 5.2 (1)4.3 (0.7)1.3 (0.1)1.2 (0.2)1.0 (0.1)0.93 (0.1)0.90 (0.1)↑115/15
PSO-BFGS voglis 0.59 (0.1)↑00.45 (0.1)↑00.13 (0.0)↑00.11 (0.0)↑00.10 (0.0)↑00.09 (0.0)↑00.11 (0.0)↑015/15
SNES schaul 3896 (2956)1e60/15
xNES schaul 4.4 (1)3.9 (1)1.2 (0.3)1.1 (0.2)1.1 (0.2)1.1 (0.1)1.2 (0.1)15/15
xNESas schaul 4.2 (3)4.3 (1)1.3 (0.3)1.1 (0.2)1.1 (0.2)1.0 (0.1)1.1 (0.1)15/15

Δ fopt
f12, 5-D
1e1
108
1e0
268
1e-1
371
1e-2
413
1e-3
461
1e-5
1303
1e-7
1494
#succ
15/15
ACOR liao 4137 (7133)3.3e4 (5e4)7.8e4 (7e4)1.8e5 (1e5)1e70/15
BIPOPaCMA loshchilov 12 (9)8.3 (6)7.7 (6)7.6 (6)7.4 (6)3.0 (3)3.2 (3)15/15
BIPOPsaACM loshchilov 2.6 (0.8)2.1 (2)2.1 (2)2.4 (3)2.5 (3)1.4 (1)1.7 (2)15/15
CMAES posik 8.4 (9)5.9 (7)7.1 (7)7.7 (6)7.9 (5)3.5 (2)3.8 (2)15/15
CMA brockhoff 10 (8)8.3 (5)8.4 (5)8.5 (5)8.6 (5)3.7 (2)3.7 (3)15/15
CMAa brockhoff 8.7 (6)7.2 (6)7.9 (6)8.4 (6)8.5 (6)3.7 (2)3.7 (2)15/15
CMAm brockhoff 7.4 (8)7.5 (6)8.2 (6)8.6 (6)8.7 (6)3.9 (3)3.9 (3)15/15
CMAma brockhoff 6.1 (3)4.9 (5)5.3 (5)5.7 (4)5.9 (4)2.6 (2)2.6 (2)15/15
CMAmah brockhoff 6.5 (8)7.3 (7)8.1 (6)8.8 (5)8.8 (5)3.9 (2)3.8 (2)15/15
CMAmh brockhoff 8.3 (10)8.9 (10)10 (9)10 (9)10 (9)4.5 (4)4.5 (4)15/15
DBRCGA chuang 616 (1693)1327 (1930)9435 (1e4)5e50/15
DE-AUTO voglis 2.8 (3)2.2 (2)2.2 (2)2.2 (2)2.2 (2)0.93 (0.8)1.2 (1)15/15
DE-BFGS voglis 2.8 (1)2.0 (1)1.9 (1)2.0 (1)1.9 (1)0.80 (0.5)1.1 (0.7)15/15
DE-ROLL voglis 21 (19)112 (37)148 (105)173 (200)211 (256)118 (148)485 (792)1/15
DE-SIMPLEX voglis 4.1 (4)3.1 (2)3.4 (2)3.5 (2)3.4 (2)1.6 (1)2.0 (2)15/15
DEAE posik 15 (5)11 (4)11 (6)12 (6)13 (6)5.6 (3)5.6 (3)15/15
DE posik 103 (94)107 (85)117 (116)129 (129)135 (129)63 (51)66 (52)15/15
DEb posik 103 (94)107 (85)117 (116)129 (129)135 (129)63 (51)66 (52)15/15
DEctpb posik 89 (42)77 (46)104 (117)122 (140)138 (134)70 (57)80 (56)14/15
IPOPsaACM loshchilov 3.8 (3)2.9 (2)2.8 (2)2.8 (2)2.8 (2)1.2 (0.9)1.2 (0.9)15/15
JADE posik 24 (3)13 (4)12 (7)13 (7)14 (7)6.1 (3)6.2 (4)15/15
JADEb posik 18 (13)15 (8)15 (10)15 (12)15 (11)6.7 (4)6.7 (4)15/15
JADEctpb posik 24 (3)13 (4)12 (7)13 (7)14 (7)6.1 (3)6.2 (4)15/15
MVDE melo 207 (116)342 (277)714 (673)1077 (799)1417 (756)1221 (1262)3255 (2004)2/15
NBIPOPaCMA loshchilov 11 (6)6.9 (6)6.5 (6)6.6 (6)6.5 (5)2.7 (2)2.8 (2)15/15
NIPOPaCMA loshchilov 11 (16)8.2 (11)8.0 (9)8.0 (8)7.9 (8)3.4 (3)3.4 (3)15/15
PSO-BFGS voglis 2.8 (2)1.7 (1)1.5 (1)1.5 (1)1.7 (1)0.73 (0.5)0.86 (0.9)15/15
SNES schaul 43 (92)219 (274)296 (609)2093 (2326)5021 (4623)1e60/15
xNES schaul 11 (3)24 (38)32 (41)48 (91)50 (107)22 (39)25 (35)15/15
xNESas schaul 16 (28)36 (66)36 (58)44 (107)51 (97)21 (35)31 (34)15/15

Δ fopt
f13, 5-D
1e1
132
1e0
195
1e-1
250
1e-2
319
1e-3
1310
1e-5
1752
1e-7
2255
#succ
15/15
ACOR liao 99 (222)474 (602)2135 (2397)5323 (3022)5449 (7692)8.1e4 (7e4)1e70/15
BIPOPaCMA loshchilov 3.2 (2)3.8 (1)4.3 (0.8)4.1 (0.7)1.2 (0.1)1.2 (0.1)1.1 (0.2)15/15
BIPOPsaACM loshchilov 1.2 (0.3)1.3 (0.4)1.3 (0.3)1.3 (0.2)0.37 (0.1)↑00.34 (0.1)↑00.32 (0.1)↑015/15
CMAES posik 4.5 (3)4.8 (3)5.1 (2)4.7 (1)1.5 (0.4)1.5 (0.4)1.4 (0.4)15/15
CMA brockhoff 3.3 (2)5.3 (2)5.5 (2)5.0 (1)1.4 (0.3)1.6 (0.3)1.5 (0.3)15/15
CMAa brockhoff 2.9 (0.7)4.1 (2)4.5 (1)4.1 (0.6)1.2 (0.2)1.2 (0.1)1.2 (0.1)15/15
CMAm brockhoff 4.0 (3)5.0 (2)4.7 (2)5.3 (3)1.7 (0.7)1.8 (0.8)2.0 (0.8)15/15
CMAma brockhoff 3.1 (2)4.5 (3)4.6 (2)4.2 (1)1.2 (0.3)1.3 (0.2)1.2 (0.2)15/15
CMAmah brockhoff 4.0 (4)5.6 (4)5.6 (3)5.1 (2)1.7 (0.8)1.7 (0.6)1.6 (0.5)15/15
CMAmh brockhoff 4.7 (5)10 (3)8.9 (2)8.6 (3)2.2 (0.8)2.5 (1)2.8 (0.9)15/15
DBRCGA chuang 22 (8)138 (160)603 (907)1457 (2003)1034 (973)2061 (2680)5e50/15
DE-AUTO voglis 0.99 (0.1)0.87 (0.1)↑00.83 (0.1)↑00.78 (0.1)↑00.22 (0.0)↑01.1 (0.5)0.96 (0.1)15/15
DE-BFGS voglis 1.0 (0.2)0.91 (0.1)↑10.87 (0.1)↑10.82 (0.0)↑10.23 (0.0)↑02.6 (1.0)528 (486)0/15
DE-ROLL voglis 20 (18)43 (38)53 (29)55 (28)16 (7)16 (4)79 (122)12/15
DE-SIMPLEX voglis 4.8 (4)6.2 (5)8.4 (6)8.2 (6)2.3 (1)2.2 (1)2.7 (2)15/15
DEAE posik 6.0 (0.8)6.4 (1.0)6.7 (0.5)6.8 (0.5)2.0 (0.1)2.0 (0.1)2.0 (0.1)15/15
DE posik 14 (4)26 (11)39 (11)54 (17)19 (7)28 (9)45 (23)6/15
DEb posik 14 (4)26 (11)39 (11)54 (17)19 (7)28 (9)45 (23)6/15
DEctpb posik 17 (8)30 (10)49 (16)66 (20)23 (6)30 (6)34 (4)12/15
IPOPsaACM loshchilov 1.2 (0.4)1.1 (0.3)1.2 (0.3)1.2 (0.3)0.33 (0.1)↑00.35 (0.1)↑00.33 (0.1)↑015/15
JADE posik 8.2 (1)12 (2)12 (2)11 (1)3.1 (0.3)2.9 (0.2)2.6 (0.2)15/15
JADEb posik 5.4 (2)8.9 (3)11 (3)11 (3)3.5 (1)3.5 (1)3.3 (0.8)15/15
JADEctpb posik 8.2 (1)12 (2)12 (2)11 (1)3.1 (0.3)2.9 (0.2)2.6 (0.2)15/15
MVDE melo 29 (12)92 (44)239 (114)487 (257)280 (188)2644 (2426)1e60/15
NBIPOPaCMA loshchilov 2.7 (1)3.3 (2)3.9 (1)3.7 (1)1.1 (0.2)1.2 (0.2)1.2 (0.1)15/15
NIPOPaCMA loshchilov 2.9 (2)4.4 (2)4.7 (1)4.3 (1.0)1.2 (0.2)1.3 (0.3)1.2 (0.2)15/15
PSO-BFGS voglis 0.99 (0.1)0.87 (0.1)↑00.84 (0.1)↑00.79 (0.1)↑00.22 (0.0)↑0181 (409)5e50/15
SNES schaul 44 (76)157 (174)335 (294)981 (733)860 (983)2575 (3252)6384 (7064)0/15
xNES schaul 3.6 (0.8)4.3 (0.3)4.7 (0.3)4.8 (0.2)1.4 (0.1)1.5 (0.1)1.5 (0.1)15/15
xNESas schaul 3.3 (0.6)3.7 (0.5)4.0 (0.5)4.0 (0.4)1.3 (0.2)1.4 (0.2)1.5 (0.2)15/15

Δ fopt
f14, 5-D
1e1
10
1e0
41
1e-1
58
1e-2
90
1e-3
139
1e-5
251
1e-7
476
#succ
15/15
ACOR liao 1.7 (2)4.7 (2)6.4 (1)7.0 (2)9.2 (3)123 (85)4.8e4 (7e4)0/15
BIPOPaCMA loshchilov 2.2 (3)2.6 (1)3.3 (0.8)3.6 (0.9)3.9 (0.7)3.9 (0.7)3.2 (0.3)15/15
BIPOPsaACM loshchilov 1.4 (2)2.3 (0.5)2.4 (0.5)2.5 (0.6)2.2 (0.3)1.8 (0.2)1.3 (0.1)15/15
CMAES posik 1.4 (1)2.9 (1)3.8 (0.8)4.0 (0.9)4.2 (1)5.4 (1)4.4 (0.5)15/15
CMA brockhoff 2.3 (3)2.8 (0.9)3.5 (1)3.9 (0.8)4.2 (1)5.4 (0.5)4.4 (0.6)15/15
CMAa brockhoff 2.5 (3)2.7 (1)3.5 (1)4.0 (1)4.0 (0.7)3.9 (0.4)3.1 (0.4)15/15
CMAm brockhoff 1.6 (2)2.8 (1)3.2 (2)3.3 (1)4.1 (1.0)5.4 (1)4.4 (0.6)15/15
CMAma brockhoff 1.8 (2)2.8 (0.9)3.3 (0.6)3.2 (1)3.7 (0.7)4.0 (0.8)3.0 (0.4)15/15
CMAmah brockhoff 1.4 (1)2.1 (0.8)2.4 (0.6)3.0 (0.8)3.4 (0.9)4.1 (1)3.5 (0.4)15/15
CMAmh brockhoff 1.4 (2)2.1 (1)2.5 (0.9)2.8 (1)4.1 (2)6.4 (0.8)5.1 (0.6)15/15
DBRCGA chuang 1.5 (1)15 (7)25 (3)24 (4)25 (8)110 (97)1315 (860)1/15
DE-AUTO voglis 1.7 (1)2.0 (0.3)1.7 (0.2)1.3 (0.2)0.99 (0.1)0.73 (0.1)↑05.1 (5)15/15
DE-BFGS voglis 1.0 (1)1.8 (0.2)1.5 (0.3)1.2 (0.2)0.94 (0.1)0.71 (0.1)↑06.4 (10)13/15
DE-ROLL voglis 1.4 (2)4.7 (6)4.9 (4)5.0 (3)10 (10)113 (33)1823 (1466)0/15
DE-SIMPLEX voglis 0.93 (2)5.3 (4)4.9 (3)3.9 (2)3.1 (0.9)2.2 (0.5)1.5 (0.3)15/15
DEAE posik 2.2 (3)6.3 (3)11 (2)11 (2)9.4 (1)7.9 (0.9)5.6 (0.6)15/15
DE posik 1.8 (3)7.2 (3)12 (2)12 (2)15 (4)37 (8)47 (12)15/15
DEb posik 1.8 (3)7.2 (3)12 (2)12 (2)15 (4)37 (8)47 (12)15/15
DEctpb posik 1.1 (1)6.2 (4)12 (2)14 (2)16 (3)40 (12)52 (10)15/15
IPOPsaACM loshchilov 2.8 (2)2.4 (0.6)2.5 (0.6)2.4 (0.5)2.1 (0.3)1.8 (0.2)1.3 (0.1)15/15
JADE posik 0.93 (0.8)5.3 (2)8.9 (2)9.1 (2)10 (2)12 (1)8.2 (0.5)15/15
JADEb posik 1.3 (1)4.0 (1.0)6.1 (1)6.2 (1)7.8 (1)10 (2)8.2 (3)15/15
JADEctpb posik 0.93 (0.8)5.3 (2)8.9 (2)9.1 (2)10 (2)12 (1)8.2 (0.5)15/15
MVDE melo 0.89 (0.9)14 (6)26 (7)29 (4)38 (9)173 (39)591 (271)15/15
NBIPOPaCMA loshchilov 1.7 (2)2.5 (1)3.6 (0.8)3.9 (0.8)4.1 (0.5)4.2 (0.5)3.2 (0.4)15/15
NIPOPaCMA loshchilov 2.0 (2)3.1 (1)3.9 (1)3.9 (1.0)4.3 (0.7)4.0 (0.5)3.2 (0.4)15/15
PSO-BFGS voglis 2.2 (3)1.9 (0.3)1.6 (0.2)1.3 (0.2)0.98 (0.1)0.76 (0.1)↑0134 (203)4/15
SNES schaul 2.5 (3)2.4 (1)3.3 (1)4.2 (0.5)8.3 (10)1.2e4 (8489)1e60/15
xNES schaul 2.3 (2)2.1 (1)4.2 (1)5.5 (0.9)5.5 (0.7)5.1 (0.7)3.9 (0.2)15/15
xNESas schaul 1.9 (2)1.9 (0.9)3.9 (1)4.9 (1)4.9 (1)4.6 (0.5)3.3 (0.3)15/15

Δ fopt
f15, 5-D
1e1
511
1e0
9310
1e-1
19369
1e-2
19743
1e-3
20073
1e-5
20769
1e-7
21359
#succ
14/15
ACOR liao 5.3 (4)7.7 (11)17 (27)16 (27)16 (26)16 (25)15 (25)15/15
BIPOPaCMA loshchilov 1.5 (2)1.1 (0.8)1.4 (1)1.4 (1)1.3 (1)1.3 (1)1.3 (1)15/15
BIPOPsaACM loshchilov 1.4 (1)0.59 (0.5)0.65 (0.5)0.65 (0.5)0.64 (0.5)0.62 (0.5)0.61 (0.4)15/15
CMAES posik 2.1 (2)5.0 (5)15 (14)15 (15)15 (14)14 (13)14 (14)9/15
CMA brockhoff 1.6 (2)0.74 (0.5)0.86 (0.6)0.86 (0.6)0.86 (0.6)0.86 (0.6)0.87 (0.6)15/15
CMAa brockhoff 1.5 (2)1.1 (0.7)1.2 (0.6)1.2 (0.7)1.2 (0.7)1.2 (0.6)1.2 (0.6)15/15
CMAm brockhoff 1.8 (2)0.74 (0.6)0.66 (0.4)↑10.67 (0.4)0.67 (0.4)0.67 (0.3)0.68 (0.3)15/15
CMAma brockhoff 1.0 (0.5)0.86 (0.6)1.1 (0.8)1.1 (0.8)1.1 (0.8)1.1 (0.8)1.1 (0.8)15/15
CMAmah brockhoff 2.0 (2)0.98 (0.5)1.1 (0.7)1.1 (0.7)1.1 (0.7)1.1 (0.7)1.1 (0.7)15/15
CMAmh brockhoff 3.2 (3)0.95 (0.5)1.1 (0.6)1.1 (0.6)1.1 (0.6)1.1 (0.6)1.1 (0.6)15/15
DBRCGA chuang 3.7 (2)26 (24)84 (93)83 (87)81 (126)79 (85)77 (71)4/15
DE-AUTO voglis 15 (9)6.1 (7)11 (14)11 (15)11 (13)11 (13)10 (13)13/15
DE-BFGS voglis 3.8 (3)1.1 (1)1.6 (1)1.6 (1)1.6 (1)1.5 (1)1.5 (1)15/15
DE-ROLL voglis 24 (14)7.0 (6)12 (17)12 (14)12 (13)12 (13)11 (15)13/15
DE-SIMPLEX voglis 10 (5)3.1 (3)3.2 (3)3.1 (3)3.0 (3)2.9 (3)2.9 (3)15/15
DEAE posik 3.9 (4)4.2 (4)4.8 (5)4.7 (5)4.6 (5)4.5 (5)4.4 (5)14/15
DE posik 6.1 (5)4.3 (4)6.0 (7)5.9 (8)5.9 (8)5.7 (7)5.6 (7)13/15
DEb posik 6.1 (5)4.3 (4)6.0 (6)5.9 (6)5.9 (8)5.7 (8)5.6 (6)13/15
DEctpb posik 6.0 (4)4.9 (4)7.1 (8)7.2 (8)7.2 (7)7.1 (7)7.1 (10)12/15
IPOPsaACM loshchilov 1.6 (1)0.42 (0.4)↑10.72 (0.6)0.71 (0.6)0.71 (0.6)0.70 (0.6)0.69 (0.6)15/15
JADE posik 3.7 (1)7.5 (14)39 (52)39 (47)39 (61)59 (51)175 (219)1/15
JADEb posik 3.0 (2)14 (15)32 (51)31 (26)39 (53)38 (84)37 (41)4/15
JADEctpb posik 3.7 (1)7.5 (14)39 (38)39 (51)39 (53)59 (39)175 (296)1/15
MVDE melo 5.1 (2)12 (12)26 (28)28 (64)31 (30)32 (26)32 (28)11/15
NBIPOPaCMA loshchilov 1.7 (2)0.99 (1)1.6 (0.9)1.6 (0.9)1.6 (0.9)1.5 (0.9)1.5 (0.8)15/15
NIPOPaCMA loshchilov 1.4 (2)1.1 (0.9)1.2 (0.7)1.2 (0.7)1.2 (0.7)1.2 (0.7)1.2 (0.7)15/15
PSO-BFGS voglis 10 (7)6.6 (5)39 (35)38 (41)37 (59)36 (35)35 (43)8/15
SNES schaul 5.0 (10)14 (14)23 (20)23 (19)22 (19)22 (18)21 (18)14/15
xNES schaul 1.8 (1)5.3 (6)25 (24)25 (25)24 (27)24 (36)23 (48)11/15
xNESas schaul 3.6 (6)4.3 (4)18 (20)18 (20)18 (19)17 (19)16 (18)14/15

Δ fopt
f16, 5-D
1e1
120
1e0
612
1e-1
2662
1e-2
10163
1e-3
10449
1e-5
11644
1e-7
12095
#succ
15/15
ACOR liao 7.0 (9)325 (232)154 (187)65 (79)66 (77)70 (66)75 (83)15/15
BIPOPaCMA loshchilov 3.6 (2)3.5 (3)1.8 (2)0.75 (1.0)0.74 (1.0)0.71 (0.8)0.71 (0.8)15/15
BIPOPsaACM loshchilov 3.2 (4)4.3 (2)1.6 (1)0.69 (0.7)0.82 (0.7)0.77 (0.7)0.79 (0.7)15/15
CMAES posik 2.0 (2)3.6 (4)2.7 (4)3.2 (5)4.5 (8)5.8 (7)5.7 (7)15/15
CMA brockhoff 2.3 (2)3.1 (3)1.9 (2)0.73 (0.7)1.1 (1)1.00 (1)1.00 (1)15/15
CMAa brockhoff 1.7 (1)2.8 (3)2.2 (2)0.77 (0.7)0.84 (0.6)0.80 (0.5)0.80 (0.5)15/15
CMAm brockhoff 2.9 (4)5.0 (6)3.0 (2)1.0 (0.6)1.0 (0.6)1.1 (0.7)1.1 (0.7)15/15
CMAma brockhoff 2.3 (2)3.3 (5)1.7 (0.8)0.84 (0.6)0.88 (0.6)0.83 (0.5)0.83 (0.5)15/15
CMAmah brockhoff 2.3 (1)3.8 (4)2.4 (2)0.94 (0.7)0.94 (0.7)0.90 (0.6)0.90 (0.6)15/15
CMAmh brockhoff 2.9 (1)3.8 (3)2.5 (1)1.2 (1)1.2 (1)1.1 (1.0)1.1 (1.0)15/15
DBRCGA chuang 2.2 (1)27 (41)38 (51)34 (34)50 (60)86 (68)101 (133)5/15
DE-AUTO voglis 6.6 (15)115 (105)99 (95)65 (65)93 (114)86 (45)605 (801)1/15
DE-BFGS voglis 8.0 (8)17 (12)21 (9)12 (25)33 (51)30 (44)585 (622)0/15
DE-ROLL voglis 8.3 (9)69 (41)62 (96)69 (111)73 (88)110 (148)616 (497)0/15
DE-SIMPLEX voglis 2.4 (2)7.6 (7)19 (25)7.6 (9)10 (9)10 (8)37 (55)7/15
DEAE posik 3.2 (4)26 (15)12 (9)3.2 (3)3.2 (2)3.3 (3)3.2 (2)15/15
DE posik 5.2 (6)31 (13)17 (16)8.1 (6)11 (10)10 (9)10 (8)14/15
DEb posik 5.2 (6)31 (13)17 (16)8.1 (6)11 (10)10 (9)10 (8)14/15
DEctpb posik 3.9 (5)54 (30)52 (30)53 (49)165 (161)149 (182)144 (149)2/15
IPOPsaACM loshchilov 3.1 (4)2.4 (2)1.0 (1)0.49 (0.6)0.52 (0.6)0.55 (0.6)0.55 (0.5)15/15
JADE posik 2.9 (5)10 (5)36 (48)64 (52)2e50/15
JADEb posik 3.1 (3)4.5 (2)6.8 (8)4.4 (7)7.6 (13)8.4 (12)8.7 (11)12/15
JADEctpb posik 2.9 (5)10 (5)36 (57)64 (51)2e50/15
MVDE melo 1.8 (2)24 (11)90 (163)116 (126)1411 (1149)1e60/15
NBIPOPaCMA loshchilov 2.6 (2)4.6 (6)2.4 (2)0.99 (1)0.99 (1)0.94 (1.0)0.93 (1.0)15/15
NIPOPaCMA loshchilov 1.8 (2)2.7 (5)1.0 (1)0.55 (0.6)0.56 (0.6)0.55 (0.5)0.57 (0.5)15/15
PSO-BFGS voglis 7.0 (8)41 (37)75 (112)62 (76)111 (165)298 (459)594 (518)1/15
SNES schaul 3.0 (3)7.8 (16)13 (24)5.1 (6)11 (10)41 (43)61 (83)9/15
xNES schaul 2.0 (2)3.6 (2)4.4 (8)2.4 (3)2.5 (3)2.3 (3)2.2 (3)15/15
xNESas schaul 2.3 (2)5.3 (8)1.7 (3)1.6 (2)1.8 (2)1.6 (2)1.6 (2)15/15

Δ fopt
f17, 5-D
1e1
5.0
1e0
215
1e-1
899
1e-2
2861
1e-3
3669
1e-5
6351
1e-7
7934
#succ
15/15
ACOR liao 3.2 (3)1.8 (0.4)0.95 (0.2)0.49 (0.1)↑02.8 (8)7.5 (9)11 (14)15/15
BIPOPaCMA loshchilov 3.9 (6)0.86 (0.3)1.1 (2)0.83 (0.6)0.83 (0.5)0.94 (0.7)1.4 (0.4)15/15
BIPOPsaACM loshchilov 4.0 (6)1.0 (1)1.2 (2)0.80 (0.7)0.92 (0.5)1.1 (0.4)1.4 (1)15/15
CMAES posik 4.3 (4)0.96 (0.4)0.74 (0.2)↑10.74 (1)1.2 (2)8.5 (11)30 (31)9/15
CMA brockhoff 1.9 (2)0.82 (0.3)↑10.93 (2)0.75 (0.6)0.89 (0.6)1.1 (0.7)1.2 (0.4)15/15
CMAa brockhoff 2.7 (2)1.3 (0.4)0.77 (1.0)0.69 (0.6)0.89 (0.5)0.81 (0.3)1.0 (0.4)15/15
CMAm brockhoff 3.6 (3)0.85 (0.5)0.58 (0.1)↑10.47 (0.4)↑10.73 (0.4)↑10.77 (0.5)0.91 (0.3)15/15
CMAma brockhoff 3.5 (2)1.5 (0.4)1.1 (1)0.71 (0.6)0.84 (0.9)0.82 (0.5)0.96 (0.4)15/15
CMAmah brockhoff 3.2 (2)1.5 (2)2.1 (2)1.2 (0.6)1.3 (0.8)1.1 (0.5)1.0 (0.4)15/15
CMAmh brockhoff 2.6 (2)1.2 (0.6)2.6 (3)1.5 (2)1.5 (1.0)1.4 (0.6)1.5 (0.6)15/15
DBRCGA chuang 3.9 (5)5.4 (0.8)7.7 (1)12 (12)16 (14)38 (37)88 (103)4/15
DE-AUTO voglis 3.9 (3)163 (53)120 (212)52 (70)47 (57)35 (32)41 (46)10/15
DE-BFGS voglis 3.1 (3)7.1 (7)35 (110)12 (35)10 (27)6.9 (16)145 (126)0/15
DE-ROLL voglis 2.8 (3)47 (41)125 (261)60 (88)54 (69)45 (40)898 (1295)1/15
DE-SIMPLEX voglis 2.6 (2)23 (16)55 (35)29 (44)24 (34)15 (20)887 (1136)0/15
DEAE posik 3.2 (4)2.7 (1)1.5 (0.2)0.78 (0.1)↑00.85 (0.1)0.80 (0.1)↑00.91 (0.1)↑115/15
DE posik 4.2 (6)3.2 (1.0)2.2 (0.5)1.3 (0.3)2.1 (0.5)2.8 (2)3.3 (3)15/15
DEb posik 4.2 (6)3.2 (1.0)2.2 (0.5)1.3 (0.3)2.1 (0.5)2.8 (2)3.3 (3)15/15
DEctpb posik 4.3 (5)3.4 (1)2.6 (0.9)1.7 (0.4)2.1 (0.5)2.1 (0.5)3.7 (2)15/15
IPOPsaACM loshchilov 5.1 (4)1.7 (0.4)1.1 (1)0.83 (0.6)0.85 (0.5)1.2 (0.5)1.4 (0.8)15/15
JADE posik 3.5 (4)2.5 (0.7)1.9 (0.3)1.0 (0.2)1.2 (0.2)1.2 (0.3)1.2 (0.2)15/15
JADEb posik 3.2 (3)1.4 (0.6)3.3 (7)3.7 (7)3.4 (7)5.3 (5)9.0 (7)13/15
JADEctpb posik 3.5 (4)2.5 (0.7)1.9 (0.3)1.0 (0.2)1.2 (0.2)1.2 (0.3)1.2 (0.2)15/15
MVDE melo 3.1 (4)5.8 (2)5.8 (2)4.5 (1)6.8 (3)10 (6)32 (64)13/15
NBIPOPaCMA loshchilov 6.7 (6)5.7 (7)2.1 (2)0.95 (0.6)1.1 (1)1.0 (0.6)1.3 (0.7)15/15
NIPOPaCMA loshchilov 5.7 (5)0.99 (0.4)0.88 (2)0.49 (0.5)0.98 (0.9)0.90 (0.4)1.0 (0.4)15/15
PSO-BFGS voglis 1.6 (1)26 (15)21 (19)14 (24)13 (21)9.2 (12)907 (758)0/15
SNES schaul 5.6 (4)4.2 (0.9)3.6 (6)2.6 (4)2.7 (3)8.1 (9)19 (20)14/15
xNES schaul 4.7 (6)1.1 (0.4)0.79 (0.2)↑10.42 (0.1)↑00.47 (0.1)↑01.3 (1)6.1 (9)15/15
xNESas schaul 7.1 (8)1.0 (0.7)1.1 (0.7)0.76 (0.9)0.81 (0.7)1.4 (1)2.0 (3)15/15

Δ fopt
f18, 5-D
1e1
103
1e0
378
1e-1
3968
1e-2
8451
1e-3
9280
1e-5
10905
1e-7
12469
#succ
15/15
ACOR liao 1.9 (1)2.4 (1)5.8 (14)18 (17)36 (38)82 (70)80 (60)15/15
BIPOPaCMA loshchilov 1.2 (0.3)2.0 (3)0.62 (0.5)0.69 (0.5)0.76 (0.3)0.86 (0.3)0.98 (0.3)15/15
BIPOPsaACM loshchilov 2.5 (1)3.1 (4)0.82 (1.0)0.71 (0.9)0.76 (0.7)1.2 (0.7)1.4 (0.7)15/15
CMAES posik 1.2 (0.8)2.2 (4)1.5 (2)4.1 (5)11 (11)76 (67)92 (69)3/15
CMA brockhoff 1.2 (0.9)1.6 (0.8)1.6 (2)0.93 (0.9)0.97 (0.8)1.0 (0.7)1.1 (0.5)15/15
CMAa brockhoff 0.83 (0.3)1.7 (0.3)0.44 (0.5)0.48 (0.4)↑10.66 (0.3)0.76 (0.3)0.94 (0.6)15/15
CMAm brockhoff 0.94 (0.7)0.77 (0.3)0.53 (0.6)0.68 (0.5)0.79 (0.4)0.82 (0.3)0.85 (0.3)15/15
CMAma brockhoff 0.89 (0.7)1.2 (0.8)0.63 (0.5)0.52 (0.4)↑10.69 (0.6)0.67 (0.6)0.71 (0.5)15/15
CMAmah brockhoff 6.2 (2)7.2 (11)1.5 (1)1.1 (0.7)1.2 (0.6)1.1 (0.7)1.1 (0.6)15/15
CMAmh brockhoff 0.51 (0.3)↑02.6 (3)1.1 (1)1.1 (0.6)1.3 (0.6)1.3 (0.6)1.3 (0.6)15/15
DBRCGA chuang 5.0 (3)12 (2)5.4 (9)13 (13)100 (152)5e50/15
DE-AUTO voglis 48 (107)161 (60)60 (98)55 (57)54 (45)60 (69)84 (102)2/15
DE-BFGS voglis 5.7 (7)18 (10)28 (63)14 (34)19 (33)20 (23)587 (595)0/15
DE-ROLL voglis 49 (69)112 (57)65 (66)60 (39)88 (91)5e50/15
DE-SIMPLEX voglis 23 (23)155 (285)62 (99)68 (81)65 (84)74 (82)575 (894)0/15
DEAE posik 2.4 (1)2.8 (0.8)0.50 (0.1)↑00.36 (0.1)↑00.43 (0.1)↑00.53 (0.1)↑00.69 (0.5)15/15
DE posik 2.5 (2)4.4 (2)1.4 (0.7)2.1 (3)2.8 (3)7.7 (9)40 (46)5/15
DEb posik 2.5 (2)4.4 (2)1.4 (0.7)2.1 (3)2.8 (3)7.7 (9)40 (48)5/15
DEctpb posik 2.9 (2)4.9 (2)1.5 (0.7)1.6 (0.9)2.3 (1.0)6.7 (7)290 (180)1/15
IPOPsaACM loshchilov 2.8 (0.8)1.5 (0.5)0.64 (0.7)0.79 (0.4)0.85 (0.7)1.0 (0.4)1.1 (0.4)15/15
JADE posik 1.9 (1)3.3 (0.7)0.72 (0.1)↑10.53 (0.1)↑00.60 (0.1)↑01.1 (0.2)1.1 (0.2)15/15
JADEb posik 1.8 (1)4.0 (1)2.5 (3)2.0 (3)12 (16)72 (60)2e50/15
JADEctpb posik 1.9 (1)3.3 (0.7)0.72 (0.1)↑10.53 (0.1)↑00.60 (0.1)↑01.1 (0.2)1.1 (0.2)15/15
MVDE melo 4.2 (1)10 (4)4.3 (2)7.9 (3)18 (10)39 (24)50 (28)12/15
NBIPOPaCMA loshchilov 1.0 (0.6)3.0 (7)0.68 (0.9)0.80 (0.7)0.99 (0.4)1.0 (0.4)1.1 (0.4)15/15
NIPOPaCMA loshchilov 1.1 (0.7)1.5 (1)0.49 (0.6)0.90 (0.9)0.99 (0.7)1.1 (0.7)1.1 (0.4)15/15
PSO-BFGS voglis 24 (18)37 (11)16 (10)24 (31)38 (49)53 (57)5e50/15
SNES schaul 1.1 (0.9)6.3 (13)1.9 (3)5.9 (8)20 (22)647 (597)1e60/15
xNES schaul 1.2 (1)1.3 (0.5)0.43 (0.1)↑10.27 (0.0)↑10.51 (0.6)2.0 (2)3.6 (4)15/15
xNESas schaul 0.80 (0.5)1.4 (0.3)0.25 (0.1)↑00.31 (0.3)↑10.43 (0.5)1.4 (0.9)2.0 (3)15/15

Δ fopt
f19, 5-D
1e1
1
1e0
1
1e-1
242
1e-2
1.0e5
1e-3
1.2e5
1e-5
1.2e5
1e-7
1.2e5
#succ
15/15
ACOR liao 28 (28)3135 (4608)626 (612)10 (13)17 (38)17 (38)17 (38)14/15
BIPOPaCMA loshchilov 22 (14)1466 (1186)186 (177)1.9 (1)2.0 (1)2.0 (1)2.0 (1)15/15
BIPOPsaACM loshchilov 16 (14)1834 (1246)92 (142)0.88 (0.6)0.85 (0.6)0.85 (0.6)0.85 (0.6)15/15
CMAES posik 21 (13)2230 (1651)328 (335)7.5 (9)3e50/15
CMA brockhoff 15 (14)1796 (1570)573 (828)2.0 (2)2.1 (2)2.1 (2)2.1 (2)15/15
CMAa brockhoff 24 (10)6888 (1525)463 (417)3.3 (3)3.0 (3)3.0 (3)3.0 (3)14/15
CMAm brockhoff 20 (16)1379 (1430)551 (661)2.4 (2)2.3 (2)2.3 (2)2.3 (2)15/15
CMAma brockhoff 18 (13)1297 (924)259 (256)1.6 (2)1.9 (2)1.9 (2)1.9 (2)15/15
CMAmah brockhoff 17 (12)1167 (656)518 (491)2.5 (2)2.4 (2)2.4 (2)2.3 (2)15/15
CMAmh brockhoff 12 (15)3.1e4 (8e4)421 (494)2.6 (2)2.5 (2)2.5 (2)2.5 (2)15/15
DBRCGA chuang 28 (26)3184 (1818)860 (1120)5e50/15
DE-AUTO voglis 323 (28)1.3e4 (1e4)361 (227)6.5 (5)19 (15)19 (17)19 (19)3/15
DE-BFGS voglis 40 (38)2166 (1133)71 (66)2.1 (1)4.3 (5)4.3 (4)11 (6)2/15
DE-ROLL voglis 38 (26)5195 (8159)502 (490)34 (27)61 (60)61 (58)5e50/15
DE-SIMPLEX voglis 62 (16)2807 (2948)68 (95)1.5 (1)4.7 (4)4.7 (5)4.7 (5)9/15
DEAE posik 32 (38)3555 (2186)388 (230)3.9 (5)6.7 (8)6.7 (8)6.6 (5)4/15
DE posik 32 (28)4210 (2571)1107 (1377)11 (9)15 (18)15 (18)15 (11)2/15
DEb posik 32 (28)4210 (2571)1107 (1111)11 (11)15 (11)15 (21)15 (23)2/15
DEctpb posik 34 (41)3526 (3425)1051 (1297)2e50/15
IPOPsaACM loshchilov 19 (16)1931 (1477)250 (254)1.2 (1)1.4 (1)1.4 (1)1.4 (1)15/15
JADE posik 35 (26)2139 (2314)276 (160)11 (13)2e50/15
JADEb posik 30 (24)3020 (2620)587 (873)6.0 (7)9.5 (8)9.4 (13)9.4 (8)3/15
JADEctpb posik 35 (26)2139 (2314)276 (160)11 (12)2e50/15
MVDE melo 34 (26)4483 (4878)757 (723)30 (45)56 (68)120 (83)120 (127)1/15
NBIPOPaCMA loshchilov 20 (20)2026 (1762)156 (138)2.6 (4)2.6 (4)2.6 (4)2.6 (4)15/15
NIPOPaCMA loshchilov 16 (16)1813 (1877)324 (474)2.9 (3)2.7 (3)2.7 (3)2.7 (3)15/15
PSO-BFGS voglis 69 (94)2559 (2762)60 (51)2.3 (1)3.6 (3)3.6 (2)19 (19)1/15
SNES schaul 14 (12)3327 (5308)1669 (2124)41 (40)36 (23)36 (27)36 (41)3/15
xNES schaul 15 (16)2009 (1734)386 (503)4.2 (5)5.3 (6)5.3 (5)5.6 (6)10/15
xNESas schaul 17 (18)3280 (5087)543 (793)8.8 (9)11 (8)20 (25)21 (17)6/15

Δ fopt
f20, 5-D
1e1
16
1e0
851
1e-1
38111
1e-2
51362
1e-3
54470
1e-5
54861
1e-7
55313
#succ
14/15
ACOR liao 6.0 (2)3.2 (4)3.3 (4)2.5 (3)2.3 (3)2.3 (3)2.3 (3)15/15
BIPOPaCMA loshchilov 3.4 (3)10 (11)2.4 (1)1.8 (0.9)1.7 (0.9)1.8 (0.9)1.8 (0.9)15/15
BIPOPsaACM loshchilov 3.1 (2)3.8 (4)1.7 (1)1.3 (1)1.2 (1.0)1.2 (1.0)1.2 (1.0)15/15
CMAES posik 3.7 (3)27 (28)3e50/15
CMA brockhoff 3.7 (2)8.3 (6)1.7 (0.8)1.3 (0.6)1.3 (0.6)1.3 (0.6)1.3 (0.6)15/15
CMAa brockhoff 2.5 (2)9.1 (3)1.7 (1)1.4 (1)1.4 (1)1.4 (1)1.4 (1)15/15
CMAm brockhoff 3.0 (3)9.0 (4)1.7 (0.8)1.3 (0.6)1.3 (0.6)1.3 (0.6)1.3 (0.6)15/15
CMAma brockhoff 2.4 (2)9.4 (6)1.7 (2)1.4 (1)1.3 (1)1.3 (1)1.4 (1)15/15
CMAmah brockhoff 2.3 (2)11 (4)1.6 (2)1.2 (1)1.2 (1)1.2 (1)1.2 (1)15/15
CMAmh brockhoff 2.6 (1)14 (12)1.7 (2)1.3 (1)1.3 (1)1.3 (1)1.3 (1)15/15
DBRCGA chuang 18 (15)4.4 (6)2.4 (2)1.8 (1)1.7 (1)1.7 (1)1.7 (1)14/15
DE-AUTO voglis 4.0 (1)7.2 (6)14 (17)10 (17)10 (10)10 (9)10 (13)9/15
DE-BFGS voglis 4.1 (2)2.8 (1)10 (14)7.5 (6)7.1 (10)7.0 (8)7.0 (6)10/15
DE-ROLL voglis 15 (19)3.1 (3)4.0 (6)3.0 (4)2.8 (4)2.8 (4)2.8 (4)14/15
DE-SIMPLEX voglis 6.4 (2)4.7 (5)19 (17)14 (15)13 (21)13 (13)13 (14)7/15
DEAE posik 10 (7)3.0 (2)1.6 (1)1.2 (1)1.1 (1)1.1 (1)1.1 (1)14/15
DE posik 8.8 (6)1.9 (0.7)0.57 (0.8)0.43 (0.6)0.41 (0.6)0.42 (0.6)0.42 (0.5)15/15
DEb posik 8.8 (6)1.9 (0.7)0.57 (0.8)0.43 (0.6)0.41 (0.6)0.42 (0.6)0.42 (0.5)15/15
DEctpb posik 7.7 (6)2.1 (1)0.14 (0.0)↑00.13 (0.0)↑00.14 (0.0)↑00.16 (0.0)↑00.17 (0.0)↑015/15
IPOPsaACM loshchilov 2.4 (2)3.5 (3)1.6 (1)1.2 (1)1.2 (1)1.2 (1)1.2 (1)15/15
JADE posik 4.9 (3)2.3 (2)0.25 (0.2)↑10.22 (0.1)↑00.25 (0.2)↑00.29 (0.2)↑00.33 (0.2)↑015/15
JADEb posik 5.8 (4)0.91 (0.3)1.7 (2)1.3 (2)1.2 (2)1.2 (2)1.2 (2)14/15
JADEctpb posik 4.9 (3)2.3 (2)0.25 (0.2)↑10.22 (0.1)↑00.25 (0.2)↑00.29 (0.2)↑00.33 (0.2)↑015/15
MVDE melo 14 (8)2.7 (2)0.23 (0.1)↑00.23 (0.1)↑00.26 (0.1)↑00.32 (0.1)↑00.35 (0.1)↑015/15
NBIPOPaCMA loshchilov 3.6 (3)11 (12)2.4 (1)1.8 (1)1.8 (1)1.8 (1)1.8 (1)15/15
NIPOPaCMA loshchilov 3.2 (2)10 (5)2.1 (2)1.7 (1)1.6 (1)1.6 (1)1.7 (1)15/15
PSO-BFGS voglis 4.9 (0.9)5.4 (7)3.5 (3)2.6 (2)2.4 (2)2.4 (2)2.4 (2)14/15
SNES schaul 2.3 (2)29 (29)23 (24)17 (11)16 (21)16 (16)16 (12)11/15
xNES schaul 2.3 (2)10 (12)11 (12)8.5 (7)8.0 (10)8.0 (6)7.9 (10)13/15
xNESas schaul 3.2 (3)12 (22)21 (29)15 (21)15 (16)15 (15)14 (15)12/15

Δ fopt
f21, 5-D
1e1
41
1e0
1157
1e-1
1674
1e-2
1692
1e-3
1705
1e-5
1729
1e-7
1757
#succ
14/15
ACOR liao 3.8 (4)118 (196)299 (212)296 (210)294 (209)290 (206)285 (202)15/15
BIPOPaCMA loshchilov 1.8 (0.9)7.4 (8)49 (23)50 (22)50 (22)50 (22)49 (22)15/15
BIPOPsaACM loshchilov 1.9 (1)3.4 (4)4.9 (8)5.0 (8)5.0 (8)4.9 (8)4.9 (8)15/15
CMAES posik 1.8 (1)3.1 (3)3.9 (5)3.9 (5)3.9 (5)3.9 (5)3.9 (5)15/15
CMA brockhoff 6.6 (16)7.3 (14)43 (106)43 (121)43 (112)43 (111)42 (102)13/15
CMAa brockhoff 1.9 (1)28 (14)23 (20)23 (20)23 (21)23 (21)22 (22)14/15
CMAm brockhoff 1.4 (1)26 (8)21 (20)21 (20)21 (21)21 (21)21 (21)14/15
CMAma brockhoff 2.0 (2)5.0 (5)22 (18)40 (117)39 (116)39 (107)39 (106)13/15
CMAmah brockhoff 3.6 (4)2.7 (3)5.7 (10)5.8 (11)5.9 (11)6.0 (11)6.1 (11)15/15
CMAmh brockhoff 3.3 (1)5.6 (6)40 (62)41 (63)41 (63)42 (70)42 (69)14/15
DBRCGA chuang 3.2 (3)2.2 (5)2.1 (4)2.4 (3)2.7 (3)3.3 (3)3.8 (3)15/15
DE-AUTO voglis 10 (24)26 (47)36 (72)36 (71)36 (71)35 (70)35 (69)15/15
DE-BFGS voglis 2.2 (2)1.6 (2)2.7 (3)2.7 (3)2.7 (3)2.7 (3)16 (15)12/15
DE-ROLL voglis 10 (21)33 (51)31 (39)31 (39)31 (39)30 (38)30 (38)15/15
DE-SIMPLEX voglis 3.2 (2)19 (23)19 (17)19 (17)19 (17)18 (17)18 (17)15/15
DEAE posik 3.1 (3)1.2 (0.7)2.5 (3)2.6 (3)2.7 (3)2.9 (3)2.9 (3)15/15
DE posik 2.7 (3)3.9 (6)3.7 (4)3.9 (4)4.0 (4)4.3 (4)4.5 (4)15/15
DEb posik 2.7 (3)3.9 (6)3.7 (4)3.9 (4)4.0 (4)4.3 (4)4.5 (4)15/15
DEctpb posik 3.2 (3)5.5 (5)4.5 (4)5.0 (4)5.3 (4)5.8 (4)6.2 (4)15/15
IPOPsaACM loshchilov 2.9 (2)1.6 (2)28 (23)28 (26)28 (26)28 (26)27 (26)15/15
JADE posik 1.7 (2)1.1 (1)1.2 (1)2.2 (3)2.8 (4)5.0 (9)8.2 (13)15/15
JADEb posik 2.3 (2)4.4 (5)4.4 (4)4.4 (4)4.4 (4)4.5 (4)4.6 (4)15/15
JADEctpb posik 1.7 (2)1.1 (1)1.2 (1)2.2 (3)2.8 (4)5.0 (9)8.2 (13)15/15
MVDE melo 4.3 (3)1.5 (0.8)2.8 (2)4.1 (3)5.9 (3)10 (4)13 (4)15/15
NBIPOPaCMA loshchilov 2.1 (2)11 (10)31 (62)30 (61)30 (61)30 (60)29 (59)15/15
NIPOPaCMA loshchilov 4.1 (1)76 (145)272 (620)270 (613)269 (609)266 (601)263 (591)15/15
PSO-BFGS voglis 1.8 (2)0.88 (1)1.6 (2)1.6 (2)1.6 (2)1.6 (2)29 (55)13/15
SNES schaul 51 (123)46 (73)53 (65)53 (64)52 (63)52 (62)51 (62)15/15
xNES schaul 34 (123)29 (37)32 (44)32 (44)32 (44)31 (43)31 (42)15/15
xNESas schaul 12 (1)23 (25)36 (57)36 (56)35 (56)35 (55)35 (54)15/15

Δ fopt
f22, 5-D
1e1
71
1e0
386
1e-1
938
1e-2
980
1e-3
1008
1e-5
1040
1e-7
1068
#succ
14/15
ACOR liao 2.9 (3)143 (261)855 (1544)819 (1478)797 (1437)775 (1394)756 (1358)15/15
BIPOPaCMA loshchilov 14 (13)16 (22)38 (92)37 (89)36 (86)35 (84)34 (82)15/15
BIPOPsaACM loshchilov 2.2 (4)3.2 (4)14 (27)14 (25)13 (25)13 (24)13 (23)15/15
CMAES posik 9.3 (10)21 (28)18 (31)17 (29)17 (28)16 (28)16 (27)15/15
CMA brockhoff 10 (11)87 (40)292 (380)431 (749)554 (737)537 (1272)524 (460)6/15
CMAa brockhoff 15 (24)87 (30)379 (525)445 (531)433 (611)421 (387)411 (489)7/15
CMAm brockhoff 12 (23)17 (26)144 (222)456 (557)444 (714)431 (549)421 (492)7/15
CMAma brockhoff 2.0 (0.8)94 (72)250 (475)475 (678)465 (550)453 (708)442 (353)7/15
CMAmah brockhoff 6.3 (14)130 (263)289 (495)277 (401)346 (553)336 (670)328 (513)8/15
CMAmh brockhoff 5.3 (8)38 (29)288 (496)351 (807)436 (378)425 (566)414 (612)7/15
DBRCGA chuang 2.6 (3)6.7 (5)11 (11)12 (11)12 (10)15 (11)16 (11)15/15
DE-AUTO voglis 8.1 (15)84 (101)102 (128)97 (123)95 (119)92 (115)95 (103)15/15
DE-BFGS voglis 6.7 (15)13 (27)23 (24)22 (23)21 (22)21 (22)131 (234)8/15
DE-ROLL voglis 16 (24)144 (290)150 (233)144 (223)143 (217)144 (215)208 (237)8/15
DE-SIMPLEX voglis 6.5 (8)29 (74)44 (47)42 (45)41 (44)40 (42)39 (41)15/15
DEAE posik 3.2 (2)6.2 (7)10 (14)10 (13)10 (13)10 (12)10 (12)15/15
DE posik 5.0 (4)13 (16)17 (25)17 (23)17 (22)18 (22)19 (21)15/15
DEb posik 5.0 (4)13 (16)17 (25)17 (23)17 (22)18 (22)19 (21)15/15
DEctpb posik 5.1 (5)7.9 (13)11 (15)12 (14)13 (14)16 (13)17 (13)15/15
IPOPsaACM loshchilov 3.4 (5)12 (13)85 (258)115 (274)116 (267)113 (259)110 (252)15/15
JADE posik 2.1 (1)3.4 (3)8.0 (11)10 (12)12 (18)16 (27)17 (30)15/15
JADEb posik 12 (30)16 (19)14 (10)14 (10)14 (10)14 (9)14 (9)15/15
JADEctpb posik 2.1 (1)3.4 (3)8.0 (11)10 (12)12 (18)16 (27)17 (30)15/15
MVDE melo 4.4 (3)5.5 (3)85 (14)92 (51)98 (52)113 (58)124 (58)14/15
NBIPOPaCMA loshchilov 8.9 (11)14 (18)18 (19)18 (18)17 (18)17 (18)17 (17)15/15
NIPOPaCMA loshchilov 4.0 (10)258 (468)338 (714)325 (684)317 (665)308 (644)300 (628)15/15
PSO-BFGS voglis 1.6 (2)4.2 (6)3.4 (4)3.3 (4)3.2 (4)3.3 (4)170 (234)5/15
SNES schaul 91 (152)192 (260)134 (155)130 (148)130 (144)149 (188)161 (189)15/15
xNES schaul 66 (209)100 (193)104 (119)100 (114)97 (110)95 (107)92 (104)15/15
xNESas schaul 46 (61)44 (57)39 (42)38 (40)37 (39)36 (37)35 (36)15/15

Δ fopt
f23, 5-D
1e1
3.0
1e0
518
1e-1
14249
1e-2
27890
1e-3
31654
1e-5
33030
1e-7
34256
#succ
15/15
ACOR liao 2.6 (3)86 (79)1e70/15
BIPOPaCMA loshchilov 3.2 (3)11 (9)1.6 (1)0.93 (0.7)0.86 (0.6)0.85 (0.6)0.84 (0.6)15/15
BIPOPsaACM loshchilov 4.2 (4)14 (8)1.1 (1)0.86 (0.8)0.91 (0.9)0.88 (0.8)0.97 (0.8)15/15
CMAES posik 2.9 (5)13 (15)6.9 (9)5.5 (7)4.9 (7)4.7 (6)4.5 (4)12/15
CMA brockhoff 2.7 (3)20 (18)107 (106)55 (73)49 (95)47 (69)45 (81)6/15
CMAa brockhoff 2.4 (3)29 (17)39 (53)20 (36)18 (27)17 (24)17 (32)10/15
CMAm brockhoff 2.2 (2)16 (17)63 (88)42 (55)37 (64)36 (62)35 (29)7/15
CMAma brockhoff 2.5 (2)21 (38)37 (70)25 (18)22 (32)21 (23)20 (29)9/15
CMAmah brockhoff 1.9 (2)17 (29)52 (73)26 (53)23 (35)22 (19)22 (18)9/15
CMAmh brockhoff 4.5 (10)10 (13)38 (90)26 (37)23 (48)22 (47)21 (44)9/15
DBRCGA chuang 0.91 (0.8)19 (19)43 (46)126 (117)222 (403)212 (197)205 (193)1/15
DE-AUTO voglis 2.9 (3)4.6 (4)3.5 (2)4.5 (3)4.4 (2)4.8 (2)6.1 (3)14/15
DE-BFGS voglis 2.2 (2)2.5 (3)2.0 (2)1.2 (0.9)1.3 (0.9)1.4 (0.9)96 (98)0/15
DE-ROLL voglis 2.4 (2)4.4 (5)18 (22)15 (16)14 (14)16 (14)104 (95)0/15
DE-SIMPLEX voglis 2.3 (2)0.92 (0.9)0.88 (0.7)0.94 (0.9)0.91 (0.8)1.1 (0.8)99 (134)0/15
DEAE posik 2.8 (4)72 (58)124 (118)63 (83)56 (71)54 (53)52 (38)2/15
DE posik 2.9 (4)48 (59)57 (51)39 (54)35 (48)53 (57)105 (106)1/15
DEb posik 2.9 (4)48 (59)57 (86)39 (49)35 (41)53 (36)105 (86)1/15
DEctpb posik 3.5 (4)57 (60)2e50/15
IPOPsaACM loshchilov 2.1 (2)13 (17)8.8 (2)7.5 (22)6.6 (20)6.4 (19)6.2 (18)15/15
JADE posik 2.4 (3)37 (32)8.3 (6)8.4 (10)7.6 (5)7.3 (8)7.1 (7)10/15
JADEb posik 2.3 (3)35 (40)32 (46)20 (16)17 (19)17 (20)16 (14)6/15
JADEctpb posik 2.4 (3)37 (32)8.3 (6)8.4 (12)7.6 (6)7.3 (6)7.1 (8)10/15
MVDE melo 1.8 (2)32 (40)190 (142)1e60/15
NBIPOPaCMA loshchilov 1.6 (2)8.2 (8)1.4 (2)0.95 (1)0.97 (1)0.95 (1)1.1 (0.9)15/15
NIPOPaCMA loshchilov 3.2 (2)15 (21)1.8 (1)0.94 (0.8)0.86 (0.7)0.86 (0.7)0.87 (0.7)15/15
PSO-BFGS voglis 1.4 (1)3.5 (5)3.3 (4)10 (11)30 (37)5e50/15
SNES schaul 2.8 (2)35 (38)46 (44)472 (608)416 (416)399 (270)384 (493)1/15
xNES schaul 3.4 (3)66 (68)755 (583)386 (485)8e50/15
xNESas schaul 2.2 (2)97 (97)1e60/15

Δ fopt
f24, 5-D
1e1
1622
1e0
2.2e5
1e-1
6.4e6
1e-2
9.6e6
1e-3
9.6e6
1e-5
1.3e7
1e-7
1.3e7
#succ
3/15
ACOR liao 8.2 (6)155 (151)1e70/15
BIPOPaCMA loshchilov 1.3 (1)1.0 (1)1.1 (2)1.3 (2)1.3 (1)0.96 (1)0.96 (0.7)5/15
BIPOPsaACM loshchilov 1.8 (1)1.0 (1)0.69 (0.8)0.82 (0.8)0.97 (1.0)0.73 (0.9)0.73 (0.6)6/15
CMAES posik 1.6 (2)3.1 (3)3e50/15
CMA brockhoff 1.9 (1)9.4 (14)1e60/15
CMAa brockhoff 1.5 (2)13 (14)1e60/15
CMAm brockhoff 2.2 (2)19 (20)1e60/15
CMAma brockhoff 1.3 (1)65 (81)1e60/15
CMAmah brockhoff 1.6 (1)19 (31)1e60/15
CMAmh brockhoff 1.4 (1)13 (21)2.2 (2)1.5 (2)1.5 (2)1.1 (1)1.1 (1)1/15
DBRCGA chuang 11 (12)5.6 (5)5e50/15
DE-AUTO voglis 10 (11)10 (14)5e50/15
DE-BFGS voglis 1.3 (1)4.3 (3)0.19 (0.2)0.24 (0.3)0.24 (0.2)0.18 (0.2)0.18 (0.2)3/15
DE-ROLL voglis 13 (11)16 (16)5e50/15
DE-SIMPLEX voglis 3.5 (3)10 (12)0.56 (0.8)0.77 (0.5)0.76 (0.7)0.57 (0.5)0.57 (0.6)1/15
DEAE posik 6.1 (5)3.7 (3)2e50/15
DE posik 10 (8)5.4 (6)2e50/15
DEb posik 10 (8)5.4 (7)2e50/15
DEctpb posik 12 (8)17 (26)2e50/15
IPOPsaACM loshchilov 1.9 (1)42 (40)11 (10)5e60/15
JADE posik 6.5 (5)2e50/15
JADEb posik 4.2 (4)7.8 (11)2e50/15
JADEctpb posik 6.5 (5)2e50/15
MVDE melo 13 (10)69 (73)1e60/15
NBIPOPaCMA loshchilov 2.0 (1)0.64 (0.5)↑10.92 (1)0.81 (0.8)0.81 (1)0.71 (1)0.88 (0.8)5/15
NIPOPaCMA loshchilov 1.8 (1)2.1 (4)0.61 (0.7)0.46 (0.4)0.46 (0.4)0.35 (0.3)0.35 (0.4)11/15
PSO-BFGS voglis 3.2 (2)0.69 (1)0.20 (0.2)0.24 (0.2)0.23 (0.4)0.18 (0.1)0.18 (0.2)3/15
SNES schaul 1.6 (2)3.2 (4)1e60/15
xNES schaul 7.5 (10)12 (11)8e50/15
xNESas schaul 6.2 (8)26 (29)1e60/15

Previous dimension | Dimension = 10 | Next dimension

Δ fopt
f1, 10-D
1e1
22
1e0
23
1e-1
23
1e-2
23
1e-3
23
1e-5
23
1e-7
23
#succ
15/15
ACOR liao 11 (2)24 (4)36 (5)49 (7)63 (5)88 (6)113 (7)15/15
BIPOPaCMA loshchilov 4.9 (2)12 (3)18 (3)25 (3)31 (2)44 (4)57 (5)15/15
BIPOPsaACM loshchilov 4.8 (1)6.3 (0.5)7.6 (1.0)10 (0.8)11 (0.8)14 (1)17 (1)15/15
CMAES posik 5.8 (2)12 (2)18 (2)24 (3)31 (3)44 (4)57 (6)15/15
CMA brockhoff 5.3 (3)12 (3)18 (3)24 (3)31 (4)44 (5)57 (5)15/15
CMAa brockhoff 5.2 (2)11 (3)18 (2)24 (2)30 (3)44 (5)57 (6)15/15
CMAm brockhoff 4.4 (2)8.9 (2)14 (2)18 (3)23 (3)32 (2)42 (3)15/15
CMAma brockhoff 4.5 (0.8)8.6 (2)13 (2)18 (3)23 (3)31 (4)41 (4)15/15
CMAmah brockhoff 3.2 (1)6.4 (2)9.4 (2)13 (2)16 (3)22 (2)29 (3)15/15
CMAmh brockhoff 3.4 (1)6.5 (1)9.4 (2)13 (2)16 (2)22 (3)29 (3)15/15
DBRCGA chuang 77 (18)194 (54)334 (58)478 (83)612 (97)910 (116)1201 (85)15/15
DE-AUTO voglis 3.7 (0.4)4.1 (0.2)4.1 (0.2)4.1 (0.2)4.1 (0.2)4.1 (0.2)4.1 (0.2)15/15
DE-BFGS voglis 3.2 (0.2)3.2 (0)3.2 (0)3.2 (0)3.2 (0)3.2 (0)3.2 (0)15/15
DE-ROLL voglis 7.6 (8)18 (16)19 (20)19 (20)20 (20)20 (21)20 (21)15/15
DE-SIMPLEX voglis 8.5 (7)21 (12)34 (14)42 (14)46 (15)55 (14)67 (11)15/15
DEAE posik 26 (11)61 (7)95 (10)133 (11)169 (13)240 (18)312 (23)15/15
DE posik 28 (10)66 (12)106 (18)139 (17)179 (14)252 (17)328 (27)15/15
DEb posik 28 (10)66 (12)106 (18)139 (17)179 (14)252 (17)328 (27)15/15
DEctpb posik 28 (8)68 (10)114 (10)152 (15)201 (15)287 (11)368 (17)15/15
IPOPsaACM loshchilov 4.6 (1)6.1 (0.4)7.3 (0.7)9.0 (0.7)11 (1)14 (0.8)17 (0.7)15/15
JADE posik 18 (4)45 (5)78 (8)108 (10)141 (7)211 (7)282 (6)15/15
JADEb posik 13 (4)32 (5)52 (8)74 (6)98 (9)147 (12)201 (13)15/15
JADEctpb posik 18 (4)45 (5)78 (8)108 (10)141 (7)211 (7)282 (6)15/15
MVDE melo 47 (15)137 (12)225 (15)316 (17)409 (17)594 (24)781 (21)15/15
NBIPOPaCMA loshchilov 4.6 (3)11 (2)18 (3)24 (3)31 (4)43 (4)55 (4)15/15
NIPOPaCMA loshchilov 5.9 (2)12 (3)19 (3)25 (4)31 (4)44 (4)57 (5)15/15
PSO-BFGS voglis 3.1 (0.2)3.2 (0)3.2 (0)3.2 (0)3.2 (0)3.2 (0)3.2 (0)15/15
SNES schaul 4.3 (2)10 (3)19 (4)29 (3)39 (3)57 (4)76 (5)15/15
xNES schaul 3.8 (1)18 (6)51 (3)81 (5)111 (7)176 (6)239 (6)15/15
xNESas schaul 4.0 (2)16 (4)37 (5)53 (10)64 (15)85 (19)103 (31)15/15

Δ fopt
f2, 10-D
1e1
187
1e0
190
1e-1
191
1e-2
191
1e-3
193
1e-5
194
1e-7
195
#succ
15/15
ACOR liao 6.9 (1)8.2 (0.8)10 (0.9)11 (1.0)12 (1)15 (1)18 (2)15/15
BIPOPaCMA loshchilov 15 (3)17 (2)18 (2)19 (2)20 (1)21 (1)22 (2)15/15
BIPOPsaACM loshchilov 3.9 (0.9)4.4 (0.8)4.8 (0.6)5.1 (0.6)5.3 (0.6)5.8 (0.5)6.2 (0.6)15/15
CMAES posik 21 (4)24 (4)26 (2)27 (2)28 (2)29 (2)31 (2)15/15
CMA brockhoff 22 (6)24 (3)26 (2)27 (2)28 (2)29 (2)30 (2)15/15
CMAa brockhoff 16 (2)17 (2)18 (1)19 (1)20 (1)21 (1)23 (1)15/15
CMAm brockhoff 21 (5)24 (3)25 (3)27 (1)27 (1)28 (1)30 (1)15/15
CMAma brockhoff 15 (3)17 (2)18 (1)19 (1)19 (1)20 (1)21 (1)15/15
CMAmah brockhoff 16 (3)18 (3)19 (2)20 (1)20 (2)21 (2)22 (2)15/15
CMAmh brockhoff 19 (3)24 (3)25 (3)27 (2)27 (1)28 (1)28 (1)15/15
DBRCGA chuang 60 (8)78 (9)96 (9)114 (11)129 (12)161 (12)191 (10)15/15
DE-AUTO voglis 1.7 (0.6)1.9 (0.7)2.0 (0.8)2.1 (0.8)2.1 (0.9)2.4 (1.0)2.7 (1)15/15
DE-BFGS voglis 1.9 (0.8)2.2 (0.9)2.4 (1)2.5 (1)2.7 (1)2.9 (1)3.1 (1)15/15
DE-ROLL voglis 7.4 (10)7.5 (10)7.6 (10)7.7 (10)7.7 (9)8.0 (9)8.3 (9)15/15
DE-SIMPLEX voglis 91 (33)109 (39)118 (41)133 (31)138 (31)144 (26)176 (121)15/15
DEAE posik 20 (1)24 (2)29 (2)33 (2)37 (3)45 (3)53 (3)15/15
DE posik 20 (2)24 (3)29 (2)33 (3)38 (2)47 (3)56 (3)15/15
DEb posik 20 (2)24 (3)29 (2)33 (3)38 (2)47 (3)56 (3)15/15
DEctpb posik 22 (2)27 (1)32 (2)37 (2)42 (2)52 (2)61 (3)15/15
IPOPsaACM loshchilov 4.1 (0.7)4.4 (0.7)4.7 (0.8)5.0 (0.8)5.3 (0.7)5.7 (0.8)6.1 (0.7)15/15
JADE posik 17 (1)21 (2)25 (2)30 (2)34 (1)43 (2)51 (3)15/15
JADEb posik 11 (1)14 (1)17 (1)21 (2)24 (1)31 (2)38 (3)15/15
JADEctpb posik 17 (1)21 (2)25 (2)30 (2)34 (1)43 (2)51 (3)15/15
MVDE melo 44 (2)54 (2)65 (3)77 (3)86 (4)109 (1)130 (2)15/15
NBIPOPaCMA loshchilov 14 (3)17 (2)18 (2)19 (1)20 (1)21 (1)23 (1.0)15/15
NIPOPaCMA loshchilov 14 (3)16 (3)18 (2)19 (2)19 (2)21 (2)23 (2)15/15
PSO-BFGS voglis 2.6 (1)2.6 (1)2.7 (1)2.9 (1)3.0 (1)3.2 (1)3.6 (2)15/15
SNES schaul 4.8 (0.9)5.6 (0.7)6.7 (0.5)7.9 (0.6)8.9 (0.6)11 (0.6)13 (0.7)15/15
xNES schaul 15 (1)17 (1.0)21 (0.9)25 (1)28 (1)35 (0.8)43 (1)15/15
xNESas schaul 13 (2)16 (2)18 (2)20 (2)21 (2)25 (3)27 (4)15/15

Δ fopt
f3, 10-D
1e1
1739
1e0
3600
1e-1
3609
1e-2
3636
1e-3
3642
1e-5
3646
1e-7
3651
#succ
15/15
ACOR liao 15 (16)2427 (3315)9806 (1e4)9733 (6434)9717 (7354)9707 (7346)9694 (7092)4/15
BIPOPaCMA loshchilov 4.0 (3)307 (440)4151 (5424)4120 (4266)4114 (4107)4110 (3947)4105 (6258)7/15
BIPOPsaACM loshchilov 2.2 (2)231 (319)1682 (2416)1670 (2381)1667 (2232)1665 (2391)1663 (1617)12/15
CMAES posik 8.4 (11)2030 (2014)5e50/15
CMA brockhoff 3.7 (3)632 (635)2699 (4941)2680 (4753)2676 (2348)2674 (4882)2671 (1830)2/15
CMAa brockhoff 4.4 (3)818 (984)1e60/15
CMAm brockhoff 3.0 (3)494 (696)5720 (9933)5679 (7869)5670 (3793)5665 (5009)5658 (5519)1/15
CMAma brockhoff 2.0 (3)366 (510)2640 (2035)2621 (2928)2616 (2807)2614 (2702)2611 (3207)2/15
CMAmah brockhoff 3.0 (2)358 (483)5586 (5759)5545 (8893)5537 (4105)5532 (7034)5525 (5643)1/15
CMAmh brockhoff 4.2 (3)608 (794)5512 (7194)5471 (5765)5462 (6382)5456 (6131)5449 (7415)1/15
DBRCGA chuang 13 (5)38 (23)56 (38)56 (38)56 (38)57 (39)59 (39)15/15
DE-AUTO voglis 9.1 (9)24 (7)45 (24)45 (24)45 (24)45 (24)45 (24)15/15
DE-BFGS voglis 9.4 (6)16 (7)24 (11)24 (11)24 (11)24 (11)24 (11)15/15
DE-ROLL voglis 3.6 (3)13 (6)17 (8)17 (8)17 (8)17 (8)17 (8)15/15
DE-SIMPLEX voglis 37 (20)56 (16)80 (37)80 (37)80 (37)80 (37)80 (37)15/15
DEAE posik 132 (69)5e50/15
DE posik 5.5 (1)5.5 (4)16 (15)16 (15)16 (15)17 (15)17 (15)15/15
DEb posik 5.5 (1)5.5 (4)16 (15)16 (15)16 (15)17 (15)17 (15)15/15
DEctpb posik 7.6 (2)9.0 (1)10 (1)10 (1)11 (1)11 (1)12 (1)15/15
IPOPsaACM loshchilov 2.3 (0.6)174 (325)7894 (9119)7835 (1e4)7823 (8979)7814 (1e4)7804 (8358)4/14
JADE posik 3.9 (0.4)3.1 (0.2)3.5 (0.3)3.9 (0.2)4.3 (0.2)5.0 (0.2)5.7 (0.2)15/15
JADEb posik 3.5 (0.8)6.3 (6)19 (24)19 (24)19 (24)20 (24)20 (24)15/15
JADEctpb posik 3.9 (0.4)3.1 (0.2)3.5 (0.3)3.9 (0.2)4.3 (0.2)5.0 (0.2)5.7 (0.2)15/15
MVDE melo 5.8 (1)5.6 (0.3)6.3 (0.4)6.9 (0.4)7.4 (0.4)8.7 (0.4)10 (0.3)15/15
NBIPOPaCMA loshchilov 3.7 (4)1586 (2780)7792 (1e4)7734 (7557)7722 (9612)7714 (2e4)7704 (9589)4/15
NIPOPaCMA loshchilov 2.3 (1)1021 (1497)6291 (6062)6245 (9164)6235 (5891)6229 (9433)6221 (6680)5/15
PSO-BFGS voglis 69 (74)1999 (1652)1e60/15
SNES schaul 18 (17)5463 (6548)3e60/15
xNES schaul 15 (17)4196 (4611)2e60/15
xNESas schaul 16 (17)8179 (1e4)1.7e4 (1e4)1.7e4 (2e4)1.7e4 (2e4)1.7e4 (2e4)1.7e4 (1e4)1/15

Δ fopt
f4, 10-D
1e1
2234
1e0
3626
1e-1
3660
1e-2
3695
1e-3
3707
1e-5
3744
1e-7
28767
#succ
12/15
ACOR liao 31 (60)1e70/15
BIPOPaCMA loshchilov 5.6 (5)1e70/15
BIPOPsaACM loshchilov 5.3 (4)1e70/5
CMAES posik 24 (29)5e50/15
CMA brockhoff 6.6 (4)2e60/15
CMAa brockhoff 7.5 (4)2e60/15
CMAm brockhoff 5.5 (4)2e60/15
CMAma brockhoff 5.6 (4)2e60/15
CMAmah brockhoff 8.6 (8)1e60/15
CMAmh brockhoff 8.6 (3)2e60/15
DBRCGA chuang 25 (15)64 (31)166 (165)165 (175)165 (147)164 (130)22 (18)13/15
DE-AUTO voglis 12 (9)49 (33)139 (150)138 (146)137 (154)136 (144)18 (22)13/15
DE-BFGS voglis 14 (9)52 (39)80 (65)79 (65)79 (64)78 (64)10 (8)14/15
DE-ROLL voglis 5.2 (3)17 (9)44 (34)44 (34)44 (34)43 (34)5.6 (4)15/15
DE-SIMPLEX voglis 37 (14)102 (47)239 (224)237 (232)236 (216)259 (158)117 (70)2/15
DEAE posik 102 (54)5e50/15
DE posik 4.1 (0.9)18 (16)48 (61)48 (60)48 (60)48 (60)6.3 (8)14/15
DEb posik 4.1 (0.9)18 (16)48 (61)48 (60)48 (60)48 (60)6.3 (8)14/15
DEctpb posik 6.9 (1.0)11 (1)17 (9)18 (8)18 (8)18 (8)2.5 (1)15/15
IPOPsaACM loshchilov 5.6 (7)1e70/5
JADE posik 3.6 (0.3)3.4 (0.3)3.9 (0.2)4.4 (0.2)4.8 (0.2)5.5 (0.2)0.82 (0.0)↑015/15
JADEb posik 3.6 (5)25 (22)125 (137)124 (116)124 (149)123 (168)16 (17)10/15
JADEctpb posik 3.6 (0.3)3.4 (0.3)3.9 (0.2)4.4 (0.2)4.8 (0.2)5.5 (0.2)0.82 (0.0)↑015/15
MVDE melo 6.0 (0.9)26 (1)143 (274)143 (136)143 (270)143 (134)19 (17)10/15
NBIPOPaCMA loshchilov 8.4 (10)1e70/15
NIPOPaCMA loshchilov 4.9 (5)1e70/15
PSO-BFGS voglis 156 (93)1e60/15
SNES schaul 25 (27)3e60/15
xNES schaul 17 (20)2e60/15
xNESas schaul 7.8 (9)4e60/15

Δ fopt
f5, 10-D
1e1
20
1e0
20
1e-1
20
1e-2
20
1e-3
20
1e-5
20
1e-7
20
#succ
15/15
ACOR liao 8.9 (3)11 (3)11 (3)11 (3)11 (3)11 (3)11 (3)15/15
BIPOPaCMA loshchilov 5.0 (2)6.0 (2)6.1 (2)6.1 (2)6.1 (2)6.1 (2)6.1 (2)15/15
BIPOPsaACM loshchilov 5.1 (2)6.2 (2)6.5 (2)6.5 (2)6.5 (2)6.5 (2)6.5 (2)15/15
CMAES posik 5.3 (0.9)6.4 (1)6.6 (1)6.6 (1)6.6 (1)6.6 (1)6.6 (1)15/15
CMA brockhoff 5.4 (2)6.2 (1)6.3 (1)6.3 (1)6.3 (1)6.3 (1)6.3 (1)15/15
CMAa brockhoff 5.2 (1)6.6 (1)6.7 (1)6.7 (1)6.8 (1)6.8 (1)6.8 (1)15/15
CMAm brockhoff 4.6 (0.8)5.6 (1)5.7 (1)5.7 (1)5.7 (1)5.7 (1)5.7 (1)15/15
CMAma brockhoff 4.0 (0.9)4.8 (0.9)4.9 (0.9)4.9 (1)4.9 (1)4.9 (1)4.9 (1)15/15
CMAmah brockhoff 3.1 (1)3.9 (1)4.0 (1)4.0 (1)4.0 (1)4.0 (1)4.0 (1)15/15
CMAmh brockhoff 3.1 (0.7)3.8 (1.0)4.1 (1.0)4.1 (1.0)4.1 (1.0)4.1 (1.0)4.1 (1.0)15/15
DBRCGA chuang 116 (75)156 (70)158 (72)159 (72)159 (72)159 (72)159 (72)15/15
DE-AUTO voglis 3.9 (0.3)4.0 (0.3)4.1 (0.4)4.1 (0.4)4.1 (0.4)4.1 (0.4)4.1 (0.4)15/15
DE-BFGS voglis 7.4 (3)9.4 (4)9.5 (3)9.5 (3)9.5 (3)10 (4)11 (6)15/15
DE-ROLL voglis 6.4 (0.5)6.7 (0.8)6.9 (0.7)7.1 (1)7.3 (2)7.7 (3)8.1 (5)15/15
DE-SIMPLEX voglis 354 (93)596 (300)832 (366)1028 (430)1142 (360)1320 (389)7246 (1e4)15/15
DEAE posik 17 (8)22 (10)23 (10)23 (10)23 (10)23 (10)23 (10)15/15
DE posik 16 (5)22 (6)22 (5)22 (5)22 (5)22 (5)22 (5)15/15
DEb posik 16 (5)22 (6)22 (5)22 (5)22 (5)22 (5)22 (5)15/15
DEctpb posik 21 (4)28 (4)29 (4)30 (4)30 (4)30 (4)30 (4)15/15
IPOPsaACM loshchilov 5.0 (1)6.2 (1)6.2 (0.9)6.3 (0.8)6.3 (0.8)6.3 (0.8)6.3 (0.8)15/15
JADE posik 25 (10)34 (9)36 (6)36 (6)36 (6)36 (6)36 (6)15/15
JADEb posik 15 (4)21 (5)22 (4)22 (4)22 (4)22 (4)22 (4)15/15
JADEctpb posik 25 (10)34 (9)36 (6)36 (6)36 (6)36 (6)36 (6)15/15
MVDE melo 111 (18)165 (17)184 (32)197 (41)199 (42)199 (42)199 (42)15/15
NBIPOPaCMA loshchilov 4.9 (1)6.2 (1)6.2 (1)6.2 (1)6.2 (1)6.2 (1)6.2 (1)15/15
NIPOPaCMA loshchilov 5.8 (0.8)6.8 (2)7.1 (2)7.1 (2)7.1 (2)7.1 (2)7.1 (2)15/15
PSO-BFGS voglis 7.7 (4)11 (6)12 (5)12 (5)12 (5)12 (5)12 (5)15/15
SNES schaul 10 (5)13 (4)14 (4)14 (4)14 (4)14 (4)14 (4)15/15
xNES schaul 9.0 (2)12 (4)13 (4)13 (4)13 (4)13 (4)13 (4)15/15
xNESas schaul 9.0 (3)12 (3)12 (3)12 (3)12 (3)12 (3)12 (3)15/15

Δ fopt
f6, 10-D
1e1
412
1e0
623
1e-1
826
1e-2
1039
1e-3
1292
1e-5
1841
1e-7
2370
#succ
15/15
ACOR liao 3.9 (0.9)4.3 (0.9)4.5 (0.8)4.6 (0.9)4.5 (0.9)4.3 (0.8)4.3 (0.8)15/15
BIPOPaCMA loshchilov 2.0 (0.6)1.9 (0.5)1.9 (0.3)1.8 (0.3)1.7 (0.2)1.6 (0.1)1.6 (0.1)15/15
BIPOPsaACM loshchilov 1.8 (0.5)1.8 (0.5)1.9 (0.5)1.9 (0.3)1.8 (0.3)1.8 (0.3)1.7 (0.3)15/15
CMAES posik 1.9 (0.7)1.9 (0.5)1.9 (0.4)1.9 (0.4)1.8 (0.3)1.7 (0.2)1.7 (0.1)15/15
CMA brockhoff 1.8 (0.4)1.8 (0.2)1.9 (0.2)1.9 (0.3)1.8 (0.3)1.7 (0.2)1.6 (0.2)15/15
CMAa brockhoff 1.8 (0.6)1.8 (0.5)1.8 (0.3)1.8 (0.3)1.8 (0.3)1.7 (0.2)1.6 (0.2)15/15
CMAm brockhoff 1.9 (0.6)2.0 (0.3)1.9 (0.3)1.9 (0.3)1.8 (0.3)1.7 (0.2)1.7 (0.2)15/15
CMAma brockhoff 1.9 (0.5)1.8 (0.4)1.8 (0.4)1.7 (0.3)1.7 (0.4)1.5 (0.2)1.5 (0.2)15/15
CMAmah brockhoff 1.3 (0.4)1.4 (0.5)1.5 (0.5)1.5 (0.4)1.5 (0.3)1.4 (0.4)1.5 (0.4)15/15
CMAmh brockhoff 1.4 (0.6)1.6 (0.5)1.6 (0.4)1.7 (0.6)1.7 (0.7)1.6 (0.6)1.7 (0.4)15/15
DBRCGA chuang 18 (5)24 (5)28 (5)30 (5)31 (7)30 (5)30 (3)15/15
DE-AUTO voglis 2.4 (1)2.4 (1)2.3 (0.6)2.2 (0.8)2.2 (0.6)4.0 (3)6.3 (8)15/15
DE-BFGS voglis 2.2 (2)2.0 (1)2.1 (2)2.4 (1)5.3 (6)16 (7)84 (61)12/15
DE-ROLL voglis 16 (12)22 (19)26 (26)27 (24)41 (41)55 (42)185 (262)10/15
DE-SIMPLEX voglis 25 (17)43 (23)55 (19)58 (23)76 (32)145 (79)1e60/15
DEAE posik 8.3 (2)10 (1)11 (0.8)11 (0.7)10 (0.9)10 (0.7)10 (0.6)15/15
DE posik 17 (4)20 (3)23 (4)24 (5)24 (5)24 (6)24 (6)15/15
DEb posik 17 (4)20 (3)23 (4)24 (5)24 (5)24 (6)24 (6)15/15
DEctpb posik 12 (2)14 (2)15 (2)15 (1)15 (2)14 (2)14 (2)15/15
IPOPsaACM loshchilov 1.7 (0.7)1.8 (0.5)1.9 (0.5)1.9 (0.4)1.8 (0.5)1.8 (0.4)1.8 (0.2)15/15
JADE posik 6.6 (1)7.5 (1)7.9 (0.9)8.4 (1)8.3 (1)8.2 (1)8.1 (1)15/15
JADEb posik 5.7 (3)8.8 (2)12 (3)21 (10)46 (37)382 (415)451 (584)2/15
JADEctpb posik 6.6 (1)7.5 (1)7.9 (0.9)8.4 (1)8.3 (1)8.2 (1)8.1 (1)15/15
MVDE melo 19 (6)27 (4)33 (7)38 (7)41 (8)48 (15)57 (23)15/15
NBIPOPaCMA loshchilov 1.8 (0.6)1.9 (0.5)1.9 (0.4)1.8 (0.3)1.8 (0.2)1.6 (0.2)1.6 (0.2)15/15
NIPOPaCMA loshchilov 1.8 (0.6)1.8 (0.4)1.8 (0.3)1.8 (0.3)1.8 (0.3)1.6 (0.2)1.6 (0.2)15/15
PSO-BFGS voglis 4.0 (3)3.2 (2)2.8 (2)3.8 (5)9.4 (7)23 (9)220 (305)4/15
SNES schaul 1.6 (0.3)1.7 (0.3)1.9 (0.4)2.1 (0.6)3.2 (2)155 (257)269 (619)13/15
xNES schaul 2.5 (0.4)3.3 (0.2)3.9 (0.2)4.1 (0.2)4.1 (0.2)4.1 (0.1)4.1 (0.2)15/15
xNESas schaul 2.2 (0.2)3.1 (0.3)3.6 (0.3)3.8 (0.3)3.9 (0.3)3.8 (0.2)3.8 (0.1)15/15

Δ fopt
f7, 10-D
1e1
172
1e0
1611
1e-1
4195
1e-2
5099
1e-3
5141
1e-5
5141
1e-7
5389
#succ
15/15
ACOR liao 5.7 (3)21 (37)275 (279)236 (244)235 (240)235 (240)225 (227)15/15
BIPOPaCMA loshchilov 2.0 (0.3)1.1 (0.6)0.88 (0.4)0.80 (0.4)0.85 (0.4)0.85 (0.4)0.82 (0.3)15/15
BIPOPsaACM loshchilov 1.5 (0.3)0.81 (0.5)0.72 (0.4)0.68 (0.3)0.69 (0.3)0.69 (0.3)0.70 (0.3)15/15
CMAES posik 2.9 (1)2.2 (3)6.0 (6)24 (38)27 (37)27 (37)36 (36)14/15
CMA brockhoff 3.0 (1)1.5 (1)1.1 (0.7)1.4 (0.8)1.4 (0.8)1.4 (0.8)1.3 (0.7)15/15
CMAa brockhoff 2.1 (0.5)1.2 (1)0.91 (0.6)0.89 (0.4)0.93 (0.4)0.93 (0.4)0.90 (0.3)15/15
CMAm brockhoff 2.4 (1)2.0 (1)1.3 (0.9)1.2 (0.8)1.2 (0.8)1.2 (0.8)1.1 (0.8)15/15
CMAma brockhoff 2.2 (1)1.3 (1)0.83 (0.4)0.76 (0.3)0.79 (0.3)0.79 (0.3)0.80 (0.3)15/15
CMAmah brockhoff 2.7 (2)2.1 (0.9)0.99 (0.3)0.89 (0.3)0.90 (0.3)0.90 (0.3)0.87 (0.3)15/15
CMAmh brockhoff 4.7 (4)2.2 (1)1.4 (0.4)1.3 (0.4)1.3 (0.3)1.3 (0.3)1.2 (0.3)15/15
DBRCGA chuang 20 (6)15 (16)58 (72)128 (114)152 (186)152 (175)146 (132)11/15
DE-AUTO voglis 38 (20)19 (16)62 (106)57 (88)58 (87)58 (87)58 (83)14/15
DE-BFGS voglis 22 (18)151 (278)386 (339)436 (394)434 (451)434 (611)635 (682)2/15
DE-ROLL voglis 15 (11)17 (18)26 (40)31 (34)32 (34)32 (34)33 (37)15/15
DE-SIMPLEX voglis 23 (32)19 (18)31 (42)30 (34)30 (34)30 (34)30 (32)15/15
DEAE posik 6.6 (2)1.6 (0.3)0.94 (0.1)1.1 (0.1)1.2 (0.2)1.2 (0.2)1.2 (0.1)15/15
DE posik 19 (9)6.7 (3)22 (60)20 (50)20 (49)20 (49)19 (46)13/15
DEb posik 19 (9)6.7 (3)22 (60)20 (49)20 (49)20 (49)19 (47)13/15
DEctpb posik 16 (8)6.2 (2)5.0 (2)6.1 (2)6.3 (2)6.3 (2)6.3 (2)15/15
IPOPsaACM loshchilov 1.8 (0.5)1.00 (0.5)0.70 (0.4)0.68 (0.3)0.69 (0.3)0.69 (0.3)0.72 (0.3)15/15
JADE posik 8.0 (1)2.3 (0.7)20 (60)17 (49)17 (49)17 (49)16 (47)13/15
JADEb posik 6.6 (2)157 (311)180 (268)271 (368)269 (389)269 (389)256 (255)4/15
JADEctpb posik 8.0 (1)2.3 (0.7)20 (60)17 (49)17 (49)17 (49)16 (47)13/15
MVDE melo 24 (10)11 (3)12 (7)26 (19)31 (20)31 (20)33 (31)15/15
NBIPOPaCMA loshchilov 2.0 (0.5)1.4 (2)1.0 (0.7)1.2 (0.6)1.3 (0.6)1.3 (0.6)1.2 (0.6)15/15
NIPOPaCMA loshchilov 2.0 (0.6)1.2 (0.7)1.0 (0.4)0.96 (0.3)0.96 (0.3)0.96 (0.3)0.93 (0.3)15/15
PSO-BFGS voglis 2441 (3627)8889 (1e4)1e60/15
SNES schaul 1.9 (0.5)87 (80)245 (235)823 (1017)1145 (1170)1145 (1428)1092 (1406)6/15
xNES schaul 2.4 (0.8)0.78 (0.1)↑00.48 (0.0)↑00.58 (0.1)↑00.58 (0.1)↑00.58 (0.1)↑00.64 (0.1)↑015/15
xNESas schaul 2.4 (1)0.76 (0.1)↑00.45 (0.1)↑00.56 (0.1)↑00.58 (0.1)↑00.58 (0.1)↑00.59 (0.0)↑015/15

Δ fopt
f8, 10-D
1e1
326
1e0
921
1e-1
1114
1e-2
1217
1e-3
1267
1e-5
1315
1e-7
1343
#succ
15/15
ACOR liao 4.3 (0.9)28 (2)41 (2)58 (3)76 (2)112 (3)149 (4)15/15
BIPOPaCMA loshchilov 2.1 (0.7)3.5 (0.7)3.6 (0.6)3.6 (0.5)3.7 (0.5)3.8 (0.5)4.0 (0.4)15/15
BIPOPsaACM loshchilov 1.2 (0.4)1.8 (1)1.7 (1)1.7 (1)1.7 (1)1.7 (1.0)1.7 (1.0)15/15
CMAES posik 2.2 (1.0)4.6 (0.9)4.6 (0.7)4.6 (0.6)4.6 (0.6)4.8 (0.5)4.9 (0.5)15/15
CMA brockhoff 2.5 (1)6.2 (6)6.0 (5)5.9 (5)5.9 (4)6.0 (4)6.1 (4)15/15
CMAa brockhoff 2.1 (0.4)3.6 (0.7)3.7 (0.6)3.7 (0.5)3.8 (0.5)3.9 (0.5)4.0 (0.5)15/15
CMAm brockhoff 3.7 (5)4.6 (2)4.7 (2)4.7 (2)4.7 (2)4.8 (1)4.9 (1)15/15
CMAma brockhoff 2.1 (0.8)3.7 (0.6)3.8 (0.5)3.8 (0.4)3.8 (0.4)3.9 (0.4)4.0 (0.4)15/15
CMAmah brockhoff 1.5 (1)3.8 (4)3.7 (3)3.7 (3)3.7 (3)3.7 (3)3.8 (3)15/15
CMAmh brockhoff 2.0 (2)4.6 (3)4.6 (3)4.5 (2)4.5 (2)4.6 (2)4.7 (2)15/15
DBRCGA chuang 29 (5)107 (98)109 (73)116 (54)127 (43)148 (39)180 (40)15/15
DE-AUTO voglis 0.94 (0.2)2.0 (0.7)1.8 (0.6)1.7 (0.2)1.7 (0.2)1.6 (0.2)1.6 (0.2)15/15
DE-BFGS voglis 1.2 (0.2)1.4 (1)1.3 (0.9)1.2 (0.8)1.2 (0.8)1.2 (0.8)1.2 (0.7)15/15
DE-ROLL voglis 4.2 (3)8.7 (9)20 (17)27 (22)35 (24)55 (17)257 (390)8/15
DE-SIMPLEX voglis 5.5 (4)11 (12)11 (10)13 (6)13 (8)14 (8)17 (11)15/15
DEAE posik 11 (1)13 (1)12 (1)12 (0.9)12 (1)13 (1)14 (1)15/15
DE posik 14 (4)64 (92)70 (78)73 (72)77 (67)88 (64)98 (61)15/15
DEb posik 14 (4)64 (92)70 (78)73 (72)77 (67)88 (64)98 (61)15/15
DEctpb posik 15 (2)41 (3)49 (2)55 (5)60 (4)73 (5)87 (5)15/15
IPOPsaACM loshchilov 1.3 (0.8)2.0 (2)1.9 (1)1.9 (1)1.8 (1)1.8 (1)1.9 (1)15/15
JADE posik 10 (2)16 (2)15 (2)15 (2)15 (2)16 (2)16 (2)15/15
JADEb posik 6.6 (2)15 (13)16 (12)28 (11)34 (11)42 (10)42 (10)14/15
JADEctpb posik 10 (2)16 (2)15 (2)15 (2)15 (2)16 (2)16 (2)15/15
MVDE melo 29 (6)631 (370)6126 (7635)5816 (6856)1.1e4 (2e4)1.1e4 (9892)1.1e4 (1e4)0/15
NBIPOPaCMA loshchilov 2.6 (1)4.9 (4)4.8 (3)4.7 (3)4.7 (3)4.8 (3)4.9 (3)15/15
NIPOPaCMA loshchilov 2.1 (0.7)5.0 (4)4.9 (4)4.8 (3)4.8 (3)4.9 (3)5.0 (3)15/15
PSO-BFGS voglis 1.4 (0.4)1.1 (0.3)1.0 (0.2)0.96 (0.2)0.94 (0.2)0.93 (0.2)0.92 (0.2)15/15
SNES schaul 1.9 (0.3)90 (26)287 (232)529 (349)961 (693)3800 (2691)3e60/15
xNES schaul 5.3 (0.6)5.7 (0.5)6.1 (0.7)6.2 (0.8)6.2 (0.8)6.7 (0.6)7.5 (0.7)15/15
xNESas schaul 4.5 (0.6)8.0 (2)8.3 (2)8.2 (2)8.2 (2)8.4 (2)8.8 (2)15/15

Δ fopt
f9, 10-D
1e1
200
1e0
648
1e-1
857
1e-2
993
1e-3
1065
1e-5
1138
1e-7
1185
#succ
15/15
ACOR liao 9.1 (6)326 (21)303 (27)365 (41)457 (68)664 (125)868 (185)15/15
BIPOPaCMA loshchilov 3.4 (1)5.1 (1)4.8 (1)4.5 (1)4.4 (0.9)4.5 (0.8)4.5 (0.8)15/15
BIPOPsaACM loshchilov 1.6 (0.5)2.2 (0.5)2.0 (0.4)1.8 (0.3)1.8 (0.3)1.7 (0.3)1.7 (0.3)15/15
CMAES posik 3.6 (2)8.1 (5)7.3 (4)6.7 (4)6.6 (3)6.5 (3)6.5 (3)15/15
CMA brockhoff 5.0 (5)6.7 (2)6.2 (2)5.8 (2)5.7 (1)5.6 (1)5.7 (1)15/15
CMAa brockhoff 3.0 (0.5)5.3 (1.0)4.9 (0.7)4.6 (0.6)4.6 (0.6)4.5 (0.6)4.6 (0.5)15/15
CMAm brockhoff 3.5 (2)6.5 (3)6.0 (2)5.6 (2)5.5 (2)5.4 (2)5.5 (2)15/15
CMAma brockhoff 3.1 (2)7.7 (6)6.8 (5)6.2 (4)6.0 (4)5.9 (4)5.9 (4)15/15
CMAmah brockhoff 1.9 (0.9)4.0 (1)3.9 (0.9)3.7 (0.8)3.6 (0.7)3.5 (0.7)3.6 (0.7)15/15
CMAmh brockhoff 3.1 (0.5)5.9 (5)5.5 (4)5.1 (4)5.0 (3)4.9 (3)4.9 (3)15/15
DBRCGA chuang 38 (9)694 (797)627 (616)712 (792)882 (973)4259 (4176)1.3e4 (2e4)0/15
DE-AUTO voglis 1.7 (0.4)4.1 (3)3.3 (2)3.0 (2)2.8 (2)2.6 (2)2.6 (2)15/15
DE-BFGS voglis 2.0 (1.0)2.3 (2)1.9 (1)1.7 (1)1.6 (1)1.5 (1)1.4 (1)15/15
DE-ROLL voglis 5.1 (5)64 (15)86 (18)101 (22)107 (23)129 (25)418 (427)6/15
DE-SIMPLEX voglis 10 (10)28 (41)26 (29)23 (25)22 (24)22 (23)22 (22)15/15
DEAE posik 15 (3)17 (4)16 (4)15 (3)15 (3)15 (3)16 (3)15/15
DE posik 23 (6)130 (70)186 (62)226 (59)273 (50)584 (268)3086 (3465)1/15
DEb posik 23 (6)130 (70)186 (62)226 (59)273 (50)584 (359)3086 (2410)1/15
DEctpb posik 25 (4)133 (28)193 (58)246 (55)292 (56)677 (481)3119 (3471)1/15
IPOPsaACM loshchilov 1.6 (0.4)2.0 (0.4)1.8 (0.3)1.7 (0.2)1.6 (0.2)1.6 (0.2)1.6 (0.2)15/15
JADE posik 15 (3)25 (3)22 (2)20 (2)20 (2)20 (2)20 (2)15/15
JADEb posik 15 (20)24 (8)21 (5)19 (4)19 (4)19 (4)19 (4)15/15
JADEctpb posik 15 (3)25 (3)22 (2)20 (2)20 (2)20 (2)20 (2)15/15
MVDE melo 48 (13)2.2e4 (3e4)1e60/15
NBIPOPaCMA loshchilov 3.4 (0.4)7.3 (6)6.4 (5)5.9 (4)5.8 (4)5.7 (4)5.8 (3)15/15
NIPOPaCMA loshchilov 3.1 (0.5)5.7 (0.8)5.3 (0.6)5.0 (0.5)4.9 (0.5)4.9 (0.5)4.9 (0.5)15/15
PSO-BFGS voglis 1.6 (0.4)1.1 (0.3)0.98 (0.2)0.90 (0.2)0.86 (0.2)0.83 (0.2)↑10.81 (0.2)↑115/15
SNES schaul 3.6 (1)289 (308)620 (359)2444 (2263)4.0e4 (5e4)3e60/15
xNES schaul 8.8 (1)8.0 (1)7.7 (1)7.3 (1)7.1 (1)7.5 (1)8.4 (0.9)15/15
xNESas schaul 7.1 (1)8.7 (4)9.1 (3)8.6 (3)8.5 (3)8.6 (3)8.8 (3)15/15

Δ fopt
f10, 10-D
1e1
1835
1e0
2172
1e-1
2455
1e-2
2728
1e-3
2802
1e-5
4543
1e-7
4739
#succ
15/15
ACOR liao 1180 (1005)3560 (3511)8763 (6571)1.3e4 (1e4)5.3e4 (4e4)1e70/15
BIPOPaCMA loshchilov 1.4 (0.3)1.5 (0.2)1.4 (0.1)1.3 (0.1)1.3 (0.1)0.90 (0.0)↑10.92 (0.1)↑115/15
BIPOPsaACM loshchilov 0.41 (0.1)↑00.39 (0.1)↑00.37 (0.1)↑00.35 (0.0)↑00.36 (0.0)↑00.24 (0.0)↑00.25 (0.0)↑015/15
CMAES posik 2.2 (0.3)2.1 (0.3)2.0 (0.3)1.9 (0.2)1.9 (0.2)1.2 (0.1)1.2 (0.1)15/15
CMA brockhoff 2.3 (0.3)2.3 (0.2)2.1 (0.1)2.0 (0.1)2.0 (0.1)1.3 (0.1)1.3 (0.1)15/15
CMAa brockhoff 1.4 (0.2)1.5 (0.2)1.4 (0.2)1.3 (0.1)1.3 (0.1)0.89 (0.1)↑00.92 (0.1)15/15
CMAm brockhoff 2.1 (0.6)2.1 (0.3)2.0 (0.3)1.9 (0.1)1.9 (0.1)1.2 (0.1)1.2 (0.1)15/15
CMAma brockhoff 1.3 (0.4)1.4 (0.2)1.3 (0.1)1.2 (0.1)1.3 (0.1)0.83 (0.1)↑00.84 (0.0)↑015/15
CMAmah brockhoff 1.8 (0.3)1.7 (0.2)1.6 (0.1)1.4 (0.1)1.4 (0.1)0.92 (0.1)↑00.92 (0.0)↑015/15
CMAmh brockhoff 2.3 (0.4)2.2 (0.3)2.0 (0.1)1.9 (0.1)1.9 (0.1)1.2 (0.1)1.2 (0.1)15/15
DBRCGA chuang 437 (487)3291 (3574)1e60/15
DE-AUTO voglis 2.4 (3)2.0 (3)1.8 (2)1.6 (2)1.6 (2)1.0 (1)0.99 (1)15/15
DE-BFGS voglis 1.7 (2)1.5 (2)1.3 (1)1.2 (1)1.2 (1)0.73 (0.7)0.72 (0.7)15/15
DE-ROLL voglis 111 (35)142 (73)165 (64)172 (77)197 (71)148 (44)1524 (1477)0/15
DE-SIMPLEX voglis 20 (12)25 (8)33 (8)38 (13)46 (9)42 (9)221 (240)3/15
DEAE posik 2.2 (0.2)2.2 (0.2)2.3 (0.2)2.4 (0.1)2.6 (0.2)2.0 (0.1)2.3 (0.1)15/15
DE posik 5e50/15
DEb posik 5e50/15
DEctpb posik 5e50/15
IPOPsaACM loshchilov 0.41 (0.1)↑00.40 (0.1)↑00.38 (0.1)↑00.36 (0.1)↑00.36 (0.1)↑00.25 (0.0)↑00.25 (0.0)↑015/15
JADE posik 4.4 (1)4.4 (1)4.6 (1)4.5 (1)4.7 (1)3.4 (0.7)3.6 (0.7)15/15
JADEb posik 13 (8)15 (7)16 (5)17 (9)19 (9)14 (5)16 (6)15/15
JADEctpb posik 4.4 (1)4.4 (1)4.6 (1)4.5 (1)4.7 (1)3.4 (0.7)3.6 (0.7)15/15
MVDE melo 1e60/15
NBIPOPaCMA loshchilov 1.3 (0.4)1.4 (0.3)1.3 (0.2)1.3 (0.1)1.3 (0.1)0.89 (0.1)↑00.92 (0.1)↑015/15
NIPOPaCMA loshchilov 1.4 (0.3)1.4 (0.3)1.4 (0.2)1.3 (0.2)1.3 (0.1)0.89 (0.1)↑00.92 (0.1)↑015/15
PSO-BFGS voglis 3.9 (5)3.3 (4)2.9 (4)2.6 (3)2.6 (3)1.6 (2)1.6 (2)15/15
SNES schaul 2.3e4 (3e4)3e60/15
xNES schaul 1.5 (0.1)1.5 (0.1)1.6 (0.1)1.7 (0.1)1.9 (0.1)1.5 (0.0)1.8 (0.0)15/15
xNESas schaul 1.4 (0.2)1.4 (0.3)1.4 (0.2)1.4 (0.2)1.5 (0.2)1.0 (0.1)1.1 (0.2)15/15

Δ fopt
f11, 10-D
1e1
266
1e0
1041
1e-1
2602
1e-2
2954
1e-3
3338
1e-5
4092
1e-7
4843
#succ
15/15
ACOR liao 357 (147)160 (33)92 (18)105 (17)115 (22)132 (23)140 (23)14/15
BIPOPaCMA loshchilov 6.6 (0.9)2.0 (0.2)0.87 (0.1)↑00.83 (0.0)↑00.78 (0.0)↑00.72 (0.0)↑00.67 (0.0)↑015/15
BIPOPsaACM loshchilov 2.9 (0.2)0.79 (0.1)↑00.33 (0.0)↑00.31 (0.0)↑00.29 (0.0)↑00.25 (0.0)↑00.23 (0.0)↑015/15
CMAES posik 14 (2)4.1 (0.4)1.8 (0.2)1.6 (0.1)1.5 (0.1)1.3 (0.1)1.2 (0.1)15/15
CMA brockhoff 14 (1)4.2 (0.6)1.8 (0.3)1.7 (0.2)1.6 (0.2)1.4 (0.1)1.2 (0.1)15/15
CMAa brockhoff 6.9 (0.7)2.1 (0.2)0.90 (0.1)↑00.85 (0.1)↑00.80 (0.0)↑00.73 (0.0)↑00.67 (0.0)↑015/15
CMAm brockhoff 14 (2)4.1 (0.4)1.8 (0.1)1.7 (0.1)1.5 (0.1)1.3 (0.1)1.2 (0.1)15/15
CMAma brockhoff 6.8 (0.8)2.0 (0.2)0.88 (0.1)↑00.82 (0.1)↑00.77 (0.1)↑00.69 (0.0)↑00.63 (0.0)↑015/15
CMAmah brockhoff 9.1 (0.8)2.6 (0.3)1.1 (0.1)1.0 (0.1)0.97 (0.1)0.84 (0.1)↑00.75 (0.1)↑015/15
CMAmh brockhoff 17 (3)5.1 (0.6)2.2 (0.2)2.0 (0.2)1.9 (0.2)1.6 (0.1)1.4 (0.1)15/15
DBRCGA chuang 153 (183)233 (152)149 (50)191 (33)216 (28)235 (18)1542 (1497)0/15
DE-AUTO voglis 0.43 (0.1)↑00.20 (0.0)↑10.09 (0.0)↑00.09 (0.0)↑00.08 (0.0)↑00.08 (0.0)↑00.37 (0.5)↑115/15
DE-BFGS voglis 0.52 (0.3)↑10.16 (0.1)↑00.07 (0.0)↑00.07 (0.0)↑00.07 (0.0)↑00.07 (0.0)↑00.07 (0.0)↑015/15
DE-ROLL voglis 293 (157)170 (89)106 (64)126 (64)138 (65)156 (54)1e60/15
DE-SIMPLEX voglis 49 (33)42 (17)28 (9)35 (6)41 (7)49 (7)966 (905)0/15
DEAE posik 12 (5)4.0 (2)1.9 (0.6)2.0 (0.6)2.0 (0.5)2.1 (0.4)2.1 (0.3)15/15
DE posik 516 (175)284 (74)210 (116)1236 (1475)2234 (2809)5e50/15
DEb posik 516 (175)284 (74)210 (121)1236 (1469)2234 (1835)5e50/15
DEctpb posik 668 (172)327 (67)392 (393)2522 (2412)5e50/15
IPOPsaACM loshchilov 2.8 (0.3)0.76 (0.1)↑00.33 (0.0)↑00.30 (0.0)↑00.28 (0.0)↑00.25 (0.0)↑00.23 (0.0)↑015/15
JADE posik 21 (8)6.5 (2)3.1 (0.9)3.0 (0.8)3.0 (0.8)2.9 (0.8)2.9 (0.8)15/15
JADEb posik 22 (10)11 (8)7.3 (3)10 (3)11 (3)13 (3)13 (3)15/15
JADEctpb posik 21 (8)6.5 (2)3.1 (0.9)3.0 (0.8)3.0 (0.8)2.9 (0.8)2.9 (0.8)15/15
MVDE melo 508 (352)7038 (6943)1e60/15
NBIPOPaCMA loshchilov 6.9 (0.7)2.0 (0.2)0.90 (0.1)↑10.85 (0.1)↑00.81 (0.1)↑00.73 (0.1)↑00.68 (0.0)↑015/15
NIPOPaCMA loshchilov 7.1 (0.6)2.1 (0.2)0.92 (0.1)0.88 (0.1)↑00.83 (0.1)↑00.75 (0.1)↑00.70 (0.0)↑015/15
PSO-BFGS voglis 0.44 (0.1)↑00.14 (0.0)↑00.06 (0.0)↑00.06 (0.0)↑00.06 (0.0)↑00.06 (0.0)↑00.99 (3)15/15
SNES schaul 5.1e4 (4e4)3e60/15
xNES schaul 6.5 (0.8)2.1 (0.2)1.1 (0.1)1.2 (0.1)1.2 (0.1)1.4 (0.1)1.5 (0.1)15/15
xNESas schaul 6.7 (1)2.1 (0.3)1.0 (0.1)1.0 (0.1)1.0 (0.1)0.94 (0.1)0.88 (0.1)↑115/15

Δ fopt
f12, 10-D
1e1
515
1e0
896
1e-1
1240
1e-2
1390
1e-3
1569
1e-5
3660
1e-7
5154
#succ
15/15
ACOR liao 1391 (0.7)6350 (1e4)2.2e4 (2e4)1.0e5 (1e5)1e70/15
BIPOPaCMA loshchilov 3.2 (3)4.4 (3)4.8 (2)4.9 (2)4.9 (2)2.6 (0.9)2.1 (0.7)15/15
BIPOPsaACM loshchilov 1.0 (0.6)1.1 (1)1.1 (1)1.3 (1)1.4 (0.9)0.94 (0.8)0.91 (0.7)15/15
CMAES posik 4.0 (4)4.4 (4)4.8 (4)5.1 (3)5.3 (3)2.9 (1)2.4 (0.8)15/15
CMA brockhoff 3.7 (2)4.3 (3)5.1 (3)5.5 (3)5.7 (3)3.1 (1)2.5 (1)15/15
CMAa brockhoff 2.8 (2)3.1 (2)3.7 (2)4.0 (2)4.1 (2)2.3 (0.7)1.8 (0.5)15/15
CMAm brockhoff 2.6 (2)4.2 (3)5.1 (2)5.5 (2)5.6 (2)3.0 (0.9)2.5 (0.7)15/15
CMAma brockhoff 2.6 (2)3.3 (2)3.9 (2)4.3 (2)4.4 (2)2.4 (0.9)2.0 (0.7)15/15
CMAmah brockhoff 4.1 (5)5.0 (5)5.3 (4)5.6 (4)5.5 (3)2.9 (1)2.3 (1)15/15
CMAmh brockhoff 2.5 (4)3.3 (5)3.8 (4)4.4 (4)4.6 (3)2.6 (2)2.2 (1)15/15
DBRCGA chuang 334 (972)1000 (1396)3245 (4435)1.0e4 (1e4)1e60/15
DE-AUTO voglis 2.7 (4)2.1 (3)2.0 (2)1.9 (2)1.8 (2)0.96 (0.9)1.6 (1.0)15/15
DE-BFGS voglis 1.3 (2)0.98 (1)0.97 (1.0)0.96 (0.8)0.94 (0.7)0.53 (0.3)↑10.59 (0.3)↑115/15
DE-ROLL voglis 41 (71)40 (68)47 (67)52 (70)59 (61)59 (40)344 (443)4/15
DE-SIMPLEX voglis 10 (13)13 (11)16 (10)18 (12)22 (9)15 (8)55 (88)7/15
DEAE posik 11 (1)9.1 (4)8.8 (4)10 (4)10 (4)5.7 (2)4.8 (1)15/15
DE posik 337 (678)749 (1004)1345 (1362)5388 (6745)5e50/15
DEb posik 337 (495)749 (1316)1345 (1967)5388 (6115)5e50/15
DEctpb posik 224 (161)435 (444)1345 (1635)5e50/15
IPOPsaACM loshchilov 0.97 (0.7)1.0 (0.9)1.1 (0.9)1.3 (1.0)1.4 (0.8)0.82 (0.3)0.69 (0.3)15/15
JADE posik 18 (3)13 (2)13 (8)14 (9)15 (8)9.0 (3)7.8 (3)15/15
JADEb posik 10 (3)17 (13)20 (15)23 (13)24 (11)13 (5)11 (4)15/15
JADEctpb posik 18 (3)13 (2)13 (8)14 (9)15 (8)9.0 (3)7.8 (3)15/15
MVDE melo 416 (544)1081 (1279)5738 (6141)1e60/15
NBIPOPaCMA loshchilov 3.2 (3)4.6 (4)5.1 (4)5.3 (3)5.4 (3)2.9 (1)2.3 (0.8)15/15
NIPOPaCMA loshchilov 2.6 (2)3.5 (3)3.9 (3)4.3 (2)4.4 (2)2.5 (0.9)2.0 (0.7)15/15
PSO-BFGS voglis 1.9 (1)1.8 (1)1.7 (1.0)1.6 (0.9)1.5 (0.8)1.0 (0.9)3.5 (5)15/15
SNES schaul 14 (29)64 (50)411 (655)881 (972)3005 (3745)3e60/15
xNES schaul 7.9 (0.8)7.0 (3)9.2 (3)10 (6)10 (6)5.6 (3)5.5 (2)15/15
xNESas schaul 4.1 (0.8)3.5 (0.9)5.8 (4)9.0 (10)14 (17)8.0 (9)6.4 (7)15/15

Δ fopt
f13, 10-D
1e1
387
1e0
596
1e-1
797
1e-2
1014
1e-3
4587
1e-5
6208
1e-7
7779
#succ
15/15
ACOR liao 1068 (1012)1.9e4 (2e4)3.6e4 (6e4)4.1e4 (5e4)1.5e4 (2e4)1e70/15
BIPOPaCMA loshchilov 2.5 (2)3.6 (2)3.3 (1)3.4 (1)0.97 (0.2)0.97 (0.2)1.2 (0.7)15/15
BIPOPsaACM loshchilov 0.75 (0.1)↑11.0 (0.5)1.2 (0.5)1.0 (0.4)0.27 (0.1)↑00.30 (0.2)↑00.32 (0.1)↑015/15
CMAES posik 2.9 (2)4.2 (3)4.7 (2)5.4 (3)1.4 (0.7)1.9 (1)2.6 (2)15/15
CMA brockhoff 2.7 (2)5.9 (4)6.1 (3)5.2 (3)1.5 (0.6)1.4 (0.5)1.4 (0.5)15/15
CMAa brockhoff 2.3 (1)3.7 (2)3.6 (1)3.8 (1)0.98 (0.2)1.0 (0.3)0.99 (0.4)15/15
CMAm brockhoff 1.9 (0.6)5.1 (5)6.1 (4)6.6 (3)1.7 (0.5)1.7 (0.6)1.8 (0.7)15/15
CMAma brockhoff 1.7 (0.4)3.7 (2)5.0 (3)4.8 (2)1.1 (0.4)1.3 (0.5)1.4 (0.6)15/15
CMAmah brockhoff 2.4 (3)5.4 (4)5.6 (2)4.8 (1)1.4 (0.5)1.6 (0.6)1.6 (0.6)15/15
CMAmh brockhoff 2.9 (3)6.1 (6)8.9 (4)7.9 (3)2.0 (0.4)2.1 (1)2.2 (1)15/15
DBRCGA chuang 201 (175)552 (841)2132 (1866)4473 (4351)1487 (2270)1e60/15
DE-AUTO voglis 1.5 (0.1)1.1 (0.1)1.00 (0.1)↑10.99 (0.3)0.52 (0.4)1.6 (1)32 (27)10/15
DE-BFGS voglis 0.84 (0.1)↑10.74 (0.1)↑10.70 (0.0)↑10.66 (0.0)↑10.17 (0.0)↑02.5 (0.3)1e60/15
DE-ROLL voglis 16 (16)17 (13)31 (25)34 (25)10 (8)13 (5)65 (85)8/15
DE-SIMPLEX voglis 11 (11)13 (10)16 (12)19 (8)4.7 (1)4.6 (1)14 (12)7/15
DEAE posik 8.2 (0.8)7.9 (0.5)7.9 (0.5)7.8 (0.3)2.1 (0.1)2.0 (0.1)2.0 (0.1)15/15
DE posik 21 (7)52 (28)188 (74)417 (76)5e50/15
DEb posik 21 (7)52 (28)188 (74)417 (76)5e50/15
DEctpb posik 25 (8)78 (29)225 (86)729 (542)5e50/15
IPOPsaACM loshchilov 0.96 (0.4)1.4 (1)1.3 (0.7)1.3 (0.6)0.32 (0.1)↑00.31 (0.1)↑00.31 (0.1)↑015/15
JADE posik 11 (2)14 (2)13 (2)12 (2)3.1 (0.4)3.2 (0.9)3.1 (0.8)15/15
JADEb posik 11 (10)19 (14)25 (17)25 (12)6.7 (3)8.7 (4)14 (5)15/15
JADEctpb posik 11 (2)14 (2)13 (2)12 (2)3.1 (0.4)3.2 (0.9)3.1 (0.8)15/15
MVDE melo 42 (11)141 (83)3336 (3955)1e60/15
NBIPOPaCMA loshchilov 2.8 (2)3.6 (2)3.9 (1)3.5 (1)0.90 (0.3)1.0 (0.4)1.4 (1)15/15
NIPOPaCMA loshchilov 2.4 (2)3.7 (2)3.6 (2)4.3 (2)1.1 (0.4)1.1 (0.5)1.2 (0.5)15/15
PSO-BFGS voglis 0.92 (0.4)0.80 (0.3)0.75 (0.2)0.70 (0.2)↑10.18 (0.0)↑0357 (326)1e60/15
SNES schaul 23 (39)97 (99)370 (274)782 (882)492 (475)1651 (1461)5379 (3143)0/15
xNES schaul 5.5 (0.3)6.0 (0.1)6.1 (0.1)6.2 (0.2)1.7 (0.0)1.7 (0.0)1.7 (0.0)15/15
xNESas schaul 3.6 (0.8)3.5 (1.0)16 (27)18 (35)8.0 (11)9.5 (14)10 (12)15/15

Δ fopt
f14, 10-D
1e1
37
1e0
98
1e-1
133
1e-2
205
1e-3
392
1e-5
687
1e-7
4305
#succ
15/15
ACOR liao 4.3 (3)6.5 (1)7.6 (1)8.9 (1)13 (4)662 (245)1e70/15
BIPOPaCMA loshchilov 2.2 (1)3.0 (0.6)3.7 (0.6)3.8 (0.4)3.3 (0.4)3.5 (0.3)0.86 (0.1)↑015/15
BIPOPsaACM loshchilov 2.7 (1)2.2 (0.5)2.4 (0.3)2.2 (0.2)1.6 (0.1)1.4 (0.1)0.31 (0.0)↑015/15
CMAES posik 2.3 (2)3.1 (0.9)3.9 (0.7)4.3 (0.7)4.0 (0.4)5.2 (0.5)1.3 (0.1)15/15
CMA brockhoff 2.5 (2)3.1 (0.7)3.8 (0.5)4.2 (0.7)3.9 (0.7)5.3 (0.6)1.4 (0.2)15/15
CMAa brockhoff 2.9 (2)3.3 (0.6)4.1 (0.8)3.9 (0.8)3.2 (0.5)3.5 (0.4)0.84 (0.1)↑015/15
CMAm brockhoff 2.5 (2)2.9 (0.8)3.2 (0.7)3.7 (0.9)3.8 (0.8)5.2 (0.5)1.5 (0.2)15/15
CMAma brockhoff 1.9 (1)2.5 (0.6)3.1 (0.6)3.3 (0.4)2.8 (0.3)3.5 (0.3)0.86 (0.1)↑015/15
CMAmah brockhoff 1.6 (1)1.9 (0.6)2.2 (0.7)2.3 (0.6)2.3 (0.4)3.4 (0.5)0.97 (0.1)15/15
CMAmh brockhoff 1.4 (1)1.8 (0.6)2.1 (0.4)2.5 (0.6)2.9 (0.6)5.3 (0.8)1.5 (0.3)15/15
DBRCGA chuang 18 (14)38 (8)54 (9)59 (15)60 (18)374 (161)1e60/15
DE-AUTO voglis 1.9 (1.0)1.2 (0.2)1.1 (0.2)0.97 (0.1)0.63 (0.1)↑00.53 (0.0)↑011 (11)2/15
DE-BFGS voglis 1.9 (0.3)1.1 (0.2)1.1 (0.1)0.93 (0.1)0.64 (0.1)↑00.55 (0.1)↑019 (29)0/15
DE-ROLL voglis 2.1 (0.6)19 (21)21 (18)14 (12)16 (14)111 (46)1e60/15
DE-SIMPLEX voglis 4.4 (4)16 (10)34 (24)29 (13)20 (10)24 (13)19 (21)8/15
DEAE posik 6.9 (3)13 (3)17 (3)18 (2)12 (1)10 (0.7)2.1 (0.1)15/15
DE posik 8.7 (7)19 (4)23 (5)28 (7)46 (12)1101 (796)5e50/15
DEb posik 8.7 (7)19 (4)23 (5)28 (7)46 (12)1101 (1101)5e50/15
DEctpb posik 7.0 (7)20 (6)25 (4)29 (4)46 (11)2048 (2068)5e50/15
IPOPsaACM loshchilov 2.2 (2)2.3 (0.5)2.4 (0.5)2.2 (0.5)1.6 (0.2)1.5 (0.2)0.31 (0.0)↑015/15
JADE posik 4.8 (3)11 (2)15 (2)16 (2)16 (2)16 (3)3.4 (0.6)15/15
JADEb posik 3.8 (2)7.9 (2)11 (1)12 (2)14 (3)20 (9)20 (20)7/15
JADEctpb posik 4.8 (3)11 (2)15 (2)16 (2)16 (2)16 (3)3.4 (0.6)15/15
MVDE melo 12 (9)35 (4)46 (4)51 (7)87 (25)1e60/15
NBIPOPaCMA loshchilov 2.1 (2)3.0 (1)3.7 (0.5)3.9 (0.7)3.3 (0.6)3.7 (0.4)0.88 (0.1)↑015/15
NIPOPaCMA loshchilov 3.0 (2)3.2 (0.8)4.0 (0.6)4.0 (0.7)3.3 (0.4)3.7 (0.3)0.87 (0.1)↑115/15
PSO-BFGS voglis 1.9 (0.8)1.2 (0.2)1.1 (0.2)0.96 (0.2)0.66 (0.1)↑00.55 (0.1)↑0259 (360)0/15
SNES schaul 1.8 (1.0)2.1 (0.6)3.4 (0.6)4.4 (0.8)6.2 (2)3e60/15
xNES schaul 2.0 (0.9)3.1 (1)8.8 (1)10 (0.7)7.7 (0.3)7.1 (0.3)1.5 (0.1)15/15
xNESas schaul 2.0 (2)3.3 (0.9)7.1 (2)7.8 (1)5.9 (0.9)5.5 (0.7)1.2 (0.1)15/15

Δ fopt
f15, 10-D
1e1
4774
1e0
39246
1e-1
73643
1e-2
74669
1e-3
75790
1e-5
77814
1e-7
79834
#succ
12/15
ACOR liao 41 (40)220 (182)436 (413)430 (776)424 (428)413 (591)402 (382)4/15
BIPOPaCMA loshchilov 1.1 (0.7)1.5 (1)1.2 (0.7)1.2 (0.7)1.2 (0.7)1.2 (0.7)1.2 (0.7)15/15
BIPOPsaACM loshchilov 1.0 (1.0)1.1 (0.8)0.89 (0.5)0.88 (0.5)0.87 (0.5)0.92 (0.8)0.91 (0.8)15/15
CMAES posik 2.0 (2)190 (455)5e50/15
CMA brockhoff 0.89 (0.7)1.2 (0.7)0.79 (0.4)0.80 (0.4)0.80 (0.4)0.81 (0.4)0.82 (0.4)15/15
CMAa brockhoff 1.1 (1)1.0 (0.6)0.76 (0.4)0.77 (0.4)0.77 (0.4)0.78 (0.4)0.79 (0.4)15/15
CMAm brockhoff 0.74 (0.5)1.0 (0.8)1.0 (0.6)1.0 (0.6)1.0 (0.6)1.1 (0.6)1.1 (0.6)15/15
CMAma brockhoff 0.91 (1.0)0.89 (0.4)0.93 (0.7)0.93 (0.7)0.94 (0.7)0.95 (0.7)0.96 (0.7)15/15
CMAmah brockhoff 1.4 (1)0.96 (0.3)0.78 (0.4)0.78 (0.4)0.79 (0.4)0.80 (0.4)0.80 (0.4)15/15
CMAmh brockhoff 1.3 (1)0.97 (0.8)0.95 (0.8)0.95 (0.8)0.95 (0.8)0.96 (0.8)0.97 (0.8)15/15
DBRCGA chuang 126 (124)1e60/15
DE-AUTO voglis 24 (14)68 (110)203 (170)200 (154)197 (188)192 (180)187 (191)1/15
DE-BFGS voglis 4.5 (3)6.5 (4)8.8 (8)8.7 (7)8.5 (11)8.3 (8)8.1 (8)12/15
DE-ROLL voglis 24 (24)38 (32)199 (184)197 (131)194 (159)189 (228)184 (163)1/15
DE-SIMPLEX voglis 18 (10)16 (13)29 (33)29 (27)28 (22)28 (29)27 (33)6/15
DEAE posik 56 (62)5e50/15
DE posik 108 (61)5e50/15
DEb posik 108 (92)5e50/15
DEctpb posik 84 (54)5e50/15
IPOPsaACM loshchilov 0.90 (0.9)0.72 (0.5)0.76 (0.4)0.75 (0.4)0.74 (0.4)0.73 (0.4)0.73 (0.4)15/15
JADE posik 3.9 (1)5e50/15
JADEb posik 14 (15)5e50/15
JADEctpb posik 3.9 (1)5e50/15
MVDE melo 37 (29)1e60/15
NBIPOPaCMA loshchilov 0.77 (0.6)1.9 (0.9)1.3 (0.8)1.3 (0.8)1.3 (0.8)1.3 (0.8)1.3 (0.8)15/15
NIPOPaCMA loshchilov 0.71 (0.6)0.78 (0.8)0.75 (0.4)0.76 (0.4)0.76 (0.4)0.77 (0.4)0.78 (0.4)15/15
PSO-BFGS voglis 43 (30)1e60/15
SNES schaul 5.0 (6)503 (565)3e60/15
xNES schaul 2.4 (3)190 (214)2e60/15
xNESas schaul 3.7 (4)168 (165)407 (461)401 (414)395 (344)385 (404)375 (456)2/15

Δ fopt
f16, 10-D
1e1
425
1e0
7029
1e-1
15779
1e-2
45669
1e-3
51151
1e-5
65798
1e-7
71570
#succ
15/15
ACOR liao 169 (139)981 (1142)489 (581)328 (575)364 (296)683 (537)2005 (2480)1/15
BIPOPaCMA loshchilov 2.6 (2)0.71 (1)0.84 (1.0)0.50 (0.4)↑10.75 (0.8)0.78 (0.8)0.76 (0.7)15/15
BIPOPsaACM loshchilov 2.4 (2)0.67 (0.7)0.82 (0.5)0.58 (0.6)0.69 (0.6)0.63 (0.5)0.61 (0.5)15/15
CMAES posik 2.7 (0.9)2.0 (2)8.3 (9)10 (13)41 (34)107 (125)98 (140)0/15
CMA brockhoff 2.2 (1)1.2 (1)1.8 (2)0.93 (0.6)1.0 (0.9)0.84 (0.7)0.80 (0.6)15/15
CMAa brockhoff 2.4 (2)0.78 (1)0.90 (0.9)0.69 (0.6)1.0 (0.8)0.84 (0.6)0.80 (0.6)15/15
CMAm brockhoff 1.6 (0.8)0.95 (1)1.3 (0.8)0.66 (0.5)0.77 (0.6)0.76 (0.7)0.73 (0.6)15/15
CMAma brockhoff 1.4 (0.7)1.2 (1)1.2 (0.7)0.67 (0.5)0.67 (0.4)0.56 (0.4)↑10.53 (0.3)↑115/15
CMAmah brockhoff 3.2 (4)0.85 (0.7)1.0 (0.6)0.52 (0.3)↑10.62 (0.4)0.52 (0.4)↑00.49 (0.3)↑015/15
CMAmh brockhoff 2.6 (4)1.1 (1)1.3 (0.9)0.65 (0.5)0.88 (0.5)0.74 (0.4)0.70 (0.4)15/15
DBRCGA chuang 8.6 (6)56 (66)283 (261)1e60/15
DE-AUTO voglis 18 (22)45 (37)90 (106)103 (92)293 (206)1e60/15
DE-BFGS voglis 26 (24)15 (10)39 (51)91 (105)279 (377)1e60/15
DE-ROLL voglis 13 (10)49 (49)148 (205)316 (291)1e60/15
DE-SIMPLEX voglis 6.0 (10)13 (9)94 (115)150 (154)134 (136)107 (100)1e60/15
DEAE posik 70 (59)5e50/15
DE posik 106 (76)5e50/15
DEb posik 106 (76)5e50/15
DEctpb posik 114 (104)5e50/15
IPOPsaACM loshchilov 2.5 (1)0.67 (0.7)0.72 (0.6)0.39 (0.2)↑00.44 (0.2)↑10.36 (0.1)↑10.34 (0.1)↑115/15
JADE posik 17 (9)82 (160)5e50/15
JADEb posik 20 (14)112 (157)207 (261)5e50/15
JADEctpb posik 17 (9)82 (108)5e50/15
MVDE melo 20 (17)193 (154)1e60/15
NBIPOPaCMA loshchilov 3.3 (2)0.67 (0.5)1.1 (0.6)0.49 (0.4)0.48 (0.4)↑00.40 (0.3)↑00.38 (0.3)↑015/15
NIPOPaCMA loshchilov 2.8 (2)0.63 (0.5)0.68 (0.7)0.41 (0.2)↑00.44 (0.2)↑10.37 (0.2)↑10.36 (0.2)↑115/15
PSO-BFGS voglis 42 (26)245 (339)1e60/15
SNES schaul 2.6 (2)1.4 (2)14 (12)26 (54)65 (59)322 (494)3e60/15
xNES schaul 8.2 (5)2.2 (3)3.9 (5)2.6 (3)3.2 (3)2.6 (2)2.4 (2)15/15
xNESas schaul 7.1 (5)1.8 (2)3.2 (6)2.0 (2)2.2 (2)1.8 (2)1.7 (1)15/15

Δ fopt
f17, 10-D
1e1
26
1e0
429
1e-1
2203
1e-2
6329
1e-3
9851
1e-5
20190
1e-7
26503
#succ
15/15
ACOR liao 5.5 (3)2.6 (0.7)1.1 (0.4)11 (26)24 (31)239 (338)278 (320)11/15
BIPOPaCMA loshchilov 2.2 (1)1.1 (0.5)0.81 (1)1.4 (2)1.3 (1.0)0.90 (0.3)1.2 (0.8)15/15
BIPOPsaACM loshchilov 2.0 (2)2.6 (1)1.5 (2)1.2 (0.7)1.1 (0.5)1.1 (0.6)2.1 (2)15/15
CMAES posik 2.1 (1)1.1 (0.6)0.43 (0.1)↑01.2 (1)2.6 (4)5e50/15
CMA brockhoff 2.0 (2)1.1 (0.3)0.66 (0.2)↑10.74 (0.6)1.1 (0.9)0.81 (0.3)1.1 (0.4)15/15
CMAa brockhoff 2.4 (2)1.0 (0.3)0.61 (0.1)↑10.87 (0.8)0.80 (0.5)0.75 (0.3)0.86 (0.3)15/15
CMAm brockhoff 1.8 (1)1.1 (0.6)1.1 (1)0.68 (0.4)0.80 (0.5)0.80 (0.1)↑00.92 (0.4)15/15
CMAma brockhoff 1.5 (1)3.0 (0.4)1.2 (1)0.86 (1)0.84 (0.5)0.75 (0.2)↑00.79 (0.4)15/15
CMAmah brockhoff 1.4 (0.7)4.2 (7)1.6 (1)1.1 (0.5)1.3 (0.6)1.1 (0.6)1.1 (0.4)15/15
CMAmh brockhoff 1.5 (2)6.6 (9)2.4 (2)1.1 (0.6)1.1 (0.9)0.99 (0.3)1.1 (0.4)15/15
DBRCGA chuang 3.7 (4)16 (6)77 (67)364 (401)1426 (1574)1e60/15
DE-AUTO voglis 37 (99)207 (180)150 (235)153 (238)108 (182)69 (56)169 (189)1/15
DE-BFGS voglis 7.0 (8)38 (24)144 (229)90 (89)115 (103)83 (64)1e60/15
DE-ROLL voglis 14 (12)99 (62)118 (234)135 (164)454 (600)1e60/15
DE-SIMPLEX voglis 18 (40)114 (35)467 (686)1e60/15
DEAE posik 3.4 (5)6.3 (2)2.7 (0.4)1.6 (0.3)1.4 (0.2)1.3 (0.1)1.5 (0.9)15/15
DE posik 3.5 (4)7.4 (2)3.8 (0.9)2.4 (0.5)2.6 (0.8)12 (12)45 (35)5/15
DEb posik 3.5 (4)7.4 (2)3.8 (0.9)2.4 (0.5)2.6 (0.8)12 (12)45 (42)5/15
DEctpb posik 4.0 (5)8.1 (2)4.6 (0.7)3.2 (0.5)3.4 (0.5)5.1 (2)14 (12)13/15
IPOPsaACM loshchilov 2.4 (2)1.1 (0.3)1.1 (1)1.0 (0.9)1.2 (0.7)1.2 (0.5)1.4 (0.6)15/15
JADE posik 3.3 (4)5.2 (1.0)2.8 (0.6)1.8 (0.3)1.9 (0.5)5.2 (12)6.8 (15)12/15
JADEb posik 2.8 (3)4.1 (2)2.7 (1)4.6 (5)14 (23)75 (99)5e50/15
JADEctpb posik 3.3 (4)5.2 (1.0)2.8 (0.6)1.8 (0.3)1.9 (0.5)5.2 (12)6.8 (10)12/15
MVDE melo 4.8 (5)16 (3)13 (4)24 (8)42 (52)158 (152)566 (425)0/15
NBIPOPaCMA loshchilov 3.0 (3)3.2 (7)1.5 (2)1.0 (0.6)1.3 (0.9)1.0 (0.5)1.3 (0.4)15/15
NIPOPaCMA loshchilov 2.2 (1.0)1.1 (0.2)0.84 (1)0.79 (0.6)1.1 (0.5)0.81 (0.3)0.94 (0.5)15/15
PSO-BFGS voglis 7.8 (8)108 (99)201 (246)141 (146)125 (118)170 (147)1e60/15
SNES schaul 1.6 (2)1.1 (0.7)4.2 (7)4.1 (5)6.4 (6)28 (20)517 (518)2/15
xNES schaul 2.6 (2)1.8 (0.7)1.2 (0.2)0.74 (0.0)↑00.69 (0.0)↑01.5 (1)6.1 (7)15/15
xNESas schaul 1.5 (1)1.7 (0.3)1.1 (0.1)0.69 (0.0)↑00.63 (0.0)↑01.2 (1)2.8 (3)15/15

Δ fopt
f18, 10-D
1e1
238
1e0
836
1e-1
7012
1e-2
15928
1e-3
27536
1e-5
37234
1e-7
42708
#succ
15/15
ACOR liao 2.8 (1)2.9 (1)118 (35)207 (346)747 (1091)1e70/15
BIPOPaCMA loshchilov 1.0 (0.4)2.2 (4)0.84 (0.9)0.98 (0.5)0.72 (0.5)0.85 (0.4)0.96 (0.4)15/15
BIPOPsaACM loshchilov 1.5 (0.6)2.2 (4)0.81 (0.6)0.61 (0.3)0.63 (0.4)0.91 (0.6)0.91 (0.6)15/15
CMAES posik 1.2 (0.6)2.0 (4)1.4 (2)6.3 (5)45 (63)5e50/15
CMA brockhoff 1.0 (0.4)1.7 (0.5)1.0 (0.7)1.1 (0.9)0.83 (0.5)0.92 (0.3)0.93 (0.3)15/15
CMAa brockhoff 1.1 (0.4)2.9 (4)0.85 (1)0.84 (0.3)0.74 (0.3)0.74 (0.3)0.84 (0.3)15/15
CMAm brockhoff 0.94 (0.4)0.91 (0.4)0.66 (0.4)0.88 (0.8)0.82 (0.4)0.82 (0.3)0.85 (0.3)↑015/15
CMAma brockhoff 1.0 (0.4)1.6 (3)0.78 (0.4)0.67 (0.3)0.63 (0.5)0.70 (0.3)↑10.69 (0.2)↑015/15
CMAmah brockhoff 1.8 (0.8)8.4 (6)2.2 (3)1.4 (1)0.97 (0.7)0.92 (0.6)0.88 (0.5)15/15
CMAmh brockhoff 1.2 (1)6.3 (7)2.0 (2)1.3 (0.8)1.1 (0.5)1.0 (0.4)1.0 (0.4)15/15
DBRCGA chuang 12 (4)25 (7)108 (131)1e60/15
DE-AUTO voglis 106 (99)250 (359)108 (127)70 (65)82 (65)399 (505)1e60/15
DE-BFGS voglis 25 (15)51 (31)71 (94)91 (80)115 (181)191 (172)1e60/15
DE-ROLL voglis 78 (39)315 (613)421 (538)904 (755)1e60/15
DE-SIMPLEX voglis 135 (112)1303 (1659)972 (1357)918 (943)532 (564)1e60/15
DEAE posik 5.1 (2)5.0 (1)1.1 (0.2)0.94 (0.2)↑10.88 (0.8)0.84 (0.6)0.92 (0.6)15/15
DE posik 5.9 (2)12 (7)10 (4)12 (12)19 (19)96 (83)5e50/15
DEb posik 5.9 (2)12 (7)10 (4)12 (12)19 (27)96 (94)5e50/15
DEctpb posik 6.1 (2)13 (5)6.0 (3)10 (7)18 (21)197 (212)5e50/15
IPOPsaACM loshchilov 1.3 (0.6)1.2 (0.5)1.6 (1)0.92 (0.6)0.75 (0.5)1.0 (0.4)1.3 (0.6)15/15
JADE posik 4.1 (2)6.4 (2)1.6 (0.3)0.96 (0.1)1.9 (3)4.9 (7)16 (23)7/15
JADEb posik 3.2 (2)5.6 (2)4.6 (7)49 (42)5e50/15
JADEctpb posik 4.1 (2)6.4 (2)1.6 (0.3)0.96 (0.1)1.9 (3)4.9 (7)16 (25)7/15
MVDE melo 10 (4)32 (10)53 (74)1e60/15
NBIPOPaCMA loshchilov 1.2 (0.5)2.1 (4)0.67 (0.7)0.84 (0.8)0.81 (0.6)1.1 (0.7)1.1 (0.6)15/15
NIPOPaCMA loshchilov 1.2 (0.4)1.0 (0.2)0.87 (0.9)1.1 (0.8)0.81 (0.5)0.85 (0.3)0.86 (0.2)15/15
PSO-BFGS voglis 74 (31)188 (213)133 (161)292 (308)538 (446)1e60/15
SNES schaul 1.3 (0.9)6.2 (18)5.9 (6)15 (15)35 (26)3e60/15
xNES schaul 1.1 (0.7)2.2 (0.2)0.54 (0.0)↑00.37 (0.0)↑00.29 (0.0)↑01.1 (0.6)4.1 (4)15/15
xNESas schaul 1.1 (0.5)2.2 (0.5)0.72 (0.1)↑10.44 (0.0)↑10.32 (0.0)↑10.75 (0.5)1.3 (0.8)15/15

Δ fopt
f19, 10-D
1e1
1
1e0
1
1e-1
10609
1e-2
9.8e5
1e-3
1.4e6
1e-5
1.4e6
1e-7
1.4e6
#succ
15/15
ACOR liao 187 (48)1.8e6 (2e6)1e70/15
BIPOPaCMA loshchilov 63 (48)1.0e4 (4478)11 (9)0.86 (0.5)0.77 (0.3)↑10.77 (0.3)↑10.77 (0.3)↑115/15
BIPOPsaACM loshchilov 44 (37)1.1e4 (8202)5.9 (5)0.68 (0.7)0.78 (0.5)0.78 (0.5)0.78 (0.5)15/15
CMAES posik 67 (50)1.3e4 (9380)144 (162)5e50/15
CMA brockhoff 56 (28)8548 (2692)37 (38)1.1 (0.5)1.1 (0.5)1.1 (0.5)1.2 (0.7)13/15
CMAa brockhoff 63 (34)7971 (5628)35 (50)1.1 (1)0.95 (0.8)0.95 (1.0)0.94 (0.8)12/15
CMAm brockhoff 52 (45)8856 (7009)32 (56)1.0 (0.6)0.80 (0.4)0.80 (0.4)0.80 (0.4)14/15
CMAma brockhoff 56 (42)5.7e4 (2e4)31 (38)1.2 (0.7)1.1 (0.9)1.1 (0.8)1.1 (0.9)12/15
CMAmah brockhoff 43 (28)6.3e4 (8e4)27 (31)0.86 (0.5)0.77 (0.4)0.77 (0.4)0.77 (0.4)15/15
CMAmh brockhoff 42 (26)7109 (6223)55 (74)1.2 (0.8)1.2 (1)1.2 (0.8)1.2 (1)12/15
DBRCGA chuang 379 (265)1.3e5 (5e4)1396 (1414)1e60/15
DE-AUTO voglis 1579 (2240)4.7e4 (4e4)96 (82)1e60/15
DE-BFGS voglis 665 (492)6773 (6367)10 (12)15 (18)1e60/15
DE-ROLL voglis 801 (1046)2.7e4 (2e4)105 (162)1e60/15
DE-SIMPLEX voglis 1048 (1127)2.6e4 (2e4)42 (47)1e60/15
DEAE posik 219 (54)2.3e6 (2e6)5e50/15
DE posik 387 (218)7.5e6 (6e6)5e50/15
DEb posik 387 (218)7.5e6 (9e6)5e50/15
DEctpb posik 305 (222)3.5e6 (4e6)5e50/15
IPOPsaACM loshchilov 60 (42)1.8e4 (8701)9.3 (8)0.55 (0.3)↑10.49 (0.3)↑10.49 (0.3)↑10.49 (0.3)↑115/15
JADE posik 165 (106)7.8e4 (6e4)679 (954)5e50/15
JADEb posik 174 (106)2.0e5 (1e5)5e50/15
JADEctpb posik 165 (106)7.8e4 (6e4)679 (542)5e50/15
MVDE melo 473 (308)4.8e5 (4e5)1e60/15
NBIPOPaCMA loshchilov 73 (34)8153 (7547)13 (13)0.84 (0.6)0.82 (0.5)0.82 (0.5)0.82 (0.5)15/15
NIPOPaCMA loshchilov 55 (24)8205 (6590)29 (47)1.5 (1)1.5 (1)1.5 (1)1.5 (1)15/15
PSO-BFGS voglis 766 (800)1.3e4 (8284)16 (9)4.8 (5)1e60/15
SNES schaul 47 (20)3.5e4 (7e4)4148 (4030)3e60/15
xNES schaul 40 (23)2.6e5 (3e5)3159 (3543)2e60/15
xNESas schaul 38 (24)4.0e5 (6e5)1440 (1183)5e60/15

Δ fopt
f20, 10-D
1e1
32
1e0
15426
1e-1
5.5e5
1e-2
5.7e5
1e-3
5.7e5
1e-5
5.8e5
1e-7
5.9e5
#succ
15/15
ACOR liao 11 (4)1.6 (2)1.3 (1)1.2 (1)1.2 (1)1.2 (1)1.2 (1)15/15
BIPOPaCMA loshchilov 4.6 (1)3.2 (2)1.2 (0.4)1.2 (0.4)1.2 (0.4)1.2 (0.3)1.2 (0.3)15/15
BIPOPsaACM loshchilov 4.4 (0.6)1.4 (1)1.1 (0.5)1.1 (0.5)1.1 (0.5)1.0 (0.5)1.0 (0.5)15/15
CMAES posik 5.6 (2)22 (21)5e50/15
CMA brockhoff 4.9 (2)2.8 (0.8)0.89 (0.4)0.90 (0.4)0.90 (0.4)0.91 (0.4)0.92 (0.4)15/15
CMAa brockhoff 4.8 (2)1.8 (0.8)0.86 (0.4)0.87 (0.4)0.88 (0.4)0.88 (0.4)0.89 (0.4)15/15
CMAm brockhoff 3.9 (2)3.2 (2)0.88 (0.4)0.89 (0.4)0.90 (0.4)0.90 (0.4)0.91 (0.4)15/15
CMAma brockhoff 4.2 (1)2.1 (0.9)0.77 (0.4)0.78 (0.4)0.78 (0.4)0.79 (0.4)0.79 (0.4)15/15
CMAmah brockhoff 3.0 (0.8)2.5 (1)0.83 (0.4)0.84 (0.4)0.85 (0.4)0.85 (0.4)0.86 (0.4)15/15
CMAmh brockhoff 3.0 (0.7)3.3 (2)0.75 (0.4)0.77 (0.4)0.77 (0.4)0.78 (0.4)0.78 (0.4)15/15
DBRCGA chuang 48 (8)5.8 (6)1e60/15
DE-AUTO voglis 3.2 (0.5)1.6 (1)13 (14)12 (17)12 (18)12 (10)12 (14)2/15
DE-BFGS voglis 4.6 (2)0.43 (0.3)↑01e60/15
DE-ROLL voglis 49 (78)0.57 (0.7)3.0 (4)2.9 (2)2.9 (5)2.8 (4)2.8 (3)7/15
DE-SIMPLEX voglis 11 (6)3.1 (2)1e60/15
DEAE posik 22 (8)7.0 (10)5e50/15
DE posik 26 (11)0.77 (0.3)0.48 (0.5)0.47 (0.7)0.47 (0.6)0.46 (0.5)0.46 (0.4)13/15
DEb posik 26 (11)0.77 (0.3)0.48 (0.7)0.47 (0.5)0.47 (0.6)0.46 (0.5)0.46 (0.4)13/15
DEctpb posik 25 (6)1.9 (0.5)0.14 (0.0)↑00.14 (0.0)↑00.15 (0.0)↑00.15 (0.0)↑00.15 (0.0)↑015/15
IPOPsaACM loshchilov 4.3 (0.7)0.86 (0.4)0.74 (0.4)0.76 (0.5)0.75 (0.5)0.75 (0.4)0.74 (0.4)15/15
JADE posik 14 (6)0.73 (0.2)↑00.16 (0.2)↑00.18 (0.2)↑00.21 (0.2)↑00.29 (0.2)↑00.34 (0.2)↑015/15
JADEb posik 11 (4)0.27 (0.1)↑03.0 (3)2.9 (3)2.9 (3)2.9 (3)2.8 (3)3/15
JADEctpb posik 14 (6)0.73 (0.2)↑00.16 (0.2)↑00.18 (0.2)↑00.21 (0.2)↑00.29 (0.2)↑00.34 (0.2)↑015/15
MVDE melo 50 (13)0.98 (0.4)0.22 (0.0)↑10.22 (0.0)↑10.23 (0.0)↑10.24 (0.0)↑10.25 (0.0)↑114/15
NBIPOPaCMA loshchilov 4.9 (2)3.1 (2)1.3 (0.5)1.3 (0.5)1.3 (0.5)1.3 (0.5)1.3 (0.5)15/15
NIPOPaCMA loshchilov 4.5 (1)2.6 (1)0.77 (0.4)0.78 (0.4)0.78 (0.4)0.79 (0.4)0.80 (0.4)15/15
PSO-BFGS voglis 4.2 (2)1.0 (0.8)26 (44)25 (19)25 (17)25 (22)24 (28)1/15
SNES schaul 3.1 (0.8)7.2 (6)3e60/15
xNES schaul 3.6 (2)1.1 (1)2e60/15
xNESas schaul 3.4 (2)2.1 (3)106 (110)102 (119)102 (109)100 (92)99 (140)1/15

Δ fopt
f21, 10-D
1e1
130
1e0
2236
1e-1
4392
1e-2
4487
1e-3
4618
1e-5
5074
1e-7
11329
#succ
15/15
ACOR liao 36 (4)1457 (2283)1746 (2717)1709 (1989)1661 (1884)1512 (1606)677 (834)10/15
BIPOPaCMA loshchilov 2.7 (0.7)5.9 (12)14 (15)13 (15)13 (14)12 (13)5.4 (6)15/15
BIPOPsaACM loshchilov 2.5 (4)2.3 (2)1.5 (2)1.5 (2)1.5 (2)1.4 (2)0.61 (0.7)15/15
CMAES posik 7.0 (20)6.4 (6)6.0 (9)5.9 (8)5.7 (8)5.2 (7)2.4 (3)15/15
CMA brockhoff 6.8 (12)21 (25)11 (13)11 (13)11 (13)11 (12)4.9 (5)15/15
CMAa brockhoff 2.8 (0.7)53 (157)30 (76)29 (76)29 (75)26 (67)12 (30)13/15
CMAm brockhoff 2.5 (1)50 (138)46 (73)45 (76)44 (71)40 (65)18 (30)12/15
CMAma brockhoff 5.7 (9)89 (147)47 (109)46 (72)45 (70)41 (64)19 (41)12/15
CMAmah brockhoff 2.4 (5)71 (146)63 (122)62 (159)60 (81)55 (98)25 (33)11/15
CMAmh brockhoff 2.3 (5)108 (151)67 (115)66 (79)65 (77)59 (66)27 (58)11/15
DBRCGA chuang 18 (8)40 (68)47 (56)46 (54)46 (53)42 (48)20 (21)14/15
DE-AUTO voglis 4.4 (7)28 (49)32 (36)32 (35)31 (34)28 (31)13 (14)15/15
DE-BFGS voglis 2.6 (2)7.6 (10)8.8 (18)8.7 (18)8.4 (18)7.7 (16)32 (51)4/15
DE-ROLL voglis 22 (31)53 (86)48 (92)47 (90)45 (87)41 (80)18 (36)15/15
DE-SIMPLEX voglis 16 (23)83 (156)83 (96)81 (94)79 (92)72 (83)32 (37)14/15
DEAE posik 14 (9)13 (15)10 (11)10 (11)10 (11)9.3 (10)4.2 (4)15/15
DE posik 24 (15)17 (22)10 (11)10 (11)10 (11)10 (10)4.6 (4)15/15
DEb posik 24 (15)17 (22)10 (11)10 (11)10 (11)10 (10)4.6 (4)15/15
DEctpb posik 21 (9)43 (113)23 (57)23 (56)22 (89)21 (50)10 (22)13/15
IPOPsaACM loshchilov 2.5 (4)15 (23)48 (109)47 (107)46 (104)42 (95)19 (43)15/15
JADE posik 7.7 (3)6.0 (6)3.6 (3)4.5 (5)5.0 (5)6.3 (7)3.7 (4)15/15
JADEb posik 23 (45)25 (31)18 (18)18 (18)18 (18)16 (16)7.4 (7)15/15
JADEctpb posik 7.7 (3)6.0 (6)3.6 (3)4.5 (5)5.0 (5)6.3 (7)3.7 (4)15/15
MVDE melo 21 (9)8.9 (8)6.5 (4)10 (7)13 (9)19 (13)12 (7)15/15
NBIPOPaCMA loshchilov 5.6 (11)11 (16)10 (11)10 (10)9.3 (10)8.5 (9)3.8 (4)15/15
NIPOPaCMA loshchilov 6.1 (10)99 (140)71 (75)70 (74)68 (72)62 (65)28 (29)15/15
PSO-BFGS voglis 2.6 (2)2.2 (3)2.1 (3)2.1 (3)2.1 (3)1.9 (3)26 (44)7/15
SNES schaul 116 (230)82 (94)77 (117)75 (115)73 (111)67 (101)30 (45)15/15
xNES schaul 125 (230)66 (58)94 (146)92 (143)89 (139)81 (126)37 (57)14/15
xNESas schaul 84 (155)69 (85)58 (59)56 (58)55 (56)50 (51)22 (23)15/15

Δ fopt
f22, 10-D
1e1
98
1e0
2839
1e-1
6353
1e-2
6620
1e-3
6798
1e-5
8296
1e-7
10351
#succ
15/15
ACOR liao 9749 (3e4)5191 (5568)1.1e4 (9444)1.0e4 (1e4)1.0e4 (9863)8352 (8932)6694 (4545)2/15
BIPOPaCMA loshchilov 29 (34)6.4 (9)143 (202)137 (194)133 (189)109 (155)88 (124)15/15
BIPOPsaACM loshchilov 13 (13)3.7 (6)32 (18)31 (17)30 (17)25 (14)20 (11)15/15
CMAES posik 21 (29)12 (12)56 (67)54 (64)53 (56)43 (50)35 (37)11/15
CMA brockhoff 6.4 (15)157 (231)1357 (1540)1302 (1964)1268 (1137)1039 (1232)833 (676)1/15
CMAa brockhoff 10 (15)127 (143)1359 (1171)1304 (1929)1270 (1246)1041 (1110)834 (522)1/15
CMAm brockhoff 14 (14)210 (274)6e50/15
CMAma brockhoff 26 (53)153 (215)1365 (1283)1310 (1950)1276 (1234)1045 (1096)838 (880)1/15
CMAmah brockhoff 6.8 (18)246 (431)6e50/15
CMAmh brockhoff 17 (36)194 (220)6e50/15
DBRCGA chuang 27 (16)38 (41)62 (105)61 (76)60 (90)52 (63)43 (48)13/15
DE-AUTO voglis 143 (286)81 (104)206 (199)198 (156)193 (332)158 (270)127 (151)5/15
DE-BFGS voglis 4.2 (6)12 (17)26 (28)25 (27)24 (27)20 (22)121 (123)0/15
DE-ROLL voglis 34 (84)44 (62)140 (157)134 (276)132 (134)109 (84)127 (124)5/15
DE-SIMPLEX voglis 95 (316)65 (137)90 (136)87 (99)85 (111)70 (89)69 (77)10/15
DEAE posik 35 (84)19 (17)29 (39)28 (40)27 (38)23 (30)18 (27)13/15
DE posik 68 (19)45 (62)50 (54)54 (58)53 (49)46 (39)39 (31)11/15
DEb posik 68 (19)45 (62)50 (53)54 (79)53 (54)46 (37)39 (52)11/15
DEctpb posik 30 (28)128 (176)235 (363)229 (237)225 (275)187 (160)152 (314)4/15
IPOPsaACM loshchilov 119 (46)175 (219)1652 (2173)1585 (1778)1544 (1680)1265 (1518)1014 (1401)9/15
JADE posik 22 (4)68 (94)111 (108)115 (125)117 (145)144 (103)147 (198)4/15
JADEb posik 66 (146)11 (13)33 (39)32 (39)32 (38)26 (31)21 (33)13/15
JADEctpb posik 22 (4)68 (111)111 (116)115 (113)117 (99)144 (193)147 (221)4/15
MVDE melo 33 (17)141 (193)253 (363)259 (227)270 (339)869 (1043)1e60/15
NBIPOPaCMA loshchilov 38 (35)17 (13)34 (16)32 (16)31 (15)26 (12)21 (10)15/15
NIPOPaCMA loshchilov 81 (201)61 (114)131 (147)126 (141)123 (137)101 (112)81 (90)15/15
PSO-BFGS voglis 5.2 (5)1.8 (2)3.0 (4)2.9 (4)2.8 (4)2.3 (3)93 (116)0/15
SNES schaul 307 (307)87 (108)93 (113)90 (108)89 (103)96 (120)105 (89)14/15
xNES schaul 125 (155)105 (190)131 (163)126 (157)123 (147)101 (125)81 (95)13/15
xNESas schaul 70 (204)53 (70)84 (124)81 (119)79 (116)65 (95)52 (76)15/15

Δ fopt
f23, 10-D
1e1
3.0
1e0
915
1e-1
16425
1e-2
1.8e5
1e-3
2.0e5
1e-5
2.1e5
1e-7
2.1e5
#succ
15/15
ACOR liao 2.3 (2)1656 (2613)1e70/15
BIPOPaCMA loshchilov 2.5 (3)20 (13)1.8 (2)1.4 (2)1.4 (1)1.4 (1)1.4 (1)15/15
BIPOPsaACM loshchilov 4.6 (4)19 (15)1.8 (1)0.45 (0.3)↑00.55 (0.3)↑10.65 (0.4)0.92 (0.3)15/15
CMAES posik 2.7 (2)44 (44)22 (26)5e50/15
CMA brockhoff 1.7 (2)548 (489)2e60/15
CMAa brockhoff 2.6 (2)277 (305)727 (1013)2e60/15
CMAm brockhoff 1.1 (0.7)243 (343)734 (896)2e60/15
CMAma brockhoff 2.7 (2)67 (90)224 (345)137 (150)124 (149)120 (149)118 (186)1/15
CMAmah brockhoff 3.7 (4)136 (266)459 (480)142 (210)129 (150)125 (142)123 (179)1/15
CMAmh brockhoff 3.0 (2)423 (667)1455 (2122)2e60/15
DBRCGA chuang 1.7 (2)105 (121)1e60/15
DE-AUTO voglis 1.1 (0.8)2.4 (2)12 (13)38 (34)1e60/15
DE-BFGS voglis 1.7 (2)3.6 (6)52 (63)1e60/15
DE-ROLL voglis 1.4 (1)5.7 (7)1e60/15
DE-SIMPLEX voglis 1.7 (2)0.57 (0.6)7.0 (6)1e60/15
DEAE posik 1.9 (2)529 (408)5e50/15
DE posik 2.3 (1)1384 (1791)5e50/15
DEb posik 2.3 (1)1384 (1861)5e50/15
DEctpb posik 1.2 (1)473 (651)5e50/15
IPOPsaACM loshchilov 2.3 (3)199 (326)429 (406)126 (189)114 (208)111 (169)108 (128)5/15
JADE posik 1.4 (1)89 (93)137 (167)5e50/15
JADEb posik 1.8 (2)169 (135)5e50/15
JADEctpb posik 1.4 (1)89 (93)137 (124)5e50/15
MVDE melo 1.9 (2)163 (280)1e60/15
NBIPOPaCMA loshchilov 2.2 (2)18 (19)2.9 (2)1.2 (1.0)1.5 (1)1.5 (1.0)1.5 (1.0)15/15
NIPOPaCMA loshchilov 2.6 (2)88 (109)8.4 (8)1.2 (0.7)1.1 (0.7)1.2 (0.7)1.2 (0.7)15/15
PSO-BFGS voglis 1.6 (2)3.0 (4)22 (16)1e60/15
SNES schaul 1.2 (1)60 (59)113 (105)3e60/15
xNES schaul 1.6 (2)933 (1037)2e60/15
xNESas schaul 1.3 (1)594 (669)5e60/15

Δ fopt
f24, 10-D
1e1
98761
1e0
1.0e6
1e-1
7.5e7
1e-2
7.5e7
1e-3
7.5e7
1e-5
7.5e7
1e-7
7.5e7
#succ
1/15
ACOR liao 1e70/15
BIPOPaCMA loshchilov 0.98 (1)2.2 (2)0.93 (0.9)0.93 (0.7)0.93 (1)0.93 (1)0.93 (0.8)2/15
BIPOPsaACM loshchilov 1.3 (2)1.6 (2)0.61 (0.5)2.0 (3)2.0 (1)2.0 (2)2.0 (2)1/15
CMAES posik 0.95 (1)5e50/15
CMA brockhoff 41 (41)27 (26)2e60/15
CMAa brockhoff 18 (21)13 (8)2e60/15
CMAm brockhoff 18 (31)5.5 (9)2e60/15
CMAma brockhoff 27 (23)5.8 (7)0.39 (0.3)0.39 (0.5)0.39 (0.4)0.39 (0.6)0.39 (0.3)1/15
CMAmah brockhoff 56 (76)27 (26)2e60/15
CMAmh brockhoff 82 (102)13 (15)2e60/15
DBRCGA chuang 32 (41)1e60/15
DE-AUTO voglis 143 (208)1e60/15
DE-BFGS voglis 142 (124)1e60/15
DE-ROLL voglis 41 (46)6.9 (6)1e60/15
DE-SIMPLEX voglis 21 (26)6.8 (6)1e60/15
DEAE posik 5e50/15
DE posik 5e50/15
DEb posik 5e50/15
DEctpb posik 5e50/15
IPOPsaACM loshchilov 72 (94)17 (16)1e70/15
JADE posik 34 (57)5e50/15
JADEb posik 21 (27)5e50/15
JADEctpb posik 34 (37)5e50/15
MVDE melo 1e60/15
NBIPOPaCMA loshchilov 0.90 (0.8)1.2 (2)0.58 (0.9)0.59 (0.6)0.59 (0.8)0.59 (0.7)0.59 (0.7)3/15
NIPOPaCMA loshchilov 6.8 (14)1.0 (2)0.23 (0.3)0.31 (0.4)0.31 (0.3)0.31 (0.5)0.31 (0.3)5/15
PSO-BFGS voglis 8.4 (13)7.0 (10)1e60/15
SNES schaul 1.4 (2)3e60/15
xNES schaul 336 (328)2e60/15
xNESas schaul 731 (494)5e60/15

Previous dimension | Dimension = 20 | Next dimension

Δ fopt
f1, 20-D
1e1
43
1e0
43
1e-1
43
1e-2
43
1e-3
43
1e-5
43
1e-7
43
#succ
15/15
ACOR liao 24 (5)43 (8)60 (8)77 (8)95 (9)129 (10)164 (8)15/15
BIPOPaCMA loshchilov 7.5 (2)14 (2)20 (2)27 (2)33 (2)46 (4)59 (4)15/15
BIPOPsaACM loshchilov 4.0 (0.2)5.1 (0.4)6.6 (0.7)7.9 (0.6)10 (0.7)13 (0.8)16 (1)15/15
CMAES posik 7.5 (2)13 (2)20 (2)26 (2)33 (2)45 (3)58 (4)15/15
CMA brockhoff 7.3 (1)13 (1)19 (1)25 (2)32 (2)43 (2)56 (2)15/15
CMAa brockhoff 7.8 (1)14 (2)20 (2)26 (2)32 (2)45 (3)58 (3)15/15
CMAm brockhoff 6.1 (1)10 (1)14 (2)19 (0.6)23 (1)32 (1)41 (2)15/15
CMAma brockhoff 5.8 (0.8)10 (1.0)14 (1)19 (1)23 (1)32 (1)41 (2)15/15
CMAmah brockhoff 3.8 (0.8)6.6 (0.9)10 (1)13 (1)15 (1)21 (1)27 (1)15/15
CMAmh brockhoff 3.8 (0.6)6.7 (0.7)10 (1)13 (1)15 (1)22 (2)28 (2)15/15
DBRCGA chuang 142 (31)304 (46)485 (63)634 (103)799 (93)1119 (109)1449 (135)15/15
DE-AUTO voglis 3.1 (0.1)3.1 (0.1)3.1 (0.1)3.1 (0.1)3.1 (0.1)3.1 (0.1)3.1 (0.1)15/15
DE-BFGS voglis 2.0 (0.2)2.2 (0)2.2 (0)2.2 (0)2.2 (0)2.2 (0)2.2 (0)15/15
DE-ROLL voglis 6.4 (7)36 (35)37 (36)38 (35)38 (36)38 (36)38 (36)15/15
DE-SIMPLEX voglis 71 (41)181 (83)237 (92)312 (118)389 (99)461 (117)840 (800)15/15
DEAE posik 75 (22)144 (28)214 (24)278 (29)352 (32)492 (42)635 (42)15/15
DE posik 89 (17)162 (31)241 (28)321 (27)400 (27)558 (30)717 (39)15/15
DEb posik 89 (17)162 (31)241 (28)321 (27)400 (27)558 (30)717 (39)15/15
DEctpb posik 91 (14)181 (15)269 (21)354 (19)440 (21)615 (20)803 (34)15/15
IPOPsaACM loshchilov 3.9 (0.2)5.0 (0.4)6.5 (0.5)7.8 (0.5)9.5 (0.7)13 (0.7)16 (0.8)15/15
JADE posik 47 (7)94 (8)143 (8)191 (7)240 (8)340 (10)437 (13)15/15
JADEb posik 35 (3)67 (4)102 (5)141 (9)179 (13)260 (14)346 (17)15/15
JADEctpb posik 47 (7)94 (8)143 (8)191 (7)240 (8)340 (10)437 (13)15/15
MVDE melo 144 (16)299 (10)445 (13)601 (15)743 (10)1048 (21)1355 (25)15/15
NBIPOPaCMA loshchilov 7.9 (1)14 (1)20 (1)27 (2)33 (2)46 (2)59 (3)15/15
NIPOPaCMA loshchilov 7.7 (2)14 (1)20 (2)26 (2)33 (2)45 (2)58 (3)15/15
PSO-BFGS voglis 1.9 (0.2)2.2 (0)2.2 (0)2.2 (0)2.2 (0)2.2 (0)2.2 (0)15/15
SNES schaul 5.4 (0.8)14 (1)25 (3)36 (3)45 (2)66 (2)86 (2)15/15
xNES schaul 5.8 (3)70 (5)137 (6)203 (8)274 (5)410 (7)546 (9)15/15
xNESas schaul 7.3 (2)41 (9)61 (16)74 (19)88 (23)110 (25)128 (32)15/15

Δ fopt
f2, 20-D
1e1
385
1e0
386
1e-1
387
1e-2
388
1e-3
390
1e-5
391
1e-7
393
#succ
15/15
ACOR liao 10 (0.9)12 (0.7)14 (0.5)15 (0.7)17 (1)21 (0.9)25 (0.9)15/15
BIPOPaCMA loshchilov 23 (4)27 (3)29 (3)30 (2)31 (2)33 (1)34 (1)15/15
BIPOPsaACM loshchilov 6.8 (1)8.0 (1)8.9 (1)9.2 (1)10 (1)10 (1)10 (1)15/15
CMAES posik 36 (4)43 (3)45 (2)47 (2)47 (1)48 (1)50 (1)15/15
CMA brockhoff 34 (5)40 (6)43 (3)44 (3)45 (3)47 (1)48 (1)15/15
CMAa brockhoff 23 (3)27 (3)29 (3)30 (2)31 (2)33 (2)34 (2)15/15
CMAm brockhoff 34 (6)39 (6)42 (5)45 (3)45 (2)47 (2)48 (2)15/15
CMAma brockhoff 22 (4)25 (3)27 (2)29 (2)29 (2)31 (1)32 (1)15/15
CMAmah brockhoff 23 (5)26 (4)28 (2)29 (2)30 (1)31 (1)32 (1)15/15
CMAmh brockhoff 32 (5)36 (4)38 (2)39 (2)40 (2)41 (2)41 (2)15/15
DBRCGA chuang 75 (6)93 (7)113 (8)130 (8)147 (10)183 (9)220 (9)15/15
DE-AUTO voglis 3.5 (2)3.9 (2)4.3 (2)4.4 (2)4.7 (2)5.1 (2)5.7 (3)15/15
DE-BFGS voglis 5.7 (4)6.1 (4)6.2 (4)6.4 (4)6.5 (4)7.1 (5)10 (5)15/15
DE-ROLL voglis 15 (12)16 (12)16 (12)16 (12)16 (12)17 (12)17 (12)15/15
DE-SIMPLEX voglis 90 (20)104 (16)120 (23)126 (24)135 (24)149 (23)287 (246)15/15
DEAE posik 52 (6)61 (6)69 (7)77 (6)84 (7)101 (6)116 (7)15/15
DE posik 41 (3)50 (3)59 (3)67 (4)76 (5)93 (5)110 (5)15/15
DEb posik 41 (3)50 (3)59 (3)67 (4)76 (5)93 (5)110 (5)15/15
DEctpb posik 47 (2)56 (3)66 (3)76 (3)85 (4)105 (4)125 (5)15/15
IPOPsaACM loshchilov 7.3 (1)8.3 (2)8.9 (2)9.2 (2)9.5 (2)10 (1)10 (1)15/15
JADE posik 28 (1)34 (1)39 (2)44 (2)50 (2)61 (3)71 (4)15/15
JADEb posik 20 (2)25 (2)29 (2)34 (2)39 (2)48 (3)57 (4)15/15
JADEctpb posik 28 (1)34 (1)39 (2)44 (2)50 (2)61 (3)71 (4)15/15
MVDE melo 76 (2)92 (2)108 (3)125 (3)141 (2)174 (3)206 (4)15/15
NBIPOPaCMA loshchilov 23 (4)27 (3)29 (2)31 (1)32 (2)33 (2)34 (2)15/15
NIPOPaCMA loshchilov 23 (3)26 (3)29 (2)30 (1)31 (2)33 (2)34 (2)15/15
PSO-BFGS voglis 5.2 (3)5.4 (3)5.6 (3)6.3 (5)6.7 (5)7.6 (5)12 (12)15/15
SNES schaul 4.8 (0.3)5.9 (0.2)7.0 (0.3)8.1 (0.2)9.2 (0.3)11 (0.3)14 (0.4)15/15
xNES schaul 29 (0.7)36 (0.7)43 (0.9)51 (1)58 (1)72 (0.8)87 (1)15/15
xNESas schaul 26 (1)31 (2)34 (3)36 (3)38 (4)41 (6)43 (6)15/15

Δ fopt
f3, 20-D
1e1
5066
1e0
7626
1e-1
7635
1e-2
7637
1e-3
7643
1e-5
7646
1e-7
7651
#succ
15/15
ACOR liao 1018 (1271)1e70/15
BIPOPaCMA loshchilov 9.0 (5)1.7e4 (1e4)2e70/15
BIPOPsaACM loshchilov 10 (7)2e70/5
CMAES posik 638 (562)1e60/15
CMA brockhoff 13 (9)3e60/15
CMAa brockhoff 8.7 (7)3e60/15
CMAm brockhoff 8.5 (6)3e60/15
CMAma brockhoff 7.1 (3)3e60/15
CMAmah brockhoff 13 (7)4956 (3878)4950 (6742)4949 (4601)4945 (6472)4943 (6323)4940 (4882)1/15
CMAmh brockhoff 13 (16)3e60/15
DBRCGA chuang 144 (64)450 (268)1181 (795)1181 (1449)1180 (859)1181 (1619)1182 (1325)3/15
DE-AUTO voglis 47 (49)224 (177)401 (351)401 (457)401 (282)401 (414)401 (285)8/15
DE-BFGS voglis 56 (24)132 (68)181 (141)181 (149)181 (168)181 (145)191 (128)13/15
DE-ROLL voglis 15 (11)55 (30)82 (65)82 (65)82 (65)82 (65)82 (65)15/15
DE-SIMPLEX voglis 119 (44)212 (130)355 (167)355 (345)355 (368)355 (355)484 (543)4/15
DEAE posik 1e60/15
DE posik 39 (10)67 (49)167 (163)167 (114)168 (150)168 (123)169 (207)9/15
DEb posik 39 (10)67 (49)167 (150)167 (169)168 (130)168 (140)169 (223)9/15
DEctpb posik 114 (10)94 (8)95 (7)96 (7)96 (7)97 (7)98 (7)15/15
IPOPsaACM loshchilov 11 (15)2e70/5
JADE posik 6.4 (0.3)6.0 (0.2)6.8 (0.2)7.6 (0.2)8.3 (0.2)10 (0.2)11 (0.2)15/15
JADEb posik 6.3 (0.3)13 (13)17 (20)17 (20)18 (20)19 (20)20 (20)15/15
JADEctpb posik 6.4 (0.3)6.0 (0.2)6.8 (0.2)7.6 (0.2)8.3 (0.2)10 (0.2)11 (0.2)15/15
MVDE melo 28 (2)23 (3)33 (3)34 (3)35 (3)36 (3)38 (3)14/15
NBIPOPaCMA loshchilov 12 (8)2e70/15
NIPOPaCMA loshchilov 9.4 (6)2e70/15
PSO-BFGS voglis 2e60/15
SNES schaul 550 (526)7e60/15
xNES schaul 629 (911)7e60/15
xNESas schaul 1055 (1447)1e70/15

Δ fopt
f4, 20-D
1e1
4722
1e0
7628
1e-1
7666
1e-2
7686
1e-3
7700
1e-5
7758
1e-7
1.4e5
#succ
9/15
ACOR liao 1.5e4 (2e4)1e70/15
BIPOPaCMA loshchilov 3.0e4 (2e4)2e70/15
BIPOPsaACM loshchilov 2e70/5
CMAES posik 1e60/15
CMA brockhoff 3e60/15
CMAa brockhoff 3e60/15
CMAm brockhoff 3e60/15
CMAma brockhoff 3e60/15
CMAmah brockhoff 2e60/15
CMAmh brockhoff 2e60/15
DBRCGA chuang 236 (100)2e60/15
DE-AUTO voglis 67 (50)1265 (1437)3887 (3396)3877 (2996)3870 (4030)3841 (4710)211 (259)1/15
DE-BFGS voglis 143 (83)589 (845)3893 (3984)3883 (4299)3876 (5071)3848 (3614)212 (355)1/15
DE-ROLL voglis 26 (19)165 (86)407 (358)406 (357)406 (289)403 (420)22 (19)8/15
DE-SIMPLEX voglis 172 (76)388 (268)3910 (4505)3900 (3712)3893 (3055)3867 (4774)2e60/15
DEAE posik 1e60/15
DE posik 30 (9)1e60/15
DEb posik 30 (9)1e60/15
DEctpb posik 144 (19)119 (14)311 (228)311 (327)311 (229)310 (292)17 (21)6/15
IPOPsaACM loshchilov 1.9e4 (2e4)2e70/5
JADE posik 8.0 (0.4)7.0 (0.3)8.0 (0.2)8.8 (0.2)10 (0.2)11 (0.3)0.71 (0.0)↑015/15
JADEb posik 17 (11)102 (122)265 (198)265 (305)265 (297)264 (295)15 (16)6/15
JADEctpb posik 8.0 (0.4)7.0 (0.3)8.0 (0.2)8.8 (0.2)10 (0.2)11 (0.3)0.71 (0.0)↑015/15
MVDE melo 28 (4)71 (68)869 (945)867 (1073)867 (1071)862 (999)48 (53)2/15
NBIPOPaCMA loshchilov 6.1e4 (6e4)2e70/15
NIPOPaCMA loshchilov 2e70/15
PSO-BFGS voglis 2e60/15
SNES schaul 4049 (5965)7e60/15
xNES schaul 6323 (8253)7e60/15
xNESas schaul 4192 (4564)1e70/15

Δ fopt
f5, 20-D
1e1
41
1e0
41
1e-1
41
1e-2
41
1e-3
41
1e-5
41
1e-7
41
#succ
15/15
ACOR liao 10 (3)12 (4)12 (4)12 (4)12 (4)12 (4)12 (4)15/15
BIPOPaCMA loshchilov 5.5 (0.9)6.5 (0.8)6.6 (0.9)6.7 (0.9)6.7 (0.9)6.7 (0.9)6.7 (0.9)15/15
BIPOPsaACM loshchilov 4.6 (0.6)5.3 (0.7)5.4 (0.7)5.4 (0.7)5.4 (0.7)5.4 (0.7)5.4 (0.7)15/15
CMAES posik 5.1 (1.0)6.1 (0.9)6.1 (0.9)6.1 (0.9)6.1 (0.9)6.1 (0.9)6.1 (0.9)15/15
CMA brockhoff 4.9 (1)5.6 (0.9)5.8 (1)5.8 (1)5.8 (1)5.8 (1)5.8 (1)15/15
CMAa brockhoff 5.4 (1)6.4 (2)6.6 (2)6.6 (2)6.6 (2)6.6 (2)6.6 (2)15/15
CMAm brockhoff 4.4 (1)5.3 (1)5.4 (1)5.5 (1)5.5 (1)5.5 (1)5.5 (1)15/15
CMAma brockhoff 4.6 (1)5.2 (2)5.3 (1)5.3 (1)5.3 (1)5.3 (1)5.3 (1)15/15
CMAmah brockhoff 3.0 (0.6)4.0 (1)4.0 (1)4.0 (1)4.0 (1)4.0 (1)4.0 (1)15/15
CMAmh brockhoff 3.2 (1)3.7 (1)3.7 (1)3.7 (1)3.7 (1)3.7 (1)3.7 (1)15/15
DBRCGA chuang 150 (38)211 (83)226 (105)230 (110)231 (111)231 (111)231 (111)15/15
DE-AUTO voglis 3.1 (0.1)3.1 (0.1)3.1 (0.1)3.1 (0.1)3.1 (0.1)3.1 (0.1)3.1 (0.1)15/15
DE-BFGS voglis 14 (7)22 (14)23 (16)24 (16)24 (16)25 (19)26 (19)15/15
DE-ROLL voglis 3.7 (0.6)3.9 (0.9)3.9 (0.9)3.9 (0.9)3.9 (0.9)3.9 (0.9)3.9 (0.9)15/15
DE-SIMPLEX voglis 572 (125)860 (179)1423 (331)1832 (407)2124 (449)2727 (758)2.9e4 (3e4)8/15
DEAE posik 28 (7)32 (6)33 (7)33 (7)33 (7)33 (7)33 (7)15/15
DE posik 27 (6)35 (4)36 (6)36 (6)36 (6)36 (6)36 (6)15/15
DEb posik 27 (6)35 (4)36 (6)36 (6)36 (6)36 (6)36 (6)15/15
DEctpb posik 37 (7)43 (4)46 (9)46 (10)46 (10)46 (10)46 (10)15/15
IPOPsaACM loshchilov 4.5 (0.7)5.0 (0.7)5.2 (0.7)5.2 (0.7)5.2 (0.7)5.2 (0.7)5.2 (0.7)15/15
JADE posik 43 (9)52 (7)53 (8)53 (8)53 (8)53 (8)53 (8)15/15
JADEb posik 27 (8)35 (7)36 (8)36 (8)36 (8)36 (8)36 (8)15/15
JADEctpb posik 43 (9)52 (7)53 (8)53 (8)53 (8)53 (8)53 (8)15/15
MVDE melo 210 (18)304 (31)375 (42)422 (57)445 (85)457 (95)458 (95)15/15
NBIPOPaCMA loshchilov 5.1 (1)6.0 (1)6.2 (1)6.2 (1)6.2 (1)6.2 (1)6.2 (1)15/15
NIPOPaCMA loshchilov 5.5 (1)6.3 (1)6.5 (1)6.5 (1)6.5 (1)6.5 (1)6.5 (1)15/15
PSO-BFGS voglis 22 (16)30 (32)31 (32)31 (32)32 (35)32 (35)32 (35)15/15
SNES schaul 9.3 (2)12 (2)12 (3)12 (3)12 (3)12 (3)12 (3)15/15
xNES schaul 10 (1)11 (1)12 (1)12 (1)12 (1)12 (1)12 (1)15/15
xNESas schaul 8.5 (1)10 (1)11 (2)11 (2)11 (2)11 (2)11 (2)15/15

Δ fopt
f6, 20-D
1e1
1296
1e0
2343
1e-1
3413
1e-2
4255
1e-3
5220
1e-5
6728
1e-7
8409
#succ
15/15
ACOR liao 6.5 (2)5.3 (1)4.8 (0.9)4.8 (0.7)4.7 (0.6)4.8 (0.6)4.9 (0.6)15/15
BIPOPaCMA loshchilov 1.5 (0.2)1.2 (0.1)1.1 (0.1)1.1 (0.1)1.1 (0.1)1.1 (0.1)1.1 (0.1)15/15
BIPOPsaACM loshchilov 1.4 (0.3)1.2 (0.2)1.1 (0.2)1.1 (0.1)1.1 (0.2)1.3 (0.3)1.4 (0.3)15/15
CMAES posik 1.7 (0.5)1.3 (0.3)1.2 (0.3)1.2 (0.2)1.2 (0.1)1.2 (0.2)1.2 (0.1)15/15
CMA brockhoff 1.7 (0.2)1.3 (0.2)1.2 (0.1)1.2 (0.1)1.2 (0.1)1.2 (0.1)1.2 (0.1)15/15
CMAa brockhoff 1.6 (0.3)1.3 (0.2)1.1 (0.1)1.1 (0.1)1.1 (0.1)1.1 (0.1)1.1 (0.1)15/15
CMAm brockhoff 1.7 (0.3)1.3 (0.2)1.2 (0.1)1.2 (0.1)1.2 (0.2)1.2 (0.2)1.3 (0.1)15/15
CMAma brockhoff 1.5 (0.3)1.2 (0.1)1.0 (0.1)1.0 (0.1)1.0 (0.1)1.1 (0.1)1.1 (0.1)15/15
CMAmah brockhoff 1.2 (0.3)1.1 (0.2)1.0 (0.2)1.1 (0.3)1.1 (0.3)1.2 (0.3)1.3 (0.3)15/15
CMAmh brockhoff 1.2 (0.4)1.1 (0.3)1.1 (0.3)1.2 (0.4)1.3 (0.4)1.8 (0.5)2.3 (1)15/15
DBRCGA chuang 26 (11)55 (8)46 (9)45 (8)43 (8)43 (10)43 (11)15/15
DE-AUTO voglis 1.9 (0.7)2.2 (2)4.3 (3)8.0 (6)12 (3)16 (3)71 (126)10/15
DE-BFGS voglis 6.8 (5)8.5 (6)17 (16)25 (25)32 (36)96 (162)295 (443)2/15
DE-ROLL voglis 21 (7)23 (35)23 (24)34 (24)69 (35)209 (194)1025 (680)1/15
DE-SIMPLEX voglis 34 (13)34 (10)42 (23)58 (47)102 (61)329 (185)2e60/15
DEAE posik 21 (5)18 (3)16 (2)17 (2)16 (2)17 (1)17 (1)15/15
DE posik 53 (9)46 (7)46 (8)49 (10)51 (9)57 (11)61 (12)15/15
DEb posik 53 (9)46 (7)46 (8)49 (10)51 (9)57 (11)61 (12)15/15
DEctpb posik 29 (3)23 (2)21 (2)21 (1)21 (1)21 (1)21 (1)15/15
IPOPsaACM loshchilov 1.5 (0.4)1.2 (0.3)1.1 (0.2)1.1 (0.2)1.1 (0.2)1.2 (0.2)1.3 (0.3)15/15
JADE posik 9.4 (0.7)7.8 (0.8)7.3 (0.7)7.4 (0.8)7.2 (0.9)7.4 (0.9)7.4 (0.9)15/15
JADEb posik 25 (13)72 (53)361 (420)3465 (4172)1e60/15
JADEctpb posik 9.4 (0.7)7.8 (0.8)7.3 (0.7)7.4 (0.8)7.2 (0.9)7.4 (0.9)7.4 (0.9)15/15
MVDE melo 37 (7)35 (8)35 (7)36 (7)37 (7)40 (9)43 (10)15/15
NBIPOPaCMA loshchilov 1.5 (0.3)1.2 (0.2)1.1 (0.1)1.1 (0.1)1.1 (0.1)1.1 (0.1)1.1 (0.1)15/15
NIPOPaCMA loshchilov 1.5 (0.2)1.2 (0.1)1.1 (0.1)1.1 (0.1)1.1 (0.1)1.1 (0.1)1.1 (0.1)15/15
PSO-BFGS voglis 9.4 (8)20 (18)40 (52)117 (183)148 (193)198 (161)352 (458)0/15
SNES schaul 1.3 (0.2)1.2 (0.2)1.2 (0.2)1.4 (0.6)35 (57)137 (396)445 (500)11/15
xNES schaul 4.9 (0.3)4.8 (0.2)4.7 (0.2)4.9 (0.2)5.0 (0.1)5.3 (0.1)5.4 (0.1)15/15
xNESas schaul 4.7 (0.2)4.6 (0.2)4.5 (0.1)4.8 (0.1)4.8 (0.1)5.2 (0.1)5.3 (0.1)15/15

Δ fopt
f7, 20-D
1e1
1351
1e0
4274
1e-1
9503
1e-2
16523
1e-3
16524
1e-5
16524
1e-7
16969
#succ
15/15
ACOR liao 76 (36)3.5e4 (4e4)1e70/15
BIPOPaCMA loshchilov 1.3 (1)2.9 (2)2.3 (1)1.5 (0.6)1.5 (0.6)1.5 (0.6)1.4 (0.6)15/15
BIPOPsaACM loshchilov 1.0 (0.9)1.6 (0.6)0.84 (0.3)↑10.61 (0.1)↑10.61 (0.1)↑10.61 (0.1)↑10.60 (0.1)↑115/15
CMAES posik 1.5 (1)191 (242)754 (816)1e60/15
CMA brockhoff 1.7 (1)3.9 (1)2.7 (2)1.7 (1.0)1.7 (1.0)1.7 (1.0)1.6 (0.9)15/15
CMAa brockhoff 1.0 (1.0)2.3 (1.0)1.7 (0.7)1.1 (0.4)1.1 (0.4)1.1 (0.4)1.0 (0.4)15/15
CMAm brockhoff 1.7 (1)4.2 (2)2.7 (1.0)1.7 (0.6)1.7 (0.6)1.7 (0.6)1.6 (0.6)15/15
CMAma brockhoff 1.6 (1)2.7 (1)1.8 (0.7)1.1 (0.4)1.1 (0.4)1.1 (0.4)1.1 (0.4)15/15
CMAmah brockhoff 1.7 (1)2.4 (0.7)1.5 (0.6)0.95 (0.3)0.95 (0.3)0.95 (0.3)0.93 (0.3)15/15
CMAmh brockhoff 2.9 (1)4.4 (1)2.6 (1)1.6 (0.6)1.6 (0.6)1.6 (0.6)1.6 (0.6)15/15
DBRCGA chuang 80 (75)2e60/15
DE-AUTO voglis 28 (11)577 (599)522 (524)439 (576)439 (262)439 (427)427 (296)4/15
DE-BFGS voglis 502 (768)2e60/15
DE-ROLL voglis 26 (34)259 (233)548 (790)2e60/15
DE-SIMPLEX voglis 125 (107)1277 (1218)2e60/15
DEAE posik 4.7 (0.4)3.5 (0.5)2.2 (0.3)1.9 (0.3)1.9 (0.3)1.9 (0.3)1.9 (0.2)15/15
DE posik 24 (6)94 (120)235 (301)256 (273)256 (334)256 (426)249 (266)3/15
DEb posik 24 (6)94 (178)235 (302)256 (408)256 (273)256 (363)249 (324)3/15
DEctpb posik 29 (5)32 (10)28 (5)20 (4)20 (4)20 (4)20 (6)14/15
IPOPsaACM loshchilov 1.0 (1)1.6 (0.6)0.92 (0.6)0.66 (0.3)0.66 (0.3)0.66 (0.3)0.65 (0.3)↑115/15
JADE posik 4.8 (0.9)272 (644)686 (1236)402 (391)402 (497)402 (424)391 (455)2/15
JADEb posik 119 (370)3279 (5615)1e60/15
JADEctpb posik 4.8 (0.9)272 (351)686 (947)402 (573)402 (510)402 (346)391 (499)2/15
MVDE melo 25 (5)106 (123)470 (578)882 (832)882 (1150)882 (938)860 (1311)1/15
NBIPOPaCMA loshchilov 1.1 (1)3.9 (0.8)2.6 (1)1.6 (0.6)1.6 (0.6)1.6 (0.6)1.6 (0.6)15/15
NIPOPaCMA loshchilov 0.99 (0.4)2.8 (2)1.7 (0.9)1.2 (0.3)1.2 (0.3)1.2 (0.3)1.2 (0.3)15/15
PSO-BFGS voglis 2e60/15
SNES schaul 32 (59)2715 (2197)7e60/15
xNES schaul 1.8 (0.4)1.6 (0.1)1.1 (0.0)0.93 (0.1)0.94 (0.1)0.94 (0.1)0.96 (0.1)15/15
xNESas schaul 1.9 (0.2)1.5 (0.1)1.0 (0.1)0.88 (0.1)↑00.89 (0.1)↑00.89 (0.1)↑00.91 (0.1)↑115/15

Δ fopt
f8, 20-D
1e1
2039
1e0
3871
1e-1
4040
1e-2
4148
1e-3
4219
1e-5
4371
1e-7
4484
#succ
15/15
ACOR liao 24 (8)66 (114)72 (101)80 (93)89 (86)107 (84)125 (83)15/15
BIPOPaCMA loshchilov 3.3 (0.9)4.0 (3)4.3 (3)4.4 (3)4.4 (3)4.4 (3)4.5 (3)15/15
BIPOPsaACM loshchilov 1.3 (0.2)1.5 (0.9)1.5 (0.9)1.6 (0.8)1.6 (0.8)1.6 (0.8)1.6 (0.8)15/15
CMAES posik 3.9 (0.8)4.3 (0.7)4.7 (0.7)4.8 (0.7)4.8 (0.7)4.9 (0.7)4.9 (0.7)15/15
CMA brockhoff 3.7 (0.6)4.4 (0.3)4.7 (0.3)4.8 (0.3)4.9 (0.3)4.9 (0.3)5.0 (0.3)15/15
CMAa brockhoff 3.6 (0.7)3.5 (0.6)3.8 (0.6)3.9 (0.6)4.0 (0.6)4.0 (0.6)4.0 (0.6)15/15
CMAm brockhoff 3.9 (0.7)5.0 (4)5.3 (4)5.4 (3)5.4 (3)5.4 (3)5.4 (3)15/15
CMAma brockhoff 3.1 (0.6)4.2 (3)4.4 (3)4.4 (3)4.5 (3)4.5 (2)4.5 (2)15/15
CMAmah brockhoff 2.6 (0.5)3.4 (2)3.6 (2)3.6 (2)3.7 (2)3.6 (2)3.6 (2)15/15
CMAmh brockhoff 3.2 (1)4.5 (3)4.7 (3)4.8 (3)4.8 (3)4.8 (3)4.8 (3)15/15
DBRCGA chuang 50 (40)150 (404)159 (262)171 (270)184 (241)213 (230)257 (258)12/15
DE-AUTO voglis 1.5 (0.4)4.2 (3)5.2 (5)6.2 (5)8.2 (5)9.3 (4)12 (5)15/15
DE-BFGS voglis 1.5 (1)2.8 (4)2.8 (4)2.9 (3)3.2 (3)3.2 (3)3.2 (3)15/15
DE-ROLL voglis 6.4 (8)15 (16)20 (19)25 (21)28 (21)33 (20)129 (117)13/15
DE-SIMPLEX voglis 12 (8)13 (8)15 (8)17 (9)19 (8)24 (10)81 (56)14/15
DEAE posik 19 (3)21 (15)22 (14)22 (14)23 (14)23 (14)24 (13)15/15
DE posik 53 (4)95 (6)106 (9)114 (9)120 (11)130 (11)138 (12)14/15
DEb posik 53 (4)95 (6)106 (9)114 (9)120 (11)130 (11)138 (12)14/15
DEctpb posik 52 (3)66 (2)76 (2)82 (4)89 (4)100 (4)111 (4)15/15
IPOPsaACM loshchilov 1.4 (0.2)1.3 (0.1)1.4 (0.1)1.4 (0.1)1.4 (0.1)1.4 (0.1)1.4 (0.1)15/15
JADE posik 18 (1)16 (0.6)16 (0.6)17 (0.5)17 (0.6)17 (0.7)18 (0.7)15/15
JADEb posik 12 (4)14 (12)14 (11)15 (11)15 (11)16 (10)17 (10)15/15
JADEctpb posik 18 (1)16 (0.6)16 (0.6)17 (0.5)17 (0.6)17 (0.7)18 (0.7)15/15
MVDE melo 1e60/15
NBIPOPaCMA loshchilov 3.2 (0.7)3.4 (1)3.6 (1)3.7 (1)3.8 (1)3.8 (1.0)3.8 (1.0)15/15
NIPOPaCMA loshchilov 3.3 (0.4)3.9 (2)4.1 (2)4.2 (2)4.2 (2)4.3 (2)4.3 (2)15/15
PSO-BFGS voglis 1.6 (1)4.1 (4)4.7 (5)5.4 (4)6.0 (4)6.3 (4)9.0 (12)15/15
SNES schaul 37 (10)145 (138)299 (251)483 (352)1107 (1124)1.3e4 (1e4)2.6e4 (2e4)0/15
xNES schaul 7.5 (0.8)6.9 (1)7.5 (1)7.6 (1)7.7 (1)8.4 (1.0)9.5 (0.9)15/15
xNESas schaul 7.2 (0.6)7.9 (2)9.1 (3)9.3 (4)9.4 (4)10 (4)10 (4)15/15

Δ fopt
f9, 20-D
1e1
1716
1e0
3102
1e-1
3277
1e-2
3379
1e-3
3455
1e-5
3594
1e-7
3727
#succ
15/15
ACOR liao 45 (7)78 (8)119 (11)195 (20)286 (31)473 (52)651 (74)15/15
BIPOPaCMA loshchilov 3.8 (1.0)4.4 (0.6)4.7 (0.6)4.8 (0.6)4.8 (0.5)4.8 (0.5)4.8 (0.5)15/15
BIPOPsaACM loshchilov 1.5 (0.3)1.7 (0.2)1.7 (0.2)1.8 (0.2)1.8 (0.2)1.8 (0.2)1.7 (0.2)15/15
CMAES posik 4.5 (1)5.0 (0.7)5.4 (0.6)5.5 (0.6)5.5 (0.6)5.5 (0.6)5.5 (0.6)15/15
CMA brockhoff 4.7 (0.9)5.1 (0.6)5.4 (0.6)5.5 (0.6)5.6 (0.5)5.6 (0.5)5.6 (0.5)15/15
CMAa brockhoff 3.9 (0.7)4.1 (0.4)4.4 (0.4)4.5 (0.4)4.5 (0.4)4.5 (0.4)4.5 (0.4)15/15
CMAm brockhoff 4.1 (1)5.4 (0.7)5.7 (0.6)5.8 (0.6)5.8 (0.6)5.8 (0.6)5.8 (0.6)15/15
CMAma brockhoff 3.4 (0.9)4.1 (0.6)4.3 (0.5)4.4 (0.5)4.4 (0.5)4.4 (0.4)4.4 (0.4)15/15
CMAmah brockhoff 2.9 (0.9)4.8 (3)4.9 (3)5.0 (3)5.0 (3)4.9 (3)4.9 (2)15/15
CMAmh brockhoff 3.1 (2)4.2 (0.9)4.5 (0.9)4.6 (0.9)4.6 (0.9)4.6 (0.8)4.6 (0.8)15/15
DBRCGA chuang 353 (124)1855 (1899)2e60/15
DE-AUTO voglis 2.0 (0.9)6.9 (5)8.8 (6)10 (6)11 (5)11 (4)20 (30)15/15
DE-BFGS voglis 1.8 (1)2.6 (2)2.8 (1)2.7 (1)2.7 (1)2.7 (1)2.7 (1)15/15
DE-ROLL voglis 25 (16)44 (18)54 (26)59 (24)63 (23)83 (44)1299 (1274)1/15
DE-SIMPLEX voglis 24 (8)149 (212)144 (198)143 (193)140 (188)142 (179)207 (283)13/15
DEAE posik 21 (3)25 (17)26 (16)27 (15)27 (15)28 (15)29 (14)15/15
DE posik 1e60/15
DEb posik 1e60/15
DEctpb posik 417 (89)1e60/15
IPOPsaACM loshchilov 1.6 (0.4)1.8 (1)1.9 (1)1.9 (1)1.9 (1)1.9 (1.0)1.9 (1.0)15/15
JADE posik 36 (3)30 (3)32 (3)32 (2)33 (2)33 (2)33 (2)15/15
JADEb posik 24 (6)32 (24)33 (23)34 (23)35 (22)35 (21)36 (20)15/15
JADEctpb posik 36 (3)30 (3)32 (3)32 (2)33 (2)33 (2)33 (2)15/15
MVDE melo 1e60/15
NBIPOPaCMA loshchilov 3.8 (0.7)4.0 (0.3)4.3 (0.3)4.4 (0.3)4.5 (0.2)4.5 (0.2)4.5 (0.2)15/15
NIPOPaCMA loshchilov 3.9 (1)4.5 (0.5)4.8 (0.5)4.9 (0.5)4.9 (0.5)4.9 (0.5)4.9 (0.5)15/15
PSO-BFGS voglis 1.7 (0.7)4.9 (4)5.7 (4)6.8 (4)7.1 (5)6.9 (5)6.9 (4)15/15
SNES schaul 520 (442)1.8e4 (2e4)3.5e4 (3e4)8e60/15
xNES schaul 8.9 (1)8.5 (1)9.3 (2)9.4 (2)9.4 (2)10 (1)11 (1)15/15
xNESas schaul 8.1 (1)8.9 (2)10 (2)10 (2)10 (2)11 (2)11 (2)15/15

Δ fopt
f10, 20-D
1e1
7413
1e0
8661
1e-1
10735
1e-2
13641
1e-3
14920
1e-5
17073
1e-7
17476
#succ
15/15
ACOR liao 2.0e4 (4e4)1e70/15
BIPOPaCMA loshchilov 1.2 (0.2)1.2 (0.2)1.1 (0.1)0.88 (0.0)↑00.83 (0.0)↑00.76 (0.0)↑00.77 (0.0)↑015/15
BIPOPsaACM loshchilov 0.36 (0.1)↑00.35 (0.0)↑00.31 (0.0)↑00.26 (0.0)↑00.24 (0.0)↑00.23 (0.0)↑00.23 (0.0)↑015/15
CMAES posik 1.7 (0.1)1.7 (0.2)1.6 (0.1)1.3 (0.0)1.2 (0.0)1.1 (0.0)1.1 (0.0)15/15
CMA brockhoff 1.8 (0.3)1.8 (0.2)1.6 (0.1)1.3 (0.1)1.2 (0.1)1.1 (0.0)1.1 (0.0)15/15
CMAa brockhoff 1.2 (0.2)1.2 (0.2)1.0 (0.1)0.87 (0.0)↑00.82 (0.0)↑00.75 (0.0)↑00.76 (0.0)↑015/15
CMAm brockhoff 1.8 (0.2)1.8 (0.2)1.6 (0.1)1.3 (0.0)1.2 (0.0)1.1 (0.0)1.1 (0.0)15/15
CMAma brockhoff 1.1 (0.2)1.1 (0.1)0.98 (0.1)0.81 (0.0)↑00.76 (0.0)↑00.70 (0.0)↑00.71 (0.0)↑015/15
CMAmah brockhoff 1.2 (0.2)1.2 (0.2)1.0 (0.1)0.83 (0.1)↑00.79 (0.1)↑00.71 (0.0)↑00.71 (0.0)↑015/15
CMAmh brockhoff 1.6 (0.2)1.6 (0.2)1.4 (0.1)1.1 (0.0)1.1 (0.0)0.95 (0.0)↑10.94 (0.0)↑115/15
DBRCGA chuang 2e60/15
DE-AUTO voglis 1.5 (1)1.5 (1)1.8 (2)1.8 (1)2.5 (2)4.6 (2)17 (11)9/15
DE-BFGS voglis 6.1 (6)5.3 (5)4.3 (4)3.4 (3)3.1 (3)2.7 (3)2.6 (3)15/15
DE-ROLL voglis 2e60/15
DE-SIMPLEX voglis 138 (105)817 (1097)2e60/15
DEAE posik 2.6 (0.3)2.6 (0.2)2.3 (0.2)2.1 (0.2)2.1 (0.1)2.2 (0.2)2.5 (0.2)15/15
DE posik 1e60/15
DEb posik 1e60/15
DEctpb posik 1e60/15
IPOPsaACM loshchilov 0.35 (0.1)↑00.36 (0.1)↑00.31 (0.0)↑00.26 (0.0)↑00.24 (0.0)↑00.22 (0.0)↑00.23 (0.0)↑015/15
JADE posik 12 (5)15 (4)15 (4)14 (3)15 (4)15 (3)18 (4)15/15
JADEb posik 39 (17)54 (24)64 (16)62 (15)116 (71)862 (1040)1e60/15
JADEctpb posik 12 (5)15 (4)15 (4)14 (3)15 (4)15 (3)18 (4)15/15
MVDE melo 1e60/15
NBIPOPaCMA loshchilov 1.1 (0.1)1.1 (0.2)1.0 (0.1)0.85 (0.0)↑00.80 (0.0)↑00.73 (0.0)↑00.75 (0.0)↑015/15
NIPOPaCMA loshchilov 1.2 (0.2)1.2 (0.1)1.0 (0.1)0.86 (0.0)↑00.81 (0.0)↑00.74 (0.0)↑00.76 (0.0)↑015/15
PSO-BFGS voglis 29 (15)24 (12)20 (10)16 (8)14 (7)12 (6)12 (6)14/15
SNES schaul 8e60/15
xNES schaul 1.5 (0.0)1.6 (0.0)1.6 (0.0)1.4 (0.0)1.5 (0.0)1.7 (0.0)2.0 (0.0)15/15
xNESas schaul 1.3 (0.1)1.4 (0.1)1.3 (0.1)1.1 (0.1)1.0 (0.1)0.99 (0.1)1.0 (0.1)15/15

Δ fopt
f11, 20-D
1e1
1002
1e0
2228
1e-1
6278
1e-2
8586
1e-3
9762
1e-5
12285
1e-7
14831
#succ
15/15
ACOR liao 1002 (53)1328 (2266)679 (1203)869 (1464)995 (1799)1037 (1021)1462 (1010)2/15
BIPOPaCMA loshchilov 4.5 (0.3)2.3 (0.1)0.87 (0.0)↑00.68 (0.0)↑00.64 (0.0)↑00.56 (0.0)↑00.51 (0.0)↑015/15
BIPOPsaACM loshchilov 2.5 (0.4)1.2 (0.2)0.44 (0.1)↑00.34 (0.1)↑00.30 (0.0)↑00.26 (0.0)↑00.23 (0.0)↑015/15
CMAES posik 11 (0.8)5.3 (0.2)2.0 (0.1)1.5 (0.0)1.4 (0.0)1.2 (0.0)1.0 (0.0)15/15
CMA brockhoff 10 (1.0)5.1 (0.3)1.9 (0.1)1.5 (0.1)1.4 (0.0)1.2 (0.0)1.0 (0.0)15/15
CMAa brockhoff 4.5 (0.2)2.2 (0.1)0.86 (0.0)↑00.68 (0.0)↑00.63 (0.0)↑00.55 (0.0)↑00.50 (0.0)↑015/15
CMAm brockhoff 11 (0.7)5.4 (0.4)2.0 (0.1)1.6 (0.1)1.4 (0.1)1.2 (0.1)1.1 (0.0)15/15
CMAma brockhoff 4.3 (0.5)2.1 (0.2)0.82 (0.1)↑00.64 (0.0)↑00.59 (0.0)↑00.51 (0.0)↑00.45 (0.0)↑015/15
CMAmah brockhoff 4.8 (0.5)2.4 (0.2)0.92 (0.1)↑00.71 (0.0)↑00.66 (0.0)↑00.56 (0.0)↑00.49 (0.0)↑015/15
CMAmh brockhoff 11 (0.9)5.6 (0.3)2.1 (0.1)1.7 (0.1)1.5 (0.1)1.3 (0.0)1.1 (0.0)15/15
DBRCGA chuang 431 (168)396 (54)189 (21)169 (8)165 (8)154 (5)2e60/15
DE-AUTO voglis 0.38 (0.5)0.19 (0.2)↑00.07 (0.1)↑00.06 (0.1)↑00.06 (0.1)↑00.05 (0.0)↑00.10 (0.0)↑015/15
DE-BFGS voglis 0.20 (0.1)↑00.11 (0.1)↑00.05 (0.0)↑00.04 (0.0)↑00.04 (0.0)↑00.04 (9e-3)↑00.05 (0.0)↑015/15
DE-ROLL voglis 510 (225)6544 (6040)2e60/15
DE-SIMPLEX voglis 90 (38)162 (67)142 (53)245 (192)1512 (1517)2e60/15
DEAE posik 13 (4)7.4 (2)3.2 (0.7)2.7 (0.5)2.7 (0.5)2.6 (0.4)2.6 (0.3)15/15
DE posik 7377 (9232)1e60/15
DEb posik 7377 (7485)1e60/15
DEctpb posik 1e60/15
IPOPsaACM loshchilov 2.5 (0.5)1.2 (0.2)0.45 (0.1)↑00.34 (0.1)↑00.31 (0.1)↑00.26 (0.1)↑00.23 (0.0)↑015/15
JADE posik 92 (19)46 (8)18 (4)15 (3)15 (3)15 (3)15 (3)14/15
JADEb posik 281 (520)140 (228)54 (80)43 (60)41 (54)37 (42)35 (34)12/15
JADEctpb posik 92 (19)46 (8)18 (4)15 (3)15 (3)15 (3)15 (3)14/15
MVDE melo 1e60/15
NBIPOPaCMA loshchilov 4.6 (0.4)2.3 (0.2)0.89 (0.1)↑00.69 (0.0)↑00.64 (0.0)↑00.56 (0.0)↑00.51 (0.0)↑015/15
NIPOPaCMA loshchilov 4.5 (0.3)2.3 (0.1)0.87 (0.0)↑00.69 (0.0)↑00.64 (0.0)↑00.56 (0.0)↑00.50 (0.0)↑015/15
PSO-BFGS voglis 0.25 (0.2)↑00.14 (0.1)↑00.05 (0.0)↑00.04 (0.0)↑00.04 (0.0)↑00.04 (0.0)↑00.05 (0.0)↑015/15
SNES schaul 1.2e5 (9e4)8e60/15
xNES schaul 4.9 (0.3)3.3 (0.2)1.6 (0.1)1.5 (0.0)1.6 (0.0)1.8 (0.0)1.9 (0.0)15/15
xNESas schaul 4.8 (0.3)3.1 (0.2)1.4 (0.1)1.2 (0.1)1.1 (0.2)1.00 (0.2)0.91 (0.2)15/15

Δ fopt
f12, 20-D
1e1
1042
1e0
1938
1e-1
2740
1e-2
3156
1e-3
4140
1e-5
12407
1e-7
13827
#succ
15/15
ACOR liao 3664 (5724)1.0e4 (9030)2.4e4 (3e4)1e70/15
BIPOPaCMA loshchilov 3.3 (3)3.5 (3)4.0 (2)4.2 (2)3.7 (1)1.5 (0.4)1.5 (0.4)15/15
BIPOPsaACM loshchilov 0.99 (0.9)1.1 (1)1.2 (0.9)1.3 (1)1.2 (0.9)0.55 (0.3)↑00.59 (0.3)↑015/15
CMAES posik 2.2 (0.2)3.2 (3)4.0 (3)4.4 (3)4.0 (2)1.8 (0.8)1.9 (0.7)15/15
CMA brockhoff 3.4 (5)5.4 (4)5.6 (3)5.8 (3)5.1 (2)2.1 (0.9)2.2 (0.9)15/15
CMAa brockhoff 2.4 (0.2)3.4 (2)3.4 (2)3.8 (2)3.4 (1)1.4 (0.5)1.5 (0.5)15/15
CMAm brockhoff 3.2 (4)4.1 (5)4.8 (5)5.2 (4)4.6 (3)2.0 (1)2.1 (1.0)15/15
CMAma brockhoff 2.3 (2)3.1 (3)3.2 (2)3.4 (2)3.1 (1)1.3 (0.5)1.4 (0.5)15/15
CMAmah brockhoff 1.2 (1)2.1 (2)2.6 (2)2.8 (1)2.5 (1)1.1 (0.4)1.1 (0.3)15/15
CMAmh brockhoff 4.5 (5)6.1 (6)6.4 (5)6.5 (5)5.6 (3)2.4 (1)2.4 (1)15/15
DBRCGA chuang 185 (16)1209 (1291)1.0e4 (1e4)2e60/15
DE-AUTO voglis 2.2 (2)2.3 (3)2.9 (3)3.6 (4)4.4 (4)4.5 (2)39 (49)7/15
DE-BFGS voglis 1.4 (0.8)1.4 (1)1.6 (1)1.6 (1.0)1.7 (1)1.1 (0.6)4.6 (4)15/15
DE-ROLL voglis 21 (35)18 (24)18 (17)24 (16)27 (20)25 (20)100 (110)6/15
DE-SIMPLEX voglis 34 (31)30 (23)28 (17)30 (18)31 (17)21 (17)621 (793)0/15
DEAE posik 22 (1)14 (3)14 (4)15 (4)14 (3)6.1 (1)6.4 (1)15/15
DE posik 99 (6)478 (517)1496 (2175)4481 (3961)1e60/15
DEb posik 99 (6)478 (647)1496 (2000)4481 (3406)1e60/15
DEctpb posik 194 (208)406 (722)1276 (1775)1e60/15
IPOPsaACM loshchilov 0.67 (0.1)↑00.88 (0.7)1.1 (0.7)1.2 (0.7)1.2 (0.5)0.56 (0.2)↑00.60 (0.2)↑015/15
JADE posik 19 (4)20 (15)28 (15)30 (13)28 (10)13 (3)14 (3)15/15
JADEb posik 23 (24)34 (30)40 (29)42 (24)39 (17)17 (6)18 (5)15/15
JADEctpb posik 19 (4)20 (15)28 (15)30 (13)28 (10)13 (3)14 (3)15/15
MVDE melo 108 (31)272 (313)528 (551)4612 (5308)1e60/15
NBIPOPaCMA loshchilov 2.3 (0.2)2.7 (2)3.2 (2)3.4 (2)3.2 (1)1.3 (0.5)1.4 (0.5)15/15
NIPOPaCMA loshchilov 3.5 (3)3.6 (3)3.5 (2)3.8 (2)3.4 (1)1.4 (0.4)1.4 (0.4)15/15
PSO-BFGS voglis 2.2 (2)2.3 (2)2.3 (2)3.1 (3)3.7 (3)5.0 (4)21 (24)13/15
SNES schaul 23 (38)37 (41)122 (57)651 (932)3134 (2554)8e60/15
xNES schaul 16 (0.5)11 (0.4)9.3 (1)9.4 (1)8.3 (0.8)3.5 (0.2)3.6 (0.2)15/15
xNESas schaul 6.6 (4)16 (8)18 (18)30 (42)35 (38)21 (21)22 (21)15/15

Δ fopt
f13, 20-D
1e1
652
1e0
2021
1e-1
2751
1e-2
3507
1e-3
18749
1e-5
24455
1e-7
30201
#succ
15/15
ACOR liao 1.8e4 (2e4)3.2e4 (5e4)5.1e4 (1e5)1e70/15
BIPOPaCMA loshchilov 4.1 (3)3.3 (3)3.7 (3)3.4 (2)0.85 (0.4)1.1 (0.8)1.4 (0.6)15/15
BIPOPsaACM loshchilov 1.1 (0.9)0.89 (0.7)1.4 (1.0)1.4 (1)0.38 (0.1)↑00.42 (0.2)↑00.40 (0.1)↑015/15
CMAES posik 6.3 (5)5.1 (3)4.5 (3)4.4 (3)1.9 (2)4.6 (5)8.4 (9)12/15
CMA brockhoff 2.5 (0.4)5.1 (4)7.5 (6)8.4 (6)1.7 (1)1.9 (0.9)2.0 (1)15/15
CMAa brockhoff 2.4 (0.3)3.5 (3)4.5 (3)4.5 (4)1.1 (0.8)1.2 (0.7)1.5 (1.0)15/15
CMAm brockhoff 3.1 (4)3.2 (4)6.2 (4)6.3 (4)1.7 (1)2.4 (0.9)2.4 (0.7)15/15
CMAma brockhoff 2.9 (3)3.5 (3)4.4 (2)4.0 (3)0.94 (0.4)1.1 (0.5)1.5 (1)15/15
CMAmah brockhoff 3.6 (3)3.3 (4)4.2 (3)4.8 (3)1.3 (0.4)1.4 (0.6)1.8 (0.9)15/15
CMAmh brockhoff 3.7 (3)5.1 (5)6.4 (6)6.8 (5)1.8 (0.7)2.4 (1.0)2.7 (0.7)15/15
DBRCGA chuang 183 (295)398 (496)2063 (2180)3740 (7413)2e60/15
DE-AUTO voglis 1.8 (0.5)0.91 (0.4)0.95 (0.3)1.4 (0.7)0.70 (0.6)4.5 (3)32 (37)7/15
DE-BFGS voglis 1.3 (0.1)0.59 (0.1)↑00.53 (0.0)↑00.50 (0.0)↑00.18 (0.2)↑092 (130)2e60/15
DE-ROLL voglis 24 (15)18 (20)17 (15)19 (16)5.8 (4)24 (16)289 (332)1/15
DE-SIMPLEX voglis 28 (17)15 (7)16 (6)24 (12)9.0 (6)195 (240)2e60/15
DEAE posik 22 (2)10 (0.6)10 (0.5)9.2 (0.4)2.1 (0.1)2.1 (0.1)2.1 (0.1)15/15
DE posik 41 (7)214 (247)702 (690)4009 (4562)1e60/15
DEb posik 41 (7)214 (386)702 (545)4009 (2923)1e60/15
DEctpb posik 50 (8)103 (76)607 (640)4254 (3992)1e60/15
IPOPsaACM loshchilov 1.7 (2)1.7 (0.8)1.5 (0.7)1.5 (0.9)0.34 (0.2)↑00.37 (0.1)↑00.41 (0.2)↑015/15
JADE posik 17 (2)14 (5)15 (4)14 (3)3.6 (0.6)4.8 (0.8)9.0 (2)15/15
JADEb posik 61 (53)91 (112)175 (247)721 (819)795 (960)1e60/15
JADEctpb posik 17 (2)14 (5)15 (4)14 (3)3.6 (0.6)4.8 (0.8)9.0 (2)15/15
MVDE melo 68 (5)297 (626)2522 (4090)1e60/15
NBIPOPaCMA loshchilov 3.3 (3)2.6 (2)3.7 (3)4.6 (2)1.1 (1.0)1.2 (0.6)1.3 (0.8)15/15
NIPOPaCMA loshchilov 3.3 (3)3.7 (3)4.1 (2)4.0 (2)0.95 (0.3)1.1 (0.4)1.5 (0.5)15/15
PSO-BFGS voglis 1.2 (0.1)0.56 (0.0)↑00.51 (0.0)↑00.49 (0.0)↑00.21 (0.1)↑0133 (124)2e60/15
SNES schaul 11 (0.5)54 (59)153 (139)384 (358)140 (126)796 (946)7e60/15
xNES schaul 16 (0.5)7.8 (0.2)7.9 (0.2)7.8 (0.1)1.8 (0.0)1.8 (0.0)1.9 (0.0)15/15
xNESas schaul 7.0 (3)4.6 (3)19 (28)46 (61)17 (21)40 (33)81 (83)0/15

Δ fopt
f14, 20-D
1e1
75
1e0
239
1e-1
304
1e-2
451
1e-3
932
1e-5
1648
1e-7
15661
#succ
15/15
ACOR liao 15 (4)9.5 (2)11 (2)13 (1)30 (8)1e70/15
BIPOPaCMA loshchilov 3.2 (1)2.6 (0.5)3.3 (0.4)3.9 (0.3)3.2 (0.3)3.8 (0.2)0.68 (0.0)↑015/15
BIPOPsaACM loshchilov 3.2 (1)1.8 (0.6)1.9 (0.4)2.0 (0.4)1.5 (0.2)1.4 (0.2)0.23 (0.0)↑015/15
CMAES posik 4.2 (1)3.0 (0.5)3.7 (0.4)4.3 (0.6)4.2 (0.3)6.2 (0.5)1.2 (0.1)15/15
CMA brockhoff 4.5 (2)3.0 (0.6)3.7 (0.5)4.2 (0.6)4.1 (0.4)6.1 (0.5)1.2 (0.1)15/15
CMAa brockhoff 3.8 (1)2.7 (0.3)3.5 (0.5)3.9 (0.4)3.1 (0.2)3.9 (0.2)0.69 (0.0)↑015/15
CMAm brockhoff 2.9 (1)2.3 (0.4)2.8 (0.3)3.5 (0.3)3.7 (0.4)6.3 (0.6)1.2 (0.1)15/15
CMAma brockhoff 3.3 (1)2.3 (0.4)2.8 (0.4)3.3 (0.3)2.9 (0.3)3.7 (0.3)0.65 (0.0)↑015/15
CMAmah brockhoff 2.0 (0.6)1.5 (0.3)1.9 (0.3)2.3 (0.3)2.3 (0.3)3.4 (0.4)0.66 (0.0)↑015/15
CMAmh brockhoff 2.3 (1)1.6 (0.4)1.9 (0.3)2.4 (0.3)2.8 (0.3)5.7 (0.7)1.2 (0.1)15/15
DBRCGA chuang 32 (9)45 (10)67 (13)81 (16)93 (18)1640 (998)2e60/15
DE-AUTO voglis 2.0 (0.3)0.93 (0.1)0.93 (0.1)0.88 (0.1)↑10.58 (0.0)↑00.91 (0.0)↑062 (83)0/15
DE-BFGS voglis 1.7 (0.4)0.84 (0.1)0.90 (0.2)0.93 (0.2)0.62 (0.1)↑00.56 (0.1)↑0125 (113)0/15
DE-ROLL voglis 7.4 (14)18 (21)17 (16)12 (11)33 (7)3480 (3644)2e60/15
DE-SIMPLEX voglis 12 (10)40 (32)53 (17)42 (7)30 (9)122 (52)2e60/15
DEAE posik 30 (4)27 (3)37 (4)38 (4)24 (2)19 (1)2.7 (0.2)15/15
DE posik 55 (19)46 (6)53 (6)90 (14)502 (176)1e60/15
DEb posik 55 (19)46 (6)53 (6)90 (14)502 (176)1e60/15
DEctpb posik 57 (23)47 (8)57 (10)92 (17)814 (261)1e60/15
IPOPsaACM loshchilov 3.0 (0.6)1.8 (0.3)1.9 (0.4)2.0 (0.2)1.4 (0.2)1.4 (0.1)0.23 (0.0)↑015/15
JADE posik 18 (6)18 (1)23 (2)25 (2)20 (1)38 (24)62 (54)5/15
JADEb posik 14 (4)13 (2)18 (2)22 (2)21 (3)77 (30)1e60/15
JADEctpb posik 18 (6)18 (1)23 (2)25 (2)20 (1)38 (24)62 (51)5/15
MVDE melo 57 (10)60 (6)78 (4)108 (11)1465 (2017)1e60/15
NBIPOPaCMA loshchilov 4.3 (1)3.0 (0.5)3.7 (0.7)4.0 (0.5)3.2 (0.5)3.9 (0.4)0.67 (0.1)↑015/15
NIPOPaCMA loshchilov 4.3 (1)2.8 (0.6)3.5 (0.7)4.0 (0.6)3.3 (0.3)3.9 (0.3)0.69 (0.0)↑015/15
PSO-BFGS voglis 1.7 (0.6)0.85 (0.1)0.98 (0.2)0.97 (0.2)0.63 (0.1)↑00.57 (0.1)↑0892 (1096)0/15
SNES schaul 2.6 (0.9)2.4 (0.4)3.9 (0.4)5.3 (0.4)8.5 (4)8e60/15
xNES schaul 2.4 (1.0)7.9 (1)19 (0.7)21 (0.6)14 (0.4)12 (0.3)1.7 (0.0)15/15
xNESas schaul 2.6 (0.8)7.6 (1)14 (3)17 (3)12 (1)10 (1)1.5 (0.1)15/15

Δ fopt
f15, 20-D
1e1
30378
1e0
1.5e5
1e-1
3.1e5
1e-2
3.2e5
1e-3
3.2e5
1e-5
4.5e5
1e-7
4.6e5
#succ
15/15
ACOR liao 919 (987)1e70/15
BIPOPaCMA loshchilov 0.88 (0.4)1.6 (0.6)1.2 (0.6)1.2 (0.6)1.2 (0.6)0.89 (0.5)0.89 (0.4)15/15
BIPOPsaACM loshchilov 0.65 (0.6)1.3 (0.6)0.91 (0.7)0.90 (0.6)0.89 (0.6)0.66 (0.5)0.65 (0.5)15/15
CMAES posik 37 (52)1e60/15
CMA brockhoff 0.98 (0.7)0.98 (0.4)0.76 (0.2)0.77 (0.2)0.77 (0.2)0.57 (0.2)↑00.58 (0.2)↑015/15
CMAa brockhoff 0.90 (0.5)1.0 (0.3)0.60 (0.3)↑10.61 (0.3)↑10.61 (0.3)↑10.45 (0.2)↑00.46 (0.3)↑015/15
CMAm brockhoff 0.81 (0.6)1.1 (0.3)0.69 (0.3)0.69 (0.3)0.70 (0.3)0.52 (0.3)↑10.53 (0.3)↑115/15
CMAma brockhoff 0.62 (0.2)↑10.98 (0.3)0.65 (0.3)↑00.66 (0.3)↑10.67 (0.3)↑10.49 (0.2)↑00.50 (0.2)↑015/15
CMAmah brockhoff 0.92 (0.6)1.2 (0.6)0.64 (0.3)↑10.65 (0.3)↑10.65 (0.3)↑10.48 (0.2)↑00.49 (0.2)↑015/15
CMAmh brockhoff 0.98 (0.6)1.1 (0.3)0.66 (0.3)0.67 (0.3)0.67 (0.3)0.50 (0.3)↑00.50 (0.3)↑015/15
DBRCGA chuang 2e60/15
DE-AUTO voglis 59 (45)2e60/15
DE-BFGS voglis 28 (15)2e60/15
DE-ROLL voglis 32 (19)2e60/15
DE-SIMPLEX voglis 25 (11)2e60/15
DEAE posik 1e60/15
DE posik 1e60/15
DEb posik 1e60/15
DEctpb posik 1e60/15
IPOPsaACM loshchilov 0.60 (0.5)0.92 (0.7)0.53 (0.4)↑10.53 (0.4)↑10.52 (0.4)↑10.37 (0.3)↑00.37 (0.3)↑015/15
JADE posik 39 (32)1e60/15
JADEb posik 1e60/15
JADEctpb posik 39 (42)1e60/15
MVDE melo 1e60/15
NBIPOPaCMA loshchilov 1.2 (0.9)1.2 (0.5)0.79 (0.5)0.79 (0.5)0.79 (0.5)0.58 (0.4)↑00.59 (0.4)↑015/15
NIPOPaCMA loshchilov 0.81 (0.3)↑10.99 (0.3)0.67 (0.3)↑10.67 (0.3)0.68 (0.3)0.50 (0.3)↑00.51 (0.3)↑015/15
PSO-BFGS voglis 2e60/15
SNES schaul 49 (76)8e60/15
xNES schaul 43 (41)7e60/15
xNESas schaul 44 (52)2e70/15

Δ fopt
f16, 20-D
1e1
1384
1e0
27265
1e-1
77015
1e-2
1.4e5
1e-3
1.9e5
1e-5
2.0e5
1e-7
2.2e5
#succ
15/15
ACOR liao 1.0e5 (2e5)1e70/15
BIPOPaCMA loshchilov 1.7 (0.6)0.87 (0.5)0.78 (0.5)0.85 (0.5)0.92 (0.4)1.2 (0.8)1.1 (0.8)15/15
BIPOPsaACM loshchilov 1.9 (0.6)0.74 (0.4)0.51 (0.3)↑10.64 (0.3)↑10.60 (0.5)0.84 (0.5)0.83 (0.5)15/15
CMAES posik 1.9 (0.8)2.7 (2)1e60/15
CMA brockhoff 1.8 (1)1.1 (0.4)0.82 (0.7)0.93 (1.0)1.1 (0.9)1.2 (0.9)1.1 (0.8)15/15
CMAa brockhoff 1.9 (0.6)0.76 (0.3)0.83 (0.7)0.56 (0.4)0.81 (0.5)1.00 (0.9)0.95 (0.8)15/15
CMAm brockhoff 1.3 (0.6)0.85 (0.5)1.3 (1)1.2 (0.9)1.4 (1)1.4 (1)1.3 (1)15/15
CMAma brockhoff 2.2 (3)0.63 (0.6)0.84 (0.6)0.64 (0.6)0.76 (0.6)0.85 (0.9)0.79 (0.9)15/15
CMAmah brockhoff 2.3 (3)0.91 (0.5)0.90 (0.6)0.69 (0.6)0.92 (0.5)1.3 (1)1.2 (0.9)15/15
CMAmh brockhoff 3.0 (3)1.1 (0.6)1.1 (0.7)0.99 (0.7)1.0 (0.8)1.1 (0.8)1.0 (0.8)15/15
DBRCGA chuang 118 (162)2e60/15
DE-AUTO voglis 40 (46)2e60/15
DE-BFGS voglis 595 (508)242 (184)2e60/15
DE-ROLL voglis 20 (18)1093 (863)2e60/15
DE-SIMPLEX voglis 54 (37)2e60/15
DEAE posik 1e60/15
DE posik 1e60/15
DEb posik 1e60/15
DEctpb posik 1e60/15
IPOPsaACM loshchilov 1.8 (0.8)0.55 (0.4)↑10.77 (0.8)0.63 (0.5)0.52 (0.4)↑00.55 (0.4)↑00.50 (0.3)↑015/15
JADE posik 24 (8)1e60/15
JADEb posik 60 (42)1e60/15
JADEctpb posik 24 (8)1e60/15
MVDE melo 1353 (1592)1e60/15
NBIPOPaCMA loshchilov 2.6 (2)0.80 (0.4)0.51 (0.2)↑00.51 (0.3)↑00.42 (0.2)↑00.43 (0.2)↑00.41 (0.2)↑015/15
NIPOPaCMA loshchilov 2.0 (0.9)0.57 (0.3)0.41 (0.3)↑00.41 (0.2)↑00.38 (0.1)↑00.39 (0.1)↑00.37 (0.1)↑015/15
PSO-BFGS voglis 542 (550)2e60/15
SNES schaul 2.7 (1)11 (15)157 (158)861 (862)8e60/15
xNES schaul 17 (8)2.3 (2)15 (13)35 (32)48 (49)56 (69)50 (58)7/15
xNESas schaul 20 (10)4.2 (5)9.2 (7)22 (25)108 (110)133 (140)119 (102)6/15

Δ fopt
f17, 20-D
1e1
63
1e0
1030
1e-1
4005
1e-2
12242
1e-3
30677
1e-5
56288
1e-7
80472
#succ
15/15
ACOR liao 12 (8)4.5 (1)269 (447)677 (902)4564 (3830)1e70/15
BIPOPaCMA loshchilov 3.0 (1)1.1 (0.3)1.7 (2)1.4 (1)1.0 (0.4)0.90 (0.5)1.1 (0.4)15/15
BIPOPsaACM loshchilov 3.2 (2)1.2 (0.4)2.7 (3)1.6 (0.9)1.2 (0.7)1.2 (0.5)1.4 (0.8)15/15
CMAES posik 2.8 (2)0.96 (0.4)1.5 (2)3.7 (3)8.1 (8)1e60/15
CMA brockhoff 2.2 (1)1.00 (0.3)1.5 (2)1.1 (0.7)0.81 (0.3)0.93 (0.4)0.91 (0.3)15/15
CMAa brockhoff 2.3 (1)0.87 (0.2)0.52 (0.2)↑00.73 (0.6)0.70 (0.3)0.80 (0.4)0.92 (0.2)15/15
CMAm brockhoff 2.2 (0.5)0.82 (0.3)1.4 (1)0.76 (0.5)0.59 (0.3)↑10.82 (0.4)0.92 (0.1)15/15
CMAma brockhoff 2.2 (2)0.86 (0.2)1.4 (2)1.2 (0.7)0.70 (0.3)↑10.79 (0.3)0.82 (0.2)↑115/15
CMAmah brockhoff 2.0 (1)8.8 (10)4.0 (2)1.7 (1.0)0.92 (0.4)0.96 (0.4)0.94 (0.3)15/15
CMAmh brockhoff 1.8 (0.8)22 (28)7.7 (6)3.1 (2)1.4 (0.8)1.3 (0.7)1.3 (0.6)15/15
DBRCGA chuang 18 (9)2347 (3923)2e60/15
DE-AUTO voglis 48 (68)335 (185)529 (515)2e60/15
DE-BFGS voglis 17 (19)117 (48)327 (282)1140 (1674)952 (930)2e60/15
DE-ROLL voglis 15 (17)358 (276)535 (1378)1105 (1063)2e60/15
DE-SIMPLEX voglis 34 (40)381 (238)2127 (2231)2e60/15
DEAE posik 19 (11)13 (2)8.4 (0.9)4.4 (0.4)2.3 (0.3)37 (46)90 (127)2/15
DE posik 26 (19)16 (4)13 (4)8.0 (2)8.8 (9)1e60/15
DEb posik 26 (19)16 (4)13 (4)8.0 (2)8.8 (9)1e60/15
DEctpb posik 16 (12)17 (3)11 (1)6.8 (0.6)4.3 (0.6)63 (67)183 (255)1/15
IPOPsaACM loshchilov 2.5 (2)0.91 (0.3)0.98 (1)1.7 (1)1.2 (0.5)1.2 (0.4)1.1 (0.5)15/15
JADE posik 7.8 (5)7.4 (1)4.4 (0.7)2.4 (0.4)1.7 (0.5)7.2 (11)23 (27)2/15
JADEb posik 9.3 (6)14 (12)85 (130)90 (130)466 (652)1e60/15
JADEctpb posik 7.8 (5)7.4 (1)4.4 (0.7)2.4 (0.4)1.7 (0.5)7.2 (9)23 (19)2/15
MVDE melo 19 (14)29 (5)24 (5)30 (41)34 (35)1e60/15
NBIPOPaCMA loshchilov 2.6 (1)1.00 (0.2)0.77 (0.3)↑11.3 (0.7)1.2 (0.5)1.4 (0.8)1.2 (0.7)15/15
NIPOPaCMA loshchilov 2.5 (1)1.1 (0.3)1.9 (2)1.2 (0.7)0.79 (0.4)0.88 (0.3)0.81 (0.2)15/15
PSO-BFGS voglis 19 (15)1652 (1342)2e60/15
SNES schaul 2.0 (1)1.0 (0.3)5.9 (10)4.2 (10)3.9 (5)239 (213)8e60/15
xNES schaul 1.9 (1)3.6 (0.6)3.0 (0.1)1.7 (0.1)0.94 (0.0)↑02.7 (3)12 (14)15/15
xNESas schaul 2.1 (1.0)3.5 (0.4)2.9 (0.2)1.6 (0.1)0.92 (0.0)↑01.4 (0.7)12 (9)15/15

Δ fopt
f18, 20-D
1e1
621
1e0
3972
1e-1
19561
1e-2
28555
1e-3
67569
1e-5
1.3e5
1e-7
1.5e5
#succ
15/15
ACOR liao 4.7 (2)3.5 (1)493 (943)1e70/15
BIPOPaCMA loshchilov 0.94 (0.2)0.77 (0.1)↑11.5 (0.7)1.6 (1)1.4 (0.5)1.2 (0.7)1.5 (0.7)15/15
BIPOPsaACM loshchilov 1.0 (0.3)1.5 (1)0.92 (0.4)1.3 (0.4)0.96 (0.4)1.6 (0.6)1.6 (0.5)15/15
CMAES posik 1.1 (0.4)2.0 (2)4.2 (5)493 (569)1e60/15
CMA brockhoff 0.96 (0.2)0.70 (0.4)0.89 (0.7)1.3 (0.8)0.98 (0.3)1.1 (0.8)1.1 (0.8)15/15
CMAa brockhoff 0.96 (0.3)0.96 (2)0.96 (0.9)1.2 (0.4)0.79 (0.3)0.85 (0.4)0.87 (0.3)15/15
CMAm brockhoff 0.81 (0.3)1.0 (1)0.61 (0.7)0.93 (0.4)0.89 (0.3)0.97 (0.3)0.95 (0.3)15/15
CMAma brockhoff 0.85 (0.2)0.57 (0.3)↑10.78 (0.7)0.99 (0.4)0.68 (0.2)↑00.77 (0.4)0.74 (0.3)15/15
CMAmah brockhoff 0.95 (0.5)2.5 (2)1.2 (0.7)1.1 (0.3)0.79 (0.3)0.88 (0.4)0.91 (0.3)15/15
CMAmh brockhoff 3.3 (8)3.4 (2)1.2 (0.7)1.5 (0.5)1.1 (0.7)1.1 (0.3)1.1 (0.3)15/15
DBRCGA chuang 13 (6)7527 (6924)2e60/15
DE-AUTO voglis 131 (69)416 (347)2e60/15
DE-BFGS voglis 69 (61)350 (306)1503 (1459)2e60/15
DE-ROLL voglis 87 (28)518 (524)1470 (1510)2e60/15
DE-SIMPLEX voglis 115 (81)1124 (2415)1462 (2149)2e60/15
DEAE posik 12 (4)6.3 (1)2.3 (0.3)2.7 (0.6)2.5 (2)6.7 (8)14 (9)4/15
DE posik 17 (4)16 (5)15 (7)56 (50)1e60/15
DEb posik 17 (4)16 (5)15 (7)56 (53)1e60/15
DEctpb posik 17 (5)14 (4)7.8 (2)21 (17)50 (60)1e60/15
IPOPsaACM loshchilov 0.96 (0.5)1.4 (2)0.91 (0.6)1.3 (0.8)0.78 (0.5)0.88 (0.4)1.3 (0.8)15/15
JADE posik 7.2 (2)4.4 (1)1.5 (0.4)8.2 (8)19 (24)1e60/15
JADEb posik 6.3 (3)13 (15)127 (139)1e60/15
JADEctpb posik 7.2 (2)4.4 (1)1.5 (0.4)8.2 (8)19 (22)1e60/15
MVDE melo 23 (4)37 (18)133 (230)1e60/15
NBIPOPaCMA loshchilov 1.0 (0.3)1.4 (2)1.4 (0.8)1.5 (1)1.2 (0.7)0.97 (0.3)0.92 (0.3)15/15
NIPOPaCMA loshchilov 1.0 (0.3)0.76 (0.1)↑10.79 (0.4)↑11.1 (0.4)0.88 (0.3)0.85 (0.4)0.84 (0.3)15/15
PSO-BFGS voglis 210 (159)7504 (9073)2e60/15
SNES schaul 1.0 (0.4)2.0 (0.4)6.3 (4)28 (39)547 (445)8e60/15
xNES schaul 1.3 (0.6)2.0 (0.2)0.84 (0.0)↑00.88 (0.0)↑00.50 (0.0)↑01.3 (2)11 (14)15/15
xNESas schaul 1.2 (0.5)1.9 (0.1)0.81 (0.0)↑00.84 (0.0)↑00.48 (0.0)↑00.58 (0.3)5.6 (6)15/15

Δ fopt
f19, 20-D
1e1
1
1e0
1
1e-1
3.4e5
1e-2
4.7e6
1e-3
6.2e6
1e-5
6.7e6
1e-7
6.7e6
#succ
15/15
ACOR liao 686 (252)1e70/15
BIPOPaCMA loshchilov 184 (66)2.9e4 (2e4)1.4 (1)1.0 (0.4)1.0 (0.4)1.0 (0.4)1.0 (0.4)15/15
BIPOPsaACM loshchilov 143 (52)2.5e4 (1e4)0.42 (0.3)↑10.76 (0.2)0.72 (0.4)0.73 (0.4)0.73 (0.4)15/15
CMAES posik 162 (70)4.8e4 (4e4)1e60/15
CMA brockhoff 170 (56)3.1e4 (3e4)2.0 (3)0.84 (0.6)0.94 (1.0)1.7 (1)1.7 (1)5/15
CMAa brockhoff 156 (72)7.7e4 (1e4)2.5 (4)0.85 (0.5)0.73 (0.6)0.88 (0.6)0.88 (0.8)8/15
CMAm brockhoff 134 (58)1.8e4 (1e4)1.1 (0.6)0.95 (0.6)2.3 (3)2.9 (3)2.8 (4)3/15
CMAma brockhoff 135 (44)4.2e4 (3e4)3.2 (4)1.3 (1)1.0 (0.4)1.6 (1)2.1 (2)4/15
CMAmah brockhoff 95 (46)8.5e4 (2e5)2.5 (4)0.80 (0.7)0.91 (1)1.3 (2)1.3 (1.0)6/15
CMAmh brockhoff 82 (52)2.4e4 (3e4)3.3 (4)1.3 (0.8)1.8 (2)2.9 (2)2.8 (4)3/15
DBRCGA chuang 975 (165)6.9e5 (8e5)2e60/15
DE-AUTO voglis 2751 (2816)1.1e5 (8e4)87 (115)2e60/15
DE-BFGS voglis 3206 (3658)3.8e4 (2e4)5.4 (7)2e60/15
DE-ROLL voglis 3941 (5048)2.2e5 (3e5)2e60/15
DE-SIMPLEX voglis 8348 (6218)1.5e5 (5e4)2e60/15
DEAE posik 1434 (466)1e60/15
DE posik 2739 (802)1e60/15
DEb posik 2739 (802)1e60/15
DEctpb posik 2148 (731)1e60/15
IPOPsaACM loshchilov 154 (50)3.0e4 (2e4)0.61 (0.5)0.40 (0.2)0.33 (0.1)↑10.32 (0.2)↑10.32 (0.2)↑114/15
JADE posik 856 (206)7.0e5 (5e5)1e60/15
JADEb posik 826 (254)3.1e6 (5e6)1e60/15
JADEctpb posik 856 (206)7.0e5 (7e5)1e60/15
MVDE melo 2928 (795)1e60/15
NBIPOPaCMA loshchilov 180 (56)2.9e4 (2e4)0.98 (0.9)0.75 (0.6)0.69 (0.3)0.64 (0.3)↑10.65 (0.3)↑115/15
NIPOPaCMA loshchilov 169 (62)2.8e4 (2e4)1.7 (2)0.71 (0.4)0.59 (0.4)0.56 (0.3)↑10.56 (0.3)↑115/15
PSO-BFGS voglis 3614 (6276)3.5e4 (1e4)1.4 (1)2e60/15
SNES schaul 118 (40)1.3e5 (1e5)8e60/15
xNES schaul 105 (59)6e60/15
xNESas schaul 108 (35)1e70/15

Δ fopt
f20, 20-D
1e1
82
1e0
46150
1e-1
3.1e6
1e-2
5.5e6
1e-3
5.5e6
1e-5
5.6e6
1e-7
5.6e6
#succ
14/15
ACOR liao 16 (4)1.6 (1)24 (22)27 (26)27 (41)26 (29)26 (34)1/15
BIPOPaCMA loshchilov 4.9 (1)4.8 (2)1.4 (0.6)0.95 (0.3)0.95 (0.3)0.95 (0.3)0.95 (0.3)15/15
BIPOPsaACM loshchilov 2.9 (0.5)2.1 (1)0.97 (0.7)0.87 (0.4)0.87 (0.4)0.86 (0.4)0.85 (0.4)15/15
CMAES posik 5.1 (1)156 (195)1e60/15
CMA brockhoff 4.8 (1)5.4 (2)0.79 (0.4)1.2 (1)1.2 (0.6)1.2 (1)1.2 (2)6/15
CMAa brockhoff 4.8 (1)3.2 (1)0.90 (0.4)1.1 (0.7)1.1 (0.6)1.1 (1.0)1.7 (2)5/15
CMAm brockhoff 3.4 (0.7)5.4 (3)1.1 (0.8)1.4 (1)1.4 (1)2.0 (2)3.3 (3)3/15
CMAma brockhoff 3.9 (0.7)3.0 (1)1.1 (0.7)5.0 (5)5.0 (6)5.0 (6)4.9 (3)2/15
CMAmah brockhoff 2.5 (0.8)3.4 (1)0.87 (0.4)2.4 (3)2.4 (2)3.2 (5)3.2 (4)3/15
CMAmh brockhoff 2.6 (0.8)6.1 (3)1.3 (0.7)10 (10)10 (14)10 (9)10 (10)1/15
DBRCGA chuang 34 (6)148 (126)2e60/15
DE-AUTO voglis 2.1 (0.5)3.4 (2)2e60/15
DE-BFGS voglis 6.3 (4)1.0 (1.0)2e60/15
DE-ROLL voglis 21 (18)0.84 (0.8)4.4 (7)5.3 (6)5.3 (6)5.3 (4)5.2 (4)1/15
DE-SIMPLEX voglis 21 (27)3.6 (3)2e60/15
DEAE posik 39 (9)56 (87)1e60/15
DE posik 51 (9)2.4 (1)0.79 (1)1e60/15
DEb posik 51 (9)2.4 (1)0.79 (0.6)1e60/15
DEctpb posik 55 (8)104 (82)4.8 (5)2.7 (3)2.7 (3)2.7 (4)2.7 (3)1/15
IPOPsaACM loshchilov 2.8 (0.5)1.7 (0.8)0.49 (0.2)↑10.46 (0.2)↑00.45 (0.2)↑00.45 (0.2)↑00.45 (0.2)↑015/15
JADE posik 24 (3)1.2 (0.2)0.46 (0.5)0.62 (0.4)0.85 (0.9)2.7 (2)1e60/15
JADEb posik 19 (3)0.56 (0.6)1e60/15
JADEctpb posik 24 (3)1.2 (0.2)0.46 (0.6)0.62 (0.7)0.85 (1)2.7 (3)1e60/15
MVDE melo 83 (11)4.3 (1)0.26 (0.4)0.30 (0.2)0.31 (0.2)0.36 (0.4)0.36 (0.4)6/15
NBIPOPaCMA loshchilov 4.3 (0.7)4.6 (2)1.1 (0.5)0.98 (0.6)0.98 (0.6)0.98 (0.6)0.98 (0.6)15/15
NIPOPaCMA loshchilov 4.5 (1)3.1 (1)0.73 (0.3)0.59 (0.2)↑00.59 (0.2)↑00.60 (0.2)↑00.60 (0.2)↑015/15
PSO-BFGS voglis 7.1 (1)0.87 (1)2e60/15
SNES schaul 3.1 (0.9)18 (19)7e60/15
xNES schaul 5.6 (2)1.1 (0.9)6e60/15
xNESas schaul 5.4 (3)1.1 (0.7)1e70/15

Δ fopt
f21, 20-D
1e1
561
1e0
6541
1e-1
14103
1e-2
14318
1e-3
14643
1e-5
15567
1e-7
17589
#succ
15/15
ACOR liao 2745 (8914)9938 (1e4)9927 (9041)9778 (9254)9561 (1e4)8994 (9315)7960 (8954)1/15
BIPOPaCMA loshchilov 7.8 (12)110 (57)72 (89)71 (88)69 (86)65 (81)58 (71)15/15
BIPOPsaACM loshchilov 2.6 (4)1.5 (1)6.0 (11)5.9 (11)5.8 (11)5.5 (10)4.8 (9)15/15
CMAES posik 5.4 (4)9.4 (10)5.5 (6)5.4 (6)5.3 (6)5.0 (5)4.5 (5)15/15
CMA brockhoff 5.0 (5)122 (178)57 (62)56 (80)55 (81)52 (39)46 (68)9/15
CMAa brockhoff 3.2 (4)95 (135)77 (109)76 (106)74 (121)70 (152)62 (65)8/15
CMAm brockhoff 3.5 (4)109 (165)80 (126)79 (82)77 (94)73 (108)65 (97)8/15
CMAma brockhoff 3.0 (5)92 (181)95 (122)94 (84)92 (238)86 (167)76 (133)7/15
CMAmah brockhoff 25 (22)124 (189)76 (124)75 (119)73 (65)69 (116)61 (68)8/15
CMAmh brockhoff 8.7 (7)102 (92)75 (127)74 (94)73 (125)69 (114)61 (100)8/15
DBRCGA chuang 103 (6)162 (259)97 (142)96 (118)95 (161)90 (129)81 (98)10/15
DE-AUTO voglis 50 (111)52 (72)37 (48)37 (48)36 (47)34 (44)30 (39)14/15
DE-BFGS voglis 10 (11)33 (56)17 (26)16 (26)16 (25)15 (24)205 (287)1/15
DE-ROLL voglis 84 (121)66 (79)66 (95)65 (81)64 (80)60 (77)53 (68)12/15
DE-SIMPLEX voglis 89 (131)208 (205)159 (334)157 (138)154 (240)145 (264)196 (228)5/15
DEAE posik 28 (53)26 (33)19 (40)19 (40)18 (39)17 (33)16 (28)13/15
DE posik 33 (64)45 (68)30 (35)30 (37)29 (35)28 (34)25 (38)13/15
DEb posik 33 (64)45 (68)30 (43)30 (52)29 (42)28 (47)25 (30)13/15
DEctpb posik 22 (11)139 (194)65 (72)64 (72)63 (86)61 (83)55 (101)8/15
IPOPsaACM loshchilov 2.6 (4)53 (94)157 (308)155 (303)151 (297)142 (279)126 (247)15/15
JADE posik 7.2 (2)33 (62)21 (38)20 (38)20 (36)19 (34)18 (32)13/15
JADEb posik 20 (34)24 (36)19 (22)18 (22)18 (22)17 (20)15 (18)14/15
JADEctpb posik 7.2 (2)33 (62)21 (35)20 (39)20 (37)19 (38)18 (28)13/15
MVDE melo 29 (17)64 (81)36 (74)44 (59)62 (85)73 (100)81 (105)7/15
NBIPOPaCMA loshchilov 1.9 (4)1.5 (1)13 (18)13 (18)12 (18)12 (17)10 (15)15/15
NIPOPaCMA loshchilov 2.5 (5)129 (193)135 (138)133 (136)130 (133)123 (126)109 (111)15/15
PSO-BFGS voglis 1.7 (1)0.64 (0.6)0.56 (0.9)0.56 (0.9)0.55 (0.9)0.57 (1)96 (133)1/15
SNES schaul 76 (71)93 (116)70 (84)69 (83)67 (81)63 (76)56 (67)15/15
xNES schaul 142 (281)112 (168)54 (75)54 (74)53 (72)50 (68)44 (60)15/15
xNESas schaul 45 (71)66 (112)37 (50)36 (50)35 (49)33 (46)30 (40)30/30

Δ fopt
f22, 20-D
1e1
467
1e0
5580
1e-1
23491
1e-2
24163
1e-3
24948
1e-5
26847
1e-7
1.3e5
#succ
12/15
ACOR liao 1.4e4 (2e4)3585 (3584)1e70/15
BIPOPaCMA loshchilov 37 (59)260 (240)273 (480)266 (482)257 (412)239 (400)48 (80)13/15
BIPOPsaACM loshchilov 7.7 (9)100 (96)178 (320)179 (311)173 (301)168 (274)35 (54)15/15
CMAES posik 3.8 (5)42 (96)142 (127)138 (210)133 (160)124 (144)25 (31)4/15
CMA brockhoff 12 (14)433 (937)1e60/15
CMAa brockhoff 10 (13)232 (504)1e60/15
CMAm brockhoff 7.0 (12)188 (268)1e60/15
CMAma brockhoff 6.7 (12)235 (556)1e60/15
CMAmah brockhoff 187 (29)185 (317)1e60/15
CMAmh brockhoff 6.9 (8)314 (413)1e60/15
DBRCGA chuang 100 (258)259 (255)392 (495)383 (331)372 (385)350 (464)70 (85)3/15
DE-AUTO voglis 128 (88)234 (231)281 (327)274 (411)265 (381)246 (274)216 (204)0/15
DE-BFGS voglis 5.7 (13)135 (214)151 (143)146 (137)142 (111)132 (117)2e60/15
DE-ROLL voglis 68 (139)199 (243)396 (361)385 (207)374 (300)348 (540)221 (223)0/15
DE-SIMPLEX voglis 38 (81)338 (642)1194 (1023)1161 (1388)1125 (983)1046 (1174)208 (252)0/15
DEAE posik 50 (121)123 (111)616 (660)599 (455)580 (671)539 (903)107 (109)1/15
DE posik 23 (10)92 (112)1e60/15
DEb posik 23 (10)92 (109)1e60/15
DEctpb posik 98 (14)282 (493)1e60/15
IPOPsaACM loshchilov 175 (98)978 (1800)2e70/15
JADE posik 25 (45)261 (358)638 (681)620 (724)601 (902)559 (307)1e60/15
JADEb posik 46 (66)75 (92)143 (145)139 (197)135 (164)126 (125)25 (21)4/15
JADEctpb posik 25 (45)261 (277)638 (543)620 (786)601 (711)559 (521)1e60/15
MVDE melo 40 (28)397 (315)1e60/15
NBIPOPaCMA loshchilov 32 (41)17 (16)51 (89)49 (86)48 (84)44 (78)8.8 (15)15/15
NIPOPaCMA loshchilov 42 (93)319 (438)861 (798)837 (1021)811 (814)754 (1280)150 (206)9/15
PSO-BFGS voglis 1.7 (2)3.0 (5)10 (13)9.3 (13)9.0 (13)8.6 (12)209 (271)0/15
SNES schaul 205 (254)227 (281)312 (278)303 (258)294 (335)317 (256)111 (74)4/15
xNES schaul 104 (171)231 (329)168 (197)163 (192)158 (141)147 (160)29 (29)12/15
xNESas schaul 50 (86)132 (213)226 (270)220 (238)213 (206)198 (185)39 (38)22/30

Δ fopt
f23, 20-D
1e1
3.0
1e0
1614
1e-1
67457
1e-2
3.7e5
1e-3
4.9e5
1e-5
8.1e5
1e-7
8.4e5
#succ
15/15
ACOR liao 1.9 (3)1e70/15
BIPOPaCMA loshchilov 5.0 (9)43 (44)1.2 (1)1.2 (0.8)1.4 (1)0.85 (0.7)0.90 (0.6)15/15
BIPOPsaACM loshchilov 3.2 (6)21 (13)0.61 (0.3)↑11.1 (0.6)1.4 (1)1.3 (1)1.3 (1)15/15
CMAES posik 3.1 (4)571 (574)63 (61)1e60/15
CMA brockhoff 3.6 (4)3e60/15
CMAa brockhoff 6.9 (5)1.1e4 (9175)556 (476)3e60/15
CMAm brockhoff 4.2 (5)1.1e4 (2e4)577 (750)3e60/15
CMAma brockhoff 2.6 (3)1.1e4 (2e4)255 (441)3e60/15
CMAmah brockhoff 3.1 (4)4163 (5238)515 (870)2e60/15
CMAmh brockhoff 3.0 (3)4205 (6017)519 (360)2e60/15
DBRCGA chuang 1.9 (2)415 (427)2e60/15
DE-AUTO voglis 2.4 (3)3.8 (3)36 (54)2e60/15
DE-BFGS voglis 2.3 (2)7.0 (7)54 (54)2e60/15
DE-ROLL voglis 2.0 (2)15 (14)2e60/15
DE-SIMPLEX voglis 1.8 (1)1.3 (0.9)★236 (58)2e60/15
DEAE posik 1.9 (2)1e60/15
DE posik 2.5 (2)1e60/15
DEb posik 2.5 (2)1e60/15
DEctpb posik 1.2 (0.7)1e60/15
IPOPsaACM loshchilov 4.6 (6)2.9e4 (4e4)906 (1213)2e70/15
JADE posik 2.2 (2)131 (68)1e60/15
JADEb posik 1.5 (1)673 (431)1e60/15
JADEctpb posik 2.2 (2)131 (68)1e60/15
MVDE melo 2.4 (3)1e60/15
NBIPOPaCMA loshchilov 3.3 (3)28 (34)0.86 (0.7)1.7 (0.5)1.4 (0.4)0.89 (0.2)0.90 (0.2)15/15
NIPOPaCMA loshchilov 4.0 (5)142 (65)3.9 (2)0.85 (0.5)0.72 (0.4)0.48 (0.2)↑00.50 (0.2)↑015/15
PSO-BFGS voglis 1.7 (2)4.7 (4)66 (81)2e60/15
SNES schaul 1.6 (2)102 (102)261 (225)7e60/15
xNES schaul 2.1 (2)6e60/15
xNESas schaul 1.6 (2)9.9e4 (2e5)1e70/30

Δ fopt
f24, 20-D
1e1
1.3e6
1e0
7.5e6
1e-1
5.2e7
1e-2
5.2e7
1e-3
5.2e7
1e-5
5.2e7
1e-7
5.2e7
#succ
3/15
ACOR liao 1e70/15
BIPOPaCMA loshchilov 1.00 (1)0.94 (0.9)2.8 (3)2.8 (3)2.8 (2)2.8 (4)2.8 (2)2/15
BIPOPsaACM loshchilov 0.99 (1)0.88 (0.7)0.80 (0.8)0.80 (1)0.80 (0.8)0.80 (0.8)0.79 (0.7)6/15
CMAES posik 1e60/15
CMA brockhoff 4e60/15
CMAa brockhoff 42 (58)4e60/15
CMAm brockhoff 12 (12)3.6 (4)4e60/15
CMAma brockhoff 19 (25)4e60/15
CMAmah brockhoff 42 (50)4e60/15
CMAmh brockhoff 42 (46)4e60/15
DBRCGA chuang 2e60/15
DE-AUTO voglis 2e60/15
DE-BFGS voglis 4.3 (6)2e60/15
DE-ROLL voglis 4.7 (4)2e60/15
DE-SIMPLEX voglis 22 (34)2e60/15
DEAE posik 1e60/15
DE posik 1e60/15
DEb posik 1e60/15
DEctpb posik 1e60/15
IPOPsaACM loshchilov 28 (54)38 (34)2e70/15
JADE posik 1e60/15
JADEb posik 1e60/15
JADEctpb posik 1e60/15
MVDE melo 1e60/15
NBIPOPaCMA loshchilov 1.3 (1.0)0.35 (0.3)↑10.61 (0.5)0.61 (0.6)0.61 (0.9)0.61 (0.4)0.61 (0.6)7/15
NIPOPaCMA loshchilov 1.6 (2)0.42 (0.4)↑10.35 (0.3)0.35 (0.3)0.35 (0.3)0.35 (0.3)0.35 (0.3)11/15
PSO-BFGS voglis 2e60/15
SNES schaul 12 (9)8e60/15
xNES schaul 6e60/15
xNESas schaul 1e70/30

Previous dimension | Dimension = 40 | First dimension

Δ fopt
f1, 40-D
1e1
83
1e0
83
1e-1
83
1e-2
83
1e-3
83
1e-5
83
1e-7
83
#succ
15/15
ACOR liao 53 (11)83 (13)114 (14)146 (20)177 (23)235 (18)296 (21)15/15
BIPOPaCMA loshchilov 9.4 (1)15 (2)21 (2)27 (2)33 (2)45 (3)58 (2)15/15
CMAES posik 9.4 (1)15 (0.8)21 (1)27 (1)33 (2)45 (1)57 (1)15/15
CMA brockhoff 10 (0.8)15 (2)21 (1)27 (1)33 (1)45 (1)57 (2)15/15
CMAa brockhoff 9.3 (0.8)15 (1)21 (1)27 (1)34 (1)46 (1)58 (2)15/15
CMAm brockhoff 7.1 (0.8)11 (0.8)16 (1)20 (1)24 (0.8)32 (1)41 (2)15/15
CMAma brockhoff 7.3 (0.8)11 (0.7)16 (0.9)20 (1)24 (1)33 (1)41 (1)15/15
CMAmah brockhoff 4.6 (0.5)7.3 (0.3)10 (0.8)13 (1.0)16 (0.9)21 (1.0)27 (1)15/15
CMAmh brockhoff 4.5 (0.5)7.4 (0.8)10 (0.6)13 (0.7)16 (0.6)21 (1)27 (1)15/15
DBRCGA chuang 229 (41)420 (42)625 (72)842 (73)1006 (66)1386 (60)1798 (130)15/15
DE-AUTO voglis 2.6 (0.1)2.6 (0.1)2.6 (0.1)2.6 (0.1)2.6 (0.1)2.6 (0.1)2.6 (0.1)15/15
DE-BFGS voglis 1.5 (0.2)1.6 (0)1.6 (0)1.6 (0)1.6 (0)1.6 (0)1.6 (0)15/15
DE-ROLL voglis 18 (17)53 (60)54 (61)54 (61)54 (61)54 (61)54 (61)15/15
DE-SIMPLEX voglis 152 (73)242 (81)319 (106)371 (93)431 (107)547 (104)1381 (772)15/15
DEAE posik 228 (31)378 (43)525 (42)686 (55)848 (42)1167 (62)1490 (71)15/15
DE posik 253 (23)425 (39)600 (52)775 (70)946 (69)1282 (63)1623 (87)15/15
DEb posik 253 (23)425 (39)600 (52)775 (70)946 (69)1282 (63)1623 (87)15/15
DEctpb posik 259 (27)448 (25)632 (29)825 (46)1013 (46)1401 (86)1777 (101)15/15
JADE posik 94 (4)152 (7)211 (7)267 (8)326 (7)439 (8)553 (10)15/15
JADEb posik 72 (5)127 (6)182 (7)239 (11)295 (11)410 (17)524 (13)15/15
JADEctpb posik 94 (4)152 (7)211 (7)267 (8)326 (7)439 (8)553 (10)15/15
MVDE melo 329 (23)568 (20)815 (18)1058 (13)1301 (18)1792 (19)2277 (32)15/15
NBIPOPaCMA loshchilov 9.5 (1)15 (1)22 (1)28 (1)34 (0.9)46 (2)58 (1)15/15
NIPOPaCMA loshchilov 10 (0.8)15 (1)21 (1.0)28 (1)34 (1)46 (2)58 (1)15/15
PSO-BFGS voglis 1.4 (0.2)1.6 (0)1.6 (0)1.6 (0)1.6 (0)1.6 (0)1.6 (0)15/15

Δ fopt
f2, 40-D
1e1
796
1e0
797
1e-1
799
1e-2
799
1e-3
800
1e-5
802
1e-7
804
#succ
15/15
ACOR liao 17 (2)20 (3)23 (3)26 (4)30 (4)36 (4)43 (4)15/15
BIPOPaCMA loshchilov 38 (3)45 (3)49 (3)52 (4)55 (3)57 (2)59 (2)15/15
CMAES posik 59 (3)69 (5)77 (6)82 (5)86 (3)89 (1)90 (1)15/15
CMA brockhoff 59 (7)69 (7)76 (6)81 (5)85 (4)89 (3)90 (3)15/15
CMAa brockhoff 38 (5)44 (5)48 (5)53 (4)55 (3)57 (2)59 (2)15/15
CMAm brockhoff 59 (5)69 (4)74 (4)79 (4)83 (4)85 (4)88 (2)15/15
CMAma brockhoff 36 (4)41 (5)46 (3)49 (3)51 (3)54 (1)55 (2)15/15
CMAmah brockhoff 35 (4)42 (5)47 (5)51 (4)52 (3)55 (2)56 (2)15/15
CMAmh brockhoff 49 (6)58 (6)64 (5)68 (4)71 (3)73 (2)74 (2)15/15
DBRCGA chuang 95 (13)113 (9)138 (17)153 (10)179 (12)216 (10)264 (8)15/15
DE-AUTO voglis 1.9 (0.8)★32.1 (0.9)★32.3 (0.9)★22.4 (0.8)★22.5 (0.9)★23.3 (0.5)★23.8 (0.7)★315/15
DE-BFGS voglis 35 (10)46 (12)55 (17)63 (16)71 (16)90 (18)1295 (2462)3/15
DE-ROLL voglis 20 (18)21 (18)21 (18)21 (18)21 (18)22 (17)26 (17)15/15
DE-SIMPLEX voglis 91 (12)102 (17)109 (19)115 (22)122 (16)134 (14)7.4e4 (9e4)0/15
DEAE posik 191 (24)218 (17)236 (14)253 (14)270 (16)303 (19)336 (17)15/15
DE posik 92 (10)110 (10)129 (12)147 (10)166 (10)201 (10)237 (11)15/15
DEb posik 92 (10)110 (10)129 (12)147 (10)166 (10)201 (10)237 (11)15/15
DEctpb posik 104 (8)124 (8)143 (6)163 (7)182 (8)221 (8)259 (9)15/15
JADE posik 37 (1)43 (2)49 (2)55 (2)61 (2)73 (3)84 (4)15/15
JADEb posik 32 (2)38 (2)44 (2)50 (3)56 (3)68 (3)80 (3)15/15
JADEctpb posik 37 (1)43 (2)49 (2)55 (2)61 (2)73 (3)84 (4)15/15
MVDE melo 124 (2)149 (3)174 (3)199 (2)225 (4)275 (3)325 (4)15/15
NBIPOPaCMA loshchilov 37 (3)43 (4)47 (5)51 (5)53 (4)57 (2)59 (2)15/15
NIPOPaCMA loshchilov 37 (4)43 (4)48 (4)51 (4)53 (3)57 (2)58 (1)15/15
PSO-BFGS voglis 86 (13)101 (15)115 (19)132 (21)156 (25)188 (13)2187 (2489)3/15

Δ fopt
f3, 40-D
1e1
15526
1e0
15602
1e-1
15612
1e-2
15641
1e-3
15646
1e-5
15651
1e-7
15656
#succ
15/15
ACOR liao 1e70/15
BIPOPaCMA loshchilov 2395 (3011)4e70/15
CMAES posik 2e60/15
CMA brockhoff 5301 (4819)6e60/15
CMAa brockhoff 5158 (6274)6e60/15
CMAm brockhoff 6e60/15
CMAma brockhoff 6e60/15
CMAmah brockhoff 4723 (6051)5e60/15
CMAmh brockhoff 2268 (2143)5e60/15
DBRCGA chuang 4e60/15
DE-AUTO voglis 886 (1174)4e60/15
DE-BFGS voglis 486 (475)3823 (3592)4e60/15
DE-ROLL voglis 110 (106)1847 (1989)3774 (4680)3767 (3839)3766 (3454)3764 (3581)3763 (3644)1/15
DE-SIMPLEX voglis 282 (204)4e60/15
DEAE posik 2e60/15
DE posik 2e60/15
DEb posik 2e60/15
DEctpb posik 2e60/15
JADE posik 10 (0.4)13 (0.2)15 (0.2)16 (0.2)17 (0.2)20 (0.2)22 (0.2)15/15
JADEb posik 13 (14)44 (52)114 (122)115 (77)116 (135)119 (180)121 (192)10/15
JADEctpb posik 10 (0.4)13 (0.2)15 (0.2)16 (0.2)17 (0.2)20 (0.2)22 (0.2)15/15
MVDE melo 1e60/15
NBIPOPaCMA loshchilov 8178 (8271)4e70/15
NIPOPaCMA loshchilov 4615 (6980)4e70/15
PSO-BFGS voglis 4e60/15

Δ fopt
f4, 40-D
1e1
15536
1e0
15601
1e-1
15659
1e-2
15678
1e-3
15703
1e-5
15733
1e-7
2.8e5
#succ
6/15
ACOR liao 1e70/15
BIPOPaCMA loshchilov 4e70/15
CMAES posik 2e60/15
CMA brockhoff 6e60/15
CMAa brockhoff 5e60/15
CMAm brockhoff 6e60/15
CMAma brockhoff 6e60/15
CMAmah brockhoff 5e60/15
CMAmh brockhoff 5e60/15
DBRCGA chuang 4e60/15
DE-AUTO voglis 4e60/15
DE-BFGS voglis 4e60/15
DE-ROLL voglis 464 (389)4e60/15
DE-SIMPLEX voglis 4e60/15
DEAE posik 2e60/15
DE posik 2e60/15
DEb posik 2e60/15
DEctpb posik 2e60/15
JADE posik 12 (0.3)16 (0.3)18 (0.3)19 (0.2)21 (0.2)24 (0.2)1.5 (0.0)15/15
JADEb posik 605 (572)2e60/15
JADEctpb posik 12 (0.3)16 (0.3)18 (0.3)19 (0.2)21 (0.2)24 (0.2)1.5 (0.0)15/15
MVDE melo 1e60/15
NBIPOPaCMA loshchilov 4e70/15
NIPOPaCMA loshchilov 4e70/15
PSO-BFGS voglis 4e60/15

Δ fopt
f5, 40-D
1e1
98
1e0
116
1e-1
120
1e-2
121
1e-3
121
1e-5
121
1e-7
121
#succ
15/15
ACOR liao 11 (2)12 (2)12 (2)12 (2)12 (2)12 (2)12 (2)15/15
BIPOPaCMA loshchilov 4.7 (0.7)4.4 (0.8)4.4 (0.7)4.4 (0.6)4.4 (0.6)4.4 (0.6)4.4 (0.6)15/15
CMAES posik 4.5 (0.4)4.5 (0.5)4.5 (0.4)4.5 (0.4)4.5 (0.4)4.5 (0.4)4.5 (0.4)15/15
CMA brockhoff 4.5 (0.5)4.3 (0.6)4.3 (0.5)4.2 (0.5)4.2 (0.5)4.2 (0.5)4.2 (0.5)15/15
CMAa brockhoff 4.7 (1.0)4.6 (0.7)4.5 (0.7)4.5 (0.7)4.5 (0.7)4.5 (0.7)4.5 (0.7)15/15
CMAm brockhoff 4.3 (0.4)4.2 (0.3)4.0 (0.3)4.0 (0.3)4.0 (0.3)4.0 (0.3)4.0 (0.3)15/15
CMAma brockhoff 4.0 (0.7)4.1 (0.6)4.0 (0.5)4.0 (0.5)4.0 (0.5)4.0 (0.5)4.0 (0.5)15/15
CMAmah brockhoff 2.7 (0.4)2.7 (0.4)2.7 (0.6)2.7 (0.5)2.7 (0.5)2.7 (0.5)2.7 (0.5)15/15
CMAmh brockhoff 2.8 (0.5)2.8 (0.7)2.7 (0.7)2.7 (0.7)2.7 (0.7)2.7 (0.7)2.7 (0.7)15/15
DBRCGA chuang 184 (49)208 (66)244 (93)273 (128)299 (167)342 (231)378 (309)15/15
DE-AUTO voglis 2.1 (0.1)1.8 (0.1)1.7 (0.1)1.7 (0.1)1.7 (0.1)1.7 (0.1)1.7 (0.1)15/15
DE-BFGS voglis 49 (36)52 (37)53 (40)53 (40)53 (40)56 (40)56 (40)15/15
DE-ROLL voglis 8.3 (8)7.1 (7)7.0 (7)7.1 (7)7.5 (8)8.1 (9)8.8 (10)15/15
DE-SIMPLEX voglis 841 (189)1330 (262)4385 (1516)4878 (1572)5458 (1741)6146 (2140)1.1e5 (1e5)2/15
DEAE posik 50 (19)47 (21)45 (20)45 (20)45 (20)45 (20)45 (20)15/15
DE posik 43 (7)46 (10)45 (9)45 (9)45 (9)45 (9)45 (9)15/15
DEb posik 43 (7)46 (10)45 (9)45 (9)45 (9)45 (9)45 (9)15/15
DEctpb posik 59 (7)57 (7)56 (8)56 (8)56 (8)56 (8)56 (8)15/15
JADE posik 62 (7)62 (7)62 (7)62 (4)62 (4)62 (4)62 (4)15/15
JADEb posik 39 (4)39 (4)40 (6)40 (5)40 (5)40 (5)40 (5)15/15
JADEctpb posik 62 (7)62 (7)62 (7)62 (4)62 (4)62 (4)62 (4)15/15
MVDE melo 336 (17)415 (18)524 (27)635 (30)750 (38)977 (53)1202 (40)15/15
NBIPOPaCMA loshchilov 4.6 (0.9)4.5 (0.8)4.4 (0.7)4.4 (0.7)4.4 (0.7)4.4 (0.7)4.4 (0.7)15/15
NIPOPaCMA loshchilov 4.9 (0.8)4.6 (0.8)4.5 (0.8)4.4 (0.8)4.4 (0.8)4.4 (0.8)4.4 (0.8)15/15
PSO-BFGS voglis 77 (74)94 (78)93 (75)102 (81)103 (81)103 (81)106 (81)15/15

Δ fopt
f6, 40-D
1e1
3507
1e0
5523
1e-1
7168
1e-2
9470
1e-3
11538
1e-5
15007
1e-7
19222
#succ
15/15
ACOR liao 14 (3)13 (2)13 (1)12 (1)12 (1)12 (1)12 (1)15/15
BIPOPaCMA loshchilov 1.6 (0.2)1.5 (0.3)1.4 (0.2)1.3 (0.2)1.3 (0.2)1.3 (0.1)1.3 (0.1)15/15
CMAES posik 1.6 (0.3)1.5 (0.2)1.5 (0.2)1.4 (0.2)1.3 (0.1)1.4 (0.1)1.4 (0.1)15/15
CMA brockhoff 1.6 (0.2)1.4 (0.2)1.4 (0.2)1.3 (0.2)1.3 (0.1)1.4 (0.1)1.3 (0.1)15/15
CMAa brockhoff 1.6 (0.2)1.4 (0.2)1.4 (0.1)1.3 (0.1)1.3 (0.1)1.3 (0.1)1.3 (0.1)15/15
CMAm brockhoff 1.5 (0.2)1.3 (0.2)1.3 (0.2)1.3 (0.1)1.3 (0.1)1.3 (0.1)1.3 (0.1)15/15
CMAma brockhoff 1.5 (0.2)1.3 (0.2)1.3 (0.2)1.2 (0.1)1.2 (0.1)1.2 (0.1)1.2 (0.1)15/15
CMAmah brockhoff 1.2 (0.2)1.2 (0.3)1.3 (0.3)1.3 (0.3)1.3 (0.3)1.5 (0.3)1.6 (0.2)15/15
CMAmh brockhoff 1.4 (0.3)1.4 (0.3)1.5 (0.3)1.5 (0.3)1.6 (0.3)1.9 (0.4)2.2 (0.5)15/15
DBRCGA chuang 44 (16)55 (25)63 (24)67 (21)72 (18)79 (21)79 (16)15/15
DE-AUTO voglis 6.5 (5)8.9 (3)13 (5)14 (6)22 (5)37 (15)479 (520)0/15
DE-BFGS voglis 62 (65)84 (101)316 (479)404 (637)341 (607)278 (269)4e60/15
DE-ROLL voglis 17 (12)25 (14)51 (30)136 (115)348 (418)4e60/15
DE-SIMPLEX voglis 36 (11)43 (10)52 (27)143 (219)424 (554)4e60/15
DEAE posik 75 (9)67 (8)67 (7)62 (5)61 (4)61 (4)75 (52)10/15
DE posik 264 (58)258 (41)433 (218)3153 (1426)2e60/15
DEb posik 264 (58)258 (41)433 (158)3153 (2851)2e60/15
DEctpb posik 80 (6)70 (4)68 (3)63 (2)61 (2)61 (2)178 (183)5/15
JADE posik 13 (0.7)13 (0.8)13 (0.7)13 (0.6)12 (0.8)12 (1)12 (0.8)15/15
JADEb posik 456 (394)2e60/15
JADEctpb posik 13 (0.7)13 (0.8)13 (0.7)13 (0.6)12 (0.8)12 (1)12 (0.8)15/15
MVDE melo 70 (7)67 (10)70 (7)68 (7)69 (7)498 (717)1e60/15
NBIPOPaCMA loshchilov 1.5 (0.2)1.4 (0.2)1.3 (0.1)1.2 (0.1)1.2 (0.1)1.2 (0.1)1.2 (0.1)15/15
NIPOPaCMA loshchilov 1.6 (0.3)1.4 (0.2)1.4 (0.1)1.3 (0.1)1.3 (0.1)1.3 (0.1)1.2 (0.1)15/15
PSO-BFGS voglis 406 (572)297 (374)234 (281)393 (636)330 (440)274 (344)4e60/15

Δ fopt
f7, 40-D
1e1
10698
1e0
17839
1e-1
41037
1e-2
66294
1e-3
66294
1e-5
66294
1e-7
68145
#succ
15/15
ACOR liao 1204 (2599)1e70/15
BIPOPaCMA loshchilov 1.2 (0.9)4.5 (2)2.4 (0.9)1.5 (0.6)1.5 (0.6)1.5 (0.6)1.5 (0.6)15/15
CMAES posik 8.5 (8)2e60/15
CMA brockhoff 1.6 (0.8)4.7 (2)2.6 (2)1.7 (1.0)1.7 (1)1.7 (1)1.6 (1.0)15/15
CMAa brockhoff 1.2 (0.6)3.2 (1)1.6 (0.5)1.0 (0.3)1.0 (0.3)1.0 (0.3)1.0 (0.3)15/15
CMAm brockhoff 1.5 (0.7)4.8 (1)2.4 (0.2)1.6 (0.1)1.6 (0.1)1.6 (0.1)1.5 (0.1)15/15
CMAma brockhoff 1.1 (0.5)2.8 (1)1.5 (0.5)0.95 (0.3)0.95 (0.3)0.95 (0.3)0.93 (0.3)15/15
CMAmah brockhoff 1.7 (0.6)3.3 (1)1.7 (0.5)1.1 (0.3)1.1 (0.3)1.1 (0.3)1.1 (0.3)15/15
CMAmh brockhoff 2.0 (0.6)5.2 (0.4)2.5 (0.2)1.6 (0.1)1.6 (0.1)1.6 (0.1)1.6 (0.1)15/15
DBRCGA chuang 4e60/15
DE-AUTO voglis 211 (263)4e60/15
DE-BFGS voglis 4e60/15
DE-ROLL voglis 287 (395)4e60/15
DE-SIMPLEX voglis 4e60/15
DEAE posik 4.5 (1)104 (113)137 (171)87 (106)87 (121)87 (76)84 (103)4/15
DE posik 37 (15)2e60/15
DEb posik 37 (15)2e60/15
DEctpb posik 30 (6)198 (278)341 (546)215 (141)215 (353)215 (202)210 (247)2/15
JADE posik 219 (280)2e60/15
JADEb posik 2e60/15
JADEctpb posik 219 (188)2e60/15
MVDE melo 29 (10)825 (716)1e60/15
NBIPOPaCMA loshchilov 1.2 (0.9)3.2 (0.7)1.8 (0.6)1.2 (0.4)1.2 (0.4)1.2 (0.4)1.1 (0.4)15/15
NIPOPaCMA loshchilov 0.89 (0.8)3.2 (1.0)1.9 (0.5)1.2 (0.3)1.2 (0.3)1.2 (0.3)1.2 (0.3)15/15
PSO-BFGS voglis 4e60/15

Δ fopt
f8, 40-D
1e1
7080
1e0
10655
1e-1
11012
1e-2
11265
1e-3
11430
1e-5
11701
1e-7
11969
#succ
15/15
ACOR liao 48 (34)382 (488)375 (694)375 (466)379 (669)389 (864)399 (437)11/15
BIPOPaCMA loshchilov 5.5 (0.6)6.1 (4)6.3 (4)6.3 (4)6.3 (4)6.2 (3)6.2 (3)15/15
CMAES posik 7.3 (0.9)6.6 (0.6)6.8 (0.6)6.8 (0.6)6.8 (0.6)6.8 (0.6)6.8 (0.5)15/15
CMA brockhoff 7.0 (0.4)6.4 (0.3)6.6 (0.3)6.6 (0.3)6.6 (0.2)6.6 (0.2)6.6 (0.2)15/15
CMAa brockhoff 5.4 (0.5)4.6 (0.3)4.8 (0.3)4.8 (0.3)4.8 (0.3)4.8 (0.3)4.8 (0.3)15/15
CMAm brockhoff 7.1 (1)7.5 (5)7.6 (5)7.6 (4)7.6 (4)7.6 (4)7.6 (4)15/15
CMAma brockhoff 5.1 (0.3)4.9 (0.4)5.0 (0.4)5.0 (0.4)5.0 (0.4)5.0 (0.3)5.0 (0.3)15/15
CMAmah brockhoff 4.2 (0.8)4.3 (3)4.4 (3)4.4 (3)4.4 (3)4.4 (3)4.4 (3)15/15
CMAmh brockhoff 5.2 (1)5.2 (2)5.3 (2)5.3 (2)5.4 (2)5.4 (2)5.4 (2)15/15
DBRCGA chuang 73 (55)175 (196)181 (188)190 (196)199 (187)219 (180)280 (348)10/15
DE-AUTO voglis 11 (3)11 (2)11 (3)11 (3)12 (3)12 (3)37 (47)14/15
DE-BFGS voglis 10 (3)31 (49)30 (47)30 (46)30 (46)30 (44)31 (43)14/15
DE-ROLL voglis 31 (19)40 (35)43 (33)44 (33)45 (34)46 (29)159 (116)11/15
DE-SIMPLEX voglis 23 (21)65 (100)66 (96)66 (94)67 (93)69 (90)4e60/15
DEAE posik 57 (4)52 (2)53 (2)54 (2)54 (2)55 (2)56 (2)15/15
DE posik 172 (7)174 (7)200 (96)661 (754)2e60/15
DEb posik 172 (7)174 (7)200 (96)661 (622)2e60/15
DEctpb posik 148 (5)136 (5)143 (5)152 (6)160 (7)1277 (1239)2e60/15
JADE posik 32 (1)27 (0.8)28 (0.7)28 (0.7)28 (0.8)29 (0.9)30 (1)15/15
JADEb posik 22 (8)31 (22)31 (21)32 (21)32 (20)33 (20)35 (19)15/15
JADEctpb posik 32 (1)27 (0.8)28 (0.7)28 (0.7)28 (0.8)29 (0.9)30 (1)15/15
MVDE melo 1e60/15
NBIPOPaCMA loshchilov 5.5 (0.7)6.5 (4)6.6 (4)6.6 (3)6.6 (3)6.6 (3)6.6 (3)15/15
NIPOPaCMA loshchilov 5.5 (0.4)7.8 (8)7.9 (8)7.9 (8)7.8 (8)7.8 (8)7.8 (8)15/15
PSO-BFGS voglis 13 (4)42 (7)41 (7)41 (6)41 (6)41 (9)41 (15)14/15

Δ fopt
f9, 40-D
1e1
6122
1e0
12982
1e-1
13300
1e-2
13496
1e-3
13651
1e-5
13909
1e-7
14142
#succ
15/15
ACOR liao 187 (13)254 (387)295 (376)359 (373)433 (366)589 (366)798 (364)5/15
BIPOPaCMA loshchilov 6.0 (0.8)4.5 (3)4.6 (3)4.7 (3)4.7 (3)4.7 (3)4.7 (3)15/15
CMAES posik 8.5 (0.9)5.8 (0.5)6.0 (0.4)6.0 (0.5)6.1 (0.4)6.1 (0.4)6.1 (0.4)15/15
CMA brockhoff 8.2 (1)6.2 (4)6.4 (4)6.5 (4)6.5 (4)6.5 (4)6.5 (4)15/15
CMAa brockhoff 6.3 (0.6)4.8 (0.3)5.0 (0.3)5.0 (0.3)5.0 (0.3)5.0 (0.3)5.0 (0.2)15/15
CMAm brockhoff 8.2 (1)6.3 (4)6.4 (4)6.5 (4)6.5 (4)6.5 (4)6.5 (4)15/15
CMAma brockhoff 5.8 (0.5)4.3 (3)4.4 (3)4.5 (3)4.5 (3)4.5 (3)4.5 (3)15/15
CMAmah brockhoff 4.7 (0.7)4.0 (2)4.2 (2)4.2 (2)4.2 (2)4.2 (2)4.2 (2)15/15
CMAmh brockhoff 6.1 (2)5.4 (4)5.5 (4)5.6 (4)5.6 (4)5.6 (3)5.6 (3)15/15
DBRCGA chuang 4e60/15
DE-AUTO voglis 14 (5)11 (3)11 (4)12 (4)12 (4)13 (4)37 (46)11/15
DE-BFGS voglis 16 (5)19 (11)19 (10)20 (10)20 (10)20 (9)41 (48)13/15
DE-ROLL voglis 58 (10)43 (7)48 (7)50 (8)51 (8)68 (26)1255 (1761)0/15
DE-SIMPLEX voglis 78 (18)164 (171)166 (171)168 (170)170 (241)177 (160)4e60/15
DEAE posik 66 (4)43 (2)44 (2)45 (2)46 (2)47 (2)48 (2)15/15
DE posik 2e60/15
DEb posik 2e60/15
DEctpb posik 2e60/15
JADE posik 100 (6)60 (3)62 (3)63 (3)63 (3)64 (3)64 (3)15/15
JADEb posik 123 (16)146 (83)163 (87)250 (151)291 (225)525 (578)2114 (2546)0/15
JADEctpb posik 100 (6)60 (3)62 (3)63 (3)63 (3)64 (3)64 (3)15/15
MVDE melo 1e60/15
NBIPOPaCMA loshchilov 6.3 (0.7)4.6 (3)4.8 (3)4.8 (3)4.8 (3)4.9 (3)4.9 (3)15/15
NIPOPaCMA loshchilov 6.3 (0.8)5.0 (3)5.1 (3)5.2 (3)5.2 (3)5.2 (3)5.2 (3)15/15
PSO-BFGS voglis 19 (15)20 (18)21 (16)21 (16)22 (16)22 (15)43 (31)14/15

Δ fopt
f10, 40-D
1e1
25536
1e0
29762
1e-1
35676
1e-2
51579
1e-3
56007
1e-5
65128
1e-7
70824
#succ
15/15
ACOR liao 1e70/15
BIPOPaCMA loshchilov 1.2 (0.1)1.2 (0.1)1.1 (0.1)0.78 (0.1)↑00.77 (0.0)↑00.70 (0.0)↑00.66 (0.0)↑015/15
CMAES posik 1.9 (0.2)1.9 (0.2)1.7 (0.1)1.2 (0.1)1.2 (0.1)1.1 (0.0)1.0 (0.0)15/15
CMA brockhoff 1.9 (0.2)1.9 (0.2)1.7 (0.2)1.2 (0.1)1.2 (0.1)1.1 (0.0)1.0 (0.0)15/15
CMAa brockhoff 1.2 (0.1)1.2 (0.1)1.1 (0.1)0.81 (0.0)↑00.79 (0.0)↑00.71 (0.0)↑00.67 (0.0)↑015/15
CMAm brockhoff 1.8 (0.2)1.8 (0.2)1.7 (0.2)1.2 (0.1)1.2 (0.1)1.1 (0.0)0.99 (0.0)15/15
CMAma brockhoff 1.1 (0.1)1.1 (0.1)1.0 (0.0)0.75 (0.0)↑00.73 (0.0)↑00.66 (0.0)↑00.62 (0.0)↑015/15
CMAmah brockhoff 1.1 (0.1)1.2 (0.1)1.1 (0.1)0.79 (0.0)↑00.76 (0.0)↑00.67 (0.0)↑00.63 (0.0)↑015/15
CMAmh brockhoff 1.5 (0.2)1.6 (0.1)1.5 (0.1)1.1 (0.1)1.0 (0.0)0.91 (0.0)↑00.84 (0.0)↑015/15
DBRCGA chuang 4e60/15
DE-AUTO voglis 137 (93)2002 (1951)4e60/15
DE-BFGS voglis 33 (47)40 (39)64 (75)58 (82)65 (95)57 (67)187 (228)0/15
DE-ROLL voglis 4e60/15
DE-SIMPLEX voglis 4e60/15
DEAE posik 6.1 (0.9)5.8 (0.6)5.3 (0.5)3.9 (0.3)3.8 (0.3)3.7 (0.2)3.8 (0.2)15/15
DE posik 2e60/15
DEb posik 2e60/15
DEctpb posik 2e60/15
JADE posik 47 (9)99 (91)275 (267)2e60/15
JADEb posik 65 (37)159 (121)839 (1121)2e60/15
JADEctpb posik 47 (9)99 (124)275 (292)2e60/15
MVDE melo 1e60/15
NBIPOPaCMA loshchilov 1.1 (0.1)1.1 (0.1)1.1 (0.1)0.79 (0.0)↑00.77 (0.0)↑00.71 (0.0)↑00.67 (0.0)↑015/15
NIPOPaCMA loshchilov 1.2 (0.1)1.2 (0.1)1.1 (0.1)0.79 (0.0)↑00.77 (0.0)↑00.70 (0.0)↑00.67 (0.0)↑015/15
PSO-BFGS voglis 114 (129)192 (383)160 (187)111 (128)103 (128)89 (77)837 (918)0/15

Δ fopt
f11, 40-D
1e1
2368
1e0
4855
1e-1
11681
1e-2
25315
1e-3
29749
1e-5
38949
1e-7
48211
#succ
15/15
ACOR liao 7811 (8891)2.9e4 (4e4)1.2e4 (1e4)1e70/15
BIPOPaCMA loshchilov 5.0 (0.3)2.6 (0.1)1.2 (0.0)0.57 (0.0)↑00.51 (0.0)↑00.42 (0.0)↑00.37 (1e-2)↑015/15
CMAES posik 16 (3)8.2 (2)3.6 (0.8)1.7 (0.3)1.5 (0.3)1.2 (0.2)1.0 (0.2)15/15
CMA brockhoff 15 (2)7.8 (1)3.4 (0.4)1.7 (0.2)1.5 (0.2)1.2 (0.1)1.00 (0.1)15/15
CMAa brockhoff 5.0 (0.2)2.7 (0.1)1.2 (0.0)0.57 (0.0)↑00.51 (0.0)↑00.42 (9e-3)↑00.37 (6e-3)↑015/15
CMAm brockhoff 16 (5)8.6 (2)3.7 (0.9)1.8 (0.4)1.6 (0.4)1.3 (0.3)1.1 (0.3)15/15
CMAma brockhoff 4.6 (0.3)2.4 (0.1)1.1 (0.0)0.52 (0.0)↑00.46 (0.0)↑00.38 (0.0)↑00.33 (0.0)↑015/15
CMAmah brockhoff 5.4 (0.3)2.8 (0.1)1.2 (0.1)0.59 (0.0)↑00.52 (0.0)↑00.43 (0.0)↑00.36 (0.0)↑015/15
CMAmh brockhoff 17 (2)8.9 (0.9)3.9 (0.4)1.9 (0.2)1.7 (0.1)1.3 (0.1)1.1 (0.1)15/15
DBRCGA chuang 597 (135)443 (22)228 (9)122 (3)112 (2)96 (1)4e60/15
DE-AUTO voglis 0.17 (0.0)↑00.10 (1e-2)↑00.05 (6e-3)↑00.03 (0.0)↑00.04 (0.0)↑00.04 (6e-3)↑00.07 (0.1)↑015/15
DE-BFGS voglis 0.19 (0.2)↑00.11 (0.1)↑00.05 (0.0)↑00.03 (0.0)↑00.03 (0.0)↑00.03 (0.0)↑00.03 (9e-3)↑013/15
DE-ROLL voglis 8090 (7115)4e60/15
DE-SIMPLEX voglis 914 (506)4e60/15
DEAE posik 19 (5)13 (3)6.4 (1)3.5 (0.6)3.4 (0.5)3.3 (0.3)3.2 (0.2)15/15
DE posik 2e60/15
DEb posik 2e60/15
DEctpb posik 2e60/15
JADE posik 247 (428)131 (212)59 (88)30 (41)27 (35)24 (26)22 (21)12/15
JADEb posik 470 (441)243 (213)107 (88)53 (43)47 (68)40 (27)35 (22)10/15
JADEctpb posik 247 (424)131 (209)59 (89)30 (42)27 (35)24 (26)22 (22)12/15
MVDE melo 1e60/15
NBIPOPaCMA loshchilov 5.0 (0.2)2.7 (0.1)1.2 (0.0)0.58 (0.0)↑00.51 (0.0)↑00.43 (8e-3)↑00.37 (7e-3)↑015/15
NIPOPaCMA loshchilov 5.0 (0.2)2.7 (0.1)1.2 (0.0)0.57 (0.0)↑00.51 (9e-3)↑00.42 (9e-3)↑00.37 (9e-3)↑015/15
PSO-BFGS voglis 0.35 (0.5)0.19 (0.2)↑00.09 (0.1)↑00.04 (0.0)↑00.04 (0.0)↑00.04 (0.0)↑00.04 (0.0)↑012/15

Δ fopt
f12, 40-D
1e1
4169
1e0
7452
1e-1
9174
1e-2
10751
1e-3
13146
1e-5
22758
1e-7
25192
#succ
15/15
ACOR liao 2104 (3598)8726 (1e4)1e70/15
BIPOPaCMA loshchilov 1.9 (1)1.9 (1)2.2 (1)2.2 (0.9)2.1 (0.7)1.5 (0.4)1.5 (0.4)15/15
CMAES posik 2.0 (2)2.3 (2)2.6 (2)2.6 (1)2.6 (1)1.9 (0.7)2.0 (0.6)15/15
CMA brockhoff 1.4 (1)1.7 (2)2.4 (1)2.4 (1)2.4 (1)1.8 (0.6)1.9 (0.6)15/15
CMAa brockhoff 2.3 (1)2.0 (1)2.2 (1)2.2 (1)2.1 (0.9)1.5 (0.5)1.5 (0.5)15/15
CMAm brockhoff 1.8 (1)2.2 (2)2.5 (2)2.6 (2)2.5 (2)1.9 (1.0)2.0 (0.9)15/15
CMAma brockhoff 1.3 (1)1.9 (0.6)2.1 (0.6)2.1 (0.5)1.9 (0.5)1.4 (0.3)1.4 (0.3)15/15
CMAmah brockhoff 0.94 (1)1.2 (0.9)1.4 (0.5)1.5 (0.4)1.4 (0.3)1.0 (0.2)1.1 (0.2)15/15
CMAmh brockhoff 1.4 (2)1.8 (2)2.3 (2)2.4 (2)2.4 (2)1.9 (1)2.0 (1)15/15
DBRCGA chuang 271 (482)1093 (1073)890 (1418)5224 (5953)4e60/15
DE-AUTO voglis 1.3 (2)1.2 (1)1.3 (1)1.8 (2)4.3 (4)7.1 (6)54 (80)7/15
DE-BFGS voglis 3.6 (2)2.6 (1)2.8 (2)3.4 (1)8.4 (8)107 (140)4e60/15
DE-ROLL voglis 21 (46)13 (26)13 (23)13 (19)12 (15)22 (19)132 (158)6/15
DE-SIMPLEX voglis 26 (22)41 (44)51 (41)57 (36)114 (113)4e60/15
DEAE posik 25 (2)18 (4)19 (5)19 (5)18 (4)13 (2)14 (2)15/15
DE posik 227 (273)233 (286)250 (239)391 (426)715 (506)2e60/15
DEb posik 227 (241)233 (343)250 (222)391 (466)715 (696)2e60/15
DEctpb posik 209 (242)238 (310)508 (572)554 (604)2e60/15
JADE posik 29 (46)44 (38)56 (18)56 (15)51 (12)35 (6)35 (5)15/15
JADEb posik 49 (98)101 (150)102 (118)95 (93)93 (78)62 (49)61 (48)12/15
JADEctpb posik 29 (46)44 (38)56 (18)56 (15)51 (12)35 (6)35 (5)15/15
MVDE melo 100 (121)395 (403)733 (846)1327 (1281)1e60/15
NBIPOPaCMA loshchilov 2.3 (1)2.2 (1)2.4 (1.0)2.3 (0.9)2.2 (0.7)1.5 (0.4)1.5 (0.4)15/15
NIPOPaCMA loshchilov 1.9 (2)2.0 (1)2.2 (1)2.2 (0.9)2.1 (0.7)1.5 (0.4)1.5 (0.4)15/15
PSO-BFGS voglis 12 (8)11 (10)14 (11)14 (9)30 (23)406 (363)4e60/15

Δ fopt
f13, 40-D
1e1
2029
1e0
6916
1e-1
8734
1e-2
11861
1e-3
71936
1e-5
98467
1e-7
1.2e5
#succ
15/15
ACOR liao 1802 (2465)2896 (3615)7446 (1e4)1.2e4 (1e4)1e70/15
BIPOPaCMA loshchilov 2.0 (0.2)3.8 (3)5.3 (4)6.5 (5)1.3 (0.9)1.6 (1)2.0 (1)15/15
CMAES posik 2.7 (4)3.8 (3)7.2 (8)16 (23)5.9 (4)66 (80)2e60/15
CMA brockhoff 2.1 (0.1)3.6 (5)8.6 (11)9.3 (9)2.5 (2)3.0 (2)3.8 (1)15/15
CMAa brockhoff 2.1 (0.3)2.8 (2)4.0 (4)5.5 (6)1.2 (1)1.6 (0.7)1.8 (0.7)15/15
CMAm brockhoff 1.7 (0.1)3.3 (4)7.2 (9)9.0 (6)3.3 (2)4.3 (1)4.1 (0.8)15/15
CMAma brockhoff 2.0 (3)2.2 (2)3.6 (2)4.2 (2)0.93 (0.5)1.8 (1)1.9 (0.6)15/15
CMAmah brockhoff 1.1 (0.2)2.7 (3)5.9 (3)5.4 (4)1.4 (1)1.5 (0.9)1.9 (0.8)15/15
CMAmh brockhoff 1.1 (0.1)1.9 (3)5.6 (6)11 (9)3.3 (2)3.0 (1)2.8 (1)15/15
DBRCGA chuang 459 (988)408 (445)841 (1175)4840 (5564)4e60/15
DE-AUTO voglis 1.1 (0.2)1.3 (1)2.2 (2)4.5 (2)1.3 (1.0)12 (14)153 (207)1/15
DE-BFGS voglis 9.4 (4)4.3 (0.6)6.5 (0.7)7.8 (0.8)12 (28)120 (173)4e60/15
DE-ROLL voglis 15 (20)6.0 (6)7.1 (5)7.0 (4)2.3 (2)31 (35)470 (570)0/15
DE-SIMPLEX voglis 30 (21)21 (20)28 (20)97 (177)4e60/15
DEAE posik 33 (3)14 (1)14 (0.9)12 (0.8)2.4 (0.1)2.3 (0.1)2.3 (0.1)15/15
DE posik 54 (7)77 (101)386 (346)573 (507)2e60/15
DEb posik 54 (7)77 (101)386 (415)573 (718)2e60/15
DEctpb posik 60 (4)27 (3)145 (159)245 (237)201 (215)2e60/15
JADE posik 74 (64)77 (145)283 (293)354 (313)73 (78)2e60/15
JADEb posik 29 (47)80 (82)258 (383)1224 (1265)406 (313)2e60/15
JADEctpb posik 74 (64)77 (162)283 (318)354 (297)73 (74)2e60/15
MVDE melo 67 (4)156 (146)487 (458)574 (612)96 (125)1e60/15
NBIPOPaCMA loshchilov 2.5 (3)3.2 (2)5.0 (4)5.1 (3)1.2 (0.9)2.0 (2)2.8 (2)15/15
NIPOPaCMA loshchilov 2.4 (3)2.4 (3)4.1 (4)5.6 (8)1.4 (1)1.6 (0.8)1.7 (0.8)15/15
PSO-BFGS voglis 26 (2)8.0 (0.4)9.1 (3)13 (7)95 (111)574 (539)4e60/15

Δ fopt
f14, 40-D
1e1
304
1e0
616
1e-1
777
1e-2
1105
1e-3
2207
1e-5
4825
1e-7
57711
#succ
15/15
ACOR liao 21 (6)16 (3)18 (2)24 (3)107 (28)1e70/15
BIPOPaCMA loshchilov 2.5 (0.2)2.3 (0.3)2.9 (0.2)3.7 (0.3)3.5 (0.2)3.9 (0.2)0.59 (0.0)↑015/15
CMAES posik 2.4 (0.4)2.4 (0.2)2.9 (0.2)3.8 (0.4)4.3 (0.3)6.7 (0.5)1.1 (0.1)15/15
CMA brockhoff 2.5 (0.4)2.4 (0.3)3.0 (0.3)3.9 (0.5)4.4 (0.3)6.8 (0.4)1.1 (0.1)15/15
CMAa brockhoff 2.5 (0.4)2.4 (0.3)3.0 (0.3)3.6 (0.3)3.4 (0.3)3.9 (0.2)0.58 (0.0)↑015/15
CMAm brockhoff 2.0 (0.4)1.9 (0.3)2.3 (0.2)3.0 (0.2)3.9 (0.3)6.6 (0.4)1.1 (0.1)15/15
CMAma brockhoff 1.9 (0.4)1.9 (0.2)2.3 (0.2)3.0 (0.3)3.0 (0.2)3.6 (0.2)0.56 (0.0)↑015/15
CMAmah brockhoff 1.5 (0.5)1.4 (0.3)1.6 (0.3)2.0 (0.3)2.3 (0.2)3.5 (0.2)0.61 (0.0)↑015/15
CMAmh brockhoff 1.5 (0.3)1.3 (0.2)1.6 (0.2)2.1 (0.2)2.8 (0.2)5.9 (0.6)1.1 (0.1)15/15
DBRCGA chuang 34 (11)57 (11)81 (14)110 (19)154 (35)4e60/15
DE-AUTO voglis 0.92 (0.1)0.70 (0.1)↑00.77 (0.1)↑01.3 (0.1)1.1 (0.2)13 (3)4e60/15
DE-BFGS voglis 0.91 (0.2)0.70 (0.1)↑00.83 (0.2)↑10.91 (0.1)0.64 (0.1)↑02.0 (2)★24e60/15
DE-ROLL voglis 4.1 (4)11 (11)12 (13)12 (7)24 (6)4e60/15
DE-SIMPLEX voglis 27 (14)31 (9)34 (9)35 (7)31 (11)4e60/15
DEAE posik 49 (11)53 (8)73 (10)81 (9)54 (6)40 (2)4.5 (0.3)15/15
DE posik 123 (18)100 (10)115 (14)329 (106)2e60/15
DEb posik 123 (18)100 (10)115 (14)329 (106)2e60/15
DEctpb posik 114 (18)100 (10)120 (7)446 (68)2e60/15
JADE posik 23 (2)23 (1)27 (1)29 (1)30 (2)166 (50)2e60/15
JADEb posik 20 (2)20 (2)25 (2)32 (3)30 (2)153 (27)2e60/15
JADEctpb posik 23 (2)23 (1)27 (1)29 (1)30 (2)166 (50)2e60/15
MVDE melo 79 (10)89 (4)114 (7)277 (53)1e60/15
NBIPOPaCMA loshchilov 2.5 (0.5)2.4 (0.2)3.0 (0.2)3.6 (0.3)3.5 (0.3)3.9 (0.2)0.59 (0.0)↑015/15
NIPOPaCMA loshchilov 2.5 (0.4)2.3 (0.3)3.0 (0.3)3.6 (0.2)3.4 (0.1)3.8 (0.2)0.60 (0.0)↑015/15
PSO-BFGS voglis 0.93 (0.2)0.72 (0.1)↑00.85 (0.2)0.94 (0.1)0.66 (0.1)↑06.4 (4)4e60/15

Δ fopt
f15, 40-D
1e1
1.9e5
1e0
7.9e5
1e-1
1.0e6
1e-2
1.1e6
1e-3
1.1e6
1e-5
1.1e6
1e-7
1.1e6
#succ
15/15
ACOR liao 1e70/15
BIPOPaCMA loshchilov 1.2 (0.5)1.1 (0.5)1.1 (0.4)1.1 (0.4)1.1 (0.4)1.1 (0.4)1.1 (0.4)15/15
CMAES posik 2e60/15
CMA brockhoff 0.97 (0.3)0.78 (0.3)0.71 (0.2)↑10.72 (0.2)↑10.72 (0.2)↑10.74 (0.2)↑10.75 (0.2)↑115/15
CMAa brockhoff 0.75 (0.3)0.67 (0.2)↑10.66 (0.2)↑10.66 (0.2)↑10.67 (0.2)↑10.68 (0.2)↑10.69 (0.2)↑115/15
CMAm brockhoff 0.71 (0.3)0.64 (0.3)0.68 (0.5)0.68 (0.5)0.69 (0.5)0.70 (0.5)0.71 (0.5)15/15
CMAma brockhoff 0.72 (0.3)↑10.58 (0.2)↑00.60 (0.2)↑00.60 (0.2)↑00.61 (0.2)↑00.62 (0.2)↑00.63 (0.2)↑015/15
CMAmah brockhoff 0.79 (0.2)0.68 (0.2)↑00.69 (0.4)0.70 (0.4)0.70 (0.4)0.72 (0.4)0.72 (0.4)15/15
CMAmh brockhoff 0.86 (0.3)0.66 (0.3)0.71 (0.3)↑10.72 (0.3)↑10.72 (0.3)↑10.74 (0.3)↑10.75 (0.3)15/15
DBRCGA chuang 4e60/15
DE-AUTO voglis 4e60/15
DE-BFGS voglis 4e60/15
DE-ROLL voglis 4e60/15
DE-SIMPLEX voglis 4e60/15
DEAE posik 2e60/15
DE posik 2e60/15
DEb posik 2e60/15
DEctpb posik 2e60/15
JADE posik 2e60/15
JADEb posik 2e60/15
JADEctpb posik 2e60/15
MVDE melo 1e60/15
NBIPOPaCMA loshchilov 1.0 (0.4)0.71 (0.3)0.75 (0.3)↑10.76 (0.3)↑10.76 (0.3)↑10.77 (0.3)↑10.77 (0.3)↑115/15
NIPOPaCMA loshchilov 0.92 (0.3)0.61 (0.2)↑00.55 (0.2)↑00.56 (0.2)↑00.56 (0.2)↑00.57 (0.2)↑00.58 (0.2)↑015/15
PSO-BFGS voglis 4e60/15

Δ fopt
f16, 40-D
1e1
5244
1e0
72122
1e-1
3.2e5
1e-2
7.1e5
1e-3
1.4e6
1e-5
2.0e6
1e-7
2.0e6
#succ
15/15
ACOR liao 8740 (6472)1e70/15
BIPOPaCMA loshchilov 1.3 (0.4)0.96 (0.3)0.80 (0.4)0.61 (0.3)↑10.54 (0.3)↑10.50 (0.3)↑10.51 (0.3)↑115/15
CMAES posik 1.1 (0.5)47 (39)2e60/15
CMA brockhoff 1.8 (3)1.2 (0.7)0.92 (0.6)0.99 (1)0.64 (0.5)0.57 (0.5)0.58 (0.5)15/15
CMAa brockhoff 0.88 (0.3)0.94 (0.4)0.65 (0.5)0.66 (0.6)0.59 (0.6)0.44 (0.4)↑10.45 (0.4)↑115/15
CMAm brockhoff 0.72 (0.3)↑11.2 (0.9)1.2 (1.0)0.91 (1)0.62 (0.6)0.61 (0.4)0.63 (0.4)15/15
CMAma brockhoff 0.65 (0.3)↑10.72 (0.3)↑10.55 (0.2)↑00.81 (0.8)0.52 (0.4)↑10.52 (0.5)0.56 (0.5)15/15
CMAmah brockhoff 2.4 (2)1.00 (0.6)0.75 (0.6)0.55 (0.4)↑10.55 (0.6)0.47 (0.4)0.48 (0.4)15/15
CMAmh brockhoff 2.8 (2)1.9 (0.9)0.79 (0.4)0.99 (0.8)0.73 (0.6)0.58 (0.4)↑10.60 (0.4)↑115/15
DBRCGA chuang 657 (853)4e60/15
DE-AUTO voglis 329 (274)4e60/15
DE-BFGS voglis 2351 (3156)4e60/15
DE-ROLL voglis 415 (373)4e60/15
DE-SIMPLEX voglis 1082 (1395)4e60/15
DEAE posik 2e60/15
DE posik 2e60/15
DEb posik 2e60/15
DEctpb posik 2e60/15
JADE posik 219 (211)2e60/15
JADEb posik 1211 (1289)2e60/15
JADEctpb posik 219 (250)2e60/15
MVDE melo 1e60/15
NBIPOPaCMA loshchilov 0.97 (0.3)0.78 (0.4)0.34 (0.1)↑00.28 (0.2)↑00.38 (0.3)↑10.46 (0.4)↑10.74 (1)15/15
NIPOPaCMA loshchilov 1.2 (0.4)0.65 (0.2)↑00.23 (0.1)↑00.27 (0.2)↑00.21 (0.2)↑00.16 (0.1)↑00.18 (0.1)↑015/15
PSO-BFGS voglis 4e60/15

Δ fopt
f17, 40-D
1e1
399
1e0
4220
1e-1
14158
1e-2
34948
1e-3
51958
1e-5
1.3e5
1e-7
2.7e5
#succ
14/15
ACOR liao 37 (22)9.3 (5)1064 (1590)1e70/15
BIPOPaCMA loshchilov 1.1 (0.3)0.64 (0.2)↑11.6 (1)1.0 (0.1)1.1 (0.4)1.4 (1)0.87 (0.4)15/15
CMAES posik 1.0 (0.3)1.0 (0.1)1.1 (1)15 (17)2e60/15
CMA brockhoff 0.98 (0.2)1.2 (0.3)1.1 (1)0.94 (0.1)0.94 (0.4)0.98 (0.3)0.73 (0.3)15/15
CMAa brockhoff 0.88 (0.5)0.53 (0.1)↑01.0 (1)0.95 (0.1)1.0 (0.3)1.00 (0.7)0.69 (0.2)15/15
CMAm brockhoff 0.79 (0.3)0.42 (0.1)↑01.1 (0.9)0.79 (0.1)↑10.96 (0.3)0.93 (0.6)0.80 (0.3)15/15
CMAma brockhoff 0.89 (0.4)0.46 (0.2)↑00.96 (0.8)0.68 (0.1)↑00.77 (0.3)0.77 (0.2)↑10.60 (0.2)↑015/15
CMAmah brockhoff 0.82 (0.2)11 (7)4.3 (3)2.4 (0.9)1.9 (0.8)1.1 (0.4)0.82 (0.3)15/15
CMAmh brockhoff 1.0 (0.6)7.6 (6)3.9 (3)1.8 (1)1.5 (0.7)1.2 (0.6)0.90 (0.3)15/15
DBRCGA chuang 5.6 (2)4e60/15
DE-AUTO voglis 15 (20)636 (506)4e60/15
DE-BFGS voglis 13 (13)422 (493)4118 (5726)4e60/15
DE-ROLL voglis 19 (17)1039 (562)1986 (2119)4e60/15
DE-SIMPLEX voglis 25 (24)1894 (1363)4e60/15
DEAE posik 30 (11)19 (4)13 (2)9.2 (2)28 (27)2e60/15
DE posik 35 (10)24 (6)17 (3)13 (2)26 (23)2e60/15
DEb posik 35 (10)24 (6)17 (3)13 (2)26 (21)2e60/15
DEctpb posik 28 (9)21 (2)15 (1.0)10 (0.5)10 (0.5)2e60/15
JADE posik 7.0 (2)5.4 (0.9)3.2 (0.6)5.2 (7)13 (19)2e60/15
JADEb posik 6.7 (3)115 (240)924 (1271)2e60/15
JADEctpb posik 7.0 (2)5.4 (0.9)3.2 (0.6)5.2 (7)13 (21)2e60/15
MVDE melo 17 (4)27 (5)21 (4)17 (5)29 (25)1e60/15
NBIPOPaCMA loshchilov 1.0 (0.4)0.57 (0.2)↑01.2 (1)1.2 (0.3)1.2 (0.5)1.0 (0.3)0.81 (0.3)15/15
NIPOPaCMA loshchilov 0.98 (0.3)0.52 (0.1)↑00.97 (1)1.1 (0.5)1.00 (0.4)1.1 (0.6)0.70 (0.2)15/15
PSO-BFGS voglis 24 (22)4e60/15

Δ fopt
f18, 40-D
1e1
1442
1e0
16998
1e-1
47068
1e-2
1.3e5
1e-3
1.9e5
1e-5
6.7e5
1e-7
9.5e5
#succ
15/15
ACOR liao 16 (6)397 (442)1e70/15
BIPOPaCMA loshchilov 0.94 (0.2)0.51 (0.8)1.0 (0.4)0.72 (0.5)0.98 (0.4)0.88 (0.7)0.67 (0.5)15/15
CMAES posik 0.97 (0.2)1.2 (2)68 (84)2e60/15
CMA brockhoff 0.94 (0.2)0.58 (0.9)1.1 (0.5)0.72 (0.4)0.77 (0.2)↑10.53 (0.2)↑00.58 (0.2)↑115/15
CMAa brockhoff 0.95 (0.2)0.50 (0.8)1.2 (0.5)0.75 (0.2)0.83 (0.3)0.54 (0.4)↑00.43 (0.2)↑015/15
CMAm brockhoff 0.78 (0.2)0.62 (0.7)0.90 (0.4)0.65 (0.2)↑10.68 (0.5)0.85 (0.8)0.67 (0.6)15/15
CMAma brockhoff 0.77 (0.1)↑00.72 (0.7)0.93 (0.4)0.62 (0.2)↑00.61 (0.2)↑00.46 (0.3)↑00.47 (0.2)↑115/15
CMAmah brockhoff 9.3 (24)3.5 (2)1.7 (0.9)0.99 (0.3)0.96 (0.3)0.58 (0.2)↑10.47 (0.2)↑115/15
CMAmh brockhoff 24 (37)3.4 (4)2.0 (1)1.1 (0.5)1.1 (0.4)0.68 (0.3)↑10.58 (0.2)↑115/15
DBRCGA chuang 1183 (1428)4e60/15
DE-AUTO voglis 291 (158)4e60/15
DE-BFGS voglis 230 (206)3492 (4475)4e60/15
DE-ROLL voglis 442 (268)3530 (4062)4e60/15
DE-SIMPLEX voglis 638 (406)4e60/15
DEAE posik 32 (8)11 (2)10 (5)38 (38)2e60/15
DE posik 46 (9)24 (13)38 (24)2e60/15
DEb posik 46 (9)24 (13)38 (30)2e60/15
DEctpb posik 40 (7)14 (3)12 (2)7.8 (2)10 (6)2e60/15
JADE posik 10 (1)2.8 (0.8)16 (21)2e60/15
JADEb posik 16 (6)794 (851)2e60/15
JADEctpb posik 10 (1)2.8 (0.8)16 (23)2e60/15
MVDE melo 49 (8)29 (12)316 (218)1e60/15
NBIPOPaCMA loshchilov 1.0 (0.2)0.97 (1)1.1 (0.6)0.94 (0.3)0.93 (0.4)0.57 (0.4)0.53 (0.3)↑015/15
NIPOPaCMA loshchilov 0.95 (0.2)0.58 (0.8)0.75 (0.1)↑10.66 (0.2)0.71 (0.2)↑10.50 (0.3)↑00.42 (0.2)↑015/15
PSO-BFGS voglis 1465 (1799)4e60/15

Δ fopt
f19, 40-D
1e1
1
1e0
1
1e-1
1.4e6
1e-2
1.7e7
1e-3
2.6e7
1e-5
4.5e7
1e-7
4.5e7
#succ
8/15
ACOR liao 4435 (1033)1e70/15
BIPOPaCMA loshchilov 396 (82)6.7e4 (5e4)0.87 (0.7)1.2 (0.7)1.2 (1.0)1.0 (2)1.0 (0.9)9/15
CMAES posik 407 (116)2.5e5 (3e5)2e60/15
CMA brockhoff 421 (92)6.9e5 (8e5)1.5 (3)1.7 (2)8e60/15
CMAa brockhoff 443 (121)4.8e4 (3e4)1.8 (3)2.3 (2)8e60/15
CMAm brockhoff 293 (90)5.5e4 (4e4)2.5 (3)1.6 (2)4.5 (4)2.5 (4)2.5 (3)1/15
CMAma brockhoff 323 (38)3.9e4 (3e4)2.3 (3)1.2 (2)8e60/15
CMAmah brockhoff 338 (204)1.6e6 (4e6)7.1 (9)6.9 (12)8e60/15
CMAmh brockhoff 305 (114)1.2e6 (2e6)2.3 (3)6.9 (9)8e60/15
DBRCGA chuang 1270 (156)2.5e6 (2e6)4e60/15
DE-AUTO voglis 2.1e4 (2e4)2.1e6 (3e6)4e60/15
DE-BFGS voglis 1.6e4 (7636)1.9e6 (2e6)4e60/15
DE-ROLL voglis 2.1e4 (1e4)2.8e7 (3e7)4e60/15
DE-SIMPLEX voglis 2.7e4 (9260)5.8e7 (8e7)4e60/15
DEAE posik 9417 (2203)2e60/15
DE posik 1.4e4 (4500)2e60/15
DEb posik 1.4e4 (4500)2e60/15
DEctpb posik 1.2e4 (3772)2e60/15
JADE posik 3064 (499)2e60/15
JADEb posik 3765 (784)8.9e6 (1e7)2e60/15
JADEctpb posik 3064 (499)2e60/15
MVDE melo 1.4e4 (1661)1e60/15
NBIPOPaCMA loshchilov 424 (90)8.3e4 (6e4)0.97 (0.6)0.80 (0.3)0.81 (0.5)1.1 (1)1.1 (1)9/15
NIPOPaCMA loshchilov 436 (102)8.2e4 (4e4)1.9 (6)0.54 (0.4)0.48 (0.3)↑10.32 (0.2)↑00.32 (0.2)↑015/15
PSO-BFGS voglis 2.8e4 (2e4)1.2e5 (6e4)41 (55)4e60/15

Δ fopt
f20, 40-D
1e1
222
1e0
1.3e5
1e-1
1.6e8
1e-2
1e-3
1e-5
1e-7
#succ
0/15
ACOR liao 26 (4)34 (39)1e70/15
BIPOPaCMA loshchilov 4.0 (0.4)9.0 (4)0.34 (0.5)4e70/15
CMAES posik 4.0 (0.5)2e60/15
CMA brockhoff 3.9 (0.7)14 (4)8e60/15
CMAa brockhoff 4.1 (0.5)5.6 (3)0.73 (1.0)8e60/15
CMAm brockhoff 3.0 (0.4)13 (4)8e60/15
CMAma brockhoff 3.0 (0.5)5.5 (2)0.21 (0.2)8e60/15
CMAmah brockhoff 2.0 (0.4)5.1 (2)0.35 (0.4)8e60/15
CMAmh brockhoff 2.1 (0.4)12 (5)8e60/15
DBRCGA chuang 28 (6)4e60/15
DE-AUTO voglis 1.5 (0.3)★23.9 (3)4e60/15
DE-BFGS voglis 10 (8)2.2 (1)4e60/15
DE-ROLL voglis 30 (30)0.94 (0.8)4e60/15
DE-SIMPLEX voglis 36 (18)5.5 (3)4e60/15
DEAE posik 80 (13)2e60/15
DE posik 106 (23)7.2 (4)2e60/15
DEb posik 106 (23)7.2 (4)2e60/15
DEctpb posik 102 (22)2e60/15
JADE posik 29 (2)2.7 (0.4)2e60/15
JADEb posik 27 (4)11 (11)2e60/15
JADEctpb posik 29 (2)2.7 (0.4)2e60/15
MVDE melo 121 (9)1e60/15
NBIPOPaCMA loshchilov 4.0 (0.8)8.5 (3)0.39 (0.5)4e70/15
NIPOPaCMA loshchilov 4.0 (0.6)6.5 (2)0.32 (0.3)4e70/15
PSO-BFGS voglis 8.0 (1)209 (251)4e60/15

Δ fopt
f21, 40-D
1e1
1044
1e0
21144
1e-1
1.0e5
1e-2
1.0e5
1e-3
1.0e5
1e-5
1.0e5
1e-7
1.0e5
#succ
26/30
ACOR liao 2674 (4792)3199 (3768)1410 (1415)1406 (2054)1402 (1826)1393 (2085)1387 (1709)1/15
BIPOPaCMA loshchilov 7.5 (11)60 (19)37 (56)37 (56)37 (56)37 (56)37 (55)15/15
CMAES posik 5.6 (9)2.2 (3)2.2 (1.0)2.2 (1.0)2.2 (1.0)2.1 (1.0)2.1 (1.0)14/15
CMA brockhoff 3.5 (5)63 (63)39 (33)39 (39)39 (52)39 (39)39 (51)6/15
CMAa brockhoff 2.0 (5)63 (91)38 (38)38 (44)38 (50)38 (68)37 (93)6/15
CMAm brockhoff 7.0 (10)110 (126)30 (27)30 (40)30 (39)30 (32)30 (52)7/15
CMAma brockhoff 1.6 (3)61 (121)38 (57)38 (39)38 (38)38 (32)38 (50)6/15
CMAmah brockhoff 1.3 (2)30 (59)17 (25)16 (30)16 (24)16 (24)16 (23)9/15
CMAmh brockhoff 2.3 (3)44 (61)22 (31)22 (37)22 (18)22 (31)22 (24)8/15
DBRCGA chuang 15 (9)56 (95)26 (36)26 (35)26 (32)27 (31)27 (24)11/15
DE-AUTO voglis 1.4 (2)162 (284)47 (63)47 (59)47 (43)47 (49)46 (57)8/15
DE-BFGS voglis 16 (18)60 (104)22 (28)22 (25)22 (27)21 (21)4e60/15
DE-ROLL voglis 176 (103)99 (125)33 (55)33 (44)33 (50)33 (58)66 (116)4/15
DE-SIMPLEX voglis 606 (1917)522 (615)258 (278)258 (228)257 (316)256 (314)548 (684)0/15
DEAE posik 38 (9)30 (50)18 (18)18 (20)18 (25)18 (21)18 (20)9/15
DE posik 65 (127)30 (70)9.4 (16)10 (11)11 (13)11 (20)11 (11)11/15
DEb posik 65 (127)30 (47)9.4 (10)10 (14)11 (13)11 (20)11 (13)11/15
DEctpb posik 39 (12)112 (142)80 (89)80 (104)80 (109)80 (103)80 (73)3/15
JADE posik 30 (3)25 (35)13 (15)13 (23)13 (19)13 (19)13 (10)9/15
JADEb posik 16 (3)12 (28)3.3 (6)3.3 (6)3.4 (6)3.4 (6)3.5 (6)15/15
JADEctpb posik 30 (3)25 (35)13 (19)13 (13)13 (17)13 (14)13 (22)9/15
MVDE melo 40 (15)58 (48)21 (27)21 (30)21 (23)22 (15)22 (20)5/15
NBIPOPaCMA loshchilov 4.9 (6)10 (20)5.1 (8)5.1 (8)5.1 (8)5.1 (8)5.1 (8)15/15
NIPOPaCMA loshchilov 14 (22)440 (890)173 (292)173 (338)172 (200)171 (196)171 (217)12/15
PSO-BFGS voglis 0.61 (0.9)1.7 (3)0.98 (1)0.97 (1)0.97 (1)1.1 (1)161 (177)1/15

Δ fopt
f22, 40-D
1e1
3090
1e0
35442
1e-1
6.5e5
1e-2
6.5e5
1e-3
6.5e5
1e-5
6.5e5
1e-7
6.5e5
#succ
8/30
ACOR liao 1184 (1619)1129 (1622)1e70/15
BIPOPaCMA loshchilov 12 (20)343 (566)201 (358)201 (121)200 (326)200 (288)199 (196)4/15
CMAES posik 8.1 (16)35 (57)46 (39)46 (55)46 (55)45 (36)45 (45)1/15
CMA brockhoff 82 (117)149 (187)3e60/15
CMAa brockhoff 65 (8)197 (213)3e60/15
CMAm brockhoff 71 (59)147 (128)3e60/15
CMAma brockhoff 62 (6)144 (143)3e60/15
CMAmah brockhoff 1.2 (2)102 (135)2e60/15
CMAmh brockhoff 8.6 (2)141 (142)2e60/15
DBRCGA chuang 167 (345)196 (231)4e60/15
DE-AUTO voglis 218 (489)315 (339)4e60/15
DE-BFGS voglis 101 (92)136 (174)87 (102)87 (86)87 (85)87 (77)4e60/15
DE-ROLL voglis 538 (1264)254 (226)4e60/15
DE-SIMPLEX voglis 869 (1296)1582 (1948)4e60/15
DEAE posik 84 (70)77 (99)2e60/15
DE posik 68 (49)98 (123)2e60/15
DEb posik 68 (49)98 (94)2e60/15
DEctpb posik 128 (324)368 (606)2e60/15
JADE posik 109 (324)119 (144)2e60/15
JADEb posik 13 (28)74 (129)2e60/15
JADEctpb posik 109 (324)119 (142)2e60/15
MVDE melo 95 (166)83 (92)1e60/15
NBIPOPaCMA loshchilov 12 (6)112 (120)32 (46)32 (40)32 (42)32 (41)32 (33)12/15
NIPOPaCMA loshchilov 179 (468)583 (1021)4e70/15
PSO-BFGS voglis 0.79 (0.9)22 (57)6.6 (9)6.6 (6)6.6 (7)9.4 (17)4e60/15

Δ fopt
f23, 40-D
1e1
7.0
1e0
11925
1e-1
75453
1e-2
6.6e5
1e-3
1.3e6
1e-5
3.2e6
1e-7
3.4e6
#succ
15/15
ACOR liao 1.3 (2)1e70/15
BIPOPaCMA loshchilov 8.5 (10)7.8 (7)1.3 (1)1.0 (1)1.9 (1)1.00 (0.4)0.99 (0.4)15/15
CMAES posik 5.0 (4)2478 (2180)2e60/15
CMA brockhoff 4.2 (3)4e60/15
CMAa brockhoff 4.9 (4)4e60/15
CMAm brockhoff 5.9 (6)4975 (6628)787 (1174)4e60/15
CMAma brockhoff 3.3 (3)2196 (2693)760 (1069)4e60/15
CMAmah brockhoff 7.5 (11)859 (1146)4e60/15
CMAmh brockhoff 7.5 (7)4340 (4434)4e60/15
DBRCGA chuang 1.1 (0.9)350 (233)4e60/15
DE-AUTO voglis 1.4 (2)6.7 (4)4e60/15
DE-BFGS voglis 0.99 (1)7.0 (5)748 (942)4e60/15
DE-ROLL voglis 0.74 (0.7)47 (45)4e60/15
DE-SIMPLEX voglis 1.3 (2)0.43 (0.8)★3354 (292)4e60/15
DEAE posik 0.93 (0.9)2e60/15
DE posik 2.0 (3)2e60/15
DEb posik 2.0 (3)2e60/15
DEctpb posik 1.1 (2)2e60/15
JADE posik 2.2 (2)95 (38)2e60/15
JADEb posik 1.4 (1)2e60/15
JADEctpb posik 2.2 (2)95 (38)2e60/15
MVDE melo 1.1 (1)1e60/15
NBIPOPaCMA loshchilov 8.8 (11)10 (12)1.6 (2)2.4 (0.8)1.3 (0.4)0.58 (0.2)↑00.59 (0.2)↑015/15
NIPOPaCMA loshchilov 6.0 (8)61 (18)11 (3)1.3 (0.4)0.72 (0.2)↑00.36 (0.2)↑00.38 (0.2)↑015/15
PSO-BFGS voglis 1.5 (1)4.3 (2)84 (147)4e60/15

Δ fopt
f24, 40-D
1e1
5.8e6
1e0
9.8e7
1e-1
3.0e8
1e-2
3.0e8
1e-3
3.0e8
1e-5
3.0e8
1e-7
3.0e8
#succ
1/15
ACOR liao 1e70/15
BIPOPaCMA loshchilov 3.6 (4)1.4 (1)4e70/15
CMAES posik 2e60/15
CMA brockhoff 8e60/15
CMAa brockhoff 19 (22)8e60/15
CMAm brockhoff 8e60/15
CMAma brockhoff 9.0 (8)8e60/15
CMAmah brockhoff 10 (8)1.2 (2)8e60/15
CMAmh brockhoff 8e60/15
DBRCGA chuang 4e60/15
DE-AUTO voglis 4e60/15
DE-BFGS voglis 4e60/15
DE-ROLL voglis 4e60/15
DE-SIMPLEX voglis 4e60/15
DEAE posik 2e60/15
DE posik 2e60/15
DEb posik 2e60/15
DEctpb posik 2e60/15
JADE posik 2e60/15
JADEb posik 2e60/15
JADEctpb posik 2e60/15
MVDE melo 1e60/15
NBIPOPaCMA loshchilov 2.1 (3)0.19 (0.2)↑00.97 (0.8)0.97 (1)0.97 (1.0)0.97 (1)0.97 (0.9)2/15
NIPOPaCMA loshchilov 1.2 (1)0.15 (0.2)0.44 (0.4)0.44 (0.5)0.44 (0.6)0.44 (0.6)0.44 (0.4)4/15
PSO-BFGS voglis 4e60/15

Expected runtime (ERT in number of f-evaluations) divided by the respective best ERT measured during BBOB-2009 (when finite) in different dimensions. This ERT ratio and, in braces as dispersion measure, the half difference between 10 and 90%-tile of (bootstrapped) run lengths appear for each algorithm and target, the corresponding reference ERT  in the first row. The different target ∆f-values are shown in the top row. #succ is the number of trials that reached the (final) target fopt+ 10−8. The median number of conducted function evaluations is additionally given in italics, if the target in the last column was never reached. The best entry is marked by a star when the largest p-value of pairwise rank-sum tests with the other algorithms either obeys 0.01 < p ≤ 0.05 or 10−k−1 < p ≤ 10−k when the star is followed by the number k, with Bonferroni correction by the number of functions (24). A ↑ signifies the number of trials that were worse than the ERT of the best algorithm from BBOB 2009 shown only when less than 10 percent were worse and the ERT was better. Best results are printed in bold.