Overview page

Table showing the aRT in number of function evaluations divided by the best aRT measured during BBOB-2009

Last dimension | Dimension = 2 | Next dimension

Δ fopt
f1, 2-D		 1e1
2.0		 1e0
6.0		 1e-1
6.0		 1e-2
6.0		 1e-3
6.0		 1e-5
6.0		 1e-7
6.0		 #succ
15/15
BFGS ros noiseless 3.0 (0.8)1.1 (0.1)1.2 (0)★1.2 (0)★41.2 (0)★41.2 (0)★41.2 (0)★415/15
BIPOP-CMA-ES hansen noiseless 2.9 (4)3.6 (3)8.1 (4)13 (7)19 (4)29 (5)39 (5)15/15
GA nicolau noiseless 2.5 (2)6.8 (3)59 (94)310 (214)1077 (487)2600 (515)4460 (1251)15/15
NELDERDOERR doerr noiseless 0.93 (0.8)1.4 (0.5)2.7 (0.4)4.1 (0.6)5.3 (0.5)7.6 (0.9)10 (0.8)15/15
ONEFIFTH auger noiseless 3.1 (2)2.6 (2)6.4 (4)10 (3)14 (2)23 (5)30 (4)15/15
IPOP-CMA-ES ros noiseless 4.6 (5)4.3 (2)10 (5)15 (7)20 (5)28 (6)37 (8)15/15

Δ fopt
f2, 2-D		 1e1
16		 1e0
19		 1e-1
25		 1e-2
25		 1e-3
26		 1e-5
28		 1e-7
29		 #succ
15/15
BFGS ros noiseless 2.6 (2)4.0 (0.8)3.7 (0.8)4.0 (0.8)4.0 (0.9)4.1 (1)4.3 (1)15/15
BIPOP-CMA-ES hansen noiseless 13 (6)19 (10)17 (3)18 (3)19 (2)20 (2)22 (2)15/15
GA nicolau noiseless 136 (115)324 (200)416 (147)547 (206)776 (188)1260 (350)1868 (422)15/15
NELDERDOERR doerr noiseless 1.7 (0.6)1.9 (0.2)★1.7 (0.1)★42.0 (0.2)★42.1 (0.2)★42.5 (0.2)★43.0 (0.2)★315/15
ONEFIFTH auger noiseless 8873 (2e4)4.6e4 (3e4)1.2e5 (1e5)3.8e5 (8e5)∞∞∞2e60/15
IPOP-CMA-ES ros noiseless 16 (8)21 (7)18 (3)20 (3)20 (3)21 (3)22 (2)15/15

Δ fopt
f3, 2-D		 1e1
15		 1e0
271		 1e-1
445		 1e-2
446		 1e-3
450		 1e-5
454		 1e-7
464		 #succ
15/15
BFGS ros noiseless 14 (12)3.1 (3)10 (8)10 (10)10 (15)10 (8)10 (11)10/15
BIPOP-CMA-ES hansen noiseless 3.4 (4)3.5 (3)5.2 (7)6.2 (9)6.4 (12)6.5 (5)6.7 (5)15/15
GA nicolau noiseless 8.1 (13)13 (9)19 (6)27 (8)40 (18)70 (12)108 (15)15/15
NELDERDOERR doerr noiseless 0.98 (0.5)1.00 (4)1.7 (2)1.8 (1)★1.8 (2)★1.8 (2)★1.8 (2)★15/15
ONEFIFTH auger noiseless 11 (16)5.0 (5)15 (17)15 (11)15 (16)15 (9)14 (20)15/15
IPOP-CMA-ES ros noiseless 4.1 (8)3.3 (4)7.7 (3)8.0 (4)8.8 (4)9.0 (7)9.1 (9)15/15

Δ fopt
f4, 2-D		 1e1
22		 1e0
344		 1e-1
459		 1e-2
496		 1e-3
523		 1e-5
544		 1e-7
566		 #succ
15/15
BFGS ros noiseless 11 (14)5.7 (6)12 (15)11 (15)11 (9)10 (9)10 (5)9/15
BIPOP-CMA-ES hansen noiseless 2.6 (1)6.9 (6)55 (53)97 (116)99 (122)99 (71)106 (150)15/15
GA nicolau noiseless 10 (9)16 (5)22 (10)28 (5)37 (10)60 (10)105 (16)15/15
NELDERDOERR doerr noiseless 1.9 (0.7)1.4 (0.8)3.5 (3)3.2 (2)3.1 (2)3.0 (2)3.0 (1)15/15
ONEFIFTH auger noiseless 4.5 (11)5.5 (5)23 (24)21 (26)20 (13)20 (21)19 (21)15/15
IPOP-CMA-ES ros noiseless 4.6 (3)12 (7)61 (116)97 (103)114 (124)171 (132)171 (308)14/15

Δ fopt
f5, 2-D		 1e1
4.0		 1e0
4.0		 1e-1
4.0		 1e-2
4.0		 1e-3
4.0		 1e-5
4.0		 1e-7
4.0		 #succ
15/15
BFGS ros noiseless 1.4 (0.4)3.1 (0.8)3.1 (0.2)3.1 (0.4)3.1 (0.8)3.1 (0.8)3.1 (0)15/15
BIPOP-CMA-ES hansen noiseless 3.1 (2)5.9 (3)6.3 (3)6.4 (3)6.4 (4)6.4 (3)6.4 (2)15/15
GA nicolau noiseless 3.9 (4)336 (278)2152 (463)4672 (619)6958 (1367)1.7e4 (1644)7.5e5 (7e5)0/15
NELDERDOERR doerr noiseless 1.1 (0.3)2.1 (0.9)2.1 (0.8)2.1 (1)2.1 (0.9)2.1 (0.8)2.1 (0.6)15/15
ONEFIFTH auger noiseless 1.8 (2)2.6 (0.6)2.7 (1)2.8 (2)2.8 (1)2.8 (2)2.8 (2)15/15
IPOP-CMA-ES ros noiseless 2.8 (2)7.7 (3)8.8 (8)8.8 (8)8.8 (9)8.8 (3)8.8 (3)15/15

Δ fopt
f6, 2-D		 1e1
13		 1e0
23		 1e-1
41		 1e-2
54		 1e-3
67		 1e-5
95		 1e-7
124		 #succ
15/15
BFGS ros noiseless 4.1 (3)3.3 (2)2.7 (0.8)2.3 (0.7)2.0 (0.7)1.7 (0.5)1.6 (1)15/15
BIPOP-CMA-ES hansen noiseless 2.0 (3)2.8 (2)3.6 (2)3.9 (1)4.2 (1)4.1 (0.5)4.3 (0.6)15/15
GA nicolau noiseless 3.4 (3)13 (14)85 (113)1000 (1310)3073 (4084)3568 (7281)4909 (8436)3/15
NELDERDOERR doerr noiseless 1.2 (0.9)1.3 (0.5)1 (0.2)★21.00 (0.1)★41 (0.2)★41.00 (0.2)★31.0 (0.1)★215/15
ONEFIFTH auger noiseless 2.5 (2)3.7 (2)3.6 (2)3.6 (2)3.4 (4)3.3 (1)3.2 (3)15/15
IPOP-CMA-ES ros noiseless 2.3 (1)5.0 (2)4.2 (3)4.7 (2)4.5 (1)4.3 (0.8)4.5 (1)15/15

Δ fopt
f7, 2-D		 1e1
3.0		 1e0
21		 1e-1
60		 1e-2
193		 1e-3
217		 1e-5
217		 1e-7
241		 #succ
15/15
BFGS ros noiseless 11 (10)19 (26)34 (28)∞∞∞∞3000/15
BIPOP-CMA-ES hansen noiseless 3.5 (4)2.6 (4)3.4 (5)1.5 (0.7)1.5 (0.4)1.5 (1)1.6 (0.8)15/15
GA nicolau noiseless 5.6 (7)4.0 (4)23 (15)24 (22)47 (31)47 (26)67 (27)14/15
NELDERDOERR doerr noiseless 2.8 (2)1.0 (1)8.6 (12)5.4 (6)5.2 (4)5.2 (9)5.4 (9)15/15
ONEFIFTH auger noiseless 6.0 (4)4.2 (7)4.3 (12)1.8 (4)3.3 (7)3.3 (7)3.1 (8)15/15
IPOP-CMA-ES ros noiseless 7.9 (8)4.1 (2)3.7 (1)1.9 (0.8)1.7 (2)1.7 (2)1.9 (1)15/15

Δ fopt
f8, 2-D		 1e1
5.0		 1e0
12		 1e-1
37		 1e-2
46		 1e-3
86		 1e-5
94		 1e-7
112		 #succ
15/15
BFGS ros noiseless 4.5 (4)5.1 (3)2.4 (1)2.2 (1)1.3 (0.4)1.3 (0.5)1.1 (0.5)15/15
BIPOP-CMA-ES hansen noiseless 3.7 (4)7.1 (14)9.1 (10)11 (7)6.5 (4)6.7 (3)6.2 (3)15/15
GA nicolau noiseless 9.1 (8)34 (50)86 (52)169 (149)1348 (2376)∞∞2e50/15
NELDERDOERR doerr noiseless 4.9 (4)6.2 (5)2.9 (1)2.8 (1)1.6 (0.5)1.6 (0.6)1.5 (0.4)15/15
ONEFIFTH auger noiseless 51 (2)59 (4)23 (59)34 (55)35 (13)70 (19)95 (48)15/15
IPOP-CMA-ES ros noiseless 5.9 (2)14 (10)9.4 (9)11 (3)6.3 (4)6.7 (3)6.1 (2)15/15

Δ fopt
f9, 2-D		 1e1
1		 1e0
18		 1e-1
30		 1e-2
44		 1e-3
68		 1e-5
81		 1e-7
92		 #succ
15/15
BFGS ros noiseless 16 (15)2.4 (1)2.3 (2)1.9 (1)1.3 (0.5)1.2 (0.4)1.1 (0.6)15/15
BIPOP-CMA-ES hansen noiseless 19 (16)4.6 (7)7.1 (5)7.5 (5)5.8 (2)5.8 (2)5.9 (2)15/15
GA nicolau noiseless 44 (58)22 (25)90 (67)192 (91)2154 (3739)1.0e4 (1e4)1.5e4 (1e4)2/15
NELDERDOERR doerr noiseless 11 (8)2.2 (1)2.6 (1)2.1 (0.6)1.5 (0.5)1.4 (0.5)1.4 (0.4)15/15
ONEFIFTH auger noiseless 19 (24)81 (1)116 (20)115 (403)100 (71)134 (53)160 (69)15/15
IPOP-CMA-ES ros noiseless 39 (24)10 (14)12 (6)11 (5)7.8 (3)7.4 (4)7.2 (1)15/15

Δ fopt
f10, 2-D		 1e1
30		 1e0
46		 1e-1
54		 1e-2
61		 1e-3
68		 1e-5
82		 1e-7
98		 #succ
15/15
BFGS ros noiseless 0.99 (0.2)1.3 (0.5)1.4 (0.2)1.4 (0.3)1.4 (0.3)6.3 (13)24 (40)10/15
BIPOP-CMA-ES hansen noiseless 7.8 (4)9.0 (2)8.5 (2)7.9 (1.0)7.8 (0.9)7.3 (1)6.8 (1)15/15
GA nicolau noiseless 76 (103)698 (119)2814 (1920)4284 (4362)4.2e4 (6e4)∞∞2e50/15
NELDERDOERR doerr noiseless 1.2 (0.5)0.99 (0.2)1.00 (0.4)★21.00 (0.2)★31.0 (0.2)★31.00 (0.1)★31.00 (0.2)★315/15
ONEFIFTH auger noiseless 8620 (1e4)2.4e4 (1e4)7.6e4 (8e4)1.5e5 (1e5)4.4e5 (5e5)∞∞2e60/15
IPOP-CMA-ES ros noiseless 10 (7)8.6 (4)8.4 (1)7.8 (1)7.6 (2)6.9 (0.9)6.4 (0.7)15/15

Δ fopt
f11, 2-D		 1e1
35		 1e0
45		 1e-1
50		 1e-2
62		 1e-3
67		 1e-5
81		 1e-7
97		 #succ
15/15
BFGS ros noiseless 1.2 (1)1.6 (0.9)2.0 (0.2)1.7 (0.5)1.9 (0.3)5.7 (2)36 (27)10/15
BIPOP-CMA-ES hansen noiseless 7.9 (5)8.8 (4)9.3 (1)8.1 (0.7)8.0 (0.7)7.5 (0.5)6.8 (0.6)15/15
GA nicolau noiseless 54 (47)218 (91)5086 (7131)4.6e4 (6e4)∞∞∞2e50/15
NELDERDOERR doerr noiseless 1.0 (0.2)1 (0.3)1.0 (0.3)★30.99 (0.2)★31.0 (0.2)★31.0 (0.2)★41.0 (0.2)★315/15
ONEFIFTH auger noiseless 7746 (7768)2.1e4 (2e4)6.1e4 (3e4)2.2e5 (2e5)4.4e5 (9e5)∞∞2e60/15
IPOP-CMA-ES ros noiseless 7.6 (5)8.3 (4)8.8 (3)7.6 (2)7.5 (2)6.8 (2)6.4 (1)15/15

Δ fopt
f12, 2-D		 1e1
35		 1e0
46		 1e-1
75		 1e-2
94		 1e-3
105		 1e-5
153		 1e-7
195		 #succ
15/15
BFGS ros noiseless 1.2 (2)3.2 (4)3.1 (2)2.9 (2)2.8 (3)2.4 (2)4.2 (3)15/15
BIPOP-CMA-ES hansen noiseless 7.6 (5)12 (8)10 (7)9.1 (6)9.0 (11)10 (13)8.2 (0.5)15/15
GA nicolau noiseless 90 (76)171 (99)576 (1375)1010 (1633)2403 (3354)2220 (1644)1870 (1079)6/15
NELDERDOERR doerr noiseless 1.1 (0.7)1.6 (2)1.6 (3)1.7 (4)1.7 (0.7)1.4 (1.0)1.3 (2)15/15
ONEFIFTH auger noiseless 6570 (1e4)1.7e4 (2e4)2.3e4 (2e4)5.5e4 (5e4)1.3e5 (9e4)1.9e5 (1e5)∞2e60/15
IPOP-CMA-ES ros noiseless 10 (6)12 (4)9.3 (7)9.0 (14)8.6 (7)7.2 (0.5)6.4 (10)15/15

Δ fopt
f13, 2-D		 1e1
23		 1e0
35		 1e-1
46		 1e-2
60		 1e-3
71		 1e-5
95		 1e-7
122		 #succ
15/15
BFGS ros noiseless 6.7 (5)15 (18)45 (45)74 (74)164 (121)580 (279)∞1e40/15
BIPOP-CMA-ES hansen noiseless 3.2 (3)5.4 (5)5.7 (2)5.9 (1)6.4 (3)6.6 (2)7.0 (0.9)15/15
GA nicolau noiseless 24 (31)174 (159)1098 (1180)2.2e4 (2e4)∞∞∞2e50/15
NELDERDOERR doerr noiseless 1.1 (0.9)1.1 (0.6)★1.1 (0.3)★41.0 (0.4)★41.0 (0.2)★41.1 (0.1)★41.0 (0.1)★415/15
ONEFIFTH auger noiseless 37 (40)94 (81)209 (127)371 (416)792 (727)8090 (6397)3.7e4 (3e4)2/15
IPOP-CMA-ES ros noiseless 4.9 (6)6.3 (2)6.7 (3)6.3 (3)6.6 (2)6.8 (1)7.1 (2)15/15

Δ fopt
f14, 2-D		 1e1
1		 1e0
7.0		 1e-1
16		 1e-2
24		 1e-3
38		 1e-5
67		 1e-7
90		 #succ
15/15
BFGS ros noiseless 3.0 (2)2.9 (2)1.8 (0.8)1.7 (0.9)1.4 (0.6)1.0 (0.3)6.0 (6)15/15
BIPOP-CMA-ES hansen noiseless 2.6 (4)2.7 (2)3.0 (1)4.2 (2)4.6 (2)5.6 (2)7.1 (0.8)15/15
GA nicolau noiseless 1.5 (0.5)4.2 (3)41 (36)202 (81)274 (102)3183 (3275)∞2e50/15
NELDERDOERR doerr noiseless 1.8 (2)1.4 (0.7)1.3 (0.5)1.3 (0.1)1.1 (0.1)1.0 (0.2)1.0 (0.2)★215/15
ONEFIFTH auger noiseless 3.3 (9)2.6 (3)2.5 (2)3.5 (2)9.2 (7)3429 (1095)∞2e60/15
IPOP-CMA-ES ros noiseless 3.1 (2)3.1 (2)4.6 (3)5.1 (2)4.7 (2)6.1 (2)7.2 (1)15/15

Δ fopt
f15, 2-D		 1e1
37		 1e0
291		 1e-1
1033		 1e-2
1066		 1e-3
1113		 1e-5
1231		 1e-7
1412		 #succ
15/15
BFGS ros noiseless 4.2 (5)4.6 (7)7.9 (12)7.7 (12)7.3 (5)6.6 (8)5.8 (6)7/15
BIPOP-CMA-ES hansen noiseless 1.1 (1)1.8 (2)2.1 (3)2.2 (4)2.2 (3)2.1 (1)1.9 (2)15/15
GA nicolau noiseless 4.2 (6)18 (9)13 (5)34 (6)96 (50)102 (124)123 (75)10/15
NELDERDOERR doerr noiseless 1.1 (1)1.3 (1)1.4 (1)1.3 (1)1.3 (1)1.2 (1)1.0 (1)15/15
ONEFIFTH auger noiseless 1.1 (0.5)5.3 (7)8.4 (2)8.2 (15)7.9 (4)7.1 (13)6.3 (8)15/15
IPOP-CMA-ES ros noiseless 0.99 (1.0)2.8 (4)2.5 (3)2.5 (2)2.4 (2)2.3 (2)2.1 (2)15/15

Δ fopt
f16, 2-D		 1e1
9.0		 1e0
50		 1e-1
174		 1e-2
326		 1e-3
358		 1e-5
409		 1e-7
538		 #succ
15/15
BFGS ros noiseless 41 (41)147 (108)173 (294)269 (295)∞∞∞1e40/15
BIPOP-CMA-ES hansen noiseless 3.2 (4)3.5 (0.7)3.5 (4)2.5 (3)2.4 (3)2.3 (2)1.9 (2)15/15
GA nicolau noiseless 2.1 (0.9)4.1 (5)16 (13)42 (18)178 (150)687 (1017)692 (556)5/15
NELDERDOERR doerr noiseless 1.7 (1)3.5 (4)1.8 (2)1.1 (0.7)1.1 (1)1.0 (0.8)1.00 (1)15/15
ONEFIFTH auger noiseless 35 (210)38 (95)35 (75)33 (51)56 (147)84 (120)121 (77)15/15
IPOP-CMA-ES ros noiseless 2.6 (3)11 (13)5.0 (4)3.6 (6)4.5 (9)4.2 (5)3.4 (6)15/15

Δ fopt
f17, 2-D		 1e1
3.0		 1e0
61		 1e-1
133		 1e-2
275		 1e-3
396		 1e-5
1086		 1e-7
1657		 #succ
15/15
BFGS ros noiseless 13 (12)16 (31)90 (157)∞∞∞∞37860/15
BIPOP-CMA-ES hansen noiseless 3.6 (4)1.8 (1.0)1.5 (1)1.0 (0.8)1.00 (0.2)1.3 (0.5)1.1 (0.6)15/15
GA nicolau noiseless 1.8 (1)5.0 (7)47 (32)61 (23)91 (23)151 (109)∞2e50/15
NELDERDOERR doerr noiseless 1.2 (0.7)1.5 (4)3.3 (6)3.0 (4)3.1 (3)5.9 (5)4.0 (6)14/15
ONEFIFTH auger noiseless 2.4 (2)5.9 (7)6.7 (7)4.8 (4)8.5 (20)23 (25)15 (15)15/15
IPOP-CMA-ES ros noiseless 17 (102)2.4 (5)2.0 (3)1.6 (1)1.7 (1)1.5 (0.3)1.1 (0.7)15/15

Δ fopt
f18, 2-D		 1e1
19		 1e0
134		 1e-1
666		 1e-2
1249		 1e-3
1708		 1e-5
2438		 1e-7
2858		 #succ
15/15
BFGS ros noiseless 14 (15)29 (33)108 (109)∞∞∞∞48990/15
BIPOP-CMA-ES hansen noiseless 2.2 (1)6.5 (6)1.9 (1)1.1 (0.6)1.00 (0.5)1.0 (0.3)1.00 (0.3)15/15
GA nicolau noiseless 4.3 (8)15 (9)23 (9)107 (49)275 (181)1237 (702)∞2e50/15
NELDERDOERR doerr noiseless 1.2 (4)3.1 (2)2.4 (3)4.3 (8)5.8 (7)25 (38)21 (13)6/15
ONEFIFTH auger noiseless 63 (231)232 (258)618 (571)1493 (2343)4934 (3347)∞∞2e60/15
IPOP-CMA-ES ros noiseless 4.9 (2)3.7 (4)1.5 (1)1.1 (0.9)1.1 (0.7)1.0 (0.4)1.1 (0.4)15/15

Δ fopt
f19, 2-D		 1e1
1		 1e0
1		 1e-1
26		 1e-2
216		 1e-3
227		 1e-5
252		 1e-7
276		 #succ
15/15
BFGS ros noiseless 37 (65)311 (286)62 (31)30 (20)29 (22)26 (20)24 (20)11/15
BIPOP-CMA-ES hansen noiseless 6.0 (5)31 (41)10 (21)12 (19)12 (16)14 (13)14 (13)15/15
GA nicolau noiseless 4.5 (4)51 (42)20 (38)21 (19)108 (236)643 (811)4855 (6405)1/15
NELDERDOERR doerr noiseless 4.6 (4)52 (43)11 (8)8.1 (4)7.8 (12)7.1 (3)6.5 (6)15/15
ONEFIFTH auger noiseless 6.2 (8)103 (199)22 (65)23 (28)25 (17)30 (18)38 (14)15/15
IPOP-CMA-ES ros noiseless 6.3 (5)22 (19)9.2 (4)17 (8)17 (55)18 (31)17 (52)15/15

Δ fopt
f20, 2-D		 1e1
4.0		 1e0
61		 1e-1
365		 1e-2
366		 1e-3
366		 1e-5
370		 1e-7
375		 #succ
15/15
BFGS ros noiseless 1.9 (2)6.0 (7)2.7 (4)2.7 (2)2.7 (4)2.7 (4)2.6 (3)15/15
BIPOP-CMA-ES hansen noiseless 2.5 (4)12 (18)10 (9)10 (13)11 (15)11 (11)11 (14)15/15
GA nicolau noiseless 2.6 (5)14 (17)15 (5)27 (15)45 (11)85 (21)126 (23)15/15
NELDERDOERR doerr noiseless 1.4 (1)3.9 (4)2.8 (3)2.8 (2)2.9 (2)2.9 (2)2.9 (3)15/15
ONEFIFTH auger noiseless 3.1 (2)13 (25)9.0 (6)9.1 (9)9.2 (9)9.2 (6)9.2 (9)15/15
IPOP-CMA-ES ros noiseless 5.2 (6)12 (16)11 (8)12 (12)12 (19)13 (13)13 (10)15/15

Δ fopt
f21, 2-D		 1e1
2.0		 1e0
51		 1e-1
174		 1e-2
276		 1e-3
290		 1e-5
324		 1e-7
330		 #succ
15/15
BFGS ros noiseless 2.2 (2)4.8 (6)3.1 (3)2.0 (2)1.9 (2)1.7 (0.8)1.8 (3)15/15
BIPOP-CMA-ES hansen noiseless 1.1 (1)11 (14)10 (10)8.2 (7)10 (18)8.9 (8)8.9 (15)15/15
GA nicolau noiseless 1.2 (1)1.0 (0.8)1.7 (3)4.1 (5)7.7 (9)117 (169)271 (324)10/15
NELDERDOERR doerr noiseless 1.2 (0.8)2.6 (5)2.6 (5)1.7 (2)1.6 (2)1.5 (1)1.5 (3)15/15
ONEFIFTH auger noiseless 2.3 (4)14 (22)19 (25)12 (12)11 (23)10 (18)10 (12)15/15
IPOP-CMA-ES ros noiseless 1.1 (2)13 (13)7.7 (12)5.4 (10)13 (32)13 (30)14 (7)15/15

Δ fopt
f22, 2-D		 1e1
5.0		 1e0
27		 1e-1
168		 1e-2
218		 1e-3
249		 1e-5
289		 1e-7
306		 #succ
15/15
BFGS ros noiseless 5.4 (6)5.0 (3)1.5 (3)1.2 (2)1.1 (2)1 (0.6)1.00 (0.2)15/15
BIPOP-CMA-ES hansen noiseless 1.1 (0.8)7.2 (34)11 (9)8.7 (7)10 (27)9.1 (5)8.7 (22)15/15
GA nicolau noiseless 1.2 (2)3.0 (4)1.3 (1)3.3 (3)7.1 (13)281 (184)1852 (2623)2/15
NELDERDOERR doerr noiseless 1.3 (0.8)8.0 (15)1.8 (1)1.4 (2)1.2 (2)1.1 (0.9)1.1 (1)15/15
ONEFIFTH auger noiseless 1.6 (0.6)46 (24)11 (17)10 (19)9.4 (16)10 (14)12 (13)15/15
IPOP-CMA-ES ros noiseless 1.6 (1)5.8 (7)5.0 (9)5.0 (11)4.8 (7)23 (0.4)72 (1)14/15

Δ fopt
f23, 2-D		 1e1
8.0		 1e0
193		 1e-1
234		 1e-2
263		 1e-3
299		 1e-5
348		 1e-7
379		 #succ
15/15
BFGS ros noiseless 4.7 (7)4.9 (2)28 (55)121 (118)477 (539)410 (399)∞97440/15
BIPOP-CMA-ES hansen noiseless 1.7 (2)8.3 (10)15 (13)14 (12)13 (12)12 (14)12 (8)15/15
GA nicolau noiseless 1.4 (1)6.6 (5)328 (80)842 (654)3312 (4042)∞∞2e50/15
NELDERDOERR doerr noiseless 4.6 (2)1.00 (0.9)1.00 (1)★21.00 (1)★21.0 (0.5)★31.00 (1)★31.0 (0.8)★315/15
ONEFIFTH auger noiseless 2.5 (4)3.7 (4)19 (13)55 (84)237 (319)2092 (2277)6678 (1e4)6/15
IPOP-CMA-ES ros noiseless 1.9 (1)7.8 (7)162 (571)232 (771)205 (30)176 (1154)163 (26)14/15

Δ fopt
f24, 2-D		 1e1
18		 1e0
857		 1e-1
8515		 1e-2
23399		 1e-3
24113		 1e-5
24721		 1e-7
24721		 #succ
5/15
BFGS ros noiseless 3.4 (6)5.1 (4)2.9 (2)∞∞∞∞53130/15
BIPOP-CMA-ES hansen noiseless 4.7 (13)19 (23)17 (12)13 (12)22 (36)22 (61)22 (34)14/15
GA nicolau noiseless 1.6 (2)67 (62)∞∞∞∞∞2e50/15
NELDERDOERR doerr noiseless 1.6 (5)1.9 (4)1.5 (1)3.2 (3)3.1 (5)3.0 (2)3.0 (3)6/15
ONEFIFTH auger noiseless 8.1 (12)12 (17)11 (8)21 (16)20 (15)19 (13)19 (14)15/15
IPOP-CMA-ES ros noiseless 1.3 (1)27 (65)375 (797)∞∞∞∞8e50/15

Previous dimension | Dimension = 3 | Next dimension

Δ fopt
f1, 3-D		 1e1
4.0		 1e0
8.0		 1e-1
8.0		 1e-2
8.0		 1e-3
8.0		 1e-5
8.0		 1e-7
8.0		 #succ
15/15
BFGS ros noiseless 2.1 (0.5)1.1 (0)★1.1 (0)★41.1 (0)★41.1 (0)★41.1 (0)★41.1 (0)★415/15
BIPOP-CMA-ES hansen noiseless 2.5 (5)5.1 (8)11 (6)18 (10)23 (4)34 (2)47 (10)15/15
GA nicolau noiseless 2.8 (5)26 (34)440 (234)1196 (431)2124 (299)4184 (428)6760 (700)15/15
NELDERDOERR doerr noiseless 1.8 (2)2.4 (0.6)3.9 (1)5.4 (0.8)6.9 (0.4)10 (1)14 (1)15/15
ONEFIFTH auger noiseless 3.1 (4)4.1 (3)7.0 (3)11 (2)14 (3)22 (2)29 (3)15/15
IPOP-CMA-ES ros noiseless 3.2 (4)4.9 (4)11 (5)18 (4)23 (3)35 (4)47 (7)15/15

Δ fopt
f2, 3-D		 1e1
38		 1e0
42		 1e-1
43		 1e-2
44		 1e-3
45		 1e-5
47		 1e-7
48		 #succ
15/15
BFGS ros noiseless 3.1 (2)3.9 (1)4.7 (1)4.9 (2)4.9 (1)5.1 (0.9)5.2 (0.8)15/15
BIPOP-CMA-ES hansen noiseless 13 (7)17 (6)20 (2)21 (4)21 (2)23 (4)24 (3)15/15
GA nicolau noiseless 282 (70)404 (99)577 (106)774 (86)944 (176)1365 (132)1940 (211)15/15
NELDERDOERR doerr noiseless 2.3 (0.8)2.8 (2)3.2 (0.4)★3.6 (1)★3.7 (0.8)4.2 (2)4.6 (2)15/15
ONEFIFTH auger noiseless 5859 (1e4)2.0e4 (2e4)4.2e4 (3e4)6.6e4 (4e4)3.1e5 (4e5)∞∞3e60/15
IPOP-CMA-ES ros noiseless 12 (5)17 (4)17 (2)18 (3)19 (3)21 (2)22 (1)15/15

Δ fopt
f3, 3-D		 1e1
38		 1e0
822		 1e-1
830		 1e-2
835		 1e-3
842		 1e-5
847		 1e-7
853		 #succ
15/15
BFGS ros noiseless 41 (28)25 (41)155 (88)154 (311)153 (132)152 (69)151 (142)1/15
BIPOP-CMA-ES hansen noiseless 3.2 (1)4.7 (5)25 (78)25 (29)26 (13)26 (9)26 (90)15/15
GA nicolau noiseless 52 (35)15 (3)23 (4)31 (4)41 (10)69 (8)104 (15)15/15
NELDERDOERR doerr noiseless 3.0 (3)1.5 (1.0)8.4 (8)8.3 (7)8.3 (12)8.3 (9)8.3 (7)15/15
ONEFIFTH auger noiseless 14 (13)12 (8)69 (56)68 (43)68 (47)67 (46)67 (65)15/15
IPOP-CMA-ES ros noiseless 7.5 (9)3.4 (2)25 (12)33 (12)34 (13)35 (13)36 (12)15/15

Δ fopt
f4, 3-D		 1e1
40		 1e0
808		 1e-1
866		 1e-2
921		 1e-3
952		 1e-5
1015		 1e-7
1044		 #succ
15/15
BFGS ros noiseless 48 (60)54 (39)∞∞∞∞∞98360/15
BIPOP-CMA-ES hansen noiseless 10 (15)263 (104)3269 (2750)4051 (2960)3919 (4833)3676 (2901)3574 (2841)4/15
GA nicolau noiseless 91 (62)19 (5)24 (5)34 (6)42 (8)63 (13)114 (83)14/15
NELDERDOERR doerr noiseless 4.6 (5)7.8 (9)43 (37)40 (37)39 (36)37 (49)36 (15)12/15
ONEFIFTH auger noiseless 32 (26)33 (31)228 (254)214 (273)207 (196)195 (206)189 (211)15/15
IPOP-CMA-ES ros noiseless 12 (16)440 (477)4534 (6077)4264 (4604)4125 (3149)3869 (7062)3762 (2437)2/15

Δ fopt
f5, 3-D		 1e1
7.0		 1e0
7.0		 1e-1
7.0		 1e-2
7.0		 1e-3
7.0		 1e-5
7.0		 1e-7
7.0		 #succ
15/15
BFGS ros noiseless 1.5 (0.3)2.3 (0.9)2.4 (0.1)2.4 (0.4)2.4 (0.7)2.4 (0.4)2.4 (0.9)15/15
BIPOP-CMA-ES hansen noiseless 3.4 (2)5.1 (1)5.4 (2)5.4 (2)5.4 (1)5.4 (2)5.4 (1)15/15
GA nicolau noiseless 13 (11)1017 (196)2859 (308)4566 (794)7086 (1126)1.5e4 (1502)∞3e50/15
NELDERDOERR doerr noiseless 1.3 (0.8)2.3 (0.9)2.3 (0.9)2.3 (0.8)2.3 (1)2.3 (1.0)2.3 (1)15/15
ONEFIFTH auger noiseless 2.1 (0.9)2.8 (2)2.9 (2)2.9 (2)2.9 (3)2.9 (2)2.9 (1)15/15
IPOP-CMA-ES ros noiseless 3.2 (1)5.4 (3)5.4 (3)5.4 (2)5.4 (2)5.4 (3)5.4 (3)15/15

Δ fopt
f6, 3-D		 1e1
34		 1e0
56		 1e-1
90		 1e-2
117		 1e-3
149		 1e-5
215		 1e-7
265		 #succ
15/15
BFGS ros noiseless 3.5 (2)3.4 (1)2.9 (1)2.4 (0.9)2.0 (0.6)1.9 (0.4)3.1 (2)15/15
BIPOP-CMA-ES hansen noiseless 2.4 (2)3.2 (1)3.2 (0.7)3.2 (1)3.2 (0.7)3.0 (0.5)3.2 (0.4)15/15
GA nicolau noiseless 8.9 (13)102 (84)272 (161)4167 (2497)4364 (6567)4387 (3502)1.6e4 (7956)0/15
NELDERDOERR doerr noiseless 0.99 (0.5)1 (0.3)★1.0 (0.1)★21.00 (0.4)★1.0 (0.3)★21.00 (0.2)★31.00 (0.2)★315/15
ONEFIFTH auger noiseless 1.6 (0.7)2.0 (0.4)1.8 (0.8)1.8 (0.4)2.0 (0.9)2.1 (1)3.0 (3)15/15
IPOP-CMA-ES ros noiseless 2.8 (2)3.3 (0.8)3.3 (1.0)3.2 (0.7)3.2 (0.6)3.0 (0.5)3.1 (0.4)15/15

Δ fopt
f7, 3-D		 1e1
11		 1e0
65		 1e-1
342		 1e-2
464		 1e-3
482		 1e-5
482		 1e-7
535		 #succ
15/15
BFGS ros noiseless 17 (15)86 (146)∞∞∞∞∞4000/15
BIPOP-CMA-ES hansen noiseless 3.4 (4)2.8 (3)1.1 (1)1 (0.9)1.00 (0.4)1.00 (0.8)1.0 (0.4)15/15
GA nicolau noiseless 3.5 (4)24 (31)27 (12)134 (179)196 (319)196 (15)252 (24)10/15
NELDERDOERR doerr noiseless 7.8 (0.8)4.2 (9)4.3 (7)4.2 (4)8.8 (14)8.8 (24)8.8 (12)15/15
ONEFIFTH auger noiseless 2.0 (1)3.6 (5)3.9 (6)7.7 (3)9.3 (17)9.3 (17)8.4 (12)15/15
IPOP-CMA-ES ros noiseless 3.6 (4)7.2 (1)2.0 (0.8)1.6 (3)1.9 (6)1.9 (3)1.8 (0.9)15/15

Δ fopt
f8, 3-D		 1e1
27		 1e0
45		 1e-1
152		 1e-2
179		 1e-3
188		 1e-5
198		 1e-7
208		 #succ
15/15
BFGS ros noiseless 1.4 (0.7)2.7 (2)1.1 (0.5)1.0 (0.3)1.0 (0.4)1.0 (0.3)1.0 (0.3)15/15
BIPOP-CMA-ES hansen noiseless 3.5 (3)8.0 (5)4.5 (3)4.8 (3)5.1 (3)5.4 (2)5.6 (3)15/15
GA nicolau noiseless 47 (61)164 (91)403 (522)∞∞∞∞3e50/15
NELDERDOERR doerr noiseless 1.6 (2)4.0 (2)1.5 (0.8)1.4 (0.8)1.4 (0.7)1.5 (0.8)1.5 (0.6)15/15
ONEFIFTH auger noiseless 2.8 (2)44 (98)20 (38)38 (34)64 (30)119 (32)171 (20)15/15
IPOP-CMA-ES ros noiseless 5.0 (7)13 (19)5.8 (5)5.7 (5)5.8 (3)6.2 (4)6.3 (4)15/15

Δ fopt
f9, 3-D		 1e1
21		 1e0
65		 1e-1
127		 1e-2
149		 1e-3
159		 1e-5
169		 1e-7
178		 #succ
15/15
BFGS ros noiseless 1.5 (1.0)1.5 (1)1.1 (0.5)1.1 (0.1)1.1 (0.3)1.1 (0.4)1.0 (0.2)15/15
BIPOP-CMA-ES hansen noiseless 3.9 (2)4.6 (6)4.4 (1)4.7 (3)4.9 (1)5.3 (2)5.6 (2)15/15
GA nicolau noiseless 49 (39)104 (46)3768 (2450)2.8e4 (2e4)∞∞∞3e50/15
NELDERDOERR doerr noiseless 1.5 (0.5)1.4 (0.8)1.1 (0.5)1.1 (0.5)1.1 (0.3)1.2 (0.8)1.3 (0.6)15/15
ONEFIFTH auger noiseless 2.6 (0.6)80 (230)71 (167)88 (13)116 (248)179 (18)237 (129)15/15
IPOP-CMA-ES ros noiseless 2.9 (3)4.8 (6)4.4 (2)4.8 (4)5.0 (4)5.5 (3)5.7 (2)15/15

Δ fopt
f10, 3-D		 1e1
114		 1e0
152		 1e-1
168		 1e-2
180		 1e-3
194		 1e-5
218		 1e-7
242		 #succ
15/15
BFGS ros noiseless 1.0 (0.6)1.2 (0.2)1.2 (0.2)1.2 (0.2)1.4 (0.9)5.9 (5)76 (98)3/15
BIPOP-CMA-ES hansen noiseless 4.1 (2)4.1 (2)4.6 (2)4.9 (0.5)4.9 (0.4)4.9 (0.3)4.8 (0.5)15/15
GA nicolau noiseless 202 (104)2001 (2059)1.2e4 (2e4)∞∞∞∞3e50/15
NELDERDOERR doerr noiseless 1.1 (0.8)1.1 (0.2)1.1 (0.4)1.1 (0.3)1.1 (0.4)1.0 (0.2)★21.0 (0.1)★415/15
ONEFIFTH auger noiseless 2115 (4206)6187 (6093)1.2e4 (9454)2.3e4 (7368)7.6e4 (3e4)∞∞3e60/15
IPOP-CMA-ES ros noiseless 3.9 (1)4.3 (0.9)4.4 (0.5)4.5 (0.7)4.4 (0.6)4.4 (0.5)4.3 (0.3)15/15

Δ fopt
f11, 3-D		 1e1
67		 1e0
105		 1e-1
227		 1e-2
263		 1e-3
277		 1e-5
302		 1e-7
327		 #succ
15/15
BFGS ros noiseless 1.0 (0.7)1.0 (0.2)★21.0 (0.6)1.4 (1)3.7 (3)41 (68)∞2e40/15
BIPOP-CMA-ES hansen noiseless 10 (4)7.5 (1)4.0 (0.3)3.6 (0.4)3.7 (0.4)3.7 (0.4)3.6 (0.3)15/15
GA nicolau noiseless 74 (65)2073 (3584)5577 (4319)∞∞∞∞3e50/15
NELDERDOERR doerr noiseless 2.3 (1)2.0 (0.9)1.1 (0.3)1 (0.2)1.0 (0.1)★1 (0.2)★31.0 (0.2)★415/15
ONEFIFTH auger noiseless 8373 (7089)1.5e4 (8372)1.7e4 (5262)1.7e5 (2e5)∞∞∞3e60/15
IPOP-CMA-ES ros noiseless 9.2 (5)7.5 (0.9)4.0 (0.8)3.7 (0.3)3.7 (0.5)3.7 (0.3)3.7 (0.3)15/15

Δ fopt
f12, 3-D		 1e1
65		 1e0
168		 1e-1
338		 1e-2
401		 1e-3
445		 1e-5
696		 1e-7
790		 #succ
15/15
BFGS ros noiseless 1.7 (1)1.4 (1)1.00 (0.9)1.00 (0.6)1.00 (0.5)2.3 (2)43 (32)9/15
BIPOP-CMA-ES hansen noiseless 7.8 (10)5.7 (7)4.5 (3)4.7 (3)4.8 (2)4.0 (2)4.1 (2)15/15
GA nicolau noiseless 425 (105)2373 (3702)1.3e4 (7574)1.1e4 (8450)∞∞∞3e50/15
NELDERDOERR doerr noiseless 1.7 (0.8)1.6 (2)1.3 (1)1.2 (1)1.3 (0.8)1.00 (0.4)1.0 (0.6)★215/15
ONEFIFTH auger noiseless 2.8e4 (4e4)2.7e4 (4e4)3.9e4 (3e4)1.1e5 (1e5)∞∞∞3e60/15
IPOP-CMA-ES ros noiseless 8.9 (5)6.6 (8)4.5 (5)4.6 (5)4.6 (2)3.7 (3)4.1 (2)15/15

Δ fopt
f13, 3-D		 1e1
49		 1e0
85		 1e-1
108		 1e-2
136		 1e-3
215		 1e-5
281		 1e-7
365		 #succ
15/15
BFGS ros noiseless 1.1 (0.2)1 (0.2)1.0 (0.1)1.00 (0.2)2.1 (4)409 (131)∞3e40/15
BIPOP-CMA-ES hansen noiseless 3.8 (0.9)3.8 (1)5.0 (0.9)6.1 (2)4.5 (1)4.8 (0.6)4.6 (0.9)15/15
GA nicolau noiseless 152 (73)252 (48)3660 (6296)1.5e4 (2e4)2.0e4 (2e4)∞∞3e50/15
NELDERDOERR doerr noiseless 1.0 (0.2)1.1 (0.4)1.2 (0.5)1.3 (0.9)1.2 (0.6)1.2 (0.9)★41.1 (0.6)★415/15
ONEFIFTH auger noiseless 16 (22)65 (71)125 (48)289 (124)1032 (445)3311 (3306)5.7e4 (7e4)1/15
IPOP-CMA-ES ros noiseless 3.4 (0.6)5.0 (4)5.9 (2)5.7 (2)4.6 (1.0)4.6 (1)4.5 (0.5)15/15

Δ fopt
f14, 3-D		 1e1
2.0		 1e0
17		 1e-1
28		 1e-2
43		 1e-3
71		 1e-5
110		 1e-7
194		 #succ
15/15
BFGS ros noiseless 4.1 (4)1.5 (1)1.5 (0.8)1.3 (1)1.1 (0.4)★1.0 (0.2)★329 (22)4/15
BIPOP-CMA-ES hansen noiseless 3.4 (3)2.9 (2)3.6 (1)4.2 (2)4.4 (1)7.1 (1)6.0 (0.4)15/15
GA nicolau noiseless 2.1 (2)11 (11)158 (117)283 (21)320 (99)6041 (2e4)∞3e50/15
NELDERDOERR doerr noiseless 2.9 (3)1.1 (0.5)1.4 (0.4)1.8 (0.5)1.5 (0.3)1.6 (0.3)1.2 (0.2)★15/15
ONEFIFTH auger noiseless 2.4 (3)1.8 (0.7)1.9 (1)2.5 (0.8)5.8 (4)2367 (150)∞3e60/15
IPOP-CMA-ES ros noiseless 3.1 (6)3.8 (4)4.1 (2)4.7 (2)4.8 (1)6.8 (1)5.8 (0.6)15/15

Δ fopt
f15, 3-D		 1e1
121		 1e0
1372		 1e-1
6285		 1e-2
8282		 1e-3
8429		 1e-5
8787		 1e-7
9041		 #succ
15/15
BFGS ros noiseless 7.3 (6)17 (13)22 (29)17 (11)16 (22)16 (9)15 (21)1/15
BIPOP-CMA-ES hansen noiseless 2.0 (4)1.3 (1)1.7 (2)1.3 (1)1.3 (1)1.3 (1)1.3 (1)15/15
GA nicolau noiseless 14 (9)20 (9)62 (96)62 (64)62 (54)83 (68)150 (325)3/15
NELDERDOERR doerr noiseless 1.4 (0.1)1.0 (0.2)2.5 (1)1.9 (3)1.9 (1)1.8 (5)1.8 (2)13/15
ONEFIFTH auger noiseless 3.4 (3)6.2 (6)13 (10)10 (12)10 (8)10 (8)9.3 (7)15/15
IPOP-CMA-ES ros noiseless 2.4 (3)1.4 (2)1.2 (1.0)0.93 (0.6)0.93 (0.7)0.92 (0.8)0.93 (0.5)15/15

Δ fopt
f16, 3-D		 1e1
41		 1e0
319		 1e-1
582		 1e-2
789		 1e-3
1864		 1e-5
3204		 1e-7
3361		 #succ
15/15
BFGS ros noiseless 71 (40)154 (200)∞∞∞∞∞2e40/15
BIPOP-CMA-ES hansen noiseless 2.1 (2)3.5 (3)4.3 (4)3.3 (3)1.7 (1)1.1 (0.6)1.1 (0.6)15/15
GA nicolau noiseless 0.99 (0.8)6.0 (14)61 (46)339 (199)490 (738)654 (232)1288 (1008)1/15
NELDERDOERR doerr noiseless 1.2 (0.3)2.8 (4)3.4 (4)3.9 (5)3.2 (3)2.6 (3)6.3 (5)14/15
ONEFIFTH auger noiseless 8.6 (28)18 (24)40 (41)57 (84)120 (292)231 (232)3980 (5579)3/15
IPOP-CMA-ES ros noiseless 2.2 (3)3.2 (7)3.8 (4)3.3 (2)1.4 (1)0.88 (0.7)1.1 (0.6)15/15

Δ fopt
f17, 3-D		 1e1
4.0		 1e0
78		 1e-1
282		 1e-2
491		 1e-3
1134		 1e-5
2347		 1e-7
3469		 #succ
15/15
BFGS ros noiseless 43 (56)45 (38)∞∞∞∞∞73360/15
BIPOP-CMA-ES hansen noiseless 4.8 (7)4.0 (10)2.4 (2)2.3 (2)1.5 (1)1.4 (0.9)1.1 (0.7)15/15
GA nicolau noiseless 1.2 (1)30 (15)57 (8)72 (11)72 (10)115 (102)∞3e50/15
NELDERDOERR doerr noiseless 1.7 (2)3.8 (11)8.5 (7)36 (22)69 (75)∞∞5e40/15
ONEFIFTH auger noiseless 22 (3)33 (41)865 (191)2294 (4274)4122 (6374)∞∞3e60/15
IPOP-CMA-ES ros noiseless 18 (4)2.2 (0.7)1.1 (1.0)1.8 (0.9)1.2 (0.9)1.1 (0.1)1.0 (0.4)15/15

Δ fopt
f18, 3-D		 1e1
40		 1e0
145		 1e-1
1289		 1e-2
3084		 1e-3
3523		 1e-5
4738		 1e-7
5527		 #succ
15/15
BFGS ros noiseless 33 (58)∞∞∞∞∞∞84880/15
BIPOP-CMA-ES hansen noiseless 1.4 (1)3.4 (3)1.8 (0.6)1.1 (0.9)1.00 (0.7)1.1 (0.9)1.3 (0.5)15/15
GA nicolau noiseless 6.3 (8)63 (22)42 (61)423 (660)1228 (919)∞∞3e50/15
NELDERDOERR doerr noiseless 1.9 (2)5.4 (4)7.0 (4)16 (13)72 (84)169 (277)∞6e40/15
ONEFIFTH auger noiseless 340 (1188)296 (357)2752 (717)1.4e4 (6809)1.2e4 (1e4)∞∞3e60/15
IPOP-CMA-ES ros noiseless 1.4 (0.8)1.8 (0.5)1.2 (2)1.0 (1)1.2 (1)1.4 (0.9)1.3 (0.8)15/15

Δ fopt
f19, 3-D		 1e1
1		 1e0
1		 1e-1
109		 1e-2
6764		 1e-3
7367		 1e-5
7399		 1e-7
7441		 #succ
15/15
BFGS ros noiseless 113 (114)872 (1698)162 (119)33 (46)∞∞∞1e40/15
BIPOP-CMA-ES hansen noiseless 13 (13)101 (101)49 (46)2.9 (2)3.2 (3)3.2 (2)3.3 (2)15/15
GA nicolau noiseless 7.1 (4)928 (1244)101 (47)19 (15)39 (72)81 (102)∞3e50/15
NELDERDOERR doerr noiseless 7.6 (5)146 (207)20 (23)5.4 (1)11 (23)11 (19)11 (21)7/15
ONEFIFTH auger noiseless 10 (10)2.1e5 (8e5)3.2e4 (3e4)1776 (3326)2649 (3360)2638 (4561)2624 (2721)2/15
IPOP-CMA-ES ros noiseless 11 (11)196 (256)67 (39)4.4 (4)4.1 (4)4.1 (4)4.1 (3)15/15

Δ fopt
f20, 3-D		 1e1
8.0		 1e0
385		 1e-1
2291		 1e-2
2398		 1e-3
2481		 1e-5
2573		 1e-7
2776		 #succ
15/15
BFGS ros noiseless 1.9 (1)1.7 (1)5.5 (8)5.3 (5)5.1 (4)4.9 (5)4.6 (7)8/15
BIPOP-CMA-ES hansen noiseless 2.4 (2)8.2 (9)10 (6)10 (6)10 (4)10 (4)9.5 (5)15/15
GA nicolau noiseless 5.2 (3)14 (7)7.1 (1)10 (2)14 (1)21 (4)29 (6)15/15
NELDERDOERR doerr noiseless 1.8 (1)3.6 (5)10 (11)10 (14)10 (9)9.4 (18)8.7 (8)13/15
ONEFIFTH auger noiseless 3.2 (1)4.7 (7)10 (11)9.1 (6)8.8 (8)8.5 (6)7.9 (7)15/15
IPOP-CMA-ES ros noiseless 3.0 (2)4.5 (3)5.6 (3)5.7 (4)5.6 (5)5.7 (5)5.4 (4)15/15

Δ fopt
f21, 3-D		 1e1
6.0		 1e0
184		 1e-1
425		 1e-2
439		 1e-3
458		 1e-5
469		 1e-7
482		 #succ
14/15
BFGS ros noiseless 2.1 (3)3.3 (2)3.5 (3)3.4 (3)3.3 (2)3.3 (2)3.2 (3)14/15
BIPOP-CMA-ES hansen noiseless 1.7 (2)6.8 (18)6.0 (9)6.0 (9)6.0 (11)6.1 (3)6.1 (8)15/15
GA nicolau noiseless 1.5 (2)2.5 (3)5.3 (3)18 (8)29 (11)99 (337)229 (22)12/15
NELDERDOERR doerr noiseless 2.0 (1)2.8 (2)2.9 (3)2.8 (2)2.7 (3)2.7 (3)2.6 (2)15/15
ONEFIFTH auger noiseless 2.0 (1.0)15 (42)17 (12)17 (12)16 (25)16 (40)16 (36)15/15
IPOP-CMA-ES ros noiseless 1.5 (3)11 (7)10 (10)11 (25)11 (11)11 (11)11 (4)15/15

Δ fopt
f22, 3-D		 1e1
18		 1e0
170		 1e-1
354		 1e-2
362		 1e-3
384		 1e-5
401		 1e-7
414		 #succ
15/15
BFGS ros noiseless 3.3 (4)2.6 (3)2.1 (2)2.1 (2)2.0 (1)2.0 (2)2.0 (2)15/15
BIPOP-CMA-ES hansen noiseless 1.1 (2)6.4 (12)13 (9)14 (6)13 (13)13 (21)13 (20)15/15
GA nicolau noiseless 1.0 (2)3.5 (3)6.5 (11)27 (24)273 (617)1592 (2042)3084 (7148)3/15
NELDERDOERR doerr noiseless 4.1 (12)2.0 (2)2.2 (3)2.2 (2)2.1 (3)2.0 (3)2.0 (5)15/15
ONEFIFTH auger noiseless 23 (82)17 (36)17 (8)17 (15)17 (7)19 (28)20 (26)15/15
IPOP-CMA-ES ros noiseless 1.2 (0.8)5.0 (7)21 (32)90 (230)247 (300)286 (599)281 (300)11/15

Δ fopt
f23, 3-D		 1e1
3.0		 1e0
407		 1e-1
906		 1e-2
1215		 1e-3
2214		 1e-5
2293		 1e-7
2393		 #succ
15/15
BFGS ros noiseless 15 (36)8.7 (10)112 (73)∞∞∞∞1e40/15
BIPOP-CMA-ES hansen noiseless 4.2 (5)6.4 (6)9.3 (8)7.1 (7)4.2 (5)4.2 (5)4.2 (5)15/15
GA nicolau noiseless 3.7 (4)16 (9)522 (602)3702 (3532)∞∞∞3e50/15
NELDERDOERR doerr noiseless 5.8 (2)1.00 (1)1.0 (0.9)★21.0 (1)★21.1 (0.7)★1.4 (2)1.4 (3)15/15
ONEFIFTH auger noiseless 19 (6)2.9 (2)13 (8)238 (175)506 (1079)1771 (1941)3541 (3427)4/15
IPOP-CMA-ES ros noiseless 4.3 (5)5.2 (7)80 (11)60 (12)33 (105)32 (194)31 (95)14/15

Δ fopt
f24, 3-D		 1e1
97		 1e0
10391		 1e-1
1.0e5		 1e-2
3.6e5		 1e-3
3.6e5		 1e-5
3.6e5		 1e-7
3.6e5		 #succ
2/15
BFGS ros noiseless 9.3 (7)∞∞∞∞∞∞86000/15
BIPOP-CMA-ES hansen noiseless 1.3 (0.8)7.6 (10)7.9 (7)3.0 (2)4.1 (1)4.9 (6)4.9 (4)11/15
GA nicolau noiseless 18 (10)∞∞∞∞∞∞3e50/15
NELDERDOERR doerr noiseless 2.3 (4)1.5 (1)3.9 (6)2.4 (2)2.4 (5)2.4 (3)2.4 (2)1/15
ONEFIFTH auger noiseless 23 (27)13 (8)40 (28)124 (103)124 (164)124 (134)124 (120)1/15
IPOP-CMA-ES ros noiseless 1.9 (1)272 (219)∞∞∞∞∞1e60/15

Previous dimension | Dimension = 5 | Next dimension

Δ fopt
f1, 5-D		 1e1
11		 1e0
12		 1e-1
12		 1e-2
12		 1e-3
12		 1e-5
12		 1e-7
12		 #succ
15/15
BFGS ros noiseless 1.2 (0)1.1 (0)★41.1 (0)★41.1 (0)★41.1 (0)★41.1 (0)★41.1 (0)★415/15
BIPOP-CMA-ES hansen noiseless 3.2 (2)9.1 (4)15 (3)21 (5)28 (2)41 (3)54 (6)15/15
GA nicolau noiseless 8.7 (6)369 (268)1202 (114)2130 (343)2989 (312)5474 (435)8468 (426)13/15
NELDERDOERR doerr noiseless 1.5 (1)3.5 (2)5.6 (0.6)7.6 (2)10 (1.0)14 (3)18 (3)15/15
ONEFIFTH auger noiseless 2.3 (1)5.1 (2)8.6 (2)11 (2)15 (2)22 (1)29 (3)15/15
IPOP-CMA-ES ros noiseless 2.5 (2)8.1 (3)14 (3)21 (4)28 (3)40 (3)52 (3)15/15

Δ fopt
f2, 5-D		 1e1
83		 1e0
87		 1e-1
88		 1e-2
89		 1e-3
90		 1e-5
92		 1e-7
94		 #succ
15/15
BFGS ros noiseless 3.9 (1)5.7 (2)6.3 (1)6.5 (2)6.6 (2)6.9 (2)7.1 (1)15/15
BIPOP-CMA-ES hansen noiseless 13 (5)16 (1)18 (2)19 (2)20 (2)21 (2)22 (2)15/15
GA nicolau noiseless 334 (61)459 (61)609 (55)772 (31)1301 (66)2156 (132)2535 (1398)13/15
NELDERDOERR doerr noiseless 4.9 (3)8.2 (4)9.0 (6)9.3 (4)10 (3)10 (5)10 (7)15/15
ONEFIFTH auger noiseless 5577 (1e4)1.6e4 (1e4)3.1e4 (2e4)4.6e4 (3e4)1.9e5 (3e5)8.0e5 (8e5)∞5e60/15
IPOP-CMA-ES ros noiseless 14 (3)16 (4)18 (2)19 (2)19 (2)21 (1)22 (1)15/15

Δ fopt
f3, 5-D		 1e1
716		 1e0
1622		 1e-1
1637		 1e-2
1642		 1e-3
1646		 1e-5
1650		 1e-7
1654		 #succ
15/15
BFGS ros noiseless 107 (164)∞∞∞∞∞∞2e40/15
BIPOP-CMA-ES hansen noiseless 1.4 (0.8)16 (22)139 (348)139 (9)139 (17)139 (346)140 (571)14/15
GA nicolau noiseless 19 (0.9)18 (2)25 (2)34 (5)43 (5)112 (309)200 (232)11/15
NELDERDOERR doerr noiseless 1.5 (3)33 (92)268 (349)268 (257)267 (391)266 (178)266 (480)3/15
ONEFIFTH auger noiseless 16 (24)308 (315)3860 (3573)3848 (2408)3839 (6199)3830 (7396)3820 (2309)8/15
IPOP-CMA-ES ros noiseless 2.2 (2)70 (190)3130 (2136)3121 (3953)3113 (3008)3106 (4419)3099 (1586)2/15

Δ fopt
f4, 5-D		 1e1
809		 1e0
1633		 1e-1
1688		 1e-2
1758		 1e-3
1817		 1e-5
1886		 1e-7
1903		 #succ
15/15
BFGS ros noiseless 169 (194)∞∞∞∞∞∞2e40/15
BIPOP-CMA-ES hansen noiseless 2.7 (3)∞∞∞∞∞∞2e60/15
GA nicolau noiseless 18 (3)20 (2)26 (2)33 (4)41 (5)58 (8)185 (134)9/15
NELDERDOERR doerr noiseless 7.1 (4)898 (597)870 (740)835 (924)808 (1156)779 (557)772 (828)1/15
ONEFIFTH auger noiseless 25 (36)3741 (4593)2.0e4 (4e4)1.9e4 (1e4)1.9e4 (2e4)1.8e4 (2e4)1.8e4 (2e4)2/15
IPOP-CMA-ES ros noiseless 2.0 (2)∞∞∞∞∞∞9e50/15

Δ fopt
f5, 5-D		 1e1
10		 1e0
10		 1e-1
10		 1e-2
10		 1e-3
10		 1e-5
10		 1e-7
10		 #succ
15/15
BFGS ros noiseless 1.9 (0.3)3.0 (1)3.1 (0.6)3.1 (0.8)3.1 (1)3.1 (1)3.1 (0.5)15/15
BIPOP-CMA-ES hansen noiseless 4.5 (2)6.5 (2)6.6 (3)6.6 (2)6.6 (2)6.6 (2)6.6 (3)15/15
GA nicolau noiseless 481 (266)2072 (144)3983 (584)6349 (682)9220 (872)1.7e4 (676)3.4e4 (3138)0/15
NELDERDOERR doerr noiseless 1.9 (0.6)2.4 (1)2.5 (0.8)2.5 (0.7)2.5 (0.8)2.5 (0.7)2.5 (0.8)15/15
ONEFIFTH auger noiseless 2.0 (0.9)2.4 (0.8)2.5 (0.8)2.6 (0.8)2.6 (0.8)2.6 (1)2.6 (1.0)15/15
IPOP-CMA-ES ros noiseless 4.6 (1)6.0 (3)6.3 (2)6.3 (2)6.3 (3)6.3 (2)6.3 (2)15/15

Δ fopt
f6, 5-D		 1e1
114		 1e0
214		 1e-1
281		 1e-2
404		 1e-3
580		 1e-5
1038		 1e-7
1332		 #succ
15/15
BFGS ros noiseless 3.0 (1)3.3 (2)3.4 (1)3.0 (1)2.5 (0.8)2.0 (0.9)7.8 (4)15/15
BIPOP-CMA-ES hansen noiseless 2.3 (1)2.1 (0.6)2.2 (0.6)1.9 (0.4)1.7 (0.2)1.3 (0.3)1.3 (0.2)15/15
GA nicolau noiseless 66 (44)148 (41)382 (78)3680 (3734)1.2e4 (2e4)∞∞5e50/15
NELDERDOERR doerr noiseless 5.1 (7)5.6 (8)5.6 (6)4.9 (4)5.3 (7)5.6 (5)8.5 (8)14/15
ONEFIFTH auger noiseless 1.6 (1)1.5 (1)1.7 (1)1.5 (0.6)1.3 (0.2)1.0 (0.6)1.00 (0.2)15/15
IPOP-CMA-ES ros noiseless 2.5 (1)2.1 (0.6)2.2 (0.3)2.0 (0.4)1.7 (0.2)1.3 (0.2)1.2 (0.2)15/15

Δ fopt
f7, 5-D		 1e1
24		 1e0
324		 1e-1
1171		 1e-2
1451		 1e-3
1572		 1e-5
1572		 1e-7
1597		 #succ
15/15
BFGS ros noiseless ∞∞∞∞∞∞∞6000/15
BIPOP-CMA-ES hansen noiseless 4.9 (0.9)1.5 (2)1.0 (0.8)1.00 (1.0)1.0 (0.8)1.0 (0.8)1.00 (0.5)15/15
GA nicolau noiseless 49 (51)35 (13)57 (116)245 (357)524 (974)524 (484)523 (1027)5/15
NELDERDOERR doerr noiseless 1.3 (0.3)★27.5 (11)15 (11)39 (48)71 (85)71 (52)71 (112)9/15
ONEFIFTH auger noiseless 5.5 (8)6.8 (14)100 (166)372 (359)807 (905)807 (1057)794 (678)15/15
IPOP-CMA-ES ros noiseless 4.4 (3)1.7 (1)1.2 (0.8)1.1 (0.8)1.2 (0.5)1.2 (0.8)1.2 (0.5)15/15

Δ fopt
f8, 5-D		 1e1
73		 1e0
273		 1e-1
336		 1e-2
372		 1e-3
391		 1e-5
410		 1e-7
422		 #succ
15/15
BFGS ros noiseless 2.1 (0.5)1.8 (2)1.6 (0.3)1.5 (1)1.5 (2)1.5 (2)1.5 (0.5)★15/15
BIPOP-CMA-ES hansen noiseless 3.2 (3)3.7 (0.7)4.5 (1)4.7 (0.7)4.8 (3)5.1 (0.5)5.4 (2)15/15
GA nicolau noiseless 187 (100)837 (1381)∞∞∞∞∞5e50/15
NELDERDOERR doerr noiseless 2.1 (2)2.4 (2)2.4 (2)2.3 (2)2.3 (1)2.4 (0.7)2.4 (1)15/15
ONEFIFTH auger noiseless 15 (42)242 (619)227 (498)236 (320)258 (145)317 (302)382 (277)15/15
IPOP-CMA-ES ros noiseless 3.5 (3)4.8 (6)5.3 (4)5.5 (4)5.6 (4)5.8 (4)6.1 (2)15/15

Δ fopt
f9, 5-D		 1e1
35		 1e0
127		 1e-1
214		 1e-2
263		 1e-3
300		 1e-5
335		 1e-7
369		 #succ
15/15
BFGS ros noiseless 3.6 (3)3.0 (2)2.0 (1)1.8 (1.0)1.6 (0.9)1.5 (0.7)1.4 (0.6)15/15
BIPOP-CMA-ES hansen noiseless 5.8 (1)8.7 (9)7.2 (2)6.7 (2)6.4 (3)6.3 (3)6.2 (3)15/15
GA nicolau noiseless 418 (55)5.6e4 (4e4)∞∞∞∞∞5e50/15
NELDERDOERR doerr noiseless 2.3 (2)3.1 (2)2.5 (0.8)2.3 (1)2.1 (1)2.1 (0.6)2.0 (0.8)15/15
ONEFIFTH auger noiseless 2.8 (0.8)103 (711)80 (425)99 (205)128 (340)201 (187)266 (69)15/15
IPOP-CMA-ES ros noiseless 5.9 (1)11 (5)8.7 (6)7.9 (5)7.5 (3)7.4 (4)7.2 (2)15/15

Δ fopt
f10, 5-D		 1e1
349		 1e0
500		 1e-1
574		 1e-2
607		 1e-3
626		 1e-5
829		 1e-7
880		 #succ
15/15
BFGS ros noiseless 1.0 (0.5)1.00 (0.3)1.0 (0.4)1 (0.3)1.00 (0.3)1.1 (0.2)23 (7)5/15
BIPOP-CMA-ES hansen noiseless 3.5 (0.8)2.9 (0.4)2.7 (0.4)2.7 (0.3)2.8 (0.3)2.3 (0.2)2.4 (0.1)15/15
GA nicolau noiseless 2375 (2163)∞∞∞∞∞∞5e50/15
NELDERDOERR doerr noiseless 1.2 (0.9)1.3 (0.6)1.2 (0.3)1.2 (0.5)1.2 (0.3)1.0 (0.4)1.00 (0.3)★315/15
ONEFIFTH auger noiseless 699 (459)2505 (1566)4463 (1225)5853 (1129)1.4e4 (8225)∞∞5e60/15
IPOP-CMA-ES ros noiseless 3.7 (0.8)2.9 (0.3)2.7 (0.3)2.7 (0.3)2.8 (0.1)2.3 (0.2)2.3 (0.2)15/15

Δ fopt
f11, 5-D		 1e1
143		 1e0
202		 1e-1
763		 1e-2
977		 1e-3
1177		 1e-5
1467		 1e-7
1673		 #succ
15/15
BFGS ros noiseless 1.00 (0.2)★21.00 (0.6)★41.1 (0.8)1.9 (2)8.2 (14)199 (121)∞4e40/15
BIPOP-CMA-ES hansen noiseless 8.3 (3)7.1 (1)2.2 (0.3)1.8 (0.2)1.6 (0.2)1.4 (0.1)1.3 (0.1)15/15
GA nicolau noiseless 338 (911)7124 (6214)9351 (2e4)∞∞∞∞5e50/15
NELDERDOERR doerr noiseless 4.5 (5)4.7 (3)1.5 (0.7)1.4 (0.5)1.2 (0.4)★1.1 (0.2)1.2 (0.6)15/15
ONEFIFTH auger noiseless 6381 (4229)9277 (2938)3729 (108)3788 (593)6671 (3394)∞∞5e60/15
IPOP-CMA-ES ros noiseless 8.6 (1)7.3 (0.8)2.1 (0.2)1.8 (0.1)1.6 (0.1)1.4 (0.1)1.3 (0.1)15/15

Δ fopt
f12, 5-D		 1e1
108		 1e0
268		 1e-1
371		 1e-2
413		 1e-3
461		 1e-5
1303		 1e-7
1494		 #succ
15/15
BFGS ros noiseless 1.1 (1)★1.00 (0.8)1.00 (0.8)1 (0.6)★1.0 (0.7)★2.0 (1)49 (92)5/15
BIPOP-CMA-ES hansen noiseless 11 (13)7.4 (6)7.4 (6)7.5 (6)7.7 (5)3.3 (2)3.3 (2)15/15
GA nicolau noiseless 933 (116)2447 (1412)1.9e4 (2e4)∞∞∞∞5e50/15
NELDERDOERR doerr noiseless 4.4 (4)2.9 (2)2.7 (2)2.7 (2)2.7 (2)1.1 (1)1.2 (0.8)15/15
ONEFIFTH auger noiseless 2.1e4 (4e4)6.1e4 (1e5)1.9e5 (2e5)∞∞∞∞5e60/15
IPOP-CMA-ES ros noiseless 9.5 (4)6.1 (5)6.2 (5)6.4 (5)6.4 (5)2.8 (2)2.8 (2)15/15

Δ fopt
f13, 5-D		 1e1
132		 1e0
195		 1e-1
250		 1e-2
319		 1e-3
1310		 1e-5
1752		 1e-7
2255		 #succ
15/15
BFGS ros noiseless 1.0 (0.2)1.00 (0.2)1.00 (0.1)★1.0 (0.1)★24.8 (14)136 (233)∞5e40/15
BIPOP-CMA-ES hansen noiseless 3.9 (3)5.4 (3)5.9 (2)5.4 (0.9)1.6 (0.3)1.5 (0.2)1.7 (0.8)15/15
GA nicolau noiseless 243 (33)726 (664)4390 (3495)2.3e4 (3e4)∞∞∞5e50/15
NELDERDOERR doerr noiseless 2.4 (1)2.4 (3)5.2 (2)6.1 (10)1.9 (0.8)3.9 (10)5.0 (3)15/15
ONEFIFTH auger noiseless 20 (30)30 (29)110 (105)246 (133)156 (68)1518 (2147)7247 (3880)1/15
IPOP-CMA-ES ros noiseless 3.2 (2)4.9 (2)5.3 (2)5.1 (2)1.4 (0.4)1.6 (0.5)1.6 (0.6)15/15

Δ fopt
f14, 5-D		 1e1
10		 1e0
41		 1e-1
58		 1e-2
90		 1e-3
139		 1e-5
251		 1e-7
476		 #succ
15/15
BFGS ros noiseless 2.2 (1)1.7 (1)1.8 (1)1.5 (0.8)1.3 (0.7)1.0 (0.4)★2350 (513)0/15
BIPOP-CMA-ES hansen noiseless 1.1 (0.7)2.8 (1)3.7 (1)4.0 (1)4.5 (1)5.4 (1)4.5 (0.3)15/15
GA nicolau noiseless 2.1 (3)90 (49)267 (65)305 (40)349 (72)∞∞5e50/15
NELDERDOERR doerr noiseless 1.0 (1)1.1 (0.3)1.4 (0.3)1.6 (0.5)1.7 (0.6)1.6 (0.4)1.3 (0.2)★415/15
ONEFIFTH auger noiseless 2.0 (1)1.8 (1.0)2.1 (0.7)2.2 (0.8)5.5 (2)1120 (8)∞5e60/15
IPOP-CMA-ES ros noiseless 2.1 (3)2.9 (2)3.8 (1)4.3 (1)4.7 (2)5.5 (0.4)4.4 (0.5)15/15

Δ fopt
f15, 5-D		 1e1
511		 1e0
9310		 1e-1
19369		 1e-2
19743		 1e-3
20073		 1e-5
20769		 1e-7
21359		 #succ
14/15
BFGS ros noiseless 87 (122)∞∞∞∞∞∞2e40/15
BIPOP-CMA-ES hansen noiseless 1.6 (0.9)1.5 (0.9)1.2 (0.8)1.2 (0.6)1.2 (0.7)1.2 (0.5)1.2 (0.5)15/15
GA nicolau noiseless 35 (6)91 (81)367 (544)361 (337)355 (707)345 (562)∞5e50/15
NELDERDOERR doerr noiseless 4.5 (4)20 (27)73 (91)72 (85)71 (112)69 (60)67 (30)1/15
ONEFIFTH auger noiseless 28 (54)103 (50)246 (323)241 (220)237 (268)229 (304)223 (347)10/15
IPOP-CMA-ES ros noiseless 2.3 (2)1.3 (0.5)1.2 (1)1.2 (1)1.2 (1)1.2 (1)1.2 (1)15/15

Δ fopt
f16, 5-D		 1e1
120		 1e0
612		 1e-1
2662		 1e-2
10163		 1e-3
10449		 1e-5
11644		 1e-7
12095		 #succ
15/15
BFGS ros noiseless 153 (129)960 (1018)∞∞∞∞∞4e40/15
BIPOP-CMA-ES hansen noiseless 3.0 (2)3.6 (3)2.6 (5)1.1 (1)1.3 (2)1.4 (1)1.4 (0.8)15/15
GA nicolau noiseless 2.1 (3)84 (71)93 (99)71 (86)148 (204)621 (399)605 (778)0/15
NELDERDOERR doerr noiseless 1.6 (2)4.8 (2)10 (7)6.3 (8)13 (14)59 (69)119 (87)0/15
ONEFIFTH auger noiseless 37 (49)88 (88)344 (274)591 (1150)2156 (2153)∞∞5e60/15
IPOP-CMA-ES ros noiseless 2.5 (2)2.3 (3)1.7 (2)0.55 (0.4)0.96 (0.4)0.94 (0.3)0.95 (0.2)15/15

Δ fopt
f17, 5-D		 1e1
5.0		 1e0
215		 1e-1
899		 1e-2
2861		 1e-3
3669		 1e-5
6351		 1e-7
7934		 #succ
15/15
BFGS ros noiseless 125 (87)645 (531)∞∞∞∞∞2e40/15
BIPOP-CMA-ES hansen noiseless 3.5 (3)1.00 (0.2)1.0 (2)1.00 (0.8)1.00 (1)1.00 (0.4)1.2 (0.4)15/15
GA nicolau noiseless 5.6 (6)46 (8)36 (1)52 (92)189 (283)550 (573)∞5e50/15
NELDERDOERR doerr noiseless 2.0 (4)10 (14)48 (111)∞∞∞∞1e50/15
ONEFIFTH auger noiseless 1244 (9290)7933 (2e4)3.8e4 (3e4)∞∞∞∞5e60/15
IPOP-CMA-ES ros noiseless 5.0 (5)1.1 (0.3)0.97 (2)0.61 (0.5)0.77 (1)0.81 (0.5)1.0 (0.5)15/15

Δ fopt
f18, 5-D		 1e1
103		 1e0
378		 1e-1
3968		 1e-2
8451		 1e-3
9280		 1e-5
10905		 1e-7
12469		 #succ
15/15
BFGS ros noiseless 57 (54)∞∞∞∞∞∞2e40/15
BIPOP-CMA-ES hansen noiseless 1.0 (0.7)3.4 (7)1.0 (1)1.0 (0.5)1.0 (0.3)1.2 (0.6)1.3 (0.7)15/15
GA nicolau noiseless 22 (15)59 (14)34 (33)134 (48)∞∞∞5e50/15
NELDERDOERR doerr noiseless 4.3 (10)28 (37)43 (64)∞∞∞∞1e50/15
ONEFIFTH auger noiseless 3091 (7291)3.1e4 (3e4)∞∞∞∞∞5e60/15
IPOP-CMA-ES ros noiseless 1.2 (0.5)2.7 (6)0.87 (0.9)1.1 (0.4)1.0 (0.4)1.0 (0.1)0.99 (0.4)15/15

Δ fopt
f19, 5-D		 1e1
1		 1e0
1		 1e-1
242		 1e-2
1.0e5		 1e-3
1.2e5		 1e-5
1.2e5		 1e-7
1.2e5		 #succ
15/15
BFGS ros noiseless 1655 (1611)2.2e4 (4e4)1781 (1963)∞∞∞∞3e40/15
BIPOP-CMA-ES hansen noiseless 20 (10)2801 (5149)161 (157)1.00 (0.7)1.00 (0.7)1.0 (0.7)1.00 (0.6)15/15
GA nicolau noiseless 35 (22)1.2e4 (5571)700 (239)68 (105)60 (59)∞∞5e50/15
NELDERDOERR doerr noiseless 12 (7)340 (454)107 (120)14 (22)∞∞∞1e50/15
ONEFIFTH auger noiseless 104 (307)4.1e5 (2e5)2.9e5 (2e5)∞∞∞∞5e60/15
IPOP-CMA-ES ros noiseless 21 (26)1720 (1508)125 (96)1.2 (0.4)1.1 (0.6)1.1 (0.7)1.1 (0.6)15/15

Δ fopt
f20, 5-D		 1e1
16		 1e0
851		 1e-1
38111		 1e-2
51362		 1e-3
54470		 1e-5
54861		 1e-7
55313		 #succ
14/15
BFGS ros noiseless 1.8 (1)2.5 (2)10 (8)7.6 (9)7.2 (6)7.1 (14)7.1 (5)1/15
BIPOP-CMA-ES hansen noiseless 3.3 (3)8.2 (10)2.8 (1.0)2.2 (2)2.1 (2)2.2 (0.7)2.2 (1)15/15
GA nicolau noiseless 47 (42)21 (5)1.00 (0.1)1.0 (0.2)1.3 (0.2)2.6 (2)5.0 (9)11/15
NELDERDOERR doerr noiseless 2.2 (2)8.5 (6)37 (37)28 (25)26 (32)26 (32)26 (48)1/15
ONEFIFTH auger noiseless 4.0 (2)16 (21)43 (26)32 (33)30 (22)30 (27)30 (20)15/15
IPOP-CMA-ES ros noiseless 3.9 (2)11 (5)1.4 (0.8)1.1 (0.9)1.1 (0.7)1.1 (0.8)1.1 (1.0)15/15

Δ fopt
f21, 5-D		 1e1
41		 1e0
1157		 1e-1
1674		 1e-2
1692		 1e-3
1705		 1e-5
1729		 1e-7
1757		 #succ
14/15
BFGS ros noiseless 3.8 (4)1.4 (2)1.9 (1)1.9 (3)1.9 (2)1.9 (2)2.0 (2)15/15
BIPOP-CMA-ES hansen noiseless 2.3 (2)14 (50)24 (74)25 (6)25 (35)25 (64)25 (79)15/15
GA nicolau noiseless 4.6 (5)5.5 (3)61 (154)68 (18)70 (81)139 (148)291 (433)8/15
NELDERDOERR doerr noiseless 2.9 (4)1.5 (2)1.2 (0.8)1.2 (1)1.2 (1)1.2 (1)1.2 (1)15/15
ONEFIFTH auger noiseless 45 (17)19 (8)18 (18)18 (13)18 (6)18 (17)18 (16)15/15
IPOP-CMA-ES ros noiseless 6.3 (2)5.6 (4)30 (16)30 (119)31 (5)31 (16)31 (72)14/15

Δ fopt
f22, 5-D		 1e1
71		 1e0
386		 1e-1
938		 1e-2
980		 1e-3
1008		 1e-5
1040		 1e-7
1068		 #succ
14/15
BFGS ros noiseless 3.1 (3)2.9 (4)2.1 (1)2.1 (2)2.0 (1)2.0 (0.9)2.6 (3)14/15
BIPOP-CMA-ES hansen noiseless 6.9 (13)20 (5)45 (100)43 (63)42 (97)41 (49)40 (34)15/15
GA nicolau noiseless 6.0 (6)18 (14)387 (678)648 (1552)1489 (2493)6832 (7001)∞5e50/15
NELDERDOERR doerr noiseless 2.5 (4)2.5 (3)2.1 (1)2.0 (2)2.0 (4)2.0 (2)2.1 (2)15/15
ONEFIFTH auger noiseless 21 (19)37 (40)30 (30)29 (16)29 (29)29 (34)30 (25)15/15
IPOP-CMA-ES ros noiseless 12 (49)48 (77)165 (193)165 (296)161 (104)158 (284)155 (255)11/15

Δ fopt
f23, 5-D		 1e1
3.0		 1e0
518		 1e-1
14249		 1e-2
27890		 1e-3
31654		 1e-5
33030		 1e-7
34256		 #succ
15/15
BFGS ros noiseless 11 (8)31 (47)∞∞∞∞∞2e40/15
BIPOP-CMA-ES hansen noiseless 1.7 (2)13 (16)3.7 (4)2.1 (1)1.8 (0.9)1.8 (2)1.8 (2)15/15
GA nicolau noiseless 1.5 (2)59 (34)∞∞∞∞∞5e50/15
NELDERDOERR doerr noiseless 1.5 (2)1.00 (1)1.0 (3)★3.6 (2)15 (13)∞∞1e50/15
ONEFIFTH auger noiseless 3.1 (7)4.7 (5)52 (32)594 (903)∞∞∞5e60/15
IPOP-CMA-ES ros noiseless 2.2 (2)26 (65)33 (21)17 (1.0)15 (39)14 (56)14 (1)11/15

Δ fopt
f24, 5-D		 1e1
1622		 1e0
2.2e5		 1e-1
6.4e6		 1e-2
9.6e6		 1e-3
9.6e6		 1e-5
1.3e7		 1e-7
1.3e7		 #succ
3/15
BFGS ros noiseless 69 (84)∞∞∞∞∞∞2e40/15
BIPOP-CMA-ES hansen noiseless 2.1 (3)1.6 (0.7)1 (0.9)1.0 (2)1.0 (0.8)1 (2)1 (2)3/15
GA nicolau noiseless 21 (10)∞∞∞∞∞∞5e50/15
NELDERDOERR doerr noiseless 1.0 (1.0)1.4 (1)∞∞∞∞∞1e50/15
ONEFIFTH auger noiseless 31 (9)68 (151)∞∞∞∞∞5e60/15
IPOP-CMA-ES ros noiseless 2.9 (4)18 (35)1.4 (1)0.94 (1)0.94 (0.9)0.70 (0.5)0.70 (0.9)2/15

Previous dimension | Dimension = 10 | Next dimension

Δ fopt
f1, 10-D		 1e1
22		 1e0
23		 1e-1
23		 1e-2
23		 1e-3
23		 1e-5
23		 1e-7
23		 #succ
15/15
BFGS ros noiseless 1.0 (0)★21 (0)★41 (0)★41 (0)★41 (0)★41 (0)★41 (0)★415/15
BIPOP-CMA-ES hansen noiseless 5.7 (3)11 (2)18 (3)25 (3)31 (3)44 (5)58 (5)15/15
GA nicolau noiseless 309 (71)1156 (136)2110 (203)3224 (354)4446 (423)1.2e4 (3e4)6.1e4 (7e4)6/15
NELDERDOERR doerr noiseless 2.4 (2)5.2 (2)8.1 (3)11 (2)14 (5)21 (3)32 (12)15/15
ONEFIFTH auger noiseless 3.9 (2)6.8 (2)10 (2)13 (3)16 (4)22 (3)28 (5)15/15
IPOP-CMA-ES ros noiseless 5.0 (2)11 (2)17 (3)24 (2)30 (3)43 (4)56 (5)15/15

Δ fopt
f2, 10-D		 1e1
187		 1e0
190		 1e-1
191		 1e-2
191		 1e-3
193		 1e-5
194		 1e-7
195		 #succ
15/15
BFGS ros noiseless 10 (3)★312 (1)★314 (2)★314 (3)★414 (2)★415 (3)★415 (2)★415/15
BIPOP-CMA-ES hansen noiseless 20 (3)24 (3)26 (2)27 (2)28 (1)29 (1.0)30 (2)15/15
GA nicolau noiseless 822 (42)1394 (2684)2657 (2698)4430 (2747)7015 (9062)7.3e4 (6e4)∞1e60/15
NELDERDOERR doerr noiseless 22 (6)52 (66)83 (84)102 (160)119 (115)128 (111)203 (111)14/15
ONEFIFTH auger noiseless 5542 (4418)1.4e4 (6912)2.3e4 (1e4)3.2e4 (9911)4.8e4 (9561)2.4e5 (2e5)7.6e5 (4e5)0/15
IPOP-CMA-ES ros noiseless 21 (2)25 (0.7)26 (1)26 (2)27 (1)28 (1)30 (2)15/15

Δ fopt
f3, 10-D		 1e1
1739		 1e0
3600		 1e-1
3609		 1e-2
3636		 1e-3
3642		 1e-5
3646		 1e-7
3651		 #succ
15/15
BFGS ros noiseless ∞∞∞∞∞∞∞5e40/15
BIPOP-CMA-ES hansen noiseless 3.6 (2)311 (791)5926 (6607)5882 (9142)5873 (5464)5867 (8623)5859 (2e4)2/15
GA nicolau noiseless 26 (3)23 (3)73 (141)141 (74)463 (549)827 (965)3938 (6231)0/15
NELDERDOERR doerr noiseless 179 (173)∞∞∞∞∞∞2e50/15
ONEFIFTH auger noiseless 6368 (6465)∞∞∞∞∞∞1e70/15
IPOP-CMA-ES ros noiseless 2.7 (3)1658 (2037)5796 (5799)5753 (5413)5744 (9973)5738 (4900)5730 (9744)1/15

Δ fopt
f4, 10-D		 1e1
2234		 1e0
3626		 1e-1
3660		 1e-2
3695		 1e-3
3707		 1e-5
3744		 1e-7
28767		 #succ
12/15
BFGS ros noiseless ∞∞∞∞∞∞∞5e40/15
BIPOP-CMA-ES hansen noiseless 6.5 (7)∞∞∞∞∞∞3e60/15
GA nicolau noiseless 22 (2)26 (5)79 (71)305 (542)1812 (3910)∞∞1e60/15
NELDERDOERR doerr noiseless ∞∞∞∞∞∞∞2e50/15
ONEFIFTH auger noiseless 6.3e4 (6e4)∞∞∞∞∞∞1e70/15
IPOP-CMA-ES ros noiseless 7.5 (3)∞∞∞∞∞∞2e60/15

Δ fopt
f5, 10-D		 1e1
20		 1e0
20		 1e-1
20		 1e-2
20		 1e-3
20		 1e-5
20		 1e-7
20		 #succ
15/15
BFGS ros noiseless 2.2 (0.7)2.8 (0.6)2.9 (0.7)2.9 (0.7)2.9 (0.3)2.9 (0.6)2.9 (0.3)15/15
BIPOP-CMA-ES hansen noiseless 4.9 (2)6.1 (1)6.2 (2)6.2 (2)6.2 (2)6.2 (1)6.2 (1)15/15
GA nicolau noiseless 1414 (148)3174 (284)5456 (360)8327 (683)1.1e4 (800)1.9e4 (1206)3.0e4 (2127)0/15
NELDERDOERR doerr noiseless 3.1 (0.5)4.1 (0.8)4.2 (1)4.2 (1)4.2 (1)4.2 (0.6)4.2 (1)15/15
ONEFIFTH auger noiseless 2.2 (1)2.6 (0.7)2.8 (1)2.8 (0.6)2.8 (1)2.8 (0.8)2.8 (1.0)15/15
IPOP-CMA-ES ros noiseless 4.9 (1)6.0 (1)6.2 (2)6.3 (2)6.3 (0.8)6.3 (1)6.3 (1)15/15

Δ fopt
f6, 10-D		 1e1
412		 1e0
623		 1e-1
826		 1e-2
1039		 1e-3
1292		 1e-5
1841		 1e-7
2370		 #succ
15/15
BFGS ros noiseless 3.7 (1)4.2 (2)4.5 (2)4.6 (2)4.5 (1)4.5 (1)66 (78)0/15
BIPOP-CMA-ES hansen noiseless 2.0 (0.5)2.0 (0.5)2.0 (0.5)1.9 (0.4)1.9 (0.2)1.7 (0.1)1.7 (0.1)15/15
GA nicolau noiseless 136 (12)4647 (5622)∞∞∞∞∞1e60/15
NELDERDOERR doerr noiseless 3.7 (3)10 (6)15 (5)18 (9)25 (18)256 (299)∞2e50/15
ONEFIFTH auger noiseless 1.7 (0.7)1.9 (2)2.1 (0.7)2.5 (1)2.4 (2)2.4 (0.6)2.6 (2)15/15
IPOP-CMA-ES ros noiseless 1.9 (0.7)1.9 (0.5)1.9 (0.3)1.9 (0.3)1.8 (0.2)1.7 (0.2)1.7 (0.2)15/15

Δ fopt
f7, 10-D		 1e1
172		 1e0
1611		 1e-1
4195		 1e-2
5099		 1e-3
5141		 1e-5
5141		 1e-7
5389		 #succ
15/15
BFGS ros noiseless ∞∞∞∞∞∞∞11000/15
BIPOP-CMA-ES hansen noiseless 2.3 (1)1.2 (0.7)1.3 (1)1.3 (0.4)1.3 (0.6)1.3 (0.4)1.2 (0.4)15/15
GA nicolau noiseless 135 (34)267 (469)676 (775)2857 (2991)2834 (3064)2834 (1994)∞1e60/15
NELDERDOERR doerr noiseless 59 (54)404 (384)∞∞∞∞∞2e50/15
ONEFIFTH auger noiseless 187 (391)6973 (9740)∞∞∞∞∞1e70/15
IPOP-CMA-ES ros noiseless 2.6 (0.9)1.9 (1)1.5 (0.9)1.4 (0.6)1.4 (0.5)1.4 (0.7)1.4 (0.6)15/15

Δ fopt
f8, 10-D		 1e1
326		 1e0
921		 1e-1
1114		 1e-2
1217		 1e-3
1267		 1e-5
1315		 1e-7
1343		 #succ
15/15
BFGS ros noiseless 1.7 (1)1.5 (0.5)1.3 (0.9)★21.3 (0.6)★21.3 (0.4)★31.2 (0.6)★31.2 (0.3)★315/15
BIPOP-CMA-ES hansen noiseless 1.8 (0.4)4.1 (1.0)4.2 (0.7)4.3 (0.5)4.3 (0.6)4.5 (0.6)4.6 (0.4)15/15
GA nicolau noiseless 204 (17)∞∞∞∞∞∞1e60/15
NELDERDOERR doerr noiseless 1.3 (0.3)2.2 (2)2.7 (2)2.9 (0.9)3.1 (2)3.3 (0.6)3.6 (0.9)15/15
ONEFIFTH auger noiseless 21 (70)137 (220)127 (285)141 (102)165 (82)221 (321)279 (169)15/15
IPOP-CMA-ES ros noiseless 2.3 (0.8)3.7 (0.2)3.9 (0.4)4.0 (1)4.0 (0.8)4.2 (0.5)4.3 (1.0)15/15

Δ fopt
f9, 10-D		 1e1
200		 1e0
648		 1e-1
857		 1e-2
993		 1e-3
1065		 1e-5
1138		 1e-7
1185		 #succ
15/15
BFGS ros noiseless 2.1 (0.8)1.9 (0.7)★1.6 (0.4)★31.4 (0.1)★41.4 (0.7)★41.3 (0.7)★41.3 (0.1)★415/15
BIPOP-CMA-ES hansen noiseless 3.4 (2)6.3 (1)5.9 (1)5.5 (0.6)5.4 (0.8)5.5 (1)5.5 (0.7)15/15
GA nicolau noiseless 366 (35)∞∞∞∞∞∞1e60/15
NELDERDOERR doerr noiseless 2.7 (1)7.1 (7)6.5 (5)6.1 (3)6.0 (3)6.0 (3)6.0 (3)15/15
ONEFIFTH auger noiseless 9.5 (55)229 (316)191 (481)195 (110)217 (385)275 (90)335 (523)15/15
IPOP-CMA-ES ros noiseless 3.2 (0.4)6.2 (1)5.8 (1)5.4 (0.9)5.3 (0.8)5.3 (0.8)5.4 (0.8)15/15

Δ fopt
f10, 10-D		 1e1
1835		 1e0
2172		 1e-1
2455		 1e-2
2728		 1e-3
2802		 1e-5
4543		 1e-7
4739		 #succ
15/15
BFGS ros noiseless 1.0 (0.6)★31.00 (0.3)★41.00 (0.2)★41.0 (0.1)★21.0 (0.4)★31.3 (0.5)924 (1073)0/15
BIPOP-CMA-ES hansen noiseless 2.3 (0.4)2.1 (0.2)1.9 (0.2)1.8 (0.1)1.8 (0.1)1.2 (0.1)1.2 (0.1)15/15
GA nicolau noiseless ∞∞∞∞∞∞∞1e60/15
NELDERDOERR doerr noiseless 9.5 (10)25 (54)34 (41)57 (62)335 (291)∞∞2e50/15
ONEFIFTH auger noiseless 533 (506)1079 (587)1736 (895)2388 (861)3667 (2090)1.1e4 (9898)∞1e70/15
IPOP-CMA-ES ros noiseless 2.0 (0.5)2.0 (0.4)2.0 (0.1)1.9 (0.1)1.9 (0.1)1.2 (0.0)1.2 (0.1)15/15

Δ fopt
f11, 10-D		 1e1
266		 1e0
1041		 1e-1
2602		 1e-2
2954		 1e-3
3338		 1e-5
4092		 1e-7
4843		 #succ
15/15
BFGS ros noiseless 1.0 (0.2)★41.00 (0.4)★41.7 (1)6.0 (8)56 (76)∞∞8e40/15
BIPOP-CMA-ES hansen noiseless 13 (1)3.8 (0.3)1.7 (0.1)1.6 (0.1)1.5 (0.1)1.3 (0.1)1.2 (0.0)15/15
GA nicolau noiseless 1.6e4 (1e4)∞∞∞∞∞∞1e60/15
NELDERDOERR doerr noiseless 13 (9)7.8 (5)5.4 (2)10 (7)17 (17)93 (128)∞2e50/15
ONEFIFTH auger noiseless 5333 (2307)2426 (583)1328 (286)1522 (162)1703 (247)1910 (140)2962 (3193)2/15
IPOP-CMA-ES ros noiseless 13 (2)3.9 (0.2)1.7 (0.1)1.6 (0.1)1.5 (0.1)1.3 (0.1)1.2 (0.0)15/15

Δ fopt
f12, 10-D		 1e1
515		 1e0
896		 1e-1
1240		 1e-2
1390		 1e-3
1569		 1e-5
3660		 1e-7
5154		 #succ
15/15
BFGS ros noiseless 1.3 (0.8)1.4 (0.8)1.4 (0.6)★21.3 (0.5)★31.3 (0.5)★42.6 (9)23 (33)9/15
BIPOP-CMA-ES hansen noiseless 3.7 (4)4.6 (5)5.3 (5)5.6 (4)5.6 (4)3.1 (2)2.5 (1.0)15/15
GA nicolau noiseless 1307 (2922)1912 (1941)1.1e4 (1e4)∞∞∞∞1e60/15
NELDERDOERR doerr noiseless 3.0 (7)6.1 (8)7.2 (8)7.6 (4)7.7 (7)4.3 (2)6.5 (3)15/15
ONEFIFTH auger noiseless 1.5e4 (2e4)4.8e4 (4e4)∞∞∞∞∞1e70/15
IPOP-CMA-ES ros noiseless 2.0 (0.2)2.6 (1)3.7 (3)4.4 (2)4.6 (2)2.7 (1.0)2.2 (1.0)15/15

Δ fopt
f13, 10-D		 1e1
387		 1e0
596		 1e-1
797		 1e-2
1014		 1e-3
4587		 1e-5
6208		 1e-7
7779		 #succ
15/15
BFGS ros noiseless 1.00 (0.1)1.0 (0.1)★21.00 (0.1)★21.00 (0.0)★286 (43)∞∞1e50/15
BIPOP-CMA-ES hansen noiseless 3.6 (2)4.2 (2)5.6 (4)4.8 (1)1.3 (0.9)1.5 (0.3)1.8 (1)15/15
GA nicolau noiseless 481 (76)1.1e4 (1e4)∞∞∞∞∞1e60/15
NELDERDOERR doerr noiseless 7.2 (11)16 (4)40 (57)76 (119)64 (80)479 (693)∞2e50/15
ONEFIFTH auger noiseless 11 (17)21 (42)44 (13)99 (131)125 (226)942 (1894)1.9e4 (2e4)0/15
IPOP-CMA-ES ros noiseless 3.8 (2)5.0 (4)5.1 (4)4.4 (2)1.2 (0.5)1.5 (0.9)1.6 (1)15/15

Δ fopt
f14, 10-D		 1e1
37		 1e0
98		 1e-1
133		 1e-2
205		 1e-3
392		 1e-5
687		 1e-7
4305		 #succ
15/15
BFGS ros noiseless 1.6 (1)1.6 (0.6)1.6 (0.5)1.4 (0.4)★21.0 (0.2)★41.00 (0.3)★4∞9e40/15
BIPOP-CMA-ES hansen noiseless 2.6 (2)3.3 (0.8)3.8 (0.7)4.1 (0.6)4.3 (0.8)5.2 (0.6)1.4 (0.1)15/15
GA nicolau noiseless 18 (24)248 (31)371 (57)396 (35)4249 (6391)∞∞1e60/15
NELDERDOERR doerr noiseless 1.1 (1)2.4 (7)2.8 (3)3.5 (2)3.7 (2)6.2 (2)43 (33)0/15
ONEFIFTH auger noiseless 2.2 (0.9)2.1 (0.8)2.1 (0.6)2.3 (0.5)4.6 (0.9)576 (40)∞1e70/15
IPOP-CMA-ES ros noiseless 2.2 (1)2.9 (0.6)3.8 (0.6)4.2 (0.7)3.8 (0.4)5.0 (0.4)1.3 (0.2)15/15

Δ fopt
f15, 10-D		 1e1
4774		 1e0
39246		 1e-1
73643		 1e-2
74669		 1e-3
75790		 1e-5
77814		 1e-7
79834		 #succ
12/15
BFGS ros noiseless ∞∞∞∞∞∞∞4e40/15
BIPOP-CMA-ES hansen noiseless 1.0 (0.6)1.7 (0.8)1.3 (0.4)1.3 (0.4)1.3 (0.7)1.3 (0.4)1.3 (0.6)15/15
GA nicolau noiseless 27 (4)∞∞∞∞∞∞1e60/15
NELDERDOERR doerr noiseless 47 (40)∞∞∞∞∞∞2e50/15
ONEFIFTH auger noiseless 2132 (2626)∞∞∞∞∞∞1e70/15
IPOP-CMA-ES ros noiseless 1.3 (0.8)1.0 (0.4)0.82 (0.2)0.82 (0.3)0.83 (0.6)0.84 (0.5)0.85 (0.4)15/15

Δ fopt
f16, 10-D		 1e1
425		 1e0
7029		 1e-1
15779		 1e-2
45669		 1e-3
51151		 1e-5
65798		 1e-7
71570		 #succ
15/15
BFGS ros noiseless ∞∞∞∞∞∞∞1e50/15
BIPOP-CMA-ES hansen noiseless 3.0 (1)1.00 (0.6)1.0 (0.5)1.00 (0.4)1.00 (0.8)1 (0.7)1.00 (0.6)15/15
GA nicolau noiseless 28 (19)126 (42)905 (1236)∞∞∞∞1e60/15
NELDERDOERR doerr noiseless 1.4 (0.1)23 (19)∞∞∞∞∞2e50/15
ONEFIFTH auger noiseless 65 (54)3736 (2635)∞∞∞∞∞1e70/15
IPOP-CMA-ES ros noiseless 3.5 (8)1.2 (0.9)1.2 (0.4)0.87 (0.7)0.90 (0.9)0.75 (0.3)0.71 (0.4)15/15

Δ fopt
f17, 10-D		 1e1
26		 1e0
429		 1e-1
2203		 1e-2
6329		 1e-3
9851		 1e-5
20190		 1e-7
26503		 #succ
15/15
BFGS ros noiseless 53 (91)∞∞∞∞∞∞8e40/15
BIPOP-CMA-ES hansen noiseless 1.7 (1)1.1 (0.2)1.7 (2)1.0 (0.8)1.0 (0.3)1.00 (0.7)1.0 (0.7)15/15
GA nicolau noiseless 4.9 (7)77 (13)45 (3)212 (277)1458 (1015)∞∞1e60/15
NELDERDOERR doerr noiseless 1.2 (1)447 (895)∞∞∞∞∞2e50/15
ONEFIFTH auger noiseless 3572 (4283)∞∞∞∞∞∞1e70/15
IPOP-CMA-ES ros noiseless 2.7 (2)2.6 (0.4)1.5 (2)0.83 (0.7)1.0 (0.4)0.88 (0.2)1.0 (0.4)15/15

Δ fopt
f18, 10-D		 1e1
238		 1e0
836		 1e-1
7012		 1e-2
15928		 1e-3
27536		 1e-5
37234		 1e-7
42708		 #succ
15/15
BFGS ros noiseless 4958 (8689)∞∞∞∞∞∞8e40/15
BIPOP-CMA-ES hansen noiseless 1.00 (0.3)1.00 (0.3)1.00 (0.6)1.0 (0.9)1.2 (0.5)1.1 (0.5)1.2 (0.5)15/15
GA nicolau noiseless 57 (11)84 (9)124 (189)∞∞∞∞1e60/15
NELDERDOERR doerr noiseless 72 (97)3542 (2811)∞∞∞∞∞2e50/15
ONEFIFTH auger noiseless 2.8e5 (2e5)∞∞∞∞∞∞1e70/15
IPOP-CMA-ES ros noiseless 1.1 (0.3)1.7 (3)0.95 (0.9)0.95 (0.5)0.84 (0.4)0.97 (0.3)0.91 (0.7)15/15

Δ fopt
f19, 10-D		 1e1
1		 1e0
1		 1e-1
10609		 1e-2
9.8e5		 1e-3
1.4e6		 1e-5
1.4e6		 1e-7
1.4e6		 #succ
15/15
BFGS ros noiseless 1.9e4 (1e4)∞∞∞∞∞∞8e40/15
BIPOP-CMA-ES hansen noiseless 52 (21)9423 (4060)10 (11)1.00 (0.2)1.0 (0.3)1.00 (0.3)1.0 (0.4)15/15
GA nicolau noiseless 1004 (812)1.7e5 (9e4)293 (239)∞∞∞∞1e60/15
NELDERDOERR doerr noiseless 24 (9)★21.2e4 (2e4)∞∞∞∞∞2e50/15
ONEFIFTH auger noiseless 6541 (367)2.8e7 (7e7)∞∞∞∞∞1e70/15
IPOP-CMA-ES ros noiseless 56 (26)1.3e4 (1e4)8.9 (8)0.55 (0.4)0.53 (0.3)0.53 (0.2)0.53 (0.2)15/15

Δ fopt
f20, 10-D		 1e1
32		 1e0
15426		 1e-1
5.5e5		 1e-2
5.7e5		 1e-3
5.7e5		 1e-5
5.8e5		 1e-7
5.9e5		 #succ
15/15
BFGS ros noiseless 2.3 (0.5)1.1 (1)∞∞∞∞∞1e50/15
BIPOP-CMA-ES hansen noiseless 5.5 (2)3.6 (3)1.00 (0.4)1.0 (0.1)1.00 (0.1)1.0 (0.1)1.0 (0.1)15/15
GA nicolau noiseless 360 (58)3.2 (0.2)1.8 (2)2.0 (2)2.6 (4)∞∞1e60/15
NELDERDOERR doerr noiseless 2.3 (0.3)5.7 (5)∞∞∞∞∞2e50/15
ONEFIFTH auger noiseless 3.0 (1.0)7.2 (9)∞∞∞∞∞1e70/15
IPOP-CMA-ES ros noiseless 4.6 (2)2.8 (2)0.78 (0.4)0.79 (0.4)0.79 (0.4)0.80 (0.5)0.81 (0.4)15/15

Δ fopt
f21, 10-D		 1e1
130		 1e0
2236		 1e-1
4392		 1e-2
4487		 1e-3
4618		 1e-5
5074		 1e-7
11329		 #succ
15/15
BFGS ros noiseless 4.6 (4)2.9 (3)2.8 (6)2.7 (3)2.7 (6)2.5 (2)2.0 (3)6/15
BIPOP-CMA-ES hansen noiseless 5.9 (12)28 (83)16 (15)15 (14)15 (30)14 (4)6.3 (9)15/15
GA nicolau noiseless 91 (45)85 (5)95 (116)97 (282)126 (56)123 (154)260 (267)3/15
NELDERDOERR doerr noiseless 8.4 (16)6.0 (10)3.7 (6)3.6 (3)3.5 (2)3.3 (3)1.6 (1)15/15
ONEFIFTH auger noiseless 10 (17)20 (43)18 (28)18 (18)17 (29)16 (26)7.1 (6)15/15
IPOP-CMA-ES ros noiseless 5.9 (11)14 (29)52 (137)51 (28)50 (112)45 (124)21 (57)12/15

Δ fopt
f22, 10-D		 1e1
98		 1e0
2839		 1e-1
6353		 1e-2
6620		 1e-3
6798		 1e-5
8296		 1e-7
10351		 #succ
15/15
BFGS ros noiseless 6.6 (8)3.1 (5)4.4 (10)4.2 (7)4.2 (4)3.5 (1)5.7 (6)7/15
BIPOP-CMA-ES hansen noiseless 29 (24)58 (253)201 (115)193 (319)188 (308)154 (115)123 (219)9/15
GA nicolau noiseless 130 (50)722 (1144)∞∞∞∞∞1e60/15
NELDERDOERR doerr noiseless 18 (17)2.5 (2)5.0 (16)4.9 (3)4.9 (1)4.0 (8)3.3 (2)14/15
ONEFIFTH auger noiseless 47 (106)17 (12)13 (15)13 (15)13 (11)11 (12)8.9 (5)15/15
IPOP-CMA-ES ros noiseless 42 (2)90 (293)666 (386)640 (856)623 (1157)511 (796)409 (1057)2/15

Δ fopt
f23, 10-D		 1e1
3.0		 1e0
915		 1e-1
16425		 1e-2
1.8e5		 1e-3
2.0e5		 1e-5
2.1e5		 1e-7
2.1e5		 #succ
15/15
BFGS ros noiseless 15 (34)128 (64)∞∞∞∞∞5e40/15
BIPOP-CMA-ES hansen noiseless 1.9 (2)21 (25)2.7 (3)★1.3 (2)1.2 (2)1.2 (2)1.2 (1.0)15/15
GA nicolau noiseless 1.3 (2)393 (279)∞∞∞∞∞1e60/15
NELDERDOERR doerr noiseless 1.6 (1)1.4 (2)★11 (16)∞∞∞∞2e50/15
ONEFIFTH auger noiseless 4.1 (5)7.6 (7)2873 (2003)∞∞∞∞1e70/15
IPOP-CMA-ES ros noiseless 2.2 (2)376 (503)308 (848)65 (57)59 (94)57 (69)56 (90)2/15

Δ fopt
f24, 10-D		 1e1
98761		 1e0
1.0e6		 1e-1
7.5e7		 1e-2
7.5e7		 1e-3
7.5e7		 1e-5
7.5e7		 1e-7
7.5e7		 #succ
1/15
BFGS ros noiseless ∞∞∞∞∞∞∞4e40/15
BIPOP-CMA-ES hansen noiseless 2.7 (11)1.00 (1)1 (0.7)1 (1)1 (0.7)1 (1)1 (1)1/15
GA nicolau noiseless ∞∞∞∞∞∞∞1e60/15
NELDERDOERR doerr noiseless 2.6 (3)∞∞∞∞∞∞2e50/15
ONEFIFTH auger noiseless 745 (589)∞∞∞∞∞∞1e70/15
IPOP-CMA-ES ros noiseless 24 (19)6.9 (3)0.48 (0.7)0.48 (1)0.48 (0.6)0.48 (0.4)∞2e60/15

Previous dimension | Dimension = 20 | Next dimension

Δ fopt
f1, 20-D		 1e1
43		 1e0
43		 1e-1
43		 1e-2
43		 1e-3
43		 1e-5
43		 1e-7
43		 #succ
15/15
BFGS ros noiseless 1 (0)★41 (0)★41 (0)★41 (0)★41 (0)★41 (0)★41 (0)★415/15
BIPOP-CMA-ES hansen noiseless 7.9 (2)14 (3)20 (1)26 (2)33 (3)45 (4)57 (4)15/15
GA nicolau noiseless 876 (67)1905 (171)3205 (248)1.2e4 (1e4)3.1e4 (1174)6.7e5 (4e5)∞2e60/15
NELDERDOERR doerr noiseless 3.3 (2)6.7 (3)11 (5)16 (3)21 (8)32 (7)40 (5)15/15
ONEFIFTH auger noiseless 4.9 (0.9)8.1 (2)11 (2)15 (2)18 (2)25 (2)31 (3)15/15
IPOP-CMA-ES ros noiseless 8.0 (1)14 (0.7)20 (2)26 (2)33 (2)46 (2)58 (2)15/15

Δ fopt
f2, 20-D		 1e1
385		 1e0
386		 1e-1
387		 1e-2
388		 1e-3
390		 1e-5
391		 1e-7
393		 #succ
15/15
BFGS ros noiseless 20 (2)24 (2)26 (4)27 (5)27 (4)28 (4)28 (3)★215/15
BIPOP-CMA-ES hansen noiseless 35 (5)40 (4)44 (4)45 (2)47 (3)48 (2)50 (2)15/15
GA nicolau noiseless 3228 (1e4)6769 (1e4)7.3e4 (7e4)∞∞∞∞2e60/15
NELDERDOERR doerr noiseless 13 (2)★317 (4)★219 (3)★23 (5)28 (22)36 (14)48 (18)15/15
ONEFIFTH auger noiseless 6938 (3338)1.6e4 (7323)2.6e4 (1e4)3.8e4 (3e4)7.4e4 (7e4)3.8e5 (3e5)∞2e70/15
IPOP-CMA-ES ros noiseless 35 (7)41 (4)43 (3)44 (3)45 (3)47 (1)48 (1)15/15

Δ fopt
f3, 20-D		 1e1
5066		 1e0
7626		 1e-1
7635		 1e-2
7637		 1e-3
7643		 1e-5
7646		 1e-7
7651		 #succ
15/15
BFGS ros noiseless ∞∞∞∞∞∞∞1e50/15
BIPOP-CMA-ES hansen noiseless 12 (6)∞∞∞∞∞∞6e60/15
GA nicolau noiseless 29 (10)3709 (5839)∞∞∞∞∞2e60/15
NELDERDOERR doerr noiseless ∞∞∞∞∞∞∞4e50/15
ONEFIFTH auger noiseless ∞∞∞∞∞∞∞2e70/15
IPOP-CMA-ES ros noiseless 13 (15)∞∞∞∞∞∞3e60/15

Δ fopt
f4, 20-D		 1e1
4722		 1e0
7628		 1e-1
7666		 1e-2
7686		 1e-3
7700		 1e-5
7758		 1e-7
1.4e5		 #succ
9/15
BFGS ros noiseless ∞∞∞∞∞∞∞2e50/15
BIPOP-CMA-ES hansen noiseless ∞∞∞∞∞∞∞6e60/15
GA nicolau noiseless 65 (5)3751 (4198)∞∞∞∞∞2e60/15
NELDERDOERR doerr noiseless ∞∞∞∞∞∞∞4e50/15
ONEFIFTH auger noiseless ∞∞∞∞∞∞∞2e70/15
IPOP-CMA-ES ros noiseless ∞∞∞∞∞∞∞3e60/15

Δ fopt
f5, 20-D		 1e1
41		 1e0
41		 1e-1
41		 1e-2
41		 1e-3
41		 1e-5
41		 1e-7
41		 #succ
15/15
BFGS ros noiseless 2.3 (0.4)2.7 (0.3)2.8 (0.4)2.8 (0.4)2.8 (0.4)2.8 (0.5)2.8 (0.4)15/15
BIPOP-CMA-ES hansen noiseless 5.0 (0.7)6.1 (1)6.2 (1)6.2 (1)6.3 (1)6.3 (1)6.3 (1.0)15/15
GA nicolau noiseless 2137 (158)4548 (164)7446 (289)1.1e4 (354)1.4e4 (584)2.2e4 (816)2.3e5 (2e5)0/15
NELDERDOERR doerr noiseless 5.2 (2)6.1 (2)6.3 (2)6.3 (2)6.3 (1)6.3 (2)6.3 (2)15/15
ONEFIFTH auger noiseless 3.0 (1)3.5 (1)3.6 (0.9)3.6 (0.5)3.6 (0.7)3.6 (2)3.6 (2)15/15
IPOP-CMA-ES ros noiseless 5.7 (1)6.5 (0.9)6.6 (0.9)6.6 (1)6.6 (0.8)6.6 (0.9)6.6 (0.6)15/15

Δ fopt
f6, 20-D		 1e1
1296		 1e0
2343		 1e-1
3413		 1e-2
4255		 1e-3
5220		 1e-5
6728		 1e-7
8409		 #succ
15/15
BFGS ros noiseless 3.6 (1)3.5 (1)3.4 (0.9)3.5 (1)3.5 (0.9)3.6 (0.7)45 (34)0/15
BIPOP-CMA-ES hansen noiseless 1.5 (0.5)1.3 (0.3)1.2 (0.2)1.1 (0.2)1.1 (0.1)1.2 (0.1)1.2 (0.1)15/15
GA nicolau noiseless 1955 (793)∞∞∞∞∞∞2e60/15
NELDERDOERR doerr noiseless 9.1 (14)15 (4)20 (36)46 (62)79 (119)∞∞4e50/15
ONEFIFTH auger noiseless 2.1 (1.0)2.1 (2)2.8 (5)3.7 (1)4.3 (1)4.7 (1)4.9 (20)15/15
IPOP-CMA-ES ros noiseless 1.7 (0.3)1.3 (0.2)1.2 (0.2)1.2 (0.1)1.2 (0.2)1.2 (0.1)1.2 (0.1)15/15

Δ fopt
f7, 20-D		 1e1
1351		 1e0
4274		 1e-1
9503		 1e-2
16523		 1e-3
16524		 1e-5
16524		 1e-7
16969		 #succ
15/15
BFGS ros noiseless ∞∞∞∞∞∞∞21000/15
BIPOP-CMA-ES hansen noiseless 1.00 (0.1)4.9 (3)3.5 (0.5)2.2 (0.2)2.2 (0.2)2.2 (0.2)2.1 (0.2)15/15
GA nicolau noiseless 77 (23)∞∞∞∞∞∞2e60/15
NELDERDOERR doerr noiseless 370 (438)∞∞∞∞∞∞4e50/15
ONEFIFTH auger noiseless ∞∞∞∞∞∞∞2e70/15
IPOP-CMA-ES ros noiseless 1.9 (2)4.8 (1)2.7 (0.7)1.7 (0.2)1.7 (0.7)1.7 (0.4)1.6 (0.7)15/15

Δ fopt
f8, 20-D		 1e1
2039		 1e0
3871		 1e-1
4040		 1e-2
4148		 1e-3
4219		 1e-5
4371		 1e-7
4484		 #succ
15/15
BFGS ros noiseless 1.8 (0.3)1.2 (0.2)1.2 (0.1)1.2 (0.1)★21.2 (0.2)★31.2 (0.1)★41.2 (0.1)★415/15
BIPOP-CMA-ES hansen noiseless 4.0 (1)4.0 (0.5)4.3 (0.6)4.5 (0.6)4.5 (0.9)4.6 (0.6)4.6 (0.6)15/15
GA nicolau noiseless ∞∞∞∞∞∞∞2e60/15
NELDERDOERR doerr noiseless 2.8 (6)4.7 (2)5.5 (1)6.0 (15)6.5 (9)7.7 (9)9.1 (6)15/15
ONEFIFTH auger noiseless 13 (9)117 (67)124 (139)138 (58)157 (369)196 (359)234 (235)15/15
IPOP-CMA-ES ros noiseless 3.7 (0.7)3.9 (0.5)4.2 (0.8)4.3 (0.3)4.4 (0.7)4.4 (0.6)4.5 (0.4)15/15

Δ fopt
f9, 20-D		 1e1
1716		 1e0
3102		 1e-1
3277		 1e-2
3379		 1e-3
3455		 1e-5
3594		 1e-7
3727		 #succ
15/15
BFGS ros noiseless 2.2 (0.3)★32.2 (1)★22.1 (0.9)★32.1 (0.9)★32.0 (1)★32.0 (1)★41.9 (1)★415/15
BIPOP-CMA-ES hansen noiseless 4.7 (2)5.7 (5)6.0 (4)6.1 (0.7)6.1 (0.8)6.1 (0.7)6.1 (4)15/15
GA nicolau noiseless ∞∞∞∞∞∞∞2e60/15
NELDERDOERR doerr noiseless 3.3 (0.6)6.1 (4)6.6 (6)7.0 (5)7.5 (9)8.4 (7)9.3 (2)15/15
ONEFIFTH auger noiseless 12 (5)52 (3)65 (128)86 (73)110 (70)159 (135)205 (3)15/15
IPOP-CMA-ES ros noiseless 4.6 (0.7)5.7 (0.3)6.0 (0.4)6.1 (2)6.1 (0.3)6.1 (4)6.1 (0.3)15/15

Δ fopt
f10, 20-D		 1e1
7413		 1e0
8661		 1e-1
10735		 1e-2
13641		 1e-3
14920		 1e-5
17073		 1e-7
17476		 #succ
15/15
BFGS ros noiseless 1.0 (0.2)★41.0 (0.2)★41.00 (0.3)★1.1 (0.5)1.1 (0.4)3.1 (0.8)∞1e60/15
BIPOP-CMA-ES hansen noiseless 1.9 (0.2)1.8 (0.2)1.6 (0.1)1.3 (0.1)1.2 (0.0)1.1 (0.0)1.1 (0.0)15/15
GA nicolau noiseless ∞∞∞∞∞∞∞2e60/15
NELDERDOERR doerr noiseless 30 (34)∞∞∞∞∞∞4e50/15
ONEFIFTH auger noiseless 301 (119)696 (226)996 (327)1043 (269)2234 (895)8686 (1e4)∞2e70/15
IPOP-CMA-ES ros noiseless 1.8 (0.2)1.8 (0.2)1.5 (0.2)1.3 (0.1)1.2 (0.0)1.1 (0.0)1.1 (0.0)15/15

Δ fopt
f11, 20-D		 1e1
1002		 1e0
2228		 1e-1
6278		 1e-2
8586		 1e-3
9762		 1e-5
12285		 1e-7
14831		 #succ
15/15
BFGS ros noiseless 1 (0.6)★41.0 (0.5)★41.3 (2)★22.6 (4)147 (151)∞∞2e50/15
BIPOP-CMA-ES hansen noiseless 10 (0.4)5.1 (0.2)1.9 (0.1)1.5 (0.1)1.4 (0.0)1.2 (0.0)1.0 (0.0)15/15
GA nicolau noiseless 2.9e4 (5e4)∞∞∞∞∞∞2e60/15
NELDERDOERR doerr noiseless 17 (7)24 (16)74 (73)∞∞∞∞4e50/15
ONEFIFTH auger noiseless 1625 (219)1233 (343)575 (99)559 (101)606 (27)665 (72)684 (19)12/15
IPOP-CMA-ES ros noiseless 11 (2)5.4 (0.7)2.1 (0.4)1.6 (0.2)1.4 (0.1)1.2 (0.1)1.1 (0.0)15/15

Δ fopt
f12, 20-D		 1e1
1042		 1e0
1938		 1e-1
2740		 1e-2
3156		 1e-3
4140		 1e-5
12407		 1e-7
13827		 #succ
15/15
BFGS ros noiseless 1.6 (2)★1.6 (0.8)1.6 (1)1.7 (0.7)★21.6 (0.7)★21.8 (3)45 (49)1/15
BIPOP-CMA-ES hansen noiseless 3.0 (3)4.0 (3)4.5 (3)4.9 (3)4.5 (3)1.9 (0.5)2.0 (0.6)15/15
GA nicolau noiseless ∞∞∞∞∞∞∞2e60/15
NELDERDOERR doerr noiseless 13 (20)45 (31)61 (97)396 (389)1393 (1449)∞∞4e50/15
ONEFIFTH auger noiseless 1.2e4 (2e4)6.7e4 (8e4)∞∞∞∞∞2e70/15
IPOP-CMA-ES ros noiseless 4.8 (5)5.3 (4)5.5 (4)5.9 (3)5.1 (3)2.1 (1)2.2 (0.5)15/15

Δ fopt
f13, 20-D		 1e1
652		 1e0
2021		 1e-1
2751		 1e-2
3507		 1e-3
18749		 1e-5
24455		 1e-7
30201		 #succ
15/15
BFGS ros noiseless 1.7 (0.4)1.0 (0.0)1.00 (0.0)★21.00 (0.0)23 (32)∞∞5e50/15
BIPOP-CMA-ES hansen noiseless 4.3 (6)2.7 (2)5.1 (6)6.2 (5)1.5 (0.6)2.3 (2)3.0 (2)15/15
GA nicolau noiseless 5114 (6899)∞∞∞∞∞∞2e60/15
NELDERDOERR doerr noiseless 12 (24)18 (15)31 (47)87 (33)98 (64)∞∞4e50/15
ONEFIFTH auger noiseless 7.4 (9)13 (4)26 (5)95 (115)50 (71)410 (375)2031 (2657)2/15
IPOP-CMA-ES ros noiseless 6.5 (5)4.8 (5)6.2 (4)5.1 (3)1.4 (0.8)1.7 (0.5)2.3 (0.7)15/15

Δ fopt
f14, 20-D		 1e1
75		 1e0
239		 1e-1
304		 1e-2
451		 1e-3
932		 1e-5
1648		 1e-7
15661		 #succ
15/15
BFGS ros noiseless 2.7 (2)1.8 (0.7)2.0 (0.6)1.8 (0.4)1.2 (0.2)★41.1 (0.2)★4∞2e50/15
BIPOP-CMA-ES hansen noiseless 3.9 (1)2.9 (0.5)3.7 (0.3)4.3 (0.4)4.1 (0.3)6.2 (0.6)1.2 (0.1)15/15
GA nicolau noiseless 277 (76)320 (54)477 (50)2898 (4550)∞∞∞2e60/15
NELDERDOERR doerr noiseless 2.0 (0.9)2.1 (0.5)3.5 (1)3.7 (0.9)3.0 (0.6)21 (13)∞4e50/15
ONEFIFTH auger noiseless 2.5 (1)1.8 (0.4)2.0 (0.4)2.2 (0.3)4.8 (0.3)466 (25)∞2e70/15
IPOP-CMA-ES ros noiseless 3.7 (2)2.8 (0.7)3.6 (0.6)4.2 (0.8)3.9 (0.5)6.0 (0.7)1.2 (0.0)15/15

Δ fopt
f15, 20-D		 1e1
30378		 1e0
1.5e5		 1e-1
3.1e5		 1e-2
3.2e5		 1e-3
3.2e5		 1e-5
4.5e5		 1e-7
4.6e5		 #succ
15/15
BFGS ros noiseless ∞∞∞∞∞∞∞1e50/15
BIPOP-CMA-ES hansen noiseless 1.0 (0.4)2.0 (0.6)1.4 (0.5)1.4 (0.4)1.4 (0.5)1.0 (0.3)1.00 (0.3)15/15
GA nicolau noiseless ∞∞∞∞∞∞∞2e60/15
NELDERDOERR doerr noiseless ∞∞∞∞∞∞∞4e50/15
ONEFIFTH auger noiseless ∞∞∞∞∞∞∞2e70/15
IPOP-CMA-ES ros noiseless 1.1 (0.6)1.1 (0.3)0.69 (0.2)0.70 (0.3)0.70 (0.2)0.52 (0.3)0.53 (0.3)15/15

Δ fopt
f16, 20-D		 1e1
1384		 1e0
27265		 1e-1
77015		 1e-2
1.4e5		 1e-3
1.9e5		 1e-5
2.0e5		 1e-7
2.2e5		 #succ
15/15
BFGS ros noiseless ∞∞∞∞∞∞∞3e50/15
BIPOP-CMA-ES hansen noiseless 1.7 (0.4)1.0 (0.3)1.2 (0.8)1.0 (0.5)1.00 (0.9)1.0 (0.5)1.00 (0.3)15/15
GA nicolau noiseless 138 (40)1037 (2367)∞∞∞∞∞2e60/15
NELDERDOERR doerr noiseless 7.2 (18)∞∞∞∞∞∞4e50/15
ONEFIFTH auger noiseless 1398 (1005)∞∞∞∞∞∞2e70/15
IPOP-CMA-ES ros noiseless 1.7 (1)0.81 (0.3)0.92 (0.9)0.85 (0.3)0.84 (0.4)1.1 (0.7)1.0 (0.6)15/15

Δ fopt
f17, 20-D		 1e1
63		 1e0
1030		 1e-1
4005		 1e-2
12242		 1e-3
30677		 1e-5
56288		 1e-7
80472		 #succ
15/15
BFGS ros noiseless 359 (717)∞∞∞∞∞∞4e50/15
BIPOP-CMA-ES hansen noiseless 2.2 (2)1.0 (0.4)1.0 (2)1.0 (0.7)1.2 (1)1.3 (0.8)1.4 (0.6)15/15
GA nicolau noiseless 57 (61)92 (9)7071 (7746)∞∞∞∞2e60/15
NELDERDOERR doerr noiseless 2.1 (2)∞∞∞∞∞∞4e50/15
ONEFIFTH auger noiseless 5.2e4 (2e5)∞∞∞∞∞∞2e70/15
IPOP-CMA-ES ros noiseless 2.1 (1)0.94 (0.2)1.2 (2)1.0 (0.6)0.76 (0.5)0.99 (0.3)1.0 (0.6)15/15

Δ fopt
f18, 20-D		 1e1
621		 1e0
3972		 1e-1
19561		 1e-2
28555		 1e-3
67569		 1e-5
1.3e5		 1e-7
1.5e5		 #succ
15/15
BFGS ros noiseless ∞∞∞∞∞∞∞4e50/15
BIPOP-CMA-ES hansen noiseless 1.0 (0.3)2.4 (5)1.2 (0.9)1.6 (1)1.1 (0.8)1.7 (0.7)1.6 (0.2)15/15
GA nicolau noiseless 76 (15)311 (640)∞∞∞∞∞2e60/15
NELDERDOERR doerr noiseless 4320 (5380)∞∞∞∞∞∞4e50/15
ONEFIFTH auger noiseless ∞∞∞∞∞∞∞2e70/15
IPOP-CMA-ES ros noiseless 1.1 (0.3)1.8 (2)1.1 (0.6)1.5 (0.6)0.97 (0.5)1.0 (0.3)★21.1 (0.4)★215/15

Δ fopt
f19, 20-D		 1e1
1		 1e0
1		 1e-1
3.4e5		 1e-2
4.7e6		 1e-3
6.2e6		 1e-5
6.7e6		 1e-7
6.7e6		 #succ
15/15
BFGS ros noiseless 1.2e6 (1e6)∞∞∞∞∞∞2e50/15
BIPOP-CMA-ES hansen noiseless 169 (72)2.4e4 (7900)1.2 (1)1.0 (0.4)1.0 (0.3)1.0 (0.3)1 (0.3)15/15
GA nicolau noiseless 1.4e4 (752)6.5e5 (1e6)∞∞∞∞∞2e60/15
NELDERDOERR doerr noiseless 73 (26)★24.3e5 (7e5)∞∞∞∞∞4e50/15
ONEFIFTH auger noiseless 6.3e6 (1e7)∞∞∞∞∞∞2e70/15
IPOP-CMA-ES ros noiseless 161 (55)2.7e4 (1e4)0.71 (0.2)0.45 (0.2)0.38 (0.1)0.41 (0.1)0.41 (0.1)15/15

Δ fopt
f20, 20-D		 1e1
82		 1e0
46150		 1e-1
3.1e6		 1e-2
5.5e6		 1e-3
5.5e6		 1e-5
5.6e6		 1e-7
5.6e6		 #succ
14/15
BFGS ros noiseless 2.1 (0.4)5.8 (4)∞∞∞∞∞4e50/15
BIPOP-CMA-ES hansen noiseless 4.3 (0.9)9.2 (4)1.00 (0.3)1.00 (0.3)1.00 (0.3)1.00 (0.3)1.00 (0.5)14/15
GA nicolau noiseless 502 (57)2.8 (0.4)∞∞∞∞∞2e60/15
NELDERDOERR doerr noiseless 2.2 (0.8)28 (40)∞∞∞∞∞4e50/15
ONEFIFTH auger noiseless 3.1 (0.8)113 (133)∞∞∞∞∞2e70/15
IPOP-CMA-ES ros noiseless 4.6 (1.0)6.4 (2)0.65 (0.3)0.57 (0.2)0.57 (0.2)0.58 (0.1)0.58 (0.2)15/15

Δ fopt
f21, 20-D		 1e1
561		 1e0
6541		 1e-1
14103		 1e-2
14318		 1e-3
14643		 1e-5
15567		 1e-7
17589		 #succ
15/15
BFGS ros noiseless 1.9 (4)5.5 (2)4.6 (4)4.6 (5)4.5 (6)4.3 (4)7.3 (4)2/15
BIPOP-CMA-ES hansen noiseless 3.2 (9)55 (190)48 (22)47 (20)46 (69)43 (18)39 (88)13/15
GA nicolau noiseless 90 (23)625 (459)398 (604)397 (874)904 (1708)∞∞2e60/15
NELDERDOERR doerr noiseless 7.6 (13)4.0 (3)2.0 (2)2.1 (1)2.1 (2)2.0 (2)1.8 (2)15/15
ONEFIFTH auger noiseless 8.3 (17)13 (9)9.4 (8)9.3 (14)9.1 (9)8.6 (13)7.6 (15)15/15
IPOP-CMA-ES ros noiseless 3.7 (5)139 (310)110 (162)108 (70)106 (91)100 (165)88 (148)7/15

Δ fopt
f22, 20-D		 1e1
467		 1e0
5580		 1e-1
23491		 1e-2
24163		 1e-3
24948		 1e-5
26847		 1e-7
1.3e5		 #succ
12/15
BFGS ros noiseless 2.5 (2)1.8 (4)8.1 (9)7.9 (20)7.7 (4)10 (19)14 (15)0/15
BIPOP-CMA-ES hansen noiseless 6.8 (6)13 (23)215 (235)209 (290)202 (308)188 (160)37 (54)5/15
GA nicolau noiseless 110 (17)1452 (1703)∞∞∞∞∞2e60/15
NELDERDOERR doerr noiseless 5.2 (8)6.5 (11)8.3 (3)8.2 (13)8.0 (8)7.5 (8)1.5 (2)13/15
ONEFIFTH auger noiseless 11 (26)5.0 (4)11 (14)11 (11)11 (18)10 (15)2.1 (2)15/15
IPOP-CMA-ES ros noiseless 445 (26)287 (228)∞∞∞∞∞1e60/15

Δ fopt
f23, 20-D		 1e1
3.0		 1e0
1614		 1e-1
67457		 1e-2
3.7e5		 1e-3
4.9e5		 1e-5
8.1e5		 1e-7
8.4e5		 #succ
15/15
BFGS ros noiseless 50 (19)304 (307)∞∞∞∞∞1e50/15
BIPOP-CMA-ES hansen noiseless 4.6 (6)32 (34)1.00 (0.7)1.7 (2)2.0 (1)1.2 (0.4)1.2 (0.9)15/15
GA nicolau noiseless 1.8 (2)4570 (3092)∞∞∞∞∞2e60/15
NELDERDOERR doerr noiseless 2.0 (2)1.4 (0.7)★386 (39)∞∞∞∞4e50/15
ONEFIFTH auger noiseless 29 (120)32 (14)∞∞∞∞∞2e70/15
IPOP-CMA-ES ros noiseless 4.6 (5)2.3e4 (1e4)∞∞∞∞∞3e60/15

Δ fopt
f24, 20-D		 1e1
1.3e6		 1e0
7.5e6		 1e-1
5.2e7		 1e-2
5.2e7		 1e-3
5.2e7		 1e-5
5.2e7		 1e-7
5.2e7		 #succ
3/15
BFGS ros noiseless ∞∞∞∞∞∞∞1e50/15
BIPOP-CMA-ES hansen noiseless 1.00 (0.8)1.00 (0.5)1.0 (0.6)1 (1)1.00 (0.8)1 (1)1.00 (0.8)3/15
GA nicolau noiseless ∞∞∞∞∞∞∞2e60/15
NELDERDOERR doerr noiseless ∞∞∞∞∞∞∞4e50/15
ONEFIFTH auger noiseless ∞∞∞∞∞∞∞2e70/15
IPOP-CMA-ES ros noiseless ∞∞∞∞∞∞∞5e60/15

Previous dimension | Dimension = 40 | First dimension

Δ fopt
f1, 40-D		 1e1
83		 1e0
83		 1e-1
83		 1e-2
83		 1e-3
83		 1e-5
83		 1e-7
83		 #succ
15/15
BFGS ros noiseless 1 (0)★41 (0)★41 (0)★41 (0)★41 (0)★41 (0)★41 (0)★415/15
BIPOP-CMA-ES hansen noiseless 10 (1)15 (2)21 (1)28 (2)34 (2)45 (2)58 (3)15/15
GA nicolau noiseless 1467 (84)2990 (216)2.3e4 (5e4)6.8e5 (5e5)∞∞∞4e60/15
ONEFIFTH auger noiseless 5.8 (0.8)9.2 (2)13 (0.8)16 (2)19 (2)26 (2)33 (2)15/15
IPOP-CMA-ES ros noiseless 9.4 (1)16 (1)21 (2)27 (1)33 (1)45 (2)57 (1)15/15

Δ fopt
f2, 40-D		 1e1
796		 1e0
797		 1e-1
799		 1e-2
799		 1e-3
800		 1e-5
802		 1e-7
804		 #succ
15/15
BFGS ros noiseless 36 (3)★442 (4)★445 (5)★448 (2)★451 (7)★453 (5)★454 (6)★415/15
BIPOP-CMA-ES hansen noiseless 63 (6)71 (2)78 (4)82 (3)85 (5)88 (3)90 (3)15/15
GA nicolau noiseless ∞∞∞∞∞∞∞4e60/15
ONEFIFTH auger noiseless 8671 (3435)1.7e4 (6780)2.7e4 (9911)3.8e4 (2e4)8.4e4 (5e4)7.5e5 (1e6)∞4e70/15
IPOP-CMA-ES ros noiseless 61 (3)70 (4)77 (6)82 (2)85 (3)88 (2)90 (2)15/15

Δ fopt
f3, 40-D		 1e1
15526		 1e0
15602		 1e-1
15612		 1e-2
15641		 1e-3
15646		 1e-5
15651		 1e-7
15656		 #succ
15/15
BFGS ros noiseless ∞∞∞∞∞∞∞3e50/15
BIPOP-CMA-ES hansen noiseless ∞∞∞∞∞∞∞1e70/15
GA nicolau noiseless 476 (397)∞∞∞∞∞∞4e60/15
ONEFIFTH auger noiseless ∞∞∞∞∞∞∞4e70/15
IPOP-CMA-ES ros noiseless ∞∞∞∞∞∞∞6e60/15

Δ fopt
f4, 40-D		 1e1
15536		 1e0
15601		 1e-1
15659		 1e-2
15678		 1e-3
15703		 1e-5
15733		 1e-7
2.8e5		 #succ
6/15
BFGS ros noiseless ∞∞∞∞∞∞∞5e50/15
BIPOP-CMA-ES hansen noiseless ∞∞∞∞∞∞∞1e70/15
GA nicolau noiseless 3716 (7016)∞∞∞∞∞∞4e60/15
ONEFIFTH auger noiseless ∞∞∞∞∞∞∞4e70/15
IPOP-CMA-ES ros noiseless ∞∞∞∞∞∞∞6e60/15

Δ fopt
f5, 40-D		 1e1
98		 1e0
116		 1e-1
120		 1e-2
121		 1e-3
121		 1e-5
121		 1e-7
121		 #succ
15/15
BFGS ros noiseless 2.1 (0.5)2.3 (0.6)2.3 (0.6)2.3 (0.7)2.3 (0.4)2.3 (0.6)2.3 (0.6)15/15
BIPOP-CMA-ES hansen noiseless 4.5 (0.5)4.4 (0.5)4.4 (0.5)4.4 (0.3)4.4 (0.5)4.4 (0.5)4.4 (0.4)15/15
GA nicolau noiseless 3000 (178)4798 (185)7016 (569)9476 (441)1.2e4 (567)1.8e4 (597)∞4e60/15
ONEFIFTH auger noiseless 2.9 (1)2.9 (1)2.9 (0.8)2.9 (1.0)2.9 (0.6)2.9 (0.5)2.9 (0.8)15/15
IPOP-CMA-ES ros noiseless 4.9 (0.6)4.7 (0.8)4.7 (0.6)4.6 (0.4)4.6 (0.2)4.7 (0.7)4.7 (0.6)15/15

Δ fopt
f6, 40-D		 1e1
3507		 1e0
5523		 1e-1
7168		 1e-2
9470		 1e-3
11538		 1e-5
15007		 1e-7
19222		 #succ
15/15
BFGS ros noiseless 4.5 (2)4.6 (0.9)4.7 (1)4.6 (1)4.6 (1)5.1 (0.7)25 (56)0/15
BIPOP-CMA-ES hansen noiseless 1.6 (0.2)1.5 (0.2)1.5 (0.2)1.4 (0.1)1.4 (0.1)1.4 (0.1)1.4 (0.1)15/15
GA nicolau noiseless ∞∞∞∞∞∞∞4e60/15
ONEFIFTH auger noiseless 3.2 (2)4.6 (7)6.1 (3)6.8 (2)7.4 (7)8.6 (9)9.0 (5)15/15
IPOP-CMA-ES ros noiseless 1.7 (0.3)1.5 (0.2)1.5 (0.2)1.4 (0.2)1.4 (0.2)1.4 (0.1)1.4 (0.1)15/15

Δ fopt
f7, 40-D		 1e1
10698		 1e0
17839		 1e-1
41037		 1e-2
66294		 1e-3
66294		 1e-5
66294		 1e-7
68145		 #succ
15/15
BFGS ros noiseless ∞∞∞∞∞∞∞41000/15
BIPOP-CMA-ES hansen noiseless 1.2 (0.8)8.3 (0.7)4.0 (0.3)2.6 (0.2)2.6 (0.2)2.6 (0.2)2.5 (1)15/15
GA nicolau noiseless ∞∞∞∞∞∞∞4e60/15
ONEFIFTH auger noiseless ∞∞∞∞∞∞∞4e70/15
IPOP-CMA-ES ros noiseless 1.6 (0.7)5.5 (2)2.6 (1)1.7 (0.4)1.7 (0.5)1.7 (0.1)1.7 (0.0)15/15

Δ fopt
f8, 40-D		 1e1
7080		 1e0
10655		 1e-1
11012		 1e-2
11265		 1e-3
11430		 1e-5
11701		 1e-7
11969		 #succ
15/15
BFGS ros noiseless 2.4 (0.4)★42.2 (1)★32.2 (1.0)★42.1 (1.0)★42.1 (0.5)★42.1 (0.9)★42.0 (0.9)★415/15
BIPOP-CMA-ES hansen noiseless 7.3 (0.6)7.7 (3)7.9 (5)7.9 (0.4)7.9 (4)7.9 (2)7.8 (4)15/15
GA nicolau noiseless ∞∞∞∞∞∞∞4e60/15
ONEFIFTH auger noiseless 27 (4)67 (56)73 (101)85 (42)101 (50)134 (86)165 (93)13/15
IPOP-CMA-ES ros noiseless 6.9 (0.7)6.3 (0.4)6.5 (0.4)6.5 (0.4)6.5 (0.3)6.6 (0.3)6.5 (0.2)15/15

Δ fopt
f9, 40-D		 1e1
6122		 1e0
12982		 1e-1
13300		 1e-2
13496		 1e-3
13651		 1e-5
13909		 1e-7
14142		 #succ
15/15
BFGS ros noiseless 2.6 (0.3)★41.8 (0.8)★41.8 (1)★41.8 (1)★41.7 (0.4)★41.7 (1)★41.7 (0.7)★415/15
BIPOP-CMA-ES hansen noiseless 8.2 (0.8)6.2 (2)6.4 (4)6.5 (4)6.5 (0.4)6.5 (4)6.5 (2)15/15
GA nicolau noiseless ∞∞∞∞∞∞∞4e60/15
ONEFIFTH auger noiseless 33 (3)91 (126)95 (136)105 (87)118 (165)145 (162)172 (167)15/15
IPOP-CMA-ES ros noiseless 8.1 (0.9)5.7 (0.3)5.9 (3)5.9 (2)6.0 (0.3)6.0 (2)6.0 (3)15/15

Δ fopt
f10, 40-D		 1e1
25536		 1e0
29762		 1e-1
35676		 1e-2
51579		 1e-3
56007		 1e-5
65128		 1e-7
70824		 #succ
15/15
BFGS ros noiseless 1.00 (0.1)★41.00 (0.1)★41.0 (0.1)★31.6 (0.3)8.0 (9)134 (147)∞4e60/15
BIPOP-CMA-ES hansen noiseless 1.9 (0.2)1.9 (0.1)1.8 (0.1)1.3 (0.1)1.2 (0.1)1.1 (0.0)1.0 (0.0)15/15
GA nicolau noiseless ∞∞∞∞∞∞∞4e60/15
ONEFIFTH auger noiseless 262 (133)435 (216)595 (298)624 (683)1033 (1679)∞∞4e70/15
IPOP-CMA-ES ros noiseless 1.9 (0.2)1.9 (0.2)1.8 (0.1)1.3 (0.1)1.2 (0.0)1.1 (0.0)1.0 (0.0)15/15

Δ fopt
f11, 40-D		 1e1
2368		 1e0
4855		 1e-1
11681		 1e-2
25315		 1e-3
29749		 1e-5
38949		 1e-7
48211		 #succ
15/15
BFGS ros noiseless 1.0 (0.2)★41.0 (0.9)★41.00 (0.7)★42.3 (3)65 (41)∞∞4e50/15
BIPOP-CMA-ES hansen noiseless 15 (2)8.0 (0.7)3.5 (0.2)1.7 (0.1)1.5 (0.2)1.2 (0.2)1.0 (0.1)15/15
GA nicolau noiseless ∞∞∞∞∞∞∞4e60/15
ONEFIFTH auger noiseless 866 (183)654 (61)350 (36)212 (17)213 (9)223 (8)225 (8)14/15
IPOP-CMA-ES ros noiseless 15 (2)7.7 (0.8)3.4 (0.2)1.6 (0.1)1.4 (0.1)1.2 (0.0)0.98 (0.1)15/15

Δ fopt
f12, 40-D		 1e1
4169		 1e0
7452		 1e-1
9174		 1e-2
10751		 1e-3
13146		 1e-5
22758		 1e-7
25192		 #succ
15/15
BFGS ros noiseless 1.0 (2)1.0 (0.4)1.0 (0.6)1.0 (0.2)1.00 (0.4)★215 (13)656 (515)0/15
BIPOP-CMA-ES hansen noiseless 2.2 (3)2.3 (2)2.5 (1)2.5 (2)2.5 (1)1.9 (0.9)1.9 (0.5)15/15
GA nicolau noiseless ∞∞∞∞∞∞∞4e60/15
ONEFIFTH auger noiseless 4798 (7196)7717 (1e4)∞∞∞∞∞4e70/15
IPOP-CMA-ES ros noiseless 2.3 (2)2.5 (2)2.8 (2)2.9 (2)2.8 (1)2.1 (0.8)2.2 (0.4)15/15

Δ fopt
f13, 40-D		 1e1
2029		 1e0
6916		 1e-1
8734		 1e-2
11861		 1e-3
71936		 1e-5
98467		 1e-7
1.2e5		 #succ
15/15
BFGS ros noiseless 1.4 (0.2)1.0 (0.0)1 (0.0)1.00 (0.0)★246 (44)∞∞2e60/15
BIPOP-CMA-ES hansen noiseless 2.6 (4)2.6 (3)5.0 (4)17 (15)4.4 (4)5.3 (3)5.9 (2)15/15
GA nicolau noiseless ∞∞∞∞∞∞∞4e60/15
ONEFIFTH auger noiseless 4.7 (6)4.5 (3)18 (19)36 (27)11 (11)104 (35)1405 (1539)2/15
IPOP-CMA-ES ros noiseless 2.8 (0.3)3.5 (5)6.6 (8)10 (4)2.3 (2)2.7 (1)2.9 (1)★315/15

Δ fopt
f14, 40-D		 1e1
304		 1e0
616		 1e-1
777		 1e-2
1105		 1e-3
2207		 1e-5
4825		 1e-7
57711		 #succ
15/15
BFGS ros noiseless 1.7 (0.9)1.6 (0.6)1.8 (0.5)1.7 (0.5)★1.2 (0.3)★41.0 (0.1)★4∞7e50/15
BIPOP-CMA-ES hansen noiseless 2.7 (0.4)2.5 (0.1)3.1 (0.4)3.9 (0.5)4.4 (0.2)6.6 (0.5)1.1 (0.0)15/15
GA nicolau noiseless 276 (33)399 (46)1.1e4 (2e4)∞∞∞∞4e60/15
ONEFIFTH auger noiseless 1.9 (0.5)1.6 (0.3)1.8 (0.2)2.2 (0.2)5.2 (0.5)400 (42)∞4e70/15
IPOP-CMA-ES ros noiseless 2.7 (0.3)2.5 (0.4)3.0 (0.2)3.9 (0.4)4.3 (0.3)6.7 (0.4)1.1 (0.0)15/15

Δ fopt
f15, 40-D		 1e1
1.9e5		 1e0
7.9e5		 1e-1
1.0e6		 1e-2
1.1e6		 1e-3
1.1e6		 1e-5
1.1e6		 1e-7
1.1e6		 #succ
15/15
BFGS ros noiseless ∞∞∞∞∞∞∞3e50/15
BIPOP-CMA-ES hansen noiseless 1.4 (0.5)1.0 (0.2)1.0 (0.6)1.00 (0.4)1.00 (0.4)1.00 (0.4)1.00 (0.4)15/15
GA nicolau noiseless ∞∞∞∞∞∞∞4e60/15
ONEFIFTH auger noiseless ∞∞∞∞∞∞∞4e70/15
IPOP-CMA-ES ros noiseless 0.80 (0.4)★20.60 (0.3)0.70 (0.2)0.70 (0.2)0.71 (0.2)0.72 (0.2)0.73 (0.1)15/15

Δ fopt
f16, 40-D		 1e1
5244		 1e0
72122		 1e-1
3.2e5		 1e-2
7.1e5		 1e-3
1.4e6		 1e-5
2.0e6		 1e-7
2.0e6		 #succ
15/15
BFGS ros noiseless ∞∞∞∞∞∞∞1e60/15
BIPOP-CMA-ES hansen noiseless 1 (0.2)1.00 (0.4)1.0 (0.9)1.3 (1)1.00 (0.9)1.0 (0.6)1.0 (0.6)15/15
GA nicolau noiseless 255 (386)∞∞∞∞∞∞4e60/15
ONEFIFTH auger noiseless ∞∞∞∞∞∞∞4e70/15
IPOP-CMA-ES ros noiseless 0.94 (0.1)1.2 (0.5)1.0 (0.4)0.71 (0.4)0.46 (0.3)0.38 (0.3)0.39 (0.2)15/15

Δ fopt
f17, 40-D		 1e1
399		 1e0
4220		 1e-1
14158		 1e-2
34948		 1e-3
51958		 1e-5
1.3e5		 1e-7
2.7e5		 #succ
14/15
BFGS ros noiseless 382 (172)∞∞∞∞∞∞1e60/15
BIPOP-CMA-ES hansen noiseless 1.0 (0.3)1.0 (2)1.0 (1)1.0 (0.4)1.00 (0.4)1.00 (0.4)1.4 (0.9)15/15
GA nicolau noiseless 63 (9)231 (247)∞∞∞∞∞4e60/15
ONEFIFTH auger noiseless 5.6e4 (9e4)∞∞∞∞∞∞4e70/15
IPOP-CMA-ES ros noiseless 1.1 (0.3)0.50 (0.1)1.0 (1)1.1 (0.4)1.1 (0.6)0.99 (0.3)0.84 (0.3)★15/15

Δ fopt
f18, 40-D		 1e1
1442		 1e0
16998		 1e-1
47068		 1e-2
1.3e5		 1e-3
1.9e5		 1e-5
6.7e5		 1e-7
9.5e5		 #succ
15/15
BFGS ros noiseless ∞∞∞∞∞∞∞1e60/15
BIPOP-CMA-ES hansen noiseless 1.1 (0.8)1.1 (1)1.4 (1)1.1 (0.4)1.1 (0.3)1.2 (2)1.1 (1.0)15/15
GA nicolau noiseless 104 (27)∞∞∞∞∞∞4e60/15
ONEFIFTH auger noiseless ∞∞∞∞∞∞∞4e70/15
IPOP-CMA-ES ros noiseless 0.97 (0.3)0.66 (1)1.1 (0.5)0.85 (0.3)0.86 (0.0)0.74 (0.5)1.4 (5)14/15

Δ fopt
f19, 40-D		 1e1
1		 1e0
1		 1e-1
1.4e6		 1e-2
1.7e7		 1e-3
2.6e7		 1e-5
4.5e7		 1e-7
4.5e7		 #succ
8/15
BFGS ros noiseless ∞∞∞∞∞∞∞8e50/15
BIPOP-CMA-ES hansen noiseless 391 (76)5.6e4 (3e4)1.2 (1.0)1.00 (0.4)1 (0.5)1.00 (1)1.00 (0.8)8/15
GA nicolau noiseless 4.6e4 (6790)5.7e7 (4e7)∞∞∞∞∞4e60/15
ONEFIFTH auger noiseless 2.7e8 (2e8)∞∞∞∞∞∞4e70/15
IPOP-CMA-ES ros noiseless 442 (110)6.8e4 (8e4)0.64 (0.5)0.38 (0.1)0.31 (0.1)0.21 (0.0)0.22 (0.1)14/15

Δ fopt
f20, 40-D		 1e1
222		 1e0
1.3e5		 1e-1
1.6e8		 1e-2
∞		 1e-3
∞		 1e-5
∞		 1e-7
∞		 #succ
0/15
BFGS ros noiseless 1.5 (0.2)★433 (37)∞    0/15
BIPOP-CMA-ES hansen noiseless 4.1 (0.7)22 (8)1 (0.8)    0/15
GA nicolau noiseless 514 (34)2.9 (1)★3∞    0/15
ONEFIFTH auger noiseless 2.6 (0.4)1379 (1574)∞    0/15
IPOP-CMA-ES ros noiseless 4.1 (0.5)15 (3)0.33 (0.5)    0/15

Δ fopt
f21, 40-D		 1e1
1044		 1e0
21144		 1e-1
1.0e5		 1e-2
1.0e5		 1e-3
1.0e5		 1e-5
1.0e5		 1e-7
1.0e5		 #succ
26/30
BFGS ros noiseless 2.9 (4)2.3 (2)2.1 (3)2.1 (1)2.1 (1)2.1 (2)9.3 (7)2/15
BIPOP-CMA-ES hansen noiseless 2.7 (3)49 (71)112 (166)112 (152)111 (207)111 (166)110 (137)5/15
GA nicolau noiseless 120 (34)768 (947)559 (655)∞∞∞∞4e60/15
ONEFIFTH auger noiseless 3.6 (6)5.2 (6)2.8 (2)2.8 (2)2.8 (5)2.8 (6)2.8 (6)15/15
IPOP-CMA-ES ros noiseless 10 (26)166 (216)83 (75)83 (76)83 (97)82 (112)82 (112)4/15

Δ fopt
f22, 40-D		 1e1
3090		 1e0
35442		 1e-1
6.5e5		 1e-2
6.5e5		 1e-3
6.5e5		 1e-5
6.5e5		 1e-7
6.5e5		 #succ
8/30
BFGS ros noiseless 1.5 (1)1.5 (0.5)∞∞∞∞∞3e50/15
BIPOP-CMA-ES hansen noiseless 10 (34)60 (3)∞∞∞∞∞5e60/15
GA nicolau noiseless 130 (648)178 (142)∞∞∞∞∞4e60/15
ONEFIFTH auger noiseless 4.9 (12)2.7 (1)6.6 (8)6.6 (7)6.6 (8)6.6 (9)6.6 (13)15/15
IPOP-CMA-ES ros noiseless 367 (502)133 (141)∞∞∞∞∞3e60/15

Δ fopt
f23, 40-D		 1e1
7.0		 1e0
11925		 1e-1
75453		 1e-2
6.6e5		 1e-3
1.3e6		 1e-5
3.2e6		 1e-7
3.4e6		 #succ
15/15
BFGS ros noiseless 78 (184)263 (234)∞∞∞∞∞2e50/15
BIPOP-CMA-ES hansen noiseless 7.6 (6)4.8 (5)★31.0 (0.5)★41.6 (1)2.0 (2)1.4 (1)1.4 (0.5)15/15
GA nicolau noiseless 1.5 (2)437 (187)∞∞∞∞∞4e60/15
ONEFIFTH auger noiseless 33 (11)278 (181)∞∞∞∞∞4e70/26
IPOP-CMA-ES ros noiseless 8.1 (12)∞∞∞∞∞∞4e60/15

Δ fopt
f24, 40-D		 1e1
5.8e6		 1e0
9.8e7		 1e-1
3.0e8		 1e-2
3.0e8		 1e-3
3.0e8		 1e-5
3.0e8		 1e-7
3.0e8		 #succ
1/15
BFGS ros noiseless ∞∞∞∞∞∞∞3e50/15
BIPOP-CMA-ES hansen noiseless 4.6 (3)1.00 (1)1 (0.8)1 (0.6)1 (0.7)1 (0.9)1 (0.8)1/15
GA nicolau noiseless ∞∞∞∞∞∞∞4e60/15
ONEFIFTH auger noiseless ∞∞∞∞∞∞∞4e70/15
IPOP-CMA-ES ros noiseless ∞∞∞∞∞∞∞9e60/15

Average runtime (aRT in number of function evaluations) divided by the respective best aRT measured during BBOB-2009 in different dimensions. The aRT and in braces, as dispersion measure, the half difference between 10 and 90%-tile of bootstrapped run lengths appear for each algorithm and target, the corresponding reference aRT  in the first row. The different target ∆f-values are shown in the top row. #succ is the number of trials that reached the (final) target fopt+ 10−8. The median number of conducted function evaluations is additionally given in italics, if the target in the last column was never reached. Entries, succeeded by a star, are statistically significantly better (according to the rank-sum test) when compared to all other algorithms of the table, with p = 0.05 or p = 10−k when the number k following the star is larger than 1, with Bonferroni correction by the number of functions (24). A ↓ indicates the same tested against the best algorithm from BBOB 2009. Best results are printed in bold.
Data produced with COCO v2.0.797