Algorithm data sets for the bbob-noisy test suite
In the table below, you will find all official algorithm data sets on the bbob-noisy test suite, together with their year of publication, the authors, and related PDFs for each data set. Links to the source code to run the corresponding experiments/algorithms are provided whenever available.
To sort the table, simply click on the table header of the corresponding column.
| Number | Algorithm Name | Year | Author(s) | link to data | related PDFs, source code, and remarks |
|---|---|---|---|---|---|
| noisy-000 | ALPS | 2009 | Hornby | data | |
| noisy-001 | AMALGAM | 2009 | Bosman et al. | data | pdf noiseless - pdf noisy |
| noisy-002 | BAYEDA | 2009 | Gallagher | data | pdf noiseless - pdf noisy |
| noisy-003 | BFGS | 2009 | Ros | data | pdf noiseless - pdf noisy |
| noisy-004 | BIPOP-CMA-ES | 2009 | Hansen | data | pdf noiseless - pdf noisy |
| noisy-005 | CMA-ESPLUSSEL | 2009 | Auger and Hansen | data | pdf noiseless - pdf noisy |
| noisy-006 | DASA | 2009 | Korošec and Šilc | data | pdf noiseless - pdf noisy |
| noisy-007 | DE-PSO | 2009 | García-Nieto et al. | data | pdf noiseless - pdf noisy |
| noisy-008 | EDA-PSO | 2009 | El-Abd and Kamel | data | |
| noisy-009 | FULLNEWUOA | 2009 | Ros | data | original 2009 noiseless paper - original 2009 noisy paper - 2010 comparison noiseless - 2010 comparison noisy |
| noisy-010 | GLOBAL | 2009 | Pál et al. | data | BBOB-2009 paper not available online - corresponding ECJ paper |
| noisy-011 | iAMALGAM | 2009 | Bosman et al. | data | pdf noiseless - pdf noisy |
| noisy-012 | IPOP-SEP-CMA-ES | 2009 | Ros | data | pdf noiseless - pdf noisy |
| noisy-013 | MA-LS-CHAIN | 2009 | Molina et al. | data | pdf noiseless - pdf noisy |
| noisy-014 | MCS | 2009 | Huyer and Neumaier | data | pdf noiseless - pdf noisy |
| noisy-015 | ONEFIFTH | 2009 | Auger | data | pdf noiseless - pdf noisy |
| noisy-016 | PSO | 2009 | El-Abd and Kamel | data | |
| noisy-017 | PSO_Bounds | 2009 | El-Abd and Kamel | data | |
| noisy-018 | RANDOMSEARCH | 2009 | Auger and Ros | data | pdf noiseless - pdf noisy |
| noisy-019 | SNOBFIT | 2009 | Huyer and Neumaier | data | |
| noisy-020 | VNS | 2009 | García-Martínez and Lozano | data | pdf noiseless - pdf noisy |
| noisy-021 | 1komma2 | 2010 | Auger et al. | data | pdf cmp1komma2mirAnd1komma2mirser - doi - pdf cmp1komma2mirAnd1komma2mirserNoisy - pdf cmp1komma2ser - cmp1komma2serNoisy |
| noisy-022 | 1komma2mir | 2010 | Auger et al. | data | pdf cmp1komma2And1komma2mirser - doi - pdf cmp1komma2And1komma2mirserNoisy |
| noisy-023 | 1komma2mirser | 2010 | Auger et al. | data | pdf cmp1komma2And1komma2mir - doi - pdf cmp1komma2And1komma2mirNoisy |
| noisy-024 | 1komma2ser | 2010 | Auger et al. | data | pdf cmp1komma2 - pdf cmp1komma2Noisy |
| noisy-025 | 1komma4 | 2010 | Auger et al. | data | pdf cmp1komma4serNoisy - doi - the other three papers using the data set are not linked at the moment |
| noisy-026 | 1komma4mir | 2010 | Auger et al. | data | pdf cmp1komma4And1komma4mirser - pdf cmp1komma4And1komma4mirserNoisy |
| noisy-027 | 1komma4mirser | 2010 | Auger et al. | data | pdf noiseless - pdf noisy - pdf cmp1komma4And1komma4mir - pdf cmp1komma4And1komma4mirNoisy |
| noisy-028 | 1komma4ser | 2010 | Auger et al. | data | pdf cmp1komma4 - pdf cmp1komma4Noisy - doi |
| noisy-029 | AVGNEWUOA | 2010 | Ros | data | mentioned in 2009 paper, data set submitted in 2009, but data presented only in 2010 - cmpNEWUOAFULLNEWUOnoiseless - algname still NEWUOA |
| noisy-030 | CMAEGS | 2010 | Finck and Beyer | data | pdf noiseless - doi noisy |
| noisy-031 | IPOP-ACTCMA-ES | 2010 | Hansen and Ros | data | pdf cmpIPOP-CMA-ESNoiseless - pdf cmpIPOP-CMA-ESNoisy |
| noisy-032 | IPOP-CMA-ES | 2010 | Hansen and Ros | data | pdf cmpIPOP-ACTCMA-ESNoiseless - pdf cmpIPOP-ACTCMA-ESNoisy - pdf cmpBIPOP-CMA-ESNoiseless - pdf cmpBIPOP-CMA-ESNoisy |
| noisy-033 | MOS | 2010 | LaTorre et al. | data | pdf noiseless - pdf noisy |
| noisy-034 | NEWUOA | 2010 | Hansen and Ros | data | |
| noisy-035 | RCGA | 2010 | Tran and Jin | data | doi noiseless - doi noisy |
| noisy-036 | SPSA | 2010 | Finck and Beyer | data | pdf noiseless - pdf noisy |
| noisy-037 | IPOPsaACM | 2012 | Loshchilov et al. | data | pdf cmpBIPOPsaACM - pdf cmpIPOP-ACTCMA-ESNoisy - source code |
| noisy-038 | SNES | 2012 | Schaul | data | |
| noisy-039 | xNES | 2012 | Schaul | data | pdf - pdf cmpxNESas |
| noisy-040 | xNESas | 2012 | Schaul | data | pdf - pdf cmpxNES - pdf cmpBIPOP-CMA-ES |
| noisy-041 | PSAaLmC-CMA-ES | 2016 | Nishida and Akimoto | data | GECCO paper |
| noisy-042 | PSAaLmD-CMA-ES | 2016 | Nishida and Akimoto | data | GECCO paper |
| noisy-043 | PSAaSmC-CMA-ES | 2016 | Nishida and Akimoto | data | GECCO paper |
| noisy-044 | PSAaSmD-CMA-ES | 2016 | Nishida and Akimoto | data | GECCO paper |