Article

Bayesian optimization models for particle swarms

Authors:

Christopher K. Monson,

Kevin D. SeppiAuthors Info & Claims

GECCO '05: Proceedings of the 7th annual conference on Genetic and evolutionary computation

Pages 193 - 200

https://doi.org/10.1145/1068009.1068039

Published: 25 June 2005 Publication History

Abstract

We explore the use of information models as a guide for the development of single objective optimization algorithms, giving particular attention to the use of Bayesian models in a PSO context. The use of an explicit information model as the basis for particle motion provides tools for designing successful algorithms. One such algorithm is developed and shown empirically to be effective. Its relationship to other popular PSO algorithms is explored and arguments are presented that those algorithms may be developed from the same model, potentially providing new tools for their analysis and tuning.

References

[1]

M. Clerc. The swarm and the queen: Towards a deterministic and adaptive particle swarm optimization. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC 1999), pages 1951--1957, Piscataway, New Jersey, 1999.

[2]

M. Clerc. TRIBES - un exemple d'optimisation par essaim particulaire sans paramètres de contrôle. In Optimisation par Essaim Particulaire (OEP 2003), Paris, France, 2003.

[3]

M. Clerc and J. Kennedy. The particle swarm: Explosion, stability, and convergence in a multidimensional complex space. IEEE Transactions on Evolutionary Computation, 6(1):58--73, February 2002.

Digital Library

[4]

R. C. Eberhart and Y. Shi. Comparing inertia weights and constriction factors in particle swarm optimization. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC 2000), pages 84--88, San Diego, California, 2000.

[5]

R. E. Kalman. A new approach to linear filtering and prediction problems. Transactions of the ASME--Journal of Basic Engineering, 82(Series D):35--45, 1960.

[6]

J. Kennedy. Bare bones particle swarms. In Proceedings of the IEEE Swarm Intelligence Symposium 2003 (SIS 2003), pages 80--87, Indianapolis, Indiana, 2003.

[7]

J. Kennedy and R. C. Eberhart. Particle swarm optimization. In International Conference on Neural Networks IV, pages 1942--1948, Piscataway, NJ, 1995. IEEE Service Center.

[8]

J. Kennedy and R. C. Eberhart. Swarm Intelligence. Morgan Kaufmann Publishers, 2001.

Digital Library

[9]

C. T. Leondes, editor. Theory and Applications of Kalman Filtering. Number 139 in AGARDograph. North Atlantic Treaty Organization, Advisory Group for Aerospace Research and Development, 1970.

[10]

R. Mendes, J. Kennedy, and J. Neves. Watch thy neighbor or how the swarm can learn from its environment. In Proceedings of the IEEE Swarm Intelligence Symposium 2003 (SIS 2003), pages 88--94, Indianapolis, Indiana, 2003.

[11]

C. K. Monson and K. D. Seppi. The Kalman swarm. In Proceedings of the Genetic and Evolutionary Computation Conference, volume 1, pages 140--150, Seattle, Washington, 2004.

[12]

E. Ozcan and C. K. Mohan. Particle swarm optimizaton: Surfing the waves. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC 1999), Washington, D.C., 1999.

[13]

S. Russel and P. Norvig. Artificial Intelligence: A Modern Approach. Prentice Hall, Englewood Cliffs, New Jersey, second edition, 2003.

Digital Library

[14]

Y. Shi and R. C. Eberhart. A modified particle swarm optimizer. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC 1998), Piscataway, New Jersey, 1998.

[15]

D. H. Wolpert and W. G. Macready. No free lunch theorems for optimization. IEEE Transactions on Evolutionary Computation, 1(1):67--82, April 1997.

Digital Library

[16]

Y. Zheng, L. Ma, L. Zhang, and J. Qian. Empirical study of particle swarm optimizer with an increasing inertia weight. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC 2003), pages 221--226, Canbella, Australia, 2003.

Cited By

Wang CGoatman KBoardman JBeveridge ENewby DSemple S(2019)Distance Oriented Particle Swarm Optimizer for Brain Image RegistrationIEEE Access10.1109/ACCESS.2019.29077697(56016-56027)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2907769
Wang DTan DLiu L(2018)Particle swarm optimization algorithmSoft Computing - A Fusion of Foundations, Methodologies and Applications10.1007/s00500-016-2474-622:2(387-408)Online publication date: 30-Dec-2018
https://dl.acm.org/doi/10.1007/s00500-016-2474-6
SI WPAN XOGAI HHIRAI K(2016)LP Guided PSO Algorithm for Office Lighting ControlIEICE Transactions on Information and Systems10.1587/transinf.2015EDP7242E99.D:7(1753-1761)Online publication date: 2016
https://doi.org/10.1587/transinf.2015EDP7242
Show More Cited By

Index Terms

Bayesian optimization models for particle swarms
1. Mathematics of computing
  1. Mathematical analysis
    1. Mathematical optimization
2. Theory of computation
  1. Design and analysis of algorithms
    1. Mathematical optimization

Recommendations

Particle Swarm Optimization inspired by starling flock behavior

New Particle Swarm Optimization algorithm based on the collective response of starlings flock behavior called "Starling PSO."Starling PSO introduces a new method to adjust the position and velocity of particles which will generate new feasible solutions ...
Scalability of particle swarm algorithms
GECCO '07: Proceedings of the 9th annual conference on Genetic and evolutionary computation

When dealing with complex optimisations problems, evolutionary computation techniques have proven tobe very helpful. Amongst optimisation algorithms driven by evolutionary computation techniques,particle swarm algorithms have proven to be a very good ...
A Modified Two Sub-swarms Exchange Particle Swarm Optimization
ICICTA '10: Proceedings of the 2010 International Conference on Intelligent Computation Technology and Automation - Volume 01

Particle swarm optimization and its modification for two sub-swarms exchange appear premature convergence for complex optimization problem, because particles’ performance becomes same in seeking later period. Therefore, in this paper, a modified two sub-...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

GECCO '05: Proceedings of the 7th annual conference on Genetic and evolutionary computation

June 2005

2272 pages

ISBN:1595930108

DOI:10.1145/1068009

Editor:
Hans-Georg Beyer
Vorarlberg University of Applied Sciences, Austria
,
General Chair:
Una-May O'Reilly
CSAIL, MIT

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 June 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

GECCO05

Sponsor:

GECCO05: Genetic and Evolutionary Computation Conference

June 25 - 29, 2005

Washington DC, USA

Acceptance Rates

Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
869
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wang CGoatman KBoardman JBeveridge ENewby DSemple S(2019)Distance Oriented Particle Swarm Optimizer for Brain Image RegistrationIEEE Access10.1109/ACCESS.2019.29077697(56016-56027)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2907769
Wang DTan DLiu L(2018)Particle swarm optimization algorithmSoft Computing - A Fusion of Foundations, Methodologies and Applications10.1007/s00500-016-2474-622:2(387-408)Online publication date: 30-Dec-2018
https://dl.acm.org/doi/10.1007/s00500-016-2474-6
SI WPAN XOGAI HHIRAI K(2016)LP Guided PSO Algorithm for Office Lighting ControlIEICE Transactions on Information and Systems10.1587/transinf.2015EDP7242E99.D:7(1753-1761)Online publication date: 2016
https://doi.org/10.1587/transinf.2015EDP7242
Siyun Xie Xiafu Peng Xunyu Zhong Chengrui Liu (2013)Fault diagnosis of the satellite power system based on the Bayesian network2013 8th International Conference on Computer Science & Education10.1109/ICCSE.2013.6554060(1004-1008)Online publication date: Apr-2013
https://doi.org/10.1109/ICCSE.2013.6554060
Li HZhou Y(2012)Fault Diagnosis by Bayesian Network in System of Poor Braking EfficiencyProceedings of the 2012 4th International Conference on Intelligent Human-Machine Systems and Cybernetics - Volume 0110.1109/IHMSC.2012.17(45-48)Online publication date: 26-Aug-2012
https://dl.acm.org/doi/10.1109/IHMSC.2012.17
Zhou YZhang Y(2011)Applications of Bayesian Network in Fault Diagnosis of Braking Deviation SystemProceedings of the 2011 Fourth International Symposium on Computational Intelligence and Design - Volume 0110.1109/ISCID.2011.51(170-173)Online publication date: 28-Oct-2011
https://dl.acm.org/doi/10.1109/ISCID.2011.51
Chen Y(2011)Applications of Bayesian Network in Fault Diagnosis of Braking SystemProceedings of the 2011 Third International Conference on Intelligent Human-Machine Systems and Cybernetics - Volume 0110.1109/IHMSC.2011.63(234-237)Online publication date: 26-Aug-2011
https://dl.acm.org/doi/10.1109/IHMSC.2011.63
Monson C(2011)Simple adaptive cognition for PSO2011 IEEE Congress of Evolutionary Computation (CEC)10.1109/CEC.2011.5949814(1657-1664)Online publication date: Jun-2011
https://doi.org/10.1109/CEC.2011.5949814
Yan ZPeng L(2011)Application of Bayesian Network in Failure Diagnosis of Hydro-electrical Simulation SystemIntelligent Decision Technologies10.1007/978-3-642-22194-1_68(691-698)Online publication date: 2011
https://doi.org/10.1007/978-3-642-22194-1_68
Cui ZZeng JYin Y(2008)An Improved PSO with Time-Varying Accelerator CoefficientsProceedings of the 2008 Eighth International Conference on Intelligent Systems Design and Applications - Volume 0210.1109/ISDA.2008.86(638-643)Online publication date: 26-Nov-2008
https://dl.acm.org/doi/10.1109/ISDA.2008.86
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten