skip to main content
10.1145/1389095.1389171acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
research-article

Improved EDNA (estimation of dependency networks algorithm) using combining function with bivariate probability distributions

Published: 12 July 2008 Publication History

Abstract

One of the key points in Estimation of Distribution Algorithms (EDAs) is the learning of the probabilistic graphical model used to guide the search: the richer the model the more complex the learning task. Dependency networks-based EDAs have been recently introduced. On the contrary of Bayesian networks, dependency networks allow the presence of directed cycles in their structure. In a previous work the authors proposed EDNA, an EDA algorithm in which a multivariate dependency network is used but approximating its structure learning by considering only bivariate statistics. EDNA was compared with other models from the literature with the same computational complexity (e.g., univariate and bivariate models). In this work we propose a modified version of EDNA in which not only the structural learning phase is limited to bivariate statistics, but also the simulation and the parameter learning task. Now, we extend the comparison employing multivariate models based on Bayesian networks (EBNA and hBOA). Our experiments show that the modified EDNA is more accurate than the original one, being its accuracy comparable to EBNA and hBOA, but with the advantage of being faster specially in the more complex cases.

References

[1]
S. Baluja and S. Davies. Combining Multiple Optimization Runs with Optimal Dependency Trees. Technical Report CMU-CS-97-157, Carnegie Mellon University, 1997.
[2]
J. S. D. Bonet, C. L. Isbell, and P. Viola. MIMIC: Finding optima by estimating probability densities. In Advances in Neural Information Processing Systems, volume 9, pages 424--430. MIT Press, Cambridge, 1997.
[3]
N. Friedman and M. Goldszmidt. Learning bayesian networks with local structure. In 12th Annual Conference on Uncertainty in Artificial Intelligence (UAI-96), pages 252--262, 1996.
[4]
J. A. Gámez, J. L. Mateo, and J. M. Puerta. Dependency networks based classifiers: learning models by using independence test. In Third European Workshop on Probabilistica Graphical Models (PGM06), pages 115--122, 2006.
[5]
J. A. Gámez, J. L. Mateo, and J. M. Puerta. EDNA: Estimation of Dependency Networks Algorithm. In International Work-Conference on the Interplay between Natural and Artificial Computation (IWINAC'07), volume 1, pages 427--436, 2007.
[6]
S. Geman and D. Geman. Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6:147--156, 1984.
[7]
D. E. Goldberg, K. Deb, and J. Horn. Massive multimodality, deception, and genetic algorithms. In Parallel Problem Solving from Nature (PPSN), volume 2, 1992.
[8]
G. Harik. Linkage learning in via probabilistic modelling in the EcGA. Technical Report 99010, Illinois Genetic Algorithms Laboratory, 1999.
[9]
G. Harik. Finding multimodal solutions using restricted tournament selection. In Proceedings of the Sixth International Conference on Genetic Algorithms, pages 24--31, 2005.
[10]
G. Harik, F. G. Lobo, and D. E. Golberg. The compat genetic algorithm. In Proceedings of the 4th International Conference on Evolutionary Computation, pages 1--5, 1997.
[11]
D. Heckerman. A Tutorial on Learning Bayesian Networks. Technical Report MSR-TR-95--06, Microsoft Research, Mar. 1995.
[12]
D. Heckerman, D. M. Chickering, and C. Meek. Dependency networks for inference, collaborative filtering and data visualization. Journal of Machine Learning Research, 1:49--75, 2000.
[13]
D. Heckerman, D. Geiger, and D. M. Chickering. Learning bayesian networks: The combination of knowledge and statistical data. In 10th Conf. Uncertainty in Artificial Intelligence, pages 293--301. Morgan Kaufmann Publishers, 1994.
[14]
J. H. Holland. Adaptation in Natural and Artificial Systems. University of Michigan Press, 1975.
[15]
M. Jaeger. Complex probabilistic modeling with recursive relational bayesian networks. Annals of Mathematics and Artificial Intelligence, 32:179 -- 220, 2001.
[16]
P. Larrañaga, R. Etxeberria, J. A. Lozano, and J. M. Peña. Combinatonal Optimization by Learning and Simulation of Bayesian Networks. In UAI '00: Proceedings of the 16th Conference in Uncertainty in Artificial Intelligence, pages 343--352, 2000.
[17]
J. L. Mateo and L. de la Ossa. LiO: an easy and exible library of metaheuristics. Technical Report DIAB-06-04-1, Departamento de Sistemas Informaticos, Escuela Politecnica Superior de Albacete, Universidad de Castilla-La Mancha, 2006.
[18]
H. Mühlenbein. The equation for response to selection an its use for prediction. Evolutionary Computation, 5:303--346, 1998.
[19]
H. Mühlenbein, T. Mahnig, and A. Ochoa. Schemata, distributions and graphical models in evolutionary optimization. Journal of Heuristics, 5:215--247, 1999.
[20]
H. Mühlenbein and G. Paaß. From recombination of genes to the estimation of distributions I. Binary patameters. In 4th Internatial Conference on Parallel Problem Solving from Nature, pages 178--187, 1996.
[21]
J. Neville and D. Jensen. Relational dependency networks. Journal of Machine Learning Research, 8:653--692, 2007.
[22]
A. Onisko, M. J. Druzdzel, and H. Wasyluk. Learning bayesian network parameters from small data sets: Application of noisy-or gates. International Journal of Approximate Reasoning, 27(2):165--182, 2001.
[23]
J. Pearl. Fusion, propagation and structuring in belief networks. Arti.cial Intelligence, 29:241--288, 1986.
[24]
J. Pearl. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, 1988.
[25]
M. Pelikan and D. E. Goldberg. Escaping hierarchical traps with competent genetic algorithms. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2001), pages 511--518, San Francisco, California, USA, 7--11 2001. Morgan Kaufmann.
[26]
R. Santana. Estimation of distribution algorithms with kikuchi approximations. Evolutionary Computation, 13(1):67--97, 2005.
[27]
G. Schwarz. Estimating the dimension of a model. Annals of Statistics, 6(2):461--464, 1978.
[28]
Y. Tian, Q. Yang, T. Huang, C. X. Ling, and W. Gao. Learning Contextual Dependency Network Models for Link-Based Classification. IEEE Transactions on Knowledge and Data Engineering, 18:1482--1496, Nov 2006.
[29]
R. A. Watson, G. Hornby, and J. B. Pollack. Modeling building-block interdependency. In Proceedings of the 5th International Conference on Parallel Problem Solving From Nature, pages 480--490, 1998.

Cited By

View all
  • (2014)A factor graph based genetic algorithmInternational Journal of Applied Mathematics and Computer Science10.5555/3062481.306252224:3(621-633)Online publication date: 1-Sep-2014
  • (2012)A Review of Estimation of Distribution Algorithms and Markov NetworksMarkov Networks in Evolutionary Computation10.1007/978-3-642-28900-2_2(21-37)Online publication date: 2012
  • (2010)Graph clustering based model buildingProceedings of the 11th international conference on Parallel problem solving from nature: Part I10.5555/1885031.1885086(506-515)Online publication date: 11-Sep-2010
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
GECCO '08: Proceedings of the 10th annual conference on Genetic and evolutionary computation
July 2008
1814 pages
ISBN:9781605581309
DOI:10.1145/1389095
  • Conference Chair:
  • Conor Ryan,
  • Editor:
  • Maarten Keijzer
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 July 2008

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. combinatorial optimization
  2. dependency networks
  3. estimation of distribution algorithms
  4. probability combining function
  5. scalability

Qualifiers

  • Research-article

Conference

GECCO08
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 08 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2014)A factor graph based genetic algorithmInternational Journal of Applied Mathematics and Computer Science10.5555/3062481.306252224:3(621-633)Online publication date: 1-Sep-2014
  • (2012)A Review of Estimation of Distribution Algorithms and Markov NetworksMarkov Networks in Evolutionary Computation10.1007/978-3-642-28900-2_2(21-37)Online publication date: 2012
  • (2010)Graph clustering based model buildingProceedings of the 11th international conference on Parallel problem solving from nature: Part I10.5555/1885031.1885086(506-515)Online publication date: 11-Sep-2010
  • (2010)Learning factorizations in estimation of distribution algorithms using affinity propagationEvolutionary Computation10.1162/EVCO_a_0000218:4(515-546)Online publication date: 1-Dec-2010
  • (2010)Graph Clustering Based Model BuildingParallel Problem Solving from Nature, PPSN XI10.1007/978-3-642-15844-5_51(506-515)Online publication date: 2010

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media