skip to main content
10.1145/2739480.2754745acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
research-article

Global vs Local Search on Multi-objective NK-Landscapes: Contrasting the Impact of Problem Features

Published: 11 July 2015 Publication History

Abstract

Computationally hard multi-objective combinatorial optimization problems are common in practice, and numerous evolutionary multi-objective optimization (EMO) algorithms have been proposed to tackle them. Our aim is to understand which (and how) problem features impact the search performance of such approaches. In this paper, we consider two prototypical dominance-based algorithms: a global EMO strategy using an ergodic variation operator (GSEMO) and a neighborhood-based local search heuristic (PLS). Their respective runtime is estimated on a benchmark of combinatorial problems with tunable ruggedness, objective space dimension, and objective correlation ($\rho$MNK-landscapes). In other words, benchmark parameters define classes of instances with increasing empirical problem hardness; we enumerate and characterize the search space of small instances. Our study departs from simple performance comparison to systematically analyze the correlations between runtime and problem features, contrasting their association with search performance within and across instance classes, for both chosen algorithms. A mixed-model approach then allows us to further generalize from the experimental design, supporting a sound assessment of the joint impact of instance features on EMO search performance.

References

[1]
H. E. Aguirre and K. Tanaka. Working principles, behavior, and performance of MOEAs on MNK-landscapes. Eur J Oper Res, 181(3):1670--1690, 2007.
[2]
H. Akaike. Information theory as an extension of the maximum likelihood principle. In Second International Symposium on Information Theory, pages 267--281. Akademinai Kiado, 1973.
[3]
A. Auger and N. Hansen. Performance evaluation of an advanced local search evolutionary algorithm. In Evolutionary Computation, 2005. The 2005 IEEE Congress on, volume 2, pages 1777--1784. IEEE, 2005.
[4]
K. Bartoín. MuMIn: Multi-Model Inference, 2014. R package version 1.12.1.
[5]
D. Bates, M. Mächler, B. Bolker, and S. Walker. Fitting linear mixed-effects models using lme4. arXiv preprint arXiv:1406.5823, 2014.
[6]
K. P. Burnham and D. R. Anderson. Model selection and multimodel inference: a practical information-theoretic approach. Springer Science & Business Media, 2002.
[7]
K. P. Burnham and D. R. Anderson. Multimodel inference understanding aic and bic in model selection. Sociological methods & research, 33(2):261--304, 2004.
[8]
M. Chiarandini and Y. Goegebeur. Mixed models for the analysis of optimization algorithms. In Experimental Methods for the Analysis of Optimization Algorithms, volume 1, page 225. Springer, 2010.
[9]
M. Ehrgott. Multicriteria optimization. Springer, 2005.
[10]
J. J. Faraway. Extending the linear model with R: generalized linear, mixed effects and nonparametric regression models. Texts in Statistical Science. Chapman & Hall/CRC, 2005.
[11]
F. Hutter, L. Xu, H. H. Hoos, and K. Leyton-Brown. Algorithm runtime prediction: Methods & evaluation. Artificial Intelligence, 206:79--111, 2014.
[12]
S. A. Kauffman. The Origins of Order. Oxford University Press, 1993.
[13]
J. Knowles and D. Corne. Instance generators and test suites for the multiobjective quadratic assignment problem. In Evolutionary Multi-Criterion Optimization (EMO 2003), volume 2632 of LNCS, pages 295--310. Springer, 2003.
[14]
M. Laumanns, L. Thiele, and E. Zitzler. Running time analysis of evolutionary algorithms on a simplified multiobjective knapsack problem. Nat Comput, 3(1):37--51, 2004.
[15]
A. Liefooghe, L. Paquete, and J. R. Figueira. On local search for bi-objective knapsack problems. Evol Comput, 21(1):179--196, 2013.
[16]
A. Liefooghe, S. Verel, H. Aguirre, and K. Tanaka. What makes an instance difficult for black-box 0-1 evolutionary multiobjective optimizers? In International Conference on Artificial Evolution (EA 2013), volume 8752 of LNCS, pages 3--15, 2013.
[17]
A. Liefooghe, S. Verel, F. Daolio, H. Aguirre, and K. Tanaka. A feature-based performance analysis in evolutionary multiobjective optimization. In Evolutionary Multi-Criterion Optimization, volume 9019 of LNCS, pages 95--109. Springer, 2015.
[18]
A. McLeod. Kendall: Kendall rank correlation and Mann-Kendall trend test, 2011. R package version 2.2.
[19]
S. Nakagawa and H. Schielzeth. A general and simple method for obtaining r2 from generalized linear mixed-effects models. Methods in Ecology and Evolution, 4(2):133--142, 2013.
[20]
C. H. Papadimitriou and M. Yannakakis. On the approximability of trade-offs and optimal access of web sources. In Symposium on Foundations of Computer Science (FOCS 2000), pages 86--92, 2000.
[21]
L. Paquete, M. Chiarandini, and T. Stützle. Pareto local optimum sets in the biobjective traveling salesman problem: An experimental study. In Metaheuristics for Multiobjective Optimisation, volume 535 of Lecture Notes in Economics and Mathematical Systems, chapter 7, pages 177--199. Springer, 2004.
[22]
L. Paquete, T. Schiavinotto, and T. Stützle. On local optima in multiobjective combinatorial optimization problems. Ann Oper Res, 156(1):83--97, 2007.
[23]
L. Paquete and T. Stützle. Clusters of non-dominated solutions in multiobjective combinatorial optimization: An experimental analysis. In Multiobjective Programming and Goal Programming, volume 618 of LNMES, pages 69--77. Springer, 2009.
[24]
S. Verel, A. Liefooghe, L. Jourdan, and C. Dhaenens. On the structure of multiobjective combinatorial search space: MNK-landscapes with correlated objectives. Eur J Oper Res, 227(2):331--342, 2013.
[25]
E. Zitzler, L. Thiele, M. Laumanns, C. M. Foneseca, and V. Grunert da Fonseca. Performance assessment of multiobjective optimizers: An analysis and review. IEEE Trans. Evol. Comput., 7(2):117--132, 2003.

Cited By

View all
  • (2025)Multi-objective fitness landscape-based estimation of distribution algorithm for distributed heterogeneous flexible job shop scheduling problemApplied Soft Computing10.1016/j.asoc.2025.112780171(112780)Online publication date: Mar-2025
  • (2024)Empirical Comparison between MOEAs and Local Search on Multi-Objective Combinatorial Optimisation ProblemsProceedings of the Genetic and Evolutionary Computation Conference10.1145/3638529.3654077(547-556)Online publication date: 14-Jul-2024
  • (2024)Investigating Global Search Performance of Multi-Objective Genetic Algorithm based on Innately Split Model2024 Joint 13th International Conference on Soft Computing and Intelligent Systems and 25th International Symposium on Advanced Intelligent Systems (SCIS&ISIS)10.1109/SCISISIS61014.2024.10760138(1-4)Online publication date: 9-Nov-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
GECCO '15: Proceedings of the 2015 Annual Conference on Genetic and Evolutionary Computation
July 2015
1496 pages
ISBN:9781450334723
DOI:10.1145/2739480
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 July 2015

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. evolutionary multi-objective optimisation
  2. feature importance
  3. fitness landscape
  4. mixed-model regression
  5. running-time estimation

Qualifiers

  • Research-article

Funding Sources

Conference

GECCO '15
Sponsor:

Acceptance Rates

GECCO '15 Paper Acceptance Rate 182 of 505 submissions, 36%;
Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)12
  • Downloads (Last 6 weeks)3
Reflects downloads up to 02 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Multi-objective fitness landscape-based estimation of distribution algorithm for distributed heterogeneous flexible job shop scheduling problemApplied Soft Computing10.1016/j.asoc.2025.112780171(112780)Online publication date: Mar-2025
  • (2024)Empirical Comparison between MOEAs and Local Search on Multi-Objective Combinatorial Optimisation ProblemsProceedings of the Genetic and Evolutionary Computation Conference10.1145/3638529.3654077(547-556)Online publication date: 14-Jul-2024
  • (2024)Investigating Global Search Performance of Multi-Objective Genetic Algorithm based on Innately Split Model2024 Joint 13th International Conference on Soft Computing and Intelligent Systems and 25th International Symposium on Advanced Intelligent Systems (SCIS&ISIS)10.1109/SCISISIS61014.2024.10760138(1-4)Online publication date: 9-Nov-2024
  • (2023)From Fitness Landscapes to Explainable AI and BackProceedings of the Companion Conference on Genetic and Evolutionary Computation10.1145/3583133.3596395(1663-1667)Online publication date: 15-Jul-2023
  • (2023)MOEAs Are Stuck in a Different Area at a TimeProceedings of the Genetic and Evolutionary Computation Conference10.1145/3583131.3590447(303-311)Online publication date: 15-Jul-2023
  • (2023)An Dual-Clustering Search Strategy for Evolutionary Multi-Objective Optimization with Complicated Pareto Sets2023 5th International Communication Engineering and Cloud Computing Conference (CECCC)10.1109/CECCC59577.2023.10560847(43-50)Online publication date: 27-Oct-2023
  • (2022)A wrapper based binary bat algorithm with greedy crossover for attribute selectionExpert Systems with Applications10.1016/j.eswa.2021.115828187(115828)Online publication date: Jan-2022
  • (2021)B-MFO: A Binary Moth-Flame Optimization for Feature Selection from Medical DatasetsComputers10.3390/computers1011013610:11(136)Online publication date: 25-Oct-2021
  • (2021)A Survey of Advances in Landscape Analysis for OptimisationAlgorithms10.3390/a1402004014:2(40)Online publication date: 28-Jan-2021
  • (2021)Multimodal Multiobjective Evolutionary Optimization With Dual Clustering in Decision and Objective SpacesIEEE Transactions on Evolutionary Computation10.1109/TEVC.2020.300882225:1(130-144)Online publication date: Feb-2021
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media