A1 Journal article (refereed)
Designing empirical experiments to compare interactive multiobjective optimization methods (2022)

Afsar, B., Silvennoinen, J., Misitano, G., Ruiz, F., Ruiz, A. B., & Miettinen, K. (2022). Designing empirical experiments to compare interactive multiobjective optimization methods. Journal of the operational research society, Early online. https://doi.org/10.1080/01605682.2022.2141145

JYU authors or editors

Publication details

All authors or editorsAfsar, Bekir; Silvennoinen, Johanna; Misitano, Giovanni; Ruiz, Francisco; Ruiz, Ana B.; Miettinen, Kaisa

Journal or seriesJournal of the operational research society



Publication year2022

Publication date07/11/2022

VolumeEarly online

PublisherPalgrave Macmillan

Publication countryUnited Kingdom

Publication languageEnglish


Publication open accessOpenly available

Publication channel open accessPartially open access channel

Publication is parallel published (JYX)https://jyx.jyu.fi/handle/123456789/83841


Interactive multiobjective optimization methods operate iteratively so that a decision maker directs the solution process by providing preference information, and only solutions of interest are generated. These methods limit the amount of information considered in each iteration and support the decision maker in learning about the trade-offs. Many interactive methods have been developed, and they differ in technical aspects and the type of preference information used. Finding the most appropriate method for a problem to be solved is challenging, and supporting the selection is crucial. Published research lacks information on the conducted experiments’ specifics (e.g. questions asked), making it impossible to replicate them. We discuss the challenges of conducting experiments and offer realistic means to compare interactive methods. We propose a novel questionnaire and experimental design and, as proof of concept, apply them in comparing two methods. We also develop user interfaces for these methods and introduce a sustainability problem with multiple objectives. The proposed experimental setup is reusable, enabling further experiments.

Keywordsinteractionmethodsdevelopment (active)researchplanning and designdecision makingcomparisonusabilityobjectivessupporting

Free keywordsmultiple objective programming; interactive methods; performance comparison; experimental study; human decision makers

Contributing organizations

Related projects

Ministry reportingYes

Reporting Year2022

JUFO rating2

Last updated on 2024-03-04 at 18:57