# Multi-Objectivizing Software Configuration Tuning (for a single performance concern)

arXiv: https://arxiv.org/abs/2106.01331 · HTML: https://mlsanity.com/paper/2106.01331/

## Key facts

- Cited by 28 papers in the map (data through 14 Oct 2026).
- Builds on 15 of its 71 references that are in the map.
- First posted on arXiv 31 May 2021.

## Builds on (most cited first, 15 of 15)

- [Language Models are Few-Shot Learners](https://mlsanity.com/paper/2005.14165/) (2020)
- [ParamILS: An Automatic Algorithm Configuration Framework](https://mlsanity.com/paper/1401.3492/) (2014)
- [Finding Faster Configurations using FLASH](https://mlsanity.com/paper/1801.02175/) (2018)
- [ARJA: Automated Repair of Java Programs via Multi-Objective Genetic Programming](https://mlsanity.com/paper/1712.07804/) (2017)
- [BestConfig: Tapping the Performance Potential of Systems via Automatic Configuration Tuning](https://mlsanity.com/paper/1710.03439/) (2017)
- [FEMOSAA: Feature Guided and Knee Driven Multi-Objective Optimization for Self-Adaptive Software](https://mlsanity.com/paper/1608.08933/) (2016)
- [A Survey and Taxonomy of Self-Aware and Self-Adaptive Cloud Autoscaling Systems](https://mlsanity.com/paper/1609.03590/) (2016)
- [An Uncertainty-Aware Approach to Optimal Configuration of Stream Processing Systems](https://mlsanity.com/paper/1606.06543/) (2016)
- [Self-Adaptive Trade-off Decision Making for Autoscaling Cloud-Based Services](https://mlsanity.com/paper/1608.05917/) (2016)
- [How to Evaluate Solutions in Pareto-based Search-Based Software Engineering? A Critical Review and Methodological Guidance](https://mlsanity.com/paper/2002.09040/) (2020)
- [BiLO-CPDP: Bi-Level Programming for Automated Model Discovery in Cross-Project Defect Prediction](https://mlsanity.com/paper/2008.13489/) (2020)
- [TrimTuner: Efficient Optimization of Machine Learning Jobs in the Cloud via Sub-Sampling](https://mlsanity.com/paper/2011.04726/) (2020)
- [Synergizing Domain Expertise with Self-Awareness in Software Systems: A Patternized Architecture Guideline](https://mlsanity.com/paper/2001.07076/) (2020)
- [DATESSO: Self-Adapting Service Composition with Debt-Aware Two Levels Constraint Reasoning](https://mlsanity.com/paper/2003.14377/) (2020)
- [Multiobjectivization of Local Search: Single-Objective Optimization Benefits From Multi-Objective Gradient Descent](https://mlsanity.com/paper/2010.01004/) (2020)

## Built on by (most cited first, 28 of 28)

- [Do Performance Aspirations Matter for Guiding Software Configuration Tuning?](https://mlsanity.com/paper/2301.03290/) (2023)
- [MMO: Meta Multi-Objectivization for Software Configuration Tuning](https://mlsanity.com/paper/2112.07303/) (2021)
- [The Weights can be Harmful: Pareto Search versus Weighted Search in Multi-Objective Search-Based Software Engineering](https://mlsanity.com/paper/2202.03728/) (2022)
- [Predicting Configuration Performance in Multiple Environments with Sequential Meta-learning](https://mlsanity.com/paper/2402.03183/) (2024)
- [Lifelong Dynamic Optimization for Self-Adaptive Systems: Fact or Fiction?](https://mlsanity.com/paper/2201.07096/) (2022)
- [Predicting Software Performance with Divide-and-Learn](https://mlsanity.com/paper/2306.06651/) (2023)
- [Adapting Multi-objectivized Software Configuration Tuning](https://mlsanity.com/paper/2404.04744/) (2024)
- [Planning Landscape Analysis for Self-Adaptive Systems](https://mlsanity.com/paper/2203.12472/) (2022)
- [Distilled Lifelong Self-Adaptation for Configurable Systems](https://mlsanity.com/paper/2501.00840/) (2025)
- [Does Configuration Encoding Matter in Learning Software Performance? An Empirical Study on Encoding Schemes](https://mlsanity.com/paper/2203.15988/) (2022)
- [Faster Configuration Performance Bug Testing with Neural Dual-level Prioritization](https://mlsanity.com/paper/2501.15392/) (2025)
- [Deep Configuration Performance Learning: A Systematic Survey and Taxonomy](https://mlsanity.com/paper/2403.03322/) (2024)
- [Dually Hierarchical Drift Adaptation for Online Configuration Performance Learning](https://mlsanity.com/paper/2507.08730/) (2025)
- [Revealing Domain-Spatiality Patterns for Configuration Tuning: Domain Knowledge Meets Fitness Landscapes](https://mlsanity.com/paper/2603.19897/) (2026)
- [Dividable Configuration Performance Learning](https://mlsanity.com/paper/2409.07629/) (2024)
- [Rethinking Performance Analysis for Configurable Software Systems: A Case Study from a Fitness Landscape Perspective](https://mlsanity.com/paper/2412.16888/) (2024)
- [AI-driven Java Performance Testing: Balancing Result Quality with Testing Time](https://mlsanity.com/paper/2408.05100/) (2024)
- [CoTune: Co-evolutionary Configuration Tuning](https://mlsanity.com/paper/2509.24694/) (2025)
- [Light over Heavy: Automated Performance Requirements Quantification with Linguistic Inducement](https://mlsanity.com/paper/2511.03421/) (2025)
- [Evaluating Useful Surrogate Models for Configuration Tuning Beyond Accuracy: A Fitness Landscape Analysis Perspective](https://mlsanity.com/paper/2509.21945/) (2025)
- [Causally Perturbed Fairness Testing](https://mlsanity.com/paper/2510.18719/) (2025)
- [CDS4RAG: Cyclic Dual-Sequential Hyperparameter Optimization for RAG](https://mlsanity.com/paper/2605.08333/) (2026)
- [When to Use Which? Benchmarking Optimisers for Configurable Systems under Varying Budgets](https://mlsanity.com/paper/2607.16476/) (2026)
- [Multifaceted Hierarchical Report Identification for Non-Functional Bugs in Deep Learning Frameworks](https://mlsanity.com/paper/2210.01855/) (2022)
- [Contexts Matter: An Empirical Study on Contextual Influence in Fairness Testing for Deep Learning Systems](https://mlsanity.com/paper/2408.06102/) (2024)
- [Human-Machine Co-Boosted Bug Report Identification with Mutualistic Neural Active Learning](https://mlsanity.com/paper/2604.18862/) (2026)
- [LLMSYS-HPOBench: Hyperparameter Optimization Benchmark Suite for Real-World LLM Systems](https://mlsanity.com/paper/2605.08305/) (2026)
- [Configuring RAG Systems: What Breaks, Where Originates, and How to Fix](https://mlsanity.com/paper/2610.18567/) (2026)

## Abstract (arXiv)

Automatically tuning software configuration for optimizing a single performance attribute (e.g., minimizing latency) is not trivial, due to the nature of the configuration systems (e.g., complex landscape and expensive measurement). To deal with the problem, existing work has been focusing on developing various effective optimizers. However, a prominent issue that all these optimizers need to take care of is how to avoid the search being trapped in local optima -- a hard nut to crack for software configuration tuning due to its rugged and sparse landscape, and neighboring configurations tending to behave very differently. Overcoming such in an expensive measurement setting is even more challenging. In this paper, we take a different perspective to tackle this issue. Instead of focusing on improving the optimizer, we work on the level of optimization model. We do this by proposing a meta multi-objectivization model (MMO) that considers an auxiliary performance objective (e.g., throughput in addition to latency). What makes this model unique is that we do not optimize the auxiliary performance objective, but rather use it to make similarly-performing while different configurations less comparable (i.e. Pareto nondominated to each other), thus preventing the search from being trapped in local optima. Experiments on eight real-world software systems/environments with diverse performance attributes reveal that our MMO model is statistically more effective than state-of-the-art single-objective counterparts in overcoming local optima (up to 42% gain), while using as low as 24% of their measurements to achieve the same (or better) performance result.