Multi-Objective Deep Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
We propose Deep Optimistic Linear Support Learning (DOL) to solve high-dimensional multi-objective decision problems where the relative importances of the objectives are not known a priori. Using features from the high-dimensional inputs, DOL computes the convex coverage set containing all potential optimal solutions of the convex combinations of the objectives. To our knowledge, this is the first time that deep reinforcement learning has succeeded in learning multi-objective policies. In addition, we provide a testbed with two experiments to be used as a benchmark for deep multi-objective reinforcement learning.
Key facts. Cited by 81 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Oct 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 9; 2022: 14; 2023: 17; 2024: 16; 2025: 13; 2026: 11.
81 papers.
Sort:
By area:
- 2021A Practical Guide to Multi-Objective Reinforcement Learning and Planningcited by 240
- 2023Rewarded soups: towards Pareto-optimal alignment by interpolating weights fine-tuned on diverse rewardscited by 232
- 2022PD-MORL: Preference-Driven Multi-Objective Reinforcement Learning Algorithmcited by 51
- 2023Sample-Efficient Multi-Objective Learning via Generalized Policy Improvement Prioritizationcited by 46
- 2021Learning Controllable Content Generatorscited by 40
- 2023Scaling Pareto-Efficient Decision Making Via Offline Multi-Objective RLcited by 36
- 2024Parrot: Pareto-optimal Multi-Reward Reinforcement Learning Framework for Text-to-Image Generationcited by 35
- 2023Multi-Objective Reinforcement Learning Based on Decomposition: A Taxonomy and Frameworkcited by 28
- 2023Promptable Behaviors: Personalizing Multi-Objective Rewards from Human Preferencescited by 25
- 2025CAPO: Towards Enhancing LLM Reasoning through Generative Credit Assignmentcited by 25
- 2021Provably Efficient Cooperative Multi-Agent Reinforcement Learning with Function Approximationcited by 23
- 2022Pareto Conditioned Networkscited by 22
38 more
- 2022Optimistic Linear Support and Successor Features as a Basis for Optimal Policy Transfercited by 22
- 2021Levels of explainable artificial intelligence for human-aligned conversational explanationscited by 21
- 2022Imitating Past Successes can be Very Suboptimalcited by 20
- 2022PrefixRL: Optimization of Parallel Prefix Circuits using Deep Reinforcement Learningcited by 18
- 2025Pareto Set Learning for Multi-Objective Reinforcement Learningcited by 18
- 2023Two-Stage Constrained Actor-Critic for Short Video Recommendationcited by 16
- 2021Choosing the Best of Both Worlds: Diverse and Novel Recommendations through Multi-Objective Reinforcement Learningcited by 14
- 2022Socially Fair Reinforcement Learningcited by 13
- 2022Policy Optimization with Advantage Regularization for Long-Term Fairness in Decision Systemscited by 13
- 2025Bone Soups: A Seek-and-Soup Model Merging Approach for Controllable Multi-Objective Generationcited by 13
- 2025Formalizing Learning from Language Feedback with Provable Guaranteescited by 10
- 2021Towards Content Provider Aware Recommender Systems: A Simulation Study on the Interplay between User and Provider Utilitiescited by 9
- 2024Policy-regularized Offline Multi-objective Reinforcement Learningcited by 9
- 2024Multi-objective Reinforcement learning from AI Feedbackcited by 9
- 2023Achieving Fairness in Multi-Agent Markov Decision Processes Using Reinforcement Learningcited by 8
- 2024Beyond Worst-case Attacks: Robust RL with Adaptive Defense via Non-dominated Policiescited by 8
- 2025VARP: Reinforcement Learning from Vision-Language Model Feedback with Agent Regularized Preferencescited by 8
- 2019Integration of Imitation Learning using GAIL and Reinforcement Learning using Task-achievement Rewards via Probabilistic Graphical Modelcited by 7
- 2022Behaviour-Diverse Automatic Penetration Testing: A Curiosity-Driven Multi-Objective Deep Reinforcement Learning Approachcited by 7
- 2024Multi-objective Deep Learning: Taxonomy and Survey of the State of the Artcited by 6
- 2026MO-MIX: Multi-Objective Multi-Agent Cooperative Decision-Making With Deep Reinforcement Learningcited by 6
- 2023Multi-Objective Reinforcement Learning-based Approach for Pressurized Water Reactor Optimizationcited by 5
- 2024An Offline Adaptation Framework for Constrained Multi-Objective Reinforcement Learningcited by 5
- 2024How to Find the Exact Pareto Front for Multi-Objective MDPs?cited by 5
- 2021On Multi-objective Policy Optimization as a Tool for Reinforcement Learning: Case Studies in Offline RL and Finetuningcited by 4
- 2022Multi-objective Optimization of Notifications Using Offline Reinforcement Learningcited by 4
- 2025Scalable Multi-Objective Robot Reinforcement Learning through Gradient Conflict Resolutioncited by 4
- 2021Preference Communication in Multi-Objective Normal-Form Gamescited by 3
- 2023Deep Reinforcement Learning from Hierarchical Preference Designcited by 3
- 2022Multi-Objective reward generalization: Improving performance of Deep Reinforcement Learning for applications in single-asset tradingcited by 2
- 2022Constrained Reinforcement Learning for Short Video Recommendationcited by 2
- 2023Pruning the Way to Reliable Policies: A Multi-Objective Deep Q-Learning Approach to Critical Carecited by 2
- 2024Demonstration Guided Multi-Objective Reinforcement Learningcited by 2
- 2024A Meta-Learning Approach for Multi-Objective Reinforcement Learning in Sustainable Home Environmentscited by 2
- 2025Dual-Objective Reinforcement Learning with Novel Hamilton-Jacobi-Bellman Formulationscited by 2
- 2025Multi-Objective Bilevel Learningcited by 2
- 2026LAD: Learning Advantage Distribution for Reasoningcited by 2
- 2026A Reward-Free Viewpoint on Multi-Objective Reinforcement Learningcited by 2
50 most cited of 81 All 81 (JSON)
- 2026On Preference Coverage Collapse from Hindsight Relabeling in Multi-Objective Reinforcement Learning22 Sep 2026
- 2026Small RL Controller, Large Language Model: RL-Guided Adaptive Sampling for Test-Time Scaling2 Jun 2026
- 2026A Tale of Two Problems: Multi-Task Bilevel Learning Meets Equality Constrained Multi-Objective Optimization9 May 2026
- 2026A Single Deep Preference-Conditioned Policy for Learning Pareto Coverage Sets9 May 2026
- 2026A Production-Ready RL Framework for Personalized Utility Tuning with Pareto Sweeping in Pinterest Recommender Systems8 May 2026
- 2026A Reward-Free Viewpoint on Multi-Objective Reinforcement Learning27 Apr 2026
- 2026Learning What Matters Now: Dynamic Preference Inference under Contextual Shifts24 Mar 2026
- 2026PA2D-MORL: Pareto Ascent Directional Decomposition based Multi-Objective Reinforcement Learning20 Mar 2026
- 2026MO-MIX: Multi-Objective Multi-Agent Cooperative Decision-Making With Deep Reinforcement Learning28 Feb 2026
- 2026LAD: Learning Advantage Distribution for Reasoning23 Feb 2026
- 2026From Intents to Actions: Agentic AI in Autonomous Networks1 Feb 2026
- 2025Complex Instruction Following with Diverse Style Policies in Football Games25 Nov 2025
38 more
- 2025LPPG-RL: Lexicographically Projected Policy Gradient Reinforcement Learning with Subproblem Exploration11 Nov 2025
- 2025Multi-Objective Bilevel Learning11 Nov 2025
- 2025Scalable Multi-Objective Robot Reinforcement Learning through Gradient Conflict Resolution18 Sep 2025
- 2025CAPO: Towards Enhancing LLM Reasoning through Generative Credit Assignment4 Aug 2025
- 2025Dual-Objective Reinforcement Learning with Novel Hamilton-Jacobi-Bellman Formulations19 Jun 2025
- 2025Formalizing Learning from Language Feedback with Provable Guarantees12 Jun 2025
- 2025The challenge of hidden gifts in multi-agent reinforcement learning26 May 2025
- 2025Developing and Integrating Trust Modeling into Multi-Objective Reinforcement Learning for Intelligent Agricultural Management16 May 2025
- 2025VARP: Reinforcement Learning from Vision-Language Model Feedback with Agent Regularized Preferences18 Mar 2025
- 2025Bone Soups: A Seek-and-Soup Model Merging Approach for Controllable Multi-Objective Generation15 Feb 2025
- 2025Multi-Objective Reinforcement Learning for Power Grid Topology Control27 Jan 2025
- 2025Pareto Set Learning for Multi-Objective Reinforcement Learning12 Jan 2025
- 2024Effective Reward Specification in Deep Reinforcement Learning10 Dec 2024
- 2024Multi-objective Deep Learning: Taxonomy and Survey of the State of the Art2 Dec 2024
- 2024Preference-Conditioned Gradient Variations for Multi-Objective Quality-Diversity19 Nov 2024
- 2024How to Find the Exact Pareto Front for Multi-Objective MDPs?21 Oct 2024
- 2024Inferring Preferences from Demonstrations in Multi-objective Reinforcement Learning30 Sep 2024
- 2024An Offline Adaptation Framework for Constrained Multi-Objective Reinforcement Learning16 Sep 2024
- 2024MODRL-TA:A Multi-Objective Deep Reinforcement Learning Framework for Traffic Allocation in E-Commerce Search22 Jul 2024
- 2024Deep Reinforcement Learning for Multi-Objective Optimization: Enhancing Wind Turbine Energy Generation while Mitigating Noise Emissions18 Jul 2024
- 2024A Meta-Learning Approach for Multi-Objective Reinforcement Learning in Sustainable Home Environments16 Jul 2024
- 2024Multi-objective Reinforcement learning from AI Feedback11 Jun 2024
- 2024UCB-driven Utility Function Search for Multi-objective Reinforcement Learning1 May 2024
- 2024Demonstration Guided Multi-Objective Reinforcement Learning5 Apr 2024
- 2024Beyond Worst-case Attacks: Robust RL with Adaptive Defense via Non-dominated Policies20 Feb 2024
- 2024Issues with Value-Based Multi-objective Reinforcement Learning: Value Function Interference and Overestimation Sensitivity9 Feb 2024
- 2024Parrot: Pareto-optimal Multi-Reward Reinforcement Learning Framework for Text-to-Image Generation11 Jan 2024
- 2024Policy-regularized Offline Multi-objective Reinforcement Learning4 Jan 2024
- 2023Multi-Objective Reinforcement Learning-based Approach for Pressurized Water Reactor Optimization15 Dec 2023
- 2023Promptable Behaviors: Personalizing Multi-Objective Rewards from Human Preferences14 Dec 2023
- 2023Multi-Objective Reinforcement Learning Based on Decomposition: A Taxonomy and Framework21 Nov 2023
- 2023Dynamic value alignment through preference aggregation of multiple objectives9 Oct 2023
- 2023Multicopy Reinforcement Learning Agents19 Sep 2023
- 2023Deep Reinforcement Learning from Hierarchical Preference Design6 Sep 2023
- 2023A Robust Policy Bootstrapping Algorithm for Multi-objective Reinforcement Learning in Non-stationary Environments18 Aug 2023
- 2023Pruning the Way to Reliable Policies: A Multi-Objective Deep Q-Learning Approach to Critical Care13 Jun 2023
- 2023Rewarded soups: towards Pareto-optimal alignment by interpolating weights fine-tuned on diverse rewards7 Jun 2023
- 2023Achieving Fairness in Multi-Agent Markov Decision Processes Using Reinforcement Learning1 Jun 2023
50 newest of 81 All 81 (JSON)
- 2022Imitating Past Successes can be Very Suboptimalcited by 20
- 2024Policy-regularized Offline Multi-objective Reinforcement Learningcited by 9
- 2019Integration of Imitation Learning using GAIL and Reinforcement Learning using Task-achievement Rewards via Probabilistic Graphical Modelcited by 7
- 2021On Multi-objective Policy Optimization as a Tool for Reinforcement Learning: Case Studies in Offline RL and Finetuningcited by 4
- 2022Multi-objective Optimization of Notifications Using Offline Reinforcement Learningcited by 4
- 2022Regularized Soft Actor-Critic for Behavior Transfer Learningcited by 1
- 2024Policy-regularized Offline Multi-objective Reinforcement Learning4 Jan 2024
- 2022Regularized Soft Actor-Critic for Behavior Transfer Learning27 Sep 2022
- 2022Multi-objective Optimization of Notifications Using Offline Reinforcement Learning7 Jul 2022
- 2022Imitating Past Successes can be Very Suboptimal7 Jun 2022
- 2021On Multi-objective Policy Optimization as a Tool for Reinforcement Learning: Case Studies in Offline RL and Finetuning15 Jun 2021
- 2019Integration of Imitation Learning using GAIL and Reinforcement Learning using Task-achievement Rewards via Probabilistic Graphical Model3 Jul 2019
- 2023Rewarded soups: towards Pareto-optimal alignment by interpolating weights fine-tuned on diverse rewardscited by 232
- 2024Parrot: Pareto-optimal Multi-Reward Reinforcement Learning Framework for Text-to-Image Generationcited by 35
- 2023Promptable Behaviors: Personalizing Multi-Objective Rewards from Human Preferencescited by 25
- 2024Multi-objective Reinforcement learning from AI Feedbackcited by 9
- 2024Multi-objective Reinforcement learning from AI Feedback11 Jun 2024
- 2024Parrot: Pareto-optimal Multi-Reward Reinforcement Learning Framework for Text-to-Image Generation11 Jan 2024
- 2023Promptable Behaviors: Personalizing Multi-Objective Rewards from Human Preferences14 Dec 2023
- 2023Rewarded soups: towards Pareto-optimal alignment by interpolating weights fine-tuned on diverse rewards7 Jun 2023
- 2021A Practical Guide to Multi-Objective Reinforcement Learning and Planningcited by 240
- 2022PD-MORL: Preference-Driven Multi-Objective Reinforcement Learning Algorithmcited by 51
- 2023Sample-Efficient Multi-Objective Learning via Generalized Policy Improvement Prioritizationcited by 46
- 2021Learning Controllable Content Generatorscited by 40
- 2023Scaling Pareto-Efficient Decision Making Via Offline Multi-Objective RLcited by 36
- 2023Multi-Objective Reinforcement Learning Based on Decomposition: A Taxonomy and Frameworkcited by 28
- 2021Provably Efficient Cooperative Multi-Agent Reinforcement Learning with Function Approximationcited by 23
- 2022Pareto Conditioned Networkscited by 22
- 2022Optimistic Linear Support and Successor Features as a Basis for Optimal Policy Transfercited by 22
- 2021Levels of explainable artificial intelligence for human-aligned conversational explanationscited by 21
- 2022PrefixRL: Optimization of Parallel Prefix Circuits using Deep Reinforcement Learningcited by 18
- 2025Pareto Set Learning for Multi-Objective Reinforcement Learningcited by 18
12 most cited of 66 All 66 (JSON)
- 2026On Preference Coverage Collapse from Hindsight Relabeling in Multi-Objective Reinforcement Learning22 Sep 2026
- 2026A Tale of Two Problems: Multi-Task Bilevel Learning Meets Equality Constrained Multi-Objective Optimization9 May 2026
- 2026A Single Deep Preference-Conditioned Policy for Learning Pareto Coverage Sets9 May 2026
- 2026A Production-Ready RL Framework for Personalized Utility Tuning with Pareto Sweeping in Pinterest Recommender Systems8 May 2026
- 2026A Reward-Free Viewpoint on Multi-Objective Reinforcement Learning27 Apr 2026
- 2026Learning What Matters Now: Dynamic Preference Inference under Contextual Shifts24 Mar 2026
- 2026PA2D-MORL: Pareto Ascent Directional Decomposition based Multi-Objective Reinforcement Learning20 Mar 2026
- 2026MO-MIX: Multi-Objective Multi-Agent Cooperative Decision-Making With Deep Reinforcement Learning28 Feb 2026
- 2025Complex Instruction Following with Diverse Style Policies in Football Games25 Nov 2025
- 2025LPPG-RL: Lexicographically Projected Policy Gradient Reinforcement Learning with Subproblem Exploration11 Nov 2025
- 2025Multi-Objective Bilevel Learning11 Nov 2025
- 2025Scalable Multi-Objective Robot Reinforcement Learning through Gradient Conflict Resolution18 Sep 2025
12 newest of 66 All 66 (JSON)