Exploration by Distributional Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
We propose a framework based on distributional reinforcement learning and recent attempts to combine Bayesian parameter updates with deep reinforcement learning. We show that our proposed framework conceptually unifies multiple previous methods in exploration. We also derive a practical algorithm that achieves efficient exploration on challenging control tasks.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 2; 2023: 4; 2024: 1; 2025: 2; 2026: 1.
13 papers.
Sort:
- 2022Exploration in Deep Reinforcement Learning: A Surveycited by 158
- 2021SENTINEL: Taming Uncertainty with Ensemble-based Distributional Reinforcement Learningcited by 15
- 2021Intrinsic Benefits of Categorical Distributional Loss: Uncertainty-aware Regularized Exploration in Reinforcement Learningcited by 4
- 2023Exploration via Epistemic Value Estimationcited by 4
- 2021Bayesian Distributional Policy Gradientscited by 3
- 2023Pitfall of Optimism: Distributional Reinforcement Learning by Randomizing Risk Criterioncited by 3
- 2024A unified uncertainty-aware exploration: Combining epistemic and aleatory uncertaintycited by 2
- 2025Stochastic Path Planning in Correlated Obstacle Fieldscited by 1
- 2022Exploration with Multi-Sample Target Values for Distributional Reinforcement Learningcited by 0
- 2023Bag of Policies for Distributional Deep Explorationcited by 0
- 2023DRL-ORA: Distributional Reinforcement Learning with Online Risk Adaptioncited by 0
- 2025Optimal Transport-Guided Safety in Temporal Difference Reinforcement Learningcited by 0
1 more
- 2026Distributional Active Inferencecited by 0
- 2026Distributional Active Inference28 Jan 2026
- 2025Stochastic Path Planning in Correlated Obstacle Fields23 Sep 2025
- 2025Optimal Transport-Guided Safety in Temporal Difference Reinforcement Learning22 Feb 2025
- 2024A unified uncertainty-aware exploration: Combining epistemic and aleatory uncertainty5 Jan 2024
- 2023Pitfall of Optimism: Distributional Reinforcement Learning by Randomizing Risk Criterion25 Oct 2023
- 2023DRL-ORA: Distributional Reinforcement Learning with Online Risk Adaption8 Oct 2023
- 2023Bag of Policies for Distributional Deep Exploration3 Aug 2023
- 2023Exploration via Epistemic Value Estimation7 Mar 2023
- 2022Exploration in Deep Reinforcement Learning: A Survey2 May 2022
- 2022Exploration with Multi-Sample Target Values for Distributional Reinforcement Learning6 Feb 2022
- 2021Intrinsic Benefits of Categorical Distributional Loss: Uncertainty-aware Regularized Exploration in Reinforcement Learning7 Oct 2021
- 2021Bayesian Distributional Policy Gradients20 Mar 2021
- 2022Exploration in Deep Reinforcement Learning: A Surveycited by 158
- 2021SENTINEL: Taming Uncertainty with Ensemble-based Distributional Reinforcement Learningcited by 15
- 2021Intrinsic Benefits of Categorical Distributional Loss: Uncertainty-aware Regularized Exploration in Reinforcement Learningcited by 4
- 2023Exploration via Epistemic Value Estimationcited by 4
- 2021Bayesian Distributional Policy Gradientscited by 3
- 2023Pitfall of Optimism: Distributional Reinforcement Learning by Randomizing Risk Criterioncited by 3
- 2024A unified uncertainty-aware exploration: Combining epistemic and aleatory uncertaintycited by 2
- 2025Stochastic Path Planning in Correlated Obstacle Fieldscited by 1
- 2022Exploration with Multi-Sample Target Values for Distributional Reinforcement Learningcited by 0
- 2023Bag of Policies for Distributional Deep Explorationcited by 0
- 2023DRL-ORA: Distributional Reinforcement Learning with Online Risk Adaptioncited by 0
- 2025Optimal Transport-Guided Safety in Temporal Difference Reinforcement Learningcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Distributional Active Inference28 Jan 2026
- 2025Stochastic Path Planning in Correlated Obstacle Fields23 Sep 2025
- 2025Optimal Transport-Guided Safety in Temporal Difference Reinforcement Learning22 Feb 2025
- 2024A unified uncertainty-aware exploration: Combining epistemic and aleatory uncertainty5 Jan 2024
- 2023Pitfall of Optimism: Distributional Reinforcement Learning by Randomizing Risk Criterion25 Oct 2023
- 2023DRL-ORA: Distributional Reinforcement Learning with Online Risk Adaption8 Oct 2023
- 2023Bag of Policies for Distributional Deep Exploration3 Aug 2023
- 2023Exploration via Epistemic Value Estimation7 Mar 2023
- 2022Exploration in Deep Reinforcement Learning: A Survey2 May 2022
- 2022Exploration with Multi-Sample Target Values for Distributional Reinforcement Learning6 Feb 2022
- 2021Intrinsic Benefits of Categorical Distributional Loss: Uncertainty-aware Regularized Exploration in Reinforcement Learning7 Oct 2021
- 2021Bayesian Distributional Policy Gradients20 Mar 2021
12 newest of 13 All 13 (JSON)