DreamerV3-XP: Optimizing exploration through uncertainty estimation
Not on the map. Why?
Abstract (arXiv)
We introduce DreamerV3-XP, an extension of DreamerV3 that improves exploration and learning efficiency. This includes (i) a prioritized replay buffer, scoring trajectories by return, reconstruction loss, and value error and (ii) an intrinsic reward based on disagreement over predicted environment rewards from an ensemble of world models. DreamerV3-XP is evaluated on a subset of Atari100k and DeepMind Control Visual Benchmark tasks, confirming the original DreamerV3 results and showing that our extensions lead to faster learning and lower dynamics model loss, particularly in sparse-reward settings.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 8 of its 10 references that are in the map. First posted on arXiv 24 Oct 2025.
Builds on
8 of 10 references.
References · 8
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,194
- 2015Prioritized Experience Replaycited by 1,099
- 2020Planning to Explore via Self-Supervised World Modelscited by 368
- 2023Curious Replay for Model-based Adaptationcited by 16
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Task-Aware Exploration via a Predictive Bisimulation Metric
- 2025Beyond Noisy-TVs: Noise-Robust Exploration Via Learning Progress Monitoring
- 2025Uncertainty Prioritized Experience Replay
- 2026Integrating Novelty and Surprise for Experience Prioritization and Exploration in Image-Based Reinforcement Learning
- 2025Learning to Explore in Diverse Reward Settings via Temporal-Difference-Error Maximization
- 2025Exploration with Foundation Models: Capabilities, Limitations, and Hybrid Approaches
- 2020Mastering Atari with Discrete World Models
- 2020Learning to Plan Optimistically: Uncertainty-Guided Deep Exploration via Latent Model Ensembles