DAWN: Noise-Robust Quadruped Parkour via Depth-Denoising World Models
New in World models; no direction yet. World models
Abstract (arXiv)
Vision-based legged locomotion methods assume clean depth at training time and rely on hand-tuned post-processing filters at deployment. However, filter parameters are rarely disclosed, hindering reproducibility, and performance degrades substantially when depth noise is left unaddressed. Building noise robustness directly into the learning pipeline would eliminate this dependency. While such robustness has been explored for proprioceptive inputs, analogous approaches for depth perception remain largely absent in legged locomotion. We propose DAWN (Denoising and Alignment in World models for Noise-robustness), a noise-robust perception framework for legged locomotion, which builds noise robustness directly into a world model via two modifications: (1) feeding noisy depth to the encoder while keeping clean depth as the reconstruction target, forcing the model to implicitly denoise its input; and (2) applying contrastive learning to align the latent states of noisy and clean depth. Importantly, DAWN is not tied to a specific noise model, requiring no manual tuning to the noise distribution at deployment. Furthermore, it incurs no additional inference cost over existing world model-based methods. Without any manual filter calibration -- relying solely on the learned noise-robust representation -- DAWN achieves zero-shot quadruped parkour on a Unitree Go1: traversing stairs up to 18 cm, clearing gaps up to 70 cm, and mounting steps up to 45 cm from raw depth observations. Ablation studies show that denoising and contrastive alignment contribute at complementary levels -- reconstruction and representation, respectively -- and yield additive gains when combined. Videos and code are available at: https://dawn-parkour.github.io/
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 36 of its 41 references that are in the map. First posted on arXiv 24 Sep 2026.
Builds on
36 of 41 references.
References · 36
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2018World Modelscited by 1,444
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
- 2023Mastering Diverse Domains through World Modelscited by 1,193
- 2020Mastering Atari with Discrete World Modelscited by 990
- 2020CURL: Contrastive Unsupervised Representations for Reinforcement Learningcited by 745
24 more
- 2019Solving Rubik's Cube with a Robot Handcited by 699
- 2020Learning Quadrupedal Locomotion over Challenging Terraincited by 494
- 2020Reinforcement Learning with Augmented Datacited by 452
- 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 430
- 2019Learning agile and dynamic motor skills for legged robotscited by 402
- 2022DayDreamer: World Models for Physical Robot Learningcited by 372
- 2019Learning by Cheatingcited by 361
- 2022Learning robust perceptive locomotion for quadrupedal robots in the wildcited by 299
- 2018Sim-to-Real: Learning Agile Locomotion For Quadruped Robotscited by 277
- 2022Legged Locomotion in Challenging Terrains using Egocentric Visioncited by 131
- 2023Extreme Parkour with Legged Robotscited by 120
- 2023Robot Parkour Learningcited by 115
- 2023ANYmal Parkour: Learning Agile Navigation for Quadrupedal Robotscited by 105
- 2017Intel RealSense Stereoscopic Depth Camerascited by 82
- 2024Humanoid Parkour Learningcited by 66
- 2024Advancing Humanoid Locomotion: Mastering Challenging Terrains with Denoising World Model Learningcited by 38
- 2022Deep Depth Completion from Extremely Sparse Data: A Surveycited by 33
- 2024World Model-based Perception for Visual Legged Locomotioncited by 17
- 2025Learning Humanoid Locomotion with World Model Reconstructioncited by 10
- 2025DPL: Depth-only Perceptive Humanoid Locomotion via Realistic Depth Synthesis and Cross-Attention Terrain Reconstructioncited by 7
- 2024RaSim: A Range-aware High-fidelity RGB-D Data Simulation Pipeline for Real-world Applicationscited by 5
- 2025TAR: Teacher-Aligned Representations via Contrastive Learning for Quadrupedal Locomotioncited by 3
- 2025Contrastive Representation Learning for Robust Sim-to-Real Transfer of Adaptive Humanoid Locomotioncited by 2
- 2026Now You See That: Learning End-to-End Humanoid Locomotion from Raw Pixelscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026CAP: Continuously Adaptive Perception-Blind Humanoid Locomotion via Learned Denoising
- 2026REAL: Robust Extreme Agility via Spatio-Temporal Policy Learning and Physics-Guided Filtering
- 2026World-Model-Augmented Visual Locomotion for Humanoids on Foothold-Constrained Terrain
- 2025Learning Perceptive Humanoid Locomotion over Challenging Terrain
- 2025DreamPolicy: A Unified World-model Policy for Scalable Humanoid Locomotion
- 2026SWAP: Symmetric Equivariant World-Model for Agile Robot Parkour
- 2026Hiking in the Wild: A Scalable Perceptive Parkour Framework for Humanoids
- 2026MulDP: Multimodal Diffusion Policy for Autonomous Quadruped Parkour Navigation across Complex Terrains