mlsanityData to 7 Oct 2026

DAWN: Noise-Robust Quadruped Parkour via Depth-Denoising World Models

arXiv 2609.29092 ↗First posted 24 Sep 2026cs.RO cs.AI cs.CVcited by 1

New in World models; no direction yet. World models

Abstract (arXiv)

Vision-based legged locomotion methods assume clean depth at training time and rely on hand-tuned post-processing filters at deployment. However, filter parameters are rarely disclosed, hindering reproducibility, and performance degrades substantially when depth noise is left unaddressed. Building noise robustness directly into the learning pipeline would eliminate this dependency. While such robustness has been explored for proprioceptive inputs, analogous approaches for depth perception remain largely absent in legged locomotion. We propose DAWN (Denoising and Alignment in World models for Noise-robustness), a noise-robust perception framework for legged locomotion, which builds noise robustness directly into a world model via two modifications: (1) feeding noisy depth to the encoder while keeping clean depth as the reconstruction target, forcing the model to implicitly denoise its input; and (2) applying contrastive learning to align the latent states of noisy and clean depth. Importantly, DAWN is not tied to a specific noise model, requiring no manual tuning to the noise distribution at deployment. Furthermore, it incurs no additional inference cost over existing world model-based methods. Without any manual filter calibration -- relying solely on the learned noise-robust representation -- DAWN achieves zero-shot quadruped parkour on a Unitree Go1: traversing stairs up to 18 cm, clearing gaps up to 70 cm, and mounting steps up to 45 cm from raw depth observations. Ablation studies show that denoising and contrastive alignment contribute at complementary levels -- reconstruction and representation, respectively -- and yield additive gains when combined. Videos and code are available at: https://dawn-parkour.github.io/

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 36 of its 41 references that are in the map. First posted on arXiv 24 Sep 2026.

Builds on

36 of 41 references.

References · 36

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  5. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  6. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  7. 2018World Modelscited by 1,444
  8. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
  9. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
  10. 2023Mastering Diverse Domains through World Modelscited by 1,193
  11. 2020Mastering Atari with Discrete World Modelscited by 990
  12. 2020CURL: Contrastive Unsupervised Representations for Reinforcement Learningcited by 745
24 more
  1. 2019Solving Rubik's Cube with a Robot Handcited by 699
  2. 2020Learning Quadrupedal Locomotion over Challenging Terraincited by 494
  3. 2020Reinforcement Learning with Augmented Datacited by 452
  4. 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 430
  5. 2019Learning agile and dynamic motor skills for legged robotscited by 402
  6. 2022DayDreamer: World Models for Physical Robot Learningcited by 372
  7. 2019Learning by Cheatingcited by 361
  8. 2022Learning robust perceptive locomotion for quadrupedal robots in the wildcited by 299
  9. 2018Sim-to-Real: Learning Agile Locomotion For Quadruped Robotscited by 277
  10. 2022Legged Locomotion in Challenging Terrains using Egocentric Visioncited by 131
  11. 2023Extreme Parkour with Legged Robotscited by 120
  12. 2023Robot Parkour Learningcited by 115
  13. 2023ANYmal Parkour: Learning Agile Navigation for Quadrupedal Robotscited by 105
  14. 2017Intel RealSense Stereoscopic Depth Camerascited by 82
  15. 2024Humanoid Parkour Learningcited by 66
  16. 2024Advancing Humanoid Locomotion: Mastering Challenging Terrains with Denoising World Model Learningcited by 38
  17. 2022Deep Depth Completion from Extremely Sparse Data: A Surveycited by 33
  18. 2024World Model-based Perception for Visual Legged Locomotioncited by 17
  19. 2025Learning Humanoid Locomotion with World Model Reconstructioncited by 10
  20. 2025DPL: Depth-only Perceptive Humanoid Locomotion via Realistic Depth Synthesis and Cross-Attention Terrain Reconstructioncited by 7
  21. 2024RaSim: A Range-aware High-fidelity RGB-D Data Simulation Pipeline for Real-world Applicationscited by 5
  22. 2025TAR: Teacher-Aligned Representations via Contrastive Learning for Quadrupedal Locomotioncited by 3
  23. 2025Contrastive Representation Learning for Robust Sim-to-Real Transfer of Adaptive Humanoid Locomotioncited by 2
  24. 2026Now You See That: Learning End-to-End Humanoid Locomotion from Raw Pixelscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026CAP: Continuously Adaptive Perception-Blind Humanoid Locomotion via Learned Denoising
  2. 2026REAL: Robust Extreme Agility via Spatio-Temporal Policy Learning and Physics-Guided Filtering
  3. 2026World-Model-Augmented Visual Locomotion for Humanoids on Foothold-Constrained Terrain
  4. 2025Learning Perceptive Humanoid Locomotion over Challenging Terrain
  5. 2025DreamPolicy: A Unified World-model Policy for Scalable Humanoid Locomotion
  6. 2026SWAP: Symmetric Equivariant World-Model for Agile Robot Parkour
  7. 2026Hiking in the Wild: A Scalable Perceptive Parkour Framework for Humanoids
  8. 2026MulDP: Multimodal Diffusion Policy for Autonomous Quadruped Parkour Navigation across Complex Terrains