mlsanityData to 14 Oct 2026

Virtual avatar generation models as world navigators

arXiv 2406.01056 ↗First posted 3 Jun 2024cs.CV cs.AI cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce SABR-CLIMB, a novel video model simulating human movement in rock climbing environments using a virtual avatar. Our diffusion transformer predicts the sample instead of noise in each diffusion step and ingests entire videos to output complete motion sequences. By leveraging a large proprietary dataset, NAV-22M, and substantial computational resources, we showcase a proof of concept for a system to train general-purpose virtual avatars for complex tasks in robotics, sports, and healthcare.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 10 references that are in the map. First posted on arXiv 3 Jun 2024.

Builds on

8 of 10 references.

References · 8

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  5. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
  6. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  7. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  8. 2024MoST: Multi-modality Scene Tokenization for Motion Predictioncited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024VLOGGER: Multimodal Diffusion for Embodied Avatar Synthesis
  2. 2024Make-Your-Anchor: A Diffusion-based 2D Avatar Generation Framework
  3. 2024AMG: Avatar Motion Guided Video Generation
  4. 2025Hyper Diffusion Avatars: Dynamic Human Avatar Generation using Network Weight Space Diffusion
  5. 2024CyberHost: Taming Audio-driven Avatar Diffusion Model with Region Codebook Attention
  6. 2024Report on Methods and Applications for Crafting 3D Humans ↗
  7. 2023Dancing Avatar: Pose and Text-Guided Human Motion Videos Synthesis with Image Diffusion Model
  8. 2025MVP4D: Multi-View Portrait Video Diffusion for Animatable 4D Avatars