mlsanityData to 7 Oct 2026

SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Control

arXiv 2511.07820 ↗First posted 11 Nov 2025cs.RO cs.AI cs.CVcited by 83

Not on the map. Why?

Abstract (arXiv)

Despite the rise of billion-parameter foundation models trained across thousands of graphical processing units (GPUs), similar scaling gains have not been shown for humanoid control. Current neural controllers for humanoids remain modest in size, target a limited set of behaviors, and are trained on a handful of GPUs. We show that scaling model capacity, data, and compute yields a generalist humanoid controller capable of natural, robust whole-body movements. We position motion tracking as a scalable task for humanoid control, leveraging dense supervision from diverse motion-capture data to acquire human motion priors without manual reward engineering. We build a foundation model for motion tracking by scaling along three axes: network size (1.2M to 42M parameters), dataset volume (100M+ frames from 700 hours of motion capture), and compute (21k GPU hours). Beyond demonstrating the benefits of scale, we further show downstream utility through a real-time kinematic planner that bridges motion tracking to tasks such as navigation, enabling natural and interactive control, as well as a unified token space that supports virtual reality (VR) teleoperation and vision-language-action (VLA) models with a single policy. Through this interface, we demonstrate autonomous VLA-driven whole-body loco-manipulation requiring coordinated hand and foot placement. Scaling motion tracking exhibits favorable properties: performance improves steadily with compute and data diversity, and learned policies generalize to unseen motions, establishing motion tracking at scale as a practical foundation for humanoid control.

Key facts. Cited by 83 papers in the map (data through 7 Oct 2026). Builds on 56 of its 80 references that are in the map. First posted on arXiv 11 Nov 2025.

Builds on

56 of 80 references.

References · 56

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2017Proximal Policy Optimization Algorithmscited by 14,441
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  5. 2020Scaling Laws for Neural Language Modelscited by 6,411
  6. 2017Neural Discrete Representation Learningcited by 4,650
  7. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  8. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  9. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  10. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  11. 2022Emergent Abilities of Large Language Modelscited by 2,483
  12. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
38 more
  1. 2022Video Diffusion Modelscited by 2,280
  2. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  3. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  4. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  5. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  6. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  7. 2022Human Motion Diffusion Modelcited by 1,062
  8. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  9. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
  10. 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 615
  11. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
  12. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
  13. 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 425
  14. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
  15. 2022MAGVIT: Masked Generative Video Transformercited by 341
  16. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
  17. 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 210
  18. 2017Asymmetric Actor Critic for Image-Based Robot Learningcited by 202
  19. 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 198
  20. 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 167
  21. 2024Open-MAGVIT2: An Open-Source Project Toward Democratizing Auto-regressive Visual Generationcited by 153
  22. 2023MMM: Generative Masked Motion Modelcited by 129
  23. 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 128
  24. 2023Universal Humanoid Motion Representations for Physics-Based Controlcited by 109
  25. 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 104
  26. 2024MaskedMimic: Unified Physics-Based Character Control Through Masked Motion Inpaintingcited by 101
  27. 2023CALM: Conditional Adversarial Latent Models for Directable Virtual Characterscited by 91
  28. 2025TWIST: Teleoperated Whole-Body Imitation Systemcited by 86
  29. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 78
  30. 2024HOVER: Versatile Neural Whole-Body Controller for Humanoid Robotscited by 76
  31. 2025GMT: General Motion Tracking for Humanoid Whole-Body Controlcited by 72
  32. 2025HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpitcited by 65
  33. 2025Retargeting Matters: General Motion Retargeting for Humanoid Motion Trackingcited by 60
  34. 2025AMO: Adaptive Motion Optimization for Hyper-Dexterous Humanoid Whole-Body Controlcited by 47
  35. 2025GENMO: A GENeralist Model for Human MOtioncited by 43
  36. 2020UniCon: Universal Neural Controller For Physics-based Character Motioncited by 39
  37. 2025Learning Humanoid Standing-up Control across Diverse Posturescited by 34
  38. 2025UniTracker: Learning Universal Whole-Body Motion Tracker for Humanoid Robotscited by 34

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 80.

83 papers.

Sort:

By area:

  1. 2026Kimodo: Scaling Controllable Human Motion Generationcited by 33
  2. 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Controlcited by 14
  3. 2025Opening the Sim-to-Real Door for Humanoid Pixel-to-Action Policy Transfercited by 13
  4. 2026Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matchingcited by 13
  5. 2026Hiking in the Wild: A Scalable Perceptive Parkour Framework for Humanoidscited by 11
  6. 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrationscited by 11
  7. 2026FRoM-W1: Towards General Humanoid Whole-Body Control with Language Instructionscited by 10
  8. 2026HEX: Humanoid-Aligned Experts for Cross-Embodiment Whole-Body Manipulationcited by 10
  9. 2026ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulationcited by 9
  10. 2026HoloMotion-1 Technical Reportcited by 8
  11. 2026MotionWAM: Towards Foundation World Action Models for Real-Time Humanoid Loco-Manipulationcited by 8
  12. 2026Learning Dexterous Manipulation Using Contact Wrench Guidance From Human Demonstrationcited by 6
38 more
  1. 2025CHIP: Adaptive Compliance for Humanoid Control through Hindsight Perturbationcited by 5
  2. 2026MeshMimic: Geometry-Aware Humanoid Motion Learning through 3D Scene Reconstructioncited by 5
  3. 2026ZeroWBC: Learning Natural Whole-Body Humanoid Interaction from Human Egocentric Datacited by 5
  4. 2026Heracles: Bridging Precise Tracking and Generative Synthesis for General Humanoid Controlcited by 5
  5. 2026MotionBricks: Scalable Real-Time Motions with Modular Latent Generative Model and Smart Primitivescited by 5
  6. 2026ω-0: A Latent Predictive World Action Model for Concurrent Humanoid Loco-Manipulationcited by 5
  7. 2025Coordinated Humanoid Manipulation with Choice Policiescited by 4
  8. 2026ZEST: Zero-shot Embodied Skill Transfer for Athletic Robot Controlcited by 4
  9. 2026Fast SAM 3D Body: Accelerating SAM 3D Body for Real-Time Full-Body Human Mesh Recoverycited by 4
  10. 2026SCRIPT: Scalable Diffusion Policy with Multi-stage Training for Language-driven Physics-Based Humanoid Controlcited by 4
  11. 2026Humanoid-GPT: Scaling Data and Structure for Zero-Shot Motion Trackingcited by 4
  12. 2026OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulationcited by 4
  13. 2026SceneBot: Contact-Prompted General Humanoid Whole Body Tracking with Scene-Interactioncited by 4
  14. 2026HAIC: Humanoid Agile Object Interaction Control via Dynamics-Aware World Modelcited by 3
  15. 2026SafeFlow: Real-Time Text-Driven Humanoid Whole-Body Control via Physics-Guided Rectified Flow and Selective Safety Gatingcited by 3
  16. 2026TEXEDO : Test Time Scaling for Controller-aware Language-conditioned Humanoid Motion Generationcited by 3
  17. 2026REFINE-DP: Diffusion Policy Fine-tuning for Humanoid Loco-manipulation via Reinforcement Learningcited by 2
  18. 2026PhyGile: Physics-Prefix Guided Motion Generation for Agile General Humanoid Motion Trackingcited by 2
  19. 2026Imagine2Real: Towards Zero-shot Humanoid-Object Interaction via Video Generative Priorscited by 2
  20. 2026VLK: Learning Humanoid Loco-Manipulation from Synthetic Interactions in Reconstructed Scenescited by 2
  21. 2026Scaling Behavior Foundation Model for Humanoid Robotscited by 2
  22. 2026PAC-MAN: Perception-Aware CBF-RL for Whole-Body Safety in Humanoid Dodgeballcited by 2
  23. 2026PhysMoDPO: Physically-Plausible Humanoid Motion with Preference Optimizationcited by 1
  24. 2026DreamControl-v2: Simpler and Scalable Autonomous Humanoid Skills via Trainable Guided Diffusion Priorscited by 1
  25. 2026HumanoidMimicGen: Data Generation for Loco-Manipulation via Whole-Body Planningcited by 1
  26. 2026HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memorycited by 1
  27. 2026PressMimic: Pressure-Guided Motion Capture and Control for Humanoid Robot Imitationcited by 1
  28. 2026ReactiveBFM: Reactive Closed-Loop Motion Planning Towards Universal Humanoid Whole-Body Controlcited by 1
  29. 2026GenTrack: Physical Alignment for Robot-Native Motion Generation and Zero-Shot Humanoid Trackingcited by 1
  30. 2026Self-Evolving AI for Humanoids: Mechanisms, Safety, and Evaluation of Post-Deployment Self-Improvementcited by 1
  31. 2026Rolling-WAM: World Action Models with Rolling Imaginationcited by 1
  32. 2026EgoActor: Grounding Task Planning into Spatial-aware Egocentric Actions for Humanoid Robots via Visual-Language Modelscited by 0
  33. 2026Coupled Local and Global World Models for Efficient First Order RLcited by 0
  34. 2026HERO: Learning Humanoid End-Effector Control for Visual Whole-Body Open-Vocabulary Object Graspingcited by 0
  35. 2026CRAFT: A Tendon-Driven Hand with Hybrid Hard-Soft Compliancecited by 0
  36. 2026Any2Any: Efficient Cross-Embodiment Transfer for Humanoid Whole-Body Trackingcited by 0
  37. 2026HOIST: Humanoid Optimization with Imitation and Sample-efficient Tuning for Manipulating Suspended Loadscited by 0
  38. 2026LEGS: Fine-Tuning Teleop-Free VLAs for Humanoid Loco-manipulation in an Embodied Gaussian Splatting Worldcited by 0

50 most cited of 83 All 83 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025KungfuBot2: Learning Versatile Motion Skills for Humanoid Whole-Body Control
  2. 2026PASSAGE: Scaling Scene-Aligned Motion Learning for Perceptive Humanoid Traversal in Cluttered Environments ↗
  3. 2026OmniTrack: General Motion Tracking via Physics-Consistent Reference
  4. 2024Hierarchical World Models as Visual Whole-Body Humanoid Controllers
  5. 2026KPI: A Promptable Kernel for Physical Interaction on Humanoids ↗
  6. 2026InterMimicGen: Scaling Humanoid Loco-Manipulation through Self-Evolving Motion Imitation
  7. 2026OmniXtreme: Breaking the Generality Barrier in High-Dynamic Humanoid Control
  8. 2025TWIST2: Scalable, Portable, and Holistic Humanoid Data Collection System