mlsanityData to 14 Oct 2026

Learning to Understand Body Language from Flight through Robust 3D Avatar Placing

arXiv 2607.27865 ↗First posted 30 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Perceiving human motion and intent at long range is a prerequisite for socially intelligent aerial robots, yet the data to learn it barely exists. We introduce Drones2BodyLanguage, a dataset grounding human motion in real UAV footage: avatars manifesting ten communicative intents are placed into unmodified 4K drone scenes with metrically correct position, scale and orientation, maintained over hundreds of frames of camera motion. Enabling it is a lightweight geometric world model of the local scene - semantically selected anchors lifted to 3D through streaming monocular depth - in which a placement point is predicted as an affine anchor combination with provably rigid-invariant weights, and re-rendered under an SVD-fitted ground rotation. Across twelve architectures on scene- and motion-disjoint splits, training on placed data lifts mean intent accuracy by a wide margin for real, retargeted and generated motion alike, with gains confirmed on two in-the-wild scenes.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 32 references that are in the map. First posted on arXiv 30 Jul 2026.

Builds on

24 of 32 references.

References · 24

  1. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  2. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  3. 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,209
  4. 2025SAM 3: Segment Anything with Conceptscited by 906
  5. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
  6. 2019NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understandingcited by 533
  7. 2023CoTracker: It is Better to Track Togethercited by 522
  8. 2017Learning from Synthetic Humanscited by 359
  9. 2021Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action Recognitioncited by 322
  10. 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 287
  11. 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 228
  12. 2017Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detectioncited by 209
12 more
  1. 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 181
  2. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 168
  3. 2019DoveNet: Deep Image Harmonization via Domain Verificationcited by 135
  4. 2018ST-GAN: Spatial Transformer Generative Adversarial Networks for Image Compositingcited by 90
  5. 2025SpatialTrackerV2: 3D Point Tracking Made Easycited by 87
  6. 2025TAPIP3D: Tracking Any Point in Persistent 3D Geometrycited by 69
  7. 2019Learning to Generate Synthetic Data via Compositingcited by 52
  8. 2026Kimodo: Scaling Controllable Human Motion Generationcited by 37
  9. 2021OPA: Object Placement Assessment Datasetcited by 28
  10. 2022Learning Object Placement via Dual-path Graph Completioncited by 20
  11. 2023TopNet: Transformer-based Object Placement Network for Image Compositingcited by 16
  12. 2026Non-verbal Real-time Human-AI Interaction in Constrained Robotic Environmentscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025AirCopBench: A Benchmark for Multi-drone Collaborative Embodied Perception and Reasoning
  2. 2025Agentic Aerial Cinematography: From Dialogue Cues to Cinematic Trajectories
  3. 2026ActiveFly-Bench: Aligning Embodied Question Answering with Vision-Language-Action for Aerial Embodied Perception
  4. 2026Memory-Augmented Multimodal Large Language Models for Small Object Understanding in Streaming Aerial Videos
  5. 2024AeroVerse: UAV-Agent Benchmark Suite for Simulating, Pre-training, Finetuning, and Evaluating Aerospace Embodied World Models
  6. 2026AeroGround: A Comprehensive Benchmark for Aerial-Ground Collaborative Reasoning
  7. 2026HoverAI: An Embodied Aerial Agent for Natural Human-Drone Interaction
  8. 2026From Local Whole-Body VLA Behaviors to Scene-Scale Aerial Manipulation