# From Local Whole-Body VLA Behaviors to Scene-Scale Aerial Manipulation

arXiv: https://arxiv.org/abs/2609.39670 · HTML: https://mlsanity.com/paper/2609.39670/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Placed in Aerial and drone VLA, one of 13 directions in Vision-language-action models.
- Builds on 24 of its 26 references that are in the map.
- First posted on arXiv 30 Sep 2026.

## Placed in

- Vision-language-action models / [Aerial and drone VLA](https://mlsanity.com/vla/aerial-and-drone-vla/)

## Builds on (most cited first, 24 of 24)

- [RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control](https://mlsanity.com/paper/2307.15818/) (2023)
- [OpenVLA: An Open-Source Vision-Language-Action Model](https://mlsanity.com/paper/2406.09246/) (2024)
- [π0.5: a Vision-Language-Action Model with Open-World Generalization](https://mlsanity.com/paper/2504.16054/) (2025)
- [ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planning](https://mlsanity.com/paper/2309.16650/) (2023)
- [SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planning](https://mlsanity.com/paper/2307.06135/) (2023)
- [Real-Time Execution of Action Chunking Flow Policies](https://mlsanity.com/paper/2506.07339/) (2025)
- [Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigation](https://mlsanity.com/paper/2403.17846/) (2024)
- [Dynamic Open-Vocabulary 3D Scene Graphs for Long-term Language-Guided Mobile Manipulation](https://mlsanity.com/paper/2410.11989/) (2024)
- [GS-Planner: A Gaussian-Splatting-based Planning Framework for Active High-Fidelity Reconstruction](https://mlsanity.com/paper/2405.10142/) (2024)
- [Real-Time Robot Execution with Masked Action Chunking](https://mlsanity.com/paper/2601.20130/) (2026)
- [Geometrically Constrained Trajectory Optimization for Multicopters](https://mlsanity.com/paper/2103.00190/) (2021)
- [AutoFly: Vision-Language-Action Model for UAV Autonomous Navigation in the Wild](https://mlsanity.com/paper/2602.09657/) (2026)
- [UMI-on-Air: Embodiment-Aware Guidance for Embodiment-Agnostic Visuomotor Policies](https://mlsanity.com/paper/2510.02614/) (2025)
- [FutureRTC: Real-Time Robot Execution with Anticipatory-Conditioned Action Chunking](https://mlsanity.com/paper/2607.24008/) (2026)
- [Flying Hand: End-Effector-Centric Framework for Versatile Aerial Manipulation Teleoperation and Policy Learning](https://mlsanity.com/paper/2504.10334/) (2025)
- [π, But Make It Fly: Physics-Guided Transfer of VLA Models to Aerial Manipulation](https://mlsanity.com/paper/2603.25038/) (2026)
- [AIR-VLA: Vision-Language-Action Systems for Aerial Manipulation](https://mlsanity.com/paper/2601.21602/) (2026)
- [Whole-Body Integrated Motion Planning for Aerial Manipulators](https://mlsanity.com/paper/2501.06493/) (2025)
- [USS-Nav: Unified Spatio-Semantic Scene Graph for Lightweight UAV Zero-Shot Object Navigation](https://mlsanity.com/paper/2602.00708/) (2026)
- [FLOAT Drone: A Fully-actuated Coaxial Aerial Robot for Close-Proximity Operations](https://mlsanity.com/paper/2503.00785/) (2025)
- [From Sketch Prior to Trajectories: A Mission-Oriented Coordinated Navigation Framework for Indoor UAV Swarm](https://mlsanity.com/paper/2607.11386/) (2026)
- [Effector-Centric NMPC of Tiltable-Multirotors for Offset-Free Omnidirectional Aerial Manipulation](https://mlsanity.com/paper/2608.17819/) (2026)
- [DuctAM: A Duct-Assisted Quadrotor-Based Aerial Manipulator Enabling High-Force Push-and-Pull Interactions](https://mlsanity.com/paper/2609.15861/) (2026)
- [QuadHand: A Compact Quadrotor Aerial Manipulator with MRC-SDF-Based Whole-Body Motion Planning](https://mlsanity.com/paper/2609.35094/) (2026)

## Abstract (arXiv)

Vision-language-action (VLA) models enable task-conditioned interaction, but extending them to scene-scale aerial manipulation remains challenging due to costly whole-body demonstrations, latency-induced action-state misalignment, and cross-site behavior composition. We present a unified framework for synthetic policy training and scene-scale execution on articulated uncrewed aerial manipulators (UAMs). A scene-reconfigurable pipeline synthesizes task-conditioned, kinodynamically feasible trajectories and synchronized multiview observations for VLA training without physical-platform demonstrations. Measured-progress-aligned realization (MPAR) aligns asynchronously returned action chunks with measured execution progress and realizes them as continuous, dynamically feasible trajectories. A relational Scene Graph grounds language goals to object instances and feasible interaction regions, while topology-guided transfer connects local behaviors across sites. Local VLA skills achieve 39/60 successes (65.0%) in simulation under oracle target and feasible-handoff conditions. Under 500-ms added latency, with and without a transient command-update stall, MPAR reduces median takeover phase error by 0.212 s over nominal-time alignment. The complete system completes 21/50 simulated multi-site missions (42.0%) and is further validated on a physical articulated UAM.
