CARLA-Air: Fly Drones Inside a CARLA World -- A Unified Infrastructure for Air-Ground Embodied Intelligence
Not on the map. Why?
Abstract (arXiv)
The convergence of low-altitude economies, embodied intelligence, and air-ground cooperative systems creates growing demand for simulation infrastructure capable of jointly modeling aerial and ground agents within a single physically coherent environment. Existing open-source platforms remain domain-segregated: driving simulators lack aerial dynamics, while multirotor simulators lack realistic ground scenes. Bridge-based co-simulation introduces synchronization overhead and cannot guarantee strict spatial-temporal consistency. We present CARLA-Air, an open-source infrastructure that unifies high-fidelity urban driving and physics-accurate multirotor flight within a single Unreal Engine process. The platform preserves both CARLA and AirSim native Python APIs and ROS 2 interfaces, enabling zero-modification code reuse. Within a shared physics tick and rendering pipeline, CARLA-Air delivers photorealistic environments with rule-compliant traffic, socially-aware pedestrians, and aerodynamically consistent UAV dynamics, synchronously capturing up to 18 sensor modalities across all platforms at each tick. The platform supports representative air-ground embodied intelligence workloads spanning cooperation, embodied navigation and vision-language action, multi-modal perception and dataset construction, and reinforcement-learning-based policy training. An extensible asset pipeline allows integration of custom robot platforms into the shared world. By inheriting AirSim's aerial capabilities -- whose upstream development has been archived -- CARLA-Air ensures this widely adopted flight stack continues to evolve within a modern infrastructure. Released with prebuilt binaries and full source: https://github.com/louiszengCN/CarlaAir
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 13 of its 26 references that are in the map. First posted on arXiv 30 Mar 2026.
Builds on
13 of 26 references.
References · 13
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
- 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 523
- 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 511
- 2021MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learningcited by 290
- 2022Robot Operating System 2: Design, Architecture, and Uses In The Wildcited by 199
- 2020LGSVL Simulator: A High Fidelity Simulator for Autonomous Drivingcited by 121
- 2020Flightmare: A Flexible Quadrotor Simulatorcited by 84
- 2021VISTA 2.0: An Open, Data-driven Simulator for Multimodal Sensing and Policy Learning for Autonomous Vehiclescited by 81
- 2021Learning to Fly -- a Gym Environment with PyBullet Physics for Reinforcement Learning of Multi-agent Quadcopter Controlcited by 77
- 2023OmniDrones: An Efficient and Flexible Platform for Reinforcement Learning in Drone Controlcited by 33
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026CosFly-VLA: A Spatially Aware Vision-Language-Action Model for UAV Trackingcited by 1
- 2026Air-Ground Collaborative Vision-and-Language Navigation via Shared Bird's-Eye Mapscited by 1
- 2026Towards Embodied Air-Ground Cooperative Object Search: Benchmark, Dataset and Agentic Methodcited by 1
- 2026UAVs Meet Embodied Intelligence: Bridging Human Intents and Flying Dynamics Via Harnessing Physical-Digital AI Agentscited by 0
- 2026AURORA: A Natural Language-Driven Agentic Framework for Understanding, Reasoning, and Orchestrating Reliable Air-Ground Co-Simulationcited by 0
- 2026AURORA: A Natural Language-Driven Agentic Framework for Understanding, Reasoning, and Orchestrating Reliable Air-Ground Co-Simulation17 Sep 2026
- 2026UAVs Meet Embodied Intelligence: Bridging Human Intents and Flying Dynamics Via Harnessing Physical-Digital AI Agents16 Sep 2026
- 2026Towards Embodied Air-Ground Cooperative Object Search: Benchmark, Dataset and Agentic Method8 Sep 2026
- 2026Air-Ground Collaborative Vision-and-Language Navigation via Shared Bird's-Eye Maps3 Sep 2026
- 2026CosFly-VLA: A Spatially Aware Vision-Language-Action Model for UAV Tracking16 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Can Aerial VLA Models Cooperate? Evaluating Closed-Loop Air-Ground Coordination with CARLA-Air
- 2024AeroVerse: UAV-Agent Benchmark Suite for Simulating, Pre-training, Finetuning, and Evaluating Aerospace Embodied World Models
- 2025BEDI: A Comprehensive Benchmark for Evaluating Embodied Agents on UAVs
- 2025AirCopBench: A Benchmark for Multi-drone Collaborative Embodied Perception and Reasoning
- 2025AirScape: An Aerial Generative World Model with Motion Controllability
- 2026Zero-Shot Mission-Level Evaluation for Aerial MLLM Agents
- 2026HoverAI: An Embodied Aerial Agent for Natural Human-Drone Interaction
- 2026Lingjing: A Simulation Testbed for Multi-Agent Embodied Tasks in Open-Ended Cities