mlsanityData to 14 Oct 2026

CARLA-Air: Fly Drones Inside a CARLA World -- A Unified Infrastructure for Air-Ground Embodied Intelligence

arXiv 2603.28032 ↗First posted 30 Mar 2026cs.RO cs.AI cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

The convergence of low-altitude economies, embodied intelligence, and air-ground cooperative systems creates growing demand for simulation infrastructure capable of jointly modeling aerial and ground agents within a single physically coherent environment. Existing open-source platforms remain domain-segregated: driving simulators lack aerial dynamics, while multirotor simulators lack realistic ground scenes. Bridge-based co-simulation introduces synchronization overhead and cannot guarantee strict spatial-temporal consistency. We present CARLA-Air, an open-source infrastructure that unifies high-fidelity urban driving and physics-accurate multirotor flight within a single Unreal Engine process. The platform preserves both CARLA and AirSim native Python APIs and ROS 2 interfaces, enabling zero-modification code reuse. Within a shared physics tick and rendering pipeline, CARLA-Air delivers photorealistic environments with rule-compliant traffic, socially-aware pedestrians, and aerodynamically consistent UAV dynamics, synchronously capturing up to 18 sensor modalities across all platforms at each tick. The platform supports representative air-ground embodied intelligence workloads spanning cooperation, embodied navigation and vision-language action, multi-modal perception and dataset construction, and reinforcement-learning-based policy training. An extensible asset pipeline allows integration of custom robot platforms into the shared world. By inheriting AirSim's aerial capabilities -- whose upstream development has been archived -- CARLA-Air ensures this widely adopted flight stack continues to evolve within a modern infrastructure. Released with prebuilt binaries and full source: https://github.com/louiszengCN/CarlaAir

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 13 of its 26 references that are in the map. First posted on arXiv 30 Mar 2026.

Builds on

13 of 26 references.

References · 13

  1. 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
  2. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  3. 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
  4. 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 523
  5. 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 511
  6. 2021MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learningcited by 290
  7. 2022Robot Operating System 2: Design, Architecture, and Uses In The Wildcited by 199
  8. 2020LGSVL Simulator: A High Fidelity Simulator for Autonomous Drivingcited by 121
  9. 2020Flightmare: A Flexible Quadrotor Simulatorcited by 84
  10. 2021VISTA 2.0: An Open, Data-driven Simulator for Multimodal Sensing and Policy Learning for Autonomous Vehiclescited by 81
  11. 2021Learning to Fly -- a Gym Environment with PyBullet Physics for Reinforcement Learning of Multi-agent Quadcopter Controlcited by 77
  12. 2023OmniDrones: An Efficient and Flexible Platform for Reinforcement Learning in Drone Controlcited by 33
1 more
  1. 2025TranSimHub:A Unified Air-Ground Simulation Platform for Multi-Modal Perception and Decision-Makingcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Can Aerial VLA Models Cooperate? Evaluating Closed-Loop Air-Ground Coordination with CARLA-Air
  2. 2024AeroVerse: UAV-Agent Benchmark Suite for Simulating, Pre-training, Finetuning, and Evaluating Aerospace Embodied World Models
  3. 2025BEDI: A Comprehensive Benchmark for Evaluating Embodied Agents on UAVs
  4. 2025AirCopBench: A Benchmark for Multi-drone Collaborative Embodied Perception and Reasoning
  5. 2025AirScape: An Aerial Generative World Model with Motion Controllability
  6. 2026Zero-Shot Mission-Level Evaluation for Aerial MLLM Agents
  7. 2026HoverAI: An Embodied Aerial Agent for Natural Human-Drone Interaction
  8. 2026Lingjing: A Simulation Testbed for Multi-Agent Embodied Tasks in Open-Ended Cities