AirSim360: A Panoramic Simulation Platform within Drone View
Not on the map. Why?
Abstract (arXiv)
The field of 360-degree omnidirectional understanding has been receiving increasing attention for advancing spatial intelligence. However, the lack of large-scale and diverse data remains a major limitation. In this work, we propose AirSim360, a simulation platform for omnidirectional data from aerial viewpoints, enabling wide-ranging scene sampling with drones. Specifically, AirSim360 focuses on three key aspects: a render-aligned data and labeling paradigm for pixel-level geometric, semantic, and entity-level understanding; an interactive pedestrian-aware system for modeling human behavior; and an automated trajectory generation paradigm to support navigation tasks. Furthermore, we collect more than 60K panoramic samples and conduct extensive experiments across various tasks to demonstrate the effectiveness of our simulator. Unlike existing simulators, our work is the first to systematically model the 4D real world under an omnidirectional setting. The entire platform, including the toolkit, plugins, and collected datasets, will be made publicly available at https://insta360-research-team.github.io/AirSim360-website.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 33 of its 59 references that are in the map. First posted on arXiv 1 Dec 2025.
Builds on
33 of 59 references.
References · 33
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,069
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 523
- 2017Joint 2D-3D-Semantic Data for Indoor Scene Understandingcited by 406
- 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robotscited by 228
- 2022A Self-Supervised Descriptor for Image Copy Detectioncited by 176
- 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 148
21 more
- 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 121
- 2018Mapping Instructions to Actions in 3D Environments with Visual Goal Predictioncited by 101
- 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 95
- 2022High-Quality Entity Segmentationcited by 93
- 2021Open-World Entity Segmentationcited by 74
- 2025A Survey on Vision-Language-Action Models for Autonomous Drivingcited by 72
- 2019Deep Sky Modeling for Single Image Outdoor Lighting Estimationcited by 66
- 2021Capturing Omni-Range Context for Omnidirectional Segmentationcited by 50
- 2022Aerial Vision-and-Dialog Navigationcited by 49
- 2025Openfly: A comprehensive platform for aerial vision-language navigationcited by 46
- 2017Predicting Head Movement in Panoramic Video: A Deep Reinforcement Learning Approachcited by 34
- 2025UAVScenes: A Multi-Modal Dataset for UAVscited by 27
- 2019360-Indoor: Towards Learning Real-World Objects in 360deg Indoor Equirectangular Imagescited by 26
- 2024UnrealZoo: Enriching Photo-realistic Virtual Worlds for Embodied AIcited by 25
- 2025One Flight Over the Gap: A Survey from Perspective to Panoramic Visioncited by 25
- 2025DiT360: High-Fidelity Panoramic Image Generation via Hybrid Trainingcited by 24
- 2024Open Panoramic Segmentationcited by 17
- 2023Cosys-AirSim: A Real-Time Simulation Framework Expanded for Complex Industrial Applicationscited by 8
- 2023FreeMan: Towards Benchmarking 3D Human Pose Estimation under Real-World Conditionscited by 7
- 2020Perceiving Humans: from Monocular 3D Localization to Social Distancingcited by 6
- 2025Pushing the Boundaries of Immersion and Storytelling: A Technical Review of Unreal Enginecited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 11.
12 papers.
- 2025Depth Any Panoramas: A Foundation Model for Panoramic Depth Estimationcited by 25
- 2026MemoBench: Benchmarking World Modeling in Dynamically Changing Environmentscited by 12
- 2026SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creationcited by 8
- 2026PanoWorld: Towards Spatial Supersensing in 360^circ Panorama Worldcited by 5
- 2026PanoWorld: Real-World Panoramic Generationcited by 5
- 2026Fly360: Omnidirectional Obstacle Avoidance within Drone Viewcited by 2
- 2026UniSHARP: Universal Sharp Monocular View Synthesiscited by 2
- 2026See-and-Reach: Precise Vision-Language Navigation for UAVs within the Field of Viewcited by 2
- 2026WorldRover: A Scalable Synthetic Video Data Engine for World Exploration with Rich Annotationscited by 2
- 2026Look Up and Look Back: Hidden Attention and Latent Orientation in a Frozen Foundation Model for Panoramic SLAMcited by 1
- 2026Zero-Shot UAV Navigation in Forests via Relightable 3D Gaussian Splattingcited by 0
- 2026Geometry and Gradient-based Partitioning for Panoramic Outdoor Reconstructioncited by 0
- 2026WorldRover: A Scalable Synthetic Video Data Engine for World Exploration with Rich Annotations16 Aug 2026
- 2026Look Up and Look Back: Hidden Attention and Latent Orientation in a Frozen Foundation Model for Panoramic SLAM2 Aug 2026
- 2026PanoWorld: Real-World Panoramic Generation10 Jul 2026
- 2026Geometry and Gradient-based Partitioning for Panoramic Outdoor Reconstruction9 Jul 2026
- 2026SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation2 Jul 2026
- 2026MemoBench: Benchmarking World Modeling in Dynamically Changing Environments25 Jun 2026
- 2026See-and-Reach: Precise Vision-Language Navigation for UAVs within the Field of View18 Jun 2026
- 2026UniSHARP: Universal Sharp Monocular View Synthesis5 Jun 2026
- 2026PanoWorld: Towards Spatial Supersensing in 360^circ Panorama World13 May 2026
- 2026Fly360: Omnidirectional Obstacle Avoidance within Drone View6 Mar 2026
- 2026Zero-Shot UAV Navigation in Forests via Relightable 3D Gaussian Splatting6 Feb 2026
- 2025Depth Any Panoramas: A Foundation Model for Panoramic Depth Estimation18 Dec 2025