Sky-Drive: A Distributed Multi-Agent Simulation Platform for Human-AI Collaborative and Socially-Aware Future Transportation
On the map: End-to-end autonomous driving → Cooperative and V2X driving
also in 1 more
Abstract (arXiv)
Recent advances in autonomous system simulation platforms have significantly enhanced the safe and scalable testing of driving policies. However, existing simulators do not yet fully meet the needs of future transportation research-particularly in enabling effective human-AI collaboration and modeling socially-aware driving agents. This paper introduces Sky-Drive, a novel distributed multi-agent simulation platform that addresses these limitations through four key innovations: (a) a distributed architecture for synchronized simulation across multiple terminals; (b) a multi-modal human-in-the-loop framework integrating diverse sensors to collect rich behavioral data; (c) a human-AI collaboration mechanism supporting continuous and adaptive knowledge exchange; and (d) a digital twin framework for constructing high-fidelity virtual replicas of real-world transportation environments. Sky-Drive supports diverse applications such as autonomous vehicle-human road users interaction modeling, human-in-the-loop training, socially-aware reinforcement learning, personalized driving development, and customized scenario generation. Future extensions will incorporate foundation models for context-aware decision support and hardware-in-the-loop testing for real-world validation. By bridging scenario generation, data collection, algorithm training, and hardware integration, Sky-Drive has the potential to become a foundational platform for the next generation of human-centered and socially-aware autonomous transportation systems research. The demo video and code are available at:https://sky-lab-uw.github.io/Sky-Drive-website/
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Cooperative and V2X driving, one of 9 directions in End-to-end autonomous driving. Builds on 42 of its 90 references that are in the map. First posted on arXiv 25 Apr 2025.
Builds on
42 of 90 references.
Closest ancestors · 2
Same direction, newest first
- 2024V2X-VLM: End-to-End V2X Cooperative Autonomous Driving Through Large Vision-Language Models17 Aug
- 2023Towards Socially Responsive Autonomous Vehicles: A Reinforcement Learning Framework with Driving Priors and Coordination Awareness18 Sep
Other references · 40
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 523
- 2020Tracking Objects as Pointscited by 483
- 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Modelscited by 305
- 2021MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learningcited by 290
- 2023Waymax: An Accelerated, Data-Driven Simulator for Large-Scale Autonomous Driving Researchcited by 160
- 2016End-to-end Learning of Driving Models from Large-scale Video Datasetscited by 148
- 2020LGSVL Simulator: A High Fidelity Simulator for Autonomous Drivingcited by 121
28 more
- 2019CityFlow: A Multi-Agent Reinforcement Learning Environment for Large Scale City Traffic Scenariocited by 115
- 2024DriveArena: A Closed-loop Generative Simulation Platform for Autonomous Drivingcited by 98
- 2024ChatScene: Knowledge-Enabled Safety-Critical Scenario Generation for Autonomous Vehiclescited by 93
- 2020Uncertainty-based Traffic Accident Anticipation with Spatio-Temporal Relational Learningcited by 91
- 2024Editable Scene Simulation for Autonomous Driving via Collaborative LLM-Agentscited by 91
- 2021VISTA 2.0: An Open, Data-driven Simulator for Multimodal Sensing and Policy Learning for Autonomous Vehiclescited by 81
- 2017Flow: A Modular Learning Framework for Mixed Autonomy Trafficcited by 73
- 2024DriveCoT: Integrating Chain-of-Thought Reasoning with End-to-End Drivingcited by 67
- 2022Nocturne: a scalable driving benchmark for bringing multi-agent learning one step closer to the real worldcited by 56
- 2019Multi-Agent Connected Autonomous Driving using Deep Reinforcement Learningcited by 53
- 2019SUMMIT: A Simulator for Urban Driving in Massive Mixed Trafficcited by 40
- 2019Social Attention for Autonomous Decision-Making in Dense Trafficcited by 39
- 2023GPT-4 Enhanced Multimodal Grounding for Autonomous Driving: Leveraging Cross-Modal Attention with Large Language Modelscited by 32
- 2024HAIM-DRL: Enhanced Human-in-the-loop Reinforcement Learning for Safe and Efficient Autonomous Drivingcited by 32
- 2017Sim4CV: A Photo-Realistic Simulator for Computer Vision Applicationscited by 31
- 2022Social Interactions for Autonomous Driving: A Review and Perspectivescited by 27
- 2023Choose Your Simulator Wisely: A Review on Open-source Simulators for Autonomous Drivingcited by 26
- 2023SurrealDriver: Designing LLM-powered Generative Driver Agent Framework based on Human Drivers' Driving-thinking Datacited by 24
- 2024Event-guided Low-light Video Semantic Segmentationcited by 14
- 2025CurricuVLM: Towards Safe Autonomous Driving via Personalized Safety-Critical Curriculum Learning with Vision-Language Modelscited by 12
- 2023EPG-MGCN: Ego-Planning Guided Multi-Graph Convolutional Network for Heterogeneous Agent Trajectory Predictioncited by 10
- 2022DOROTHIE: Spoken Dialogue for Handling Unexpected Situations in Interactive Autonomous Driving Agentscited by 8
- 2024Trustworthy Human-AI Collaboration: Reinforcement Learning with Human Feedback and Physics Knowledge for Safe Autonomous Drivingcited by 8
- 2019GAMMA: A General Agent Motion Model for Autonomous Drivingcited by 7
- 2024Traffic expertise meets residual RL: Knowledge-informed model-based residual reinforcement learning for CAV trajectory controlcited by 7
- 2023A Physics Enhanced Residual Learning (PERL) Framework for Vehicle Trajectory Predictioncited by 5
- 2024GarchingSim: An Autonomous Driving Simulator with Photorealistic Scenes and Minimalist Workflowcited by 5
- 2019Human-Machine Collaborative Design for Accelerated Design of Compact Deep Neural Networks for Autonomous Drivingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Multi-Agent Embodied Autonomous Driving (MAEAD): From V2X Information Exchange to Shared World Models
- 2024Investigating Driving Interactions: A Robust Multi-Agent Simulation Framework for Autonomous Vehicles
- 2026MDrive: Benchmarking Closed-Loop Cooperative Driving for End-to-End Multi-agent Systems
- 2026CommonRoad-Game: A Human-in-the-Loop Simulation Framework for Autonomous Driving
- 2023Towards Sim2Real Transfer of Autonomy Algorithms using AutoDRIVE Ecosystem
- 2022AutoDRIVE: A Comprehensive, Flexible and Integrated Digital Twin Ecosystem for Enhancing Autonomous Driving Research and Education
- 2026Learning from Human Driving: A Human-in-the-Loop Online Behavior Cloning Framework for Autonomous Driving
- 2026From Virtual Environments to Real-World Trials: Emerging Trends in Autonomous Driving