ManeuverGPT Agentic Control for Safe Autonomous Stunt Maneuvers
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
The next generation of active safety features in autonomous vehicles should be capable of safely executing evasive hazard-avoidance maneuvers akin to those performed by professional stunt drivers to achieve high-agility motion at the limits of vehicle handling. This paper presents a novel framework, ManeuverGPT, for generating and executing high-dynamic stunt maneuvers in autonomous vehicles using large language model (LLM)-based agents as controllers. We target aggressive maneuvers, such as J-turns, within the CARLA simulation environment and demonstrate an iterative, prompt-based approach to refine vehicle control parameters, starting tabula rasa without retraining model weights. We propose an agentic architecture comprised of three specialized agents (1) a Query Enricher Agent for contextualizing user commands, (2) a Driver Agent for generating maneuver parameters, and (3) a Parameter Validator Agent that enforces physics-based and safety constraints. Experimental results demonstrate successful J-turn execution across multiple vehicle models through textual prompts that adapt to differing vehicle dynamics. We evaluate performance via established success criteria and discuss limitations regarding numeric precision and scenario complexity. Our findings underscore the potential of LLM-driven control for flexible, high-dynamic maneuvers, while highlighting the importance of hybrid approaches that combine language-based reasoning with algorithmic validation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 12 of its 25 references that are in the map. First posted on arXiv 12 Mar 2025.
Builds on
12 of 25 references.
Closest ancestors · 1
Same direction, newest first
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents18 Jan
Other references · 11
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2023LanguageMPC: Large Language Models as Decision Makers for Autonomous Drivingcited by 188
- 2023Large Language Models for Robotics: A Surveycited by 132
- 2023Self-planning Code Generation with Large Language Modelscited by 121
- 2024Asynchronous Large Language Model Enhanced Planner for Autonomous Drivingcited by 38
- 2024Verifiably Following Complex Robot Instructions with Foundation Modelscited by 15
- 2018Automated Driving Maneuvers under Interactive Environment based on Deep Reinforcement Learningcited by 4
- 2024Deep Reinforcement Learning in Autonomous Car Path Planning and Control: A Surveycited by 4
- 2024Safety Verification for Evasive Collision Avoidance in Autonomous Vehicles with Enhanced Resolutionscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Seeking to Collide: Online Safety-Critical Scenario Generation for Autonomous Driving with Retrieval Augmented Large Language Models
- 2024ChatScene: Knowledge-Enabled Safety-Critical Scenario Generation for Autonomous Vehicles
- 2026PlannerForge: LLM Agents for Scenario-Based Testing of Motion Planners in Autonomous Driving
- 2026AnchorDrive: LLM Scenario Rollout with Anchor-Guided Diffusion Regeneration for Safety-Critical Scenario Generation
- 2025AgentSpec: Customizable Runtime Enforcement for Safe and Reliable LLM Agents
- 2025Do LLM Modules Generalize? A Study on Motion Generation for Autonomous Driving
- 2025Exploring GPT-4 for Robotic Agent Strategy with Real-Time State Feedback and a Reactive Behaviour Framework
- 2025Plan-R1: Safe and Feasible Trajectory Planning as Language Modeling