SVBRD-LLM: Self-Verifying Behavioral Rule Discovery for Autonomous Vehicle Identification
On the map: End-to-end autonomous driving → Large language models for driving
Abstract (arXiv)
As autonomous vehicles (AVs) are increasingly deployed on public roads, understanding their real-world behaviors is critical for traffic safety analysis and regulatory oversight. However, many data-driven methods lack interpretability and cannot provide verifiable explanations of AV behavior in mixed traffic. This paper proposes SVBRD-LLM, a self-verifying behavioral rule discovery framework that automatically extracts interpretable behavioral rules from real-world traffic videos through zero-shot large language model (LLM) reasoning. The framework first derives vehicle trajectories using YOLOv26-based detection and ByteTrack-based tracking, then computes kinematic features and contextual information. It then employs GPT-5 zero-shot prompting to perform comparative behavioral analysis between AVs and human-driven vehicles (HDVs) across lane-changing and normal driving behaviors, generating 26 structured rule hypotheses that comprises both numerical thresholds and statistical behavioral patterns. These rules are subsequently evaluated through the AV identification task using an independent validation dataset, and iteratively refined through failure case analysis to filter spurious correlations and improve robustness. The resulting rule library contains 20 high-confidence behavioral rules, each including semantic description, quantitative thresholds or behavioral patterns, applicable context, and validation confidence. Experiments conducted on over 1,500 hours of real-world traffic videos from Waymo's commercial operating area demonstrate that the proposed framework achieves 90.0% accuracy and 93.3% F1-score in AV identification, with 98.0% recall. The discovered rules capture key AV traits in smoothness, conservatism, and lane discipline, informing safety assessment, regulatory compliance, and traffic management in mixed traffic. The dataset is available at: svbrd-llm-roadside-video-av.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Large language models for driving, one of 9 directions in End-to-end autonomous driving. Builds on 29 of its 59 references that are in the map. First posted on arXiv 18 Nov 2025.
Builds on
29 of 59 references.
Closest ancestors · 4
Same direction, newest first
- 2025CoT-Drive: Efficient Motion Forecasting for Autonomous Driving with LLMs and Chain-of-Thought Prompting10 Mar
- 2024Large Language Models Powered Context-aware Motion Prediction in Autonomous Driving17 Mar
- 2023LLM4Drive: A Survey of Large Language Models for Autonomous Driving2 Nov
- 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Model2 Oct
Other references · 25
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 1,017
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
- 2022Large Language Models Can Self-Improvecited by 664
- 2023MotionLM: Multi-Agent Motion Forecasting as Language Modelingcited by 156
- 2023LLMLight: Large Language Models as Traffic Signal Control Agentscited by 73
- 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 53
- 2023A Practical Survey on Zero-shot Prompt Design for In-context Learningcited by 49
- 2023TrafficGPT: Viewing, Processing and Interacting with Traffic Foundation Modelscited by 45
- 2022Two-stage LLM Fine-tuning with Less Specialization and More Generalizationcited by 41
- 2024LC-LLM: Explainable Lane-Change Intention and Trajectory Predictions with Large Language Modelscited by 35
13 more
- 2024How Interpretable are Reasoning Explanations from Prompting Large Language Models?cited by 29
- 2024Deeper Insights Without Updates: The Power of In-Context Learning Over Fine-Tuningcited by 21
- 2024Language-Driven Interactive Traffic Trajectory Generationcited by 19
- 2025RAD: Retrieval-Augmented Decision-Making of Meta-Actions with Vision-Language Models in Autonomous Drivingcited by 18
- 2025Trajectory Prediction Meets Large Language Models: A Surveycited by 14
- 2024TrajGPT: Controlled Synthetic Trajectory Generation Using a Multitask Transformer-Based Spatiotemporal Modelcited by 13
- 2022Towards Explainable Motion Prediction using Heterogeneous Graph Representationscited by 10
- 2025Characteristics Analysis of Autonomous Vehicle Pre-crash Scenarioscited by 8
- 2024Leveraging Large Language Models (LLMs) for Traffic Management at Urban Intersections: The Case of Mixed Traffic Scenarioscited by 6
- 2024Are you a robot? Detecting Autonomous Vehicles from Behavior Analysiscited by 2
- 2025Interaction Dataset of Autonomous Vehicles with Traffic Lights and Signscited by 2
- 2025Can the Waymo Open Motion Dataset Support Realistic Behavioral Modeling? A Validation Study with Naturalistic Trajectoriescited by 2
- 2025KEPT: Knowledge-Enhanced Prediction of Trajectories from Consecutive Driving Frames with Vision-Language Modelscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025LLM-based Human-like Traffic Simulation for Self-driving Tests
- 2025DriveQA: Passing the Driving Knowledge Test
- 2024Driving by the Rules: A Benchmark for Integrating Traffic Sign Regulations into Vectorized HD Map
- 2026Reasoning to Regulate: Chain-of-Thought for Traffic Rule Understanding
- 2026Towards Lawful Autonomous Driving: Deriving Scenario-Aware Driving Requirements from Traffic Laws and Regulations
- 2025Can VLMs Unlock Semantic Anomaly Detection? A Framework for Structured Reasoning
- 2026DriveCombo: Benchmarking Compositional Traffic Rule Reasoning in Autonomous Driving
- 2024Testing Large Language Models on Driving Theory Knowledge and Skills for Connected Autonomous Vehicles