Technical Report for Argoverse2 Scenario Mining Challenges on Iterative Error Correction and Spatially-Aware Prompting
Not on the map. Why?
Abstract (arXiv)
Scenario mining from extensive autonomous driving datasets, such as Argoverse 2, is crucial for the development and validation of self-driving systems. The RefAV framework represents a promising approach by employing Large Language Models (LLMs) to translate natural-language queries into executable code for identifying relevant scenarios. However, this method faces challenges, including runtime errors stemming from LLM-generated code and inaccuracies in interpreting parameters for functions that describe complex multi-object spatial relationships. This technical report introduces two key enhancements to address these limitations: (1) a fault-tolerant iterative code-generation mechanism that refines code by re-prompting the LLM with error feedback, and (2) specialized prompt engineering that improves the LLM's comprehension and correct application of spatial-relationship functions. Experiments on the Argoverse 2 validation set with diverse LLMs-Qwen2.5-VL-7B, Gemini 2.5 Flash, and Gemini 2.5 Pro-show consistent gains across multiple metrics; most notably, the proposed system achieves a HOTA-Temporal score of 52.37 on the official test set using Gemini 2.5 Pro. These results underline the efficacy of the proposed techniques for reliable, high-precision scenario mining.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 9 of its 11 references that are in the map. First posted on arXiv 10 Jun 2025.
Builds on
9 of 11 references.
References · 9
- 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 552
- 2023A Survey of Hallucination in Large Foundation Modelscited by 368
- 2024The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Modelscited by 88
- 2020Scalable Active Learning for Object Detectioncited by 58
- 2022Towards Long-Tailed 3D Detectioncited by 40
- 2024Towards Explainable, Safe Autonomous Driving with Language Embeddings for Novelty Identification and Active Learning: Framework and Experimental Analysis with Real-World Data Setscited by 25
- 2024Language-Driven Active Learning for Diverse Open-Set 3D Object Detectioncited by 15
- 2025RefAV: Towards Planning-Centric Scenario Miningcited by 13
- 2020Real-World Scenario Mining for the Assessment of Automated Vehiclescited by 5
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2025Diffusion-Based Image Editing: An Unforeseen Adversary to Robust Invisible Watermarkscited by 3
- 2026Vanishing Watermarks: Diffusion-Based Image Editing Undermines Robust Invisible Watermarkingcited by 2
- 2025Robust Concept Erasure in Diffusion Models: A Theoretical Perspective on Security and Robustnesscited by 0
- 2026SMc2f: Robust Scenario Mining for Robotic Autonomy from Coarse to Finecited by 0
- 2026When Denoising Becomes Unsigning: Theoretical and Empirical Analysis of Watermark Fragility Under Diffusion-Based Image Editingcited by 0
- 2026Editing Away the Evidence: Diffusion-Based Image Manipulation and the Failure Modes of Robust Watermarkingcited by 0
- 2026Editing Away the Evidence: Diffusion-Based Image Manipulation and the Failure Modes of Robust Watermarking13 Mar 2026
- 2026When Denoising Becomes Unsigning: Theoretical and Empirical Analysis of Watermark Fragility Under Diffusion-Based Image Editing5 Mar 2026
- 2026Vanishing Watermarks: Diffusion-Based Image Editing Undermines Robust Invisible Watermarking24 Feb 2026
- 2026SMc2f: Robust Scenario Mining for Robotic Autonomy from Coarse to Fine17 Jan 2026
- 2025Diffusion-Based Image Editing: An Unforeseen Adversary to Robust Invisible Watermarks5 Nov 2025
- 2025Robust Concept Erasure in Diffusion Models: A Theoretical Perspective on Security and Robustness15 Sep 2025