mlsanityData to 14 Oct 2026

Technical Report for Argoverse2 Scenario Mining Challenges on Iterative Error Correction and Spatially-Aware Prompting

arXiv 2506.11124 ↗First posted 10 Jun 2025cs.CV cs.SEcited by 6

Not on the map. Why?

Abstract (arXiv)

Scenario mining from extensive autonomous driving datasets, such as Argoverse 2, is crucial for the development and validation of self-driving systems. The RefAV framework represents a promising approach by employing Large Language Models (LLMs) to translate natural-language queries into executable code for identifying relevant scenarios. However, this method faces challenges, including runtime errors stemming from LLM-generated code and inaccuracies in interpreting parameters for functions that describe complex multi-object spatial relationships. This technical report introduces two key enhancements to address these limitations: (1) a fault-tolerant iterative code-generation mechanism that refines code by re-prompting the LLM with error feedback, and (2) specialized prompt engineering that improves the LLM's comprehension and correct application of spatial-relationship functions. Experiments on the Argoverse 2 validation set with diverse LLMs-Qwen2.5-VL-7B, Gemini 2.5 Flash, and Gemini 2.5 Pro-show consistent gains across multiple metrics; most notably, the proposed system achieves a HOTA-Temporal score of 52.37 on the official test set using Gemini 2.5 Pro. These results underline the efficacy of the proposed techniques for reliable, high-precision scenario mining.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 9 of its 11 references that are in the map. First posted on arXiv 10 Jun 2025.

Builds on

9 of 11 references.

References · 9

  1. 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 552
  2. 2023A Survey of Hallucination in Large Foundation Modelscited by 368
  3. 2024The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Modelscited by 88
  4. 2020Scalable Active Learning for Object Detectioncited by 58
  5. 2022Towards Long-Tailed 3D Detectioncited by 40
  6. 2024Towards Explainable, Safe Autonomous Driving with Language Embeddings for Novelty Identification and Active Learning: Framework and Experimental Analysis with Real-World Data Setscited by 25
  7. 2024Language-Driven Active Learning for Diverse Open-Set 3D Object Detectioncited by 15
  8. 2025RefAV: Towards Planning-Centric Scenario Miningcited by 13
  9. 2020Real-World Scenario Mining for the Assessment of Automated Vehiclescited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 4.

6 papers.