mlsanityData to 7 Oct 2026

UniTraffic-Agent: Unified Traffic Video Reasoning for AI City Challenge 2026 Track 3 with Two Out-of-Domain Evaluations

arXiv 2608.13031 ↗First posted 13 Aug 2026cs.CV cs.AIcited by 1

On the map: LLM reasoning → Chain-of-thought reasoning for driving

also in 1 more
Abstract (arXiv)

Traffic video understanding has become an important problem in intelligent transportation, as road videos provide direct evidence for accidents, violations, and interactions between vehicles and vulnerable road users. A useful system should explain how a traffic event develops, why it happens, and when the relevant interaction occurs, yet this remains difficult for multimodal large language models (MLLMs) because traffic videos contain sparse events and varied viewpoints. We introduce UniTraffic-Agent, the MR-CAS solution for Track~3 of the 10th AI City Challenge, which includes Traffic Anomaly Reasoning (TAR) and two out-of-domain evaluations: FETV for fisheye traffic events and PSI-VQA for pedestrian intention reasoning. UniTraffic-Agent follows an observe--reason--act--verify workflow that samples timestamped visual evidence, reasons over all questions from the same clip in one request, and converts responses through task-specific action adapters. On the official Public leaderboards, MR-CAS ranks 16th on TAR with a score of 0.5780, 2nd on FETV with 0.4884, and 4th on PSI-VQA with 64.4161. The code is available at https://github.com/Roclp/UniTraffic-Agent.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 20 of its 33 references that are in the map. First posted on arXiv 13 Aug 2026.

Builds on

20 of 33 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Vad-R1: Towards Video Anomaly Reasoning via Perception-to-Cognition Chain-of-Thought26 May

Other references · 19

  1. 2023Visual Instruction Tuningcited by 7,792
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  3. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
  4. 2021VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understandingcited by 596
  5. 2018Real-world Anomaly Detection in Surveillance Videoscited by 570
  6. 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 399
  7. 2022VideoCoCa: Video-Text Modeling with Zero-Shot Transfer from Contrastive Captionerscited by 69
  8. 2024ReconBoost: Boosting Can Achieve Modality Reconcilementcited by 56
  9. 2020Localizing Anomalies from Weakly-Labeled Videoscited by 52
  10. 2022The 6th AI City Challengecited by 23
  11. 2023FishEye8K: A Benchmark and Dataset for Fisheye Camera Object Detectioncited by 21
  12. 2022TAD: A Large-Scale Benchmark for Traffic Accidents Detection from Video Surveillancecited by 20
7 more
  1. 2024TrafficVLM: A Controllable Visual Language Model for Traffic Video Captioningcited by 17
  2. 2022Rethinking Collaborative Metric Learning: Toward an Efficient Alternative without Negative Samplingcited by 14
  3. 2025OpenworldAUC: Towards Unified Evaluation and Optimization for Open-world Prompt Tuningcited by 12
  4. 2024Improved Diversity-Promoting Collaborative Metric Learning for Recommendationcited by 9
  5. 2025STER-VLM: Spatio-Temporal With Enhanced Reference Vision-Language Modelscited by 9
  6. 2025AccidentBench: Benchmarking Multimodal Understanding and Reasoning in Vehicle Accidents and Beyondcited by 8
  7. 2025Warehouse Spatial Question Answering with LLM Agentcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026TAU-Agent: An Agentic Retrieval-Augmented Framework for Traffic Anomaly Understanding
  2. 2026UDVideoQA: A Traffic Video Question Answering Dataset for Multi-Object Spatio-Temporal Reasoning in Urban Dynamics
  3. 2026From Detection to Understanding: TAR and TAR-Bench for Multi-Task Traffic Anomaly Reasoning
  4. 2026SGTA: Scene-Graph Based Multi-Modal Traffic Agent for Video Understanding
  5. 2025TUMTraffic-VideoQA: A Benchmark for Unified Spatio-Temporal Video Understanding in Traffic Scenes
  6. 2026TAU-R1: Visual Language Model for Traffic Anomaly Understanding
  7. 2026OmniTraffic: A Controllable Generation Pipeline and Benchmark for Spatio-Temporal Traffic Reasoning
  8. 2026PEDESTRIANQA: A Benchmark for Vision-Language Models on Pedestrian Intention and Trajectory Prediction