Perception Test 2025: Challenge Summary and a Unified VQA Extension
Not on the map. Why?
Abstract (arXiv)
The Third Perception Test challenge was organised as a full-day workshop alongside the IEEE/CVF International Conference on Computer Vision (ICCV) 2025. Its primary goal is to benchmark state-of-the-art video models and measure the progress in multimodal perception. This year, the workshop featured 2 guest tracks as well: KiVA (an image understanding challenge) and Physic-IQ (a video generation challenge). In this report, we summarise the results from the main Perception Test challenge, detailing both the existing tasks as well as novel additions to the benchmark. In this iteration, we placed an emphasis on task unification, as this poses a more challenging test for current SOTA multimodal models. The challenge included five consolidated tracks: unified video QA, unified object and point tracking, unified action and sound localisation, grounded video QA, and hour-long video QA, alongside an analysis and interpretability track that is still open for submissions. Notably, the unified video QA track introduced a novel subset that reformulates traditional perception tasks (such as point tracking and temporal action localisation) as multiple-choice video QA questions that video-language models can natively tackle. The unified object and point tracking merged the original object tracking and point tracking tasks, whereas the unified action and sound localisation merged the original temporal action localisation and temporal sound localisation tracks. Accordingly, we required competitors to use unified approaches rather than engineered pipelines with task-specific models. By proposing such a unified challenge, Perception Test 2025 highlights the significant difficulties existing models face when tackling diverse perception tasks through unified interfaces.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 13 of its 14 references that are in the map. First posted on arXiv 9 Jan 2026.
Builds on
13 of 14 references.
References · 13
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 819
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 706
- 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 552
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2020Rescaling Egocentric Visioncited by 540
- 2023Perception Test: A Diagnostic Benchmark for Multimodal Video Modelscited by 314
- 2022ActionFormer: Localizing Moments of Actions with Transformerscited by 311
- 2020Self-Supervised MultiModal Versatile Networkscited by 276
- 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 263
- 2020TSP: Temporally-Sensitive Pretraining of Video Encoders for Localization Taskscited by 77
- 2025AllTracker: Efficient Dense Point Tracking at High Resolutioncited by 58
1 more
Built on by
Citing papers per year: 2026: 1.
1 paper.