Front-to-Back: Benchmarking Vision-Language Models for Asymmetric Cross-View Vehicle Re-Identification
On the map: Multimodal LLMs / vision-language models → Driving VLMs and open-vocabulary detection
Abstract (arXiv)
Matching the same vehicle across front and rear cameras is difficult because the cameras do not share a view and the vehicle's appearance changes substantially. We introduce Front2Back-ReID, a benchmark of 500 manually verified vehicle handovers from 20 recording sequences in South Africa. Each example asks a model to match a vehicle highlighted in a front-camera image to the same vehicle among at least three candidates in a later rear-camera image. We evaluate seven zero-shot vision-language models, four image-retrieval baselines, and 25 human participants. Models are tested using full front RGB images, cropped target vehicles, and binary silhouettes. The strongest VLM achieved 76.6 percent Rank-1 accuracy on target crops, compared with 74.0 percent for the frozen SigLIP2 baseline; this difference was not statistically clear. Human participants achieved 94.0 percent accuracy with full images and 92.2 percent with target crops. Under our evaluation setup, enabling reasoning improved accuracy across all three input conditions for every model evaluated in both modes. We also found that VLMs generally performed worse on full scenes than on target crops. These results show that general-purpose VLMs do not yet consistently outperform strong visual retrieval for front-to-rear vehicle matching, while humans remain substantially more reliable.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Driving VLMs and open-vocabulary detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 18 of its 30 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
18 of 30 references.
Closest ancestors · 1
Same direction, newest first
Other references · 17
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 735
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 706
- 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 583
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
- 2024MuirBench: A Comprehensive Benchmark for Robust Multi-image Understandingcited by 188
- 2022CLIP-ReID: Exploiting Vision-Language Model for Image Re-Identification without Concrete Text Labelscited by 181
- 2019CityFlow: A City-Scale Benchmark for Multi-Target Multi-Camera Vehicle Tracking and Re-Identificationcited by 119
- 2023Standing Between Past and Future: Spatio-Temporal Modeling for Multi-Camera 3D Multi-Object Trackingcited by 54
5 more
- 2020Parsing-based View-aware Embedding Network for Vehicle Re-Identificationcited by 53
- 2019Vehicle Re-identification with Viewpoint-aware Metric Learningcited by 45
- 2025RoundaboutHD: High-Resolution Real-World Urban Environment Benchmark for Multi-Camera Vehicle Trackingcited by 3
- 2023Multi-query Vehicle Re-identification: Viewpoint-conditioned Network, Unified Dataset and New Metriccited by 2
- 2026Zero-Shot Semantic Re-Identification for Autonomous Driving: A VLM Baseline Studycited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025CLIPVehicle: A Unified Framework for Vision-based Vehicle Search
- 2026CrossView: Can Vision-Language Models Reason Across Cameras?
- 2025CLIP-SENet: CLIP-based Semantic Enhancement Network for Vehicle Re-identification
- 2026How Well Do Vision-Language Models Understand Sequential Driving Scenes? A Sensitivity Study
- 2025RT-VLM: Re-Thinking Vision Language Model with 4-Clues for Real-World Object Recognition Robustness
- 2025GeoVLM: Improving Automated Vehicle Geolocalisation Using Vision-Language Matching
- 2025MMLongBench: Benchmarking Long-Context Vision-Language Models Effectively and Thoroughly
- 2026Validating, Not Sampling: Region-Level Robustness of Vision-Language and Vision-Language-Action Models