Can a Second-View Image Be a Language? Geometric and Semantic Cross-Modal Reasoning for X-ray Prohibited Item Detection
Not on the map. Why?
Abstract (arXiv)
Automatic X-ray prohibited items detection is vital for security inspection and has been widely studied. Traditional methods rely on visual modality, often struggling with complex threats. While recent studies incorporate language to guide single-view images, human inspectors typically use dual-view images in practice. This raises the question: can the second view provide constraints similar to a language modality? In this work, we introduce DualXrayBench, the first comprehensive benchmark for X-ray inspection that includes multiple views and modalities. It supports eight tasks designed to test cross-view reasoning. In DualXrayBench, we introduce a caption corpus consisting of 45,613 dual-view image pairs across 12 categories with corresponding captions. Building upon these data, we propose the Geometric (cross-view)-Semantic (cross-modality) Reasoner (GSR), a multimodal model that jointly learns correspondences between cross-view geometry and cross-modal semantics, treating the second-view images as a "language-like modality". To enable this, we construct the GSXray dataset, with structured Chain-of-Thought sequences: <top>, <side>, <conclusion>. Comprehensive evaluations on DualXrayBench demonstrate that GSR achieves significant improvements across all X-ray tasks, offering a new perspective for real-world X-ray inspection.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 26 of its 41 references that are in the map. First posted on arXiv 23 Nov 2025.
Builds on
26 of 41 references.
References · 26
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
- 2021Grounded Language-Image Pre-trainingcited by 1,156
- 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 625
- 2021RegionCLIP: Region-based Language-Image Pretrainingcited by 616
14 more
- 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 410
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 328
- 2022Open-Vocabulary DETR with Conditional Matchingcited by 220
- 2023Aligning Bag of Regions for Open-Vocabulary Object Detectioncited by 119
- 2019SIXray : A Large-scale Security Inspection X-ray Benchmark for Prohibited Item Discovery in Overlapping Imagescited by 52
- 2020Occluded Prohibited Items Detection: an X-ray Security Inspection Benchmark and De-occlusion Attention Modulecited by 39
- 2023Video-GroundingDINO: Towards Open-Vocabulary Spatio-Temporal Video Groundingcited by 32
- 2021Towards Real-World Prohibited Item Detection: A Large-Scale X-ray Benchmarkcited by 31
- 2021Towards Real-world X-ray Security Inspection: A High-Quality Benchmark and Lateral Inhibition Module for Prohibited Items Detectioncited by 30
- 2025STING-BEE: Towards Vision-Language Model for Real-World X-ray Baggage Security Inspectioncited by 5
- 2021On the impact of using X-ray energy response imagery for object detection via Convolutional Neural Networkscited by 4
- 2024Dual-view X-ray Detection: Can AI Detect Prohibited Items from Dual-view X-ray Images like Humans?cited by 4
- 2018Multi-view X-ray R-CNNcited by 3
- 2025DAGNet: A Dual-View Attention-Guided Network for Efficient X-ray Security Inspectioncited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026OneFocus: Enabling Real-World X-ray Security Screening with a Unified Vision-Language Model
- 2025XBench: A Comprehensive Benchmark for Visual-Language Explanations in Chest Radiography
- 2026MC-CXR: A Multi-Context Chest X-ray Benchmark for Context-Induced Disruption in Vision-Language Models
- 2026CheXthought: A global multimodal dataset of clinical chain-of-thought reasoning and visual attention for chest X-ray interpretation
- 2026Falcon: Functional Assembly and Language for Compositional Reasoning in X-ray
- 2026Rethinking Visual Attribution for Chest X-ray Reasoning in Large Vision Language Models
- 2025RadZero: Similarity-Based Cross-Attention for Explainable Vision-Language Alignment in Chest X-ray with Zero-Shot Multi-Task Capability
- 2025CoCa-CXR: Contrastive Captioners Learn Strong Temporal Structures for Chest X-Ray Vision-Language Understanding