mlsanityData to 14 Oct 2026

Falcon: Functional Assembly and Language for Compositional Reasoning in X-ray

arXiv 2606.25701 ↗First posted 24 Jun 2026cs.CVcited by 1

On the map: LLM reasoning → Clinical and biomedical applications

also in 1 more
Abstract (arXiv)

Conventional vision-language models are largely object-centric, focusing on detecting and describing individual entities. In safety-critical X-ray baggage screening, however, threat often emerges not from a single object but from the functional compatibility of spatially dispersed components, such as batteries, detonators, and explosive charges. We formalize this setting as compositional threat reasoning, where risk is modeled as a relational property of grounded regions rather than an independent detection outcome. We introduce Falcon, a multimodal framework that abstracts segmentation-aware region features into a structured safety state capturing component presence, pairwise functional compatibility, and scene-level risk. This structured representation is injected into the language model as an explicit intermediate interface, encouraging relationally consistent and safety-aware reasoning. To evaluate this problem, we present Falcon-X, a benchmark that unifies dense grounding with structured supervision over component completeness and risk inference in cluttered X-ray imagery. Experiments show that while existing multimodal models adapt to appearance, they struggle with compositional safety reasoning. Falcon improves functional grounding and produces more coherent threat assessments, establishing compositional safety reasoning as a distinct evaluation paradigm for multimodal systems.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 24 of its 36 references that are in the map. First posted on arXiv 24 Jun 2026.

Builds on

24 of 36 references.

References · 24

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  5. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  6. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
  7. 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
  8. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
  9. 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 455
  10. 2019The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervisioncited by 372
  11. 2023GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interestcited by 302
  12. 2023GRES: Generalized Referring Expression Segmentationcited by 254
12 more
  1. 2025Sa2VA: Marrying SAM2 with MLLM for Dense Grounded Understanding of Images and Videoscited by 159
  2. 2024Groma: Localized Visual Tokenization for Grounding Multimodal Large Language Modelscited by 119
  3. 2025RF-DETR: Neural Architecture Search for Real-Time Detection Transformerscited by 75
  4. 2019SIXray : A Large-scale Security Inspection X-ray Benchmark for Prohibited Item Discovery in Overlapping Imagescited by 52
  5. 2020Occluded Prohibited Items Detection: an X-ray Security Inspection Benchmark and De-occlusion Attention Modulecited by 39
  6. 2021Towards Real-world X-ray Security Inspection: A High-Quality Benchmark and Lateral Inhibition Module for Prohibited Items Detectioncited by 30
  7. 2022PIDray: A Large-scale X-ray Benchmark for Real-World Prohibited Item Detectioncited by 17
  8. 2025NAVER: A Neuro-Symbolic Compositional Automaton for Visual Grounding with Explicit Logic Reasoningcited by 12
  9. 2024AO-DETR: Anti-Overlapping DETR for X-Ray Prohibited Items Detectioncited by 9
  10. 2025ViLU: Learning Vision-Language Uncertainties for Failure Predictioncited by 9
  11. 2025STING-BEE: Towards Vision-Language Model for Real-World X-ray Baggage Security Inspectioncited by 5
  12. 2025Superpowering Open-Vocabulary Object Detectors for X-ray Visioncited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Can a Second-View Image Be a Language? Geometric and Semantic Cross-Modal Reasoning for X-ray Prohibited Item Detection
  2. 2025PRISM: Robust VLM Alignment with Principled Reasoning for Integrated Safety in Multimodality
  3. 2026Localize Any Object in X-Ray Security Scans without Human Annotation
  4. 2026Rethinking Visual Attribution for Chest X-ray Reasoning in Large Vision Language Models
  5. 2026CheXthought: A global multimodal dataset of clinical chain-of-thought reasoning and visual attention for chest X-ray interpretation
  6. 2026A Reasoning-Enabled Vision-Language Foundation Model for Chest X-ray Interpretation
  7. 2025ProGuard: Towards Proactive Multimodal Safeguard
  8. 2026OneFocus: Enabling Real-World X-ray Security Screening with a Unified Vision-Language Model