mlsanityData to 14 Oct 2026

Visual Model Checking: Graph-Based Inference of Visual Routines for Image Retrieval

arXiv 2602.17386 ↗First posted 19 Feb 2026cs.AI cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

Information retrieval lies at the foundation of the modern digital industry. While natural language search has seen dramatic progress in recent years largely driven by embedding-based models and large-scale pretraining, the field still faces significant challenges. Specifically, queries that involve complex relationships, object compositions, or precise constraints such as identities, counts and proportions often remain unresolved or unreliable within current frameworks. In this paper, we propose a novel framework that integrates formal verification into deep learning-based image retrieval through a synergistic combination of graph-based verification methods and neural code generation. Our approach aims to support open-vocabulary natural language queries while producing results that are both trustworthy and verifiable. By grounding retrieval results in a system of formal reasoning, we move beyond the ambiguity and approximation that often characterize vector representations. Instead of accepting uncertainty as a given, our framework explicitly verifies each atomic truth in the user query against the retrieved content. This allows us to not only return matching results, but also to identify and mark which specific constraints are satisfied and which remain unmet, thereby offering a more transparent and accountable retrieval process while boosting the results of the most popular embedding-based approaches.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 23 references that are in the map. First posted on arXiv 19 Feb 2026.

Builds on

16 of 23 references.

References · 16

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  4. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  5. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
  6. 2024Phi-4 Technical Reportcited by 711
  7. 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 603
  8. 2022Visual Programming: Compositional visual reasoning without trainingcited by 516
  9. 2023Scaling Open-Vocabulary Object Detectioncited by 343
  10. 2023Demystifying CLIP Datacited by 270
  11. 2021Probabilistic Embeddings for Cross-Modal Retrievalcited by 151
  12. 2021From Show to Tell: A Survey on Deep Learning-based Image Captioningcited by 138
4 more
  1. 2017Self-supervised learning of visual features through embedding images into text topic spacescited by 43
  2. 2023Improved Probabilistic Image-Text Representationscited by 40
  3. 2024Pix2Code: Learning to Compose Neural Visual Concepts as Programscited by 18
  4. 2025Image Captioning Evaluation in the Age of Multimodal LLMs: Challenges and Future Perspectivescited by 18

Built on by

Not cited yet.