mlsanityData to 14 Oct 2026

On the Potential of CLIP for Compositional Logical Reasoning

arXiv 2308.15887 ↗First posted 30 Aug 2023cs.AI cs.CV cs.LGcited by 3

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

In this paper we explore the possibility of using OpenAI's CLIP to perform logically coherent grounded visual reasoning. To that end, we formalize our terms and give a geometric analysis of how embeddings in CLIP's latent space would need to be configured in order for the system to be logically coherent. Our main conclusion is that, as usually configured, CLIP cannot perform such reasoning.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 5 of its 12 references that are in the map. First posted on arXiv 30 Aug 2023.

Builds on

5 of 12 references.

References · 5

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  4. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  5. 2015VQA: Visual Question Answeringcited by 2,506

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 1.

3 papers.

  1. 2024Two Effects, One Trigger: On the Modality Gap, Object Bias, and Information Imbalance in Contrastive Vision-Language Modelscited by 57
  2. 2025Is CLIP ideal? No. Can we fix it? Yes!cited by 21
  3. 2024CLIPArTT: Adaptation of CLIP to New Domains at Test Timecited by 14

Similar, not cited

Close in wording, no citation either way

  1. 2026CS-CLIP: Compositional Scene Graph-guided CLIP for Robust Compositional Reasoning
  2. 2026ReasonCLIP-58M: Visually Grounded Commonsense Reasoning Supervision for CLIP
  3. 2022A Benchmark for Compositional Visual Reasoning
  4. 2026MM-CondChain: A Programmatically Verified Benchmark for Visually Grounded Deep Compositional Reasoning
  5. 2025Explain Before You Answer: A Survey on Compositional Visual Reasoning
  6. 2025NAVER: A Neuro-Symbolic Compositional Automaton for Visual Grounding with Explicit Logic Reasoning
  7. 2022CLIP-TD: CLIP Targeted Distillation for Vision-Language Tasks
  8. 2024Take A Step Back: Rethinking the Two Stages in Visual Reasoning