mlsanityData to 14 Oct 2026

CauSight: Learning to Supersense for Visual Causal Discovery

arXiv 2512.01827 ↗First posted 1 Dec 2025cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Causal thinking enables humans to understand not just what is seen, but why it happens. To replicate this capability in modern AI systems, we introduce the task of visual causal discovery. It requires models to infer cause-and-effect relations among visual entities across diverse scenarios instead of merely perceiving their presence. To this end, we first construct the Visual Causal Graph dataset (VCG-32K), a large-scale collection of over 32,000 images annotated with entity-level causal graphs, and further develop CauSight, a novel vision-language model to perform visual causal discovery through causally aware reasoning. Our training recipe integrates three components: (1) training data curation from VCG-32K, (2) Tree-of-Causal-Thought (ToCT) for synthesizing reasoning trajectories, and (3) reinforcement learning with a designed causal reward to refine the reasoning policy. Experiments show that CauSight outperforms GPT-4.1 on visual causal discovery, achieving over a threefold performance boost (21% absolute gain). Our code, model, and dataset are fully open-sourced at project page: https://github.com/OpenCausaLab/CauSight.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 39 of its 62 references that are in the map. First posted on arXiv 1 Dec 2025.

Builds on

39 of 62 references.

References · 39

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2025Qwen2.5-VL Technical Reportcited by 5,587
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  6. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  7. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  8. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  9. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
  10. 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
  11. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
  12. 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
27 more
  1. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
  2. 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
  3. 2023OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Modelscited by 565
  4. 2018From Recognition to Cognition: Visual Commonsense Reasoningcited by 556
  5. 2024ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Searchcited by 344
  6. 2019DAG-GNN: DAG Structure Learning with Graph Neural Networkscited by 331
  7. 2015Visual7W: Grounded Question Answering in Imagescited by 318
  8. 2013Causal Discovery with Continuous Additive Noise Modelscited by 255
  9. 2019Gradient-Based Neural DAG Learningcited by 227
  10. 2016FVQA: Fact-based Visual Question Answeringcited by 181
  11. 2019A Meta-Transfer Objective for Learning to Disentangle Causal Mechanismscited by 158
  12. 2021A Comprehensive Survey of Scene Graphs: Generation and Applicationcited by 125
  13. 2022Panoptic Scene Graph Generationcited by 114
  14. 2023OpenLane-V2: A Topology Reasoning Benchmark for Unified 3D HD Mappingcited by 83
  15. 2018Woulda, Coulda, Shoulda: Counterfactually-Guided Policy Searchcited by 82
  16. 2016Discovering Causal Signals in Imagescited by 79
  17. 2020Reasoning about Goals, Steps, and Temporal Ordering with WikiHowcited by 66
  18. 2014Visual Causal Feature Learningcited by 59
  19. 2023Graph-based Topology Reasoning for Driving Scenescited by 54
  20. 2019Causal Reasoning from Meta-reinforcement Learningcited by 53
  21. 2021Systematic Evaluation of Causal Discovery in Visual Model Based Reinforcement Learningcited by 53
  22. 2024Efficient Causal Graph Discovery Using Large Language Modelscited by 53
  23. 2019Causal Induction from Visual Observations for Goal Directed Taskscited by 31
  24. 2022ERGO: Event Relational Graph Transformer for Document-level Event Causality Identificationcited by 19
  25. 2024ADAM: An Embodied Causal Agent in Open-World Environmentscited by 13
  26. 2024CELLO: Causal Evaluation of Large Vision-Language Modelscited by 10
  27. 2025ARise: Towards Knowledge-Augmented Reasoning via Risk-Adaptive Searchcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026From Prompts to Tokens: Internalizing Causal Supervision in Vision-Language Model for Multi-Image Causal Reasoning
  2. 2025CAUSAL3D: A Comprehensive Benchmark for Causal Learning from Visual Data
  3. 2025CausalVLBench: Benchmarking Visual Causal Reasoning in Large Vision-Language Models
  4. 2026CauScale: Neural Causal Discovery at Scale
  5. 2026CCRV-Bench: Constraint-Based Evaluation of Causal Reasoning in Vision-Language Models
  6. 2026Causal Scaffolding for Physical Reasoning: A Benchmark for Causally-Informed Physical World Understanding in VLMs
  7. 2022Causal Reasoning Meets Visual Representation Learning: A Prospective Study
  8. 2026Diagnosing Causal Reasoning in Vision-Language Models via Structured Relevance Graphs