CausalVLR: A Toolbox and Benchmark for Visual-Linguistic Causal Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
We present CausalVLR (Causal Visual-Linguistic Reasoning), an open-source toolbox containing a rich set of state-of-the-art causal relation discovery and causal inference methods for various visual-linguistic reasoning tasks, such as VQA, image/video captioning, medical report generation, model generalization and robustness, etc. These methods have been included in the toolbox with PyTorch implementations under NVIDIA computing system. It not only includes training and inference codes, but also provides model weights. We believe this toolbox is by far the most complete visual-linguitic causal reasoning toolbox. We wish that the toolbox and benchmark could serve the growing research community by providing a flexible toolkit to re-implement existing methods and develop their own new causal reasoning methods. Code and models are available at https://github.com/HCPLab-SYSU/CausalVLR. The project is under active development by HCP-Lab's contributors and we will keep this document updated.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 17 of its 29 references that are in the map. First posted on arXiv 30 Jun 2023.
Builds on
17 of 29 references.
Closest ancestors · 2
Same direction, newest first
- 2022Cross-Modal Causal Relational Reasoning for Event-Level Visual Question Answering26 Jul
- 2022Causal Reasoning Meets Visual Representation Learning: A Prospective Study26 Apr
Other references · 15
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 843
- 2020Semantics-aware Adaptive Knowledge Distillation for Sensor-to-Vision Action Recognitioncited by 37
- 2021TCGL: Temporal Contrastive Graph for Self-supervised Video Representation Learningcited by 31
- 2021Cross-modal Knowledge Distillation for Vision-to-Sensor Action Recognitioncited by 25
- 2019Deep Image-to-Video Adaptation and Fusion Networks for Action Recognitioncited by 21
- 2023Masked Images Are Counterfactual Samples for Robust Fine-tuningcited by 20
- 2018Hierarchically Learned View-Invariant Representations for Cross-View Action Recognitioncited by 16
- 2019Global Temporal Representation based CNNs for Infrared Action Recognitioncited by 16
- 2023Visual Causal Scene Refinement for Video Question Answeringcited by 16
- 2019Transferable Feature Representation for Visible-to-Infrared Cross-Dataset Human Action Recognitioncited by 13
Built on by
Citing papers per year: 2024: 2; 2025: 1; 2026: 2.
5 papers.
- 2025Cross-modal Causal Relation Alignment for Video Question Groundingcited by 12
- 2024MEIA: Multimodal Embodied Perception and Interaction in Unknown Environmentscited by 5
- 2024Multimodal Sentiment Analysis Based on Causal Reasoningcited by 1
- 2026EG-VQA: Benchmarking Verifiable Video Question Answering with Grounded Temporal Evidencecited by 1
- 2026The Abstraction Gap in Vision-Language Causal Reasoningcited by 0
- 2026EG-VQA: Benchmarking Verifiable Video Question Answering with Grounded Temporal Evidence23 Jun 2026
- 2026The Abstraction Gap in Vision-Language Causal Reasoning27 May 2026
- 2025Cross-modal Causal Relation Alignment for Video Question Grounding5 Mar 2025
- 2024Multimodal Sentiment Analysis Based on Causal Reasoning10 Dec 2024
- 2024MEIA: Multimodal Embodied Perception and Interaction in Unknown Environments1 Feb 2024
Similar, not cited
Close in wording, no citation either way
- 2025CausalVLBench: Benchmarking Visual Causal Reasoning in Large Vision-Language Models
- 2024Multimodal Causal Reasoning Benchmark: Challenging Vision Large Language Models to Discern Causal Links Across Modalities
- 2026From Prompts to Tokens: Internalizing Causal Supervision in Vision-Language Model for Multi-Image Causal Reasoning
- 2025InfoCausalQA:Can Models Perform Non-explicit Causal Reasoning Based on Infographic?
- 2025VCRBench: Exploring Long-form Causal Reasoning Capabilities of Large Video Language Models
- 2025ISO-Bench: Benchmarking Multimodal Causal Reasoning in Visual-Language Models through Procedural Plans
- 2025What's Missing in Vision-Language Models? Probing Their Struggles with Causal Order Reasoning
- 2026CCRV-Bench: Constraint-Based Evaluation of Causal Reasoning in Vision-Language Models