Absence is Presence: Understanding Visual Scene Negative Events Under Safety Cognitive Constraint
Not on the map. Why?
Abstract (arXiv)
Traditional scene understanding focuses on affirmative information objectively present in images. However, in safety-critical domains, comprehending key information that should exist but is actually absent is vital for risk mitigation. To bridge this gap, we focus on visual scene negative captioning with safety as the cognitive constraint. The core challenge is to convert physical absence into semantic negative events. Existing vision-language models (VLMs) struggle with this process because affirmation bias suppresses negative reasoning, while limited mental filling capability and representation bias further hinder the inference of absent information. To address these challenges, we propose a negative captioning framework based on counterfactual reconstruction and contrastive decoding (CRCD). Inspired by human cognition, CRCD reformulates the task as counterfactual latent change captioning to bypass affirmation bias. It contrasts a synthesized safe expectation with reality to identify semantic omissions. To address limited mental filling, we design a dual-branch counterfactual reconstruction architecture. The amodal completion branch restores defective objects, while the functional association branch infers completely absent safety objects. Concurrently, a multi-condition representation learning mechanism is integrated to mitigate representation bias by projecting universal features onto predefined safety criteria subspaces, thereby capturing information across more dimensions. By decoding feature-level semantic residuals between the reconstructed scene prototype and raw input, CRCD bounds the non-existence search space and activates the decoder's negative logic. Extensive experiments validate the effectiveness of CRCD, establishing a high-performance baseline for this pioneering task.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 52 references that are in the map. First posted on arXiv 17 Sep 2026.
Builds on
33 of 52 references.
References · 33
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023Visual Instruction Tuningcited by 7,869
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2024ORPO: Monolithic Preference Optimization without Reference Modelcited by 562
- 2024GME: Improving Universal Multimodal Retrieval by Multimodal LLMscited by 170
- 2021VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomenacited by 135
- 2025Are VLMs Ready for Autonomous Driving? An Empirical Study from the Reliability, Data, and Metric Perspectivescited by 122
- 2025Vision-Language Models Do Not Understand Negationcited by 72
- 2020Dark, Beyond Deep: A Paradigm Shift to Cognitive AI with Humanlike Common Sensecited by 62
21 more
- 2024Learn "No" to Say "Yes" Better: Improving Vision-Language Models via Negationscited by 46
- 2025Know "No" Better: A Data-Driven Approach for Enhancing Negation Awareness in CLIPcited by 28
- 2025AnomalyR1: A GRPO-based End-to-end MLLM for Industrial Anomaly Detectioncited by 28
- 2024Delving into Multi-modal Multi-task Foundation Models for Road Scene Understanding: From Learning Paradigm Perspectivescited by 23
- 2025Cycle Consistency as Reward: Learning Image-Text Alignment without Human Preferencescited by 22
- 2024Open-World Amodal Appearance Completioncited by 19
- 2024Enhancing Perception of Key Changes in Remote Sensing Image Change Captioningcited by 16
- 2025SC-Captioner: Improving Image Captioning with Self-Correction by Reinforcement Learningcited by 16
- 2025NegVQA: Can Vision Language Models Understand Negation?cited by 13
- 2024Beyond Walking: A Large-Scale Image-Text Benchmark for Text-based Person Anomaly Searchcited by 11
- 2024Combating Multimodal LLM Hallucination via Bottom-Up Holistic Reasoningcited by 10
- 2025Bringing CLIP to the Clinic: Dynamic Soft Labels and Negation-Aware Learning for Medical Analysiscited by 10
- 2025Group Relative Policy Optimization for Image Captioningcited by 9
- 2021Exploiting Natural Language for Efficient Risk-Aware Multi-robot SaR Planningcited by 8
- 2025TNG-CLIP:Training-Time Negation Data Generation for Negation Awareness of CLIPcited by 7
- 2025CausalVLBench: Benchmarking Visual Causal Reasoning in Large Vision-Language Modelscited by 7
- 2025Conditional Representation Learning for Customized Taskscited by 5
- 2024A Data-Driven Guided Decoding Mechanism for Diagnostic Captioningcited by 4
- 2025From Objects to Events: Unlocking Complex Visual Understanding in Object Detectors via LLM-guided Symbolic Reasoningcited by 3
- 2026Evaluating and Enhancing Negation Comprehension in Remote Sensing MLLMscited by 2
- 2025Multimodal Large Language Models for Enhanced Traffic Safety: A Comprehensive Review and Future Trendscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Benchmarking MLLMs via Cognitive Expected Scene Graph for Safety-Critical Visual Negation Understanding
- 2026When Safety Overrides Vision: Exploring Dynamics between Vision Influence and Safety Alignment in Vision-Language Models
- 2025DUAL-Bench: Measuring Over-Refusal and Robustness in Vision-Language Models
- 2026Breaking the Illusion: When Positive Meets Negative in Multimodal Decoding
- 2026Revealing the Gap in Human and VLM Scene Perception through Counterfactual Semantic Saliency
- 2026SAVeS: Steering Safety Judgments in Vision-Language Models via Semantic Cues
- 2026Global Context or Local Detail? Adaptive Visual Grounding for Hallucination Mitigation
- 2026From Local Evidence to Safety Verdicts: Causal Tracing in Vision-Language Models