A Neurosymbolic Framework for Interpretable Cognitive Attack Detection in Augmented Reality
Not on the map. Why?
Abstract (arXiv)
Augmented Reality (AR) enriches human perception by overlaying virtual elements onto the physical world. However, this tight coupling between virtual and real content makes AR vulnerable to cognitive attacks: manipulations that distort users' semantic understanding of the environment. Existing detection methods largely focus on visual inconsistencies at the pixel or image level, offering limited semantic reasoning or interpretability. To address these limitations, we introduce CADAR, a neuro-symbolic framework for cognitive attack detection in AR that integrates neural and symbolic reasoning. CADAR fuses multimodal vision-language representations from pre-trained models into a perception graph that captures objects, relations, and temporal contextual salience. Building on this structure, a particle-filter-based statistical reasoning module infers anomalies in semantic dynamics to reveal cognitive attacks. This combination provides both the adaptability of modern vision-language models and the interpretability of probabilistic symbolic reasoning. Preliminary experiments on an AR cognitive-attack dataset demonstrate consistent advantages over existing approaches, highlighting the potential of neuro-symbolic methods for robust and interpretable AR security.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 20 of its 47 references that are in the map. First posted on arXiv 7 Aug 2025.
Builds on
20 of 47 references.
References · 20
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2021ViViT: A Video Vision Transformercited by 1,620
- 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,143
- 2020Knowledge Graphscited by 621
- 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 509
- 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 439
- 2023AnomalyGPT: Detecting Industrial Anomalies Using Large Vision-Language Modelscited by 171
- 2021A Comprehensive Survey of Scene Graphs: Generation and Applicationcited by 125
- 2022ObjectFormer for Image Manipulation Detection and Localizationcited by 78
- 2022Confusing Image Quality Assessment: Towards Better Augmented Reality Experiencecited by 32
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Surveycited by 23
- 2023Neurosymbolic AI for Reasoning over Knowledge Graphs: A Surveycited by 21
8 more
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attackscited by 19
- 2025ViDDAR: Vision Language Model-Based Task-Detrimental Content Detection for Augmented Realitycited by 16
- 2024MissionGNN: Hierarchical Multimodal GNN-based Weakly Supervised Video Anomaly Recognition with Mission-Specific Knowledge Graph Generationcited by 14
- 2025Network Diffuser for Placing-Scheduling Service Function Chains with Inverse Demonstrationcited by 11
- 2024Cooperative Backdoor Attack in Decentralized Reinforcement Learning with Theoretical Guaranteecited by 6
- 2025Detecting Visual Information Manipulation Attacks in Augmented Reality: A Multimodal Semantic Reasoning Approachcited by 6
- 2024Multimodal Attack Detection for Action Recognition Modelscited by 5
- 2025SoK: Come Together -- Unifying Security, Information Theory, and Cognition for a Mixed Reality Deception Attack Ontology & Analysis Frameworkcited by 1
Built on by
Citing papers per year: 2025: 2; 2026: 6.
8 papers.
- 2026Advances in Global Solvers for 3D Visioncited by 13
- 2026Agent Alpha: Tree Search Unifying Generation, Exploration and Evaluation for Computer-Use Agentscited by 12
- 2025InSPO: Unlocking Intrinsic Self-Reflection for LLM Preference Optimizationcited by 11
- 2025Perception Graph for Cognitive Attack Reasoning in Augmented Realitycited by 4
- 2026MINT: Minimal Information Neuro-Symbolic Tree for Objective-Driven Knowledge-Gap Reasoning and Active Elicitationcited by 4
- 2026ACDZero: MCTS Agent for Mastering Automated Cyber Defensecited by 2
- 2026Reasoning Knowledge-Gap in Drone Planning via LLM-based Active Elicitationcited by 1
- 2026Benchmarking Vision-Language Models under Contradictory Virtual Content Attacks in Augmented Realitycited by 1
- 2026Benchmarking Vision-Language Models under Contradictory Virtual Content Attacks in Augmented Reality7 Apr 2026
- 2026Reasoning Knowledge-Gap in Drone Planning via LLM-based Active Elicitation8 Mar 2026
- 2026Advances in Global Solvers for 3D Vision16 Feb 2026
- 2026MINT: Minimal Information Neuro-Symbolic Tree for Objective-Driven Knowledge-Gap Reasoning and Active Elicitation4 Feb 2026
- 2026Agent Alpha: Tree Search Unifying Generation, Exploration and Evaluation for Computer-Use Agents3 Feb 2026
- 2026ACDZero: MCTS Agent for Mastering Automated Cyber Defense5 Jan 2026
- 2025InSPO: Unlocking Intrinsic Self-Reflection for LLM Preference Optimization29 Dec 2025
- 2025Perception Graph for Cognitive Attack Reasoning in Augmented Reality30 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025Toward Safe, Trustworthy and Realistic Augmented Reality User Experience
- 2025Multimodal LLM Augmented Reasoning for Interpretable Visual Perception Analysis
- 2025Visual Categorization Across Minds and Models: Cognitive Analysis of Human Labeling and Neuro-Symbolic Integration
- 2026See No Evil: Semantic Context-Aware Privacy Risk Detection for AR
- 2026Challenging Vision-Language Models with Physically Deployable Multimodal Semantic Lighting Attacks
- 2024HuBar: A Visual Analytics Tool to Explore Human Behaviour based on fNIRS in AR guidance systems
- 2025The Plot Twist: Jailbreaking Unified Multimodal Models with a Three-Act NarrativeAttack
- 2025SemVink: Advancing VLMs' Semantic Understanding of Optical Illusions via Visual Global Thinking