SpatialTrust: A Benchmark for Environmental Risk Recognition in Secure Authentication
Not on the map. Why?
Abstract (arXiv)
Visual environmental risk recognition plays an important role in secure authentication, where a user's surroundings may reveal sensitive information or introduce potential security risks. However, existing evaluations of multimodal large language models (MLLMs) rarely examine whether models can reliably recognize, localize, and explain such risks in spatially grounded authentication scenarios. We present SpatialTrust, a question-answering benchmark for evaluating environmental risk recognition in secure authentication. SpatialTrust assesses five complementary abilities: sensitive factor detection, direct factor identification, indirect factor identification, direct factor explanation, and indirect factor explanation. We evaluate both proprietary and open-source MLLMs and find that current models show limited performance, especially in understanding and explaining indirect risks, indicating that spatial risk awareness remains a challenging capability for MLLMs. In addition, we introduce SpatialTrustGuard, a structured QA-and-audit pipeline that improves Qwen3-VL-30B-A3B-Instruct from 36.78% to 41.12% overall. Our findings highlight the need for dedicated benchmarks and structured inference methods to improve the trustworthiness of MLLMs in secure authentication.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 20 references that are in the map. First posted on arXiv 30 Aug 2026.
Builds on
14 of 20 references.
References · 14
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
- 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
- 2015Visual7W: Grounded Question Answering in Imagescited by 318
- 2023MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large Language Modelscited by 274
- 2017Towards a Visual Privacy Advisor: Understanding and Predicting Privacy Risks in Imagescited by 101
- 2025MultiPriv: Benchmarking Individual-Level Privacy Reasoning in Vision-Language Modelscited by 5
- 2017Towards Baselines for Shoulder Surfing on Mobile Authenticationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Doxing via the Lens: Revealing Location-related Privacy Leakage on Multi-modal Large Reasoning Models
- 2026Do Vision-Language Models Respect Contextual Integrity in Location Disclosure?
- 2025USB: A Comprehensive and Unified Safety Evaluation Benchmark for Multimodal Large Language Models
- 2025Evaluation of Geolocation Capabilities of Multimodal Large Language Models and Analysis of Associated Privacy Risks
- 2026Hiding in Plain Sight: A Diffusion-based Mitigation of Geolocation Privacy Leakage in Vision-Language Models
- 2024Granular Privacy Control for Geolocation with Vision Language Models
- 2025Assessing Visual Privacy Risks in Multimodal AI: A Novel Taxonomy-Grounded Evaluation of Vision-Language Models
- 2024AutoTrust: Benchmarking Trustworthiness in Large Vision Language Models for Autonomous Driving