mlsanityData to 7 Oct 2026

Can Vision-Language Models be a Good Guesser? Exploring VLMs for Times and Location Reasoning

arXiv 2307.06166 ↗First posted 12 Jul 2023cs.CV cs.AIcited by 22

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Vision-Language Models (VLMs) are expected to be capable of reasoning with commonsense knowledge as human beings. One example is that humans can reason where and when an image is taken based on their knowledge. This makes us wonder if, based on visual cues, Vision-Language Models that are pre-trained with large-scale image-text resources can achieve and even outperform human's capability in reasoning times and location. To address this question, we propose a two-stage recognitionspace and reasoningspace probing task, applied to discriminative and generative VLMs to uncover whether VLMs can recognize times and location-relevant features and further reason about it. To facilitate the investigation, we introduce WikiTiLo, a well-curated image dataset compromising images with rich socio-cultural cues. In the extensive experimental studies, we find that although VLMs can effectively retain relevant features in visual encoders, they still fail to make perfect reasoning. We will release our dataset and codes to facilitate future studies.

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 33 of its 46 references that are in the map. First posted on arXiv 12 Jul 2023.

Builds on

33 of 46 references.

References · 33

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  6. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  7. 2023Visual Instruction Tuningcited by 7,792
  8. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  9. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  10. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  11. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
  12. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
21 more
  1. 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,291
  2. 2016Understanding intermediate layers using linear classifier probescited by 1,279
  3. 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
  4. 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,224
  5. 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,162
  6. 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 776
  7. 2021FLAVA: A Foundational Language And Vision Alignment Modelcited by 646
  8. 2021FILIP: Fine-grained Interactive Language-Image Pre-Trainingcited by 626
  9. 2019Designing and Interpreting Probes with Control Taskscited by 608
  10. 2023LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Modelcited by 602
  11. 2021SLIP: Self-supervision meets Language-Image Pre-trainingcited by 434
  12. 2022Unified Contrastive Learning in Image-Text-Label Spacecited by 194
  13. 2021VIOLET : End-to-End Video-Language Transformers with Masked Visual-token Modelingcited by 187
  14. 2021Align and Prompt: Video-and-Language Pre-training with Entity Promptscited by 149
  15. 2016PlaNet - Photo Geolocation with Convolutional Neural Networkscited by 114
  16. 2016Localizing and Orienting Street Views Using Overhead Imagerycited by 93
  17. 2018CPlaNet: Enhancing Image Geolocalization by Combinatorial Partitioning of Mapscited by 68
  18. 2022There is a Time and Place for Reasoning Beyond the Imagecited by 22
  19. 2021Probing Multimodal Embeddings for Linguistic Properties: the Visual-Semantic Casecited by 20
  20. 2020Learning a Dynamic Map of Visual Appearancecited by 18
  21. 2023Probing the Role of Positional Information in Vision-Language Modelscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 14; 2026: 4.

22 papers.

Sort:

By area:

  1. 2025Evaluating Precise Geolocation Inference Capabilities of Vision Language Modelscited by 12
  2. 2025NAVIG: Natural Language-guided Analysis with Vision Language Models for Image Geo-localizationcited by 8
  3. 2025ToDRE: Effective Visual Token Pruning via Token Diversity and Task Relevancecited by 7
  4. 2025Multi-modal Summarization in Model-Based Engineering: Automotive Software Development Case Studycited by 6
  5. 2025AViLA: Asynchronous Vision-Language Agent for Streaming Multimodal Data Interactioncited by 6
  6. 2024Beyond Captioning: Task-Specific Prompting for Improved VLM Performance in Mathematical Reasoningcited by 5
  7. 2026Watch Before You Answer: Learning from Visually Grounded Post-Trainingcited by 5
  8. 2025CultureCLIP: Empowering CLIP with Cultural Awareness through Synthetic Images and Contextualized Captionscited by 3
  9. 2025GeoShield: Safeguarding Geolocation Privacy from Vision-Language Models via Adversarial Perturbationscited by 3
  10. 2025V-CECE: Visual Counterfactual Explanations via Conceptual Editscited by 3
  11. 2024Automatic benchmarking of large multimodal models via iterative experiment programmingcited by 2
  12. 2025PuzzleGPT: Emulating Human Puzzle-Solving Ability for Time and Location Predictioncited by 2
10 more
  1. 2026BREATH-VL: Vision-Language-Guided 6-DoF Bronchoscopy Localization via Semantic-Geometric Fusioncited by 2
  2. 2024GPT Sonograpy: Hand Gesture Decoding from Forearm Ultrasound Images via VLMcited by 1
  3. 2025Toward Reliable VLM: A Fine-Grained Benchmark and Framework for Exposure, Bias, and Inference in Korean Street Viewscited by 1
  4. 2024Constructive Apraxia: An Unexpected Limit of Instructible Vision-Language Models and Analog for Human Cognitive Disorderscited by 0
  5. 2025Beyond the Linear Separability Ceiling: Aligning Representations in VLMscited by 0
  6. 2025Augmented Vision-Language Models: A Systematic Reviewcited by 0
  7. 2025Spatio-Temporal Data Enhanced Vision-Language Model for Traffic Scene Understandingcited by 0
  8. 2025Beyond Memorization: A Multi-Modal Ordinal Regression Benchmark to Expose Popularity Bias in Vision-Language Modelscited by 0
  9. 2026NewsRECON: News Article Retrieval for Image Contextualizationcited by 0
  10. 2026LocationAgent: A Hierarchical Agent for Image Geolocation via Decoupling Strategy and Evidence from Parametric Knowledgecited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Probing Visual Language Priors in VLMs
  2. 2025VLMs have Tunnel Vision: Evaluating Nonlocal Visual Reasoning in Leading VLMs
  3. 2025SpaRE: Enhancing Spatial Reasoning in Vision-Language Models with Synthetic Data
  4. 2026Investigating Relational Reasoning in VLMs
  5. 2025[De|Re]constructing VLMs' Reasoning in Counting
  6. 2025Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models
  7. 2025Why Is Spatial Reasoning Hard for VLMs? An Attention Mechanism Perspective on Focus Areas
  8. 2024An Introduction to Vision-Language Modeling