mlsanityData to 14 Oct 2026

Thinking with Images without Coordinates

arXiv 2610.14265 ↗First posted 9 Oct 2026cs.CVcited by 0

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Recent advances in multi-modal large language models have shifted toward the "thinking with images" paradigm to improve reasoning faithfulness, yet existing methods rely heavily on explicit coordinate- based grounding. We identify two fundamental limitations in this approach, i.e., a semantic gap where sparse regressions miss high-dimensional latent structures, and a resolution gap due to the granularity mismatch between patch-level tokens and pixel-level coordinates. To address these, we propose TiCO (Thinking with images without COordinates). It reformulates visual reasoning as a semantic evidence discovery process within the latent space, and evidence is injected as token-level regions without pixel coordinates. Specifically, TiCO utilizes a dedicated probe token to estimate similarity distributions and performs importance sampling over spatially connected components to generate diverse, semantically dominant evidence rollouts. Extensive experiments across multiple high-resolution and general visual reasoning benchmarks demonstrate that our TiCO consistently outperforms state-of-the-art coordinate-based methods with significantly improved inference efficiency.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 49 of its 56 references that are in the map. First posted on arXiv 9 Oct 2026.

Builds on

49 of 56 references.

Closest ancestors · 22

Same direction, newest first

  1. 2025High-Resolution Visual Reasoning via Multi-Turn Grounding-Based Reinforcement Learning8 Jul
  2. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun
  3. 2025VGR: Visual Grounded Reasoning13 Jun
  4. 2025Multi-Step Visual Reasoning with Visual Tokens Scaling and Verification8 Jun
  5. 2025Rex-Thinker: Grounded Object Referring via Chain-of-Thought Reasoning4 Jun
  6. 2025Grounded Reinforcement Learning for Visual Reasoning29 May
  7. 2025Ground-R1: Incentivizing Grounded Visual Reasoning via Reinforcement Learning26 May
  8. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
  9. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  10. 2025Perception-R1: Pioneering Perception Policy with Reinforcement Learning10 Apr
  11. 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
  12. 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
10 more
  1. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
  2. 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL10 Mar
  3. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
  4. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  5. 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
  6. 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMs10 Jan
  7. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
  8. 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning25 Mar
  9. 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb
  10. 2023See, Think, Confirm: Interactive Prompting Between Vision and Language Models for Knowledge-based Visual Reasoning12 Jan

Other references · 27

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  5. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  8. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  9. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  10. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
  11. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
  12. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
15 more
  1. 2022Towards Reasoning in Large Language Models: A Surveycited by 596
  2. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
  3. 2021Pix2seq: A Language Modeling Framework for Object Detectioncited by 349
  4. 2025Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Modelscited by 293
  5. 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?cited by 292
  6. 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 199
  7. 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 175
  8. 2024Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Large Language Modelscited by 161
  9. 2025Mini-o3: Scaling Up Reasoning Patterns and Interaction Turns for Visual Searchcited by 120
  10. 2024Pride and Prejudice: LLM Amplifies Self-Bias in Self-Refinementcited by 114
  11. 2025GUI-Actor: Coordinate-Free Visual Grounding for GUI Agentscited by 95
  12. 2025Traceable Evidence Enhanced Visual Grounded Reasoning: Evaluation and Methodologycited by 69
  13. 2025DyFo: A Training-Free Dynamic Focus Visual Search for Enhancing LMMs in Fine-Grained Visual Understandingcited by 49
  14. 2024UniBias: Unveiling and Mitigating LLM Bias through Internal Attention and FFN Manipulationcited by 31
  15. 2025Discrete Tokenization for Multimodal LLMs: A Comprehensive Surveycited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Retrieve, Integrate, and Synthesize: Spatial-Semantic Grounded Latent Visual Reasoning
  2. 2026Beyond Accuracy: Evaluating Grounded Visual Evidence in Thinking with Images
  3. 2026LookWise: Knowing When and Where to Look for Fine-Grained Visual Reasoning in Multimodal Large Language Models
  4. 2026DeepScan: A Training-Free Framework for Visually Grounded Reasoning in Large Vision-Language Models
  5. 2026Rethinking Latent Visual Reasoning: Grounding Latent Reasoning in Visual Evidence
  6. 2026How and What to Imagine? Visual Thinking in Unified Multimodal Models for Cross-View Spatial Reasoning
  7. 2025LaRe: Latent Refocusing for Multimodal Reasoning
  8. 2025v1: Learning to Point Visual Tokens for Multimodal Grounded Reasoning