TACIT: Transformation-Aware Capturing of Implicit Thought
On the map: LLM reasoning → Multimodal reasoning
also in 1 more
Abstract (arXiv)
We present TACIT (Transformation-Aware Capturing of Implicit Thought), a diffusion-based transformer for interpretable visual reasoning. Unlike language-based reasoning systems, TACIT operates entirely in pixel space using rectified flow, enabling direct visualization of the reasoning process at each inference step. We demonstrate the approach on maze-solving, where the model learns to transform images of unsolved mazes into solutions. Key results on 1 million synthetic maze pairs include: - 192x reduction in training loss over 100 epochs - 22.7x improvement in L2 distance to ground truth - Only 10 Euler steps required (vs. 100-1000 for typical diffusion models) Quantitative analysis reveals a striking phase transition phenomenon: the solution remains invisible for 68% of the transformation (zero recall), then emerges abruptly at t=0.70 within just 2% of the process. Most remarkably, 100% of samples exhibit simultaneous emergence across all spatial regions, ruling out sequential path construction and providing evidence for holistic rather than algorithmic reasoning. This "eureka moment" pattern -- long incubation followed by sudden crystallization -- parallels insight phenomena in human cognition. The pixel-space design with noise-free flow matching provides a foundation for understanding how neural networks develop implicit reasoning strategies that operate below and before language.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 12 of its 25 references that are in the map. First posted on arXiv 5 Feb 2026.
Builds on
12 of 25 references.
References · 12
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2018Recurrent World Models Facilitate Policy Evolutioncited by 761
- 2022Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasetscited by 599
- 2019RAVEN: A Dataset for Relational and Analogical Visual rEasoNingcited by 225
- 2018Measuring abstract reasoning in neural networkscited by 165
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Flow-of-Thought: A Framework for Visual Reasoning
- 2026Think in Strokes, Not Pixels: Process-Driven Image Generation via Interleaved Reasoning
- 2026Think Before You Paint: Recursive Latent Reasoning for Diffusion Models
- 2025Journey Before Destination: On the importance of Visual Faithfulness in Slow Thinking
- 2025From Illusion to Intention: Visual Rationale Learning for Vision-Language Reasoning
- 2025ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoning
- 2025Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Space
- 2026Mind-Brush: Integrating Agentic Cognitive Search and Reasoning into Image Generation