mlsanityData to 7 Oct 2026

SpiralThinker: Latent Reasoning through an Iterative Process with Text-Latent Interleaving

arXiv 2511.08983 ↗First posted 12 Nov 2025cs.CLcited by 2

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Recent advances in large reasoning models have been driven by reinforcement learning and test-time scaling, accompanied by growing interest in latent rather than purely textual reasoning. However, existing latent reasoning methods lack mechanisms to ensure stable reasoning dynamics in latent space and a systematic way to interleave implicit and explicit reasoning. We introduce SpiralThinker, a stabilized iterative latent reasoning framework that performs iterative updates over latent representations while interleaving latent and textual reasoning steps. At its core, it combines a progressive alignment objective that explicitly regulates latent representations across iterations with structured annotations for text-latent interleaving, thereby stabilizing latent updates and maintaining coherence with textual reasoning. Across mathematical, logical, and commonsense reasoning tasks, SpiralThinker achieves state-of-the-art performance among latent reasoning baselines. Further analysis shows that both iteration and alignment are essential, that the optimal numbers of latent tokens and iterations vary by dataset, and that proper alignment is crucial for effective iterative latent reasoning. Overall, SpiralThinker bridges iterative computation and latent reasoning, demonstrating that aligned iterative updates can reliably steer reasoning in the latent space.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 19 of its 31 references that are in the map. First posted on arXiv 12 Nov 2025.

Builds on

19 of 31 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025Reasoning with Latent Thoughts: On the Power of Looped Transformers24 Feb
  2. 2025Inner Thinking Transformer: Leveraging Dynamic Depth Scaling to Foster Adaptive Internal Thinking19 Feb
  3. 2025Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approach7 Feb
  4. 2025Token Assorted: Mixing Latent and Text Tokens for Improved Language Model Reasoning5 Feb
  5. 2024Compressed Chain of Thought: Efficient Reasoning Through Dense Representations17 Dec
  6. 2023Think before you speak: Training Language Models With Pause Tokens3 Oct

Other references · 13

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
  3. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
  4. 2021Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategiescited by 736
  5. 2018Universal Transformerscited by 613
  6. 2024From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by Stepcited by 225
  7. 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillationcited by 216
  8. 2024Chain-of-Thought Reasoning Without Promptingcited by 208
  9. 2024Let's Think Dot by Dot: Hidden Computation in Transformer Language Modelscited by 186
  10. 2025SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMscited by 110
  11. 2025Soft Thinking: Unlocking the Reasoning Potential of LLMs in Continuous Concept Spacecited by 109
  12. 2025Implicit Reasoning in Large Language Models: A Comprehensive Surveycited by 42
1 more
  1. 2025Enhancing Auto-regressive Chain-of-Thought through Loop-Aligned Reasoningcited by 19

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025A Survey on Latent Reasoning
  2. 2025Learning When to Stop: Adaptive Latent Reasoning via Reinforcement Learning
  3. 2026Thinking in Latents: Adaptive Anchor Refinement for Implicit Reasoning in LLMs
  4. 2026Why Struggle with Continuous Latents? Interpretable Discrete Latent Reasoning via Rendered Compression
  5. 2026CALR: Continuous Anchored Latent Reasoning via Render-of-Thought Compression
  6. 2026Inference-Time Rethinking with Latent Thought Vectors for Math Reasoning
  7. 2026Adaptive Latent Agentic Reasoning
  8. 2026Latent Thought Flow: Efficient Latent Reasoning in Large Language Models