mlsanityData to 7 Oct 2026

Flow Reasoning Models: Turning Flows Into Efficient Recurrent Reasoners

arXiv 2606.29150 ↗First posted 28 Jun 2026cs.AIcited by 5

On the map: LLM reasoning → Diffusion reasoning and test-time scaling

also in 1 more
Abstract (arXiv)

Structured reasoning requires making and revising interdependent decisions to reach a globally consistent solution. Existing architectures struggle with this: autoregressive models commit sequentially and cannot revise earlier decisions, while masked diffusion models often require careful decoding schemes to coordinate interdependent predictions. We introduce Flow Reasoning Models (FRMs), a novel framework for structured reasoning that adapts continuous flows over discrete structured outputs with a simple recurrent refinement mechanism. By self-conditioning a flow model on its own past outputs, we turn one-shot denoising into iterative solution refinement. This lets FRMs make and revise decisions in parallel, efficiently coordinating interdependent choices across solutions. Yet conventional self-conditioning becomes unreliable at greater recurrent depth due to exposure bias between one-step training predictions and recursively generated inference states. We address this mismatch with Fixed-Point Forcing (FPF), which trains FRMs on states produced by their own inference dynamics while preserving the standard flow-matching objective. FRMs achieve solve rates of 99.5%, 100.0%, and 99.9% on Sudoku-Extreme, Zebra, and Maze-Unique, respectively. On Sudoku-Extreme, FRMs achieve higher peak accuracy than the evaluated masked-diffusion and specialized reasoning baselines while remaining highly compute-efficient, matching the next-best method's 98.7% peak solve rate with 44× fewer inference FLOPs.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Diffusion reasoning and test-time scaling, one of 17 directions in LLM reasoning. Builds on 34 of its 38 references that are in the map. First posted on arXiv 28 Jun 2026.

Builds on

34 of 38 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026Reasoning on the Manifold: Bidirectional Consistency for Self-Verification in Diffusion Language Models17 Apr
  2. 2025Remasking Discrete Diffusion Models with Inference-Time Scaling1 Mar

Other references · 32

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  3. 2022Flow Matching for Generative Modelingcited by 5,426
  4. 2023Let's Verify Step by Stepcited by 3,598
  5. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
  6. 2025Large Language Diffusion Modelscited by 872
  7. 2024Simple and Effective Masked Diffusion Language Modelscited by 800
  8. 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
  9. 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distributioncited by 712
  10. 2025Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approachcited by 372
  11. 2022Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioningcited by 362
  12. 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 273
20 more
  1. 2024Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMscited by 265
  2. 2024Iterative Reasoning Preference Optimizationcited by 244
  3. 2025Train for the Worst, Plan for the Best: Understanding Token Ordering in Masked Diffusionscited by 208
  4. 2024Preference Fine-Tuning of LLMs Should Leverage Suboptimal, On-Policy Datacited by 184
  5. 2025Scalable Best-of-N Selection for Large Language Models via Self-Certaintycited by 182
  6. 2024Token-level Direct Preference Optimizationcited by 135
  7. 2024Dynamical Regimes of Diffusion Modelscited by 133
  8. 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency modelscited by 99
  9. 2026Flow Map Language Models: One-step Language Modeling via Continuous Denoisingcited by 49
  10. 2025Fine-Tuning Masked Diffusion for Provable Self-Correctioncited by 39
  11. 2024Causal Language Modeling Can Elicit Search and Reasoning Capabilities on Logic Puzzlescited by 35
  12. 2025Memorization to Generalization: Emergence of Diffusion Models from Associative Memorycited by 35
  13. 2026LangFlow: Continuous Diffusion Rivals Discrete in Language Modelingcited by 28
  14. 2026ELF: Embedded Language Flowscited by 27
  15. 2026Discrete Flow Mapscited by 23
  16. 2026Fixed-Point Reasoners: Stable and Adaptive Deep Looped Transformerscited by 21
  17. 2025Preference-Based Alignment of Discrete Diffusion Modelscited by 12
  18. 2026Solve the Loop: Attractor Models for Language and Reasoningcited by 11
  19. 2026Ito maps for any-step SDEscited by 3
  20. 2026Cyclic Denoising Reveals Ultrastable Memories in Diffusion Modelscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Efficient Reasoning with Flow Language Models
  2. 2026Steering Large Reasoning Models towards Concise Reasoning via Flow Matching
  3. 2026Multi-Turn Reflective Masking Elicits Reasoning in Mask Diffusion Models
  4. 2026Test-Time Scaling with Diffusion Language Models via Reward-Guided Stitching
  5. 2026Sampling via Decision-Flow: Training-Free Extraction of Improved Latent Reasoning Paths in Large Language Models
  6. 2026Diffusion as a Training Curriculum for Timestep-Free Iterative Reasoning
  7. 2025EDIT: Early Diffusion Inference Termination for dLLMs Based on Dynamics of Training Gradients
  8. 2025Reasoning in Diffusion Large Language Models is Concentrated in Dynamic Confusion Zones