Flow Reasoning Models: Turning Flows Into Efficient Recurrent Reasoners
On the map: LLM reasoning → Diffusion reasoning and test-time scaling
also in 1 more
Abstract (arXiv)
Structured reasoning requires making and revising interdependent decisions to reach a globally consistent solution. Existing architectures struggle with this: autoregressive models commit sequentially and cannot revise earlier decisions, while masked diffusion models often require careful decoding schemes to coordinate interdependent predictions. We introduce Flow Reasoning Models (FRMs), a novel framework for structured reasoning that adapts continuous flows over discrete structured outputs with a simple recurrent refinement mechanism. By self-conditioning a flow model on its own past outputs, we turn one-shot denoising into iterative solution refinement. This lets FRMs make and revise decisions in parallel, efficiently coordinating interdependent choices across solutions. Yet conventional self-conditioning becomes unreliable at greater recurrent depth due to exposure bias between one-step training predictions and recursively generated inference states. We address this mismatch with Fixed-Point Forcing (FPF), which trains FRMs on states produced by their own inference dynamics while preserving the standard flow-matching objective. FRMs achieve solve rates of 99.5%, 100.0%, and 99.9% on Sudoku-Extreme, Zebra, and Maze-Unique, respectively. On Sudoku-Extreme, FRMs achieve higher peak accuracy than the evaluated masked-diffusion and specialized reasoning baselines while remaining highly compute-efficient, matching the next-best method's 98.7% peak solve rate with 44× fewer inference FLOPs.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Diffusion reasoning and test-time scaling, one of 17 directions in LLM reasoning. Builds on 34 of its 38 references that are in the map. First posted on arXiv 28 Jun 2026.
Builds on
34 of 38 references.
Closest ancestors · 2
Same direction, newest first
- 2026Reasoning on the Manifold: Bidirectional Consistency for Self-Verification in Diffusion Language Models17 Apr
- 2025Remasking Discrete Diffusion Models with Inference-Time Scaling1 Mar
Other references · 32
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023Let's Verify Step by Stepcited by 3,598
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
- 2025Large Language Diffusion Modelscited by 872
- 2024Simple and Effective Masked Diffusion Language Modelscited by 800
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
- 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distributioncited by 712
- 2025Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approachcited by 372
- 2022Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioningcited by 362
- 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 273
20 more
- 2024Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMscited by 265
- 2024Iterative Reasoning Preference Optimizationcited by 244
- 2025Train for the Worst, Plan for the Best: Understanding Token Ordering in Masked Diffusionscited by 208
- 2024Preference Fine-Tuning of LLMs Should Leverage Suboptimal, On-Policy Datacited by 184
- 2025Scalable Best-of-N Selection for Large Language Models via Self-Certaintycited by 182
- 2024Token-level Direct Preference Optimizationcited by 135
- 2024Dynamical Regimes of Diffusion Modelscited by 133
- 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency modelscited by 99
- 2026Flow Map Language Models: One-step Language Modeling via Continuous Denoisingcited by 49
- 2025Fine-Tuning Masked Diffusion for Provable Self-Correctioncited by 39
- 2024Causal Language Modeling Can Elicit Search and Reasoning Capabilities on Logic Puzzlescited by 35
- 2025Memorization to Generalization: Emergence of Diffusion Models from Associative Memorycited by 35
- 2026LangFlow: Continuous Diffusion Rivals Discrete in Language Modelingcited by 28
- 2026ELF: Embedded Language Flowscited by 27
- 2026Discrete Flow Mapscited by 23
- 2026Fixed-Point Reasoners: Stable and Adaptive Deep Looped Transformerscited by 21
- 2025Preference-Based Alignment of Discrete Diffusion Modelscited by 12
- 2026Solve the Loop: Attractor Models for Language and Reasoningcited by 11
- 2026Ito maps for any-step SDEscited by 3
- 2026Cyclic Denoising Reveals Ultrastable Memories in Diffusion Modelscited by 1
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Energy-guided Recursive Modelcited by 1
- 2026Recursive Vision Language Models for General Symbolic Reasoningcited by 0
- 2026Reasoning with Neural Cellular Automatacited by 0
- 2026Unrolled Flow Models for Reasoningcited by 0
- 2026Think Before You Paint: Recursive Latent Reasoning for Diffusion Modelscited by 0
- 2026Think Before You Paint: Recursive Latent Reasoning for Diffusion Models7 Oct 2026
- 2026Unrolled Flow Models for Reasoning7 Oct 2026
- 2026Reasoning with Neural Cellular Automata28 Sep 2026
- 2026Recursive Vision Language Models for General Symbolic Reasoning2 Aug 2026
- 2026Energy-guided Recursive Model11 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Efficient Reasoning with Flow Language Models
- 2026Steering Large Reasoning Models towards Concise Reasoning via Flow Matching
- 2026Multi-Turn Reflective Masking Elicits Reasoning in Mask Diffusion Models
- 2026Test-Time Scaling with Diffusion Language Models via Reward-Guided Stitching
- 2026Sampling via Decision-Flow: Training-Free Extraction of Improved Latent Reasoning Paths in Large Language Models
- 2026Diffusion as a Training Curriculum for Timestep-Free Iterative Reasoning
- 2025EDIT: Early Diffusion Inference Termination for dLLMs Based on Dynamics of Training Gradients
- 2025Reasoning in Diffusion Large Language Models is Concentrated in Dynamic Confusion Zones