mlsanityData to 7 Oct 2026

ImpRIF: Stronger Implicit Reasoning Leads to Better Complex Instruction Following

arXiv 2602.21228 ↗First posted 4 Feb 2026cs.CL cs.AIcited by 3

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

As applications of large language models (LLMs) become increasingly complex, the demand for robust complex instruction following capabilities is growing accordingly. We argue that a thorough understanding of the instruction itself, especially the latent reasoning structure embedded between the lines, is crucial for improving instruction following. Therefore we target complex instructions that involve implicit reasoning, intricate logical relations, and multi-constraint dependencies. We propose ImpRIF, a method to enhance LLMs' understanding of implicit reasoning instructions, thereby improving its ability to follow complex instructions. We formalize such instructions as verifiable reasoning graphs, enabling programmatic verification and graph-driven chain-of-thought reasoning. Based on this formulation, we synthesize large-scale single- and multi-turn data, propose fine-tuning with graph reasoning, and apply reinforcement learning to explicitly train models to reason along the graph. On five complex instruction following benchmarks, our models substantially outperform their base models. These results demonstrate that enhancing implicit reasoning capabilities can significantly improve complex instruction following.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 15 of its 49 references that are in the map. First posted on arXiv 4 Feb 2026.

Builds on

15 of 49 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Qwen3 Technical Report14 May

Other references · 14

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2024Qwen2.5 Technical Reportcited by 4,713
  4. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  5. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
  6. 2025Kimi K2: Open Agentic Intelligencecited by 523
  7. 2025DeepSeekMath-V2: Towards Self-Verifiable Mathematical Reasoningcited by 84
  8. 2025MM-IFEngine: Towards Multimodal Instruction Followingcited by 41
  9. 2025Scaling Reasoning, Losing Control: Evaluating Instruction Following in Large Reasoning Modelscited by 28
  10. 2024Conifer: Improving Complex Constrained Instruction-Following Ability of Large Language Modelscited by 26
  11. 2025Incentivizing Reasoning for Advanced Instruction-Following of Large Language Modelscited by 17
  12. 2025MulDimIF: A Multi-Dimensional Constraint Framework for Evaluating and Improving Instruction Following in Large Language Modelscited by 13
2 more
  1. 2025EIFBENCH: Extremely Complex Instruction Following Benchmark for Large Language Modelscited by 9
  2. 2025Light-IF: Endowing LLMs with Generalizable Reasoning via Preview and Self-Checking for Complex Instruction Followingcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025ReasonIF: Large Reasoning Models Fail to Follow Instructions During Reasoning
  2. 2025When Thinking Fails: The Pitfalls of Reasoning for Instruction-Following in LLMs
  3. 2026Bridging Auxiliary Constraints to Resolve Instruction Following in Large Reasoning Models
  4. 2023Ada-Instruct: Adapting Instruction Generators for Complex Reasoning
  5. 2025Effectively Controlling Reasoning Models through Thinking Intervention
  6. 2025Implicit Reasoning in Large Language Models: A Comprehensive Survey
  7. 2025Beyond the Trade-off: Self-Supervised Reinforcement Learning for Reasoning Models' Instruction Following
  8. 2025Reasoning Up the Instruction Ladder for Controllable Language Models