mlsanityData to 7 Oct 2026

DAIS: Dependency-Aware Intermediate QA Supervision for Complex Reasoning

arXiv 2607.19088 ↗First posted 21 Jul 2026cs.CL cs.AIcited by 0

On the map: LLM reasoning → Prompting and chain-of-thought reasoning

Abstract (arXiv)

Chain-of-thought (CoT) supervision exposes intermediate rationales, but flat rationale targets usually optimize a single reasoning sequence and provide limited supervision on how local conclusions should support later decisions. We introduce Dependency-Aware Intermediate QA Supervision (DAIS), a training-time framework that converts filtered teacher rationales into stage-level QA records. Each intermediate record predicts a local answer conditioned on the previous states needed for that decision, while the final-answer record keeps the original task format; evaluation therefore uses only the original input and optional context. Across GDPR, AIACT, MedQA, and FOLIO with multiple Qwen backbones, DAIS improves average final-answer accuracy over answer-only, flat chain-of-thought, and independent-QA baselines. On policy-compliance benchmarks, it achieves a largest gain of 5.6% and an average gain of 4.2% over the strongest non-DAIS baseline. Controlled ablations show that valid previous-state conditioning contributes beyond longer targets or additional intermediate text, supporting dependency-conditioned intermediate QA as a lightweight auxiliary supervision signal for standard final-answer inference.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 17 of its 23 references that are in the map. First posted on arXiv 21 Jul 2026.

Builds on

17 of 23 references.

Closest ancestors · 3

Same direction, newest first

  1. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Prompting7 May
  2. 2022Teaching Small Language Models to Reason16 Dec
  3. 2022Large Language Models are Zero-Shot Reasoners24 May

Other references · 14

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  3. 2023Let's Verify Step by Stepcited by 3,598
  4. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
  5. 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,054
  6. 2019Attention is not Explanationcited by 916
  7. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
  8. 2022Solving math word problems with process- and outcome-based feedbackcited by 871
  9. 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
  10. 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 554
  11. 2019ERASER: A Benchmark to Evaluate Rationalized NLP Modelscited by 523
  12. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
2 more
  1. 2016Rationalizing Neural Predictionscited by 281
  2. 2025PrivaCI-Bench: Evaluating Privacy with Contextual Integrity and Legal Compliancecited by 34

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025QFFT, Question-Free Fine-Tuning for Adaptive Reasoning
  2. 2025Attentive Reasoning Queries: A Systematic Method for Optimizing Instruction-Following in Large Language Models
  3. 2026SAFE: An LLM-as-Verifier Framework for Evidence-Grounded Multi-Hop Reasoning
  4. 2025ReasoningShield: Safety Detection over Reasoning Traces of Large Reasoning Models
  5. 2026APR: Penalizing Structural Redundancy in Large Reasoning Models via Anchor-based Process Rewards
  6. 2026MI-Distillation: Selecting from Model-Interpolated Instruct-Reasoning Data Spectrum for Chain-of-Thought Distillation
  7. 2023Knowledge-Driven CoT: Exploring Faithful Reasoning in LLMs for Knowledge-intensive Question Answering
  8. 2025FRIT: Using Causal Importance to Improve Chain-of-Thought Faithfulness