Overtaught, Underlearned: Learner-Centered Distillation from Multi-Agent Discussion
Not on the map. Why?
Abstract (arXiv)
Multi-agent discussion produces reasoning collaboratively, while deployment still relies on a smaller student that must answer alone. Full-graph distillation transfers such discussions by treating each correct solution as a separate training target, but what teachers provide need not match what the student learns. This mismatch appears in two ways: several correct solutions may amount to the same lesson in the student's representation (over-teaching), while some training questions remain missed after learning (under-learning). We quantify both with rates that are high on discussion graphs. To address them, we introduce FAR (Fold--Attempt--Revisit), a learner-centered distillation procedure that organizes supervision around the student's own state. Before training, FAR folds solutions within each discussion state into representative lessons. After training, the student's own attempts identify missed questions, while poorly represented clusters indicate where folding may have lost useful variation; FAR then writes targeted lessons from retained discussion contexts. Across two students and four reasoning tasks, FAR outperforms full-graph distillation with far fewer training targets and lower under-learning. Further analyses examine the behavior of FAR and the sources of its gains. Overall, the results show that organizing discussion supervision around the student can make distillation both more effective and more efficient.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 42 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
26 of 42 references.
References · 26
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 939
- 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 878
- 2021Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategiescited by 743
- 2021Deduplicating Training Data Makes Language Models Bettercited by 714
- 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 678
- 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 543
- 2024LESS: Selecting Influential Data for Targeted Instruction Tuningcited by 532
- 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMscited by 309
14 more
- 2025Multiagent Finetuning: Self Improvement with Diverse Reasoning Chainscited by 95
- 2025DistiLLM-2: A Contrastive Approach Boosts the Distillation of LLMscited by 84
- 2025Debate or Vote: Which Yields Better Decisions in Multi-Agent Large Language Models?cited by 81
- 2024MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Modelscited by 43
- 2026Explain in Your Own Words: Improving Reasoning via Token-Selective Dual Knowledge Distillationcited by 16
- 2026Multi-Agent Debate with Memory Maskingcited by 10
- 2025Towards Efficient CoT Distillation: Self-Guided Rationale Selector for Better Performance with Fewer Rationalescited by 8
- 2025In Good GRACEs: Principled Teacher Selection for Knowledge Distillationcited by 5
- 2025Improved Bounds for Private and Robust Alignmentcited by 5
- 2026Latent Agents: A Post-Training Procedure for Internalized Multi-Agent Debatecited by 5
- 2025SMAGDi: Socratic Multi Agent Interaction Graph Distillation for Efficient High Accuracy Reasoningcited by 4
- 2026From Experience to Skill: Multi-Agent Generative Engine Optimization via Reusable Strategy Learningcited by 4
- 2026Pedagogically-Inspired Data Synthesis for Language Model Knowledge Distillationcited by 3
- 2025Vocabulary embeddings organize linguistic structure early in language model trainingcited by 2
Built on by
Not cited yet.