mlsanityData to 7 Oct 2026

Compete Then Collaborate: Frontier AI Teachers Build a Verifiable Curriculum to Improve a Coding Student Beyond Imitation

arXiv 2607.08255 ↗First posted 9 Jul 2026cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Large language models increasingly serve as teachers generating training data for smaller students. Prior multi-teacher knowledge distillation methods merge outputs without determining which frontier model teaches best, often relying on an LLM judge biased toward its own outputs. We introduce a compete-then-collaborate framework where four frontier AI teachers (Claude, Codex-GPT, Grok, Gemini) are ranked head-to-head by an execution-based judge (unit tests and stdin-stdout checks) with fairness controls, and then collaborate to build a verifiable curriculum for a student (Qwen2.5-Coder). We report three findings. (1) Under execution verification, all teachers solve standard problems near-perfectly after self-correction (99-100%) due to a saturation effect, but harder competition problems separate them (Gemini 77% > Claude 69% = Codex 69% > Grok 50%); however, the robust student-side results do not depend on teacher ranking. (2) Imitation (SFT) on verified solutions does not improve, and can degrade, an already-competent student at 7B and 32B (e.g., from 76.7% to 72.7% on MBPP-test, and 5.9% to 2.9% on competition problems). (3) Using the same collaborative curriculum as a reinforcement learning with verifiable rewards (RLVR) environment improves the student (from 5.9% to 8.8% peak on competition problems, a +49% relative gain), reversing SFT's direction. The value of AI-teacher collaboration lies not in pooling answers to imitate, but in jointly constructing a verifiable environment where the student learns by doing. We release a reproducible on-prem pipeline (NVIDIA GB10) with framework patches for running GRPO on a bleeding-edge stack.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 2 of its 6 references that are in the map. First posted on arXiv 9 Jul 2026.

Builds on

2 of 6 references.

References · 2

  1. 2025DistiLLM-2: A Contrastive Approach Boosts the Distillation of LLMscited by 73
  2. 2026Exploring Knowledge Purification in Multi-Teacher Knowledge Distillation for LLMscited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026AgentBrew: Lifelong Knowledge Brewing from Strong Teachers to Weak LLM Agents
  2. 2026Oracle Gap and Signal Fidelity: A Fixed-Pool Diagnostic for Test-Time Collaboration
  3. 2025Training Turn-by-Turn Verifiers for Dialogue Tutoring Agents: The Curious Case of LLMs as Your Coding Tutors
  4. 2025Student-Centered Distillation Narrows the Agentic Gap Between Small and Large LLMs
  5. 2026KASER: Knowledge-Aligned Student Error Simulator for Open-Ended Coding Tasks
  6. 2026Graph-Conditioned On-Policy Agent Distillation from Off-the-Shelf Teachers
  7. 2025The Signal is in the Steps: Local Scoring for Reasoning Data Selection
  8. 2026CORE: Collaborative Reasoning via Cross Teaching