mlsanityData to 14 Oct 2026

Avoiding What Your Teacher Already Knows: Entity Familiarity for Deep-Search Distillation

arXiv 2610.16251 ↗First posted 12 Oct 2026cs.CL cs.AIcited by 0

On the map: Knowledge distillation → Knowledge distillation for LLMs

Abstract (arXiv)

Deep-search agents are commonly trained by distilling tool-use trajectories from stronger teacher models. However, structurally complex questions may remain relatively easy for teachers familiar with key entities in the underlying entity graph, resulting in lower search demand and weaker supervision. We refer to this teacher-specific variation in question difficulty as teacher-relative difficulty and investigate entity familiarity as an early predictor. We first introduce Evidence-Verified Entity Familiarity (EVF), which estimates familiarity by verifying a teacher-generated factual brief against online evidence. Across multiple teachers, EVF is significantly correlated with teacher-relative difficulty with AUCs of 0.60--0.70. However, its high cost makes it impractical for constructing entity graphs at scale. To address this limitation, we propose Self-Reported Entity Familiarity (SEF), a lightweight gating signal that directly asks a teacher whether it is familiar with an entity before admitting that entity into the graph. Across multiple teachers, trajectories from SEF-gated synthesis exhibit greater observed search demand and yield higher downstream student accuracy than those from ungated synthesis. Because familiarity is teacher specific, we further study cross-teacher reuse. We screen graphs collected for other teachers using Kimi-K3's SEF judgments and use the retained graphs to produce 5,411 additional trajectories. Combined with 2,200 trajectories from newly constructed, SEF-gated graphs, these data improve Qwen3.8-27B's accuracy from 44.10% to 66.41% on a BrowseComp subset, and achieving state-of-the-art performance among models of comparable size on BrowseComp, SEAL-0, HLE-text, and xbench. Overall, SEF provides a low-cost way to synthesize more informative supervision for deep-search distillation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Knowledge distillation for LLMs, one of 12 directions in Knowledge distillation. Builds on 36 of its 46 references that are in the map. First posted on arXiv 12 Oct 2026.

Builds on

36 of 46 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Distilling LLM Agent into Small Models with Retrieval and Code Tools23 May

Other references · 35

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
  3. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
  4. 2024Phi-4 Technical Reportcited by 711
  5. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
  6. 2025WebSailor: Navigating Super-human Reasoning for Web Agentcited by 229
  7. 2025BrowseComp-ZH: Benchmarking Web Browsing Ability of Large Language Models in Chinesecited by 145
  8. 2025WebShaper: Agentically Data Synthesizing via Information-Seeking Formalizationcited by 121
  9. 2024On-Device Language Models: A Comprehensive Reviewcited by 104
  10. 2025SealQA: Raising the Bar for Reasoning in Search-Augmented Language Modelscited by 75
  11. 2025Tongyi DeepResearch Technical Reportcited by 66
  12. 2025TaskCraft: Automated Generation of Agentic Taskscited by 51
23 more
  1. 2026Dr. Zero: Self-Evolving Search Agents without Training Datacited by 44
  2. 2026OpenSeeker: Democratizing Frontier Search Agents by Fully Open-Sourcing Training Datacited by 39
  3. 2026OpenResearcher: A Fully Open Pipeline for Long-Horizon Deep Research Trajectory Synthesiscited by 37
  4. 2025Search-Time Data Contaminationcited by 19
  5. 2025WebLeaper: Empowering Efficiency and Efficacy in WebAgent via Enabling Info-Rich Seekingcited by 18
  6. 2025Open Data Synthesis For Deep Researchcited by 16
  7. 2026OffSeeker: Online Reinforcement Learning Is Not All You Need for Deep Research Agentscited by 12
  8. 2026QUEST: Training Frontier Deep Research Agents with Fully Synthetic Taskscited by 11
  9. 2026DeepResearch-9K: A Challenging Benchmark Dataset of Deep-Research Agentcited by 10
  10. 2026Search-Time Contamination in Deep Research Agents: Measuring Performance Inflation in Public Benchmark Evaluationcited by 9
  11. 2026To Search or Not to Search: Aligning the Decision Boundary of Deep Search Agents via Causal Interventioncited by 7
  12. 2026FORT-Searcher: Synthesizing Shortcut-Resistant Search Tasks for Training Deep Search Agentscited by 7
  13. 2026LiveBrowseComp: Are Search Agents Searching, or Just Verifying What They Already Know?cited by 5
  14. 2026AREX: Towards a Recursively Self-Improving Agent for Deep Researchcited by 5
  15. 2025Synthesizing Agentic Data for Web Agents with Progressive Difficulty Enhancement Mechanismscited by 4
  16. 2026EvoBrowseComp: Benchmarking Search Agents on Evolving Knowledgecited by 3
  17. 2026When Should LLMs Search? Counterfactual Supervision for Search Routingcited by 3
  18. 2026Think Big, Search Small: Where Capacity Matters in Hierarchical Search Agents?cited by 3
  19. 2026SearchMaster: Grounded and Regulated Self-Play for Search Agentscited by 3
  20. 2026Evaluating the Search Agent in a Parallel Worldcited by 2
  21. 2026DeepSearch-World: Self-Distillation for Deep Search Agents in a Verifiable Environmentcited by 2
  22. 2026SearchAuditor: Auditing and Attributing Failures in Long-Horizon Search Agentscited by 2
  23. 2026SAGE: Steerable Agentic Data Generation for Deep Search with Execution Feedbackcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Who Taught You That? Tracing Teachers in Model Distillation
  2. 2026Task-Specific Knowledge Distillation via Intermediate Probes
  3. 2023Comparative Knowledge Distillation
  4. 2023On student-teacher deviations in distillation: does it pay to disobey?
  5. 2026A Controlled Study of Feature-Based Knowledge Distillation Across Student Designs
  6. 2026RAPID: Reliability-Aware Pair Importance Distillation
  7. 2024Wisdom of Committee: Diverse Distillation from Large Foundation Models and Domain Experts
  8. 2026Distilling Directional Verification