mlsanityData to 7 Oct 2026

FlyRoute: Self-Evolving Agent Profiling via Data Flywheel for Adaptive Task Routing

arXiv 2605.22057 ↗First posted 21 May 2026cs.CLcited by 1

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

also in 1 more
Abstract (arXiv)

Enterprise routers assign queries to expert agents, yet deployed profiles stay static while agents evolve (prompts, tools, models), and developers rarely keep descriptions or exemplars current. We present FlyRoute, a self-evolving profiling framework that grows capability evidence from real traffic: dispatch candidates, quality-gate successful pairs into each agent's success store, periodically distill evidence into learned capability descriptions, and inject those descriptions together with BM25-retrieved successes into an LLM router. To make this flywheel data-efficient, FlyRoute introduces a targeted exploration policy that combines profile uncertainty, BM25 relevance, and lexical novelty, prioritizing under-profiled agents only for plausible queries and avoiding redundant evidence collection. In experiments on our proprietary enterprise developer-support dataset of real routed queries, FlyRoute improves a same-backbone zero-shot LLM router from 72.57% to 78.04% with only five seed queries per agent, showing that profile retrieval already strengthens cold-start routing. After streaming 7,211 labeled training queries through the flywheel, accuracy rises to 89.83% (+17.26pp over zero-shot; +11.79pp over cold start), with consistent gains across four expert domains under standard routing accuracy on single-gold test queries.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 16 of its 35 references that are in the map. First posted on arXiv 21 May 2026.

Builds on

16 of 35 references.

References · 16

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  3. 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
  4. 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 633
  5. 2023LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusioncited by 550
  6. 2024Hybrid LLM: Cost-Efficient and Quality-Aware Query Routingcited by 354
  7. 2023Large Language Model Routing with Benchmark Datasetscited by 166
  8. 2024GraphRouter: A Graph-based Router for LLM Selectionscited by 154
  9. 2025Universal Model Routing for Efficient LLM Inferencecited by 80
  10. 2024Learning to Route LLMs with Confidence Tokenscited by 66
  11. 2025AgentRouter: A Knowledge-Graph-Guided LLM Router for Collaborative Multi-Agent Question Answeringcited by 29
  12. 2025ICL-Router: In-Context Learned Model Representations for LLM Routingcited by 26
4 more
  1. 2025Leveraging Uncertainty Estimation for Efficient LLM Routingcited by 21
  2. 2024MoDEM: Mixture of Domain Expert Modelscited by 9
  3. 2025Arch-Router: Aligning LLM Routing with Human Preferencescited by 9
  4. 2025Dynamic LLM Routing and Selection based on User Preferences: Balancing Performance, Cost, and Ethicscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026CASTER: Breaking the Cost-Performance Barrier in Multi-Agent Orchestration via Context-Aware Strategy for Task Efficient Routing
  2. 2026AgentRouter: Heterogeneous Model Routing for Cost-Optimal Multi-Step Agentic Workflows
  3. 2026Agentic Routing: The Harness-Native Data Flywheel
  4. 2026Learning Compositional Meta-Routing for Agentic Workflows: An Executable Benchmark
  5. 2026Learning Agent Routing From Early Experience
  6. 2026RSI-Router: Evolving Subtask-Level LLM Routing and Skills for Cost-Efficient Agents
  7. 2026TROVE: Adaptive Agent Skill Orchestration via Trace-Grounded Route Validation and Editing
  8. 2026EvoAgentBench: Benchmarking Agent Self-Evolution via Ability Transfer