mlsanityData to 14 Oct 2026

Context Pruning for Coding Agents via Multi-Rubric Latent Reasoning

arXiv 2605.15315 ↗First posted 14 May 2026cs.AI cs.CLcited by 2

On the map: LLM reasoning → Test-time compute and efficient thinking

also in 1 more
Abstract (arXiv)

LLM-powered coding agents spend the majority of their token budget reading repository files, yet much of the retrieved code is irrelevant to the task at hand. Existing learned pruners compress this context with a single-objective sequence labeler, collapsing all facets of code relevance into one score and one transition matrix. We show that this formulation creates a modeling bottleneck: a single CRF transition prior must serve heterogeneous retention patterns, including contiguous semantic spans and sparse structural support lines. We propose LaMR (Latent Multi-Rubric), a structured pruning framework that decomposes code relevance into two interpretable quality dimensions, semantic evidence and dependency support, each modeled by a dedicated CRF with dimension-specific transition dynamics. A mixture-of-experts gating network dynamically weights the per-rubric emissions conditioned on the query, and a final CRF layer on the fused emissions produces the aggregate keep-or-prune decision. To supervise each dimension without additional annotation cost, we derive multi-rubric labels from the existing training corpus via AST-based program analysis, simultaneously denoising the teacher's binary labels. By effectively filtering distracting noise, LaMR frequently matches or even outperforms unpruned full-context baselines. Experiments on four benchmarks (SWE-Bench Verified, SWE-QA, LCC, LongCodeQA) show that LaMR wins 12 of 16 head-to-head multi-turn comparisons. It saves up to 31% more tokens on multi-turn agent tasks and improves Exact Match by up to +3.5 on single-turn tasks, while performance is frequently enhanced by denoising the context, and any remaining drops are marginal.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 18 of its 37 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

18 of 37 references.

References · 18

  1. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  2. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  3. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  4. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  5. 2025LLMs Get Lost In Multi-Turn Conversationcited by 429
  6. 2022UniXcoder: Unified Cross-Modal Pre-training for Code Representationcited by 361
  7. 2023RepoBench: Benchmarking Repository-Level Code Auto-Completion Systemscited by 353
  8. 2025Scaling Long-Horizon LLM Agent via Context-Foldingcited by 148
  9. 2025ACON: Optimizing Context Compression for Long-horizon LLM Agentscited by 136
  10. 2025AgentFold: Long-Horizon Web Agents with Proactive Context Managementcited by 103
  11. 2025Scaling LLM Multi-turn RL with End-to-end Summarization-based Context Managementcited by 51
  12. 2025The Complexity Trap: Simple Observation Masking Is as Efficient as LLM Summarization for Agent Context Managementcited by 48
6 more
  1. 2026SWE-Pruner: Self-Adaptive Context Pruning for Coding Agentscited by 44
  2. 2025LongCodeZip: Compress Long Context for Code Language Modelscited by 39
  3. 2025SWE-QA: Can Language Models Answer Repository-level Code Questions?cited by 38
  4. 2025LongCodeBench: Evaluating Coding LLMs at 1M Context Windowscited by 37
  5. 2025Auto-Rubric: Learning From Implicit Weights to Explicit Rubrics for Reward Modelingcited by 30
  6. 2025COMPASS: Enhancing Agent Long-Horizon Reasoning with Evolving Contextcited by 20

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Squeez: Task-Conditioned Tool-Output Pruning for Coding Agents
  2. 2026SWE-Pruner Pro: The Coder LLM Already Knows What to Prune
  3. 2026Agent Retrieval Bench: Evaluating Repository Context Retrieval for Coding Agents
  4. 2026Latent Programming Horizons in Coding Agents
  5. 2026FastContext: Training Efficient Repository Explorer for Coding Agents
  6. 2026LongAttnComp: Cross-Family Context Compression for Long-Context Reasoning
  7. 2026VITAL-RAG: Invariance Race for Context Allocation in Coding Agents
  8. 2026RuPLaR : Efficient Latent Compression of LLM Reasoning Chains with Rule-Based Priors From Multi-Step to One-Step