mlsanityData to 7 Oct 2026

MAP4CS: A Multi-dimensional Data Pruning Framework for Efficient Code Retriever Fine-tuning

arXiv 2610.11727 ↗First posted 8 Oct 2026cs.SE cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Retrieval-Augmented Generation (RAG) has become a cornerstone in software engineering for enhancing Large Language Models (LLMs) with domain-specific knowledge. However, adapting retrievers to evolving code repositories remains challenging due to the noise and redundancy inherent in massive code corpora. Standard fine-tuning on the full corpus is computationally expensive and often leads to sub-optimal performance due to negative transfer from low-quality samples. Conversely, simple random sampling fails to guarantee data representativeness. To address these challenges, we propose MAP4CS (Multi-dimensional Awareness Pruning for Code Search), an adaptive data pruning framework. MAP4CS identifies a small, high-quality core subset by integrating syntactic structure, semantic diversity, and distributional representation, followed by a rigorous rule-based filtering pipeline. Extensive experiments on two large-scale datasets demonstrate that MAP4CS consistently outperforms random sampling baselines using only 5% of the training data. Remarkably, it achieves performance comparable to, or even superior to, fine-tuning on the full dataset, validating the ''less is more'' hypothesis in data-centric AI. Furthermore, linguistic analysis reveals an adaptive optimization mechanism: MAP4CS automatically functions as a de-duplicator for redundant corpora and a denoiser for chaotic ones, constructing a training corpus that is both lexically diverse and information-dense.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 65 references that are in the map. First posted on arXiv 8 Oct 2026.

Builds on

13 of 65 references.

References · 13

  1. 2020Scaling Laws for Neural Language Modelscited by 6,411
  2. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
  3. 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 638
  4. 2023Textbooks Are All You Needcited by 561
  5. 2024StarCoder 2 and The Stack v2: The Next Generationcited by 484
  6. 2023MoDS: Model-oriented Data Selection for Instruction Tuningcited by 107
  7. 2024Vul-RAG: Enhancing LLM-based Vulnerability Detection via Knowledge-level RAGcited by 67
  8. 2023A Survey of Large Language Models for Code: Evolution, Benchmarking, and Future Trendscited by 66
  9. 2025What to Retrieve for Effective Retrieval-Augmented Code Generation? An Empirical Study and Beyondcited by 22
  10. 2020Semantic Sensitive TF-IDF to Determine Word Relevance in Documentscited by 13
  11. 2024Are Decoder-Only Large Language Models the Silver Bullet for Code Search?cited by 7
  12. 2025Evolving Triple Knowledge-Augmented LLMs for Code Translation in Repository Contextcited by 2
1 more
  1. 2024Combining Neural Architecture Search and Automatic Code Optimization: A Surveycited by 1

Built on by

Not cited yet.