MAP4CS: A Multi-dimensional Data Pruning Framework for Efficient Code Retriever Fine-tuning
Not on the map. Why?
Abstract (arXiv)
Retrieval-Augmented Generation (RAG) has become a cornerstone in software engineering for enhancing Large Language Models (LLMs) with domain-specific knowledge. However, adapting retrievers to evolving code repositories remains challenging due to the noise and redundancy inherent in massive code corpora. Standard fine-tuning on the full corpus is computationally expensive and often leads to sub-optimal performance due to negative transfer from low-quality samples. Conversely, simple random sampling fails to guarantee data representativeness. To address these challenges, we propose MAP4CS (Multi-dimensional Awareness Pruning for Code Search), an adaptive data pruning framework. MAP4CS identifies a small, high-quality core subset by integrating syntactic structure, semantic diversity, and distributional representation, followed by a rigorous rule-based filtering pipeline. Extensive experiments on two large-scale datasets demonstrate that MAP4CS consistently outperforms random sampling baselines using only 5% of the training data. Remarkably, it achieves performance comparable to, or even superior to, fine-tuning on the full dataset, validating the ''less is more'' hypothesis in data-centric AI. Furthermore, linguistic analysis reveals an adaptive optimization mechanism: MAP4CS automatically functions as a de-duplicator for redundant corpora and a denoiser for chaotic ones, constructing a training corpus that is both lexically diverse and information-dense.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 65 references that are in the map. First posted on arXiv 8 Oct 2026.
Builds on
13 of 65 references.
References · 13
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 638
- 2023Textbooks Are All You Needcited by 561
- 2024StarCoder 2 and The Stack v2: The Next Generationcited by 484
- 2023MoDS: Model-oriented Data Selection for Instruction Tuningcited by 107
- 2024Vul-RAG: Enhancing LLM-based Vulnerability Detection via Knowledge-level RAGcited by 67
- 2023A Survey of Large Language Models for Code: Evolution, Benchmarking, and Future Trendscited by 66
- 2025What to Retrieve for Effective Retrieval-Augmented Code Generation? An Empirical Study and Beyondcited by 22
- 2020Semantic Sensitive TF-IDF to Determine Word Relevance in Documentscited by 13
- 2024Are Decoder-Only Large Language Models the Silver Bullet for Code Search?cited by 7
- 2025Evolving Triple Knowledge-Augmented LLMs for Code Translation in Repository Contextcited by 2
1 more
Built on by
Not cited yet.