Code2LoRA: Hypernetwork-Generated Adapters for Code Language Models under Software Evolution
Not on the map. Why?
Abstract (arXiv)
Code language models need repository-level context to resolve imports, APIs, and project conventions. Existing methods inject this knowledge as long inputs (retrieved through RAG or dependency analysis) or through per-repository fine-tuning and LoRA -- costly at repository scale and brittle to evolving codebases. We introduce Code2LoRA, a hypernetwork framework that generates repository-specific LoRA adapters, effectively injecting repository knowledge with zero inference-time token overhead. Code2LoRA supports two usage scenarios: Code2LoRA-Static converts a single repository snapshot into an adapter, suitable for comprehension of stable codebases; while Code2LoRA-Evo maintains an adapter backed by a GRU hidden state updated per code diff, suitable for active development of evolving codebases. To evaluate Code2LoRA against parameter-efficient fine-tuning baselines, we build RepoPeftBench, a benchmark of 604 Python repositories with two tracks: a static track with 40K training and 12K test assertion-completion tasks, and an evolution track with 215K commit-derived training and 87K commit-derived test tasks. On the static track, Code2LoRA-Static achieves 63.8% cross-repo and 66.2% in-repo exact match, matching the per-repository LoRA upper bound; on the evolution track, Code2LoRA-Evo achieves 60.3% cross-repo exact match (+5.2 pp over a single shared LoRA). Code2LoRA's code can be found at https://anonymous.4open.science/r/code2lora-6857; the model checkpoints and RepoPeftBench datasets can be found at https://huggingface.co/code2lora.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 19 of its 37 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
19 of 37 references.
References · 19
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,181
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
- 2020CodeBLEU: a Method for Automatic Evaluation of Code Synthesiscited by 479
- 2023RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generationcited by 367
- 2023LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Compositioncited by 364
- 2023RepoBench: Benchmarking Repository-Level Code Auto-Completion Systemscited by 353
- 2021Mind the Gap: Assessing Temporal Generalization in Neural Language Modelscited by 230
- 2023CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completioncited by 183
- 2021Towards Continual Knowledge Learning of Language Modelscited by 174
7 more
- 2022CoCoMIC: Code Completion By Jointly Modeling In-file and Cross-file Contextcited by 65
- 2025Text-to-LoRA: Instant Transformer Adaptioncited by 58
- 2022HyperTuning: Toward Adapting Large Language Models without Back-propagationcited by 46
- 2026Doc-to-LoRA: Learning to Instantly Internalize Contextscited by 43
- 2024Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Passcited by 26
- 2024RepoHyper: Search-Expand-Refine on Semantic Graphs for Repository-Level Code Completioncited by 15
- 2021Impact of Evaluation Methodologies on Code Summarizationcited by 11
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025CODESYNC: Synchronizing Large Language Models with Dynamic Code Evolution at Scale
- 2026ReCUBE: Evaluating Repository-Level Context Utilization in Code Generation
- 2026RepoZero: Can LLMs Generate a Code Repository from Scratch?
- 2026Repo0: Design-Driven Zero-to-All Code Generation
- 2026RepoMod-Bench: A Benchmark for Code Repository Modernization via Implementation-Agnostic Testing
- 2025RepoTransAgent: Multi-Agent LLM Framework for Repository-Aware Code Translation
- 2025NL2Repo-Bench: Towards Long-Horizon Repository Generation Evaluation of Coding Agents
- 2026Large-scale Repository Engineering via Agent-Native Reusable Code Primitives