mlsanityData to 14 Oct 2026

Code2LoRA: Hypernetwork-Generated Adapters for Code Language Models under Software Evolution

arXiv 2606.06492 ↗First posted 4 Jun 2026cs.SE cs.AI cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Code language models need repository-level context to resolve imports, APIs, and project conventions. Existing methods inject this knowledge as long inputs (retrieved through RAG or dependency analysis) or through per-repository fine-tuning and LoRA -- costly at repository scale and brittle to evolving codebases. We introduce Code2LoRA, a hypernetwork framework that generates repository-specific LoRA adapters, effectively injecting repository knowledge with zero inference-time token overhead. Code2LoRA supports two usage scenarios: Code2LoRA-Static converts a single repository snapshot into an adapter, suitable for comprehension of stable codebases; while Code2LoRA-Evo maintains an adapter backed by a GRU hidden state updated per code diff, suitable for active development of evolving codebases. To evaluate Code2LoRA against parameter-efficient fine-tuning baselines, we build RepoPeftBench, a benchmark of 604 Python repositories with two tracks: a static track with 40K training and 12K test assertion-completion tasks, and an evolution track with 215K commit-derived training and 87K commit-derived test tasks. On the static track, Code2LoRA-Static achieves 63.8% cross-repo and 66.2% in-repo exact match, matching the per-repository LoRA upper bound; on the evolution track, Code2LoRA-Evo achieves 60.3% cross-repo exact match (+5.2 pp over a single shared LoRA). Code2LoRA's code can be found at https://anonymous.4open.science/r/code2lora-6857; the model checkpoints and RepoPeftBench datasets can be found at https://huggingface.co/code2lora.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 19 of its 37 references that are in the map. First posted on arXiv 4 Jun 2026.

Builds on

19 of 37 references.

References · 19

  1. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  2. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  3. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  4. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,181
  5. 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
  6. 2020CodeBLEU: a Method for Automatic Evaluation of Code Synthesiscited by 479
  7. 2023RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generationcited by 367
  8. 2023LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Compositioncited by 364
  9. 2023RepoBench: Benchmarking Repository-Level Code Auto-Completion Systemscited by 353
  10. 2021Mind the Gap: Assessing Temporal Generalization in Neural Language Modelscited by 230
  11. 2023CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completioncited by 183
  12. 2021Towards Continual Knowledge Learning of Language Modelscited by 174
7 more
  1. 2022CoCoMIC: Code Completion By Jointly Modeling In-file and Cross-file Contextcited by 65
  2. 2025Text-to-LoRA: Instant Transformer Adaptioncited by 58
  3. 2022HyperTuning: Toward Adapting Large Language Models without Back-propagationcited by 46
  4. 2026Doc-to-LoRA: Learning to Instantly Internalize Contextscited by 43
  5. 2024Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Passcited by 26
  6. 2024RepoHyper: Search-Expand-Refine on Semantic Graphs for Repository-Level Code Completioncited by 15
  7. 2021Impact of Evaluation Methodologies on Code Summarizationcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025CODESYNC: Synchronizing Large Language Models with Dynamic Code Evolution at Scale
  2. 2026ReCUBE: Evaluating Repository-Level Context Utilization in Code Generation
  3. 2026RepoZero: Can LLMs Generate a Code Repository from Scratch?
  4. 2026Repo0: Design-Driven Zero-to-All Code Generation
  5. 2026RepoMod-Bench: A Benchmark for Code Repository Modernization via Implementation-Agnostic Testing
  6. 2025RepoTransAgent: Multi-Agent LLM Framework for Repository-Aware Code Translation
  7. 2025NL2Repo-Bench: Towards Long-Horizon Repository Generation Evaluation of Coding Agents
  8. 2026Large-scale Repository Engineering via Agent-Native Reusable Code Primitives