mlsanityData to 7 Oct 2026

Agnostics: Learning to Code in Any Programming Language via Reinforcement with a Universal Learning Environment

arXiv 2508.04865 ↗First posted 6 Aug 2025cs.LG cs.PLcited by 5

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) already excel at writing code in high-resource languages such as Python and JavaScript, yet stumble on low-resource languages that remain essential to science and engineering. Besides the obvious shortage of pre-training data, post-training itself is a bottleneck: every new language seems to require new datasets, test harnesses, and reinforcement-learning (RL) infrastructure. We introduce Agnostics, a language-agnostic post-training pipeline that eliminates this per-language engineering. The key idea is to judge code solely by its externally observable behavior, so a single verifier can test solutions written in any language. Concretely, we (i) use an LLM to rewrite existing unit-test datasets into an I/O format, (ii) supply a short configuration that tells the verifier how to compile and run a target language, and (iii) apply reinforcement learning with verifiable rewards (RLVR) in a robust code execution environment. Applied to five low-resource languages--Lua, Julia, R, OCaml, and Fortran--Agnostics (1) improves Qwen-3 4B to performance that rivals other 16B-70B open-weight models; (2) scales cleanly to larger and diverse model families (Qwen-3 8B, DeepSeek Coder 6.7B Instruct, Phi 4 Mini); and (3) for ≤ 16B parameter models, sets new state-of-the-art pass@1 results on MultiPL-E and a new multi-language version of LiveCodeBench that we introduce. We release the language-agnostic training datasets (Ag-MBPP-X, Ag-Codeforces-X, Ag-LiveCodeBench-X), training code, and ready-to-use configurations, making RL post-training in any programming language as simple as editing a short YAML file.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 30 of its 73 references that are in the map. First posted on arXiv 6 Aug 2025.

Builds on

30 of 73 references.

References · 30

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  4. 2021Program Synthesis with Large Language Modelscited by 3,509
  5. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  6. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  7. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  8. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
  9. 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 728
  10. 2017Ray: A Distributed Framework for Emerging AI Applicationscited by 516
  11. 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 491
  12. 2024StarCoder 2 and The Stack v2: The Next Generationcited by 484
18 more
  1. 2022A Systematic Evaluation of Large Language Models of Codecited by 360
  2. 2023Magicoder: Empowering Code Generation with OSS-Instructcited by 251
  3. 2025SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolutioncited by 246
  4. 2023SantaCoder: don't reach for the stars!cited by 169
  5. 2024RLEF: Grounding Code LLMs in Execution Feedback with Reinforcement Learningcited by 146
  6. 2025SWEET-RL: Training Multi-Turn LLM Agents on Collaborative Reasoning Taskscited by 108
  7. 2025ACECODER: Acing Coder RL via Automated Test-Case Synthesiscited by 89
  8. 2021Leveraging Automated Unit Tests for Unsupervised Code Translationcited by 82
  9. 2023At Which Training Stage Does Code Data Help LLMs Reasoning?cited by 82
  10. 2024SelfCodeAlign: Self-Alignment for Code Generationcited by 61
  11. 2025Seed-Coder: Let the Code Model Curate Data for Itselfcited by 46
  12. 2023Knowledge Transfer from High-Resource to Low-Resource Programming Languages for Code LLMscited by 45
  13. 2023Measuring The Impact Of Programming Language Distributioncited by 32
  14. 2025Multi-Turn Code Generation Through Single-Step Rewardscited by 27
  15. 2024Performance-Aligned LLMs for Generating Fast Codecited by 20
  16. 2025Afterburner: Reinforcement Learning Facilitates Self-Improving Code Efficiency Optimizationcited by 14
  17. 2023Data Augmentation for Code Translation with Comparable Corpora and Multiple Referencescited by 9
  18. 2024Robo-Instruct: Simulator-Augmented Instruction Alignment For Finetuning Code LLMscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.