Agnostics: Learning to Code in Any Programming Language via Reinforcement with a Universal Learning Environment
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) already excel at writing code in high-resource languages such as Python and JavaScript, yet stumble on low-resource languages that remain essential to science and engineering. Besides the obvious shortage of pre-training data, post-training itself is a bottleneck: every new language seems to require new datasets, test harnesses, and reinforcement-learning (RL) infrastructure. We introduce Agnostics, a language-agnostic post-training pipeline that eliminates this per-language engineering. The key idea is to judge code solely by its externally observable behavior, so a single verifier can test solutions written in any language. Concretely, we (i) use an LLM to rewrite existing unit-test datasets into an I/O format, (ii) supply a short configuration that tells the verifier how to compile and run a target language, and (iii) apply reinforcement learning with verifiable rewards (RLVR) in a robust code execution environment. Applied to five low-resource languages--Lua, Julia, R, OCaml, and Fortran--Agnostics (1) improves Qwen-3 4B to performance that rivals other 16B-70B open-weight models; (2) scales cleanly to larger and diverse model families (Qwen-3 8B, DeepSeek Coder 6.7B Instruct, Phi 4 Mini); and (3) for ≤ 16B parameter models, sets new state-of-the-art pass@1 results on MultiPL-E and a new multi-language version of LiveCodeBench that we introduce. We release the language-agnostic training datasets (Ag-MBPP-X, Ag-Codeforces-X, Ag-LiveCodeBench-X), training code, and ready-to-use configurations, making RL post-training in any programming language as simple as editing a short YAML file.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 30 of its 73 references that are in the map. First posted on arXiv 6 Aug 2025.
Builds on
30 of 73 references.
References · 30
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
- 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 728
- 2017Ray: A Distributed Framework for Emerging AI Applicationscited by 516
- 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 491
- 2024StarCoder 2 and The Stack v2: The Next Generationcited by 484
18 more
- 2022A Systematic Evaluation of Large Language Models of Codecited by 360
- 2023Magicoder: Empowering Code Generation with OSS-Instructcited by 251
- 2025SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolutioncited by 246
- 2023SantaCoder: don't reach for the stars!cited by 169
- 2024RLEF: Grounding Code LLMs in Execution Feedback with Reinforcement Learningcited by 146
- 2025SWEET-RL: Training Multi-Turn LLM Agents on Collaborative Reasoning Taskscited by 108
- 2025ACECODER: Acing Coder RL via Automated Test-Case Synthesiscited by 89
- 2021Leveraging Automated Unit Tests for Unsupervised Code Translationcited by 82
- 2023At Which Training Stage Does Code Data Help LLMs Reasoning?cited by 82
- 2024SelfCodeAlign: Self-Alignment for Code Generationcited by 61
- 2025Seed-Coder: Let the Code Model Curate Data for Itselfcited by 46
- 2023Knowledge Transfer from High-Resource to Low-Resource Programming Languages for Code LLMscited by 45
- 2023Measuring The Impact Of Programming Language Distributioncited by 32
- 2025Multi-Turn Code Generation Through Single-Step Rewardscited by 27
- 2024Performance-Aligned LLMs for Generating Fast Codecited by 20
- 2025Afterburner: Reinforcement Learning Facilitates Self-Improving Code Efficiency Optimizationcited by 14
- 2023Data Augmentation for Code Translation with Comparable Corpora and Multiple Referencescited by 9
- 2024Robo-Instruct: Simulator-Augmented Instruction Alignment For Finetuning Code LLMscited by 6
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2025AgentPack: A Dataset of Code Changes, Co-Authored by Agents and Humanscited by 4
- 2026Tracking Capabilities for Safer Agentscited by 4
- 2026Multi-LCB: Extending LiveCodeBench to Multiple Programming Languagescited by 2
- 2025CodeChemist: Test-Time Scaling for Low-Resource Code Generation via Functional Knowledge Transfercited by 1
- 2026The Best Programming Language for Tokenmaxxing: An Investigation of Coding Agent Behavior Across Programming Languagescited by 1
- 2026The Best Programming Language for Tokenmaxxing: An Investigation of Coding Agent Behavior Across Programming Languages24 Jul 2026
- 2026Multi-LCB: Extending LiveCodeBench to Multiple Programming Languages18 Jun 2026
- 2026Tracking Capabilities for Safer Agents1 Mar 2026
- 2025CodeChemist: Test-Time Scaling for Low-Resource Code Generation via Functional Knowledge Transfer1 Oct 2025
- 2025AgentPack: A Dataset of Code Changes, Co-Authored by Agents and Humans26 Sep 2025