mlsanityData to 14 Oct 2026

Multi-Programming Language Sandbox for LLMs

arXiv 2410.23074 ↗First posted 30 Oct 2024cs.SE cs.CLcited by 10

Not on the map. Why?

Abstract (arXiv)

We introduce MPLSandbox, an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler and analysis tools for Large Language Models (LLMs). It can automatically identify the programming language of the code, compiling and executing it within an isolated sub-sandbox to ensure safety and stability. In addition, MPLSandbox also integrates both traditional and LLM-based code analysis tools, providing a comprehensive analysis of generated code. MPLSandbox can be effortlessly integrated into the training and deployment of LLMs to improve the quality and correctness of their generated code. It also helps researchers streamline their workflows for various LLM-based code-related tasks, reducing the development cost. To validate the effectiveness of MPLSandbox, we integrate it into training and deployment approaches, and also employ it to optimize workflows for a wide range of real-world code-related tasks. Our goal is to enhance researcher productivity on LLM-based code-related tasks by simplifying and automating workflows through delegation to MPLSandbox.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 38 of its 73 references that are in the map. First posted on arXiv 30 Oct 2024.

Builds on

38 of 73 references.

References · 38

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  5. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  6. 2022Competition-Level Code Generation with AlphaCodecited by 1,462
  7. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,181
  8. 2021Measuring Coding Challenge Competence With APPScited by 902
  9. 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 744
  10. 2023RRHF: Rank Responses to Align Language Models with Human Feedback without tearscited by 463
  11. 2020Unsupervised Translation of Programming Languagescited by 263
  12. 2023Using an LLM to Help With Code Understandingcited by 228
26 more
  1. 2023SantaCoder: don't reach for the stars!cited by 170
  2. 2023TACO: Topics in Algorithmic COde generation datasetcited by 160
  3. 2020A Transformer-based Approach for Source Code Summarizationcited by 133
  4. 2023RLTF: Reinforcement Learning from Unit Test Feedbackcited by 114
  5. 2023ChatUniTest: A Framework for LLM-Based Test Generationcited by 96
  6. 2022Execution-Based Evaluation for Open-Domain Code Generationcited by 91
  7. 2022Conversing with Copilot: Exploring Prompt Engineering for Solving CS1 Problems Using Natural Languagecited by 82
  8. 2024StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedbackcited by 77
  9. 2023Towards an Understanding of Large Language Models in Software Engineering Taskscited by 68
  10. 2024Code-Aware Prompting: A study of Coverage Guided Test Generation in Regression Setting using LLMcited by 64
  11. 2018The Art, Science, and Engineering of Fuzzing: A Surveycited by 62
  12. 2023CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modulescited by 58
  13. 2024What's Wrong with Your Code Generated by Large Language Models? An Extensive Studycited by 53
  14. 2024LeDex: Training LLMs to Better Self-Debug and Explain Codecited by 40
  15. 2024Generalization-Enhanced Code Vulnerability Detection via Multi-Task Instruction Fine-Tuningcited by 30
  16. 2024Search-Based LLMs for Code Optimizationcited by 28
  17. 2023Reflection-Tuning: Data Recycling Improves LLM Instruction-Tuningcited by 26
  18. 2024Rectifier: Code Translation with Corrector via LLMscited by 20
  19. 2024TestART: Improving LLM-based Unit Testing via Co-evolution of Automated Generation and Repair Iterationcited by 20
  20. 2024Unraveling the Potential of Large Language Models in Code Translation: How Far Are We?cited by 17
  21. 2024ReflectionCoder: Learning from Reflection Sequence for Enhanced One-off Code Generationcited by 14
  22. 2024Calibration of Large Language Models on Code Summarizationcited by 12
  23. 2024Python Symbolic Execution with LLM-powered Code Generationcited by 10
  24. 2024VERCATION: Precise Vulnerable Open-source Software Version Identification based on Static Analysis and LLMcited by 6
  25. 2022Triangulating Python Performance Issues with Scalenecited by 5
  26. 2021DJXPerf: Identifying Memory Inefficiencies via Object-centric Profiling for Javacited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 5; 2026: 4.

10 papers.

  1. 2024Qwen2.5 Technical Reportcited by 4,942
  2. 2025SoK: Trust-Authorization Mismatch in LLM Agent Interactionscited by 11
  3. 2025Reward Auditor: Inference on Reward Modeling Suitability in Real-World Perturbed Scenarioscited by 8
  4. 2025Alleviating Attention Hacking in Discriminative Reward Modeling through Interaction Distillationcited by 5
  5. 2025Compression Hacking: A Supplementary Perspective on Informatics Properties of Language Models from Geometric Distortioncited by 2
  6. 2026Executing as You Generate: Hiding Execution Latency in LLM Code Interpreterscited by 2
  7. 2025Better Language Model-Based Judging Reward Modeling through Scaling Comprehension Boundariescited by 1
  8. 2026Rethinking Code Review in the Age of AI: A Vision for Agentic Code Reviewcited by 1
  9. 2026STELP: Secure Transpilation and Execution of LLM-Generated Programscited by 0
  10. 2026Scaling Verifiable Environments for Long-horizon Work Agentscited by 0