mlsanityData to 14 Oct 2026

AIOS Compiler: LLM as Interpreter for Natural Language Programming and Flow Programming of AI Agents

arXiv 2405.06907 ↗First posted 11 May 2024cs.CL cs.AI cs.LGcited by 8

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Since their inception, programming languages have trended towards greater readability and lower barriers for programmers. Following this trend, natural language can be a promising type of programming language that provides great flexibility and usability and helps towards the democracy of programming. However, the inherent vagueness, ambiguity, and verbosity of natural language pose significant challenges in developing an interpreter that can accurately understand the programming logic and execute instructions written in natural language. Fortunately, recent advancements in Large Language Models (LLMs) have demonstrated remarkable proficiency in interpreting complex natural language. Inspired by this, we develop a novel system for Code Representation and Execution (CoRE), which employs LLM as interpreter to interpret and execute natural language instructions. The proposed system unifies natural language programming, pseudo-code programming, and flow programming under the same representation for constructing language agents, while LLM serves as the interpreter to interpret and execute the agent programs. In this paper, we begin with defining the programming syntax that structures natural language instructions logically. During the execution, we incorporate external memory to minimize redundancy. Furthermore, we equip the designed interpreter with the capability to invoke external tools, compensating for the limitations of LLM in specialized domains or when accessing real-time information. This work is open-source at https://github.com/agiresearch/CoRE, https://github.com/agiresearch/OpenAGI, and https://github.com/agiresearch/AIOS.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 33 of its 51 references that are in the map. First posted on arXiv 11 May 2024.

Builds on

33 of 51 references.

References · 33

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  5. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  6. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  7. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  8. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  9. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  10. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  11. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  12. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
21 more
  1. 2021Improving language models by retrieving from trillions of tokenscited by 1,293
  2. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
  3. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
  4. 2023Teaching Large Language Models to Self-Debugcited by 988
  5. 2022CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesiscited by 885
  6. 2023Reasoning with Language Model is Planning with World Modelcited by 861
  7. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
  8. 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 501
  9. 2020Visual Transformers: Token-based Image Representation and Processing for Computer Visioncited by 334
  10. 2022Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLPcited by 318
  11. 2023REFINER: Reasoning Feedback on Intermediate Representationscited by 205
  12. 2023OpenAGI: When LLM Meets Domain Expertscited by 197
  13. 2023TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIscited by 184
  14. 2023Task and Motion Planning with Large Language Models for Object Rearrangementcited by 141
  15. 2023The Programmer's Assistant: Conversational Interaction with a Large Language Model for Software Developmentcited by 96
  16. 2015Program Synthesis using Natural Languagecited by 41
  17. 2024Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agentscited by 40
  18. 2023LLM as OS, Agents as Apps: Envisioning AIOS, Agents and the AIOS-Agent Ecosystemcited by 38
  19. 2023Flows: Building Blocks of Reasoning and Collaborating AIcited by 25
  20. 2023GPT is becoming a Turing machine: Here are some ways to program itcited by 16
  21. 2015The NLP Engine: A Universal Turing Machine for NLPcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 5; 2026: 2.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024If LLM Is the Wizard, Then Code Is the Wand: A Survey on How Code Empowers Large Language Models to Serve as Intelligent Agents
  2. 2024Creating an LLM-based AI-agent: A high-level methodology towards enhancing LLMs with APIs
  3. 2025From Code Foundation Models to Agents and Applications: A Comprehensive Survey and Practical Guide to Code Intelligence
  4. 2026From LLMs to Agents in Programming: The Impact of Providing an LLM with a Compiler
  5. 2024Designing Algorithms Empowered by Language Models: An Analytical Framework, Case Studies, and Insights
  6. 2026Characterizing Large Language Model Agentic Workflows: A Study on N8n Ecosystem
  7. 2024Large Language Model-Based Agents for Software Engineering: A Survey
  8. 2026LLM-as-Code: Agentic Programming for Agent Harness