Low-code LLM: Graphical User Interface over Large Language Models
Not on the map. Why?
Abstract (arXiv)
Utilizing Large Language Models (LLMs) for complex tasks is challenging, often involving a time-consuming and uncontrollable prompt engineering process. This paper introduces a novel human-LLM interaction framework, Low-code LLM. It incorporates six types of simple low-code visual programming interactions to achieve more controllable and stable responses. Through visual interaction with a graphical user interface, users can incorporate their ideas into the process without writing trivial prompts. The proposed Low-code LLM framework consists of a Planning LLM that designs a structured planning workflow for complex tasks, which can be correspondingly edited and confirmed by users through low-code visual programming operations, and an Executing LLM that generates responses following the user-confirmed workflow. We highlight three advantages of the low-code LLM: user-friendly interaction, controllable generation, and wide applicability. We demonstrate its benefits using four typical applications. By introducing this framework, we aim to bridge the gap between humans and LLMs, enabling more effective and efficient utilization of LLMs for complex tasks. The code, prompts, and experimental details are available at https://github.com/moymix/TaskMatrix/tree/main/LowCodeLLM. A system demonstration video can be found at https://www.youtube.com/watch?v=jb2C1vaeO3E.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 13 of its 31 references that are in the map. First posted on arXiv 17 Apr 2023.
Builds on
13 of 31 references.
References · 13
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,434
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
- 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 668
- 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 638
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 619
- 2023Language Models can Solve Computer Taskscited by 372
- 2022RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learningcited by 366
- 2023TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIscited by 184
- 2023A Categorical Archive of ChatGPT Failurescited by 168
1 more
Built on by
Citing papers per year: 2024: 4; 2025: 6; 2026: 3.
13 papers.
Sort:
By area:
- 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 372
- 2024WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualizationcited by 39
- 2025SPHERE: An Evaluation Card for Human-AI Systemscited by 9
- 2025ScamAgents: How AI Agents Can Simulate Human-Level Scam Callscited by 4
- 2024Generating a Low-code Complete Workflow via Task Decomposition and RAGcited by 3
- 2025Composable Prompting Workspaces for Creative Writing: Exploration and Iteration Using Dynamic Widgetscited by 3
- 2025StarFlow: Generating Structured Workflow Outputs From Sketch Imagescited by 3
- 2024iToT: An Interactive System for Customized Tree-of-Thought Generationcited by 2
- 2025AIPOM: Agent-aware Interactive Planning for Multi-Agent Systemscited by 1
- 2025Componentization: Decomposing Monolithic LLM Responses into Manipulable Semantic Unitscited by 0
- 2026Qualitative Evaluation of LLM-Designed GUIcited by 0
- 2026Lazy or Efficient? Towards Accessible Eye-Tracking Event Detection Using LLMscited by 0
1 more
- 2026Gricea: An Open Science Platform for Conversational AI Research18 Sep 2026
- 2026Lazy or Efficient? Towards Accessible Eye-Tracking Event Detection Using LLMs14 Apr 2026
- 2026Qualitative Evaluation of LLM-Designed GUI30 Jan 2026
- 2025AIPOM: Agent-aware Interactive Planning for Multi-Agent Systems29 Sep 2025
- 2025Componentization: Decomposing Monolithic LLM Responses into Manipulable Semantic Units10 Sep 2025
- 2025ScamAgents: How AI Agents Can Simulate Human-Level Scam Calls8 Aug 2025
- 2025StarFlow: Generating Structured Workflow Outputs From Sketch Images27 Mar 2025
- 2025Composable Prompting Workspaces for Creative Writing: Exploration and Iteration Using Dynamic Widgets27 Mar 2025
- 2025SPHERE: An Evaluation Card for Human-AI Systems24 Mar 2025
- 2024Generating a Low-code Complete Workflow via Task Decomposition and RAG29 Nov 2024
- 2024iToT: An Interactive System for Customized Tree-of-Thought Generation31 Aug 2024
- 2024WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualization3 Aug 2024
- 2025SPHERE: An Evaluation Card for Human-AI Systemscited by 9
- 2024Generating a Low-code Complete Workflow via Task Decomposition and RAGcited by 3
- 2025Composable Prompting Workspaces for Creative Writing: Exploration and Iteration Using Dynamic Widgetscited by 3
- 2025Componentization: Decomposing Monolithic LLM Responses into Manipulable Semantic Unitscited by 0
- 2026Qualitative Evaluation of LLM-Designed GUIcited by 0
- 2026Lazy or Efficient? Towards Accessible Eye-Tracking Event Detection Using LLMscited by 0
- 2026Gricea: An Open Science Platform for Conversational AI Researchcited by 0
- 2026Gricea: An Open Science Platform for Conversational AI Research18 Sep 2026
- 2026Lazy or Efficient? Towards Accessible Eye-Tracking Event Detection Using LLMs14 Apr 2026
- 2026Qualitative Evaluation of LLM-Designed GUI30 Jan 2026
- 2025Componentization: Decomposing Monolithic LLM Responses into Manipulable Semantic Units10 Sep 2025
- 2025Composable Prompting Workspaces for Creative Writing: Exploration and Iteration Using Dynamic Widgets27 Mar 2025
- 2025SPHERE: An Evaluation Card for Human-AI Systems24 Mar 2025
- 2024Generating a Low-code Complete Workflow via Task Decomposition and RAG29 Nov 2024