SheetCopilot: Bringing Software Productivity to the Next Level through Large Language Models
Not on the map. Why?
Cited by 24 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Computer end users have spent billions of hours completing daily tasks like tabular data processing and project timeline scheduling. Most of these tasks are repetitive and error-prone, yet most end users lack the skill to automate these burdensome works. With the advent of large language models (LLMs), directing software with natural language user requests become a reachable goal. In this work, we propose a SheetCopilot agent that takes natural language task and control spreadsheet to fulfill the requirements. We propose a set of atomic actions as an abstraction of spreadsheet software functionalities. We further design a state machine-based task planning framework for LLMs to robustly interact with spreadsheets. We curate a representative dataset containing 221 spreadsheet control tasks and establish a fully automated evaluation pipeline for rigorously benchmarking the ability of LLMs in software control tasks. Our SheetCopilot correctly completes 44.3% of tasks for a single generation, outperforming the strong code generation baseline by a wide margin. Our project page:https://sheetcopilot.github.io/.
Key facts. Cited by 53 papers in the map (data through 7 Oct 2026). Builds on 26 of its 93 references that are in the map. First posted on arXiv 30 May 2023.
Builds on
26 of 93 references.
References · 26
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
- 2022Competition-Level Code Generation with AlphaCodecited by 1,427
14 more
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
- 2021Measuring Coding Challenge Competence With APPScited by 879
- 2023Can Large Language Models Be an Alternative to Human Evaluations?cited by 729
- 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 591
- 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Actioncited by 511
- 2023Augmented Language Models: a Surveycited by 398
- 2023ART: Automatic multi-step reasoning and tool-use for large language modelscited by 193
- 2023TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIscited by 184
- 2022On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models?cited by 137
- 2021Shaking the foundations: delusions in sequence models for interaction and controlcited by 61
- 2021SpreadsheetCoder: Formula Prediction from Semi-structured Contextcited by 41
- 2023FLAME: A small language model for spreadsheet formulascited by 15
Built on by
Citing papers per year: 2023: 5; 2024: 19; 2025: 15; 2026: 14.
53 papers.
Sort:
By area:
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvementcited by 203
- 2024Tree Search for Language Model Agentscited by 148
- 2024Large Language Models Meet NLP: A Surveycited by 102
- 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 100
- 2023Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflowcited by 76
- 2025A Survey on (M)LLM-Based GUI Agentscited by 61
- 2023TableGPT: Towards Unifying Tables, Nature Language and Commands into One GPTcited by 57
- 2024Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?cited by 55
- 2023TPTU: Large Language Model-based AI Agents for Task Planning and Tool Usagecited by 54
- 2024Large Language Model for Table Processing: A Surveycited by 52
- 2024TDAG: A Multi-Agent Framework based on Dynamic Task Decomposition and Agent Generationcited by 50
38 more
- 2024AgentStudio: A Toolkit for Building General Virtual Agentscited by 45
- 2023TPTU-v2: Boosting Task Planning and Tool Usage of Large Language Model-based Agents in Real-world Systemscited by 39
- 2024CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agentscited by 38
- 2025OS Agents: A Survey on MLLM-based Agents for General Computing Devices Usecited by 35
- 2025macOSWorld: A Multilingual Interactive Benchmark for GUI Agentscited by 31
- 2024AgentStore: Scalable Integration of Heterogeneous Agents As Specialized Generalist Computer Assistantcited by 27
- 2024CityX: Controllable Procedural Content Generation for Unbounded 3D Citiescited by 20
- 2024SheetAgent: Towards A Generalist Agent for Spreadsheet Reasoning and Manipulation via Large Language Modelscited by 16
- 2024PoTable: Towards Systematic Thinking via Plan-then-Execute Stage Reasoning on Tablescited by 13
- 2025MMTU: A Massive Multi-Task Table Understanding and Reasoning Benchmarkcited by 13
- 2025A Framework for Studying AI Agent Behavior: Evidence from Consumer Choice Experimentscited by 10
- 2025Finch: Benchmarking Finance & Accounting across Spreadsheet-Centric Enterprise Workflowscited by 9
- 2026ShowUI-Aloha: Human-Taught GUI Agentcited by 7
- 2026SpreadsheetBench 2: Evaluating Agents on End-to-End Business Spreadsheet Workflowscited by 7
- 2024API Pack: A Massive Multi-Programming Language Dataset for API Call Generationcited by 5
- 2025LLM Agents Are Hypersensitive to Nudgescited by 5
- 2025Text-to-Pipeline: Bridging Natural Language and Data Preparation Pipelinescited by 5
- 2023Capture the Flag: Uncovering Data Insights with Large Language Modelscited by 4
- 2026FinSheet-Bench: From Simple Lookups to Complex Reasoning, Where LLMs Break on Financial Spreadsheetscited by 4
- 2024V-RECS, a Low-Cost LLM4VIS Recommender with Explanations, Captioning and Suggestionscited by 3
- 2025Leveraging Metamemory Agent for Enhanced Data-Free Code Generation in Large Language Modelscited by 3
- 2025SheetMind: Actions Set Accuracy, Agents Set the Failure Modecited by 3
- 2025MDBench: A Synthetic Multi-Document Reasoning Benchmark Generated with Knowledge Guidancecited by 3
- 2026CausalEvolve: Towards Open-Ended Discovery with Causal Scratchpadcited by 3
- 2026PrepBench: How Far Are We from Natural-Language-Driven Data Preparation?cited by 3
- 2025Software Reuse in the Generative AI Era: From Cargo Cult Towards AI Native Software Engineeringcited by 2
- 2025Toward Real-World Table Agents: Capabilities, Workflows, and Design Principles for LLM-based Table Intelligencecited by 2
- 2026Sheet As Token: A Graph-Enhanced Representation for Multi-Sheet Spreadsheet Understandingcited by 2
- 2024MaxMind: A Memory Loop Network to Enhance Software Productivity based on Large Language Modelscited by 1
- 2024InteractPro: A Unified Framework for Motion-Aware Image Compositioncited by 1
- 2024Towards More Effective Table-to-Text Generation: Assessing In-Context Learning and Self-Evaluation with Open-Source Modelscited by 1
- 2025MDSF: Context-Aware Multi-Dimensional Data Storytelling Framework based on Large language Modelcited by 1
- 2025Prompt-in-Content Attacks: Exploiting Uploaded Inputs to Hijack LLM Behaviorcited by 1
- 2026T2S-Bench & Structure-of-Thought: Benchmarking and Prompting Comprehensive Text-to-Structure Reasoningcited by 1
- 2026SpreadsheetArena: Decomposing Preference in LLM Generation of Spreadsheet Workbookscited by 1
- 2026Spreadsheet-RL: Advancing Large Language Model Agents on Realistic Spreadsheet Tasks via Reinforcement Learningcited by 0
- 2026How Should Agents Read Demonstrations? Hierarchical Structure Beats Flat Action Logscited by 0
- 2026Plans Work in Mysterious Ways: Evaluating a Plan Mode for Spreadsheet Agentscited by 0
50 most cited of 53 All 53 (JSON)
- 2026A Dual-Process Perspective on Nudge Susceptibility in LLM-Based GUI Agents17 Sep 2026
- 2026PPTBench: Can Coding Agents Reconstruct the Visual World through Structured, Editable Slides31 Aug 2026
- 2026Plans Work in Mysterious Ways: Evaluating a Plan Mode for Spreadsheet Agents26 Jul 2026
- 2026CITBench: A Comprehensive Benchmark for Interactive Tabular Data Processing with LLMs29 Jun 2026
- 2026SpreadsheetBench 2: Evaluating Agents on End-to-End Business Spreadsheet Workflows29 Jun 2026
- 2026How Should Agents Read Demonstrations? Hierarchical Structure Beats Flat Action Logs18 Jun 2026
- 2026Spreadsheet-RL: Advancing Large Language Model Agents on Realistic Spreadsheet Tasks via Reinforcement Learning21 May 2026
- 2026PrepBench: How Far Are We from Natural-Language-Driven Data Preparation?9 May 2026
- 2026Sheet As Token: A Graph-Enhanced Representation for Multi-Sheet Spreadsheet Understanding7 May 2026
- 2026CausalEvolve: Towards Open-Ended Discovery with Causal Scratchpad15 Mar 2026
- 2026FinSheet-Bench: From Simple Lookups to Complex Reasoning, Where LLMs Break on Financial Spreadsheets7 Mar 2026
- 2026T2S-Bench & Structure-of-Thought: Benchmarking and Prompting Comprehensive Text-to-Structure Reasoning4 Mar 2026
38 more
- 2026SpreadsheetArena: Decomposing Preference in LLM Generation of Spreadsheet Workbooks16 Feb 2026
- 2026ShowUI-Aloha: Human-Taught GUI Agent12 Jan 2026
- 2025Finch: Benchmarking Finance & Accounting across Spreadsheet-Centric Enterprise Workflows15 Dec 2025
- 2025A Framework for Studying AI Agent Behavior: Evidence from Consumer Choice Experiments30 Sep 2025
- 2025Prompt-in-Content Attacks: Exploiting Uploaded Inputs to Hijack LLM Behavior25 Aug 2025
- 2025OS Agents: A Survey on MLLM-based Agents for General Computing Devices Use6 Aug 2025
- 2025Toward Real-World Table Agents: Capabilities, Workflows, and Design Principles for LLM-based Table Intelligence14 Jul 2025
- 2025Software Reuse in the Generative AI Era: From Cargo Cult Towards AI Native Software Engineering22 Jun 2025
- 2025MDBench: A Synthetic Multi-Document Reasoning Benchmark Generated with Knowledge Guidance17 Jun 2025
- 2025SheetMind: Actions Set Accuracy, Agents Set the Failure Mode14 Jun 2025
- 2025MMTU: A Massive Multi-Task Table Understanding and Reasoning Benchmark5 Jun 2025
- 2025macOSWorld: A Multilingual Interactive Benchmark for GUI Agents4 Jun 2025
- 2025Text-to-Pipeline: Bridging Natural Language and Data Preparation Pipelines21 May 2025
- 2025LLM Agents Are Hypersensitive to Nudges16 May 2025
- 2025A Survey on (M)LLM-Based GUI Agents27 Mar 2025
- 2025Leveraging Metamemory Agent for Enhanced Data-Free Code Generation in Large Language Models14 Jan 2025
- 2025MDSF: Context-Aware Multi-Dimensional Data Storytelling Framework based on Large language Model2 Jan 2025
- 2024PoTable: Towards Systematic Thinking via Plan-then-Execute Stage Reasoning on Tables5 Dec 2024
- 2024AgentStore: Scalable Integration of Heterogeneous Agents As Specialized Generalist Computer Assistant24 Oct 2024
- 2024Towards More Effective Table-to-Text Generation: Assessing In-Context Learning and Self-Evaluation with Open-Source Models15 Oct 2024
- 2024InteractPro: A Unified Framework for Motion-Aware Image Composition16 Sep 2024
- 2024MaxMind: A Memory Loop Network to Enhance Software Productivity based on Large Language Models7 Aug 2024
- 2024CityX: Controllable Procedural Content Generation for Unbounded 3D Cities24 Jul 2024
- 2024Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?15 Jul 2024
- 2024CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents1 Jul 2024
- 2024Tree Search for Language Model Agents1 Jul 2024
- 2024V-RECS, a Low-Cost LLM4VIS Recommender with Explanations, Captioning and Suggestions21 Jun 2024
- 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulation21 Jun 2024
- 2024Large Language Models Meet NLP: A Survey21 May 2024
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments11 Apr 2024
- 2024AgentStudio: A Toolkit for Building General Virtual Agents26 Mar 2024
- 2024SheetAgent: Towards A Generalist Agent for Spreadsheet Reasoning and Manipulation via Large Language Models6 Mar 2024
- 2024TDAG: A Multi-Agent Framework based on Dynamic Task Decomposition and Agent Generation15 Feb 2024
- 2024API Pack: A Massive Multi-Programming Language Dataset for API Call Generation14 Feb 2024
- 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvement12 Feb 2024
- 2024Large Language Model for Table Processing: A Survey4 Feb 2024
- 2023Capture the Flag: Uncovering Data Insights with Large Language Models21 Dec 2023
- 2023TPTU-v2: Boosting Task Planning and Tool Usage of Large Language Model-based Agents in Real-world Systems19 Nov 2023
50 newest of 53 All 53 (JSON)
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvementcited by 203
- 2024Tree Search for Language Model Agentscited by 148
- 2025A Survey on (M)LLM-Based GUI Agentscited by 61
- 2024Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?cited by 55
- 2023TPTU: Large Language Model-based AI Agents for Task Planning and Tool Usagecited by 54
- 2024TDAG: A Multi-Agent Framework based on Dynamic Task Decomposition and Agent Generationcited by 50
- 2023TPTU-v2: Boosting Task Planning and Tool Usage of Large Language Model-based Agents in Real-world Systemscited by 39
- 2025OS Agents: A Survey on MLLM-based Agents for General Computing Devices Usecited by 35
- 2025macOSWorld: A Multilingual Interactive Benchmark for GUI Agentscited by 31
- 2025A Framework for Studying AI Agent Behavior: Evidence from Consumer Choice Experimentscited by 10
- 2026ShowUI-Aloha: Human-Taught GUI Agentcited by 7
12 most cited of 22 All 22 (JSON)
- 2026A Dual-Process Perspective on Nudge Susceptibility in LLM-Based GUI Agents17 Sep 2026
- 2026PPTBench: Can Coding Agents Reconstruct the Visual World through Structured, Editable Slides31 Aug 2026
- 2026Plans Work in Mysterious Ways: Evaluating a Plan Mode for Spreadsheet Agents26 Jul 2026
- 2026SpreadsheetBench 2: Evaluating Agents on End-to-End Business Spreadsheet Workflows29 Jun 2026
- 2026How Should Agents Read Demonstrations? Hierarchical Structure Beats Flat Action Logs18 Jun 2026
- 2026Spreadsheet-RL: Advancing Large Language Model Agents on Realistic Spreadsheet Tasks via Reinforcement Learning21 May 2026
- 2026ShowUI-Aloha: Human-Taught GUI Agent12 Jan 2026
- 2025A Framework for Studying AI Agent Behavior: Evidence from Consumer Choice Experiments30 Sep 2025
- 2025OS Agents: A Survey on MLLM-based Agents for General Computing Devices Use6 Aug 2025
- 2025Toward Real-World Table Agents: Capabilities, Workflows, and Design Principles for LLM-based Table Intelligence14 Jul 2025
- 2025SheetMind: Actions Set Accuracy, Agents Set the Failure Mode14 Jun 2025
- 2025macOSWorld: A Multilingual Interactive Benchmark for GUI Agents4 Jun 2025
12 newest of 22 All 22 (JSON)
- 2024SheetAgent: Towards A Generalist Agent for Spreadsheet Reasoning and Manipulation via Large Language Modelscited by 16
- 2024PoTable: Towards Systematic Thinking via Plan-then-Execute Stage Reasoning on Tablescited by 13
- 2025MMTU: A Massive Multi-Task Table Understanding and Reasoning Benchmarkcited by 13
- 2026FinSheet-Bench: From Simple Lookups to Complex Reasoning, Where LLMs Break on Financial Spreadsheetscited by 4
- 2025MDBench: A Synthetic Multi-Document Reasoning Benchmark Generated with Knowledge Guidancecited by 3
- 2026T2S-Bench & Structure-of-Thought: Benchmarking and Prompting Comprehensive Text-to-Structure Reasoningcited by 1
- 2026FinSheet-Bench: From Simple Lookups to Complex Reasoning, Where LLMs Break on Financial Spreadsheets7 Mar 2026
- 2026T2S-Bench & Structure-of-Thought: Benchmarking and Prompting Comprehensive Text-to-Structure Reasoning4 Mar 2026
- 2025MDBench: A Synthetic Multi-Document Reasoning Benchmark Generated with Knowledge Guidance17 Jun 2025
- 2025MMTU: A Massive Multi-Task Table Understanding and Reasoning Benchmark5 Jun 2025
- 2024PoTable: Towards Systematic Thinking via Plan-then-Execute Stage Reasoning on Tables5 Dec 2024
- 2024SheetAgent: Towards A Generalist Agent for Spreadsheet Reasoning and Manipulation via Large Language Models6 Mar 2024
- 2024Large Language Models Meet NLP: A Surveycited by 102
- 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 100
- 2023Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflowcited by 76
- 2023TableGPT: Towards Unifying Tables, Nature Language and Commands into One GPTcited by 57
- 2024Large Language Model for Table Processing: A Surveycited by 52
- 2024AgentStudio: A Toolkit for Building General Virtual Agentscited by 45
- 2024AgentStore: Scalable Integration of Heterogeneous Agents As Specialized Generalist Computer Assistantcited by 27
- 2024CityX: Controllable Procedural Content Generation for Unbounded 3D Citiescited by 20
- 2025Finch: Benchmarking Finance & Accounting across Spreadsheet-Centric Enterprise Workflowscited by 9
- 2024API Pack: A Massive Multi-Programming Language Dataset for API Call Generationcited by 5
- 2025Text-to-Pipeline: Bridging Natural Language and Data Preparation Pipelinescited by 5
- 2023Capture the Flag: Uncovering Data Insights with Large Language Modelscited by 4
12 most cited of 24 All 24 (JSON)
- 2026CITBench: A Comprehensive Benchmark for Interactive Tabular Data Processing with LLMs29 Jun 2026
- 2026PrepBench: How Far Are We from Natural-Language-Driven Data Preparation?9 May 2026
- 2026Sheet As Token: A Graph-Enhanced Representation for Multi-Sheet Spreadsheet Understanding7 May 2026
- 2026CausalEvolve: Towards Open-Ended Discovery with Causal Scratchpad15 Mar 2026
- 2026SpreadsheetArena: Decomposing Preference in LLM Generation of Spreadsheet Workbooks16 Feb 2026
- 2025Finch: Benchmarking Finance & Accounting across Spreadsheet-Centric Enterprise Workflows15 Dec 2025
- 2025Prompt-in-Content Attacks: Exploiting Uploaded Inputs to Hijack LLM Behavior25 Aug 2025
- 2025Software Reuse in the Generative AI Era: From Cargo Cult Towards AI Native Software Engineering22 Jun 2025
- 2025Text-to-Pipeline: Bridging Natural Language and Data Preparation Pipelines21 May 2025
- 2025MDSF: Context-Aware Multi-Dimensional Data Storytelling Framework based on Large language Model2 Jan 2025
- 2024AgentStore: Scalable Integration of Heterogeneous Agents As Specialized Generalist Computer Assistant24 Oct 2024
- 2024Towards More Effective Table-to-Text Generation: Assessing In-Context Learning and Self-Evaluation with Open-Source Models15 Oct 2024
12 newest of 24 All 24 (JSON)