ShapefileGPT: A Multi-Agent Large Language Model Framework for Automated Shapefile Processing
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Vector data is one of the two core data structures in geographic information science (GIS), essential for accurately storing and representing geospatial information. Shapefile, the most widely used vector data format, has become the industry standard supported by all major geographic information systems. However, processing this data typically requires specialized GIS knowledge and skills, creating a barrier for researchers from other fields and impeding interdisciplinary research in spatial data analysis. Moreover, while large language models (LLMs) have made significant advancements in natural language processing and task automation, they still face challenges in handling the complex spatial and topological relationships inherent in GIS vector data. To address these challenges, we propose ShapefileGPT, an innovative framework powered by LLMs, specifically designed to automate Shapefile tasks. ShapefileGPT utilizes a multi-agent architecture, in which the planner agent is responsible for task decomposition and supervision, while the worker agent executes the tasks. We developed a specialized function library for handling Shapefiles and provided comprehensive API documentation, enabling the worker agent to operate Shapefiles efficiently through function calling. For evaluation, we developed a benchmark dataset based on authoritative textbooks, encompassing tasks in categories such as geometric operations and spatial queries. ShapefileGPT achieved a task success rate of 95.24%, outperforming the GPT series models. In comparison to traditional LLMs, ShapefileGPT effectively handles complex vector data analysis tasks, overcoming the limitations of traditional LLMs in spatial analysis. This breakthrough opens new pathways for advancing automation and intelligence in the GIS field, with significant potential in interdisciplinary data analysis and application contexts.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 26 of its 69 references that are in the map. First posted on arXiv 16 Oct 2024.
Builds on
26 of 69 references.
Closest ancestors · 2
Same direction, newest first
- 2024GenAI-powered Multi-Agent Paradigm for Smart Urban Mobility: Opportunities and Challenges for Integrating Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) with Intelligent Transportation Systems31 Aug
- 2024An Autonomous GIS Agent Framework for Geospatial Data Retrieval13 Jul
Other references · 24
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
- 2021Internet-Augmented Dialogue Generationcited by 217
- 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scalecited by 212
- 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 164
12 more
- 2024Evaluation of OpenAI o1: Opportunities and Challenges of AGIcited by 127
- 2023Solving Math Word Problems by Combining Language Models With Symbolic Solverscited by 124
- 2023Table Meets LLM: Can Large Language Models Understand Structured Table Data? A Benchmark and Empirical Studycited by 116
- 2024Embodied LLM Agents Learn to Cooperate in Organized Teamscited by 81
- 2023GPT4GEO: How a Language Model Sees the World's Geographycited by 68
- 2024Change-Agent: Towards Interactive Comprehensive Remote Sensing Change Interpretation and Analysiscited by 60
- 2023Autonomous GIS: the next-generation AI-powered GIScited by 52
- 2024From LLM to Conversational Agent: A Memory Enhanced Architecture with Fine-Tuning of Large Language Modelscited by 42
- 2024GeoLLM-Engine: A Realistic Environment for Building Geospatial Copilotscited by 27
- 2023Towards Verifiable Text Generation with Evolving Memory and Self-Reflectioncited by 21
- 2024Geode: A Zero-shot Geospatial Question-Answering Agent with Explicit Reasoning and Precise Spatio-Temporal Retrievalcited by 5
- 2024Research on the Spatial Data Intelligent Foundation Modelcited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 4; 2026: 4.
9 papers.
- 2024GIS Copilot: Towards an Autonomous GIS Agent for Spatial Analysiscited by 26
- 2025Accelerating Earth Science Discovery via Multi-Agent LLM Systemscited by 13
- 2025GeoBenchX: Benchmarking LLMs in Agent Solving Multistep Geospatial Taskscited by 11
- 2025CangLing-KnowFlow: A Unified Knowledge-and-Flow-fused Agent for Comprehensive Remote Sensing Applicationscited by 7
- 2026Agentic AI in Remote Sensing: Foundations, Taxonomy, and Emerging Systemscited by 3
- 2026GeoAgentBench: A Dynamic Execution Benchmark for Tool-Augmented Agents in Spatial Analysiscited by 2
- 2026A Dual-Helix Governance Approach Towards Reliable Agentic Artificial Intelligence for WebGIS Developmentcited by 1
- 2025AutoGEEval: A Multimodal and Automated Framework for Geospatial Code Generation on GEE with Large Language Modelscited by 0
- 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?cited by 0
- 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?22 Jul 2026
- 2026GeoAgentBench: A Dynamic Execution Benchmark for Tool-Augmented Agents in Spatial Analysis15 Apr 2026
- 2026A Dual-Helix Governance Approach Towards Reliable Agentic Artificial Intelligence for WebGIS Development4 Mar 2026
- 2026Agentic AI in Remote Sensing: Foundations, Taxonomy, and Emerging Systems5 Jan 2026
- 2025CangLing-KnowFlow: A Unified Knowledge-and-Flow-fused Agent for Comprehensive Remote Sensing Applications17 Dec 2025
- 2025AutoGEEval: A Multimodal and Automated Framework for Geospatial Code Generation on GEE with Large Language Models19 May 2025
- 2025GeoBenchX: Benchmarking LLMs in Agent Solving Multistep Geospatial Tasks23 Mar 2025
- 2025Accelerating Earth Science Discovery via Multi-Agent LLM Systems7 Mar 2025
- 2024GIS Copilot: Towards an Autonomous GIS Agent for Spatial Analysis5 Nov 2024
Similar, not cited
Close in wording, no citation either way
- 2025GeoJSON Agents:A Multi-Agent LLM Architecture for Geospatial Analysis-Function Calling vs Code Generation
- 2025MapAgent: A Hierarchical Agent for Geospatial Reasoning with Dynamic Map Tool Integration
- 2024An LLM Agent for Automatic Geospatial Data Analysis
- 2026GISAgentBench: A Practitioner-Sourced Benchmark for Evaluating LLM Agents on GIS Tasks
- 2025GeoAnalystBench: A GeoAI benchmark for assessing large language models for spatial analysis workflow and code generation
- 2026ANASSA: An Agentic AI Orchestration Framework for Spatial Intelligence
- 2026GISclaw: A Comprehensive Open-Source LLM Agent System for Realistic Multi-Step Geospatial Analysis
- 2025Towards a Barrier-free GeoQA Portal: Natural Language Interaction with Geospatial Data Using Multi-Agent LLMs and Semantic Search