mlsanityData to 7 Oct 2026

ShapefileGPT: A Multi-Agent Large Language Model Framework for Automated Shapefile Processing

arXiv 2410.12376 ↗First posted 16 Oct 2024cs.AIcited by 9

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Vector data is one of the two core data structures in geographic information science (GIS), essential for accurately storing and representing geospatial information. Shapefile, the most widely used vector data format, has become the industry standard supported by all major geographic information systems. However, processing this data typically requires specialized GIS knowledge and skills, creating a barrier for researchers from other fields and impeding interdisciplinary research in spatial data analysis. Moreover, while large language models (LLMs) have made significant advancements in natural language processing and task automation, they still face challenges in handling the complex spatial and topological relationships inherent in GIS vector data. To address these challenges, we propose ShapefileGPT, an innovative framework powered by LLMs, specifically designed to automate Shapefile tasks. ShapefileGPT utilizes a multi-agent architecture, in which the planner agent is responsible for task decomposition and supervision, while the worker agent executes the tasks. We developed a specialized function library for handling Shapefiles and provided comprehensive API documentation, enabling the worker agent to operate Shapefiles efficiently through function calling. For evaluation, we developed a benchmark dataset based on authoritative textbooks, encompassing tasks in categories such as geometric operations and spatial queries. ShapefileGPT achieved a task success rate of 95.24%, outperforming the GPT series models. In comparison to traditional LLMs, ShapefileGPT effectively handles complex vector data analysis tasks, overcoming the limitations of traditional LLMs in spatial analysis. This breakthrough opens new pathways for advancing automation and intelligence in the GIS field, with significant potential in interdisciplinary data analysis and application contexts.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 26 of its 69 references that are in the map. First posted on arXiv 16 Oct 2024.

Builds on

26 of 69 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024GenAI-powered Multi-Agent Paradigm for Smart Urban Mobility: Opportunities and Challenges for Integrating Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) with Intelligent Transportation Systems31 Aug
  2. 2024An Autonomous GIS Agent Framework for Geospatial Data Retrieval13 Jul

Other references · 24

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  4. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  5. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  6. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  7. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  8. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
  9. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  10. 2021Internet-Augmented Dialogue Generationcited by 217
  11. 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scalecited by 212
  12. 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 164
12 more
  1. 2024Evaluation of OpenAI o1: Opportunities and Challenges of AGIcited by 127
  2. 2023Solving Math Word Problems by Combining Language Models With Symbolic Solverscited by 124
  3. 2023Table Meets LLM: Can Large Language Models Understand Structured Table Data? A Benchmark and Empirical Studycited by 116
  4. 2024Embodied LLM Agents Learn to Cooperate in Organized Teamscited by 81
  5. 2023GPT4GEO: How a Language Model Sees the World's Geographycited by 68
  6. 2024Change-Agent: Towards Interactive Comprehensive Remote Sensing Change Interpretation and Analysiscited by 60
  7. 2023Autonomous GIS: the next-generation AI-powered GIScited by 52
  8. 2024From LLM to Conversational Agent: A Memory Enhanced Architecture with Fine-Tuning of Large Language Modelscited by 42
  9. 2024GeoLLM-Engine: A Realistic Environment for Building Geospatial Copilotscited by 27
  10. 2023Towards Verifiable Text Generation with Evolving Memory and Self-Reflectioncited by 21
  11. 2024Geode: A Zero-shot Geospatial Question-Answering Agent with Explicit Reasoning and Precise Spatio-Temporal Retrievalcited by 5
  12. 2024Research on the Spatial Data Intelligent Foundation Modelcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 4; 2026: 4.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025GeoJSON Agents:A Multi-Agent LLM Architecture for Geospatial Analysis-Function Calling vs Code Generation
  2. 2025MapAgent: A Hierarchical Agent for Geospatial Reasoning with Dynamic Map Tool Integration
  3. 2024An LLM Agent for Automatic Geospatial Data Analysis
  4. 2026GISAgentBench: A Practitioner-Sourced Benchmark for Evaluating LLM Agents on GIS Tasks
  5. 2025GeoAnalystBench: A GeoAI benchmark for assessing large language models for spatial analysis workflow and code generation
  6. 2026ANASSA: An Agentic AI Orchestration Framework for Spatial Intelligence
  7. 2026GISclaw: A Comprehensive Open-Source LLM Agent System for Realistic Multi-Step Geospatial Analysis
  8. 2025Towards a Barrier-free GeoQA Portal: Natural Language Interaction with Geospatial Data Using Multi-Agent LLMs and Semantic Search