mlsanityData to 14 Oct 2026

Comprehending Spatio-temporal Data via Cinematic Storytelling using Large Language Models

arXiv 2510.17301 ↗First posted 20 Oct 2025cs.DB cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Spatio-temporal data captures complex dynamics across both space and time, yet traditional visualizations are complex, require domain expertise and often fail to resonate with broader audiences. Here, we propose MapMuse, a storytelling-based framework for interpreting spatio-temporal datasets, transforming them into compelling, narrative-driven experiences. We utilize large language models and employ retrieval augmented generation (RAG) and agent-based techniques to generate comprehensive stories. Drawing on principles common in cinematic storytelling, we emphasize clarity, emotional connection, and audience-centric design. As a case study, we analyze a dataset of taxi trajectories. Two perspectives are presented: a captivating story based on a heat map that visualizes millions of taxi trip endpoints to uncover urban mobility patterns; and a detailed narrative following a single long taxi journey, enriched with city landmarks and temporal shifts. By portraying locations as characters and movement as plot, we argue that data storytelling drives insight, engagement, and action from spatio-temporal information. The case study illustrates how MapMuse can bridge the gap between data complexity and human understanding. The aim of this short paper is to provide a glimpse to the potential of the cinematic storytelling technique as an effective communication tool for spatio-temporal data, as well as to describe open problems and opportunities for future research.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 34 references that are in the map. First posted on arXiv 20 Oct 2025.

Builds on

11 of 34 references.

References · 11

  1. 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 452
  2. 2025Agentic Large Language Models, a surveycited by 108
  3. 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editingcited by 106
  4. 2024Granite-Function Calling Model: Introducing Function Calling Abilities via Multi-task Learning of Granular Taskscited by 52
  5. 2024How Can Large Language Models Understand Spatial-Temporal Data?cited by 33
  6. 2025SpaceVLLM: Endowing Multimodal Large Language Model with Spatio-Temporal Video Grounding Capabilitycited by 28
  7. 2023A Universal Question-Answering Platform for Knowledge Graphscited by 17
  8. 2024Geolocation Representation from Large Language Models are Generic Enhancers for Spatio-Temporal Learningcited by 15
  9. 2025R2D2: Remembering, Replaying and Dynamic Decision Making with a Reflective Agentic Memorycited by 14
  10. 2024STD-PLM: Understanding Both Spatial and Temporal Properties of Spatial-Temporal Data with PLMcited by 10
  11. 2024ContextualStory: Consistent Visual Storytelling with Spatially-Enhanced and Storyline Contextcited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025SceneLoom: Communicating Data with Scene Context ↗
  2. 2026LogiStory: A Logic-Aware Framework for Multi-Image Story Visualization
  3. 2026DataMagic: Authoring Data Videos through Declarative Multi-Agent Orchestration
  4. 2025VisAgent: Narrative-Preserving Story Visualization Framework
  5. 2024Movie2Story: A framework for understanding videos and telling stories in the form of novel text
  6. 2025VIST-GPT: Ushering in the Era of Visual Storytelling with LLMs?
  7. 2025Hierarchical Knowledge Graphs for Story Understanding in Visual Narratives
  8. 2026DVBench: Benchmarking MLLMs for Understanding Dynamic Charts and Narratives in Data Videos