Figures as Interfaces: Toward LLM-Native Artifacts for Scientific Discovery
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are transforming scientific workflows, not only through their generative capabilities but also through their emerging ability to use tools, reason about data, and coordinate complex analytical tasks. Yet in most human-AI collaborations, the primary outputs, figures, are still treated as static visual summaries: once rendered, they are handled by both humans and multimodal LLMs as images to be re-interpreted from pixels or captions. The emergent capabilities of LLMs open an opportunity to fundamentally rethink this paradigm. In this paper, we introduce the concept of LLM-native figures: data-driven artifacts that are simultaneously human-legible and machine-addressable. Unlike traditional plots, each artifact embeds complete provenance: the data subset, analytical operations and code, and visualization specification used to generate it. As a result, an LLM can "see through" the figure--tracing selections back to their sources, generating code to extend analyses, and orchestrating new visualizations through natural-language instructions or direct manipulation. We implement this concept through a hybrid language-visual interface that integrates LLM agents with a bidirectional mapping between figures and underlying data. Using the science of science domain as a testbed, we demonstrate that LLM-native figures can accelerate discovery, improve reproducibility, and make reasoning transparent across agents and users. More broadly, this work establishes a general framework for embedding provenance, interactivity, and explainability into the artifacts of modern research, redefining the figure not as an end product, but as an interface for discovery. For more details, please refer to the demo video available at www.llm-native-figure.com.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). First posted on arXiv 9 Apr 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026State of the Art of LLM-Enabled Interaction with Visualization ↗
- 2026Exploring LLM Agent Designs and Interaction Modalities for Scientific Visualization
- 2025VizGenie: Toward Self-Refining, Domain-Aware Workflows for Next-Generation Scientific Visualization
- 2025PlotGen: Multi-Agent LLM-based Scientific Data Visualization via Multimodal Feedback
- 2025Toward Automated and Trustworthy Scientific Analysis and Visualization with LLM-Generated Code
- 2026HiLSVA: Design and Evaluation of a Human-in-the-Loop Agentic System for Scientific Visualization
- 2024MMSci: A Dataset for Graduate-Level Multi-Discipline Multimodal Scientific Understanding
- 2024MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualization