Compass: Navigating Global Marine Lead Data Integration through Expert-Guided LLM Agent
Not on the map. Why?
Abstract (arXiv)
Marine lead (Pb) and its isotopes are critical tracers for ocean circulation and anthropogenic pollution, yet in-situ observations remain costly and sparse. While vast historical records exist, they lie buried within the unstructured content of academic papers, creating "data silos" inaccessible to comprehensive analysis. Manual extraction is unscalable, while general-purpose Large Language Models (LLMs) lack the necessary domain-specific knowledge, leading to hallucinations and scientifically invalid outputs. To address this, we introduce an expert-guided adaptation approach that enables LLMs to perform rigorous scientific data extraction without fine-tuning. We operationalize this approach through Compass, an LLM agent framework enhanced by a Knowledge Tree co-designed with marine scientists, which decomposes complex tasks into verifiable steps, guiding the agent's reasoning to ensure scientific validity. Deploying Compass across a corpus of over 230,000 relevant open-access papers, we successfully extract 3,751 previously unincorporated Pb records. This effort establishes the largest integrated marine Pb database to date. Beyond standard metrics, Compass demonstrates superior reliability through multi-layered validation, achieving 92% accuracy as confirmed through expert manual verification. The newly integrated data expand coverage in previously under-sampled regions such as the East China Sea and the Southern Ocean, providing an enriched data foundation for future scientific discoveries. We release an interactive visualization platform to facilitate open scientific access. Our work demonstrates that expert-guided agents can effectively bridge the gap between general-purpose LLMs and high-stakes scientific domains, enabling scalable data discovery in geosciences.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 100 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
14 of 100 references.
References · 14
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
- 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 255
- 2023PaperQA: Retrieval-Augmented Generative Agent for Scientific Researchcited by 143
- 2024AutoWebGLM: A Large Language Model-based Web Navigating Agentcited by 130
- 2024AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generationcited by 80
- 2024TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergycited by 70
- 2023K2: A Foundation Language Model for Geoscience Knowledge Understanding and Utilizationcited by 69
- 2023OceanGPT: A Large Language Model for Ocean Science Taskscited by 42
- 2023From Supervised to Generative: A Novel Paradigm for Tabular Deep Learning with Large Language Modelscited by 22
- 2023CF-GODE: Continuous-Time Causal Inference for Multi-Agent Dynamical Systemscited by 16
- 2025MobileSteward: Integrating Multiple App-Oriented Agents with Self-Evolution to Automate Cross-App Instructionscited by 16
- 2024MatViX: Multimodal Information Extraction from Visually Rich Articlescited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025OKG-LLM: Aligning Ocean Knowledge Graph with Observation Data via LLMs for Global Sea Surface Temperature Prediction
- 2026OceanMind: A multi-agent AI system for ocean diagnosis
- 2025Accelerating Earth Science Discovery via Multi-Agent LLM Systems
- 2026OceanPile: A Large-Scale Multimodal Ocean Corpus for Foundation Models
- 2026HERMES: a multi-agent framework for structured knowledge extraction from ultra-long documents in geoscience
- 2026A Hierarchical Multi-Agent System for Autonomous Discovery in Geoscientific Data Archives
- 2026EO-Agents: A Three-Agent LLM Pipeline for Earth Observation Hypothesis Generation
- 2026A Locally Deployable Tool-Grounded LLM Multi-agent Framework for Automating Methane Emission Analysis and Reporting