EO-Agents: A Three-Agent LLM Pipeline for Earth Observation Hypothesis Generation
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Large language models have recently been explored for scientific hypothesis generation, but most prior work relies on unstructured literature and free-form textual claims. We present a pipeline for Earth observation that grounds hypothesis generation directly in the NASA Earth Observation Knowledge Graph. A heterogeneous graph neural network trained on historical co-usage relations ranks candidate dataset pairings, and a three-agent LLM pipeline filters, generates, and evaluates structured research hypotheses. Applied to 1,475 NASA datasets, the system produces 160 hypotheses spanning multiple Earth-science domains, including ecohydrology, glaciology, aerosol--cloud interactions, vegetation phenology, and stratospheric chemistry. Model-predicted novel dataset pairings are rated nearly as plausible as held-out real co-usages from the literature, indicating that the pipeline surfaces scientifically coherent yet unexplored combinations. A 2*2*2 factorial experiment across GPT-5.2 and Claude Sonnet 4.6 shows that hypothesis rankings remain stable, while absolute scores depend strongly on judge identity, highlighting limitations of single-judge LLM evaluation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 23 of its 30 references that are in the map. First posted on arXiv 2 Jul 2026.
Builds on
23 of 30 references.
References · 23
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2018Link Prediction Based on Graph Neural Networkscited by 832
- 2023C-Pack: Packed Resources For General Chinese Embeddingscited by 578
- 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 430
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 422
- 2024Justice or Prejudice? Quantifying Biases in LLM-as-a-Judgecited by 368
- 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 363
- 2024Self-Preference Bias in LLM-as-a-Judgecited by 258
- 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 210
- 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 179
- 2022SciRepEval: A Multi-Format Benchmark for Scientific Document Representationscited by 129
11 more
- 2024On scalable oversight with weak LLMs judging strong LLMscited by 99
- 2024Mission Critical -- Satellite Data is a Distinct Modality in Machine Learningcited by 77
- 2024MOOSE-Chem: Large Language Models for Rediscovering Unseen Chemistry Scientific Hypothesescited by 72
- 2024Foundation Models for Remote Sensing and Earth Observation: A Surveycited by 70
- 2023Neural Common Neighbor with Completion for Link Predictioncited by 64
- 2024ResearchTown: Simulator of Human Research Communitycited by 37
- 2025AutoDiscovery: Open-ended Scientific Discovery via Bayesian Surprisecited by 33
- 2025MOOSE-Chem2: Exploring LLM Limits in Fine-Grained Scientific Hypothesis Discovery via Hierarchical Searchcited by 15
- 2025Any Large Language Model Can Be a Reliable Judge: Debiasing with a Reasoning-based Bias Detectorcited by 14
- 2024On the Impact of Feature Heterophily on Link Prediction with Graph Neural Networkscited by 10
- 2025AstroAgents: A Multi-Agent AI for Hypothesis Generation from Mass Spectrometry Datacited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Bringing Agentic Search to Earth Observation Data Discovery
- 2025Accelerating Earth Science Discovery via Multi-Agent LLM Systems
- 2025Earth-Agent: Unlocking the Full Landscape of Earth Observation with Agents
- 2026Earth-Agent-Pro: Towards Real-World Full-Chain Earth Observation with Agents
- 2026Agentic AI for Remote Sensing: Technical Challenges and Research Directions
- 2025AutoClimDS: Climate Data Science Agentic AI -- A Knowledge Graph is All You Need
- 2026ST-Bench: A Spatial-Temporal Benchmark for Multi-Agent System Generation on Scientific Research Tasks
- 2025Towards LLM Agents for Earth Observation