Towards Unified Vision Language Models for Forest Ecological Analysis in Earth Observation
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Recent progress in vision language models (VLMs) has enabled remarkable perception and reasoning capabilities, yet their potential for scientific regression in Earth Observation (EO) remains largely unexplored. Existing EO datasets mainly emphasize semantic understanding tasks such as captioning or classification, lacking benchmarks that align multimodal perception with measurable biophysical variables. To fill this gap, we present REO-Instruct, the first unified benchmark designed for both descriptive and regression tasks in EO. REO-Instruct establishes a cognitively interpretable logic chain in forest ecological scenario (human activity,land-cover classification, ecological patch counting, above-ground biomass (AGB) regression), bridging qualitative understanding and quantitative prediction. The dataset integrates co-registered Sentinel-2 and ALOS-2 imagery with structured textual annotations generated and validated through a hybrid human AI pipeline. Comprehensive evaluation protocols and baseline results across generic VLMs reveal that current models struggle with numeric reasoning, highlighting an essential challenge for scientific VLMs. REO-Instruct offers a standardized foundation for developing and assessing next-generation geospatial models capable of both description and scientific inference. The project page are publicly available at hrefhttps://github.com/zhu-xlab/REO-InstructREO-Instruct.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 19 of its 29 references that are in the map. First posted on arXiv 20 Nov 2025.
Builds on
19 of 29 references.
References · 19
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,392
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 328
- 2023RSGPT: A Remote Sensing Vision Language Model and Benchmarkcited by 207
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 184
- 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensingcited by 151
- 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Modelcited by 138
- 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensingcited by 125
- 2022A high-resolution canopy height model of the Earthcited by 91
7 more
- 2023Remote Sensing Vision-Language Foundation Models without Annotations via Ground Remote Alignmentcited by 71
- 2024From Words to Numbers: Your Large Language Model Is Secretly A Capable Regressor When Given In-Context Examplescited by 57
- 2024OmniPred: Language Models as Universal Regressorscited by 34
- 2024TorchSpatial: A Location Encoding Framework and Benchmark for Spatial Representation Learningcited by 31
- 2023Multi-modal learning for geospatial vegetation forecastingcited by 16
- 2024AGBD: A Global-scale Biomass Datasetcited by 13
- 2024Combining Observational Data and Language for Species Range Estimationcited by 12
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024REO-VLM: Transforming VLM to Meet Regression Challenges in Earth Observation
- 2026OmniEarth: A Benchmark for Evaluating Vision-Language Models in Geospatial Tasks
- 2025ChatENV: An Interactive Vision-Language Model for Sensor-Guided Environmental Monitoring and Scenario Simulation
- 2025Regression in EO: Are VLMs Up to the Challenge?
- 2025Towards Faithful Reasoning in Remote Sensing: A Perceptually-Grounded GeoSpatial Chain-of-Thought for Vision-Language Models
- 2026Vision-Language Agents for Interactive Forest Change Analysis
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives
- 2025EarthMind: Leveraging Cross-Sensor Data for Advanced Earth Observation Interpretation with a Unified Multimodal LLM