Forest-Chat: Adapting Vision-Language Agents for Interactive Forest Change Analysis
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
The increasing availability of high-resolution satellite imagery, together with advances in deep learning, creates new opportunities for forest monitoring workflows. Two central challenges in this domain are pixel-level change detection and semantic change interpretation, particularly for complex forest dynamics. While large language models (LLMs) are increasingly adopted for data exploration, their integration with vision-language models (VLMs) for remote sensing image change interpretation (RSICI) remains underexplored, especially beyond urban environments. This paper introduces Forest-Chat, an LLM-driven agent for forest change analysis, enabling natural language querying across multiple RSICI tasks, including change detection and captioning, object counting, deforestation characterisation, and change reasoning. Forest-Chat builds upon a multi-level change interpretation (MCI) vision-language backbone with LLM-based orchestration, incorporating zero-shot change detection via AnyChange and multimodal LLM-based zero-shot change captioning and refinement. To support adaptation and evaluation in forest environments, we introduce the Forest-Change dataset, comprising bi-temporal satellite imagery, pixel-level change masks, and semantic change captions via human annotation and rule-based methods. Forest-Chat achieves mIoU and BLEU-4 scores of 67.10% and 40.17% on Forest-Change, and 88.13% and 34.41% on LEVIR-MCI-Trees, a tree-focused subset of LEVIR-MCI. In a zero-shot capacity, it achieves 60.15% and 34.00% on Forest-Change, and 47.32% and 18.23% on LEVIR-MCI-Trees. Further experiments demonstrate the value of caption refinement for injecting geographic domain knowledge into supervised captions, and the system's limited label domain transfer onto JL1-CD-Trees. These findings demonstrate that interactive, LLM-driven systems can support accessible and interpretable forest change analysis.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 52 of its 94 references that are in the map. First posted on arXiv 21 Jan 2026.
Builds on
52 of 94 references.
Closest ancestors · 10
Same direction, newest first
- 2024UniRS: Unifying Multi-temporal Remote Sensing Tasks through Vision Language Models30 Dec
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues19 Dec
- 2024RSUniVLM: A Unified Vision Language Model for Remote Sensing via Granularity-oriented Mixture of Experts7 Dec
- 2024Remote Sensing SpatioTemporal Vision-Language Models: A Comprehensive Survey3 Dec
- 2024RS-Agent: Automating Remote Sensing Tasks through Intelligent Agent11 Jun
- 2024Good at captioning, bad at counting: Benchmarking GPT-4V on Earth observation data31 Jan
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domain30 Jan
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing24 Nov
- 2023RSGPT: A Remote Sensing Vision Language Model and Benchmark28 Jul
- 2023Vision-Language Models in Remote Sensing: Current Progress and Future Trends9 May
Other references · 42
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,358
- 2020Gradient Surgery for Multi-Task Learningcited by 1,256
- 2020Designing Network Design Spacescited by 960
30 more
- 2017A Survey on Multi-Task Learningcited by 840
- 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 834
- 2018Multi-Task Learning as Multi-Objective Optimizationcited by 821
- 2021Conflict-Averse Gradient Descent for Multi-task Learningcited by 459
- 2020Multi-Task Learning with Deep Neural Networks: A Surveycited by 375
- 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agentscited by 339
- 2023Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Biascited by 232
- 2020Just Pick a Sign: Optimizing Deep Multitask Models with Gradient Sign Dropoutcited by 201
- 2023OpenAGI: When LLM Meets Domain Expertscited by 197
- 2022Auto-Lambda: Disentangling Dynamic Task Relationshipscited by 73
- 2024TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation Datacited by 70
- 2024Change-Agent: Towards Interactive Comprehensive Remote Sensing Change Interpretation and Analysiscited by 63
- 2024Vision Foundation Models in Remote Sensing: A Surveycited by 54
- 2024CDMamba: Incorporating Local Clues into Mamba for Remote Sensing Image Binary Change Detectioncited by 48
- 2025ThinkGeo: Evaluating Tool-Augmented Agents for Remote Sensing Taskscited by 46
- 2023Changes to Captions: An Attentive Network for Remote Sensing Change Captioningcited by 41
- 2024FlowBench: Revisiting and Benchmarking Workflow-Guided Planning for LLM-based Agentscited by 40
- 2024Segment Any Changecited by 35
- 2024Remote Sensing ChatGPT: Solving Remote Sensing Tasks with ChatGPT and Visual Modelscited by 32
- 2022CLIP4IDC: CLIP for Image Difference Captioningcited by 25
- 2024ChangeChat: An Interactive Model for Remote Sensing Change Analysis via Multimodal Instruction Tuningcited by 23
- 2024Semantic-CC: Boosting Remote Sensing Image Change Captioning via Foundational Knowledge and Semantic Guidancecited by 17
- 2024Enhancing Perception of Key Changes in Remote Sensing Image Change Captioningcited by 16
- 2023OpenForest: A data catalogue for machine learning in forest monitoringcited by 15
- 2023Tree-GPT: Modular Large Language Model Expert System for Forest Remote Sensing Image Understanding and Interactive Analysiscited by 14
- 2022AI applications in forest monitoring need remote sensing benchmark datasetscited by 10
- 2024ChangeMinds: Multi-task Framework for Detecting and Describing Changes in Remote Sensingcited by 7
- 2025JL1-CD: A New Benchmark for Remote Sensing Change Detection and a Robust Multi-Teacher Knowledge Distillation Frameworkcited by 6
- 2025GlobalGeoTree: A Multi-Granular Vision-Language Dataset for Global Tree Species Classificationcited by 4
- 2022Multimodal SuperCon: Classifier for Drivers of Deforestation in Indonesiacited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Vision-Language Agents for Interactive Forest Change Analysis
- 2025ViLaCD-R1: A Vision-Language Framework for Semantic Change Detection in Remote Sensing
- 2026Decoding the Delta: Unifying Remote Sensing Change Detection and Understanding with Multimodal Large Language Models
- 2025UniChange: Unifying Change Detection with Multimodal Large Language Model
- 2025DeltaVLM: Interactive Remote Sensing Image Change Analysis via Instruction-guided Difference Perception
- 2025ChatENV: An Interactive Vision-Language Model for Sensor-Guided Environmental Monitoring and Scenario Simulation
- 2026Revisiting Change VQA in Remote Sensing with Structured and Native Multimodal Qwen Models
- 2025Towards Comprehensive Interactive Change Understanding in Remote Sensing: A Large-scale Dataset and Dual-granularity Enhanced VLM