mlsanityData to 14 Oct 2026

Forest-Chat: Adapting Vision-Language Agents for Interactive Forest Change Analysis

arXiv 2601.14637 ↗First posted 21 Jan 2026cs.CV cs.AI cs.CLcited by 0

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

The increasing availability of high-resolution satellite imagery, together with advances in deep learning, creates new opportunities for forest monitoring workflows. Two central challenges in this domain are pixel-level change detection and semantic change interpretation, particularly for complex forest dynamics. While large language models (LLMs) are increasingly adopted for data exploration, their integration with vision-language models (VLMs) for remote sensing image change interpretation (RSICI) remains underexplored, especially beyond urban environments. This paper introduces Forest-Chat, an LLM-driven agent for forest change analysis, enabling natural language querying across multiple RSICI tasks, including change detection and captioning, object counting, deforestation characterisation, and change reasoning. Forest-Chat builds upon a multi-level change interpretation (MCI) vision-language backbone with LLM-based orchestration, incorporating zero-shot change detection via AnyChange and multimodal LLM-based zero-shot change captioning and refinement. To support adaptation and evaluation in forest environments, we introduce the Forest-Change dataset, comprising bi-temporal satellite imagery, pixel-level change masks, and semantic change captions via human annotation and rule-based methods. Forest-Chat achieves mIoU and BLEU-4 scores of 67.10% and 40.17% on Forest-Change, and 88.13% and 34.41% on LEVIR-MCI-Trees, a tree-focused subset of LEVIR-MCI. In a zero-shot capacity, it achieves 60.15% and 34.00% on Forest-Change, and 47.32% and 18.23% on LEVIR-MCI-Trees. Further experiments demonstrate the value of caption refinement for injecting geographic domain knowledge into supervised captions, and the system's limited label domain transfer onto JL1-CD-Trees. These findings demonstrate that interactive, LLM-driven systems can support accessible and interpretable forest change analysis.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 52 of its 94 references that are in the map. First posted on arXiv 21 Jan 2026.

Builds on

52 of 94 references.

Closest ancestors · 10

Same direction, newest first

  1. 2024UniRS: Unifying Multi-temporal Remote Sensing Tasks through Vision Language Models30 Dec
  2. 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues19 Dec
  3. 2024RSUniVLM: A Unified Vision Language Model for Remote Sensing via Granularity-oriented Mixture of Experts7 Dec
  4. 2024Remote Sensing SpatioTemporal Vision-Language Models: A Comprehensive Survey3 Dec
  5. 2024RS-Agent: Automating Remote Sensing Tasks through Intelligent Agent11 Jun
  6. 2024Good at captioning, bad at counting: Benchmarking GPT-4V on Earth observation data31 Jan
  7. 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domain30 Jan
  8. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing24 Nov
  9. 2023RSGPT: A Remote Sensing Vision Language Model and Benchmark28 Jul
  10. 2023Vision-Language Models in Remote Sensing: Current Progress and Future Trends9 May

Other references · 42

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  5. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  6. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  7. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  8. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  9. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  10. 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,358
  11. 2020Gradient Surgery for Multi-Task Learningcited by 1,256
  12. 2020Designing Network Design Spacescited by 960
30 more
  1. 2017A Survey on Multi-Task Learningcited by 840
  2. 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 834
  3. 2018Multi-Task Learning as Multi-Objective Optimizationcited by 821
  4. 2021Conflict-Averse Gradient Descent for Multi-task Learningcited by 459
  5. 2020Multi-Task Learning with Deep Neural Networks: A Surveycited by 375
  6. 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agentscited by 339
  7. 2023Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Biascited by 232
  8. 2020Just Pick a Sign: Optimizing Deep Multitask Models with Gradient Sign Dropoutcited by 201
  9. 2023OpenAGI: When LLM Meets Domain Expertscited by 197
  10. 2022Auto-Lambda: Disentangling Dynamic Task Relationshipscited by 73
  11. 2024TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation Datacited by 70
  12. 2024Change-Agent: Towards Interactive Comprehensive Remote Sensing Change Interpretation and Analysiscited by 63
  13. 2024Vision Foundation Models in Remote Sensing: A Surveycited by 54
  14. 2024CDMamba: Incorporating Local Clues into Mamba for Remote Sensing Image Binary Change Detectioncited by 48
  15. 2025ThinkGeo: Evaluating Tool-Augmented Agents for Remote Sensing Taskscited by 46
  16. 2023Changes to Captions: An Attentive Network for Remote Sensing Change Captioningcited by 41
  17. 2024FlowBench: Revisiting and Benchmarking Workflow-Guided Planning for LLM-based Agentscited by 40
  18. 2024Segment Any Changecited by 35
  19. 2024Remote Sensing ChatGPT: Solving Remote Sensing Tasks with ChatGPT and Visual Modelscited by 32
  20. 2022CLIP4IDC: CLIP for Image Difference Captioningcited by 25
  21. 2024ChangeChat: An Interactive Model for Remote Sensing Change Analysis via Multimodal Instruction Tuningcited by 23
  22. 2024Semantic-CC: Boosting Remote Sensing Image Change Captioning via Foundational Knowledge and Semantic Guidancecited by 17
  23. 2024Enhancing Perception of Key Changes in Remote Sensing Image Change Captioningcited by 16
  24. 2023OpenForest: A data catalogue for machine learning in forest monitoringcited by 15
  25. 2023Tree-GPT: Modular Large Language Model Expert System for Forest Remote Sensing Image Understanding and Interactive Analysiscited by 14
  26. 2022AI applications in forest monitoring need remote sensing benchmark datasetscited by 10
  27. 2024ChangeMinds: Multi-task Framework for Detecting and Describing Changes in Remote Sensingcited by 7
  28. 2025JL1-CD: A New Benchmark for Remote Sensing Change Detection and a Robust Multi-Teacher Knowledge Distillation Frameworkcited by 6
  29. 2025GlobalGeoTree: A Multi-Granular Vision-Language Dataset for Global Tree Species Classificationcited by 4
  30. 2022Multimodal SuperCon: Classifier for Drivers of Deforestation in Indonesiacited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Vision-Language Agents for Interactive Forest Change Analysis
  2. 2025ViLaCD-R1: A Vision-Language Framework for Semantic Change Detection in Remote Sensing
  3. 2026Decoding the Delta: Unifying Remote Sensing Change Detection and Understanding with Multimodal Large Language Models
  4. 2025UniChange: Unifying Change Detection with Multimodal Large Language Model
  5. 2025DeltaVLM: Interactive Remote Sensing Image Change Analysis via Instruction-guided Difference Perception
  6. 2025ChatENV: An Interactive Vision-Language Model for Sensor-Guided Environmental Monitoring and Scenario Simulation
  7. 2026Revisiting Change VQA in Remote Sensing with Structured and Native Multimodal Qwen Models
  8. 2025Towards Comprehensive Interactive Change Understanding in Remote Sensing: A Large-scale Dataset and Dual-granularity Enhanced VLM