PoE-Fuse: Precision-Weighted Expert Fusion for Bi-Temporal Change Understanding
Not on the map. Why?
Abstract (arXiv)
Bi-temporal change understanding, which localizes and characterizes what changed between two satellite images, is central to disaster response and environmental monitoring, spanning change detection, building localization, and damage assessment. Strong vision-language models address these tasks, but adapting them typically requires full fine-tuning or reinforcement learning, which is costly and unstable. We propose PoE-Fuse, a parameter-efficient framework that instead composes frozen foundation experts for geometry, grounding, and language, resampling their features onto a shared spatial grid and training only a lightweight fusion trunk. PoE-Fuse treats the aligned features as Gaussian observations of a latent scene state and fuses them by learned per-cell precision. This product-of-experts estimator strictly generalizes uniform summation and scalar gating, and extends to change fields by composing the precisions of the two timestamps. A single shared trunk solves the three tasks at once, reaching a mean F1 of 59.2%, compared with 40.7% for an instruction-tuned temporal vision-language assistant, and surpassing dedicated change-detection models retrained under the same protocol and training budget.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 40 references that are in the map. First posted on arXiv 27 Sep 2026.
Builds on
29 of 40 references.
References · 29
- 2023Segment Anythingcited by 8,234
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
- 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 328
17 more
- 2018Fully Convolutional Siamese Networks for Change Detectioncited by 306
- 2021Remote Sensing Image Change Detection with Transformerscited by 306
- 2022A Transformer-Based Siamese Network for Change Detectioncited by 244
- 2018Multimodal Generative Models for Scalable Weakly-Supervised Learningcited by 200
- 2022Frozen CLIP Models are Efficient Video Learnerscited by 182
- 2023SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagerycited by 151
- 2024ChangeMamba: Remote Sensing Change Detection With Spatiotemporal State Space Modelcited by 120
- 2026Mamba-3: Improved Sequence Modeling using State Space Principlescited by 89
- 2021S2Looking: A Satellite Side-Looking Dataset for Building Change Detectioncited by 77
- 2024TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation Datacited by 70
- 2022TINYCD: A (Not So) Deep Learning Model For Change Detectioncited by 36
- 2024RSCaMa: Remote Sensing Image Change Captioning with State Space Modelcited by 35
- 2025RemoteReasoner: Towards Unifying Geospatial Reasoning Workflowcited by 28
- 2025GeoVLM-R1: Reinforcement Fine-Tuning for Improved Remote Sensing Reasoningcited by 15
- 2025BTCChat: Advancing Remote Sensing Bi-temporal Change Captioning with Multimodal Large Language Modelcited by 7
- 2026TerraScope: Pixel-Grounded Visual Reasoning for Earth Observationcited by 7
- 2026GeoSolver: Scaling Test-Time Reasoning in Remote Sensing with Fine-Grained Process Supervisioncited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026FM-ChangeNet: Learning Change through Pathwise Feature Transport
- 2025Precision Spatio-Temporal Feature Fusion for Robust Remote Sensing Change Detection
- 2025ViLaCD-R1: A Vision-Language Framework for Semantic Change Detection in Remote Sensing
- 2026Finding Change in Satellite Archives from Text: How to Combine Before-and-After Images Efficiently
- 2026A Dual-Branch Framework for Semantic Change Detection with Boundary and Temporal Awareness
- 2025ChessMamba: Structure-Aware Interleaving of State Spaces for Change Detection in Remote Sensing Images
- 2024Remote Sensing SpatioTemporal Vision-Language Models: A Comprehensive Survey
- 2024Towards Temporal Change Explanations from Bi-Temporal Satellite Images