LBTCap: A Lightweight Bilateral Transformer for Real-Time Remote Sensing Image Change Captioning
Not on the map. Why?
Abstract (arXiv)
Remote sensing image change captioning (RSICC) generates natural-language descriptions of semantic changes between paired remote sensing images (RSIs), supporting applications such as urban planning, disaster response, and environmental monitoring. Although recent methods achieve strong captioning accuracy, most overlook computational efficiency and inference speed, which are essential for real-time deployment in practice. To this end, we propose LBTCap, a lightweight RSICC framework built on a bilateral Transformer that jointly models pre- and post-change features for efficient processing of paired RSIs. Specifically, we introduce a bilateral attention mechanism for paired inputs: the two temporal images are projected into separate queries and keys by the same query and key matrices shared across the two images, the value is formed from their concatenation, and the two resulting attention maps are combined by a learnable, structurally bilateral weighting instead of a fixed subtraction. This design keeps both temporal branches explicit while remaining compact, and, together with a truncated backbone and grouped-query attention, LBTCap uses only 39.99M parameters, of which the change-aware encoder accounts for just 2.78M. Extensive experiments on two public RSICC datasets show that LBTCap matches or closely approaches the accuracy of state-of-the-art methods while using far fewer parameters and running at markedly higher inference speed, with the benefit of the bilateral formulation most pronounced in the low-resource setting, demonstrating a favorable accuracy-efficiency trade-off for practical RSICC.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 92 references that are in the map. First posted on arXiv 3 Jul 2026.
Builds on
23 of 92 references.
References · 23
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
- 2019Root Mean Square Layer Normalizationcited by 1,425
- 2024TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation Datacited by 69
- 2024Change-Agent: Towards Interactive Comprehensive Remote Sensing Change Interpretation and Analysiscited by 60
- 2023Changes to Captions: An Attentive Network for Remote Sensing Change Captioningcited by 41
- 2024RSCaMa: Remote Sensing Image Change Captioning with State Space Modelcited by 35
- 2023Progressive Scale-aware Network for Remote sensing Image Change Captioningcited by 27
- 2024ChangeChat: An Interactive Model for Remote Sensing Change Analysis via Multimodal Instruction Tuningcited by 23
- 2024Remote Sensing SpatioTemporal Vision-Language Models: A Comprehensive Surveycited by 22
11 more
- 2020Code-Aligned Autoencoders for Unsupervised Change Detection in Multimodal Remote Sensing Imagescited by 17
- 2024Semantic-CC: Boosting Remote Sensing Image Change Captioning via Foundational Knowledge and Semantic Guidancecited by 17
- 2024Enhancing Perception of Key Changes in Remote Sensing Image Change Captioningcited by 16
- 2023Pixel-Level Change Detection Pseudo-Label Learning for Remote Sensing Change Captioningcited by 14
- 2024A Lightweight Sparse Focus Transformer for Remote Sensing Image Change Captioningcited by 13
- 2024CDChat: A Large Multimodal Model for Remote Sensing Change Descriptioncited by 13
- 2024Mask Approximation Net: A Novel Diffusion Model Approach for Remote Sensing Change Captioningcited by 10
- 2025Robust Change Captioning in Remote Sensing: SECOND-CC Dataset and MModalCC Frameworkcited by 8
- 2025Towards Comprehensive Interactive Change Understanding in Remote Sensing: A Large-scale Dataset and Dual-granularity Enhanced VLMcited by 8
- 2025DeltaVLM: Interactive Remote Sensing Image Change Analysis via Instruction-guided Difference Perceptioncited by 6
- 2024Towards a multimodal framework for remote sensing image change retrieval and captioningcited by 5
Built on by
Not cited yet.