# Convolution and Attention Mixer for Synthetic Aperture Radar Image Change Detection

arXiv: https://arxiv.org/abs/2309.12010 · HTML: https://mlsanity.com/paper/2309.12010/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- Builds on 7 of its 21 references that are in the map.
- First posted on arXiv 21 Sep 2023.

## Builds on (most cited first, 7 of 7)

- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [Swin Transformer: Hierarchical Vision Transformer using Shifted Windows](https://mlsanity.com/paper/2103.14030/) (2021)
- [When Shift Operation Meets Vision Transformer: An Extremely Simple Alternative to Attention Mechanism](https://mlsanity.com/paper/2201.10801/) (2022)
- [Change Detection in Synthetic Aperture Radar Images Using a Dual-Domain Network](https://mlsanity.com/paper/2104.06699/) (2021)
- [Improving Landslide Detection on SAR Data through Deep Learning](https://mlsanity.com/paper/2105.00782/) (2021)
- [Change Detection from Synthetic Aperture Radar Images via Dual Path Denoising Network](https://mlsanity.com/paper/2203.06543/) (2022)
- [Synthetic Aperture Radar Image Change Detection via Layer Attention-Based Noise-Tolerant Network](https://mlsanity.com/paper/2208.04481/) (2022)

## Built on by (most cited first, 4 of 4)

- [Kuro Siwo: 33 billion m2 under the water. A global multi-temporal satellite dataset for rapid flood mapping](https://mlsanity.com/paper/2311.12056/) (2023)
- [Frequency-Compensated Network for Daily Arctic Sea Ice Concentration Prediction](https://mlsanity.com/paper/2504.16745/) (2025)
- [Wavelet-based Bi-dimensional Aggregation Network for SAR Image Change Detection](https://mlsanity.com/paper/2407.13151/) (2024)
- [Synthetic Aperture Radar Image Change Detection Based on Global Dynamic Context-Aware Network](https://mlsanity.com/paper/2605.16764/) (2026)

## Abstract (arXiv)

Synthetic aperture radar (SAR) image change detection is a critical task and has received increasing attentions in the remote sensing community. However, existing SAR change detection methods are mainly based on convolutional neural networks (CNNs), with limited consideration of global attention mechanism. In this letter, we explore Transformer-like architecture for SAR change detection to incorporate global attention. To this end, we propose a convolution and attention mixer (CAMixer). First, to compensate the inductive bias for Transformer, we combine self-attention with shift convolution in a parallel way. The parallel design effectively captures the global semantic information via the self-attention and performs local feature extraction through shift convolution simultaneously. Second, we adopt a gating mechanism in the feed-forward network to enhance the non-linear feature transformation. The gating mechanism is formulated as the element-wise multiplication of two parallel linear layers. Important features can be highlighted, leading to high-quality representations against speckle noise. Extensive experiments conducted on three SAR datasets verify the superior performance of the proposed CAMixer. The source codes will be publicly available at https://github.com/summitgao/CAMixer .
