# Dual-Perspective United Transformer for Object Segmentation in Optical Remote Sensing Images

arXiv: https://arxiv.org/abs/2506.21866 · HTML: https://mlsanity.com/paper/2506.21866/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Builds on 24 of its 47 references that are in the map.
- First posted on arXiv 27 Jun 2025.

## Builds on (most cited first, 24 of 24)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Very Deep Convolutional Networks for Large-Scale Image Recognition](https://mlsanity.com/paper/1409.1556/) (2014)
- [Swin Transformer: Hierarchical Vision Transformer using Shifted Windows](https://mlsanity.com/paper/2103.14030/) (2021)
- [Feature Pyramid Networks for Object Detection](https://mlsanity.com/paper/1612.03144/) (2016)
- [CBAM: Convolutional Block Attention Module](https://mlsanity.com/paper/1807.06521/) (2018)
- [Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet](https://mlsanity.com/paper/2101.11986/) (2021)
- [PVT v2: Improved Baselines with Pyramid Vision Transformer](https://mlsanity.com/paper/2106.13797/) (2021)
- [Vision Transformer Adapter for Dense Predictions](https://mlsanity.com/paper/2205.08534/) (2022)
- [Res2Net: A New Multi-scale Backbone Architecture](https://mlsanity.com/paper/1904.01169/) (2019)
- [Visual Saliency Transformer](https://mlsanity.com/paper/2104.12099/) (2021)
- [Receptive Field Block Net for Accurate and Fast Object Detection](https://mlsanity.com/paper/1711.07767/) (2017)
- [Salient Object Detection via Integrity Learning](https://mlsanity.com/paper/2101.07663/) (2021)
- [ResT: An Efficient Transformer for Visual Recognition](https://mlsanity.com/paper/2105.13677/) (2021)
- [Dense Attention Fluid Network for Salient Object Detection in Optical Remote Sensing Images](https://mlsanity.com/paper/2011.13144/) (2020)
- [Nested Network with Two-Stream Pyramid for Salient Object Detection in Optical Remote Sensing Images](https://mlsanity.com/paper/1906.08462/) (2019)
- [Frequency-Spatial Entanglement Learning for Camouflaged Object Detection](https://mlsanity.com/paper/2409.01686/) (2024)
- [Adaptive Frequency Filters As Efficient Global Token Mixers](https://mlsanity.com/paper/2307.14008/) (2023)
- [A Good Student is Cooperative and Reliable: CNN-Transformer Collaborative Learning for Semantic Segmentation](https://mlsanity.com/paper/2307.12574/) (2023)
- [Salient Object Detection in Optical Remote Sensing Images Driven by Transformer](https://mlsanity.com/paper/2309.08206/) (2023)
- [Lightweight Salient Object Detection in Optical Remote-Sensing Images via Semantic Matching and Edge Alignment](https://mlsanity.com/paper/2301.02778/) (2023)
- [Lightweight Salient Object Detection in Optical Remote Sensing Images via Feature Correlation](https://mlsanity.com/paper/2201.08049/) (2022)
- [GLCONet: Learning Multi-source Perception Representation for Camouflaged Object Detection](https://mlsanity.com/paper/2409.09588/) (2024)
- [United Domain Cognition Network for Salient Object Detection in Optical Remote Sensing Images](https://mlsanity.com/paper/2411.06703/) (2024)
- [Lightweight RGB-D Salient Object Detection from a Speed-Accuracy Tradeoff Perspective](https://mlsanity.com/paper/2505.04758/) (2025)

## Built on by (most cited first, 5 of 5)

- [Controllable-LPMoE: Adapting to Challenging Object Segmentation via Dynamic Local Priors from Mixture-of-Experts](https://mlsanity.com/paper/2510.21114/) (2025)
- [Beyond Global Scanning: Adaptive Visual State Space Modeling for Salient Object Detection in Optical Remote Sensing Images](https://mlsanity.com/paper/2508.10542/) (2025)
- [ASGNet: Adaptive Spectrum Guidance Network for Automatic Polyp Segmentation](https://mlsanity.com/paper/2604.14755/) (2026)
- [IPDiff: Diffusion-driven ORSI Salient Object Detection with Information Reconstruction and Multi-Prior Guidance](https://mlsanity.com/paper/2607.03696/) (2026)
- [SPLG-Mamba: Structure-Preserving Local-Global Mamba Network for Salient Object Detection in Optical Remote Sensing Images](https://mlsanity.com/paper/2608.29626/) (2026)

## Abstract (arXiv)

Automatically segmenting objects from optical remote sensing images (ORSIs) is an important task. Most existing models are primarily based on either convolutional or Transformer features, each offering distinct advantages. Exploiting both advantages is valuable research, but it presents several challenges, including the heterogeneity between the two types of features, high complexity, and large parameters of the model. However, these issues are often overlooked in existing the ORSIs methods, causing sub-optimal segmentation. For that, we propose a novel Dual-Perspective United Transformer (DPU-Former) with a unique structure designed to simultaneously integrate long-range dependencies and spatial details. In particular, we design the global-local mixed attention, which captures diverse information through two perspectives and introduces a Fourier-space merging strategy to obviate deviations for efficient fusion. Furthermore, we present a gated linear feed-forward network to increase the expressive ability. Additionally, we construct a DPU-Former decoder to aggregate and strength features at different layers. Consequently, the DPU-Former model outperforms the state-of-the-art methods on multiple datasets. Code: https://github.com/CSYSI/DPU-Former.