High Quality Segmentation for Ultra High-resolution Images
Not on the map. Why?
Abstract (arXiv)
To segment 4K or 6K ultra high-resolution images needs extra computation consideration in image segmentation. Common strategies, such as down-sampling, patch cropping, and cascade model, cannot address well the balance issue between accuracy and computation cost. Motivated by the fact that humans distinguish among objects continuously from coarse to precise levels, we propose the Continuous Refinement Model~(CRM) for the ultra high-resolution segmentation refinement task. CRM continuously aligns the feature map with the refinement target and aggregates features to reconstruct these images' details. Besides, our CRM shows its significant generalization ability to fill the resolution gap between low-resolution training images and ultra high-resolution testing ones. We present quantitative performance evaluation and visualization to show that our proposed method is fast and effective on image segmentation refinement. Code will be released at https://github.com/dvlab-research/Entity.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Builds on 49 of its 65 references that are in the map. First posted on arXiv 29 Nov 2021.
Builds on
49 of 65 references.
References · 49
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2016Pyramid Scene Parsing Networkcited by 2,472
- 2017Non-local Neural Networkscited by 2,290
37 more
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2018Dual Attention Network for Scene Segmentationcited by 1,001
- 2018Panoptic Segmentationcited by 796
- 2014Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFscited by 552
- 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 550
- 2016RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentationcited by 463
- 2019PointRend: Image Segmentation as Renderingcited by 439
- 2021In-Place Scene Labelling and Understanding with Implicit Scene Representationcited by 411
- 2017ICNet for Real-Time Semantic Segmentation on High-Resolution Imagescited by 261
- 2021COIN: COmpression with Implicit Neural representationscited by 232
- 2015Conditional Random Fields as Recurrent Neural Networkscited by 213
- 2017Object Region Mining with Adversarial Erasing: A Simple Classification to Semantic Segmentation Approachcited by 201
- 2019FSS-1000: A 1000-Class Dataset for Few-Shot Segmentationcited by 160
- 2018OCNet: Object Context Network for Scene Parsingcited by 140
- 2016Toward Deeper Understanding of Neural Networks: The Power of Initialization and a Dual View on Expressivitycited by 138
- 2020CascadePSP: Toward Class-Agnostic and Very High-Resolution Segmentation via Global and Local Refinementcited by 113
- 2020SegFix: Model-Agnostic Boundary Refinement for Segmentationcited by 97
- 2020Fully Convolutional Networks for Panoptic Segmentationcited by 92
- 2020Mask Guided Matting via Progressive Refinement Networkcited by 84
- 2018On the Convergence Rate of Training Recurrent Neural Networkscited by 82
- 2017Learning Affinity via Spatial Propagation Networkscited by 79
- 2021Open-World Entity Segmentationcited by 74
- 2019Bi-Directional Cascade Network for Perceptual Edge Detectioncited by 71
- 2019Collaborative Global-Local Networks for Memory-Efficient Segmentation of Ultra-High Resolution Imagescited by 51
- 2020Spatial Pyramid Based Graph Reasoning for Semantic Segmentationcited by 47
- 2020Spatially-Adaptive Pixelwise Networks for Fast Image Translationcited by 45
- 2021Progressive Semantic Segmentationcited by 35
- 2021Multi-Scale Aligned Distillation for Low-Resolution Detectioncited by 24
- 2020PointINS: Point-based Instance Segmentationcited by 17
- 2016Detect, Replace, Refine: Deep Structured Prediction For Pixel Wise Labelingcited by 11
- 2017Label Refinement Network for Coarse-to-Fine Semantic Segmentationcited by 11
- 2018Sequential Context Encoding for Duplicate Removalcited by 10
- 2020Meticulous Object Segmentationcited by 8
Built on by
Citing papers per year: 2022: 2; 2023: 12; 2024: 11; 2025: 3; 2026: 3.
31 papers.
Sort:
By area:
- 2023Segment Anything in High Qualitycited by 373
- 2023Transformer-Based Visual Segmentation: A Surveycited by 124
- 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentationcited by 112
- 2022Learning Implicit Feature Alignment Function for Semantic Segmentationcited by 31
- 2023UniGS: Unified Representation for Image Generation and Segmentationcited by 29
- 2023SegRefiner: Towards Model-Agnostic Segmentation Refinement with Discrete Diffusion Processcited by 28
- 2024Rethinking Interactive Image Segmentation with Low Latency, High Quality, and Diverse Promptscited by 22
- 2025SAMRefiner: Taming Segment Anything Model for Universal Mask Refinementcited by 19
- 2024Mamba or RWKV: Exploring High-Quality and High-Efficiency Segment Anything Modelcited by 18
- 2023Unite-Divide-Unite: Joint Boosting Trunk and Structure for High-accuracy Dichotomous Image Segmentationcited by 17
- 2023TransY-Net:Learning Fully Transformer Networks for Change Detection of Remote Sensing Imagescited by 13
- 2023Continuous Cross-resolution Remote Sensing Image Change Detectioncited by 8
19 more
- 2024Entity-NeRF: Detecting and Removing Moving Entities in Urban Scenescited by 8
- 2024HoloHisto: End-to-end Gigapixel WSI Segmentation with 4K Resolution Sequential Tokenizationcited by 8
- 2023Rethinking Evaluation Metrics of Open-Vocabulary Segmentaioncited by 7
- 2023AIMS: All-Inclusive Multi-Level Segmentationcited by 6
- 2023Stable Segment Anything Modelcited by 6
- 2024SOHES: Self-supervised Open-world Hierarchical Entity Segmentationcited by 6
- 2023Memory-Constrained Semantic Segmentation for Ultra-High Resolution UAV Imagerycited by 3
- 2024SU-SAM: A Simple Unified Framework for Adapting Segment Anything Model in Underperformed Scenescited by 3
- 2022EHSNet: End-to-End Holistic Learning Network for Large-Size Remote Sensing Image Semantic Segmentationcited by 1
- 2024Q2A: Querying Implicit Fully Continuous Feature Pyramid to Align Features for Medical Image Segmentationcited by 1
- 2024Leveraging Adaptive Implicit Representation Mapping for Ultra High-Resolution Image Segmentationcited by 1
- 2026Learning from Adversity: Semantic-Aware Mask Refinement through Adversarial Perturbationcited by 1
- 2023Elastic Interaction Energy-Informed Real-Time Traffic Scene Perceptioncited by 0
- 2024Resource Efficient Perception for Vision Systemscited by 0
- 2024Flexible Coded Distributed Convolution Computing for Enhanced Straggler Resilience and Numerical Stability in Distributed CNNscited by 0
- 2025Learning to Upscale 3D Segmentations in Neuroimagingcited by 0
- 2025Class-agnostic 3D Segmentation by Granularity-Consistent Automatic 2D Mask Trackingcited by 0
- 2026Adapting Vision Transformers to Ultra-High Resolution Semantic Segmentation with Relay Tokenscited by 0
- 2026CoordFormer: Give Me Any Coordinates and I Will Give You Labelscited by 0
- 2026CoordFormer: Give Me Any Coordinates and I Will Give You Labels8 Sep 2026
- 2026Learning from Adversity: Semantic-Aware Mask Refinement through Adversarial Perturbation31 Jul 2026
- 2026Adapting Vision Transformers to Ultra-High Resolution Semantic Segmentation with Relay Tokens9 Jan 2026
- 2025Class-agnostic 3D Segmentation by Granularity-Consistent Automatic 2D Mask Tracking2 Nov 2025
- 2025Learning to Upscale 3D Segmentations in Neuroimaging27 May 2025
- 2025SAMRefiner: Taming Segment Anything Model for Universal Mask Refinement10 Feb 2025
- 2024Flexible Coded Distributed Convolution Computing for Enhanced Straggler Resilience and Numerical Stability in Distributed CNNs3 Nov 2024
- 2024Leveraging Adaptive Implicit Representation Mapping for Ultra High-Resolution Image Segmentation31 Jul 2024
- 2024HoloHisto: End-to-end Gigapixel WSI Segmentation with 4K Resolution Sequential Tokenization3 Jul 2024
- 2024Mamba or RWKV: Exploring High-Quality and High-Efficiency Segment Anything Model27 Jun 2024
- 2024Resource Efficient Perception for Vision Systems12 May 2024
- 2024SOHES: Self-supervised Open-world Hierarchical Entity Segmentation18 Apr 2024
19 more
- 2024Q2A: Querying Implicit Fully Continuous Feature Pyramid to Align Features for Medical Image Segmentation15 Apr 2024
- 2024Rethinking Interactive Image Segmentation with Low Latency, High Quality, and Diverse Prompts31 Mar 2024
- 2024Entity-NeRF: Detecting and Removing Moving Entities in Urban Scenes24 Mar 2024
- 2024SU-SAM: A Simple Unified Framework for Adapting Segment Anything Model in Underperformed Scenes31 Jan 2024
- 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentation7 Jan 2024
- 2023SegRefiner: Towards Model-Agnostic Segmentation Refinement with Discrete Diffusion Process19 Dec 2023
- 2023UniGS: Unified Representation for Image Generation and Segmentation4 Dec 2023
- 2023Stable Segment Anything Model27 Nov 2023
- 2023Rethinking Evaluation Metrics of Open-Vocabulary Segmentaion6 Nov 2023
- 2023TransY-Net:Learning Fully Transformer Networks for Change Detection of Remote Sensing Images22 Oct 2023
- 2023Memory-Constrained Semantic Segmentation for Ultra-High Resolution UAV Imagery7 Oct 2023
- 2023Elastic Interaction Energy-Informed Real-Time Traffic Scene Perception2 Oct 2023
- 2023Unite-Divide-Unite: Joint Boosting Trunk and Structure for High-accuracy Dichotomous Image Segmentation26 Jul 2023
- 2023Segment Anything in High Quality2 Jun 2023
- 2023AIMS: All-Inclusive Multi-Level Segmentation28 May 2023
- 2023Continuous Cross-resolution Remote Sensing Image Change Detection24 May 2023
- 2023Transformer-Based Visual Segmentation: A Survey19 Apr 2023
- 2022EHSNet: End-to-End Holistic Learning Network for Large-Size Remote Sensing Image Semantic Segmentation21 Nov 2022
- 2022Learning Implicit Feature Alignment Function for Semantic Segmentation17 Jun 2022
- 2023Segment Anything in High Qualitycited by 373
- 2023Transformer-Based Visual Segmentation: A Surveycited by 124
- 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentationcited by 112
- 2022Learning Implicit Feature Alignment Function for Semantic Segmentationcited by 31
- 2024Rethinking Interactive Image Segmentation with Low Latency, High Quality, and Diverse Promptscited by 22
- 2025SAMRefiner: Taming Segment Anything Model for Universal Mask Refinementcited by 19
- 2023Unite-Divide-Unite: Joint Boosting Trunk and Structure for High-accuracy Dichotomous Image Segmentationcited by 17
- 2023TransY-Net:Learning Fully Transformer Networks for Change Detection of Remote Sensing Imagescited by 13
- 2023Continuous Cross-resolution Remote Sensing Image Change Detectioncited by 8
- 2024Entity-NeRF: Detecting and Removing Moving Entities in Urban Scenescited by 8
- 2024HoloHisto: End-to-end Gigapixel WSI Segmentation with 4K Resolution Sequential Tokenizationcited by 8
- 2023Rethinking Evaluation Metrics of Open-Vocabulary Segmentaioncited by 7
12 most cited of 28 All 28 (JSON)
- 2026CoordFormer: Give Me Any Coordinates and I Will Give You Labels8 Sep 2026
- 2026Learning from Adversity: Semantic-Aware Mask Refinement through Adversarial Perturbation31 Jul 2026
- 2026Adapting Vision Transformers to Ultra-High Resolution Semantic Segmentation with Relay Tokens9 Jan 2026
- 2025Class-agnostic 3D Segmentation by Granularity-Consistent Automatic 2D Mask Tracking2 Nov 2025
- 2025Learning to Upscale 3D Segmentations in Neuroimaging27 May 2025
- 2025SAMRefiner: Taming Segment Anything Model for Universal Mask Refinement10 Feb 2025
- 2024Flexible Coded Distributed Convolution Computing for Enhanced Straggler Resilience and Numerical Stability in Distributed CNNs3 Nov 2024
- 2024Leveraging Adaptive Implicit Representation Mapping for Ultra High-Resolution Image Segmentation31 Jul 2024
- 2024HoloHisto: End-to-end Gigapixel WSI Segmentation with 4K Resolution Sequential Tokenization3 Jul 2024
- 2024Resource Efficient Perception for Vision Systems12 May 2024
- 2024SOHES: Self-supervised Open-world Hierarchical Entity Segmentation18 Apr 2024
- 2024Q2A: Querying Implicit Fully Continuous Feature Pyramid to Align Features for Medical Image Segmentation15 Apr 2024
12 newest of 28 All 28 (JSON)