Panoptic-DeepLab
Not on the map. Why?
Abstract (arXiv)
We present Panoptic-DeepLab, a bottom-up and single-shot approach for panoptic segmentation. Our Panoptic-DeepLab is conceptually simple and delivers state-of-the-art results. In particular, we adopt the dual-ASPP and dual-decoder structures specific to semantic, and instance segmentation, respectively. The semantic segmentation branch is the same as the typical design of any semantic segmentation model (e.g., DeepLab), while the instance segmentation branch is class-agnostic, involving a simple instance center regression. Our single Panoptic-DeepLab sets the new state-of-art at all three Cityscapes benchmarks, reaching 84.2% mIoU, 39.0% AP, and 65.5% PQ on test set, and advances results on the other challenging Mapillary Vistas.
Key facts. Cited by 362 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 70; 2022: 83; 2023: 103; 2024: 62; 2025: 28; 2026: 16.
362 papers.
Sort:
By area:
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
- 2021Segmenter: Transformer for Semantic Segmentationcited by 855
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 770
- 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
- 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Modelscited by 371
- 2022OneFormer: One Transformer to Rule Universal Image Segmentationcited by 327
- 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
- 2021FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Camerascited by 239
- 2021K-Net: Towards Unified Image Segmentationcited by 211
- 2023Convolutions Die Hard: Open-Vocabulary Segmentation with Single Frozen Convolutional CLIPcited by 199
- 2021Boundary IoU: Improving Object-Centric Image Segmentation Evaluationcited by 186
38 more
- 2022Panoptic Lifting for 3D Scene Understanding with Neural Fieldscited by 171
- 2021Mask2Former for Video Instance Segmentationcited by 169
- 2023Towards Open Vocabulary Learning: A Surveycited by 165
- 2022HRDA: Context-Aware High-Resolution Domain-Adaptive Semantic Segmentationcited by 163
- 2022Panoptic NeRF: 3D-to-2D Label Transfer for Panoptic Urban Scene Segmentationcited by 152
- 2022Model-Based Imitation Learning for Urban Drivingcited by 149
- 2024HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splattingcited by 141
- 2023Rethinking Range View Representation for LiDAR Segmentationcited by 126
- 2023Transformer-Based Visual Segmentation: A Surveycited by 124
- 2021Panoptic SegFormer: Delving Deeper into Panoptic Segmentation with Transformerscited by 109
- 2021Panoptic-PolarNet: Proposal-free LiDAR Point Cloud Panoptic Segmentationcited by 107
- 2021Involution: Inverting the Inherence of Convolution for Visual Recognitioncited by 99
- 2022A Generalist Framework for Panoptic Segmentation of Images and Videoscited by 99
- 2021Pointly-Supervised Instance Segmentationcited by 83
- 2023Zenseact Open Dataset: A large-scale and diverse multimodal dataset for autonomous drivingcited by 83
- 2022Video K-Net: A Simple, Strong, and Unified Baseline for Video Segmentationcited by 79
- 2022WildNet: Learning Domain Generalized Semantic Segmentation from the Wildcited by 75
- 2024OMG-Seg: Is One Model Good Enough For All Segmentation?cited by 73
- 2021STEP: Segmenting and Tracking Every Pixelcited by 72
- 2022HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imagingcited by 66
- 20214D Panoptic LiDAR Segmentationcited by 64
- 2021Mask Transfiner for High-Quality Instance Segmentationcited by 64
- 2022CMT-DeepLab: Clustering Mask Transformers for Panoptic Segmentationcited by 60
- 2022PODA: Prompt-driven Zero-shot Domain Adaptationcited by 60
- 2022Panoptic-PHNet: Towards Real-Time and High-Precision LiDAR Panoptic Segmentation via Clustering Pseudo Heatmapcited by 59
- 2023A Survey on Open-Vocabulary Detection and Segmentation: Past, Present, and Futurecited by 59
- 2022Waymo Open Dataset: Panoramic Video Panoptic Segmentationcited by 57
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2021Part-aware Panoptic Segmentationcited by 56
- 2023Towards Label-free Scene Understanding by Vision Foundation Modelscited by 54
- 2023Cam4DOcc: Benchmark for Camera-Only 4D Occupancy Forecasting in Autonomous Driving Applicationscited by 50
- 2021Radar-Camera Pixel Depth Association for Depth Completioncited by 49
- 2021Bird's-Eye-View Panoptic Segmentation Using Monocular Frontal View Imagescited by 48
- 2021ZeroWaste Dataset: Towards Deformable Object Segmentation in Cluttered Scenescited by 47
- 2022StretchBEV: Stretching Future Instance Prediction Spatially and Temporallycited by 47
- 2022MOAT: Alternating Mobile Convolution and Attention Brings Strong Vision Modelscited by 47
- 2021FIDNet: LiDAR Point Cloud Semantic Segmentation with Fully Interpolation Decodingcited by 46
- 2023Panoptic Video Scene Graph Generationcited by 46
50 most cited of 362 All 362 (JSON)
- 2026MC-PanDA++: Simpler, Stronger, and More Robust Domain-Adaptive Panoptic Segmentation30 Sep 2026
- 2026Geometry Without Coordinates: LiDAR Diffusion as a 3D Feature Bridge9 Sep 2026
- 2026PhenoStitch: Training-Free Panoptic Crop Mapping from Satellite Image Time Series1 Aug 2026
- 2026DVPSFormer: Efficient Online Depth-aware Video Panoptic Segmentation for Autonomous Driving28 Jul 2026
- 2026Occlusion-Aware Panoptic Segmentation with Joint Position Embedding and Occlusion-Level Attention20 Jul 2026
- 2026SA-VIS: Sparse frame Annotations for training Video Instance Segmentation18 Jun 2026
- 2026Pano3D: Unified 3D Reconstruction and Panoptic Segmentation12 Jun 2026
- 2026Sensor2Sensor: Cross-Embodiment Sensor Conversion for Autonomous Driving21 May 2026
- 2026U-SEG: Uncertainty in SEGmentation -- A systematic multi-variable exploration14 May 2026
- 2026MambaPanoptic: A Vision Mamba-based Structured State Space Framework for Panoptic Segmentation12 May 2026
- 2026Hyp2Former: Hierarchy-Aware Hyperbolic Embeddings for Open-Set Panoptic Segmentation4 May 2026
- 2026Adverse-to-the-eXtreme Panoptic Segmentation: URVIS 2026 Study and Benchmark18 Apr 2026
38 more
- 2026OnlinePG: Online Open-Vocabulary Panoptic Mapping with 3D Gaussian Splatting19 Mar 2026
- 2026Efficient RGB-D Scene Understanding via Multi-task Adaptive Learning and Cross-dimensional Feature Guidance8 Mar 2026
- 2026Segment and Matte Anything in a Unified Model17 Jan 2026
- 2026Semantic Misalignment in Vision-Language Models under Perceptual Degradation13 Jan 2026
- 2025Motion-Compensated Latent Semantic Canvases for Visual Situational Awareness on Edge29 Dec 2025
- 2025Illustrator's Depth: Monocular Layer Index Prediction for Image Decomposition21 Nov 2025
- 2025Seg-VAR: Image Segmentation with Visual Autoregressive Modeling16 Nov 2025
- 2025A Machine Learning Perspective on Automated Driving Corner Cases12 Oct 2025
- 2025Panoptic Segmentation of Environmental UAV Images : Litter Beach21 Aug 2025
- 2025DSER: Spectral Epipolar Representation for Efficient Light Field Depth Estimation12 Aug 2025
- 2025Solving Scene Understanding for Autonomous Navigation in Unstructured Environments27 Jul 2025
- 2025DEARLi: Decoupled Enhancement of Recognition and Localization for Semi-supervised Panoptic Segmentation14 Jul 2025
- 2025What Demands Attention in Urban Street Scenes? From Scene Understanding towards Road Safety: A Survey of Vision-driven Datasets and Studies9 Jul 2025
- 2025Beyond Appearance: Geometric Cues for Robust Video Instance Segmentation8 Jul 2025
- 2025PanSt3R: Multi-view Consistent Panoptic Segmentation26 Jun 2025
- 2025O-MaMa: Learning Object Mask Matching between Egocentric and Exocentric Views6 Jun 2025
- 2025The Missing Point in Vision Transformers for Universal Image Segmentation26 May 2025
- 2025What You Perceive Is What You Conceive: A Cognition-Inspired Framework for Open Vocabulary Image Segmentation26 May 2025
- 2025Prior2Former -- Evidential Modeling of Mask Transformers for Assumption-Free Open-World Panoptic Segmentation7 Apr 2025
- 2025Scene-Centric Unsupervised Panoptic Segmentation2 Apr 2025
- 2025PanoGS: Gaussian-based Panoptic Segmentation for 3D Open Vocabulary Scene Understanding23 Mar 2025
- 2025Vision-Language Embodiment for Monocular Depth Estimation18 Mar 2025
- 2025Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Survey17 Mar 2025
- 2025Dynamic Relation Inference via Verb Embeddings17 Mar 2025
- 2025Think Before You Segment: High-Quality Reasoning Segmentation with GPT Chain of Thoughts10 Mar 2025
- 2025Is Pre-training Applicable to the Decoder for Dense Prediction?5 Mar 2025
- 2025VLM-E2E: Enhancing End-to-End Autonomous Driving with Multimodal Driver Attention Fusion25 Feb 2025
- 2025VPNeXt -- Rethinking Dense Decoding for Plain Vision Transformer23 Feb 2025
- 2025RendBEV: Semantic Novel View Synthesis for Self-Supervised Bird's Eye View Segmentation20 Feb 2025
- 2025Towards Fine-grained Interactive Segmentation in Images and Videos12 Feb 2025
- 2025Project-and-Fuse: Improving RGB-D Semantic Segmentation via Graph Convolution Networks31 Jan 2025
- 2025DreamMask: Boosting Open-vocabulary Panoptic Segmentation with Synthetic Data3 Jan 2025
- 2024Exploiting Boundary Loss for the Hierarchical Panoptic Segmentation of Plants and Leaves31 Dec 2024
- 2024PanoSLAM: Panoptic 3D Scene Reconstruction via Gaussian SLAM31 Dec 2024
- 2024LiDAR-Camera Fusion for Video Panoptic Segmentation without Video Training30 Dec 2024
- 2024Open-World Panoptic Segmentation17 Dec 2024
- 2024PanSR: An Object-Centric Mask Transformer for Panoptic Segmentation13 Dec 2024
- 2024Balancing Shared and Task-Specific Representations: A Hybrid Approach to Depth-Aware Video Panoptic Segmentation10 Dec 2024
50 newest of 362 All 362 (JSON)
- 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Modelscited by 371
- 2024Image Segmentation in Foundation Model Era: A Surveycited by 35
- 2024LaVin-DiT: Large Vision Diffusion Transformercited by 21
- 2024A Simple Latent Diffusion Approach for Panoptic Segmentation and Mask Inpaintingcited by 18
- 2023Unlocking Pre-trained Image Backbones for Semantic Image Synthesiscited by 6
- 2023RADiff: Controllable Diffusion Models for Radio Astronomical Maps Generationcited by 2
- 2026Geometry Without Coordinates: LiDAR Diffusion as a 3D Feature Bridgecited by 0
- 2026Geometry Without Coordinates: LiDAR Diffusion as a 3D Feature Bridge9 Sep 2026
- 2024LaVin-DiT: Large Vision Diffusion Transformer18 Nov 2024
- 2024Image Segmentation in Foundation Model Era: A Survey23 Aug 2024
- 2024A Simple Latent Diffusion Approach for Panoptic Segmentation and Mask Inpainting18 Jan 2024
- 2023Unlocking Pre-trained Image Backbones for Semantic Image Synthesis20 Dec 2023
- 2023RADiff: Controllable Diffusion Models for Radio Astronomical Maps Generation5 Jul 2023
- 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Models8 Mar 2023
- 2023Towards Label-free Scene Understanding by Vision Foundation Modelscited by 54
- 2023VCoder: Versatile Vision Encoders for Multimodal Large Language Modelscited by 42
- 2023See, Say, and Segment: Teaching LMMs to Overcome False Premisescited by 40
- 2024ViTamin: Designing Scalable Vision Models in the Vision-Language Eracited by 39
- 2024Adapting Vision-Language Model with Fine-grained Semantics for Open-Vocabulary Segmentationcited by 0
- 2026Semantic Misalignment in Vision-Language Models under Perceptual Degradationcited by 0
- 2026Semantic Misalignment in Vision-Language Models under Perceptual Degradation13 Jan 2026
- 2024Adapting Vision-Language Model with Fine-grained Semantics for Open-Vocabulary Segmentation24 Sep 2024
- 2024ViTamin: Designing Scalable Vision Models in the Vision-Language Era2 Apr 2024
- 2023VCoder: Versatile Vision Encoders for Multimodal Large Language Models21 Dec 2023
- 2023See, Say, and Segment: Teaching LMMs to Overcome False Premises13 Dec 2023
- 2023Towards Label-free Scene Understanding by Vision Foundation Models6 Jun 2023
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
- 2021Segmenter: Transformer for Semantic Segmentationcited by 855
- 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
- 2022OneFormer: One Transformer to Rule Universal Image Segmentationcited by 327
- 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
- 2021FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Camerascited by 239
- 2021K-Net: Towards Unified Image Segmentationcited by 211
- 2023Convolutions Die Hard: Open-Vocabulary Segmentation with Single Frozen Convolutional CLIPcited by 199
- 2021Boundary IoU: Improving Object-Centric Image Segmentation Evaluationcited by 186
- 2022Panoptic Lifting for 3D Scene Understanding with Neural Fieldscited by 171
- 2021Mask2Former for Video Instance Segmentationcited by 169
12 most cited of 340 All 340 (JSON)
- 2026MC-PanDA++: Simpler, Stronger, and More Robust Domain-Adaptive Panoptic Segmentation30 Sep 2026
- 2026PhenoStitch: Training-Free Panoptic Crop Mapping from Satellite Image Time Series1 Aug 2026
- 2026DVPSFormer: Efficient Online Depth-aware Video Panoptic Segmentation for Autonomous Driving28 Jul 2026
- 2026Occlusion-Aware Panoptic Segmentation with Joint Position Embedding and Occlusion-Level Attention20 Jul 2026
- 2026SA-VIS: Sparse frame Annotations for training Video Instance Segmentation18 Jun 2026
- 2026Pano3D: Unified 3D Reconstruction and Panoptic Segmentation12 Jun 2026
- 2026Sensor2Sensor: Cross-Embodiment Sensor Conversion for Autonomous Driving21 May 2026
- 2026U-SEG: Uncertainty in SEGmentation -- A systematic multi-variable exploration14 May 2026
- 2026Hyp2Former: Hierarchy-Aware Hyperbolic Embeddings for Open-Set Panoptic Segmentation4 May 2026
- 2026Adverse-to-the-eXtreme Panoptic Segmentation: URVIS 2026 Study and Benchmark18 Apr 2026
- 2026OnlinePG: Online Open-Vocabulary Panoptic Mapping with 3D Gaussian Splatting19 Mar 2026
- 2026Efficient RGB-D Scene Understanding via Multi-task Adaptive Learning and Cross-dimensional Feature Guidance8 Mar 2026
12 newest of 340 All 340 (JSON)