Fully Convolutional Networks for Panoptic Segmentation
Not on the map. Why?
Abstract (arXiv)
In this paper, we present a conceptually simple, strong, and efficient framework for panoptic segmentation, called Panoptic FCN. Our approach aims to represent and predict foreground things and background stuff in a unified fully convolutional pipeline. In particular, Panoptic FCN encodes each object instance or stuff category into a specific kernel weight with the proposed kernel generator and produces the prediction by convolving the high-resolution feature directly. With this approach, instance-aware and semantically consistent properties for things and stuff can be respectively satisfied in a simple generate-kernel-then-segment workflow. Without extra boxes for localization or instance separation, the proposed approach outperforms previous box-based and -free models with high efficiency on COCO, Cityscapes, and Mapillary Vistas datasets with single scale input. Our code is made publicly available at https://github.com/Jia-Research-Lab/PanopticFCN.
Key facts. Cited by 92 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 29; 2023: 33; 2024: 10; 2025: 6; 2026: 3.
92 papers.
Sort:
By area:
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
- 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Modelscited by 375
- 2021K-Net: Towards Unified Image Segmentationcited by 212
- 2023Tracking Anything with Decoupled Video Segmentationcited by 197
- 2022DetCLIP: Dictionary-Enriched Visual-Concept Paralleled Pre-training for Open-world Detectioncited by 176
- 2023Transformer-Based Visual Segmentation: A Surveycited by 124
- 2022Highly Accurate Dichotomous Image Segmentationcited by 110
- 2021Panoptic SegFormer: Delving Deeper into Panoptic Segmentation with Transformerscited by 109
- 2021FaPN: Feature-aligned Pyramid Network for Dense Image Predictioncited by 81
- 2022Video K-Net: A Simple, Strong, and Unified Baseline for Video Segmentationcited by 79
- 2021Open-World Entity Segmentationcited by 74
- 2022CMT-DeepLab: Clustering Mask Transformers for Panoptic Segmentationcited by 60
38 more
- 2023Learning to Upsample by Learning to Samplecited by 57
- 2022CM-GAN: Image Inpainting with Cascaded Modulation GAN and Object-Aware Trainingcited by 49
- 2022AutoAlignV2: Deformable Feature Aggregation for Dynamic Multi-Modal 3D Object Detectioncited by 46
- 2023See, Say, and Segment: Teaching LMMs to Overcome False Premisescited by 41
- 2023You Only Segment Once: Towards Real-Time Panoptic Segmentationcited by 40
- 2023Open-vocabulary Panoptic Segmentation with Embedding Modulationcited by 39
- 2023Incremental 3D Semantic Scene Graph Prediction from RGB Sequencescited by 39
- 2022Panoptic-PartFormer: Learning a Unified Model for Panoptic Part Segmentationcited by 38
- 2021PolyphonicFormer: Unified Query Learning for Depth-aware Video Panoptic Segmentationcited by 36
- 2022TubeFormer-DeepLab: Video Mask Transformercited by 35
- 2023CLUSTSEG: Clustering for Universal Segmentationcited by 32
- 2021Fully Convolutional Networks for Panoptic Segmentation with Point-based Supervisioncited by 31
- 2021High Quality Segmentation for Ultra High-resolution Imagescited by 31
- 2023PhenoBench -- A Large Dataset and Benchmarks for Semantic Image Interpretation in the Agricultural Domaincited by 31
- 2023Betrayed by Captions: Joint Caption Grounding and Generation for Open Vocabulary Instance Segmentationcited by 28
- 2022MGNet: Monocular Geometric Scene Understanding for Autonomous Drivingcited by 27
- 2024UniVS: Unified and Universal Video Segmentation with Prompts as Queriescited by 27
- 2022PVO: Panoptic Visual Odometrycited by 26
- 2024CoReS: Orchestrating the Dance of Reasoning and Segmentationcited by 25
- 2021Slot-VPS: Object-centric Representation Learning for Video Panoptic Segmentationcited by 24
- 2023Video-kMaX: A Simple Unified Approach for Online and Near-Online Video Panoptic Segmentationcited by 24
- 2021Panoramic Panoptic Segmentation: Towards Complete Surrounding Understanding via Unsupervised Contrastive Learningcited by 23
- 2024ECLIPSE: Efficient Continual Learning in Panoptic Segmentation with Visual Prompt Tuningcited by 20
- 2021Instance and Panoptic Segmentation Using Conditional Convolutionscited by 19
- 2023PanopticPartFormer++: A Unified and Decoupled View for Panoptic Part Segmentationcited by 19
- 2023DFormer: Diffusion-guided Transformer for Universal Image Segmentationcited by 19
- 2023Towards Open-World Segmentation of Partscited by 15
- 2022PanopticDepth: A Unified Framework for Depth-aware Panoptic Segmentationcited by 14
- 2022Panoramic Panoptic Segmentation: Insights Into Surrounding Parsing for Mobile Agents via Unsupervised Contrastive Learningcited by 14
- 2023Towards Real-Time Panoptic Narrative Grounding by an End-to-End Grounding Networkcited by 13
- 2022kMaX-DeepLab: k-means Mask Transformercited by 12
- 2022SFNet: Faster and Accurate Semantic Segmentation via Semantic Flowcited by 10
- 2025Frequency-Dynamic Attention Modulation for Dense Predictioncited by 10
- 2022Panoptic, Instance and Semantic Relations: A Relational Context Encoder to Enhance Panoptic Segmentationcited by 9
- 2022Dual Decision Improves Open-Set Panoptic Segmentationcited by 9
- 2023Milestones in Autonomous Driving and Intelligent Vehicles Part II: Perception and Planningcited by 9
- 2022Shape-guided Object Inpaintingcited by 8
- 2022UniDAformer: Unified Domain Adaptive Panoptic Segmentation Transformer via Hierarchical Mask Calibrationcited by 8
50 most cited of 92 All 92 (JSON)
- 2026DVPSFormer: Efficient Online Depth-aware Video Panoptic Segmentation for Autonomous Driving28 Jul 2026
- 2026Occlusion-Aware Panoptic Segmentation with Joint Position Embedding and Occlusion-Level Attention20 Jul 2026
- 2026MambaPanoptic: A Vision Mamba-based Structured State Space Framework for Panoptic Segmentation12 May 2026
- 2025Referring Video Object Segmentation with Cross-Modality Proxy Queries26 Nov 2025
- 2025Frequency-Dynamic Attention Modulation for Dense Prediction16 Jul 2025
- 2025TRACE: Your Diffusion Model is Secretly an Instance Edge Detector11 Mar 2025
- 2025vS-Graphs: Tightly Coupling Visual SLAM and 3D Scene Graphs Exploiting Hierarchical Scene Understanding3 Mar 2025
- 2025Detecting Systematic Weaknesses in Vision Models along Predefined Human-Understandable Dimensions17 Feb 2025
- 2025TimberVision: A Multi-Task Dataset and Framework for Log-Component Segmentation and Tracking in Autonomous Forestry Operations13 Jan 2025
- 2024LDA-AQU: Adaptive Query-guided Upsampling via Local Deformable Attention29 Nov 2024
- 2024COCO-OLAC: A Benchmark for Occluded Panoptic Segmentation and Image Understanding19 Sep 2024
- 2024Hybrid Mask Generation for Infrared Small Target Detection with Single-Point Supervision6 Sep 2024
38 more
- 2024CoReS: Orchestrating the Dance of Reasoning and Segmentation8 Apr 2024
- 2024ECLIPSE: Efficient Continual Learning in Panoptic Segmentation with Visual Prompt Tuning29 Mar 2024
- 2024Depth-aware Panoptic Segmentation21 Mar 2024
- 2024UniVS: Unified and Universal Video Segmentation with Prompts as Queries28 Feb 2024
- 2024Benchmarking the Robustness of Panoptic Segmentation for Automated Driving23 Feb 2024
- 2024Generalizable Semantic Vision Query Generation for Zero-shot Panoptic and Semantic Segmentation21 Feb 2024
- 2024RMP-SAM: Towards Real-Time Multi-Purpose Segment Anything18 Jan 2024
- 2023See, Say, and Segment: Teaching LMMs to Overcome False Premises13 Dec 2023
- 2023MaskConver: Revisiting Pure Convolution Model for Panoptic Segmentation11 Dec 2023
- 2023OpenSD: Unified Open-Vocabulary Segmentation and Detection10 Dec 2023
- 2023SimPLR: A Simple and Plain Transformer for Efficient Object Detection and Segmentation9 Oct 2023
- 2023ClusterFormer: Clustering As A Universal Visual Learner22 Sep 2023
- 2023Tracking Anything with Decoupled Video Segmentation7 Sep 2023
- 2023Learning to Upsample by Learning to Sample29 Aug 2023
- 2023LISA: Reasoning Segmentation via Large Language Model1 Aug 2023
- 2023Towards Deeply Unified Depth-aware Panoptic Segmentation with Bi-directional Guidance Learning27 Jul 2023
- 2023Improving Panoptic Segmentation for Nighttime or Low-Illumination Urban Driving Scenes23 Jun 2023
- 2023A Dynamic Feature Interaction Framework for Multi-task Visual Perception8 Jun 2023
- 2023PhenoBench -- A Large Dataset and Benchmarks for Semantic Image Interpretation in the Agricultural Domain7 Jun 2023
- 2023DFormer: Diffusion-guided Transformer for Universal Image Segmentation6 Jun 2023
- 2023Milestones in Autonomous Driving and Intelligent Vehicles Part II: Perception and Planning3 Jun 2023
- 2023AIMS: All-Inclusive Multi-Level Segmentation28 May 2023
- 2023SimpSON: Simplifying Photo Cleanup with Single-Click Distracting Object Segmentation Network28 May 2023
- 2023Towards Open-World Segmentation of Parts26 May 2023
- 2023Incremental 3D Semantic Scene Graph Prediction from RGB Sequences4 May 2023
- 2023CLUSTSEG: Clustering for Universal Segmentation3 May 2023
- 2023RT-K-Net: Revisiting K-Net for Real-Time Panoptic Segmentation2 May 2023
- 2023Transformer-Based Visual Segmentation: A Survey19 Apr 2023
- 2023Perceive, Excavate and Purify: A Novel Object Mining Framework for Instance Segmentation18 Apr 2023
- 2023Intra-Batch Supervision for Panoptic Segmentation on High-Resolution Images17 Apr 2023
- 2023Video-kMaX: A Simple Unified Approach for Online and Near-Online Video Panoptic Segmentation10 Apr 2023
- 2023Uncertainty estimation in Deep Learning for Panoptic segmentation4 Apr 2023
- 2023You Only Segment Once: Towards Real-Time Panoptic Segmentation26 Mar 2023
- 2023Open-vocabulary Panoptic Segmentation with Embedding Modulation20 Mar 2023
- 2023Towards Universal Vision-language Omni-supervised Segmentation12 Mar 2023
- 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Models8 Mar 2023
- 2023Unified Perception: Efficient Depth-Aware Video Panoptic Segmentation with Minimal Annotation Costs3 Mar 2023
- 2023Towards Real-Time Panoptic Narrative Grounding by an End-to-End Grounding Network9 Jan 2023
50 newest of 92 All 92 (JSON)
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
- 2024CoReS: Orchestrating the Dance of Reasoning and Segmentationcited by 25
- 2021K-Net: Towards Unified Image Segmentationcited by 212
- 2023Tracking Anything with Decoupled Video Segmentationcited by 197
- 2022DetCLIP: Dictionary-Enriched Visual-Concept Paralleled Pre-training for Open-world Detectioncited by 176
- 2023Transformer-Based Visual Segmentation: A Surveycited by 124
- 2022Highly Accurate Dichotomous Image Segmentationcited by 110
- 2021Panoptic SegFormer: Delving Deeper into Panoptic Segmentation with Transformerscited by 109
- 2021FaPN: Feature-aligned Pyramid Network for Dense Image Predictioncited by 81
- 2022Video K-Net: A Simple, Strong, and Unified Baseline for Video Segmentationcited by 79
- 2021Open-World Entity Segmentationcited by 74
- 2022CMT-DeepLab: Clustering Mask Transformers for Panoptic Segmentationcited by 60
- 2023Learning to Upsample by Learning to Samplecited by 57
- 2022CM-GAN: Image Inpainting with Cascaded Modulation GAN and Object-Aware Trainingcited by 49
12 most cited of 86 All 86 (JSON)
- 2026DVPSFormer: Efficient Online Depth-aware Video Panoptic Segmentation for Autonomous Driving28 Jul 2026
- 2026Occlusion-Aware Panoptic Segmentation with Joint Position Embedding and Occlusion-Level Attention20 Jul 2026
- 2025Referring Video Object Segmentation with Cross-Modality Proxy Queries26 Nov 2025
- 2025Frequency-Dynamic Attention Modulation for Dense Prediction16 Jul 2025
- 2025vS-Graphs: Tightly Coupling Visual SLAM and 3D Scene Graphs Exploiting Hierarchical Scene Understanding3 Mar 2025
- 2025Detecting Systematic Weaknesses in Vision Models along Predefined Human-Understandable Dimensions17 Feb 2025
- 2025TimberVision: A Multi-Task Dataset and Framework for Log-Component Segmentation and Tracking in Autonomous Forestry Operations13 Jan 2025
- 2024LDA-AQU: Adaptive Query-guided Upsampling via Local Deformable Attention29 Nov 2024
- 2024COCO-OLAC: A Benchmark for Occluded Panoptic Segmentation and Image Understanding19 Sep 2024
- 2024Hybrid Mask Generation for Infrared Small Target Detection with Single-Point Supervision6 Sep 2024
- 2024ECLIPSE: Efficient Continual Learning in Panoptic Segmentation with Visual Prompt Tuning29 Mar 2024
- 2024Depth-aware Panoptic Segmentation21 Mar 2024
12 newest of 86 All 86 (JSON)