Learning to Fuse Things and Stuff
Not on the map. Why?
Abstract (arXiv)
We propose an end-to-end learning approach for panoptic segmentation, a novel task unifying instance (things) and semantic (stuff) segmentation. Our model, TASCNet, uses feature maps from a shared backbone network to predict in a single feed-forward pass both things and stuff segmentations. We explicitly constrain these two output distributions through a global things and stuff binary mask to enforce cross-task consistency. Our proposed unified network is competitive with the state of the art on several benchmarks for panoptic segmentation as well as on the individual semantic and instance segmentation tasks.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 8; 2023: 4; 2024: 3; 2025: 0; 2026: 2.
26 papers.
Sort:
By area:
- 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
- 2022Video K-Net: A Simple, Strong, and Unified Baseline for Video Segmentationcited by 79
- 2022CMT-DeepLab: Clustering Mask Transformers for Panoptic Segmentationcited by 60
- 2021Bird's-Eye-View Panoptic Segmentation Using Monocular Frontal View Imagescited by 48
- 2022Panoptic-PartFormer: Learning a Unified Model for Panoptic Part Segmentationcited by 38
- 2021PolyphonicFormer: Unified Query Learning for Depth-aware Video Panoptic Segmentationcited by 36
- 2021Fully Convolutional Networks for Panoptic Segmentation with Point-based Supervisioncited by 31
- 2022MGNet: Monocular Geometric Scene Understanding for Autonomous Drivingcited by 27
- 2023PanopticPartFormer++: A Unified and Decoupled View for Panoptic Part Segmentationcited by 19
- 2022Interactive Image Synthesis with Panoptic Layout Generationcited by 17
- 2022PanopticDepth: A Unified Framework for Depth-aware Panoptic Segmentationcited by 14
- 2021Combinatorial Optimization for Panoptic Segmentation: A Fully Differentiable Approachcited by 10
14 more
- 2022Visual Recognition by Requestcited by 10
- 2023Milestones in Autonomous Driving and Intelligent Vehicles Part II: Perception and Planningcited by 9
- 2021Panoptic Segmentation Forecastingcited by 7
- 2022Multi-task Fusion for Efficient Panoptic-Part Segmentationcited by 6
- 2021Flying Guide Dog: Walkable Path Discovery for the Visually Impaired Utilizing Drones and Transformer-based Semantic Segmentationcited by 5
- 2021Hierarchical Lov'asz Embeddings for Proposal-free Panoptic Segmentationcited by 4
- 2024MC-PanDA: Mask Confidence for Panoptic Domain Adaptationcited by 4
- 2023Intra-Batch Supervision for Panoptic Segmentation on High-Resolution Imagescited by 3
- 2021SE-PSNet: Silhouette-based Enhancement Feature for Panoptic Segmentation Networkcited by 2
- 2023JPPF: Multi-task Fusion for Consistent Panoptic-Part Segmentationcited by 2
- 2024Resolving Inconsistent Semantics in Multi-Dataset Image Segmentationcited by 1
- 2024HyCTAS: Multi-Objective Hybrid Convolution-Transformer Architecture Search for Real-Time Image Segmentationcited by 0
- 2026MambaPanoptic: A Vision Mamba-based Structured State Space Framework for Panoptic Segmentationcited by 0
- 2026MC-PanDA++: Simpler, Stronger, and More Robust Domain-Adaptive Panoptic Segmentationcited by 0
- 2026MC-PanDA++: Simpler, Stronger, and More Robust Domain-Adaptive Panoptic Segmentation30 Sep 2026
- 2026MambaPanoptic: A Vision Mamba-based Structured State Space Framework for Panoptic Segmentation12 May 2026
- 2024Resolving Inconsistent Semantics in Multi-Dataset Image Segmentation15 Sep 2024
- 2024MC-PanDA: Mask Confidence for Panoptic Domain Adaptation19 Jul 2024
- 2024HyCTAS: Multi-Objective Hybrid Convolution-Transformer Architecture Search for Real-Time Image Segmentation15 Mar 2024
- 2023JPPF: Multi-task Fusion for Consistent Panoptic-Part Segmentation30 Nov 2023
- 2023Milestones in Autonomous Driving and Intelligent Vehicles Part II: Perception and Planning3 Jun 2023
- 2023Intra-Batch Supervision for Panoptic Segmentation on High-Resolution Images17 Apr 2023
- 2023PanopticPartFormer++: A Unified and Decoupled View for Panoptic Part Segmentation3 Jan 2023
- 2022Multi-task Fusion for Efficient Panoptic-Part Segmentation15 Dec 2022
- 2022Visual Recognition by Request28 Jul 2022
- 2022MGNet: Monocular Geometric Scene Understanding for Autonomous Driving27 Jun 2022
14 more
- 2022CMT-DeepLab: Clustering Mask Transformers for Panoptic Segmentation17 Jun 2022
- 2022PanopticDepth: A Unified Framework for Depth-aware Panoptic Segmentation1 Jun 2022
- 2022Video K-Net: A Simple, Strong, and Unified Baseline for Video Segmentation10 Apr 2022
- 2022Panoptic-PartFormer: Learning a Unified Model for Panoptic Part Segmentation10 Apr 2022
- 2022Interactive Image Synthesis with Panoptic Layout Generation4 Mar 2022
- 2021PolyphonicFormer: Unified Query Learning for Depth-aware Video Panoptic Segmentation5 Dec 2021
- 2021Fully Convolutional Networks for Panoptic Segmentation with Point-based Supervision17 Aug 2021
- 2021Flying Guide Dog: Walkable Path Discovery for the Visually Impaired Utilizing Drones and Transformer-based Semantic Segmentation16 Aug 2021
- 2021Bird's-Eye-View Panoptic Segmentation Using Monocular Frontal View Images6 Aug 2021
- 2021SE-PSNet: Silhouette-based Enhancement Feature for Panoptic Segmentation Network11 Jul 2021
- 2021Hierarchical Lov'asz Embeddings for Proposal-free Panoptic Segmentation8 Jun 2021
- 2021Combinatorial Optimization for Panoptic Segmentation: A Fully Differentiable Approach6 Jun 2021
- 2021Panoptic Segmentation Forecasting8 Apr 2021
- 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphs18 Jan 2021
- 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
- 2022Video K-Net: A Simple, Strong, and Unified Baseline for Video Segmentationcited by 79
- 2022CMT-DeepLab: Clustering Mask Transformers for Panoptic Segmentationcited by 60
- 2021Bird's-Eye-View Panoptic Segmentation Using Monocular Frontal View Imagescited by 48
- 2022Panoptic-PartFormer: Learning a Unified Model for Panoptic Part Segmentationcited by 38
- 2021PolyphonicFormer: Unified Query Learning for Depth-aware Video Panoptic Segmentationcited by 36
- 2021Fully Convolutional Networks for Panoptic Segmentation with Point-based Supervisioncited by 31
- 2022MGNet: Monocular Geometric Scene Understanding for Autonomous Drivingcited by 27
- 2023PanopticPartFormer++: A Unified and Decoupled View for Panoptic Part Segmentationcited by 19
- 2022Interactive Image Synthesis with Panoptic Layout Generationcited by 17
- 2022PanopticDepth: A Unified Framework for Depth-aware Panoptic Segmentationcited by 14
- 2021Combinatorial Optimization for Panoptic Segmentation: A Fully Differentiable Approachcited by 10
12 most cited of 25 All 25 (JSON)
- 2026MC-PanDA++: Simpler, Stronger, and More Robust Domain-Adaptive Panoptic Segmentation30 Sep 2026
- 2024Resolving Inconsistent Semantics in Multi-Dataset Image Segmentation15 Sep 2024
- 2024MC-PanDA: Mask Confidence for Panoptic Domain Adaptation19 Jul 2024
- 2024HyCTAS: Multi-Objective Hybrid Convolution-Transformer Architecture Search for Real-Time Image Segmentation15 Mar 2024
- 2023JPPF: Multi-task Fusion for Consistent Panoptic-Part Segmentation30 Nov 2023
- 2023Milestones in Autonomous Driving and Intelligent Vehicles Part II: Perception and Planning3 Jun 2023
- 2023Intra-Batch Supervision for Panoptic Segmentation on High-Resolution Images17 Apr 2023
- 2023PanopticPartFormer++: A Unified and Decoupled View for Panoptic Part Segmentation3 Jan 2023
- 2022Multi-task Fusion for Efficient Panoptic-Part Segmentation15 Dec 2022
- 2022Visual Recognition by Request28 Jul 2022
- 2022MGNet: Monocular Geometric Scene Understanding for Autonomous Driving27 Jun 2022
- 2022CMT-DeepLab: Clustering Mask Transformers for Panoptic Segmentation17 Jun 2022
12 newest of 25 All 25 (JSON)