Domain Adaptive Video Segmentation via Temporal Consistency Regularization
Not on the map. Why?
Abstract (arXiv)
Video semantic segmentation is an essential task for the analysis and understanding of videos. Recent efforts largely focus on supervised video segmentation by learning from fully annotated data, but the learnt models often experience clear performance drop while applied to videos of a different domain. This paper presents DA-VSN, a domain adaptive video segmentation network that addresses domain gaps in videos by temporal consistency regularization (TCR) for consecutive frames of target-domain videos. DA-VSN consists of two novel and complementary designs. The first is cross-domain TCR that guides the prediction of target frames to have similar temporal consistency as that of source frames (learnt from annotated source data) via adversarial learning. The second is intra-domain TCR that guides unconfident predictions of target frames to have similar temporal consistency as confident predictions of target frames. Extensive experiments demonstrate the superiority of our proposed domain adaptive video segmentation network which outperforms multiple baselines consistently by large margins.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 64 of its 82 references that are in the map. First posted on arXiv 23 Jul 2021.
Builds on
64 of 82 references.
References · 64
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
- 2017Adversarial Discriminative Domain Adaptationcited by 1,309
- 2017CyCADA: Cycle-Consistent Adversarial Domain Adaptationcited by 1,079
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 780
- 2018ADVENT: Adversarial Entropy Minimization for Domain Adaptation in Semantic Segmentationcited by 623
- 2018Learning to Adapt Structured Output Space for Semantic Segmentationcited by 584
- 2020FDA: Fourier Domain Adaptation for Semantic Segmentationcited by 540
- 2019Confidence Regularized Self-Trainingcited by 418
38 more
- 2019Bidirectional Learning for Domain Adaptation of Semantic Segmentationcited by 308
- 2018Taking A Closer Look at Domain Shift: Category-level Adversaries for Semantics Consistent Domain Adaptationcited by 295
- 2019Learning Correspondence from the Cycle-Consistency of Timecited by 269
- 2020Space-Time Correspondence as a Contrastive Random Walkcited by 239
- 2020Rectifying Pseudo Label Learning via Uncertainty Estimation for Domain Adaptive Semantic Segmentationcited by 222
- 2020Unsupervised Intra-domain Adaptation for Semantic Segmentation through Self-Supervisioncited by 198
- 2016Deep Feature Flow for Video Recognitioncited by 186
- 2020Instance Adaptive Self-Training for Unsupervised Domain Adaptationcited by 177
- 2017Playing for Benchmarkscited by 169
- 2021FSDR: Frequency Space Domain Randomization for Domain Generalizationcited by 163
- 2020Learning Texture Invariant Representation for Domain Adaptation of Semantic Segmentationcited by 153
- 2019Domain Adaptation for Structured Output via Discriminative Patch Representationscited by 150
- 2020Video Panoptic Segmentationcited by 141
- 2019Domain Adaptation for Semantic Segmentation with Maximum Squares Losscited by 138
- 2018Improving Semantic Segmentation via Video Propagation and Label Relaxationcited by 134
- 2019Self-Ensembling with GAN-based Data Augmentation for Domain Adaptation in Semantic Segmentationcited by 126
- 2020Differential Treatment for Stuff and Things: A Simple Unsupervised Domain Adaptation Method for Semantic Segmentationcited by 126
- 2020Multi-Modal Domain Adaptation for Fine-Grained Action Recognitioncited by 115
- 2020MAST: A Memory-Augmented Self-supervised Trackercited by 109
- 2019Constructing Self-motivated Pyramid Curriculums for Cross-Domain Semantic Segmentation: A Non-Adversarial Approachcited by 103
- 2019Temporal Attentive Alignment for Large-Scale Video Domain Adaptationcited by 100
- 2017ROAD: Reality Oriented Adaptation for Semantic Segmentation of Urban Scenescited by 95
- 2018Accel: A Corrective Fusion Network for Efficient Semantic Segmentation on Videocited by 78
- 2020Temporally Distributed Networks for Fast Video Semantic Segmentationcited by 77
- 2016Semantic Video Segmentation by Gated Recurrent Flow Propagationcited by 76
- 2018Fully Convolutional Adaptation Networks for Semantic Segmentationcited by 75
- 2019Significance-aware Information Bottleneck for Domain Adaptive Semantic Segmentationcited by 74
- 2020Action Segmentation with Joint Self-Supervised Temporal Domain Adaptationcited by 74
- 2020Contextual-Relation Consistent Domain Adaptation for Semantic Segmentationcited by 70
- 2017Semantic Video CNNs through Representation Warpingcited by 65
- 2021Category Contrast for Unsupervised Domain Adaptation in Visual Taskscited by 65
- 2020Efficient Semantic Video Segmentation with Per-frame Inferencecited by 63
- 2018Low-Latency Video Semantic Segmentationcited by 61
- 2021Uncertainty-Aware Unsupervised Domain Adaptation in Object Detectioncited by 59
- 2016Clockwork Convnets for Video Semantic Segmentationcited by 55
- 2018Dynamic Video Segmentation Networkcited by 51
- 2019Adversarial Cross-Domain Action Recognition with Co-Attentioncited by 51
- 2021RDA: Robust Domain Adaptation via Fourier Adversarial Attackingcited by 48
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 7; 2024: 5; 2025: 2; 2026: 1.
21 papers.
Sort:
By area:
- 2021Model Adaptation: Historical Contrastive Learning for Unsupervised Domain Adaptation without Source Datacited by 152
- 2022PolarMix: A General Data Augmentation Technique for LiDAR Point Cloudscited by 74
- 20233D Semantic Segmentation in the Wild: Learning Generalized Models for Adverse-Condition Point Cloudscited by 46
- 2024Temporally Consistent Unbalanced Optimal Transport for Unsupervised Action Segmentationcited by 37
- 2022Unbiased Subclass Regularization for Semi-Supervised Semantic Segmentationcited by 33
- 2024Cross-Domain Few-Shot Segmentation via Iterative Support-Query Correspondence Miningcited by 30
- 2023GraphEcho: Graph-Driven Unsupervised Domain Adaptation for Echocardiogram Video Segmentationcited by 22
- 2022Video Unsupervised Domain Adaptation with Deep Learning: A Comprehensive Surveycited by 12
- 2022Domain Adaptive Video Segmentation via Temporal Pseudo Supervisioncited by 11
- 2023Spatio-Temporal Pixel-Level Contrastive Learning-based Source-Free Domain Adaptation for Video Semantic Segmentationcited by 10
- 2023Temporal-aware Hierarchical Mask Classification for Video Semantic Segmentationcited by 7
- 2023Unified Domain Adaptive Semantic Segmentationcited by 6
9 more
- 2024Prompt-Driven Temporal Domain Adaptation for Nighttime UAV Trackingcited by 6
- 2024We're Not Using Videos Effectively: An Updated Domain Adaptive Video Segmentation Baselinecited by 4
- 2022Domain Adaptive Video Semantic Segmentation via Cross-Domain Moving Object Mixingcited by 3
- 2023MoDA: Leveraging Motion Priors from Videos for Advancing Unsupervised Domain Adaptation in Semantic Segmentationcited by 2
- 2025Taming Domain Shift in Multi-source CT-Scan Classification via Input-Space Standardizationcited by 2
- 2023Prompt Ensemble Self-training for Open-Vocabulary Domain Adaptationcited by 1
- 2024PiPa++: Towards Unification of Domain Adaptive Semantic Segmentation via Self-supervised Learningcited by 1
- 2025Dual form Complementary Masking for Domain-Adaptive Image Segmentationcited by 1
- 2026See the Change, Keep the Flow: Unsupervised Action Segmentation via Spectral-Temporal Representation Learningcited by 0
- 2026See the Change, Keep the Flow: Unsupervised Action Segmentation via Spectral-Temporal Representation Learning30 Aug 2026
- 2025Taming Domain Shift in Multi-source CT-Scan Classification via Input-Space Standardization26 Jul 2025
- 2025Dual form Complementary Masking for Domain-Adaptive Image Segmentation16 Jul 2025
- 2024Prompt-Driven Temporal Domain Adaptation for Nighttime UAV Tracking27 Sep 2024
- 2024PiPa++: Towards Unification of Domain Adaptive Semantic Segmentation via Self-supervised Learning24 Jul 2024
- 2024Temporally Consistent Unbalanced Optimal Transport for Unsupervised Action Segmentation1 Apr 2024
- 2024We're Not Using Videos Effectively: An Updated Domain Adaptive Video Segmentation Baseline1 Feb 2024
- 2024Cross-Domain Few-Shot Segmentation via Iterative Support-Query Correspondence Mining16 Jan 2024
- 2023Unified Domain Adaptive Semantic Segmentation22 Nov 2023
- 2023MoDA: Leveraging Motion Priors from Videos for Advancing Unsupervised Domain Adaptation in Semantic Segmentation21 Sep 2023
- 2023GraphEcho: Graph-Driven Unsupervised Domain Adaptation for Echocardiogram Video Segmentation20 Sep 2023
- 2023Temporal-aware Hierarchical Mask Classification for Video Semantic Segmentation14 Sep 2023
9 more
- 2023Prompt Ensemble Self-training for Open-Vocabulary Domain Adaptation29 Jun 2023
- 20233D Semantic Segmentation in the Wild: Learning Generalized Models for Adverse-Condition Point Clouds3 Apr 2023
- 2023Spatio-Temporal Pixel-Level Contrastive Learning-based Source-Free Domain Adaptation for Video Semantic Segmentation25 Mar 2023
- 2022Video Unsupervised Domain Adaptation with Deep Learning: A Comprehensive Survey17 Nov 2022
- 2022Domain Adaptive Video Semantic Segmentation via Cross-Domain Moving Object Mixing4 Nov 2022
- 2022PolarMix: A General Data Augmentation Technique for LiDAR Point Clouds30 Jul 2022
- 2022Domain Adaptive Video Segmentation via Temporal Pseudo Supervision6 Jul 2022
- 2022Unbiased Subclass Regularization for Semi-Supervised Semantic Segmentation18 Mar 2022
- 2021Model Adaptation: Historical Contrastive Learning for Unsupervised Domain Adaptation without Source Data7 Oct 2021
- 2021Model Adaptation: Historical Contrastive Learning for Unsupervised Domain Adaptation without Source Datacited by 152
- 2022PolarMix: A General Data Augmentation Technique for LiDAR Point Cloudscited by 74
- 20233D Semantic Segmentation in the Wild: Learning Generalized Models for Adverse-Condition Point Cloudscited by 46
- 2024Temporally Consistent Unbalanced Optimal Transport for Unsupervised Action Segmentationcited by 37
- 2022Unbiased Subclass Regularization for Semi-Supervised Semantic Segmentationcited by 33
- 2024Cross-Domain Few-Shot Segmentation via Iterative Support-Query Correspondence Miningcited by 30
- 2023GraphEcho: Graph-Driven Unsupervised Domain Adaptation for Echocardiogram Video Segmentationcited by 22
- 2022Video Unsupervised Domain Adaptation with Deep Learning: A Comprehensive Surveycited by 12
- 2022Domain Adaptive Video Segmentation via Temporal Pseudo Supervisioncited by 11
- 2023Spatio-Temporal Pixel-Level Contrastive Learning-based Source-Free Domain Adaptation for Video Semantic Segmentationcited by 10
- 2023Temporal-aware Hierarchical Mask Classification for Video Semantic Segmentationcited by 7
- 2023Unified Domain Adaptive Semantic Segmentationcited by 6
12 most cited of 20 All 20 (JSON)
- 2026See the Change, Keep the Flow: Unsupervised Action Segmentation via Spectral-Temporal Representation Learning30 Aug 2026
- 2025Taming Domain Shift in Multi-source CT-Scan Classification via Input-Space Standardization26 Jul 2025
- 2025Dual form Complementary Masking for Domain-Adaptive Image Segmentation16 Jul 2025
- 2024Prompt-Driven Temporal Domain Adaptation for Nighttime UAV Tracking27 Sep 2024
- 2024PiPa++: Towards Unification of Domain Adaptive Semantic Segmentation via Self-supervised Learning24 Jul 2024
- 2024Temporally Consistent Unbalanced Optimal Transport for Unsupervised Action Segmentation1 Apr 2024
- 2024We're Not Using Videos Effectively: An Updated Domain Adaptive Video Segmentation Baseline1 Feb 2024
- 2024Cross-Domain Few-Shot Segmentation via Iterative Support-Query Correspondence Mining16 Jan 2024
- 2023Unified Domain Adaptive Semantic Segmentation22 Nov 2023
- 2023MoDA: Leveraging Motion Priors from Videos for Advancing Unsupervised Domain Adaptation in Semantic Segmentation21 Sep 2023
- 2023GraphEcho: Graph-Driven Unsupervised Domain Adaptation for Echocardiogram Video Segmentation20 Sep 2023
- 2023Temporal-aware Hierarchical Mask Classification for Video Semantic Segmentation14 Sep 2023
12 newest of 20 All 20 (JSON)