Deep Spatio-Temporal Random Fields for Efficient Video Segmentation
Not on the map. Why?
Abstract (arXiv)
In this work we introduce a time- and memory-efficient method for structured prediction that couples neuron decisions across both space at time. We show that we are able to perform exact and efficient inference on a densely connected spatio-temporal graph by capitalizing on recent advances on deep Gaussian Conditional Random Fields (GCRFs). Our method, called VideoGCRF is (a) efficient, (b) has a unique global minimum, and (c) can be trained end-to-end alongside contemporary deep networks for video understanding. We experiment with multiple connectivity patterns in the temporal domain, and present empirical improvements over strong baselines on the tasks of both semantic and instance segmentation of videos.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Jul 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 5; 2023: 0; 2024: 3; 2025: 2.
15 papers.
Sort:
- 2021A Survey on Deep Learning Technique for Video Segmentationcited by 132
- 2021Deep Dual-resolution Networks for Real-time and Accurate Semantic Segmentation of Road Scenescited by 89
- 2022Generative Adversarial Network for Future Hand Segmentation from Egocentric Videocited by 16
- 2021Rethinking Dilated Convolution for Real-time Semantic Segmentationcited by 11
- 2022RankSeg: Adaptive Pixel Classification with Image Category Ranking for Segmentationcited by 11
- 2021Global Aggregation then Local Distribution for Scene Parsingcited by 8
- 2024SERNet-Former: Semantic Segmentation by Efficient Residual Network with Attention-Boosting Gates and Attention-Fusion Networkscited by 7
- 2022Domain Adaptive Video Semantic Segmentation via Cross-Domain Moving Object Mixingcited by 3
- 2025A Comprehensive Survey on Video Scene Parsing:Advances, Challenges, and Prospectscited by 2
- 2022Efficient Video Segmentation Models with Per-frame Inferencecited by 1
- 2021Dynamic Dual Sampling Module for Fine-Grained Semantic Segmentationcited by 0
- 2022Deep Learning Model with GA based Feature Selection and Context Integrationcited by 0
3 more
- 2024Motion-Corrected Moving Average: Including Post-Hoc Temporal Information for Improved Video Segmentationcited by 0
- 2024Breaking The Ice: Video Segmentation for Close-Range Ice-Covered Waterscited by 0
- 2025Generalized Event Partonomy Inference with Structured Hierarchical Predictive Learningcited by 0
- 2025Generalized Event Partonomy Inference with Structured Hierarchical Predictive Learning3 Dec 2025
- 2025A Comprehensive Survey on Video Scene Parsing:Advances, Challenges, and Prospects16 Jun 2025
- 2024Breaking The Ice: Video Segmentation for Close-Range Ice-Covered Waters7 Nov 2024
- 2024Motion-Corrected Moving Average: Including Post-Hoc Temporal Information for Improved Video Segmentation5 Mar 2024
- 2024SERNet-Former: Semantic Segmentation by Efficient Residual Network with Attention-Boosting Gates and Attention-Fusion Networks28 Jan 2024
- 2022Domain Adaptive Video Semantic Segmentation via Cross-Domain Moving Object Mixing4 Nov 2022
- 2022Deep Learning Model with GA based Feature Selection and Context Integration13 Apr 2022
- 2022Generative Adversarial Network for Future Hand Segmentation from Egocentric Video21 Mar 2022
- 2022RankSeg: Adaptive Pixel Classification with Image Category Ranking for Segmentation8 Mar 2022
- 2022Efficient Video Segmentation Models with Per-frame Inference24 Feb 2022
- 2021Rethinking Dilated Convolution for Real-time Semantic Segmentation18 Nov 2021
- 2021Global Aggregation then Local Distribution for Scene Parsing28 Jul 2021
- 2021A Survey on Deep Learning Technique for Video Segmentationcited by 132
- 2021Deep Dual-resolution Networks for Real-time and Accurate Semantic Segmentation of Road Scenescited by 89
- 2022Generative Adversarial Network for Future Hand Segmentation from Egocentric Videocited by 16
- 2021Rethinking Dilated Convolution for Real-time Semantic Segmentationcited by 11
- 2022RankSeg: Adaptive Pixel Classification with Image Category Ranking for Segmentationcited by 11
- 2021Global Aggregation then Local Distribution for Scene Parsingcited by 8
- 2024SERNet-Former: Semantic Segmentation by Efficient Residual Network with Attention-Boosting Gates and Attention-Fusion Networkscited by 7
- 2022Domain Adaptive Video Semantic Segmentation via Cross-Domain Moving Object Mixingcited by 3
- 2025A Comprehensive Survey on Video Scene Parsing:Advances, Challenges, and Prospectscited by 2
- 2022Efficient Video Segmentation Models with Per-frame Inferencecited by 1
- 2021Dynamic Dual Sampling Module for Fine-Grained Semantic Segmentationcited by 0
- 2022Deep Learning Model with GA based Feature Selection and Context Integrationcited by 0
12 most cited of 15 All 15 (JSON)
- 2025Generalized Event Partonomy Inference with Structured Hierarchical Predictive Learning3 Dec 2025
- 2025A Comprehensive Survey on Video Scene Parsing:Advances, Challenges, and Prospects16 Jun 2025
- 2024Breaking The Ice: Video Segmentation for Close-Range Ice-Covered Waters7 Nov 2024
- 2024Motion-Corrected Moving Average: Including Post-Hoc Temporal Information for Improved Video Segmentation5 Mar 2024
- 2024SERNet-Former: Semantic Segmentation by Efficient Residual Network with Attention-Boosting Gates and Attention-Fusion Networks28 Jan 2024
- 2022Domain Adaptive Video Semantic Segmentation via Cross-Domain Moving Object Mixing4 Nov 2022
- 2022Deep Learning Model with GA based Feature Selection and Context Integration13 Apr 2022
- 2022Generative Adversarial Network for Future Hand Segmentation from Egocentric Video21 Mar 2022
- 2022RankSeg: Adaptive Pixel Classification with Image Category Ranking for Segmentation8 Mar 2022
- 2022Efficient Video Segmentation Models with Per-frame Inference24 Feb 2022
- 2021Rethinking Dilated Convolution for Real-time Semantic Segmentation18 Nov 2021
- 2021Global Aggregation then Local Distribution for Scene Parsing28 Jul 2021
12 newest of 15 All 15 (JSON)