Deep Feature Flow for Video Recognition
Not on the map. Why?
Abstract (arXiv)
Deep convolutional neutral networks have achieved great success on image recognition tasks. Yet, it is non-trivial to transfer the state-of-the-art image recognition networks to videos as per-frame evaluation is too slow and unaffordable. We present deep feature flow, a fast and accurate framework for video recognition. It runs the expensive convolutional sub-network only on sparse key frames and propagates their deep feature maps to other frames via a flow field. It achieves significant speedup as flow computation is relatively fast. The end-to-end training of the whole architecture significantly boosts the recognition accuracy. Deep feature flow is flexible and general. It is validated on two recent large scale video datasets. It makes a large step towards practical video recognition.
Key facts. Cited by 186 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 49; 2022: 41; 2023: 36; 2024: 30; 2025: 12; 2026: 18.
186 papers.
Sort:
By area:
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 575
- 2021Occluded Video Instance Segmentation: A Benchmarkcited by 154
- 2021A Survey on Deep Learning Technique for Video Segmentationcited by 132
- 2023Transformer-Based Visual Segmentation: A Surveycited by 124
- 2022Video K-Net: A Simple, Strong, and Unified Baseline for Video Segmentationcited by 79
- 2022TransVOD: End-to-End Video Object Detection with Spatial-Temporal Transformerscited by 78
- 2021Adaptive Focus for Efficient Video Recognitioncited by 77
- 2021STEP: Segmenting and Tracking Every Pixelcited by 73
- 2023Semantic Segmentation using Vision Transformers: A surveycited by 73
- 2021Self-Supervised Monocular Depth and Ego-Motion Estimation in Endoscopy: Appearance Flow to the Rescuecited by 72
- 2022MPPNet: Multi-Frame Feature Intertwining with Proxy Points for 3D Temporal Object Detectioncited by 65
38 more
- 2021Temporal Memory Attention for Video Semantic Segmentationcited by 50
- 2021Temporal RoI Align for Video Object Recognitioncited by 44
- 2021End-to-End Video Object Detection with Spatial-Temporal Transformerscited by 40
- 2021TF-Blender: Temporal Feature Blender for Video Object Detectioncited by 37
- 2021PolyphonicFormer: Unified Query Learning for Depth-aware Video Panoptic Segmentationcited by 36
- 2022TubeFormer-DeepLab: Video Mask Transformercited by 35
- 2023Time Does Tell: Self-Supervised Time-Tuning of Dense Image Representationscited by 35
- 2021Deep Learning for UAV-based Object Detection and Tracking: A Surveycited by 33
- 2023Less is More: Reducing Task and Model Complexity for 3D Point Cloud Semantic Segmentationcited by 33
- 2021Skip-Convolutions for Efficient Video Processingcited by 32
- 2022Stubborn: A Strong Baseline for Indoor Object Navigationcited by 32
- 2022A New Dataset and A Baseline Model for Breast Lesion Detection in Ultrasound Videoscited by 32
- 2021AuxAdapt: Stable and Efficient Test-Time Adaptation for Temporally Consistent Video Semantic Segmentationcited by 31
- 2023Flow-Based Feature Fusion for Vehicle-Infrastructure Cooperative 3D Object Detectioncited by 31
- 2023Discovering Sounding Objects by Audio Queries for Audio Visual Segmentationcited by 29
- 2024Video Super-Resolution Transformer with Masked Inter&Intra-Frame Attentioncited by 29
- 2021Self-Supervised Representation Learning from Flow Equivariancecited by 28
- 2021LiDAR-based Recurrent 3D Semantic Segmentation with Temporal Memory Alignmentcited by 26
- 2022PanoFlow: Learning 360deg Optical Flow for Surrounding Temporal Understandingcited by 26
- 2023Mask Propagation for Efficient Video Semantic Segmentationcited by 26
- 2021Local Memory Attention for Fast Video Semantic Segmentationcited by 25
- 2021Learning to Associate Every Segment for Video Panoptic Segmentationcited by 25
- 2022Mining Relations among Cross-Frame Affinities for Video Semantic Segmentationcited by 25
- 2023Vehicle-Infrastructure Cooperative 3D Object Detection via Feature Flow Predictioncited by 25
- 2022Learning Local and Global Temporal Contexts for Video Semantic Segmentationcited by 24
- 2023Video-kMaX: A Simple Unified Approach for Online and Near-Online Video Panoptic Segmentationcited by 24
- 2023Tube-Link: A Flexible Cross Tube Framework for Universal Video Segmentationcited by 23
- 2022Exploiting Temporal Relations on Radar Perception for Autonomous Drivingcited by 22
- 2021Domain Adaptive Video Segmentation via Temporal Consistency Regularizationcited by 21
- 2022DeltaCNN: End-to-End CNN Inference of Sparse Frame Differences in Videoscited by 18
- 2022YOLOV: Making Still Image Object Detectors Great at Video Object Detectioncited by 18
- 2022PTSEFormer: Progressive Temporal-Spatial Enhanced TransFormer Towards Video Object Detectioncited by 17
- 2022CSFlow: Learning Optical Flow via Cross Strip Correlation for Autonomous Drivingcited by 16
- 2021Multi-frame Collaboration for Effective Endoscopic Video Polyp Detection via Spatial-Temporal Feature Transformationcited by 15
- 2023Towards Anytime Optical Flow Estimation with Event Camerascited by 15
- 2025Exploiting Temporal State Space Sharing for Video Semantic Segmentationcited by 15
- 2022AIParsing: Anchor-free Instance-level Human Parsingcited by 14
- 2021Improving Video Instance Segmentation via Temporal Pyramid Routingcited by 13
50 most cited of 186 All 186 (JSON)
- 2026Analytical and Convolutional Neural Network-Based Motion-Vector Propagation for Efficient Video Object Detection28 Sep 2026
- 2026LiFR v2: Completion-Augmented Event Propagation for High-Rate Dense Prediction22 Sep 2026
- 2026Albireo: Adaptive, Energy-Efficient Inference Framework for Video Object Detection on the Edge29 Aug 2026
- 2026StreamDAM: Presence-Aware Memory for Real-Time Streaming Video Object Segmentation4 Aug 2026
- 2026Dual-Correlation Hypergraph Network for Unaligned RGBT Video Object Detection and A Large-scale Benchmark9 Jul 2026
- 2026Multi-view feature High-order Fusion for Space Weak Object Detection and Segmentation13 Jun 2026
- 2026Learn Temporal Consistency For Robust Satellite Video Detector13 Jun 2026
- 2026Zero-Parameter Geometric Gating for Temporally Stable Low-Altitude UAV Video Semantic Segmentation8 Jun 2026
- 2026VigilFormer: Deformable Attention for Video Anomaly Detection with Causal Risk Inference31 May 2026
- 2026FAST-ME: Foundation-aware Adaptive Stopping for Motion Estimation for Efficient IoT Video Analysis22 May 2026
- 2026RS-SSM: Refining Forgotten Specifics in State Space Model for Video Semantic Segmentation25 Mar 2026
- 2026WorldCache: Content-Aware Caching for Accelerated Video World Models23 Mar 2026
38 more
- 2026LiFR-Seg: Anytime High-Frame-Rate Segmentation via Event-Guided Propagation22 Mar 2026
- 2026Scale-Gest: Scalable Model-Space Synthesis and Runtime Selection for On-Device Gesture Detection16 Mar 2026
- 2026Spatio-Temporal Attention for Consistent Video Semantic Segmentation in Automated Driving10 Feb 2026
- 2026Time2General: Learning Spatiotemporal Invariant Representations for Domain-Generalization Video Semantic Segmentation10 Feb 2026
- 2026A comprehensive overview of deep learning models for object detection from videos/images21 Jan 2026
- 2026Efficient On-Board Processing of Oblique UAV Video for Rapid Flood Extent Mapping16 Jan 2026
- 2025Error-Propagation-Free Learned Video Compression With Dual-Domain Progressive Temporal Alignment11 Dec 2025
- 2025Efficient Bayer-Domain Video Computer Vision with Fast Motion Estimation and Learned Perception Residual8 Aug 2025
- 2025Temporally Consistent Unsupervised Segmentation for Mobile Robot Perception29 Jul 2025
- 2025DATA: Domain-And-Time Alignment for High-Quality Feature Fusion in Collaborative Perception24 Jul 2025
- 2025A Comprehensive Survey on Video Scene Parsing:Advances, Challenges, and Prospects16 Jun 2025
- 2025Multimodal Spatio-temporal Graph Learning for Alignment-free RGBT Video Object Detection16 Apr 2025
- 2025Exploiting Temporal State Space Sharing for Video Semantic Segmentation26 Mar 2025
- 2025Tracktention: Leveraging Point Tracking to Attend Videos Faster and Better25 Mar 2025
- 2025High Temporal Consistency through Semantic Similarity Propagation in Semi-Supervised Video Semantic Segmentation for Autonomous Flight19 Mar 2025
- 2025Enhanced Neuromorphic Semantic Segmentation Latency through Stream Event26 Feb 2025
- 2025Gaseous Object Detection18 Feb 2025
- 2025Learning Motion and Temporal Cues for Unsupervised Video Object Segmentation14 Jan 2025
- 2024Uni-AdaFocus: Spatial-temporal Dynamic Computation for Video Recognition15 Dec 2024
- 2024Towards Open-Vocabulary Video Semantic Segmentation12 Dec 2024
- 2024Real-Time AIoT for AAV Antenna Interference Detection via Edge-Cloud Collaboration4 Dec 2024
- 2024SparseTem: Boosting the Efficiency of CNN-Based Video Encoders by Exploiting Temporal Continuity28 Oct 2024
- 2024SMITE: Segment Me In TimE24 Oct 2024
- 2024Spatiotemporal Object Detection for Improved Aerial Vehicle Detection in Traffic Monitoring17 Oct 2024
- 2024Mixture of Scale Experts for Alignment-free RGBT Video Object Detection and A Unified Benchmark16 Oct 2024
- 2024Transtreaming: Adaptive Delay-aware Transformer for Real-time Streaming Perception10 Sep 2024
- 2024A Training-Free Framework for Video License Plate Tracking and Recognition with Only One-Shot11 Aug 2024
- 2024Practical Video Object Detection via Feature Selection and Aggregation29 Jul 2024
- 2024XS-VID: A Large-Scale Benchmark for Small Object Detection and Tracking in Videos25 Jul 2024
- 2024SCIPaD: Incorporating Spatial Clues into Unsupervised Pose-Depth Joint Learning7 Jul 2024
- 2024Zero-Shot Scene Change Detection17 Jun 2024
- 2024Semi-supervised Video Semantic Segmentation Using Unreliable Pseudo Labels for PVUW20242 Jun 2024
- 2024MCDS-VSS: Moving Camera Dynamic Scene Video Semantic Segmentation by Filtering with Self-Supervised Geometry and Motion30 May 2024
- 2024SSGA-Net: Stepwise Spatial Global-local Aggregation Networks for for Autonomous Driving29 May 2024
- 2024Zero-Shot Video Semantic Segmentation based on Pre-Trained Diffusion Models27 May 2024
- 2024Arena: A Patch-of-Interest ViT Inference Acceleration System for Edge-Assisted Video Analytics14 Apr 2024
- 2024Learning Multiple Representations with Inconsistency-Guided Detail Regularization for Mask-Guided Matting28 Mar 2024
- 2024Eliminating Cross-modal Conflicts in BEV Space for LiDAR-Camera 3D Object Detection12 Mar 2024
50 newest of 186 All 186 (JSON)
- 2024MAMBA: Multi-level Aggregation via Memory Bank for Video Object Detectioncited by 13
- 2026RS-SSM: Refining Forgotten Specifics in State Space Model for Video Semantic Segmentationcited by 1
- 2024Attention-Mamba: A Mamba-Enhanced Multi-Scale Parallel Inference Network for Medical Image Segmentationcited by 0
- 2026RS-SSM: Refining Forgotten Specifics in State Space Model for Video Semantic Segmentation25 Mar 2026
- 2024Attention-Mamba: A Mamba-Enhanced Multi-Scale Parallel Inference Network for Medical Image Segmentation3 Feb 2024
- 2024MAMBA: Multi-level Aggregation via Memory Bank for Video Object Detection18 Jan 2024
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 575
- 2021Occluded Video Instance Segmentation: A Benchmarkcited by 154
- 2021A Survey on Deep Learning Technique for Video Segmentationcited by 132
- 2023Transformer-Based Visual Segmentation: A Surveycited by 124
- 2022Video K-Net: A Simple, Strong, and Unified Baseline for Video Segmentationcited by 79
- 2022TransVOD: End-to-End Video Object Detection with Spatial-Temporal Transformerscited by 78
- 2021Adaptive Focus for Efficient Video Recognitioncited by 77
- 2021STEP: Segmenting and Tracking Every Pixelcited by 73
- 2023Semantic Segmentation using Vision Transformers: A surveycited by 73
- 2021Self-Supervised Monocular Depth and Ego-Motion Estimation in Endoscopy: Appearance Flow to the Rescuecited by 72
- 2022MPPNet: Multi-Frame Feature Intertwining with Proxy Points for 3D Temporal Object Detectioncited by 65
- 2021Temporal Memory Attention for Video Semantic Segmentationcited by 50
12 most cited of 176 All 176 (JSON)
- 2026Analytical and Convolutional Neural Network-Based Motion-Vector Propagation for Efficient Video Object Detection28 Sep 2026
- 2026LiFR v2: Completion-Augmented Event Propagation for High-Rate Dense Prediction22 Sep 2026
- 2026Albireo: Adaptive, Energy-Efficient Inference Framework for Video Object Detection on the Edge29 Aug 2026
- 2026StreamDAM: Presence-Aware Memory for Real-Time Streaming Video Object Segmentation4 Aug 2026
- 2026Dual-Correlation Hypergraph Network for Unaligned RGBT Video Object Detection and A Large-scale Benchmark9 Jul 2026
- 2026Multi-view feature High-order Fusion for Space Weak Object Detection and Segmentation13 Jun 2026
- 2026Learn Temporal Consistency For Robust Satellite Video Detector13 Jun 2026
- 2026Zero-Parameter Geometric Gating for Temporally Stable Low-Altitude UAV Video Semantic Segmentation8 Jun 2026
- 2026VigilFormer: Deformable Attention for Video Anomaly Detection with Causal Risk Inference31 May 2026
- 2026FAST-ME: Foundation-aware Adaptive Stopping for Motion Estimation for Efficient IoT Video Analysis22 May 2026
- 2026LiFR-Seg: Anytime High-Frame-Rate Segmentation via Event-Guided Propagation22 Mar 2026
- 2026Scale-Gest: Scalable Model-Space Synthesis and Runtime Selection for On-Device Gesture Detection16 Mar 2026
12 newest of 176 All 176 (JSON)