Video Enhancement with Task-Oriented Flow
Not on the map. Why?
Cited by 51 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Many video enhancement algorithms rely on optical flow to register frames in a video sequence. Precise flow estimation is however intractable; and optical flow itself is often a sub-optimal representation for particular video processing tasks. In this paper, we propose task-oriented flow (TOFlow), a motion representation learned in a self-supervised, task-specific manner. We design a neural network with a trainable motion estimation component and a video processing component, and train them jointly to learn the task-oriented flow. For evaluation, we build Vimeo-90K, a large-scale, high-quality video dataset for low-level video processing. TOFlow outperforms traditional optical flow on standard benchmarks as well as our Vimeo-90K dataset in three video processing tasks: frame interpolation, video denoising/deblocking, and video super-resolution.
Key facts. Cited by 619 papers in the map (data through 14 Oct 2026). First posted on arXiv 24 Nov 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 93; 2022: 143; 2023: 108; 2024: 114; 2025: 98; 2026: 63.
619 papers.
Sort:
By area:
- 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 342
- 2022MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolationcited by 309
- 2021Deep Contextual Video Compressioncited by 221
- 2022VRT: A Video Restoration Transformercited by 220
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 176
- 2022Recurrent Video Restoration Transformer with Guided Deformable Attentioncited by 170
- 2022Lossy Image Compression with Conditional Diffusion Modelscited by 170
- 2023Neural Video Compression with Diverse Contextscited by 165
- 2021FVC: A New Framework towards Deep Video Compression in Feature Spacecited by 153
- 2022FILM: Frame Interpolation for Large Motioncited by 153
38 more
- 2021TimeLens: Event-based Video Frame Interpolationcited by 151
- 2021Low-Light Image and Video Enhancement Using Deep Learning: A Surveycited by 148
- 2021Modulated Periodic Activations for Generalizable Local Functional Representationscited by 140
- 2021Investigating Tradeoffs in Real-World Video Super-Resolutioncited by 134
- 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolutioncited by 132
- 2022Hybrid Spatial-Temporal Entropy Modelling for Neural Video Compressioncited by 128
- 2021XVFI: eXtreme Video Frame Interpolationcited by 126
- 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 126
- 2021Video Frame Interpolation Transformercited by 123
- 2024Neural Video Compression with Feature Modulationcited by 123
- 2021Video Super-Resolution Transformercited by 121
- 2021Temporal Context Mining for Learned Video Compressioncited by 117
- 2022Towards An End-to-End Framework for Flow-Guided Video Inpaintingcited by 113
- 2023Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervisioncited by 112
- 2022Time Lens++: Event-based Frame Interpolation with Parametric Non-linear Flow and Multi-scale Fusioncited by 111
- 2022IFRNet: Intermediate Feature Refine Network for Efficient Frame Interpolationcited by 109
- 2021Asymmetric Bilateral Motion Estimation for Video Frame Interpolationcited by 101
- 2022VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolutioncited by 101
- 2023Extracting Motion and Appearance via Inter-Frame Attention for Efficient Video Frame Interpolationcited by 98
- 2023LDMVFI: Video Frame Interpolation with Latent Diffusion Modelscited by 89
- 2022COIN++: Neural Compression Across Modalitiescited by 82
- 2025Towards Practical Real-Time Neural Video Compressioncited by 80
- 2023Free-Bloom: Zero-Shot Text-to-Video Generator with LLM Director and LDM Animatorcited by 74
- 2022Rethinking Alignment in Video Super-Resolution Transformerscited by 71
- 2021ELF-VC: Efficient Learned Flexible-Rate Video Codingcited by 69
- 2022A Simple Baseline for Video Restoration with Grouped Spatial-temporal Shiftcited by 68
- 2024Video Interpolation with Diffusion Modelscited by 68
- 2023Text + Sketch: Image Compression at Ultra Low Ratescited by 67
- 2024VEnhancer: Generative Space-Time Enhancement for Video Generationcited by 64
- 2022Learning Trajectory-Aware Transformer for Video Super-Resolutioncited by 61
- 2022Unifying Motion Deblurring and Frame Interpolation with Eventscited by 58
- 2021CDFI: Compression-Driven Network Design for Frame Interpolationcited by 56
- 2025STAR: Spatial-Temporal Augmentation with Text-to-Video Models for Real-World Video Super-Resolutioncited by 56
- 2022Coarse-to-fine Deep Video Coding with Hyperprior-guided Mode Predictioncited by 55
- 2021Temporal Modulation Network for Controllable Space-Time Video Super-Resolutioncited by 54
- 2021Joint Global and Local Hierarchical Priors for Learned Image Compressioncited by 54
- 2023A Dynamic Multi-Scale Voxel Flow Network for Video Predictioncited by 53
- 2022Wireless Deep Video Semantic Transmissioncited by 50
50 most cited of 619 All 619 (JSON)
- 2026Revisiting Ground-Truth Synthesis from High-Speed Video: Exact Validity Conditions and an Audited Consumer Capture Corpus4 Oct 2026
- 2026Event-guided Neural Video Compression1 Oct 2026
- 2026FANVIDv2: Evaluating Video Super-Resolution by Face and Licence-Plate Recognition Under Compound Degradation30 Sep 2026
- 2026Double-stream registration with pyramid fusion for HDR video with alternating exposures25 Sep 2026
- 2026Accurate Motion Estimation with B'ezier Control Point for Efficient Frame Interpolation20 Sep 2026
- 2026Semantic-Aware Neural Video Codec for Error-Resilient Low-Latency Transmission14 Sep 2026
- 2026ClearText-Video: A Large-Scale Text-Centric Video Dataset Bridging Video Restoration and Scene-Text Enhancement28 Aug 2026
- 2026Following Motion for Sequential Modeling in Video Frame Interpolation24 Aug 2026
- 2026Binarized High-Efficiency RAW Video Restoration and Beyond17 Aug 2026
- 2026SNM-VFI: Symmetric Nonlinear Motion-Guided Generative Video Frame Interpolation13 Aug 2026
- 2026Open Evaluation Agent: Efficient and Promptable Evaluation of Visual Generative Models10 Aug 2026
- 2026Revisiting the Current Frame: Physical-Trace-Guided Network Output Correction for Video Restoration10 Aug 2026
38 more
- 2026CodecArena: Codec Quality Assessment via Visual Reinforcement Learning10 Aug 2026
- 2026Loss-Resilient Wireless Video Token Communication over Block Fading Channels9 Aug 2026
- 2026Bit Allocation Transfer for Perceptual Quality Enhancement of Traditional Video Codecs7 Aug 2026
- 2026Multiple Hypothesis Flow Estimation for Video Frame Interpolation under Matching Ambiguity7 Aug 2026
- 2026Temporal Bridges for Spatial Resolution: Enhancing Climate Data Super-Resolution with Bidirectional Alignment6 Aug 2026
- 2026GVC-RT: Towards Real-Time Generative Video Compression at Ultra-Low Bitrates5 Aug 2026
- 2026IR275K: A Benchmark for Infrared Multi-Frame Super-Resolution Toward Efficient Remote Sensing24 Jul 2026
- 2026Coarse-to-fine Framework for Generative MEF via Implicit Neural Representation20 Jul 2026
- 2026DCVC-MB: Neural B-Frame Video Compression using State Space Models15 Jul 2026
- 2026SVI360: Spherical Video Interpolation13 Jul 2026
- 2026NanoVSR: Towards Real-Time Video Super-Resolution on Edge Devices11 Jul 2026
- 2026Differentiable Proxy Learning for Adaptive Quantization Control in H.264 Video Coding11 Jul 2026
- 2026DiffCVE: Diffusion-based Compressed Video Enhancement8 Jul 2026
- 2026MLVC: Multi-platform Learned Video Codec for Real-World Deployment26 Jun 2026
- 2026MASS: Motion-Aligned Selective Scan for Refinement in Flow-Based Video Frame Interpolation26 Jun 2026
- 2026Boosting Neural Video Codec via Scale-Driven Online Flow Refinement22 Jun 2026
- 2026EvTexture++: Event-Driven Texture Enhancement for Video Super-Resolution11 Jun 2026
- 2026MagPlus: Bridging Micro-to-Regular Facial Expressions through Learnable Magnification11 Jun 2026
- 2026JOMP: Jointly-Optimized Mixed-Precision Quantization Across Neural Video Coding Frameworks and Buffering Strategies11 Jun 2026
- 2026AnyMod-LLVE: Low-Light Video Enhancement with Modality-Agnostic Inference9 Jun 2026
- 2026CamFlow+: Hybrid Motion Bases for 2D Camera Motion Estimation with Stabilization Applications4 Jun 2026
- 2026KD-NVC: A Search-and-Distill Framework to Accelerate Neural Video Coding3 Jun 2026
- 2026Ultra-Fast Neural Video Compression3 Jun 2026
- 2026TVRN: Invertible Neural Networks for Compression-Aware Temporal Video Rescaling15 May 2026
- 2026LiVeAction: a Lightweight, Versatile, and Asymmetric Neural Codec Design for Real-time Operation7 May 2026
- 2026LatentBurst: A Fast and Efficient Multi Frame Super-Resolution for Hexadeca-Bayer Pattern CIS images25 Apr 2026
- 2026LoViF 2026 The First Challenge on Weather Removal in Videos12 Apr 2026
- 2026LiveStre4m: Feed-Forward Live Streaming of Novel Views from Unposed Multi-View Video8 Apr 2026
- 2026NeuralLVC: Neural Lossless Video Compression via Masked Diffusion with Temporal Conditioning3 Apr 2026
- 2026ANVIL: Accelerator-Native Video Interpolation via Codec Motion Vector Priors27 Mar 2026
- 2026A Mamba-based Perceptual Loss Function for Learning-based UGC Transcoding26 Mar 2026
- 2026DUO-VSR: Dual-Stream Distillation for One-Step Video Super-Resolution23 Mar 2026
- 2026Efficient Video Diffusion with Sparse Information Transmission for Video Compression19 Mar 2026
- 2026Generative Video Compression with One-Dimensional Latent Representation16 Mar 2026
- 2026TextOVSR: Text-Guided Real-World Opera Video Super-Resolution16 Mar 2026
- 2026Edit2Interp: Adapting Image Foundation Models from Spatial Editing to Video Frame Interpolation with Few-Shot Learning16 Mar 2026
- 2026F2HDR: Two-Stage HDR Video Reconstruction via Flow Adapter and Physical Motion Modeling16 Mar 2026
- 2026LoCAtion: Long-time Collaborative Attention Framework for High Dynamic Range Video Reconstruction15 Mar 2026
50 newest of 619 All 619 (JSON)
- 2022MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolationcited by 309
- 2022Lossy Image Compression with Conditional Diffusion Modelscited by 170
- 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolutioncited by 132
- 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 126
- 2023Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervisioncited by 112
- 2023LDMVFI: Video Frame Interpolation with Latent Diffusion Modelscited by 89
- 2024Video Interpolation with Diffusion Modelscited by 68
- 2024VEnhancer: Generative Space-Time Enhancement for Video Generationcited by 64
- 2025STAR: Spatial-Temporal Augmentation with Text-to-Video Models for Real-World Video Super-Resolutioncited by 56
- 2024Lossy Image Compression with Foundation Diffusion Modelscited by 36
- 2024DiffIR2VR-Zero: Zero-Shot Video Restoration with Diffusion-based Image Restoration Modelscited by 34
- 2025DOVE: Efficient One-Step Diffusion Model for Real-World Video Super-Resolutioncited by 31
12 most cited of 51 All 51 (JSON)
- 2026SNM-VFI: Symmetric Nonlinear Motion-Guided Generative Video Frame Interpolation13 Aug 2026
- 2026NeuralLVC: Neural Lossless Video Compression via Masked Diffusion with Temporal Conditioning3 Apr 2026
- 2026DUO-VSR: Dual-Stream Distillation for One-Step Video Super-Resolution23 Mar 2026
- 2026Efficient Video Diffusion with Sparse Information Transmission for Video Compression19 Mar 2026
- 2026DMAligner: Enhancing Image Alignment via Diffusion Model Based View Synthesis26 Feb 2026
- 2026DiffVC-RT: Towards Practical Real-Time Diffusion-based Perceptual Neural Video Compression28 Jan 2026
- 2026Towards Holistic Modeling for Video Frame Interpolation with Auto-regressive Diffusion Transformers21 Jan 2026
- 2025Stream-DiffVSR: Low-Latency Streamable Video Super-Resolution via Auto-Regressive Diffusion29 Dec 2025
- 2025Rethinking Diffusion Model-Based Video Super-Resolution: Leveraging Dense Guidance from Aligned Features21 Nov 2025
- 2025Time-Correlated Video Bridge Matching14 Oct 2025
- 2025OS-DiffVSR: Towards One-step Latent Diffusion Model for High-detailed Real-world Video Super-Resolution20 Sep 2025
- 2025Vivid-VR: Distilling Concepts from Text-to-Video Diffusion Transformer for Photorealistic Video Restoration20 Aug 2025
12 newest of 51 All 51 (JSON)
- 2024MambaVC: Learned Visual Compression with Selective State Spacescited by 28
- 2025VSRM: A Robust Mamba-Based Framework for Video Super-Resolutioncited by 5
- 2025MambaOVSR: Multiscale Fusion with Global Motion Modeling for Chinese Opera Video Super-Resolutioncited by 2
- 2025Trajectory-aware Shifted State Space Models for Online Video Super-Resolutioncited by 1
- 2025MambaVSR: Content-Aware Scanning State Space Model for Video Super-Resolutioncited by 0
- 2025Gather-Scatter Mamba: Accelerating Propagation with Efficient State Space Modelcited by 0
- 2026Geometric Transformation-Embedded Mamba for Learned Video Compressioncited by 0
- 2026A Mamba-based Perceptual Loss Function for Learning-based UGC Transcodingcited by 0
- 2026DCVC-MB: Neural B-Frame Video Compression using State Space Modelscited by 0
- 2026Following Motion for Sequential Modeling in Video Frame Interpolationcited by 0
- 2026Following Motion for Sequential Modeling in Video Frame Interpolation24 Aug 2026
- 2026DCVC-MB: Neural B-Frame Video Compression using State Space Models15 Jul 2026
- 2026A Mamba-based Perceptual Loss Function for Learning-based UGC Transcoding26 Mar 2026
- 2026Geometric Transformation-Embedded Mamba for Learned Video Compression9 Mar 2026
- 2025MambaOVSR: Multiscale Fusion with Global Motion Modeling for Chinese Opera Video Super-Resolution9 Nov 2025
- 2025Gather-Scatter Mamba: Accelerating Propagation with Efficient State Space Model1 Oct 2025
- 2025Trajectory-aware Shifted State Space Models for Online Video Super-Resolution14 Aug 2025
- 2025VSRM: A Robust Mamba-Based Framework for Video Super-Resolution28 Jun 2025
- 2025MambaVSR: Content-Aware Scanning State Space Model for Video Super-Resolution13 Jun 2025
- 2024MambaVC: Learned Visual Compression with Selective State Spaces24 May 2024
- 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 342
- 2021Deep Contextual Video Compressioncited by 221
- 2022VRT: A Video Restoration Transformercited by 220
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 176
- 2022Recurrent Video Restoration Transformer with Guided Deformable Attentioncited by 170
- 2023Neural Video Compression with Diverse Contextscited by 165
- 2021FVC: A New Framework towards Deep Video Compression in Feature Spacecited by 153
- 2022FILM: Frame Interpolation for Large Motioncited by 153
- 2021TimeLens: Event-based Video Frame Interpolationcited by 151
- 2021Low-Light Image and Video Enhancement Using Deep Learning: A Surveycited by 148
- 2021Modulated Periodic Activations for Generalizable Local Functional Representationscited by 140
12 most cited of 551 All 551 (JSON)
- 2026Revisiting Ground-Truth Synthesis from High-Speed Video: Exact Validity Conditions and an Audited Consumer Capture Corpus4 Oct 2026
- 2026Event-guided Neural Video Compression1 Oct 2026
- 2026FANVIDv2: Evaluating Video Super-Resolution by Face and Licence-Plate Recognition Under Compound Degradation30 Sep 2026
- 2026Double-stream registration with pyramid fusion for HDR video with alternating exposures25 Sep 2026
- 2026Accurate Motion Estimation with B'ezier Control Point for Efficient Frame Interpolation20 Sep 2026
- 2026Semantic-Aware Neural Video Codec for Error-Resilient Low-Latency Transmission14 Sep 2026
- 2026Binarized High-Efficiency RAW Video Restoration and Beyond17 Aug 2026
- 2026Open Evaluation Agent: Efficient and Promptable Evaluation of Visual Generative Models10 Aug 2026
- 2026Revisiting the Current Frame: Physical-Trace-Guided Network Output Correction for Video Restoration10 Aug 2026
- 2026Loss-Resilient Wireless Video Token Communication over Block Fading Channels9 Aug 2026
- 2026Bit Allocation Transfer for Perceptual Quality Enhancement of Traditional Video Codecs7 Aug 2026
- 2026Multiple Hypothesis Flow Estimation for Video Frame Interpolation under Matching Ambiguity7 Aug 2026
12 newest of 551 All 551 (JSON)