# Video Demoireing with Relation-Based Temporal Consistency

arXiv: https://arxiv.org/abs/2204.02957 · HTML: https://mlsanity.com/paper/2204.02957/

## Key facts

- Cited by 24 papers in the map (data through 14 Oct 2026).
- Builds on 33 of its 56 references that are in the map.
- First posted on arXiv 6 Apr 2022.

## Builds on (most cited first, 30 of 33)

- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [The Unreasonable Effectiveness of Deep Features as a Perceptual Metric](https://mlsanity.com/paper/1801.03924/) (2018)
- [SGDR: Stochastic Gradient Descent with Warm Restarts](https://mlsanity.com/paper/1608.03983/) (2016)
- [Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset](https://mlsanity.com/paper/1705.07750/) (2017)
- [Perceptual Losses for Real-Time Style Transfer and Super-Resolution](https://mlsanity.com/paper/1603.08155/) (2016)
- [RAFT: Recurrent All-Pairs Field Transforms for Optical Flow](https://mlsanity.com/paper/2003.12039/) (2020)
- [Deformable Convolutional Networks](https://mlsanity.com/paper/1703.06211/) (2017)
- [Deep High-Resolution Representation Learning for Visual Recognition](https://mlsanity.com/paper/1908.07919/) (2019)
- [FlowNet: Learning Optical Flow with Convolutional Networks](https://mlsanity.com/paper/1504.06852/) (2015)
- [FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks](https://mlsanity.com/paper/1612.01925/) (2016)
- [EDVR: Video Restoration with Enhanced Deformable Convolutional Networks](https://mlsanity.com/paper/1905.02716/) (2019)
- [Video-to-Video Synthesis](https://mlsanity.com/paper/1808.06601/) (2018)
- [Deeply-Supervised Nets](https://mlsanity.com/paper/1409.5185/) (2014)
- [Learning Texture Transformer Network for Image Super-Resolution](https://mlsanity.com/paper/2006.04139/) (2020)
- [BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignment](https://mlsanity.com/paper/2104.13371/) (2021)
- [BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyond](https://mlsanity.com/paper/2012.02181/) (2020)
- [Learning Blind Video Temporal Consistency](https://mlsanity.com/paper/1808.00449/) (2018)
- [TDAN: Temporally Deformable Alignment Network for Video Super-Resolution](https://mlsanity.com/paper/1812.02898/) (2018)
- [Frame-Recurrent Video Super-Resolution](https://mlsanity.com/paper/1801.04590/) (2018)
- [Real-Time Video Super-Resolution with Spatio-Temporal Networks and Motion Compensation](https://mlsanity.com/paper/1611.05250/) (2016)
- [FastDVDnet: Towards Real-Time Deep Video Denoising Without Flow Estimation](https://mlsanity.com/paper/1907.01361/) (2019)
- [Free-form Video Inpainting with 3D Gated Convolution and Temporal PatchGAN](https://mlsanity.com/paper/1904.10247/) (2019)
- [Blind Video Temporal Consistency via Deep Video Prior](https://mlsanity.com/paper/2010.11838/) (2020)
- [Betrayed by Motion: Camouflaged Object Discovery via Motion Segmentation](https://mlsanity.com/paper/2011.11630/) (2020)
- [Wavelet-Based Dual-Branch Network for Image Demoireing](https://mlsanity.com/paper/2007.07173/) (2020)
- [Image Demoireing with Learnable Bandpass Filters](https://mlsanity.com/paper/2004.00406/) (2020)
- [Fully Automatic Video Colorization with Self-Regularization and Diversity](https://mlsanity.com/paper/1908.01311/) (2019)
- [An Internal Learning Approach to Video Inpainting](https://mlsanity.com/paper/1909.07957/) (2019)
- [Moir'e Photo Restoration Using Multiresolution Convolutional Neural Networks](https://mlsanity.com/paper/1805.02996/) (2018)
- [Single-frame Regularization for Temporally Stable CNNs](https://mlsanity.com/paper/1902.10424/) (2019)

## Built on by (most cited first, 24 of 24)

- [Low-Light Video Enhancement with Synthetic Event Guidance](https://mlsanity.com/paper/2208.11014/) (2022)
- [RelationAdapter: Learning and Transferring Visual Relation with Diffusion Transformers](https://mlsanity.com/paper/2506.02528/) (2025)
- [Hybrid Neural Rendering for Large-Scale Scenes with Motion Blur](https://mlsanity.com/paper/2304.12652/) (2023)
- [Constructing Holistic Spatio-Temporal Scene Graph for Video Semantic Role Labeling](https://mlsanity.com/paper/2308.05081/) (2023)
- [Image Demoireing in RAW and sRGB Domains](https://mlsanity.com/paper/2312.09063/) (2023)
- [Automatic Animation of Hair Blowing in Still Portrait Photos](https://mlsanity.com/paper/2309.14207/) (2023)
- [Recaptured Raw Screen Image and Video Demoir'eing via Channel and Spatial Modulations](https://mlsanity.com/paper/2310.20332/) (2023)
- [Beyond Alignment: Blind Video Face Restoration via Parsing-Guided Temporal-Coherent Transformer](https://mlsanity.com/paper/2404.13640/) (2024)
- [RealRestorer: Towards Generalizable Real-World Image Restoration with Large-Scale Image Editing Models](https://mlsanity.com/paper/2603.25502/) (2026)
- [Direction-aware Video Demoireing with Temporal-guided Bilateral Learning](https://mlsanity.com/paper/2308.13388/) (2023)
- [Learning to See Low-Light Images via Feature Domain Adaptation](https://mlsanity.com/paper/2312.06723/) (2023)
- [Driving-Video Dehazing with Non-Aligned Regularization for Safety Assistance](https://mlsanity.com/paper/2405.09996/) (2024)
- [FPANet: Frequency-based Video Demoireing using Frame-level Post Alignment](https://mlsanity.com/paper/2301.07330/) (2023)
- [Alignment-free Raw Video Demoireing](https://mlsanity.com/paper/2408.10679/) (2024)
- [Video Demoireing using Focused-Defocused Dual-Camera System](https://mlsanity.com/paper/2508.03449/) (2025)
- [Removing Multiple Hybrid Adverse Weather in Video via a Unified Model](https://mlsanity.com/paper/2503.06200/) (2025)
- [Moir'eXNet: Adaptive Multi-Scale Demoir'eing with Linear Attention Test-Time Training and Truncated Flow Matching Prior](https://mlsanity.com/paper/2506.15929/) (2025)
- [MoCHA-former: Moir'e-Conditioned Hybrid Adaptive Transformer for Video Demoir'eing](https://mlsanity.com/paper/2508.14423/) (2025)
- [Through the Lens: Benchmarking Deepfake Detectors Against Moir'e-Induced Distortions](https://mlsanity.com/paper/2510.23225/) (2025)
- [ViStripformer: A Token-Efficient Transformer for Versatile Video Restoration](https://mlsanity.com/paper/2312.14502/) (2023)
- [Toward Accurate and Temporally Consistent Video Restoration from Raw Data](https://mlsanity.com/paper/2312.16247/) (2023)
- [Freqformer: Image-Demoir'eing Transformer via Effective Frequency Decomposition](https://mlsanity.com/paper/2505.19120/) (2025)
- [WaterWave: Bridging Underwater Image Enhancement into Video Streams via Wavelet-based Temporal Consistency Field](https://mlsanity.com/paper/2512.05492/) (2025)
- [VDFP: Video Deflickering with Flicker-banding Priors](https://mlsanity.com/paper/2605.21079/) (2026)

## Abstract (arXiv)

Moire patterns, appearing as color distortions, severely degrade image and video qualities when filming a screen with digital cameras. Considering the increasing demands for capturing videos, we study how to remove such undesirable moire patterns in videos, namely video demoireing. To this end, we introduce the first hand-held video demoireing dataset with a dedicated data collection pipeline to ensure spatial and temporal alignments of captured data. Further, a baseline video demoireing model with implicit feature space alignment and selective feature aggregation is developed to leverage complementary information from nearby frames to improve frame-level video demoireing. More importantly, we propose a relation-based temporal consistency loss to encourage the model to learn temporal consistency priors directly from ground-truth reference videos, which facilitates producing temporally consistent predictions and effectively maintains frame-level qualities. Extensive experiments manifest the superiority of our model. Code is available at urlhttps://daipengwa.github.io/VDmoireProjectPage/.