Copy What Is Seen, Generate What Is Not: Training-Free Anomaly-Aware Video Restoration
Not on the map. Why?
Abstract (arXiv)
A surveillance system that detects an anomaly often has to repair the footage as well, yet the two tasks are studied in isolation: training-free anomaly detectors stop at a score or a label, while training-free video editing answers to a user prompt rather than to a detector. This paper proposes AVR (Anomaly-aware Video Restoration), which closes that gap with frozen pretrained models alone and generates content only where the clip offers no evidence to copy. Motion evidence first gates open-vocabulary proposals into spatio-temporal masks. A background prior computed from the clip then fills every pixel the anomaly ever uncovers, leaving diffusion to synthesize only what no frame showed, and a frozen verifier decides per clip whether to trust a classical, a prior-anchored, or a background-conditioned restorer. Extensive experiments on three surveillance datasets, under both full-reference anomaly injection and real anomalies, show that AVR leads full-frame fidelity under oracle masks, matches three trained video inpainters inside the edited region, and outperforms a detect-then-generate pipeline on the masks it produces itself, while suppressing both the residual anomaly and the flicker of free diffusion.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 45 references that are in the map. First posted on arXiv 16 Sep 2026.
Builds on
38 of 45 references.
References · 38
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Segment Anythingcited by 8,234
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
- 2018Real-world Anomaly Detection in Surveillance Videoscited by 577
26 more
- 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 564
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
- 2016Learning Temporal Regularity in Video Sequencescited by 254
- 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Stepscited by 234
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
- 2022Towards An End-to-End Framework for Flow-Guided Video Inpaintingcited by 113
- 2024Harnessing Large Language Models for Training-free Video Anomaly Detectioncited by 87
- 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 72
- 2023Prompt Federated Learning for Weather Forecasting: Toward Foundation Models on Meteorological Datacited by 40
- 2024Networking Systems for Video Anomaly Detection: A Tutorial and Surveycited by 21
- 2024Video Anomaly Detection in 10 Years: A Survey and Outlookcited by 18
- 2023Gradpaint: Gradient-Guided Inpainting with Diffusion Modelscited by 17
- 2025OmnimatteZero: Fast Training-free Omnimatte with Pre-trained Video Diffusion Modelscited by 16
- 2021The DEVIL is in the Details: A Diagnostic Evaluation Benchmark for Video Inpaintingcited by 12
- 2023TempEE: Temporal-Spatial Parallel Transformer for Radar Echo Extrapolation Beyond Auto-Regressioncited by 12
- 2025FeDaL: Federated Dataset Learning for General Time Series Foundation Modelscited by 10
- 2025Track Any Anomalous Object: A Granular Video Anomaly Detection Pipelinecited by 8
- 2026No Need For Real Anomaly: MLLM Empowered Zero-Shot Video Anomaly Detectioncited by 8
- 2026Efficient Video Diffusion Models: Advancements and Challengescited by 7
- 2024Coherent Video Inpainting Using Optical Flow-Guided Efficient Diffusioncited by 6
- 2026SphereVAD: Training-Free Video Anomaly Detection via Geodesic Inference on the Unit Hyperspherecited by 2
- 2026MemoVAD: Resource-Efficient Video Anomaly Detection via Dynamic Semantic Memory in Edge Computing Scenarioscited by 2
- 2026AnomalyAgent: Training-Free Agentic Models for Zero-/Few-Shot Anomaly Detectioncited by 1
Built on by
Not cited yet.