mlsanityData to 14 Oct 2026

Copy What Is Seen, Generate What Is Not: Training-Free Anomaly-Aware Video Restoration

arXiv 2609.18836 ↗First posted 16 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

A surveillance system that detects an anomaly often has to repair the footage as well, yet the two tasks are studied in isolation: training-free anomaly detectors stop at a score or a label, while training-free video editing answers to a user prompt rather than to a detector. This paper proposes AVR (Anomaly-aware Video Restoration), which closes that gap with frozen pretrained models alone and generates content only where the clip offers no evidence to copy. Motion evidence first gates open-vocabulary proposals into spatio-temporal masks. A background prior computed from the clip then fills every pixel the anomaly ever uncovers, leaving diffusion to synthesize only what no frame showed, and a frozen verifier decides per clip whether to trust a classical, a prior-anchored, or a background-conditioned restorer. Extensive experiments on three surveillance datasets, under both full-reference anomaly injection and real anomalies, show that AVR leads full-frame fidelity under oracle masks, matches three trained video inpainters inside the edited region, and outperforms a detect-then-generate pipeline on the masks it produces itself, while suppressing both the residual anomaly and the flicker of free diffusion.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 45 references that are in the map. First posted on arXiv 16 Sep 2026.

Builds on

38 of 45 references.

References · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2023Segment Anythingcited by 8,234
  5. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  6. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  7. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  8. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
  9. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  10. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  11. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
  12. 2018Real-world Anomaly Detection in Surveillance Videoscited by 577
26 more
  1. 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 564
  2. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
  3. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
  4. 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
  5. 2016Learning Temporal Regularity in Video Sequencescited by 254
  6. 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Stepscited by 234
  7. 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
  8. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
  9. 2022Towards An End-to-End Framework for Flow-Guided Video Inpaintingcited by 113
  10. 2024Harnessing Large Language Models for Training-free Video Anomaly Detectioncited by 87
  11. 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 72
  12. 2023Prompt Federated Learning for Weather Forecasting: Toward Foundation Models on Meteorological Datacited by 40
  13. 2024Networking Systems for Video Anomaly Detection: A Tutorial and Surveycited by 21
  14. 2024Video Anomaly Detection in 10 Years: A Survey and Outlookcited by 18
  15. 2023Gradpaint: Gradient-Guided Inpainting with Diffusion Modelscited by 17
  16. 2025OmnimatteZero: Fast Training-free Omnimatte with Pre-trained Video Diffusion Modelscited by 16
  17. 2021The DEVIL is in the Details: A Diagnostic Evaluation Benchmark for Video Inpaintingcited by 12
  18. 2023TempEE: Temporal-Spatial Parallel Transformer for Radar Echo Extrapolation Beyond Auto-Regressioncited by 12
  19. 2025FeDaL: Federated Dataset Learning for General Time Series Foundation Modelscited by 10
  20. 2025Track Any Anomalous Object: A Granular Video Anomaly Detection Pipelinecited by 8
  21. 2026No Need For Real Anomaly: MLLM Empowered Zero-Shot Video Anomaly Detectioncited by 8
  22. 2026Efficient Video Diffusion Models: Advancements and Challengescited by 7
  23. 2024Coherent Video Inpainting Using Optical Flow-Guided Efficient Diffusioncited by 6
  24. 2026SphereVAD: Training-Free Video Anomaly Detection via Geodesic Inference on the Unit Hyperspherecited by 2
  25. 2026MemoVAD: Resource-Efficient Video Anomaly Detection via Dynamic Semantic Memory in Edge Computing Scenarioscited by 2
  26. 2026AnomalyAgent: Training-Free Agentic Models for Zero-/Few-Shot Anomaly Detectioncited by 1

Built on by

Not cited yet.