mlsanityData to 7 Oct 2026

Optimised ProPainter for Video Diminished Reality Inpainting

arXiv 2406.02287 ↗First posted 4 Jun 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

In this paper, part of the DREAMING Challenge - Diminished Reality for Emerging Applications in Medicine through Inpainting, we introduce a refined video inpainting technique optimised from the ProPainter method to meet the specialised demands of medical imaging, specifically in the context of oral and maxillofacial surgery. Our enhanced algorithm employs the zero-shot ProPainter, featuring optimized parameters and pre-processing, to adeptly manage the complex task of inpainting surgical video sequences, without requiring any training process. It aims to produce temporally coherent and detail-rich reconstructions of occluded regions, facilitating clearer views of operative fields. The efficacy of our approach is evaluated using comprehensive metrics, positioning it as a significant advancement in the application of diminished reality for medical purposes.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 25 references that are in the map. First posted on arXiv 4 Jun 2024.

Builds on

15 of 25 references.

References · 15

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2018Deformable ConvNets v2: More Deformable, Better Resultscited by 666
  3. 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 381
  4. 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 193
  5. 2019Deep Video Inpaintingcited by 107
  6. 2019Free-form Video Inpainting with 3D Gated Convolution and Temporal PatchGANcited by 85
  7. 2018Video Inpainting by Jointly Learning Temporal Structure and Spatial Detailscited by 57
  8. 2024Deep Learning-based Image and Video Inpainting: A Surveycited by 44
  9. 2021Occlusion-Aware Video Object Inpaintingcited by 30
  10. 2022Error Compensation Framework for Flow-Guided Video Inpaintingcited by 20
  11. 2021Internal Video Inpainting by Implicit Long-range Propagationcited by 19
  12. 2022SCOTCH and SODA: A Transformer Video Shadow Detection Frameworkcited by 19
3 more
  1. 2019Probabilistic Multilayer Regularization Network for Unsupervised 3D Brain Image Registrationcited by 13
  2. 2021Flow-Guided Video Inpainting with Scene Templatescited by 12
  3. 2022PC-SwinMorph: Patch Representation for Unsupervised Medical Image Registration and Segmentationcited by 8

Built on by

Not cited yet.