M3DDM+: An improved video outpainting by a modified masking strategy
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
M3DDM provides a computationally efficient framework for video outpainting via latent diffusion modeling. However, it exhibits significant quality degradation -- manifested as spatial blur and temporal inconsistency -- under challenging scenarios characterized by limited camera motion or large outpainting regions, where inter-frame information is limited. We identify the cause as a training-inference mismatch in the masking strategy: M3DDM's training applies random mask directions and widths across frames, whereas inference requires consistent directional outpainting throughout the video. To address this, we propose M3DDM+, which applies uniform mask direction and width across all frames during training, followed by fine-tuning of the pretrained M3DDM model. Experiments demonstrate that M3DDM+ substantially improves visual fidelity and temporal coherence in information-limited scenarios while maintaining computational efficiency. The code is available at https://github.com/tamaki-lab/M3DDM-Plus.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 19 of its 31 references that are in the map. First posted on arXiv 16 Jan 2026.
Builds on
19 of 31 references.
Closest ancestors · 2
Same direction, newest first
- 2025OutDreamer: Video Outpainting with a Diffusion Transformer27 Jun
- 2023Hierarchical Masked 3D Diffusion Model for Video Outpainting5 Sep
Other references · 17
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
- 2021In&Out : Diverse Image Outpainting via GAN Inversioncited by 55
- 2018Painting Outside the Box: Image Outpainting with GANscited by 30
5 more
- 2024Be-Your-Outpainter: Mastering Video Outpainting through Input-Specific Adaptationcited by 29
- 2024Continuous-Multiple Image Outpainting in One-Step via Positional Query and A Diffusion-based Approachcited by 18
- 2019Image Outpainting and Harmonization using Generative Adversarial Networkscited by 12
- 2025LightsOut: Diffusion-based Outpainting for Enhanced Lens Flare Removalcited by 9
- 2024VIP: Versatile Image Outpainting Empowered by Multimodal Large Language Modelcited by 8
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoising
- 2025DiffuEraser: A Diffusion Model for Video Inpainting
- 2024Semantically Consistent Video Inpainting with Conditional Diffusion Models
- 2025VipDiff: Towards Coherent and Diverse Video Inpainting via Training-free Denoising Diffusion Models
- 2025EasyOmnimatte: Taming Pretrained Inpainting Diffusion Models for End-to-End Video Layered Decomposition
- 2023Learning 3D Photography Videos via Self-supervised Diffusion on Single Images
- 2024Video Diffusion Models are Strong Video Inpainter
- 2025Reconstruct, Inpaint, Test-Time Finetune: Dynamic Novel-view Synthesis from Monocular Videos