mlsanityData to 14 Oct 2026

DreamLoop: Controllable Cinemagraph Generation from a Single Photograph

arXiv 2601.02646 ↗First posted 6 Jan 2026cs.CV cs.AIcited by 2

On the map: Diffusion models → Video generation

Abstract (arXiv)

Cinemagraphs, which combine static photographs with selective, looping motion, offer unique artistic appeal. Generating them from a single photograph in a controllable manner is particularly challenging. Existing image-animation techniques are restricted to simple, low-frequency motions and operate only in narrow domains with repetitive textures like water and smoke. In contrast, large-scale video diffusion models are not tailored for cinemagraph constraints and lack the specialized data required to generate seamless, controlled loops. We present DreamLoop, a controllable video synthesis framework dedicated to generating cinemagraphs from a single photo without requiring any cinemagraph training data. Our key idea is to adapt a general video diffusion model by training it on two objectives: temporal bridging and motion conditioning. This strategy enables flexible cinemagraph generation. During inference, by using the input image as both the first- and last- frame condition, we enforce a seamless loop. By conditioning on static tracks, we maintain a static background. Finally, by providing a user-specified motion path for a target object, our method provides intuitive control over the animation's trajectory and timing. To our knowledge, DreamLoop is the first method to enable cinemagraph generation for general scenes with flexible and intuitive controls. We demonstrate that our method produces high-quality, complex cinemagraphs that align with user intent, outperforming existing approaches.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 36 of its 61 references that are in the map. First posted on arXiv 6 Jan 2026.

Builds on

36 of 61 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025MotionCanvas: Cinematic Shot Design with Controllable Image-to-Video Generation6 Feb
  2. 2024LTX-Video: Realtime Video Latent Diffusion30 Dec
  3. 2024AKiRa: Augmentation Kit on Rays for optical video generation18 Dec
  4. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformers27 Nov
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  6. 2024MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model30 May
  7. 2024ReVideo: Remake a Video with Motion and Content Control22 May
  8. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generation2 Apr
  9. 2024Lumiere: A Space-Time Diffusion Model for Video Generation23 Jan
  10. 2023TrailBlazer: Trajectory Control for Diffusion-Based Video Generation31 Dec
  11. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  12. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generation30 Oct
1 more
  1. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors18 Oct

Other references · 23

  1. 2022Scalable Diffusion Models with Transformerscited by 6,054
  2. 2022Flow Matching for Generative Modelingcited by 5,702
  3. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  4. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  5. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  6. 2018Demystifying MMD GANscited by 1,293
  7. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  8. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
  9. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  10. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
  11. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
  12. 2024DragAnything: Motion Control for Anything using Entity Representationcited by 159
11 more
  1. 2024Boximator: Generating Rich and Controllable Motions for Video Synthesiscited by 107
  2. 2023Generative Image Dynamicscited by 94
  3. 2022High-Quality Entity Segmentationcited by 93
  4. 2024MotionBooth: Motion-Aware Customized Text-to-Video Generationcited by 93
  5. 2020Animating Pictures with Eulerian Motion Fieldscited by 55
  6. 2021Stochastic Image-to-Video Synthesis using cINNscited by 49
  7. 2021Controllable Animation of Fluid Elements in Still Imagescited by 45
  8. 20233D Cinemagraphy from a Single Imagecited by 24
  9. 2023Text-Guided Synthesis of Eulerian Cinemagraphscited by 22
  10. 2022Simulating Fluids in Real-World Still Imagescited by 15
  11. 2023Blowing in the Wind: CycleNet for Human Cinemagraphs from Still Imagescited by 14

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Controllable Longer Image Animation with Diffusion Models
  2. 2025Time-to-Move: Training-Free Motion Controlled Video Generation via Dual-Clock Denoising
  3. 2024Cinematographic Camera Diffusion Model
  4. 2024DreamCinema: Cinematic Transfer with Free Camera and 3D Character
  5. 2024Sketch-Guided Stylized Landscape Cinemagraph Synthesis
  6. 2025Frame In-N-Out: Unbounded Controllable Image-to-Video Generation
  7. 2025FloVD: Optical Flow Meets Video Diffusion Model for Enhanced Camera-Controlled Video Synthesis
  8. 2023TrackDiffusion: Tracklet-Conditioned Video Generation via Diffusion Models