mlsanityData to 7 Oct 2026

PartiCam: Camera Controlled Video Generation with Reward Guidance

arXiv 2609.39504 ↗First posted 30 Sep 2026cs.CV cs.AIcited by 0

On the map: Diffusion models → Video generation

Abstract (arXiv)

We present PartiCam, a training-free Particle filtering rooted method for improved Camera controlled video generation. Generating videos that follow a precisely specified camera trajectory remains challenging for large video diffusion models. Training-free approaches are backbone-agnostic and avoid the need to construct large camera-annotated datasets by steering pretrained models toward the desired camera motion at test time. This enables the generation of camera-controlled video data that can subsequently be used to train camera-conditioned video diffusion models. Existing sampling-based guidance approaches often suffer from unstable trajectories: they either explore too broadly and fail to respect the target camera motion or collapse early and lose visual diversity over time. We introduce a global-local refinement framework for diffusion reward guidance, enabling accurate and consistent camera control during video generation. Our method builds on Sequential Monte-Carlo (SMC) guidance, but introduces a local refinement stage based on particle filtered resampling. Experiments show large improvements in camera trajectory adherence, reduced drift, and better visual quality, without requiring model retraining.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 67 of its 85 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

67 of 85 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025MALT Diffusion: Memory-Augmented Latent Transformers for Any-Length Video Generation18 Feb
  2. 2025Goku: Flow Based Video Generative Foundation Models7 Feb
  3. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  4. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov

Other references · 63

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  6. 2022Classifier-Free Diffusion Guidancecited by 5,717
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  8. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  9. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  10. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  11. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  12. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
38 more
  1. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  2. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  3. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  4. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
  5. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  6. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
  7. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  8. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  9. 2023Training Diffusion Models with Reinforcement Learningcited by 939
  10. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 895
  11. 2023RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignmentcited by 672
  12. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  13. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
  14. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  15. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
  16. 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 501
  17. 2023DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Modelscited by 431
  18. 2023Universal Guidance for Diffusion Modelscited by 426
  19. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
  20. 2023Scaling Relationship on Learning Mathematical Reasoning with Large Language Modelscited by 417
  21. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  22. 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 310
  23. 2021Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contractioncited by 306
  24. 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 290
  25. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  26. 2022Diffusion probabilistic modeling of protein backbones in 3D for the motif-scaffolding problemcited by 229
  27. 2023Practical and Asymptotically Exact Conditional Sampling in Diffusion Modelscited by 218
  28. 2025Video models are zero-shot learners and reasonerscited by 208
  29. 2023Cross-Image Attention for Zero-Shot Appearance Transfercited by 135
  30. 2023Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fieldscited by 122
  31. 20243D Geometry-aware Deformable Gaussian Splatting for Dynamic View Synthesiscited by 109
  32. 2022ParticleSfM: Exploiting Dense Point Trajectories for Localizing Moving Cameras in the Wildcited by 90
  33. 2025Test-time Alignment of Diffusion Models without Reward Over-optimizationcited by 89
  34. 2025Inference-Time Alignment in Diffusion Models with Reward-Guided Generation: Tutorial and Reviewcited by 82
  35. 2023Restart Sampling for Improving Generative Processescited by 81
  36. 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizercited by 79
  37. 2023Long-Term Photometric Consistent Novel View Synthesis with Diffusion Modelscited by 76
  38. 20233D-aware Image Generation using 2D Diffusion Modelscited by 69

50 most cited of 63 All 63 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Taming Camera-Controlled Video Generation with Verifiable Geometry Reward
  2. 2024Boosting Camera Motion Control for Video Diffusion Transformers
  3. 2025Frame Guidance: Training-Free Guidance for Frame-Level Control in Video Diffusion Models
  4. 2024Training-free Camera Control for Video Generation
  5. 2024Latent-Reframe: Enabling Camera Control for Video Diffusion Model without Training
  6. 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Models
  7. 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control
  8. 2025Real-Time Motion-Controllable Autoregressive Video Diffusion