mlsanityData to 7 Oct 2026

Rotate Your Character: Revisiting Video Diffusion Models for High-Quality 3D Character Generation

arXiv 2601.05722 ↗First posted 9 Jan 2026cs.CVcited by 1

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Generating high-quality 3D characters from single images remains a significant challenge in digital content creation, particularly due to complex body poses and self-occlusion. In this paper, we present RCM (Rotate your Character Model), an advanced image-to-video diffusion framework tailored for high-quality novel view synthesis (NVS) and 3D character generation. Compared to existing diffusion-based approaches, RCM offers several key advantages: (1) transferring characters with any complex poses into a canonical pose, enabling consistent novel view synthesis across the entire viewing orbit, (2) high-resolution orbital video generation at 1024x1024 resolution, (3) controllable observation positions given different initial camera poses, and (4) multi-view conditioning supporting up to 4 input images, accommodating diverse user scenarios. Extensive experiments demonstrate that RCM outperforms state-of-the-art methods in both novel view synthesis and 3D generation quality.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 54 of its 60 references that are in the map. First posted on arXiv 9 Jan 2026.

Builds on

54 of 60 references.

Closest ancestors · 21

Same direction, newest first

  1. 2024Hi3D: Pursuing High-Resolution Image-to-3D Generation with Video Diffusion Models11 Sep
  2. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion18 Mar
  3. 2024V3D: Video Diffusion Models are Effective 3D Generators11 Mar
  4. 2023EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusion11 Dec
  5. 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generation2 Dec
  6. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion14 Nov
  7. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model10 Nov
  8. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Model23 Oct
  9. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusion23 Oct
  10. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Models12 Oct
  11. 2023Consistent123: One Image to Highly Consistent 3D Asset Using Case-Aware Diffusion Priors29 Sep
  12. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Image7 Sep
9 more
  1. 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
  2. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization29 Jun
  3. 2023DreamTime: An Improved Optimization Strategy for Diffusion-Guided 3D Generation21 Jun
  4. 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidance30 May
  5. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
  6. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation24 Mar
  7. 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
  8. 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
  9. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 33

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  4. 2022Flow Matching for Generative Modelingcited by 5,426
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  6. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  7. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  8. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  9. 2022Video Diffusion Modelscited by 2,280
  10. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  11. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  12. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
21 more
  1. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  2. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  3. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  4. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
  5. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 568
  6. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
  7. 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 389
  8. 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
  9. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
  10. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
  11. 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 210
  12. 2025Video models are zero-shot learners and reasonerscited by 208
  13. 2025HunyuanImage 3.0 Technical Reportcited by 138
  14. 2024VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Modelscited by 124
  15. 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 92
  16. 2024IM-3D: Iterative Multiview Diffusion and Reconstruction for High-Quality 3D Generationcited by 84
  17. 2024VideoMV: Consistent Multi-View Generation Based on Large Video Generative Modelcited by 45
  18. 2025HuMo: Human-Centric Video Generation via Collaborative Multi-Modal Conditioningcited by 44
  19. 2024MVD-Fusion: Single-view 3D via Depth-consistent Multi-view Generationcited by 35
  20. 2024CharacterGen: Efficient 3D Character Generation from Single Images with Multi-View Pose Canonicalizationcited by 28
  21. 2025AR-1-to-3: Single Image to Consistent 3D Object Generation via Next-View Predictioncited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026Image-to-Video Diffusion: From Foundations to Open Frontierscited by 1

Similar, not cited

Close in wording, no citation either way

  1. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis
  2. 2024DreamCinema: Cinematic Transfer with Free Camera and 3D Character
  3. 2023ViVid-1-to-3: Novel View Synthesis with Video Diffusion Models
  4. 2026Human Video Generation from a Single Image with 3D Pose and View Control
  5. 2025TurboPortrait3D: Single-step diffusion-based fast portrait novel-view synthesis
  6. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation
  7. 2024MIMO: Controllable Character Video Synthesis with Spatial Decomposed Modeling
  8. 2025VideoFrom3D: 3D Scene Video Generation via Complementary Image and Video Diffusion Models