mlsanityData to 14 Oct 2026

Generating Fit Check Videos with a Handheld Camera

arXiv 2505.23886 ↗First posted 29 May 2025cs.CVcited by 0

On the map: Diffusion models → Video generation

Abstract (arXiv)

Self-captured full-body videos are popular, but most deployments require mounted cameras, carefully-framed shots, and repeated practice. We propose a more convenient solution that enables full-body video capture using handheld mobile devices. Our approach takes as input two static photos (front and back) of you in a mirror, along with an IMU motion reference that you perform while holding your mobile phone, and synthesizes a realistic video of you performing a similar target motion. We enable rendering into a new scene, with consistent illumination and shadows. We propose a novel video diffusion-based model to achieve this. Specifically, we propose a parameter-free frame generation strategy and a multi-reference attention mechanism to effectively integrate appearance information from both the front and back selfies into the video diffusion model. Further, we introduce an image-based fine-tuning strategy to enhance frame sharpness and improve shadows and reflections generation for more realistic human-scene composition.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 82 of its 103 references that are in the map. First posted on arXiv 29 May 2025.

Builds on

82 of 103 references.

Closest ancestors · 24

Same direction, newest first

  1. 2025UniAnimate-DiT: Human Image Animation with Large-Scale Video Diffusion Transformer15 Apr
  2. 2025Taming Consistency Distillation for Accelerated Human Image Animation15 Apr
  3. 2025Multi-identity Human Image Animation with Structural Video Diffusion5 Apr
  4. 2025DynamiCtrl: Rethinking the Basic Structure and the Role of Text for High-quality Human Image Animation27 Mar
  5. 2025Animate Anyone 2: High-Fidelity Character Image Animation with Environment Affordance10 Feb
  6. 2024DreamDance: Animating Human Images by Enriching 3D Geometry Cues from 2D Poses30 Nov
  7. 2024StableAnimator: High-Quality Identity-Preserving Human Image Animation26 Nov
  8. 2024MoRAG -- Multi-Fusion Retrieval Augmented Generation for Human Motion18 Sep
  9. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  10. 2024TCAN: Animating Human Images with Temporally Consistent Pose Guidance using Diffusion Models12 Jul
  11. 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation3 Jun
  12. 2024VividPose: Advancing Stable Video Diffusion for Realistic Human Image Animation28 May
12 more
  1. 2024Human4DiT: 360-degree Human Video Generation with 4D Diffusion Transformer27 May
  2. 2024Disentangling Foreground and Background Motion for Enhanced Realism in Human Video Generation26 May
  3. 2024ReVideo: Remake a Video with Motion and Content Control22 May
  4. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance21 Mar
  5. 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjects18 Jan
  6. 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motion7 Dec
  7. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation28 Nov
  8. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model27 Nov
  9. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  10. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
  11. 2022PhysDiff: Physics-Guided Human Motion Diffusion Model5 Dec
  12. 2022Human Motion Diffusion Model29 Sep

Other references · 58

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2022Classifier-Free Diffusion Guidancecited by 5,847
  4. 2025Qwen2.5-VL Technical Reportcited by 5,587
  5. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  6. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  7. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  8. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  9. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  10. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  11. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  12. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
38 more
  1. 2020First Order Motion Model for Image Animationcited by 704
  2. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  3. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  4. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
  5. 2022OneFormer: One Transformer to Rule Universal Image Segmentationcited by 328
  6. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
  7. 2018Everybody Dance Nowcited by 315
  8. 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 311
  9. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
  10. 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 238
  11. 2023HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Modelscited by 225
  12. 2022Thin-Plate Spline Motion Model for Image Animationcited by 210
  13. 2018Animating Arbitrary Objects via Deep Motion Transfercited by 208
  14. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 198
  15. 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 198
  16. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
  17. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
  18. 2022Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensorscited by 146
  19. 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 129
  20. 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 129
  21. 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
  22. 2019DwNet: Dense warp-based network for pose-guided human video generationcited by 115
  23. 2023Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Modelcited by 107
  24. 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 88
  25. 2022Transformer Inertial Poser: Real-time Human Motion Reconstruction from Sparse IMUs with Simultaneous Terrain Generationcited by 76
  26. 2022Exploring Dual-task Correlation for Pose Guided Person Image Generationcited by 68
  27. 2021CoNeRF: Controllable Neural Radiance Fieldscited by 65
  28. 2024LaMP: Language-Motion Pretraining for Motion Generation, Retrieval, and Captioningcited by 59
  29. 2023IMUPoser: Full-Body Pose Estimation using IMUs in Phones, Watches, and Earbudscited by 54
  30. 2024Improving fine-grained understanding in image-text pre-trainingcited by 44
  31. 2020Deep Spatial Transformation for Pose-Guided Person Image Generation and Animationcited by 43
  32. 2021FLAME-in-NeRF : Neural control of Radiance Fields for Free View Face Animationcited by 33
  33. 2023DiffusionPoser: Real-time Human Motion Reconstruction From Arbitrary Sparse Sensors Using Autoregressive Diffusioncited by 31
  34. 2024Imagine yourself: Tuning-Free Personalized Image Generationcited by 30
  35. 2025RealisDance-DiT: Simple yet Strong Baseline towards Controllable Character Animation in the Wildcited by 29
  36. 2023Bidirectionally Deformable Motion Modulation For Video-based Human Pose Transfercited by 25
  37. 2025MobilePoser: Real-Time Full-Body Pose Estimation and 3D Human Translation from IMUs in Mobile Consumer Devicescited by 23
  38. 2023Dense Pixel-to-Pixel Harmonization via Continuous Image Representationcited by 19

50 most cited of 58 All 58 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Facial Appearance Capture at Home with Patch-Level Reflectance Prior
  2. 2025LMP: Leveraging Motion Prior in Zero-Shot Video Generation with Diffusion Transformer
  3. 2024ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuning
  4. 2026ActCam: Zero-Shot Joint Camera and 3D Motion Control for Video Generation
  5. 2024Real-time One-Step Diffusion-based Expressive Portrait Videos Generation
  6. 2026PartiCam: Camera Controlled Video Generation with Reward Guidance
  7. 2026Efficient Camera-Controlled Video Generation of Static Scenes via Sparse Diffusion and 3D Rendering
  8. 2024ViMo: Generating Motions from Casual Videos