ConsID-Gen: View-Consistent and Identity-Preserving Image-to-Video Generation
Not on the map. Why?
Abstract (arXiv)
Image-to-Video generation (I2V) animates a static image into a temporally coherent video sequence following textual instructions, yet preserving fine-grained object identity under changing viewpoints remains a persistent challenge. Unlike text-to-video models, existing I2V pipelines often suffer from appearance drift and geometric distortion, artifacts we attribute to the sparsity of single-view 2D observations and weak cross-modal alignment. Here we address this problem from both data and model perspectives. First, we curate ConsIDVid, a large-scale object-centric dataset built with a scalable pipeline for high-quality, temporally aligned videos, and establish ConsIDVid-Bench, where we present a novel benchmarking and evaluation framework for multi-view consistency using metrics sensitive to subtle geometric and appearance deviations. We further propose ConsID-Gen, a view-assisted I2V generation framework that augments the first frame with unposed auxiliary views and fuses semantic and structural cues via a dual-stream visual-geometric encoder as well as a text-visual connector, yielding unified conditioning for a Diffusion Transformer backbone. Experiments across ConsIDVid-Bench demonstrate that ConsID-Gen consistently outperforms in multiple metrics, with the best overall performance surpassing leading video generation models like Wan2.1 and HunyuanVideo, delivering superior identity fidelity and temporal coherence under challenging real-world scenarios. We will release our model and dataset at https://myangwu.github.io/ConsID-Gen.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 52 of its 65 references that are in the map. First posted on arXiv 10 Feb 2026.
Builds on
52 of 65 references.
References · 52
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
38 more
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2025Qwen-Image Technical Reportcited by 973
- 2020First Order Motion Model for Image Animationcited by 698
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
- 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 389
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 332
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
- 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 190
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 177
- 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 157
- 2020Objectron: A Large Scale Dataset of Object-Centric Videos in the Wild with Pose Annotationscited by 155
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
- 2024Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Contentcited by 132
- 2024ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generationcited by 130
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
- 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 115
- 2024FeatUp: A Model-Agnostic Framework for Features at Any Resolutioncited by 114
- 2025MEt3R: Measuring Multi-View Consistency in Generated Imagescited by 91
- 2017Learning to Generate Time-Lapse Videos Using Multi-Stage Dynamic Generative Adversarial Networkscited by 88
- 2025Wan-Animate: Unified Character Animation and Replacement with Holistic Replicationcited by 76
- 2024ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generationcited by 74
- 2025SkyReels-A2: Compose Anything in Video Diffusion Transformerscited by 72
- 2024Allegro: Open the Black Box of Commercial-Level Video Generation Modelcited by 68
- 2025Kling-Omni Technical Reportcited by 60
- 2024Track4Gen: Teaching Video Diffusion Models to Track Points Improves Video Generationcited by 42
- 2025Step-Video-TI2V Technical Report: A State-of-the-Art Text-Driven Image-to-Video Generation Modelcited by 25
- 2024Beyond FVD: Enhanced Evaluation Metrics for Video Generation Qualitycited by 21
- 2026SkyReels-V3 Technique Reportcited by 19
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026The Pulse of Motion: Measuring Physical Frame Rate from Visual Dynamicscited by 7
- 2026SparkVSR: Interactive Video Super-Resolution via Sparse Keyframe Propagationcited by 5
- 2026VEFX-Bench: A Holistic Benchmark for Generic Video Editing and Visual Effectscited by 4
- 2026Image-to-Video Diffusion: From Foundations to Open Frontierscited by 1
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancementcited by 0
- 2026ViTeX-Bench: Benchmarking High-Fidelity Video Scene Text Editingcited by 0
- 2026ViTeX-Bench: Benchmarking High-Fidelity Video Scene Text Editing30 Sep 2026
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancement20 Jul 2026
- 2026Image-to-Video Diffusion: From Foundations to Open Frontiers17 May 2026
- 2026VEFX-Bench: A Holistic Benchmark for Generic Video Editing and Visual Effects17 Apr 2026
- 2026SparkVSR: Interactive Video Super-Resolution via Sparse Keyframe Propagation17 Mar 2026
- 2026The Pulse of Motion: Measuring Physical Frame Rate from Visual Dynamics15 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026HarmoView: Harmonizing Multi-View Constraints for Identity-Consistent Video Generation
- 2024VideoMV: Consistent Multi-View Generation Based on Large Video Generative Model
- 2025UI2V-Bench: An Understanding-based Image-to-video Generation Benchmark
- 2025Dynamic-I2V: Exploring Image-to-Video Generation Models via Multimodal LLM
- 2026KeyFrame-Compass: Towards Comprehensive Evaluation of Keyframe-Conditioned Video Generation
- 2026ReImagine: Rethinking Controllable High-Quality Human Video Generation via Image-First Synthesis
- 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Models
- 2025Mask2DiT: Dual Mask-based Diffusion Transformer for Multi-Scene Long Video Generation