HarmoView: Harmonizing Multi-View Constraints for Identity-Consistent Video Generation
Not on the map. Why?
Abstract (arXiv)
Current identity-consistent video generation methods struggle to preserve appearance fidelity under large viewpoint changes. While introducing multi-view reference input offers a natural solution, progress remains constrained by the lack of effective frameworks for multi-view inputs and the scarcity of multi-view data. We address these challenges by proposing HarmoView, a robust framework for identity-consistent video generation that effectively integrates multi-view cues through three architectural refinements complemented by a staged training curriculum. Specifically, we first introduce Multi-level Feature Injection to anchor identity fidelity; by injecting raw ViT features from frontal references alongside text tokens via cross-attention, MFI provides persistent low-level appearance anchors that complement the high-level identity features within DiT blocks, leading to enhanced identity preservation. Then, we employ learnable proxy tokens to unify heterogeneous reference layouts across single-/multi-view settings while simultaneously resolving the reference-view mismatch problem. Jump-RoPE is further developed for identity-wise feature isolation to reduce identity crosstalk. To activate these structural capabilities while preserving the original generative priors, we propose the Progressive View Curriculum. This four-stage training strategy employs view dropout to facilitate a stable transition from vanilla T2V generation to high-fidelity, identity-persistent spatial reasoning. Furthermore, we construct a large-scale multi-view dataset to address the issue of data scarcity. Extensive evaluation on our multi-view benchmark, comprising 100 manually-curated cases spanning 52 unique identities, demonstrates that HarmoView significantly outperforms open-source baselines and matches leading closed-source engines, achieving state-of-the-art performance in identity-consistent video generation.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 25 references that are in the map. First posted on arXiv 9 Jun 2026.
Builds on
20 of 25 references.
References · 20
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2017NIMA: Neural Image Assessmentcited by 387
- 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 127
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
- 2024Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformercited by 121
- 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 84
- 2025FantasyTalking: Realistic Talking Portrait Generation via Coherent Motion Synthesiscited by 77
- 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
- 2025HuMo: Human-Centric Video Generation via Collaborative Multi-Modal Conditioningcited by 44
8 more
- 2024MeGA: Hybrid Mesh-Gaussian Head Avatar for High-Fidelity Rendering and Head Editingcited by 37
- 2024MVGenMaster: Scaling Multi-View Generation from Any Image via 3D Priors Enhanced Diffusion Modelcited by 31
- 2025Hallo4: High-Fidelity Dynamic Portrait Animation via Direct Preference Optimizationcited by 16
- 2025Kaleido: Open-Sourced Multi-Subject Reference Video Generation Modelcited by 16
- 2026RefAlign: Representation Alignment for Reference-to-Video Generationcited by 10
- 2026MV-S2V: Multi-View Subject-Consistent Video Generationcited by 9
- 2024Bootstrap3D: Improving Multi-view Diffusion Model with Synthetic Datacited by 5
- 2025CausNVS: Autoregressive Multi-view Diffusion for Flexible 3D Novel View Synthesiscited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026ARGUS: Stacked Multi-View Identity Mosaic Injection for Subject-Preserving Video Generation
- 2026ConsID-Gen: View-Consistent and Identity-Preserving Image-to-Video Generation
- 2025Identity-Preserving Text-to-Video Generation via Training-Free Prompt, Image, and Guidance Enhancement
- 2025PolyVivid: Vivid Multi-Subject Video Generation with Cross-Modal Interaction and Enhancement
- 2026GroupVideo: Multi-Identity Customized Text-to-Video Generation
- 2025MagicMirror: ID-Preserved Video Generation in Video Diffusion Transformers
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decomposition
- 2026TIGER: Taming Identity, Geometry, and Generative Priors for High-Quality Face Video Restoration