mlsanityData to 14 Oct 2026

Vorch-IR: Long-Form Unified Multimodal Identity Replacement Video Generation

arXiv 2608.05648 ↗First posted 6 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Video identity replacement seeks to transfer the identities of one or more subjects while preserving the motion, expressions, and temporal structure of a driving video. Existing methods largely target single-person settings and often require task-specific structural controls, such as masks or pose representations, limiting their flexibility in general multimodal editing systems. Progress on multi-person replacement is further constrained by the scarcity of paired training data. We present Vorch-IR, a unified framework that supports single- and dual-person identity replacement, with optional background replacement, in a single model. Built on LTX2, Vorch-IR jointly conditions on a driving video, indexed reference images, and a textual editing instruction. The reference images need not match the pose, layout, or spatial configuration of the driving video: their roles as subject or background references are specified through the instruction. Dense visual conditions are fused through self-attention, while a vision-language context establishes semantic correspondence through cross-attention. We further develop an automatic data construction pipeline that synthesizes paired supervision for all four editing settings. Experiments using automatic metrics and pairwise human evaluation demonstrate strong identity preservation, motion fidelity, and temporal coherence across diverse scenarios. A temporal overlapping inference strategy additionally extends the short-clip model to minute-long generation without autoregressive continuation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 29 references that are in the map. First posted on arXiv 6 Aug 2026.

Builds on

26 of 29 references.

References · 26

  1. 2022Flow Matching for Generative Modelingcited by 5,702
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  3. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  4. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  5. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  6. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
  7. 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
  8. 2025VACE: All-in-One Video Creation and Editingcited by 479
  9. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
  10. 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
  11. 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 233
  12. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
14 more
  1. 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 87
  2. 2025Wan-Animate: Unified Character Animation and Replacement with Holistic Replicationcited by 80
  3. 2025Animate Anyone 2: High-Fidelity Character Image Animation with Environment Affordancecited by 61
  4. 2025UniAnimate-DiT: Human Image Animation with Large-Scale Video Diffusion Transformercited by 42
  5. 2025Taming Teacher Forcing for Masked Autoregressive Video Generationcited by 30
  6. 2025SkyReels-Audio: Omni Audio-Conditioned Talking Portraits in Video Diffusion Transformerscited by 14
  7. 2025SCAIL: Towards Studio-Grade Character Animation via In-Context Learning of 3D-Consistent Pose Representationscited by 13
  8. 2025SteadyDancer: Harmonized and Coherent Human Image Animation with First-Frame Preservationcited by 10
  9. 2025One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfercited by 9
  10. 2026SCAIL-2: Unifying Controlled Character Animation with End-to-End In-Context Conditioningcited by 8
  11. 2026MoCha:End-to-End Video Character Replacement without Structural Guidancecited by 6
  12. 2026MultiAnimate: Pose-Guided Image Animation Made Extensiblecited by 6
  13. 2026DreamActor-M2: Universal Character Image Animation via Spatiotemporal In-Context Learningcited by 5
  14. 2025Consistent and Controllable Image Animation with Motion Linear Diffusion Transformerscited by 3

Built on by

Not cited yet.