mlsanityData to 14 Oct 2026

MSR: Multiple Subject Reference for Video Generation

arXiv 2609.18393 ↗First posted 16 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Conditioning a video generator on multiple images requires preserving appearance while associating each reference with its intended role. We present MSR (Multiple Subject Reference), a slot-aware conditioning scheme for LTX-based video generation. Each reference image is independently encoded as a static clip and represented by a separate latent-token group. A compact Fourier-feature multilayer perceptron adds a numeric slot embedding, while slot-dependent temporal offsets modify the group's rotary coordinates. The reference groups are prepended to noisy target tokens and serve as clean context during target-only flow-matching training. We implement this scheme through low-rank adaptation and release the resulting weights and inference workflows. Qualitative examples demonstrate compositions containing distinct characters and referenced environments in realistic and stylized scenes. Development observations suggest reduced reference confusion relative to an earlier continuous-reference baseline, while similar clothing, complex garments, and viewpoint changes remain challenging. We describe the conditioning mechanism, the retained training configuration, and the observed strengths and limitations of the released system. A supplementary audio-reference experiment adds voice conditioning while keeping the visual parameters frozen.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 8 references that are in the map. First posted on arXiv 16 Sep 2026.

Builds on

8 of 8 references.

References · 8

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  3. 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
  4. 2025MAGREF: Masked Guidance for Any-Reference Video Generation with Subject Disentanglementcited by 23
  5. 2025BindWeave: Subject-Consistent Video Generation via Cross-Modal Integrationcited by 23
  6. 2025Ingredients: Blending Custom Photos with Video Diffusion Transformerscited by 13
  7. 2026ID-LoRA: Identity-Driven Audio-Video Personalization with In-Context LoRAcited by 5
  8. 2026Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignmentcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025AlcheMinT: Fine-grained Temporal Control for Multi-Reference Consistent Video Generation
  2. 2026MultiRef-Compass: Towards Comprehensive Evaluation of Multi-Reference-to-Audio-Video Generation
  3. 2026Complementary Retrieval-Augmented Prompting for Consistent Long-Form Video Generation
  4. 2026Vorch-Omni: Multi-Task Orchestration of Sight and Sound
  5. 2026Visual Jev Rewards: Reference-Bound Verification for Multi-Subject Image Generation
  6. 2026Rethinking Position Embedding as a Context Controller for Multi-Reference and Multi-Shot Video Generation
  7. 2025CINEMA: Coherent Multi-Subject Video Generation via MLLM-Based Guidance
  8. 2026Custom Forcing: Training-Free Subject Customization for Autoregressive Video Generation