HECTOR: Hybrid Editable Compositional Object References for Video Generation
Not on the map. Why?
Abstract (arXiv)
Real-world videos naturally portray complex interactions among distinct physical objects, effectively forming dynamic compositions of visual elements. However, most current video generation models synthesize scenes holistically and therefore lack mechanisms for explicit compositional manipulation. To address this limitation, we propose HECTOR, a generative pipeline that enables fine-grained compositional control. In contrast to prior methods,HECTOR supports hybrid reference conditioning, allowing generation to be simultaneously guided by static images and/or dynamic videos. Moreover, users can explicitly specify the trajectory of each referenced element, precisely controlling its location, scale, and speed (see Figure1). This design allows the model to synthesize coherent videos that satisfy complex spatiotemporal constraints while preserving high-fidelity adherence to references. Extensive experiments demonstrate that HECTOR achieves superior visual quality, stronger reference preservation, and improved motion controllability compared with existing approaches.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 46 references that are in the map. First posted on arXiv 9 Mar 2026.
Builds on
42 of 46 references.
References · 42
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
30 more
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
- 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 350
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 251
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 247
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 188
- 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 178
- 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 164
- 2024DragAnything: Motion Control for Anything using Entity Representationcited by 159
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
- 2024MotionBooth: Motion-Aware Customized Text-to-Video Generationcited by 93
- 2023TrailBlazer: Trajectory Control for Diffusion-Based Video Generationcited by 91
- 2023VideoControlNet: A Motion-Guided Video-to-Video Translation Framework by Using Diffusion Model with ControlNetcited by 83
- 2025MotionStream: Real-Time Video Generation with Interactive Motion Controlscited by 76
- 2023I2V-Adapter: A General Image-to-Video Adapter for Diffusion Modelscited by 70
- 2023Directed Diffusion: Direct Control of Object Placement through Attention Guidancecited by 69
- 2024SG-I2V: Self-Guided Trajectory Control in Image-to-Video Generationcited by 68
- 2025ConceptMaster: Multi-Concept Video Customization on Diffusion Transformer Models Without Test-Time Tuningcited by 68
- 2024CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilitiescited by 60
- 2025Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidancecited by 45
- 2024DreamVideo-2: Zero-Shot Subject-Driven Video Customization with Precise Motion Controlcited by 43
- 2025ATI: Any Trajectory Instruction for Controllable Video Generationcited by 43
- 2025StoryMem: Multi-shot Long Video Storytelling with Memorycited by 40
- 2023AnimateZero: Video Diffusion Models are Zero-Shot Image Animatorscited by 19
- 2025CINEMA: Coherent Multi-Subject Video Generation via MLLM-Based Guidancecited by 19
- 2025WorldWeaver: Generating Long-Horizon Video Worlds via Rich Perceptioncited by 16
- 2025Tora2: Motion and Appearance Customized Diffusion Transformer for Multi-Entity Video Generationcited by 12
- 2023MotionZero:Exploiting Motion Priors for Zero-shot Text-to-Video Generationcited by 7
- 2025The World is Your Canvas: Painting Promptable Events with Reference Images, Trajectories, and Textcited by 7
- 2025TGT: Text-Grounded Trajectories for Locally Controlled Video Generationcited by 3
Built on by
Not cited yet.