mlsanityData to 7 Oct 2026

Identity-Preserving Text-to-Video Generation via Agentic Enhancement and Semantic Repair

arXiv 2608.20749 ↗First posted 21 Aug 2026cs.CVcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Identity-preserving video generation aims to synthesize videos that follow natural-language instructions while maintaining the visual identity of a given subject. Recent commercial video generation models have achieved strong visual quality and motion realism, but they still suffer from identity drift, incomplete instruction following, and missing visual details under complex prompts. Since these models are usually closed-source black boxes, directly improving them through parameter optimization is often infeasible. We therefore propose Agentic Enhancement and Semantic Repair (AESR), a lightweight enhancement framework for identity-preserving video generation. To improve prompt construction before generation and mitigate the above failures, AESR introduces a global agentic prompt enhancement module. This module learns model-specific prompting formats from official documentation, acquires human-centered video generation priors from human-interaction data, and accumulates test-domain identity-preserving generation experience into a reusable playbook through an agentic loop. To further repair errors in videos generated with enhanced prompts, AESR introduces a sample-level visual semantic repair module, which uses a VLM to locate erroneous video segments and design repair instructions, edits selected frames into explicit visual references, and guides a video editing model to fix local semantic or identity-related errors. We also adopt a lightweight Mixture-of-Experts selection strategy to choose reliable outputs from different generation and refinement paths. Under the official evaluation protocol of the ACM MM 2026 Identity-Preserving Video Generation Challenge, our system MIPLVideo ranked first in Track 1, demonstrating the effectiveness of AESR for practical identity-preserving video generation. The code is available at https://github.com/oceanflowlab/AESR.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 22 of its 37 references that are in the map. First posted on arXiv 21 Aug 2026.

Builds on

22 of 37 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026Taming I2V models for Image HOI Editing: A Cognitive Benchmark and Agentic Self-Correcting Framework17 Jun

Other references · 21

  1. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  2. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  3. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  4. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  5. 2025VACE: All-in-One Video Creation and Editingcited by 467
  6. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
  7. 2020CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognitioncited by 320
  8. 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 213
  9. 2024GME: Improving Universal Multimodal Retrieval by Multimodal LLMscited by 166
  10. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 142
  11. 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
  12. 2025ACE++: Instruction-Based Image Creation and Editing via Context-Aware Content Fillingcited by 95
9 more
  1. 2024MotionBooth: Motion-Aware Customized Text-to-Video Generationcited by 92
  2. 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjectscited by 76
  3. 2024EvaGaussians: Event Stream Assisted Gaussian Splatting from Blurry Imagescited by 56
  4. 2024MagicTime: Time-lapse Video Generation Models as Metamorphic Simulatorscited by 51
  5. 2024Cycle3D: High-quality and Consistent Image-to-3D Generation via Generation-Reconstruction Cyclecited by 36
  6. 2025Movie Weaver: Tuning-Free Multi-Concept Video Personalization with Anchored Promptscited by 28
  7. 2025ConMo: Controllable Motion Disentanglement and Recomposition for Zero-Shot Motion Transfercited by 12
  8. 2025Identity-Preserving Text-to-Video Generation via Training-Free Prompt, Image, and Guidance Enhancementcited by 8
  9. 2026Music-to-Dance Generation via Atomic Movementscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Trial-and-Error: Agentic Optimization for Image-to-Video Adherence
  2. 2025ID-Crafter: VLM-Grounded Online RL for Compositional Multi-Subject Video Generation
  3. 2025VISTA: A Test-Time Self-Improving Video Generation Agent
  4. 2026VideoGen-Agent: Reinforcing Video Generation Agents
  5. 2025AlcheMinT: Fine-grained Temporal Control for Multi-Reference Consistent Video Generation
  6. 2024GenMAC: Compositional Text-to-Video Generation with Multi-Agent Collaboration
  7. 2024Self-Correcting Text-to-Video Generation with Misalignment Detection and Localized Refinement
  8. 2026MLLM-Guided Semantic Correction for Text-to-Video Generation