VI-Bench: Benchmarking Prompt Inversion from AIGC Videos
Not on the map. Why?
Abstract (arXiv)
Recent advances in video generation have made prompt-based control increasingly central to AIGC video generation. Prompts specify what a video should depict and how it should be represented, controlling factors such as visual style or camera behavior. Understanding this recoverability is important both for creative reuse and editing, and for assessing prompt leakage risks. However, existing video understanding benchmarks do not measure this capability: a caption may describe what is visible, but a replayable prompt must recover the generation-relevant controls needed to reproduce the video. To address this gap, we introduce VI-Bench, a benchmark built from 16.1 million real-user prompts and 900 human-verified AIGC videos. VI-Bench spans three progressively harder settings, namely single-shot semantic grounding, control over style and camera behavior, and multi-shot compositional inversion, and evaluates five generation-critical dimensions: subject, action, scene, style, and camera. We evaluate 18 representative VLMs, including 2 proprietary and 16 open-source models on VI-Bench, using an Inversion Score that measures prompt-level alignment with the original prompt and video-level fidelity of the regenerated video. The results reveal substantial limitations: even the strongest model achieves only 0.632 on Inversion Score, performance degrades sharply as samples require richer control and multi-shot reasoning, and models often produce plausible prompts whose regenerated videos deviate from the reference. These findings show that video prompt inversion is a distinct and under-evaluated capability requiring models to transform visual understanding into replay-stable generative control.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 32 references that are in the map. First posted on arXiv 8 Sep 2026.
Builds on
24 of 32 references.
References · 24
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
- 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 779
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 644
- 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
- 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 163
12 more
- 2024VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Modelscited by 124
- 2024MIMO: Controllable Character Video Synthesis with Spatial Decomposed Modelingcited by 63
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 56
- 2023Prompt Stealing Attacks Against Text-to-Image Generation Modelscited by 48
- 2026Video-MME-v2: Towards the Next Stage in Benchmarks for Comprehensive Video Understandingcited by 46
- 2025MotionPro: A Precise Motion Controller for Image-to-Video Generationcited by 29
- 2025VidCapBench: A Comprehensive Benchmark of Video Captioning for Controllable Text-to-Video Generationcited by 22
- 2025Uniform Discrete Diffusion with Metric Path for Video Generationcited by 11
- 2025Visually Guided Decoding: Gradient-Free Hard Prompt Inversion with Language Modelscited by 10
- 2024TIP-I2V: A Million-Scale Real Text and Image Prompt Dataset for Image-to-Video Generationcited by 9
- 2025Vulnerability of Text-to-Image Models to Prompt Template Stealing: A Differential Evolution Approachcited by 5
- 2025Reverse Prompt: Cracking the Recipe Inside Text-to-Image Generationcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Stable Cinemetrics : Structured Taxonomy and Evaluation for Professional Video Generation
- 2026VGA-BenchV2: An Expanded Unified Benchmark and Multi-Model Framework for Evaluating Video Aesthetics and Generation Quality
- 2025Video-Bench: Human-Aligned Video Generation Benchmark
- 2025Video-As-Prompt: Unified Semantic Control for Video Generation
- 2025VMBench: A Benchmark for Perception-Aligned Video Motion Generation
- 2025ImagerySearch: Adaptive Test-Time Search for Video Generation Beyond Semantic Dependency Constraints
- 2026EvoState: Closed-Loop Visual State Management for Long-Form Video Generation
- 2026KeyFrame-Compass: Towards Comprehensive Evaluation of Keyframe-Conditioned Video Generation