Vidmento: Creating Video Stories Through Context-Aware Expansion With Generative Video
Not on the map. Why?
Abstract (arXiv)
Video storytelling is often constrained by available material, limiting creative expression and leaving undesired narrative gaps. Generative video offers a new way to address these limitations by augmenting captured media with tailored visuals. To explore this potential, we interviewed eight video creators to identify opportunities and challenges in integrating generative video into their workflows. Building on these insights and established filmmaking principles, we developed Vidmento, a tool for authoring hybrid video stories that combine captured and generated media through context-aware expansion. Vidmento surfaces opportunities for story development, generates clips that blend stylistically and narratively with surrounding media, and provides controls for refinement. In a study with 12 creators, Vidmento supported narrative development and exploration by systematically expanding initial materials with generative media, enabling expressive video storytelling aligned with creative intent. We highlight how creators bridge story gaps with generative content and where they find this blending capability most valuable.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 51 of its 118 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
51 of 118 references.
References · 51
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
- 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
- 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 245
- 2022Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionalscited by 191
- 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 176
- 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 124
- 2024A Design Space for Intelligent and Interactive Writing Assistantscited by 76
- 2023Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Modelscited by 67
- 2024Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language Modelscited by 51
- 2023MindfulDiary: Harnessing Large Language Model to Support Psychiatric Patients' Journalingcited by 50
- 2023Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Modelscited by 48
38 more
- 2024LAVE: LLM-Powered Agent Assistance and Language Augmentation for Video Editingcited by 47
- 2023VISAR: A Human-AI Argumentative Writing Assistant with Visual Programming and Rapid Draft Prototypingcited by 46
- 2025Personalized Generation In Large Model Era: A Surveycited by 45
- 2024AnimateLCM: Computation-Efficient Personalized Style Video Generation without Personalized Video Datacited by 42
- 2020Video Generative Adversarial Networks: A Reviewcited by 33
- 2025FilmAgent: A Multi-Agent Framework for End-to-End Film Automation in Virtual 3D Spacescited by 28
- 2025Generative and Malleable User Interfaces with Generative and Evolving Task-Driven Data Modelcited by 24
- 2024Patchview: LLM-Powered Worldbuilding with Generative Dust and Magnet Visualizationcited by 23
- 2024Understanding Nonlinear Collaboration between Human and AI Agents: A Co-design Framework for Creative Designcited by 22
- 2023Improving Pacing in Long-Form Story Planningcited by 21
- 2023Beyond Prompts: Exploring the Design Space of Mixed-Initiative Co-Creativity Systemscited by 20
- 2023AVscript: Accessible Video Editing with Audio-Visual Scriptscited by 19
- 2023ReelFramer: Human-AI Co-Creation for News-to-Video Translationcited by 19
- 2024GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agencycited by 18
- 2025VideoAuteur: Towards Long Narrative Video Generationcited by 17
- 2025EditDuet: A Multi-Agent System for Video Non-Linear Editingcited by 16
- 2025VFX Creator: Animated Visual Effect Generation with Controllable Diffusion Transformercited by 15
- 2024ExpressEdit: Video Editing with Natural Language and Sketchingcited by 14
- 2024Exploring AIGC Video Quality: A Focus on Visual Harmony, Video-Text Consistency and Domain Distribution Gapcited by 13
- 2023PodReels: Human-AI Co-Creation of Video Podcast Teaserscited by 12
- 2025Script&Shift: A Layered Interface Paradigm for Integrating Content Development and Rhetorical Strategy with LLM Writing Assistantscited by 11
- 2024Visual Story-Writing: Writing by Manipulating Visual Representations of Storiescited by 10
- 2024Future You: A Conversation with an AI-Generated Future Self Reduces Anxiety, Negative Emotions, and Increases Future Self-Continuitycited by 9
- 2025VideoDiff: Human-AI Video Co-Creation with Alternativescited by 8
- 2024Synthetic Human Memories: AI-Edited Images and Videos Can Implant False Memories and Distort Recollectioncited by 7
- 2025Malleable Overview-Detail Interfacescited by 7
- 2025Toyteller: AI-powered Visual Storytelling Through Toy-Playing with Character Symbolscited by 6
- 2025Lotus: Creating Short Videos From Long Videos With Abstractive and Extractive Summarizationcited by 6
- 2025Compositional Structures as Substrates for Human-AI Co-creation Environment: A Design Approach and A Case Studycited by 6
- 2025Exploring the Potential of Metacognitive Support Agents for Human-AI Co-Creationcited by 6
- 2022VideoMap: Supporting Video Editing Exploration, Brainstorming, and Prototyping in the Latent Spacecited by 4
- 2023Understanding Generative AI in Art: An Interview Study with Artists on G-AI from an HCI Perspectivecited by 4
- 2025Human-Centered AI Communication in Co-Creativity: An Initial Framework and Insightscited by 3
- 2025Reimagining Personal Data: Unlocking the Potential of AI-Generated Images in Personal Data Meaning-Makingcited by 2
- 2025Facilitating Video Story Interaction with Multi-Agent Collaborative Systemcited by 2
- 2025NoRe: Augmenting Journaling Experience with Generative AI for Music Creationcited by 2
- 2025Generating, Fast and Slow: Scalable Parallel Video Generation with Video Interface Networkscited by 1
- 2025Resonance: Drawing from Memories to Imagine Positive Futures through AI-Augmented Journalingcited by 1
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.