mlsanityData to 14 Oct 2026

Node-Based Editing for Multimodal Generation of Text, Audio, Image, and Video

arXiv 2511.03227 ↗First posted 5 Nov 2025cs.HC cs.AI cs.MMcited by 3

Not on the map. Why?

Abstract (arXiv)

We present a node-based storytelling system for multimodal content generation. The system represents stories as graphs of nodes that can be expanded, edited, and iteratively refined through direct user edits and natural-language prompts. Each node can integrate text, images, audio, and video, allowing creators to compose multimodal narratives. A task selection agent routes between specialized generative tasks that handle story generation, node structure reasoning, node diagram formatting, and context generation. The interface supports targeted editing of individual nodes, automatic branching for parallel storylines, and node-based iterative refinement. Our results demonstrate that node-based editing supports control over narrative structure and iterative generation of text, images, audio, and video. We report quantitative outcomes on automatic story outline generation and qualitative observations of editing workflows. Finally, we discuss current limitations such as scalability to longer narratives and consistency across multiple nodes, and outline future work toward human-in-the-loop and user-centered creative AI tools.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 9 of its 19 references that are in the map. First posted on arXiv 5 Nov 2025.

Builds on

9 of 19 references.

References · 9

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  3. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  4. 2022Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionalscited by 191
  5. 2022PromptChainer: Chaining Large Language Model Prompts through Visual Programmingcited by 134
  6. 2022StoryDALL-E: Adapting Pretrained Text-to-Image Transformers for Story Continuationcited by 74
  7. 2023AI-Generated Content (AIGC) for Various Data Modalities: A Surveycited by 25
  8. 2025ComfyUI-Copilot: An Intelligent Assistant for Automated Workflow Developmentcited by 11
  9. 2023GENEVA: GENErating and Visualizing branching narratives using LLMscited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.