mlsanityData to 7 Oct 2026

ScriptViz: A Visualization Tool to Aid Scriptwriting based on a Large Movie Database

arXiv 2410.03224 ↗First posted 4 Oct 2024cs.HC cs.AI cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Scriptwriters usually rely on their mental visualization to create a vivid story by using their imagination to see, feel, and experience the scenes they are writing. Besides mental visualization, they often refer to existing images or scenes in movies and analyze the visual elements to create a certain mood or atmosphere. In this paper, we develop ScriptViz to provide external visualization based on a large movie database for the screenwriting process. It retrieves reference visuals on the fly based on scripts' text and dialogue from a large movie database. The tool provides two types of control on visual elements that enable writers to 1) see exactly what they want with fixed visual elements and 2) see variances in uncertain elements. User evaluation among 15 scriptwriters shows that ScriptViz is able to present scriptwriters with consistent yet diverse visual possibilities, aligning closely with their scripts and helping their creation.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 26 of its 62 references that are in the map. First posted on arXiv 4 Oct 2024.

Builds on

26 of 62 references.

References · 26

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  3. 2018Hierarchical Neural Story Generationcited by 1,182
  4. 2017Generative Adversarial Networks: An Overviewcited by 588
  5. 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 245
  6. 2020MovieNet: A Holistic Dataset for Movie Understandingcited by 206
  7. 2022Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionalscited by 191
  8. 2018StoryGAN: A Sequential Conditional GAN for Story Visualizationcited by 137
  9. 2022Make-A-Story: Visual Memory Conditioned Consistent Story Generationcited by 76
  10. 2024A Design Space for Intelligent and Interactive Writing Assistantscited by 76
  11. 2020MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Modelscited by 74
  12. 2022StoryDALL-E: Adapting Pretrained Text-to-Image Transformers for Story Continuationcited by 74
14 more
  1. 2023TaleCrafter: Interactive Story Visualization with Multiple Characterscited by 71
  2. 2014Narrative Planning: Balancing Plot and Charactercited by 61
  3. 2020STORIUM: A Dataset and Evaluation Platform for Machine-in-the-Loop Story Generationcited by 56
  4. 2021Enjoy Your Editing: Controllable GANs for Image Editing via Latent Space Navigationcited by 53
  5. 2021Integrating Visuospatial, Linguistic and Commonsense Structure into Story Visualizationcited by 51
  6. 2019A Graph-Based Framework to Bridge Movies and Synopsescited by 31
  7. 2023Visual Writing Prompts: Character-Grounded Story Generation with Curated Image Sequencescited by 31
  8. 2023Dynamic Storyboard Generation in an Engine-based Virtual Environment for Video Productioncited by 21
  9. 2018Person Search in Videos with One Portrait Through Visual and Temporal Linkscited by 14
  10. 2021IGA : An Intent-Guided Authoring Assistantcited by 12
  11. 2023TaleStream: Supporting Story Ideation with Trope Knowledgecited by 9
  12. 2022TeViS:Translating Text Synopses to Video Storyboardscited by 5
  13. 2023Automated Conversion of Music Videos into Lyric Videoscited by 4
  14. 2021Telling Creative Stories Using Generative Visual Aidscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 5.

6 papers.

  1. 2025Generative AI for Film Creation: A Survey of Recent Advancescited by 17
  2. 2026PrevizWhiz: Combining Rough 3D Scenes and 2D Video to Guide Generative Video Previsualizationcited by 4
  3. 2026Narrix: Remixing Narrative Strategies from Examples for Story Writingcited by 4
  4. 2026Mind-of-Director: Multi-modal Agent-Driven Film Previsualization via Collaborative Decision-Makingcited by 2
  5. 2026Watching Movies Like a Human: Egocentric Emotion Understanding for Embodied Companionscited by 0
  6. 2026VeriForge: Mitigating Latent Knowledge Gaps in Narrative Drafting via Mixed-Initiative Scaffoldingcited by 0