mlsanityData to 14 Oct 2026

Helping Figures Tell their Story! Paper-Grounded Video Generation Explaining Complex Scientific Figures

arXiv 2606.12576 ↗First posted 10 Jun 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Scientific figures compress complex pipelines into a single canvas, yet understanding them requires paper-grounded, step-by-step narration aligned with visual highlights a capability missing from current video generation systems and benchmarks. To address this, we introduce paper-grounded figure-to-video generation: generating narrated, region-grounded walkthrough videos from a figure and its paper. We propose MINARD (Multimodal Interpretation of Narrated Architecture via Region Decomposition), a pipeline that generates paper-grounded narrations and sequentially grounds them to figure regions. We also release FigTalk, a benchmark with new sequential and component-level grounding metrics derived. On FigTalk, MINARD generates humanlike, paper-faithful narrations and outperforms narration-conditioned figure spatial grounding compared to existing approaches in both automatic and human evaluation

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 53 references that are in the map. First posted on arXiv 10 Jun 2026.

Builds on

14 of 53 references.

References · 14

  1. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  2. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  3. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
  4. 2017FigureQA: An Annotated Figure Dataset for Visual Reasoningcited by 319
  5. 2025Video models are zero-shot learners and reasonerscited by 220
  6. 2025PPTAgent: Generating and Evaluating Presentations Beyond Text-to-Slidescited by 86
  7. 2021SciCap: Generating Captions for Scientific Figurescited by 77
  8. 2021DOC2PPT: Automatic Presentation Slides Generation from Scientific Documentscited by 70
  9. 2021D2S: Document-to-Slide Generation Via Query-Based Text Summarizationcited by 50
  10. 2025Code2Video: A Code-centric Paradigm for Educational Video Generationcited by 27
  11. 2025TheoremExplainAgent: Towards Video-based Multimodal Explanations for LLM Theorem Understandingcited by 24
  12. 2025Paper2Video: Automatic Video Generation from Scientific Paperscited by 24
2 more
  1. 2023NapSS: Paragraph-level Medical Text Simplification via Narrative Prompting and Sentence-matching Summarizationcited by 13
  2. 2025What Is That Talk About? A Video-to-Text Summarization Dataset for Scientific Presentationscited by 11

Built on by

Not cited yet.