Dynamic Learning Solutions: A System for Personalized Educational Video Generation
On the map: Retrieval-augmented generation → Multimodal RAG
Abstract (arXiv)
We present an automated pipeline that converts NCERT textbooks into interactive video explanations that respond directly to user queries. A user uploads a PDF and asks a question; the system then generates a video-based explanation as output, handling both text and visual elements from the PDF for multi-modal retrieval and response generation. The pipeline combines a Retrieval-Augmented Generation (RAG) model with generative multimedia components. The RAG stage is optimized for the structure of NCERT textbooks and performs best on content from those books. Given a user query, the RAG model retrieves relevant content from the PDF and generates a multi-scene script containing narrative explanations and structured visual prompts aligned with the textbook's explanatory style. These prompts are passed to a Stable Diffusion module, implemented layer by layer for interpretability and control, which generates contextually relevant images. The images are then processed by DynamiCrafter to produce animated sequences. Finally, a Google Text-to-Speech module generates synchronized narration, aligning speech with the visual scenes through time-based control. The result is a coherent video explanation integrating animation, narration, and textbook-aligned visuals, transforming static educational material into an engaging learning experience. By combining multi-modal document retrieval, generative visual models, animation frameworks, and speech synthesis, this pipeline demonstrates a scalable approach to delivering interactive, personalized digital education content.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 4 of its 11 references that are in the map. First posted on arXiv 13 Sep 2026.
Builds on
4 of 11 references.
References · 4
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
- 2017Optimizing the Latent Space of Generative Networkscited by 157
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Automatic Teaching Platform on Vision Language Retrieval Augmented Generation
- 2025ImageRAG: Dynamic Image Retrieval for Reference-Guided Image Generation
- 2025From Query to Explanation: Uni-RAG for Multi-Modal Retrieval-Augmented Learning in STEM
- 2025VideoRAG: Retrieval-Augmented Generation over Video Corpus
- 2023Animate-A-Story: Storytelling with Retrieval-Augmented Video Generation
- 2026Beyond End-to-End Video Models: An LLM-Based Multi-Agent System for Educational Video Generation
- 2025Retrieval Augmented Generation and Understanding in Vision: A Survey and New Outlook
- 2024Towards Retrieval Augmented Generation over Large Video Libraries