mlsanityData to 14 Oct 2026

LEARN: A Story-Driven Layout-to-Image Generation Framework for STEM Instruction

arXiv 2508.11153 ↗First posted 15 Aug 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

LEARN is a layout-aware diffusion framework designed to generate pedagogically aligned illustrations for STEM education. It leverages a curated BookCover dataset that provides narrative layouts and structured visual cues, enabling the model to depict abstract and sequential scientific concepts with strong semantic alignment. Through layout-conditioned generation, contrastive visual-semantic training, and prompt modulation, LEARN produces coherent visual sequences that support mid-to-high-level reasoning in line with Bloom's taxonomy while reducing extraneous cognitive load as emphasized by Cognitive Load Theory. By fostering spatially organized and story-driven narratives, the framework counters fragmented attention often induced by short-form media and promotes sustained conceptual focus. Beyond static diagrams, LEARN demonstrates potential for integration with multimodal systems and curriculum-linked knowledge graphs to create adaptive, exploratory educational content. As the first generative approach to unify layout-based storytelling, semantic structure learning, and cognitive scaffolding, LEARN represents a novel direction for generative AI in education. The code and dataset will be released to facilitate future research and practical deployment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 25 references that are in the map. First posted on arXiv 15 Aug 2025.

Builds on

15 of 25 references.

References · 15

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  4. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  5. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  6. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  7. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
  8. 2021Image Segmentation Using Text and Image Promptscited by 512
  9. 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 259
  10. 2019Object-driven Text-to-Image Synthesis via Adversarial Trainingcited by 117
  11. 2018Inferring Semantic Layout for Hierarchical Text-to-Image Synthesiscited by 101
  12. 2017CM-GANs: Cross-modal Generative Adversarial Networks for Common Representation Learningcited by 27
3 more
  1. 2022DreamArtist++: Controllable One-Shot Text-to-Image Generation via Positive-Negative Adaptercited by 24
  2. 2024Zero-Painter: Training-Free Layout Control for Text-to-Image Synthesiscited by 9
  3. 2024Rethinking The Training And Evaluation of Rich-Context Layout-to-Image Generationcited by 8

Built on by

Not cited yet.