mlsanityData to 14 Oct 2026

Beyond Text: Probing K-12 Educators' Perspectives and Ideas for Learning Opportunities Leveraging Multimodal Large Language Models

arXiv 2507.20720 ↗First posted 28 Jul 2025cs.HCcited by 0

On the map: Multimodal LLMs / vision-language models → MLLM training and visual instruction tuning

Abstract (arXiv)

Multimodal Large Language Models (MLLMs) are beginning to enable new user experiences from generated content across a range of media, including images, text, speech, and video. These capabilities have the potential to enrich learning by enabling users to interact with information using a variety of modalities, but little is known about how textiteducators envision how MLLMs might shape the future of learning, what challenges they encounter when using these models, and what practical needs should be considered for future implementation in educational contexts. We investigated educator perspectives through workshops with 12 K-12 educators, where participants brainstormed learning opportunities, discussed practical concerns, and prototyped MLLM learning applications using Claude 3.5 and its Artifacts feature. Through this work, we uncover how educators imagined MLLMs as a way for themselves and their students to author multimedia content, and how this could provide a pathway to support learning through iterative design. At the same time, educators anticipated challenges with younger students' ability to evaluate and refine model output to better meet their design goals. We end with implications for designing with and for MLLMs in future learning experiences.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in MLLM training and visual instruction tuning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 4 of its 54 references that are in the map. First posted on arXiv 28 Jul 2025.

Builds on

4 of 54 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Taking the Next Step with Generative Artificial Intelligence: The Transformative Role of Multimodal Large Language Models in Science Education1 Jan

Other references · 3

  1. 2023Large Language Models in Education: Vision and Opportunitiescited by 54
  2. 2025Co-designing Large Language Model Tools for Project-Based Learning with K12 Educatorscited by 5
  3. 2023Co-ML: Collaborative Machine Learning Model Building for Developing Dataset Design Practicescited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Seeing the Big Picture: Evaluating Multimodal LLMs' Ability to Interpret and Grade Handwritten Student Work
  2. 2026Impact of Multimodal and Conversational AI on Learning Outcomes and Experience
  3. 2025Large Language Models Will Change The Way Children Think About Technology And Impact Every Interaction Paradigm
  4. 2024Visualization Literacy of Multimodal Large Language Models: A Comparative Study
  5. 2025Small Models, Big Support: A Local LLM Framework for Educator-Centric Content Creation and Assessment with RAG and CAG
  6. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models
  7. 2024The Revolution of Multimodal Large Language Models: A Survey
  8. 2023A Survey on Multimodal Large Language Models