SciEducator: Scientific Video Understanding and Educating via Deming-Cycle Multi-Agent System
On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs
also in 1 more
Abstract (arXiv)
Recent advancements in multimodal large language models (MLLMs) and video agent systems have significantly improved general video understanding. However, when applied to scientific video understanding and educating, a domain that demands external professional knowledge integration and rigorous step-wise reasoning, existing approaches often struggle. To bridge this gap, we propose SciEducator, the first iterative self-evolving multi-agent system for scientific video comprehension and education. Rooted in the classical Deming Cycle from management science, our design reformulates its Plan-Do-Study-Act philosophy into a self-evolving reasoning and feedback mechanism, which facilitates the interpretation of intricate scientific activities in videos. Moreover, SciEducator can produce multimodal educational content tailored to specific scientific processes, including textual instructions, visual guides, audio narrations, and interactive references. To support evaluation, we construct SciVBench, a benchmark consisting of 500 expert-verified and literature-grounded science QA pairs across five categories, covering physical, chemical, and everyday phenomena. Extensive experiments demonstrate that SciEducator substantially outperforms leading closed-source MLLMs (e.g., Gemini, GPT-4o) and state-of-the-art video agents on the benchmark, establishing a new paradigm for the community.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 37 of its 62 references that are in the map. First posted on arXiv 22 Nov 2025.
Builds on
37 of 62 references.
Closest ancestors · 2
Same direction, newest first
- 2024TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuning25 Oct
- 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding18 Mar
Other references · 35
- 2024GPT-4o System Cardcited by 4,588
- 2023Qwen Technical Reportcited by 3,344
- 2023A Survey of Large Language Modelscited by 2,576
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 771
- 2025LLMs Get Lost In Multi-Turn Conversationcited by 429
- 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agentcited by 332
- 2024InternVideo2: Scaling Foundation Models for Multimodal Video Understandingcited by 317
- 2023VTimeLLM: Empower LLM to Grasp Video Momentscited by 255
- 2024SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Modelscited by 125
- 2022Gait Recognition in the Wild with Dense 3D Representations and A Benchmarkcited by 114
- 2023AssistGPT: A General Multi-modal Assistant that can Plan, Execute, Inspect, and Learncited by 97
23 more
- 2023Cognitive Mirage: A Review of Hallucinations in Large Language Modelscited by 84
- 2025Paper2Poster: Towards Multimodal Poster Automation from Scientific Paperscited by 63
- 2024DoraemonGPT: Toward Understanding Dynamic Scenes with Large Language Models (Exemplified as A Video Agent)cited by 58
- 2022Multi-Modal Cross-Domain Alignment Network for Video Moment Retrievalcited by 43
- 2023You Can Ground Earlier than See: An Effective and Efficient Pipeline for Temporal Sentence Grounding in Compressed Videoscited by 41
- 2022Hierarchical Local-Global Transformer for Temporal Sentence Groundingcited by 38
- 2025VideoAgent2: Enhancing the LLM-Based Agent System for Long-Form Video Understanding by Uncertainty-Aware CoTcited by 38
- 2023Parsing is All You Need for Accurate Gait Recognition in the Wildcited by 32
- 2020Unbalanced Incomplete Multi-view Clustering via the Scheme of View Evolution: Weak Views are Meat; Strong Views do Eatcited by 30
- 2020Double Self-weighted Multi-view Clustering via Adaptive View Fusioncited by 23
- 2024Your Data Is Not Perfect: Towards Cross-Domain Out-of-Distribution Detection in Class-Imbalanced Datacited by 21
- 2025Multi-Agent System for Comprehensive Soccer Understandingcited by 18
- 2024Multi-Pair Temporal Sentence Grounding via Multi-Thread Knowledge Transfer Networkcited by 15
- 2025Cross-environment Cooperation Enables Zero-shot Multi-agent Coordinationcited by 14
- 2025To Align or Not to Align: Strategic Multimodal Representation Alignment for Optimal Performancecited by 14
- 2025PVChat: Personalized Video Chat with One-Shot Learningcited by 13
- 2024Uncertainty-Guided Appearance-Motion Association Network for Out-of-Distribution Action Detectioncited by 12
- 2025CompTrack: Information Bottleneck-Guided Low-Rank Dynamic Token Compression for Point Cloud Trackingcited by 9
- 2024Adaptive Hierarchical Graph Cut for Multi-granularity Out-of-distribution Detectioncited by 8
- 2025Adaptive Multi-prompt Contrastive Network for Few-shot Out-of-distribution Detectioncited by 8
- 2025SCOUT: Teaching Pre-trained Language Models to Enhance Reasoning via Flow Chain-of-Thoughtcited by 7
- 2025Breach in the Shield: Unveiling the Vulnerabilities of Large Language Modelscited by 4
- 2023ColonNeRF: High-Fidelity Neural Reconstruction of Long Colonoscopycited by 2
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026One Sentence, One Drama: Personalized Short-Form Drama Generation via Multi-Agent Systemscited by 6
- 20264DPC2hat: Towards Dynamic Point Cloud Understanding with Failure-Aware Bootstrappingcited by 5
- 2026AV-GRPO: Modality-Anchored Decoupling Diffusion Reinforcement Learning for Joint Audio-Video Generationcited by 0
- 2026Agentic Video Understanding: A Surveycited by 0
- 2026AV-GRPO: Modality-Anchored Decoupling Diffusion Reinforcement Learning for Joint Audio-Video Generation24 Sep 2026
- 2026Agentic Video Understanding: A Survey21 Sep 2026
- 2026One Sentence, One Drama: Personalized Short-Form Drama Generation via Multi-Agent Systems21 May 2026
- 20264DPC2hat: Towards Dynamic Point Cloud Understanding with Failure-Aware Bootstrapping3 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025SciVideoBench: Benchmarking Scientific Video Reasoning in Large Multimodal Models
- 2026Beyond End-to-End Video Models: An LLM-Based Multi-Agent System for Educational Video Generation
- 2026Sci-VBench: Evaluating Knowledge- and Reasoning-Intensive Video Generation in Science Domains
- 2026Can Multimodal LLMs See Science Instruction? Benchmarking Pedagogical Reasoning in K-12 Classroom Videos
- 2026PhysicsSolutionAgent: Towards Multimodal Explanations for Numerical Physics Problem Solving
- 2026SciVQR: A Multidisciplinary Multimodal Benchmark for Advanced Scientific Reasoning Evaluation
- 2026VideoResearcher: Self-Improving Tool Design for Long-Video Understanding
- 2025Stealing Creator's Workflow: A Creator-Inspired Agentic Framework with Iterative Feedback Loop for Improved Scientific Short-form Generation