mlsanityData to 14 Oct 2026

Bridging the Digital Divide: Small Language Models as a Pathway for Physics and Photonics Education in Underdeveloped Regions

arXiv 2506.12403 ↗First posted 14 Jun 2025physics.ed-ph cs.AI cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

Limited infrastructure, scarce educational resources, and unreliable internet access often hinder physics and photonics education in underdeveloped regions. These barriers create deep inequities in Science, Technology, Engineering, and Mathematics (STEM) education. This article explores how Small Language Models (SLMs)-compact, AI-powered tools that can run offline on low-power devices, offering a scalable solution. By acting as virtual tutors, enabling native-language instruction, and supporting interactive learning, SLMs can help address the shortage of trained educators and laboratory access. By narrowing the digital divide through targeted investment in AI technologies, SLMs present a scalable and inclusive solution to advance STEM education and foster scientific empowerment in marginalized communities.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 51 of its 75 references that are in the map. First posted on arXiv 14 Jun 2025.

Builds on

51 of 75 references.

References · 51

  1. 2017Attention Is All You Needcited by 60,361
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2017Proximal Policy Optimization Algorithmscited by 15,215
  4. 2024The Llama 3 Herd of Modelscited by 14,715
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  7. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  8. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  9. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  10. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  11. 2024Qwen2.5 Technical Reportcited by 4,942
  12. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
38 more
  1. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  2. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  3. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  4. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  5. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  6. 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,346
  7. 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,135
  8. 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,090
  9. 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916
  10. 2019Fast Transformer Decoding: One Write-Head is All You Needcited by 717
  11. 2024Self-Rewarding Language Modelscited by 681
  12. 2024TinyLlama: An Open-Source Small Language Modelcited by 618
  13. 2024OLMo: Accelerating the Science of Language Modelscited by 613
  14. 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 521
  15. 2023Orca: Progressive Learning from Complex Explanation Traces of GPT-4cited by 379
  16. 2025SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Modelcited by 335
  17. 2025rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinkingcited by 313
  18. 2024A Survey on Knowledge Distillation of Large Language Modelscited by 284
  19. 2024MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Casescited by 223
  20. 2025Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scalingcited by 136
  21. 2024A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and Trustworthinesscited by 127
  22. 2023f-Divergence Minimization for Sequence-Level Knowledge Distillationcited by 114
  23. 2024Small Language Models: Survey, Measurements, and Insightscited by 112
  24. 2024ChemLLM: A Chemical Large Language Modelcited by 106
  25. 2024PowerInfer-2: Fast Large Language Model Inference on a Smartphonecited by 103
  26. 2024BioMedLM: A 2.7B Parameter Language Model Trained On Biomedical Textcited by 86
  27. 2023The MiniPile Challenge for Data-Efficient Language Modelscited by 75
  28. 2020MNN: A Universal and Efficient Inference Enginecited by 65
  29. 2023MentaLLaMA: Interpretable Mental Health Analysis on Social Media with Large Language Modelscited by 63
  30. 2024Fast On-device LLM Inference with NPUscited by 62
  31. 2023AstroLLaMA: Towards Specialized Foundation Models in Astronomycited by 41
  32. 2024SciInstruct: a Self-Reflective Instruction Annotated Dataset for Training Scientific Language Modelscited by 39
  33. 2021Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domainscited by 36
  34. 2024A Comprehensive Study on Quantization Techniques for Large Language Modelscited by 36
  35. 2025Characterizing Mobile SoC for Accelerating Heterogeneous LLM Inferencecited by 22
  36. 2023Scaling Down to Scale Up: A Cost-Benefit Analysis of Replacing OpenAI's LLM with Open Source SLMs in Productioncited by 21
  37. 2023MindLLM: Pre-training Lightweight Large Language Model from Scratch, Evaluations and Domain Applicationscited by 11
  38. 2024H2O-Danube3 Technical Reportcited by 7

50 most cited of 51 All 51 (JSON)

Built on by

Not cited yet.