Robust Multilingual Text-to-Pictogram Mapping for Scalable Reading Rehabilitation
Not on the map. Why?
Abstract (arXiv)
Reading comprehension presents a significant challenge for children with Special Educational Needs and Disabilities (SEND), often requiring intensive one-on-one reading support. To assist therapists in scaling this support, we developed a multilingual, AI-powered interface that automatically enhances text with visual scaffolding. This system dynamically identifies key concepts and maps them to contextually relevant pictograms, supporting learners across languages. We evaluated the system across five typologically diverse languages (English, French, Italian, Spanish, and Arabic), through multilingual coverage analysis, expert clinical review by speech therapists and special education professionals, and latency assessment. Evaluation results indicate high pictogram coverage and visual scaffolding density across the five languages. Expert audits suggested that automatically selected pictograms were semantically appropriate, with combined correct and acceptable ratings exceeding 95% for the four European languages and approximately 90% for Arabic despite reduced pictogram repository coverage. System latency remained within interactive thresholds suitable for real-time educational use. These findings support the technical viability, semantic safety, and acceptability of automated multimodal scaffolding to improve accessibility for neurodiverse learners.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 4 of its 33 references that are in the map. First posted on arXiv 25 Mar 2026.
Builds on
4 of 33 references.
References · 4
- 2020Augmenting Scientific Papers with Just-in-Time, Position-Sensitive Definitions of Terms and Symbolscited by 36
- 2024Scaffolding Language Learning via Multi-modal Tutoring Systems with Pedagogical Instructionscited by 11
- 2023The Semantic Reader Project: Augmenting Scholarly Documents through AI-Powered Interactive Reading Interfacescited by 9
- 2023Gaze-Driven Sentence Simplification for Language Learners: Enhancing Comprehension and Readabilitycited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.