# GLAT: The Generative AI Literacy Assessment Test

arXiv: https://arxiv.org/abs/2411.00283 · HTML: https://mlsanity.com/paper/2411.00283/

## Key facts

- Cited by 10 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 1 Nov 2024.

## Built on by (most cited first, 10 of 10)

- [How to Assess AI Literacy: Misalignment Between Self-Reported and Objective-Based Measures](https://mlsanity.com/paper/2601.06101/) (2026)
- [The Agency Gap in AI-Supported Writing: How Reactive and Proactive Agent Designs Shape Multimodal Reasoning](https://mlsanity.com/paper/2507.04398/) (2025)
- [Understanding Critical Thinking in Generative Artificial Intelligence Use: Development, Validation, and Correlates of the Critical Thinking in AI Use Scale](https://mlsanity.com/paper/2512.12413/) (2025)
- [Framing, Judging, Steering: An Assessable Competency Model for Teach-ing Students to Reason With Generative AI](https://mlsanity.com/paper/2606.05983/) (2026)
- [A paradox of AI fluency](https://mlsanity.com/paper/2604.25905/) (2026)
- [Tracing GenAI Literacy: Uncovering Student-AI Interaction Patterns in Academic Writing through Epistemic Network Analysis](https://mlsanity.com/paper/2606.00040/) (2026)
- [The GenAI Skill Bypass: Mapping Divergent Pathways of University Students and Staff AI Literacy](https://mlsanity.com/paper/2607.05411/) (2026)
- [Rethinking Generative AI Literacy: An Integrative, Developmental, and Dialectical Framework for K-12 Teacher Education](https://mlsanity.com/paper/2608.01705/) (2026)
- [A Survey Instrument to Assess Students' AI and Generative AI Knowledge](https://mlsanity.com/paper/2608.21391/) (2026)
- [Beyond AI Literacy: A Structured Review and Exploratory Meta-Analysis of Measures for Competent Generative-AI Use](https://mlsanity.com/paper/2609.15624/) (2026)

## Abstract (arXiv)

The rapid integration of generative artificial intelligence (GenAI) technology into education necessitates precise measurement of GenAI literacy to ensure that learners and educators possess the skills to engage with and critically evaluate this transformative technology effectively. Existing instruments often rely on self-reports, which may be biased. In this study, we present the GenAI Literacy Assessment Test (GLAT), a 20-item multiple-choice instrument developed following established procedures in psychological and educational measurement. Structural validity and reliability were confirmed with responses from 355 higher education students using classical test theory and item response theory, resulting in a reliable 2-parameter logistic (2PL) model (Cronbach's alpha = 0.80; omega total = 0.81) with a robust factor structure (RMSEA = 0.03; CFI = 0.97). Critically, GLAT scores were found to be significant predictors of learners' performance in GenAI-supported tasks, outperforming self-reported measures such as perceived ChatGPT proficiency and demonstrating external validity. These results suggest that GLAT offers a reliable and valid method for assessing GenAI literacy, with the potential to inform educational practices and policy decisions that aim to enhance learners' and educators' GenAI literacy, ultimately equipping them to navigate an AI-enhanced future.