# Field-testing items using artificial intelligence: Natural language processing with transformers

arXiv: https://arxiv.org/abs/2310.11655 · HTML: https://mlsanity.com/paper/2310.11655/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 1 of its 4 references that are in the map.
- First posted on arXiv 18 Oct 2023.

## Builds on (most cited first, 1 of 1)

- [RoBERTa: A Robustly Optimized BERT Pretraining Approach](https://mlsanity.com/paper/1907.11692/) (2019)

## Abstract (arXiv)

Five thousand variations of the RoBERTa model, an artificially intelligent "transformer" that can understand text language, completed an English literacy exam with 29 multiple-choice questions. Data were used to calculate the psychometric properties of the items, which showed some degree of agreement to those obtained from human examinee data.