Paper ID: 2310.11655

Field-testing items using artificial intelligence: Natural language processing with transformers

Hotaka Maeda

Five thousand variations of the RoBERTa model, an artificially intelligent "transformer" that can understand text language, completed an English literacy exam with 29 multiple-choice questions. Data were used to calculate the psychometric properties of the items, which showed some degree of agreement to those obtained from human examinee data.

Submitted: Oct 18, 2023