Alma Mater Digital Library

Edited by Documentary and Departmental Support

cambia la lingua in italiano
AMS Acta
ISSN: 2038-7954
Contributi di ricerca dell'Alma Mater Studiorum - Università di Bologna
Informazioni sul Single Sign-On di Ateneo Login for authors

Uncertainties in the item parameter estimates and robust automated test assembly

Veldkamp, Bernard P. ; Matteucci, Mariagiulia ; de Jong, Martijn (2012) Uncertainties in the item parameter estimates and robust automated test assembly. [Preprint]

Full text disponibile come:

Available under License Creative Commons Attribution Non-commercial (CC BY-NC 3.0).



IRT parameters have to be estimated, and because of the estimation process, they do have uncertainty in them. In most large scale testing programs, the parameters are stored in item banks, and automated test assembly algorithms are applied to assemble operational test forms. These algorithms treat item parameters as fixed values, and uncertainty is not taken into account. As a consequence, resulting tests might be off target or less informative than expected. In this paper, the process of parameter estimation is described to provide insight into the causes of uncertainty in the item parameters. The consequences of uncertainty are studied. Besides, an alternative automated test assembly algorithm is presented that is robust against uncertainties in the data. Several numerical examples demonstrate the performance of the robust test assembly algorithm, and illustrate the dangers of not taking this uncertainty into account. Finally, some recommendations about the use of robust test assembly and some directions for further research are given.

Document type:Preprint
Uncontrolled Keywords:Automated test assembly, Computerized adaptive testing, Item parameter estimation, Item response theory, Robust optimization, Robust test assembly, Uncertainty.
Subjects:Area 11 - Scienze storiche, filosofiche, pedagogiche e psicologiche > M-PSI/03 Psicometria
Area 01 - Scienze matematiche e informatiche > MAT/09 Ricerca operativa
Area 13 - Scienze economiche e statistiche > SECS-S/01 Statistica
Area 13 - Scienze economiche e statistiche > SECS-S/05 Statistica sociale
Depositato da:Mariagiulia Matteucci
Depositato il:13 Mar 2012 10:20
Last modified:05 Apr 2012 11:53

Solo per lo Staff dell Archivio: Gestione del documento