Matteucci, Mariagiulia ; Veldkamp, P. Bernard
(2011)
On the use of MCMC CAT with empirical prior information to improve the efficiency of CAT.
[Preprint]
Full text available as:
Abstract
In this paper, empirical prior information about the candidate is applied in computerized adaptive testing (CAT). The main objective of CAT is to improve efficiency of test administration. In this paper, it is shown how the inclusion of background variables both in the initialization and the ability estimation is able to improve the accuracy of ability estimates. In particular, a Gibbs sampler scheme is proposed in the phases of interim and final ability estimation. By using both simulated and real data, it is demonstrated that the method produces more accurate ability estimates, especially for short tests and when reproducing boundary abilities. This implies that operational problems of CAT related to weak measurement precision under particular conditions, can be reduced as well. In the empirical example, the methods were applied to CAT for intelligence testing in the area of personnel selection. Other promising applications would be in the medical world, where testing efficiency is of paramount importance as well.
Abstract
In this paper, empirical prior information about the candidate is applied in computerized adaptive testing (CAT). The main objective of CAT is to improve efficiency of test administration. In this paper, it is shown how the inclusion of background variables both in the initialization and the ability estimation is able to improve the accuracy of ability estimates. In particular, a Gibbs sampler scheme is proposed in the phases of interim and final ability estimation. By using both simulated and real data, it is demonstrated that the method produces more accurate ability estimates, especially for short tests and when reproducing boundary abilities. This implies that operational problems of CAT related to weak measurement precision under particular conditions, can be reduced as well. In the empirical example, the methods were applied to CAT for intelligence testing in the area of personnel selection. Other promising applications would be in the medical world, where testing efficiency is of paramount importance as well.
Document type
Preprint
Creators
Subjects
DOI
Deposit date
20 Sep 2011 15:47
Last modified
08 Nov 2011 09:58
URI
Other metadata
Document type
Preprint
Creators
Subjects
DOI
Deposit date
20 Sep 2011 15:47
Last modified
08 Nov 2011 09:58
URI
This work may be freely consulted and used, may be reproduced on a permanent basis in a digital format (i.e. saving) and can be printed on paper with own personal equipment (without availing of third -parties services), for strictly and exclusively personal, research or teaching purposes, with express exclusion of any direct or indirect commercial use, unless otherwise expressly agreed between the user and the author or the right holder. It is also allowed, for the same purposes mentioned above, the retransmission via telecommunication network, the distribution or sending in any form of the work, including the personal redirection (e-mail), provided it is always clearly indicated the complete link to the page of the Alma DL Site in which the work is displayed. All other rights are reserved.
Downloads
Downloads
Staff only: