文章基本信息

标题：Development and Evaluation of a Confidence-Weighting Computerized Adaptive Testing
本地全文：下载
作者：Yung-Chin Yen ; Rong-Guey Ho ; Li-Ju Chen 等
期刊名称：Educational Technology and Society
印刷版ISSN：1176-3647
电子版ISSN：1436-4522
出版年度：2010
卷号：13
期号：03
页码：163-163–176
出版社：IFETS - Attn Kinshuck
摘要：ABSTRACT: The purpose of this study was to examine whether the efficiency, precision, and validity of computerized adaptive testing (CAT) could be improved by assessing confidence differences in knowledge that examinees possessed. We proposed a novel polytomous CAT model called the confidence-weighting computerized adaptive testing (CWCAT), which combined a confidence-weighting scoring scheme with the graded response model (GRM). The CWCAT provided a more interactive testing environment by focusing on the examinees’ confidence in their responses. An experiment was conducted to evaluate the comparison between the CWCAT and conventional CAT in terms of efficiency, precision, and validity. As expected, the polytomous method provided better discrimination among individual differences in the confidence in knowledge and required fewer items per examinee. Results also showed that CWCAT yielded ability estimates that were higher and better correlated to examinees’ performance in English learning. Furthermore, the ability measured by CWCAT was not as likely to be affected by guessing as on conventional CAT, and, therefore, was more consisted with examinees’ true ability.
关键词：Keywords: Confidence-weighting, Guessing, Computerized adaptive testing, Graded response model