文章基本信息

标题：Identifying low test-taking effort during low-stakes tests with the new Test-taking Effort Short Scale (TESS) – development and psychometrics
本地全文：下载
作者：Katrin Schüttpelz-Brauns ; Martina Kadmon ; Claudia Kiessling 等
期刊名称：BMC Medical Education
印刷版ISSN：1472-6920
出版年度：2018
卷号：18
期号：1
页码：101-110
DOI：10.1186/s12909-018-1196-0
出版社：BioMed Central
摘要：Low-stakes tests are becoming increasingly important in international assessments of educational progress, and the validity of these results is essential especially as these results are often used for benchmarking. Test scores in these tests not only mirror students’ ability but also depend on their test-taking effort. One way to obtain more valid scores from participating samples is to identify test-takers with low test-taking effort and to exclude them from further analyses. Self-assessment is a convenient and quick way of measuring test-taking effort. We present the newly developed Test-taking Effort Short Scale (TESS), which comprises three items measuring attainment value/intrinsic value, utility value, and perceived benefits, respectively. In a multicenter validation study with N = 1837 medical students sitting a low-stakes progress test we analyzed item and test statistics including construct and external validity. TESS showed very good psychometric properties. We propose an approach using stanine norms to determine a cutoff value for identifying participants with low test-taking effort. With just three items, TESS is shorter than most established self-assessment scales; it is thus suited for administration after low-stakes progress testing. However, further studies are necessary to establish its suitability for routine usage in assessment outside progress testing.
关键词：Nonconsequential progress testing ; Psychometrics ; Self-assessment ; Short scale ; Test-taking effort ; Validation study