文章基本信息

标题：Random Responding from Participants is a Threat to the Validity of Social Science Research Results
本地全文：下载
作者：Osborne, Jason W ; Blanchard, Margaret R
期刊名称：Frontiers in Psychology
电子版ISSN：1664-1078
出版年度：2011
卷号：1
页码：1-7
DOI：10.3389/fpsyg.2010.00220
出版社：Frontiers Media
摘要：Research in the social sciences often relies upon the motivation and goodwill of research participants (e.g., teachers, students, minimally-compensated volunteers) to do their best on low stakes assessments of the effects of interventions. Research participants who are unmotivated to perform well can engage in random responding on outcome measures, which can cause substantial mis-estimation of results, biasing results toward the null hypothesis. Data from a recent educational intervention study served as a clear example of this problem: participants identified as random responders showed substantially lower scores than other participants on tests during the study, and failed to show growth in scores from pre- to posttest, while those not engaging in random responding showed much higher scores and significant growth over time. This served to mask the hypothesized group differences across instructional method when random responders were retained in the sample (anticipated group differences were significant when these random responders were removed). We remind researchers to screen their data for random responding (and other response biases) in their critical outcome measures in order to improve the odds of detecting effects of their interventions.
关键词：best practices; random responding; response set; type II error