文章基本信息

标题：APPLICATIONS OF TEXT ANALYSIS TOOLSFOR SPOKEN RESPONSE GRADING
本地全文：下载
作者：Scott Crossley ; Danielle McNamara
期刊名称：Journal of Language Learning Technologies
电子版ISSN：1094-3501
出版年度：2013
卷号：17
期号：2
页码：171-192
出版社：Language Learning & Technology
摘要：This study explores the potential for automated indices related to speech delivery, language use, and topic development to model human judgments of TOEFL speaking proficiency in second language (L2) speech samples. For this study, 244 transcribed TOEFL speech samples taken from 244 L2 learners were analyzed using automated indices taken from Coh-Metrix, CPIDR, and LIWC. A stepwise linear regression was used to explain the variance in human judgments of independent speaking ability and overall speaking proficiency. Automated indices related to word type counts, causal cohesion, and lexical diversity predicted 52% of the variance in human ratings for the independent speech samples. Automated indices related to word type counts and word frequency predicted 61% of the variance of the human scores of overall speaking proficiency. These analyses demonstrate that, even in the absence of indices related to pronunciation and prosody (e.g., phonological accuracy, intonation, and stress), automated indices related to vocabulary size, causality, and word frequency can predict a significant amount of the variance in human ratings of speaking proficiency. These findings have important implications for understanding the construct of speaking proficiency and for the development of automatic scoring techniques.
关键词：Language Testing; Speaking Proficiency; Computational Linguistics; Corpus Linguistics; Machine Learning