Automated Scoring of Speaking and Writing: Starting to Hit its Stride

• Main Authors: Daniel Marc Jones (Author), Liying Cheng (Author), Gregory Tweedie (Author)
• Format: Book
• Published: The Canadian Network for Innovation in Education (CNIE), 2023-04-01T00:00:00Z.
• Subjects: article
• Online Access: Connect to this object online.
• Notes: 10.21432/cjlt28241; 1499-6677; 1499-6685
• Keywords: automated scoring of language; literature review; scoring feedback; technology in language assessment and teaching; Education; L
• Source: Canadian Journal of Learning and Technology, Vol 48, Iss 3 (2023)

This article reviews recent literature (2011-present) on the automated scoring (AS) of writing and speaking. Its purpose is to first survey the current research on automated scoring of language, then highlight how automated scoring impacts the present and future of assessment, teaching, and learning. The article begins by outlining the general background of AS issues in language assessment and testing. It then positions AS research with respect to technological advancements. Section two details the literature review search process and criteria for article inclusion. In section three, the three main themes emerging from the review are presented: automated scoring design considerations, the role of humans and artificial intelligence, and the accuracy of automated scoring with different groups. Two tables show how specific articles contributed to each of the themes. Following this, each of the three themes is presented in further detail, with a sequential focus on writing, speaking, and a short summary. Section four addresses AS implementation with respect to current assessment, teaching, and learning issues. Section five considers future research possibilities related to both the research and current uses of AS, with implications for the Canadian context in terms of the next steps for automated scoring.