The impact of automated writing evaluation and combined automated – teacher feedback on EFL learners' writing performance

---

Thesis Type: Postgraduate

Institution Of The Thesis: Yildiz Technical University, Faculty of Education, Department of Foreign Languages, Turkey

Approval Date: 2023

Thesis Language: English

Student: Merve BAKO

Supervisor: Suzan Kavanoz

Open Archive Collection: AVESIS Open Access Collection

Abstract:

Over the past few years, writing proficiency has become an essential component of 21st-century skills. Writing skills in first, second, and foreign languages have continuously been assessed and graded by teachers or professional raters trained solely to be objective and consistent. Some inconsistencies in teacher assessment can still occur because of the human element. To address this issue, some tools have been developed to assess and evaluate student writing and incorporate automated feedback, which can be used in writing classrooms. This study uses a naturalistic classroom-based method to investigate how the use of an AWE tool called Criterion as part of writing instruction and receiving combined automated teacher feedback affect the students' writing performance and how they view the program's efficacy in improving their writing. In the current study, a mixed methods research design was utilized, involving 38 EFL students from preparatory classes in two intact groups. Quantitative and qualitative data collection instruments were employed to gather the necessary data. The results illustrated that using an AWE tool (Criterion) and receiving combined automated–teacher feedback did not have a significant impact on the writing performance of the students in the experimental group. However, the EFL learners in the experimental group improved significantly in their writing performance before and after the intervention. One-on-one interviews revealed a positive attitude towards the use of Criterion and receiving combined automated–teacher feedback. The students felt motivated and engaged in more writing, thanks to the immediate feedback and the chance to write multiple drafts provided by Criterion. It was expressed that the whole process helped the students to learn how to write a persuasive essay properly. Keywords: automated writing evaluation (AWE), automated essay scoring (AES), automated feedback, teacher feedback, combined automated–teacher feedback, writing assessment, e-rater, Criterion