Using automated indices of cohesion to explore the growth of cohesive features in L2 writing

Abstract While the use of cohesive devices has received considerable attention in L2 writing research, scant attention has been devoted to exploring local, global, and textual cohesive features across two genres at different time points using indices generated by the computational tool for automatic analysis of cohesion (TAACO). Inspired by this gap, this study attempted to: (a) identify TAACO indices that are predictive of human ratings of essay organization, (b) investigate which of the identified TAACO indices differ between narrative and argumentative genres, and (c) explore which of the identified TAACO indices might change over time. To achieve these purposes, 270 narrative and argumentative essays were collected from 45 L2 writers in counterbalanced order at six different time points. The results of mixed-effects modeling revealed textual cohesive devices to be significant predictors of human ratings of essay organization regardless of genre and indicated sustained development in the use of textual cohesive devices over time. This study has important implications for L2 writing assessment including the potential to enhance assessment practices by incorporating computational tools like TAACO. The findings emphasize the importance of considering textual cohesive devices as significant predictors of essay organization, regardless of genre.