Ethical considerations, including transparency, play an important role when using artificial intelligence (AI) in education. Explainable AI has been coined as a solution to provide more insight into the inner workings of AI algorithms. However, carefully designed user studies on how to design explanations for AI in education are still limited. The…

This study employed a mixed-methods approach to examine how rater performance develops during a semester-long rater certification program for an English as a Second Language (ESL) writing placement test at a large US university. From 2016 to 2018, we tracked three groups of novice raters (n = 30) across four rounds in the certification program.…

We investigated the relationship between the scores assigned by an Automated Essay Scoring (AES) system, the Intelligent Essay Assessor (IEA), and grades allocated by trained, professional human raters to English essay writing by instigating two procedures novel to written-language assessment: the logistic transformation of AES raw scores into…

Purpose: Punctuation is traditionally seen to represent grammatical structures in writing, but some authors argue that it can also reflect the intonation and pauses of speech. In two experiments, we examined the influence of grammar and prosody on adults' judgments of comma placement. Method: University students rated the appropriateness of commas…

In this conceptual paper, borne from the experiences of two academic literacy lecturers at the NWU, we ask, regarding elements of assessment, how we can sensibly adapt an intervention-style writing course in a post-COVID higher education context. We propose a course correction model, applicable to academic literacy writing courses, to address the…

Writing is an important part of creative thinking as it is the reflection of a person's thoughts and reasoning. The aim with this study was to create a comprehensive and effective educational model that combines the teaching and practice of writing as a process and creative writing in a collaborative environment in the education of prospective…

Automated writing evaluation (AWE) software is an increasingly popular tool for English second language learners. However, research on the accuracy of such software has been both scarce and largely limited in its scope. As such, this article broadens the field of research on AWE accuracy by using a mixed design to holistically evaluate the…

Traditionally, the previous writing learning enterprise strictly focused its concern on gaining the fixed results from EFL educators in the form of scores or judgments. However, nowadays writing learning venture gradually abandons this old method to be replaced by formative assessment approach. It is strongly believed by worldwide researchers that…

This study aimed to elucidate the organization and developmental sequences of macro-structure elements in the written narratives of 44 students in Japan, aged 7-11 years and attending the same school, who were deaf or hard of hearing (DHH). A high-point analysis of oral paper puppet play storylines revealed that the students were able to develop…

This study seeks to investigate the relationship between text formality and writing quality by quantifying text formality in EFL English writing. In order to conduct the research, 548 English argumentation compositions were evaluated in terms of the five Coh-Metrix text formality dimensions: narrativity, syntactic simplicity, word concreteness,…

Strategy instruction is an effective method for improving the writing skills of students who struggle when writing. It is critical when implementing strategy instruction that assessment of the strategy takes place in addition to assessment of writing. Practitioners should consider strategy assessment to ensure student proper use of strategy. This…

We investigated the promise of a novel approach to formative writing assessment at scale that involved an automated writing evaluation (AWE) system called MI Write. Specifically, we investigated elementary teachers' perceptions and implementation of MI Write and changes in students' writing performance in three genres from Fall to Spring…

Writing assessment can be used for a variety of purposes, both inside the classroom and outside: supporting student learning, assigning a grade, placing students in appropriate courses, allowing them to exit a course or sequence of courses, certifying proficiency, and evaluating programs. Given the high-stakes nature of many of these assessment…

This study investigates how aspects of collocational proficiency affect the ratings that expert examiners give to second language (L2) English learner essays. Lexical proficiency is a multi-faceted phenomenon and certain aspects of it are particularly impactful on human judgements, including lexical sophistication and accuracy. However, the…

Despite the early emergence of oral argumentation, written argumentation is slow to develop, insensitive to alternative perspectives, and generally of poor quality. These findings are unsettling because high quality argumentative writing is expected throughout the curriculum and needed in an increasingly competitive workplace that requires…