The study applied the Multi-Dimensional analysis used by Biber (1988) to examine the functional parameters of essays. Co-occurrence patterns were identified within an essay corpus (n=1529) using a linguistic indices provided by Co-Metrix. These patterns were used to identify essay groups that shared features based upon situational parameters.…

This study investigates the potential for linguistic microfeatures related to length, complexity, cohesion, relevance, topic, and rhetorical style to predict L2 writing proficiency. Computational indices were calculated by two automated text analysis tools (Coh- Metrix and the Writing Assessment Tool) and used to predict human essay ratings in a…

The current study examined relationships between expert human judgments of text quality and grammar and mechanical errors in student writing. A corpus of essays (N = 100) written by high school students in the W-Pal system was collected, coded for grammar and mechanical errors, and scored by expert human raters. Results revealed weak relations…

Achieving sustained student engagement with practice in computer-based writing strategy training can be a challenge. One potential solution is to foster engagement by embedding practice in educational games; yet there is currently little research comparing the effectiveness of game-based practice versus more traditional forms of practice. In this…

Coh-Metrix analyzes texts on multiple measures of language and discourse that are aligned with multilevel theoretical frameworks of comprehension. Dozens of measures funnel into five major factors that systematically vary as a function of types of texts (e.g., narrative vs. informational) and grade level: narrativity, syntactic simplicity, word…

Educational games have the potential to provide motivating, effective training; however, the efficacy of these systems is unclear, and evaluations often fail to identify the relative impact of individual differences on learning outcomes. The current study aims to address these issues by comparing the learning gains from an educational game…

Research on individual differences indicates that students vary in how they interact with and perform while using intelligent tutoring systems (ITSs). However, less research has investigated how individual differences affect students' interactions with game-based features. This study examines how learning outcomes and interactions with specific…

This study expands upon an existing model of students' reading comprehension ability within an intelligent tutoring system. The current system evaluates students' natural language input using a local student model. We examine the potential to expand this model by assessing the linguistic features of self-explanations aggregated across entire…

Intelligent Tutoring Systems (ITSs) have begun to develop hybrid systems that balance the learning benefits of ITSs with the motivational benefits of games. iSTART-ME (Motivationally Enhanced) is a new game-based learning environment developed on top of an existing ITS for reading comprehension (iSTART). In an 11 session lab-based study, 40 high…

Various computer tools have been developed to support educators' assessment of student writing, including automated essay scoring and automated writing evaluation systems. Research demonstrates that these systems exhibit relatively high scoring accuracy but uncertain instructional efficacy. Students' writing proficiency does not necessarily…

The Writing Pal is an intelligent tutoring system that provides writing strategy training. A large part of its artificial intelligence resides in the natural language processing algorithms to assess essay quality and guide feedback to students. Because writing is often highly nuanced and subjective, the development of these algorithms must…

This study explores whether linguistic features can predict second language writing proficiency in the Test of English as a Foreign Language (TOEFL iBT) integrated and independent writing tasks and, if so, whether there are differences and similarities in the two sets of predictive linguistic features. Linguistic features related to lexical…

The ability of educational games to promote students' engagement in learning and practice depends on perceived enjoyment of those games. This study investigated high school students' perceptions and enjoyment of games within the Writing Pal intelligent tutoring system. In accord with research on motivation, results showed that perceived…

Linguistic properties of writing prompts have been shown to influence the writing patterns contained in student essays. The majority of previous research on these prompt-based effects has focused on the lexical and syntactic properties of writing prompts and essays. The current study expands this research by investigating the effects of prompt…

We present an evaluation of the Writing Pal (W-Pal) intelligent tutoring system (ITS) and the W-Pal automated writing evaluation (AWE) system through the use of computational indices related to text cohesion. Sixty-four students participated in this study. Each student was assigned to either the W-Pal ITS condition or the W-Pal AWE condition. The…