The present study was conducted with a twofold purpose. First, I aim to apply the socio-cognitive framework by Shaw and Weir (2007) in order to validate a summative writing test used in a Malaysian ESL secondary school context. Secondly, by applying the framework I also aim to illustrate practical ways in which teachers can gather validity…

Using generalizability (G-) theory, this study examined the accuracy and validity of the writing scores assigned to secondary school ESL students in the provincial English examinations in Canada. The major research question that guided this study was: Are there any differences between the accuracy and construct validity of the analytic scores…

This paper reports on a qualitative research study into the test-taking strategies employed in completing two picture prompt writing tasks--Situational Writing and Interpretational Writing in the Beijing Matriculation English Test. Think-aloud and retrospective interview protocols were collected from twelve Chinese students representing two key…

This action research demonstrates the answer to this question: How can literacy professors provide effective training in evaluating writing to preservice graduate education students? The study examines writing assessment instruction in the context of a literacy course required of preservice teachers seeking secondary (7-12) certification in…

The purpose of this study was to investigate the intra-rater and inter-rater reliability of the Critical Thinking Analytic Rubric (CTAR). The CTAR is composed of 6 rubric categories: interpretation, analysis, evaluation, inference, explanation, and disposition. To investigate inter-rater reliability, two trained raters scored four sets of…

This study investigated the relationship of prompt characteristics and response features with essay scores on the SAT Reasoning Test. A sample of essays was coded on a variety of features regarding their length and content. Analyses included descriptive statistics and computation of effect sizes, correlations between essay features and scores, and…

Much of second language (L2) class time, particularly in school and university classes, is devoted to the teaching of writing, and written assignments form an important component of assessed work. We assume that learners' L2 writing develops over time, in response to instruction, feedback, and practice. However, to date there has been very little…

Test-based accountability programs are designed to promote improved standards of teaching and learning within the systems of education that they are connected to. Brenan [Brenan, A. L. (2006). "Perspectives on the evolution and future of educational measurement." In: Robert (Ed.), "Educational measurement" (4th ed., pp. 1-16). Westport, CT:…

Despite the debate among writing researchers about its viability as a pedagogical tool in writing instruction [e.g., Helms-Park, R., & Stapleton, P. (2003). "Questioning the importance of individualized voice in undergraduate L2 argumentative writing: An empirical study with pedagogical implications." "Journal of Second Language Writing," 12 (3),…

While much of L2 teacher feedback research has focused on the effectiveness of feedback and its impact on student revision and writing, little has been done to examine teachers' feedback in the larger classroom context of teaching and learning to ascertain the functions teacher feedback serves from an assessment-for-learning perspective. Using…

Classroom assessment of writing is considered from an anthropological perspective as practitioners' tool use. Pan Canadian data from a 2002 English teacher questionnaire (N = 4070) about self-reported assessment practices were analyzed in terms of tool choice and use by secondary teachers of different experience and qualification levels. Four…

The authors report on an exploratory study that investigated Grade 10 students' responses to a large-scale, high-stakes literacy test, the results of which determine high school graduation in Ontario, Canada. Through focus-group and individual interviews, the authors found that students perceived the test as evaluating their English skills rather…