Considerations related to generalization of a study's findings are often interconnected to researchers' judgements regarding the 'quality' of the methodology and methodological pluralism. Too often, researchers consider generalization as only possible with respect to quantitative studies with large numbers of randomly selected participants…

Though previously unacknowledged, a SMART (Sequential Multiple Assignment Randomized Trial) design uses both regression discontinuity (RD) and randomized controlled trial (RCT) designs. This combination structure creates a conceptual symbiosis between the two designs that enables both RCT- and previously unrecognized, RD-based inferential claims.…

Assessing student achievement over multiple years is complicated by students' memberships in shifting upper-level nesting structures. These structures are manifested in (1) annual matriculation to different classrooms and (2) mobility between schools. Failure to model these shifting upper-level nesting structures may bias the inferences…

Language learner attitudes about technology have traditionally been studied using survey data, but those surveys have primarily been based on disparate constructs and conceptualizations of learner attitudes. The lack of a common measure, or one that reflects other levels and contexts of learning, has limited the investigation about language…

As part of an investigation into the relationship between classroom dialogue and student outcome, a test of reasoning has been developed that is suitable for preadolescents (i.e. c.10-13-year-olds). Building on previous work but expanding this considerably, the test focuses upon four areas of reasoning: differentiation of facts from opinions,…

This exploratory research documents the use of the web conference technology WebEx™ to expand the variety of focus group data collection methods. Drawn from four synchronous online focus groups with older adults from across Canada, who create and use online personal learning networks to enhance and support their informal self-directed learning…

The main aim of this study was to adjust the Questionnaire on the Experience and Evaluation of Work (QEEW) in order to measure stress causes and stress responses of beginning secondary school teachers in the Netherlands. First, the suitability of the original QEEW stress scales for use in the beginning teachers (BTs) context was investigated using…

Cognitive interviewing (CI) provides a method of systematically collecting validity evidence of response processes for questionnaire items. CI involves a range of techniques for prompting individuals to verbalise their responses to items. One such technique is concurrent verbalisation, as developed in Think Aloud Protocol (TAP). This article…

The paper aims to demonstrate the value of cognitive interviewing (CI) as a survey pretesting method in comparative education research. Although rarely used by education researchers, CI has been successfully applied in different disciplines to evaluate and improve question performance. The method assumes that observing people's thought processes…

The use of video surveillance footage presents a new possibility in educational research as a reliable and valid source of learning and teaching activities in classrooms. However, the unique nature of surveillance footage requires different approaches and poses distinctive challenges in utilizing it in research, yet no methodological guides are…

Mixed methods approach has developed into the third methodological movement in educational research. Validity in mixed methods research as an important issue, however, has not been examined as extensively as that of quantitative and qualitative research. Additionally, the previous discussions of validity in mixed methods research focus on research…

There have been many attempts over the last five decades to measure students' attitudes towards school science. Many of these studies investigated attitudes towards limited aspects of science and utilized large numbers of items to draw snapshot summaries of the educational landscape. An understanding of attitudes towards science, and how these…

Improving academic, behavioural, and social outcomes of students through empirical research has been a firm commitment among researchers, policy-makers, and other professionals in education across Europe and the United States (U.S.). To assist in building scientific evidences, executive bodies such as the European Commission and the Institute for…

We tested the criterion-related validity and potential bias of two measures of pupils' academic achievement: the Teacher Rating Scale (TRS) and the Mathematics and Literacy Achievement Tests (MLTs). These measures are representative of assessment methods largely used in the elementary school. The aims were: (1) to verify the extent to which TRS…

Social network research on teachers and schools has risen exponentially in recent years as an innovative method to reveal the role of social networks in education. However, scholars are still exploring ways to incorporate traditional quantitative methods of Social Network Analysis (SNA) with qualitative approaches to social network research. This…