Evidence of stable standard setting results over panels or occasions is an important part of the validity argument for an established cut score. Unfortunately, due to the high cost of convening multiple panels of content experts, standards often are based on the recommendation from a single panel of judges. This approach implicitly assumes that…

Functional form misfit is frequently a concern in item response theory (IRT), although the practical implications of misfit are often difficult to evaluate. In this article, we illustrate how seemingly negligible amounts of functional form misfit, when systematic, can be associated with significant distortions of the score metric in vertical…

As a global measure of precision, item response theory (IRT) estimated reliability is derived for four coefficients (Cronbach's a, Feldt-Raju, stratified a, and marginal reliability). Models with different underlying assumptions concerning test-part similarity are discussed. A detailed computational example is presented for the targeted…

The selection of bandwidth in kernel equating is important because it has a direct impact on the equated test scores. The aim of this article is to examine the use of double smoothing when selecting bandwidths in kernel equating and to compare double smoothing with the commonly used penalty method. This comparison was made using both an equivalent…

Brennan noted that users of test scores often want (indeed, demand) that subscores be reported, along with total test scores, for diagnostic purposes. Haberman suggested a method based on classical test theory (CTT) to determine if subscores have added value over the total score. One way to interpret the method is that a subscore has added value…

Sometimes, test-takers may not be able to attempt all items to the best of their ability (with full effort) due to personal factors (e.g., low motivation) or testing conditions (e.g., time limit), resulting in poor performances on certain items, especially those located toward the end of a test. Standard item response theory (IRT) models fail to…

This study explores whether the religious background of students affects their opinions about and attitudes to engaging with scientific explanations of the origins of the universe and of life. The study took place in four English secondary schools representing three different contexts (Christian faith-based; non-faith with majority Muslim…

This paper presents a model of how children generate concrete concepts from perception through processes of differentiation and integration. The model informs the design of a novel methodology ("evolutionary maps" or "emaps"), whose implementation on certain domains unfolds the web of itineraries that children may follow in the…

This paper discusses the nature of learner engagement with science content during small group discussions in which learners use their home languages. We observed that learners reverted to their home languages in small group discussions, yet very little is known about the dynamics of learner engagement when they use their home languages in…

This paper addresses the impact of teachers' beliefs about argumentation and their community of practice framed views of teaching on co-designing an environmental health afterschool club curriculum with researchers. Our team collaborated with a group of four middle school teachers, asking them to co-design a club that would facilitate (1)…

Science education researchers recently turned their attention to exploring views about nature of science (NOS). A large body of research indicates that both students and teachers have many naïve views about the NOS. Unfortunately, less attention has been directed at the issue of exploring the views of the scientists. Also, the little research in…

Aspects of chemistry content knowledge held by 265 UK-based pre-service teachers (PSTs) were probed using 28 diagnostic questions in five chemistry concept areas, "Particle theory and changes of state", "Mass conservation" (taught to 11-14-year-olds), and "Chemical bonding", "Mole calculations" and…

This paper presents the third study of research trends in science education. In this review, a total of 990 papers published in the "International Journal of Science Education," the "Journal of Research in Science Teaching," and "Science Education" from 2008 to 2012 were analyzed. The results indicate that in the…

While a number of studies have investigated people's perceptions or conceptions of creativity, there is a lack of studies looking into science teachers' views. The study aimed to explore the meanings of scientific creativity in the classroom context as perceived by a selective group of upper primary (Grades 3-6; student ages 8-12)…

Data were gathered from 95 Year 10 students in a New Zealand secondary school to explore how the indicators of scientific literacy are expressed in student responses. These students completed an activity based around the two contexts of lighting and health. A matrix, which incorporated descriptive indicators, was developed to analyse the student…