This research evaluated the impact of a common modification to Angoff standard-setting exercises: the provision of examinee performance data. Data from 18 independent standard-setting panels across three different medical licensing examinations were examined to investigate whether and how the provision of performance information impacted judgments…

Much is known about sport officials' decisions (e.g., anticipation, visual search, and prior experience). Comprehension of the entire decision process, however, requires an ecologically valid examination. To address this, we implemented a 2-part study using an expertise paradigm with ice hockey referees. Purpose: Study 1 explored the…

The paper proposes a recommender system approach to cover online judge's domains. Online judges are e-learning tools that support the automatic evaluation of programming tasks done by individual users, and for this reason they are usually used for training students in programming contest and for supporting basic programming teachings. The…

The purpose of the present study was to extend past work with the Angoff method for setting standards by examining judgments at the judge level rather than the panel level. The focus was on investigating the relationship between observed Angoff standard setting judgments and empirical conditional probabilities. This relationship has been used as a…

One of the best-known methods for setting a benchmark standard on a test is that of Angoff and its modifications. When scored dichotomously, judges estimate the probability that a benchmark student has of answering each item correctly. As in most methods of standard setting, it is assumed implicitly that the unit of the latent scale of the…

Despite being widely used and frequently studied, the Angoff standard setting procedure has received little attention with respect to an integral part of the process: how judges incorporate examinee performance data in the decision-making process. Without performance data, subject matter experts have considerable difficulty accurately making the…

A small evidence base suggests that parents with learning disabilities are likely to have their children permanently removed from their care. There is no known research involving magistrates in England, despite their role in care proceedings. This study aimed to explore the experience of magistrates making decisions in care proceedings involving…

Fifty years ago, the Reverend Dr. Martin Luther King Jr. wrote his "Letter from a Birmingham Jail." In exploring the story of the events behind the essay, and the Supreme Court case that resulted, "Walker v. Birmingham", 399 U.S. 307 (1967), educators will find a pedagogically powerful lens through which to review the seminal…

March 18, 2013, marked the 50th anniversary of the Supreme Court's unanimous 1963 decision in "Gideon v. Wainwright." "Gideon," a petty criminal, accused of suspicion of breaking and entry was the seminal Supreme Court case that ruled that defendants in criminal cases have the right to an attorney even if they cannot…

Reading U.S. Supreme Court opinions can be intimidating. Yet, in the digital age, it has never been easier to access them. The average opinion is about 4,750 words, and is one of approximately 75 issued by the Court each year. It might be reassuring to know that opinions contain similar parts and tend to follow a similar format. There are also…

The Truancy Court Diversion Program (TCDP) is a voluntary program for at risk students and their parents. It combines involvement of a Family Court judge in group and individual sessions with service provision. During the 2011-12 school year, a pilot TCDP was implemented at Kramer Middle School (M.S.) and at Johnson M.S. The program attempts to…

An evaluation of the Truancy Court Diversion Program (TCDP) found that despite significant implementation challenges, parent-child communication and youths' attitudes towards school both improved. A voluntary program for middle school students at risk for chronic truancy, TCDP involves judicially-led sessions that address student attitudes…

In the increasingly complex and combative arena of copyright in the digital age, record companies sue college students over peer-to-peer music sharing, YouTube removes home movies because of a song playing in the background, and filmmakers are denied a distribution deal when some permissions "i" proves undottable. Patricia Aufderheide and Peter…

Facing History and Ourselves has developed "Teaching The Reckoning" to help classrooms explore essential questions about judgment by studying the creation of the International Criminal Court. Ever since the Nuremberg Trials, individuals around the world have imagined how an international judicial body could be used to prevent genocide, crimes…

The purpose of this study is to understand the role that participation in IFEJE played in the personal and professional development of six judges who participated in the Institute since 2001. Three perspectives of education, including the history of adult learning, continuing professional education, and judicial branch education are discussed. The…