ERIC Number: EJ1046016
Record Type: Journal
Publication Date: 2014
Abstractor: As Provided
Reference Count: 23
Comparison of Web-Based and Face-to-Face Standard Setting Using the Angoff Method
Katz, Irvin R.; Tannenbaum, Richard J.
Journal of Applied Testing Technology, v15 n1 p1-17 2014
Web-based standard setting holds promise for reducing the travel and logistical inconveniences of traditional, face-to-face standard setting meetings. However, because there are few published reports of setting standards via remote meeting technology, little is known about the practical potential of the approach, including technical feasibility of implementing common standard setting methods and whether such an approach presents threats to validity and reliability. In previous work, we demonstrated the feasibility of implementing a modified Angoff methodology in a virtual environment (Katz, Tannenbaum,& Kannan, 2009). This paper presents results from two studies in which we compare cutscores set through face-to-face meetings and through the web-based approach on two operational tests, one of digital literacy and one of French.
Descriptors: Standard Setting, Comparative Analysis, Feasibility Studies, Program Implementation, Computer Mediated Communication, Intermode Differences, Meetings, Judges, Computer Assisted Testing, Media Literacy, Test Construction, Validity, Reliability, Evidence, Teacher Certification, French, Participant Characteristics, Interaction Process Analysis, Critical Path Method, Best Practices, Group Dynamics, Elementary Secondary Education, Higher Education
Association of Test Publishers. 601 Pennsylvania Avenue NW, South Building Suite 900, Washington DC 20004. Tel: 866-240-7909; Fax: 717-755-8962; e-mail: firstname.lastname@example.org; Web site: http://www.testpublishers.org
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Secondary Education; Higher Education; Postsecondary Education
Authoring Institution: N/A