NotesFAQContact Us
Collection
Advanced
Search Tips
ERIC Number: ED554378
Record Type: Non-Journal
Publication Date: 2013
Pages: 149
Abstractor: As Provided
Reference Count: N/A
ISBN: 978-1-3031-9748-2
ISSN: N/A
The Impact of Social Comparison on the Judgment-Based Angoff Method
Sorensen, Henry L.
ProQuest LLC, Psy.D. Dissertation, Capella University
Cut-score setting processes are used to establish the passing standards for all kinds of tests in education and for credentialing. While experts use their best efforts to guide cut-score setting processes to generate valid and reliable results, cut-score participants often have a difficult time understanding the standard at which the cut score is to be set. This study investigates the role that social comparison plays in how participants determine their estimates of difficulty when establishing a cut-score for a test. Participants in the study responded to test items and answered several questions about each item including the certainty of their answer, how well they believed their peers would perform, and how well they estimated that minimally acceptable examinees would perform on each item. The findings reveal that participant certainty in answering test items was the best predictor for how participants would subsequently estimate the difficulty of test items for minimally acceptable examinees. Furthermore, the study investigated the impact of alternate definitions of minimally acceptable examinees on the resulting cut scores. The findings revealed that defining examinees as "barely master" generated higher estimates of ability than when the examinees were defined as "barely qualified." Finally, the study revealed that participants engaged in a process of social comparison bias by consistently estimating the difficulty of test items to be lower or higher difficulty depending on how the participants perceived their own abilities relative to the minimally acceptable examinees used as the object of estimation for the study. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]
ProQuest LLC. 789 East Eisenhower Parkway, P.O. Box 1346, Ann Arbor, MI 48106. Tel: 800-521-0600; Web site: http://www.proquest.com/en-US/products/dissertations/individuals.shtml
Publication Type: Dissertations/Theses - Doctoral Dissertations
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A