ERIC Number: EJ1188699
Record Type: Journal
Publication Date: 2018-Aug-16
Pages: 11
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0010-0889
EISSN: N/A
Variance and Inter-Rater Reliability in Holistic Admissions Review
Rideout, Blaire Moody
College and University, v93 n3 p2-13 Aug 2018
This study examined a holistic admissions review process at one institution to determine whether variance occurred and, if so, possible explanations for it. The study analyzed reader reviews for approximately 15,000 individual undergraduate admission reviews over three years. The primary method was focused on the variance and inter-rater reliability of the application reviews. Findings revealed that subjective measures of performance review, and in this case holistic admissions review, may not be susceptible to high levels of variability with 97 percent of reader reviews showing agreement for this study. Overall, just 3 percent of the subjective application reviews showed variability. Implications and recommendations for future research and professional practice are provided.
Descriptors: Interrater Reliability, Holistic Approach, College Applicants, Evaluation Methods, College Admission, Undergraduate Students, Selective Admission
American Association of Collegiate Registrars and Admissions Officers (AACRAO). One Dupont Circle NW Suite 520, Washington, DC 20036. Tel: 202-293-9161; Fax: 202-872-8857; e-mail: pubs@aacrao.org; Web site: http://www.aacrao.org/
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A