Download full text
Download full text
ERIC Number: EJ1111460
Record Type: Journal
Publication Date: 2006-Oct
Abstractor: As Provided
Rasch Rating Scale Modeling of Data from the Standardized Letter of Recommendation. Research Report. ETS RR-06-33
Kim, Sooyeon; Kyllonen, Patrick C.
ETS Research Report Series, Oct 2006
The Standardized Letter of Recommendation (SLR), a 28-item form, was created by ETS to supplement the qualitative rating of graduate school applicants' nonacademic qualities with a quantitative approach. The purpose of this study was to evaluate the following psychometric properties of the SLR using the Rasch rating-scale model: dimensionality, reliability, item quality, and rating category effectiveness. Principal component and factor analyses were also conducted to examine the dimensionality of the SLR. Results revealed (a) two secondary factors underlay the data, along with a strong higher order factor, (b) item and person separation reliabilities were high, (c) noncognitive items tended to elicit higher endorsements than did cognitive items, and (d) a 5-point Likert scale functioned effectively. The psychometric properties of the SLR support the use of a composite score when reporting SLR scores and the utility of the SLR in higher education and in admissions.
Descriptors: Item Response Theory, Rating Scales, Data Analysis, Models, Letters (Correspondence), College Applicants, Graduate Students, Psychometrics, Reliability, Componential Analysis, Factor Analysis, Factor Structure, College Faculty, Statistical Analysis, Markov Processes, Student Evaluation, Evaluation Criteria, Goodness of Fit, Likert Scales, Monte Carlo Methods
Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Authoring Institution: N/A
Grant or Contract Numbers: N/A