NotesFAQContact Us
Collection
Advanced
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ789557
Record Type: Journal
Publication Date: 2003
Pages: 13
Abstractor: Author
Reference Count: 27
ISBN: N/A
ISSN: ISSN-0015-718X
Reliability and the ACTFL Oral Proficiency Interview: Reporting Indices of Interrater Consistency and Agreement for 19 Languages
Surface, Eric A.; Dierdorff, Erich C.
Foreign Language Annals, v36 n4 p507-519 Win 2003
The reliability of the ACTFL Oral Proficiency Interview (OPI) has not been reported since ACTFL revised its speaking proficiency guidelines in 1999. Reliability data for assessments should be reported periodically to provide users with enough information to evaluate the psychometric characteristics of the assessment. This study provided the most comprehensive analysis of ACTFL OPI reliability to date, reporting interrater consistency and agreement data for 19 different languages. Overall, the interrater reliability of the ACTFL OPI was found to be very high. These results demonstrate the importance of using an OPI assessment program that has a well-designed interview process, a well-articulated set of criteria for proficiency determination, a solid rater training program, and an experienced cadre of testers. Based on the data reported, educators and employers who use the ACTFL OPI can expect reliable results and use the scores generated from the testing process with increased confidence. Recommendations for future research are discussed. (Contains 4 tables.)
American Council on the Teaching of Foreign Languages. 700 South Washington Street Suite 210, Alexandria, VA 22314. Tel: 703-894-2900; Fax: 703-894-2905; e-mail: headquarters@actfl.org; Web site: http://www.actfl.org
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: ACTFL Oral Proficiency Interview