ERIC Number: ED383185
Record Type: RIE
Publication Date: 1995-Mar
The Use of Verbal Protocols To Validate an Adaptive Test.
Laurier, Michel D.; Chung How, Mee Lian
This paper presents the validation of an adaptive test developed for placement purposes in French at the post-secondary level, the French CAPT. Results from a second experiment are presented in which verbal protocols were obtained from nine college students of various levels with the thinking-aloud technique used during completion of the exam. The 4-part test includes a paragraph reading section with a comprehensive question about each paragraph, a situation reading section with grammatical statement selection, a sentence gap section, and a semi-authentic dialogue with questions section. A 5th part, under development, will use a graded-response model for self-assessment of ability. All questions are multiple choice; items in the first three parts have been calibrated with a IRT 3-parameter model. Administration of the French CAPT is similar to other computerized adaptive tests and uses a stradaptive algorithm, programmed for the selection of items. Findings indicate that perception of difficulty varied considerably, specifically regarding subjective vs objective difficulty. It is concluded that this use of verbal protocols evidenced no effect due to presentation mode and the use of appropriate desired mental processes during the test. (Contains 27 references.) (NAV)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A
Note: Paper presented at the Annual Language Testing Research Colloquium (Long Beach, CA, March 1995).