ERIC Number: ED216034
Record Type: RIE
Publication Date: 1980-Aug
Reference Count: 0
Talking with Children About Tests; A Pilot Study of Test Item Ambiguity. National Consortium on Testing Staff Circular No. 7.
Haney, Walt; Scott, Laurie
A pilot study was conducted on test item ambiguity in standardized tests. A group of second and third grade children were selected and given a random sample of items from four standardized test series. Items were drawn from the reading, science and social studies subtests and put together in a composite reading comprehension, science, and social studies test. The children were interviewed individually about their perceptions of and answers to each item. The interviews were audiotape recorded and given analytical and holistic ratings. In both rating schemes, ambiguity in children's interactions with test items were of two types. The researchers attempted to distinguish three types of keyed answer ambiguity in both types of ratings; selection of a keyed answer by guessing, by mistake, or by other reasoning which did not reflect the skill measured. The limitations of the study were cited and explained. Ambiguity was seen as a real phenomenon, but substantially less of a problem than some critics indicated. The issues of ambiquity raised by this study refer more to validity than reliability. The authors suggest further research into children's perception and reasoning about tests and test items, as well as test interpretation and use. (DWH)
Descriptors: Ambiguity, Grade 2, Grade 3, Interviews, Item Analysis, Primary Education, Standardized Tests, Test Items, Test Validity, Young Children
The Huron Institute--National Consortium on Testing Project, 123 Mt. Auburn St., Cambridge, MA 02138 ($6.00).
Publication Type: Reports - Research
Education Level: N/A
Sponsor: National Consortium on Testing, Cambridge, MA.
Authoring Institution: Huron Inst., Cambridge, MA.
Identifiers: California Achievement Tests; Comprehensive Tests of Basic Skills; Metropolitan Achievement Tests; Stanford Achievement Tests