ERIC Number: ED382661
Record Type: RIE
Publication Date: 1994-May
Reference Count: N/A
Delimiting the Verbal Domain.
DeMauro, Gerald E.; And Others
A functional analysis was made of the verbal domain as it is defined by the test development process at the Educational Testing Service (ETS). The thesis of the study was that the verbal domain consists of semantic relations that examinees must interpret. Test developers used a system of rules to sample stimulus materials from among infinite possibilities that elicit an interpretive response. Many of these rules were codified and others were in different stages of formation, beginning in the use by individual test developers, and eventually becoming part of generally accepted practice. A job analysis approach was used to examine how rules are employed to present the desired semantic relations to the examinees for their interpretation. Test developers (n=8) from two major divisions of ETS were observed and interviewed. They also rated the importance of each of the rules, suggested rules that they use that were not listed, and delineated the professional activities for which these rules are most important. The study indicates that the rule system for sampling semantic relations is an evolving body, both for the individual test developer and for test development as an institution. Ten tables support the discussion, and two appendixes provide supplemental information. (Contains 26 references.) (SLD)
Publication Type: Reports - Evaluative
Education Level: N/A
Authoring Institution: Educational Testing Service, Princeton, NJ.
Identifiers: Domain Knowledge; Educational Testing Service; Rule Application; Test Developers