ERIC Number: ED401302
Record Type: Non-Journal
Publication Date: 1996-Apr
Generative Response Modeling: Leveraging the Computer as a Test Delivery Medium.
Bejar, Isaac I.
Generative response modeling is an approach to test development and response modeling that calls for the creation of items in such a way that the parameters of the items on some response model can be anticipated through knowledge of the psychological processes and knowledge required to respond to the item. That is, the computer would not merely retrieve an item from a database, as is the case in adaptive testing, but would compose it, or assist in doing so, according to the desired specifications. This approach to assessment has implications for both the economics and validity of computer administered tests. To illustrate the concept, a system for measuring writing skills is outlined in which the examinee is expected to rewrite sentences, rather than just recognize errors in a sentence, using a multiple-choice format. The possibility of estimating the psychometric parameters of items based on a psychological analysis of the response process is examined, and shown to be feasible. A Monte Carlo study with 100 simulated examinees at each of 6 ability levels is presented, which investigated the possibility of compensating for that imprecision when estimating ability or proficiency. It is concluded that a generative approach is feasible, and can be a mechanism for taking advantage of the considerable investment required for computer-based testing. (Contains 5 figures, 7 tables, and 59 references.) (Author/SLD)
Publication Type: Reports - Evaluative
Education Level: N/A
Authoring Institution: Educational Testing Service, Princeton, NJ.