ERIC Number: EJ1111322
Record Type: Journal
Publication Date: 2005-Dec
Pages: 40
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2330-8516
EISSN: N/A
Psychometric and Cognitive Analysis as a Basis for the Design and Revision of Quantitative Item Models. Research Report. ETS RR-05-25
Graf, Edith Aurora; Peterson, Stephen; Steffen, Manfred; Lawless, René
ETS Research Report Series, Dec 2005
We describe the item modeling development and evaluation process as applied to a quantitative assessment with high-stakes outcomes. In addition to expediting the item-creation process, a model-based approach may reduce pretesting costs, if the difficulty and discrimination of model-generated items may be predicted to a predefined level of accuracy. The development and evaluation of item models represents a collaborative effort among content specialists, statisticians, and cognitive scientists. A cycle for developing and revising item models that generate items with more predictable statistics is described. We review the goals of item modeling from different perspectives and recommend a method for structuring families of models that span content and generate items with more predictable psychometric parameters. [This report combines two documents, the original versions of which were included in a set of symposium papers presented at the International Association for Education Assessment conference in June 2004.]
Descriptors: Psychometrics, Accuracy, Item Analysis, High Stakes Tests, Statistical Analysis, Models, Test Items, Difficulty Level, Test Content, Specialists, Mathematics Tests, Item Response Theory, Test Validity, College Entrance Examinations, Graduate Study, Test Construction, Equations (Mathematics)
Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Graduate Record Examinations
Grant or Contract Numbers: N/A