ERIC Number: EJ1111632
Record Type: Journal
Publication Date: 2007-Jul
Pages: 72
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2330-8516
EISSN: N/A
Available Date: N/A
Supporting Efficient, Evidence-Centered Item Development for the GRE Verbal Measure. ETS GRE Board Research Report No. 03-14. ETS RR-07-29
Sheehan, Kathleen M.; Kostin, Irene; Futagi, Yoko
ETS Research Report Series, Jul 2007
This paper explores alternative approaches for facilitating efficient, evidence-centered item development for a new type of verbal reasoning item developed for use on the GRE® General Test. Results obtained in two separate studies are reported. The first study documented the development and validation of a fully automated approach for locating the types of stimulus materials needed to support more efficient generation of the studied item type. The validation results confirmed that the proposed filtering technique can help item writers increase the percentage of acceptable stimulus paragraphs located per unit time interval from the current level of about 10% to nearly 30%. The second study documented the development and validation of a set of task models designed to help item writers generate new items that are optimally constructed to provide high-quality evidence about targeted skills. The proposed models were validated by considering the percentage of difficulty variance accounted for by the specified item classifications. That amount ranged from slightly more than 30% for items designed to test vocabulary skills to slightly more than 40% for items designed to test additional verbal reasoning skills, such as generating near and far inferences and understanding complex oppositional reasoning.
Descriptors: College Entrance Examinations, Graduate Study, Test Items, Item Analysis, Verbal Ability, Test Construction, Validity, Intervals, Classification, Vocabulary Skills, Thinking Skills, Inferences, Evidence, Difficulty Level, Semantics, Regression (Statistics), Statistical Analysis, Factor Analysis
Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Graduate Record Examinations
Grant or Contract Numbers: N/A
Author Affiliations: N/A