ERIC Number: EJ1111587
Record Type: Journal
Publication Date: 2007-Mar
Pages: 35
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2330-8516
EISSN: N/A
Comparison of Multistage Tests with Computerized Adaptive and Paper-and-Pencil Tests. Research Report. ETS RR-07-04
Rotou, Ourania; Patsula, Liane; Steffen, Manfred; Rizavi, Saba
ETS Research Report Series, Mar 2007
Traditionally, the fixed-length linear paper-and-pencil (P&P) mode of administration has been the standard method of test delivery. With the advancement of technology, however, the popularity of administering tests using adaptive methods like computerized adaptive testing (CAT) and multistage testing (MST) has grown in the field of measurement in both theory and practice. In practice, several standardized tests have sections that include only set-based items. To date, there is no study in the literature that compares these testing procedures when a test is completely set-based under various item response theory (IRT) models. This study investigates the measurement precision of MST compared to CAT and compared to P&P tests for the one-, two-, and three-parameter logistic (1-, 2-, and 3PL) models when the test is completely set-based. Results showed that MST performed better for the 2- and 3PL models than an equivalent-length P&P test in terms of reliability and conditional standard error of measurement. In addition, findings showed that MST performed better for the 1- and 2PL models than for an equivalent length CAT test. For the 3PL model, MST and CAT performed about the same.
Descriptors: Comparative Analysis, Test Format, Computer Assisted Testing, Models, Test Length, Item Response Theory, Test Reliability, Error of Measurement, Test Content, Scores, Simulation, Statistical Analysis
Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A