ERIC Number: ED562580
Record Type: Non-Journal
Publication Date: 2011
Abstractor: As Provided
A Review of Models for Computer-Based Testing. Research Report 2011-12
Luecht, Richard M.; Sireci, Stephen G.
Over the past four decades, there has been incremental growth in computer-based testing (CBT) as a viable alternative to paper-and-pencil testing. However, the transition to CBT is neither easy nor inexpensive. As Drasgow, Luecht, and Bennett (2006) noted, many design engineering, test development, operations/logistics, and psychometric changes are required to develop a successful operational program. Early research on CBT almost exclusively focused on theoretical issues such as improving measurement efficiency by achieving adequate levels of test score reliability using as few items as possible. However, it was soon evident that practical issues--such as ensuring content representation, making sure all examinees have sufficient time to complete the test, implementation of new item types, and controlling the degree to which items were exposed to examinees--needed to be addressed, too. In the past few years, research on CBT has focused on developing models that achieve desired levels of measurement efficiency while simultaneously satisfying other important goals, such as minimizing item exposure and maintaining content validity. In addition, there has been a growing awareness among practitioners that basic CBT research using small samples or simulation studies needs to be vetted using cost-benefit analysis, as well as engineering design and implementation criteria to ensure that feasibility, scalability, and efficiency are evaluated in more concrete ways than by merely reporting a reduction of error variances for theoretical examinee scores (Luecht, 2005a, 2005b).
Descriptors: College Entrance Examinations, Computer Assisted Testing, Educational Technology, Evaluation Methods, Test Construction, Delivery Systems, Barriers, Mastery Tests, Scores, Measurement Techniques, Test Length, Psychometrics, Computer Software, Time, Standardized Tests, Navigation
College Board. 250 Vesey Street, New York, NY 10281. Tel: 212-713-8000; e-mail: email@example.com; Web site: http://research.collegeboard.org
Publication Type: Reports - Research
Education Level: Higher Education; Postsecondary Education
Authoring Institution: College Board
Identifiers - Assessments and Surveys: Advanced Placement Examinations (CEEB); Preliminary Scholastic Aptitude Test; SAT (College Admission Test)
Grant or Contract Numbers: N/A