NotesFAQContact Us
Collection
Advanced
Search Tips
ERIC Number: ED445002
Record Type: Non-Journal
Publication Date: 2000-Apr
Pages: 34
Abstractor: N/A
ISBN: N/A
ISSN: N/A
EISSN: N/A
Developing a Research Plan for an Online Assessment Program.
Patelis, Thanos; Way, Walter D.; Elliot, Scott
The purpose of this paper is threefold. First, the description of a research plan for a large-scale computer adaptive testing program migrating from a network to Internet version is presented. The general areas needed in such a research plan include: (1) comparability studies; (2) psychometric analyses; (3) development projects; (4) validity studies; and (5) audits. Second, some data showing the comparability between the network and Internet version of one test (i.e., Elementary Algebra) are presented. Simulations used actual test questions with previously calibrated parameters at known ability groups. The comparability results examine comparability in ability estimates, scale scores, performance levels, course placements, and content specifications. The third aspect of this paper is to suggest the use of the "Association of Test Publisher's Provisional Guidelines" in the development of a research plan. Limitations in the simulation data require additional research. Next steps to replicate the comparability studies are presented. Appendixes contain a discussion of characteristics of the Elementary Algebra test, summaries of item pool parameters, a summary of performance level statements, and an outline of system functionality specifications. (Contains 8 figures and 19 references.) (Author/SLD)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A