ERIC Number: EJ723968
Record Type: Journal
Publication Date: 2005
Reference Count: N/A
Reliability as a Measurement Design Effect
Adams, Raymond J.
Studies in Educational Evaluation, v31 n2-3 p162-172 2005
Test reliability is a concept central to classical test theory and it is commonly stated as a requirement that a test attain a certain level of reliability before it be considered of sufficient quality for practical use. This article discusses the role of reliability in item response theory, and in particular the role of reliability in contexts where matrix sampling designs are used and concern is with the estimation of population parameters rather than the measurement of individuals. The concept of a measurement design effect is introduced. This concept parallels the concept of sampling design effects, in that it describes the impact of measurement error at the individual level (described through a reliability index) on the accuracy with which population parameters are estimated.
Descriptors: Test Reliability, Error of Measurement, Item Sampling, Item Response Theory, Educational Research, Measurement Techniques
Elsevier Customer Service Department, 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126 (Toll Free); Fax: 407-363-1354; e-mail: firstname.lastname@example.org.
Publication Type: Journal Articles; Reports - Descriptive
Education Level: N/A
Authoring Institution: N/A