ERIC Number: EJ910863
Record Type: Journal
Publication Date: 2010
Abstractor: As Provided
Reference Count: 69
Do Concept Inventories Actually Measure Anything?
Wallace, Colin S.; Bailey, Janelle M.
Astronomy Education Review, v9 n1 p010116-1-010116-34 2010
Although concept inventories are among the most frequently used tools in the physics and astronomy education communities, they are rarely evaluated using item response theory (IRT). When IRT models fit the data, they offer sample-independent estimates of item and person parameters. IRT may also provide a way to measure students' learning gains that circumvents some known issues with Hake's normalized gain. In this paper, we review the essentials of IRT while simultaneously applying it to the Star Properties Concept Inventory. We also use IRT to explore an important psychometrics debate that has received too little attention from physics and astronomy education researchers: What do we mean when we say we "measure" a mental process? This question leads us to use IRT to address the provocative question that constitutes the title of this paper: Do concept inventories actually measure anything? (Contains 18 figures and 9 tables.)
Descriptors: Astronomy, Science Tests, Multiple Choice Tests, Item Response Theory, Test Theory, Scientific Concepts, Achievement Gains, College Students, Science Education
American Astronomical Society. 2000 Florida Avenue NW Suite 400, Washington, DC 20009. Tel: 800-874-6383; Fax: 516-349-9704; e-mail: email@example.com; Web site: http://aer.aip.org
Publication Type: Journal Articles; Reports - Evaluative
Education Level: Higher Education; Postsecondary Education
Authoring Institution: N/A