NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ910863
Record Type: Journal
Publication Date: 2010
Pages: 34
Abstractor: As Provided
Reference Count: 69
ISSN: ISSN-1539-1515
Do Concept Inventories Actually Measure Anything?
Wallace, Colin S.; Bailey, Janelle M.
Astronomy Education Review, v9 n1 p010116-1-010116-34 2010
Although concept inventories are among the most frequently used tools in the physics and astronomy education communities, they are rarely evaluated using item response theory (IRT). When IRT models fit the data, they offer sample-independent estimates of item and person parameters. IRT may also provide a way to measure students' learning gains that circumvents some known issues with Hake's normalized gain. In this paper, we review the essentials of IRT while simultaneously applying it to the Star Properties Concept Inventory. We also use IRT to explore an important psychometrics debate that has received too little attention from physics and astronomy education researchers: What do we mean when we say we "measure" a mental process? This question leads us to use IRT to address the provocative question that constitutes the title of this paper: Do concept inventories actually measure anything? (Contains 18 figures and 9 tables.)
American Astronomical Society. 2000 Florida Avenue NW Suite 400, Washington, DC 20009. Tel: 800-874-6383; Fax: 516-349-9704; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Evaluative
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A