NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1223656
Record Type: Journal
Publication Date: 2019
Pages: 34
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1062-7197
EISSN: N/A
Validity Evidence Supporting Use of Anchoring Vignettes to Measure Teaching Practice
Kaufman, Julia H.; Engberg, John; Hamilton, Laura S.; Yuan, Kun; Hill, Heather C.
Educational Assessment, v24 n3 p155-188 2019
High-quality measures of instructional practice are essential for research and evaluation of innovative instructional policies and programs. However, existing measures have generally proven inadequate because of cost and validity issues. This paper addresses two potential drawbacks of survey self-report measures: variation in teachers' interpretation of response scales and their interpretation of survey questions. To address these drawbacks, researchers tested out use of "anchoring vignettes" in teacher surveys to capture information about teaching practice, and they gathered validity evidence in regard to their use as a tool for adjusting teachers' survey self-reports about their instructional practices for research purposes, or potentially to inform professional development. Data from 65 teachers in grades 4-9 responding to our survey suggested that vignette adjustments were reliable and valid for some instructional practices more than others. For some instructional practices, researchers found significant and high correlations between teachers' adjusted survey self-rating, through use of anchoring vignettes, and previous observation ratings of teachers' instruction, including ratings from several widely-used observation rubrics. These results suggest that anchoring vignettes may provide an efficient, cost-effective method for gathering data on teachers' instruction.
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research; Tests/Questionnaires
Education Level: Elementary Education; Grade 4; Intermediate Grades; Grade 5; Middle Schools; Grade 6; Grade 7; Junior High Schools; Secondary Education; Grade 8; Grade 9; High Schools
Audience: N/A
Language: English
Sponsor: National Science Foundation (NSF), Education and Human Resources (EHR)
Authoring Institution: N/A
Grant or Contract Numbers: 1237543