NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ1123148
Record Type: Journal
Publication Date: 2016-Dec
Pages: 13
Abstractor: As Provided
ISSN: EISSN-1531-7714
Macro- and Micro-Validation: Beyond the "Five Sources" Framework for Classifying Validation Evidence and Analysis
Newton, Paul E.
Practical Assessment, Research & Evaluation, v21 n12 Dec 2016
This paper argues that the dominant framework for conceptualizing validation evidence and analysis--the "five sources" framework from the 1999 "Standards"--is seriously limited. Its limitation raises a significant barrier to understanding the nature of comprehensive validation, and this presents a significant threat to effective validation practice. Motivated by a belief that "validity by design" ought to be substantiated through "validation of design" this paper demonstrates the importance of adopting a broader conceptual framework. It introduces a new framework, based upon the metaphor of different validation lenses through which to scrutinize assessment procedures at differing levels of detail, with micro-validation lenses at one end of a continuum and macro-validation lenses at the other. The evolution of validation theory can be seen as a very gradual, if somewhat reluctant, acknowledgement of the importance of micro-validation. This paper recommends micro-validation as the natural foundation for any comprehensive validation program.
Center for Educational Assessment. 813 North Pleasant Street, Amherst, MA 01002. e-mail:; Tel: 413-577-2180; Web site:
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A