ERIC Number: EJ1160298
Record Type: Journal
Publication Date: 2017
Abstractor: As Provided
School Self-Evaluation Instruments and Cognitive Validity. Do Items Capture What They Intend to?
Faddar, Jerich; Vanhoof, Jan; De Maeyer, Sven
School Effectiveness and School Improvement, v28 n4 p608-628 2017
School self-evaluation (SSE) often makes use of questionnaires in order to sketch a picture of the school. How respondents cognitively process questionnaire items determines the validity of SSE results. Still, one readily assumes that respondents interpret and answer items as intended by the instrument developer (referred to as cognitive validity), but it remains unclear whether they do. This study tested an exemplary SSE instrument by focusing on the extent to which SSE results are cognitively valid, and on the extent to which differences in cognitive validity can be attributed to respondents and/or items. Cognitive interviews with 20 participants made respondents' answering processes manifest. Results show that, overall, fewer than 50% of respondents' processes of interpreting and elaborating on items are cognitively valid. Cross-classified multilevel analyses indicate that various hierarchical levels, respondents and items, are significant in explaining differences in cognitive validity, but not for all stages of the answering process.
Descriptors: Self Evaluation (Individuals), Questionnaires, Cognitive Tests, Construct Validity, Interviews, Memory, Congruence (Psychology), Cognitive Psychology, Likert Scales, Teacher Surveys, Administrator Surveys, Outcome Measures, Cognitive Processes, Response Style (Tests), Qualitative Research, Elementary School Teachers
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Education
Authoring Institution: N/A
Grant or Contract Numbers: N/A