ERIC Number: EJ1139171
Record Type: Journal
Publication Date: 2016-Feb
Abstractor: As Provided
Coding Cognitive Interviews: An Approach to Enhancing the Value of Cognitive Testing for Survey Question Evaluation
Fowler, Floyd J.; Lloyd, Stephanie J.; Cosenza, Carol A.; Wilson, Ira B.
Field Methods, v28 n1 p3-20 Feb 2016
Cognitive testing has become routine for well-designed surveys. However, the protocols for cognitive testing vary widely, and observers have been concerned that analysis of the results is not systematic, that results are not replicable, and that the bases for conclusions are not transparent. To address some of those concerns, in this study the cognitive interviews were structured so that interviewers gathered information specifically about whether there was a problem with any of the four standard issues in question answering: comprehension, retrieval, estimation, and providing an answer. From the tape-recorded interviews, the percentage of respondents who had "no problem" with each element of question answering was tabulated for each question. In addition to being systematic and transparent, a strength of the approach is that it documents the positive features of questions, potentially providing evidence for the validity of answers as well as identifying possible question problems.
Descriptors: Coding, Interviews, Intelligence Tests, Audio Equipment, Validity, Patients, Acquired Immunodeficiency Syndrome (AIDS), Drug Therapy, Compliance (Psychology), Questionnaires, Surveys, Language Processing, Statistical Analysis, Case Studies, Cognitive Tests
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: firstname.lastname@example.org; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research; Tests/Questionnaires
Education Level: N/A
Sponsor: National Institute of Mental Health (DHHS/NIH)
Authoring Institution: N/A
Identifiers - Location: Rhode Island (Providence); Massachusetts (Boston)
Grant or Contract Numbers: RO1MH092238; 2K24MH092242