ERIC Number: EJ1158062
Record Type: Journal
Publication Date: 2017-Nov
Pages: 18
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1525-822X
EISSN: N/A
Investigating Cognitive Effort and Response Quality of Question Formats in Web Surveys Using Paradata
Höhne, Jan Karem; Schlosser, Stephan; Krebs, Dagmar
Field Methods, v29 n4 p365-382 Nov 2017
Measuring attitudes and opinions employing agree/disagree (A/D) questions is a common method in social research because it appears to be possible to measure different constructs with identical response scales. However, theoretical considerations suggest that A/D questions require a considerable cognitive processing. Item-specific (IS) questions, in contrast, offer content-related response categories, implying less cognitive processing. To investigate the respective cognitive effort and response quality associated with A/D and IS questions, we conducted a web-based experiment with 1,005 students. Cognitive effort was assessed by response times and answer changes. Response quality, in contrast, was assessed by different indicators such as dropouts. According to our results, single IS questions require higher cognitive effort than single A/D questions in terms of response times. Moreover, our findings show substantial differences in processing single and grid questions.
Descriptors: Online Surveys, Test Format, Test Items, Difficulty Level, Responses, Attitude Measures, Reaction Time, College Students, Foreign Countries
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Germany
Grant or Contract Numbers: N/A