NotesFAQContact Us
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1203497
Record Type: Journal
Publication Date: 2019
Pages: 20
Abstractor: As Provided
ISSN: ISSN-1364-5579
The Impact of Response Options Ordering on Respondents' Answers to Rating Questions: Results of Two Experiments
Terentev, Evgeniy; Maloshonok, Natalia
International Journal of Social Research Methodology, v22 n2 p179-198 2019
This paper aims to explore the response-order effects for rating questions presented in item-by-item and grid formats. It was hypothesized that the primacy effect occurs for both formats of questions, and that this effect is dependent on age, education, and type of device used for responding to questions. Two randomized experiments were conducted in 28 pre-course surveys of massive open online course students (N = 22,910). Our findings suggest that the order of response options affects respondents' perception of the option lists and their responding patterns. The primacy effect is found for the item-by-item question, while there is no evidence for the presence of such an effect for the grid question format. Primacy effect for the item-by-item layout is lower for respondents with higher education degree while there are no interaction effects between ordering and age, gender, and type of device. For a grid question, mixed results were observed.
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A