ERIC Number: EJ1137583
Record Type: Journal
Publication Date: 2017-Mar
Abstractor: As Provided
Controlling for Response Order Effects in Ranking Items Using Latent Choice Factor Modeling
Vriens, Ingrid; Moors, Guy; Gelissen, John; Vermunt, Jeroen K.
Sociological Methods & Research, v46 n2 p218-241 Mar 2017
Measuring values in sociological research sometimes involves the use of ranking data. A disadvantage of a ranking assignment is that the order in which the items are presented might influence the choice preferences of respondents regardless of the content being measured. The standard procedure to rule out such effects is to randomize the order of items across respondents. However, implementing this design may be impractical and the biasing impact of a response order effect cannot be evaluated. We use a latent choice factor (LCF) model that allows statistically controlling for response order effects. Furthermore, the model adequately deals with the known issue of ipsativity of ranking data. Applying this model to a Dutch survey on work values, we show that a primacy effect accounts for response order bias in item preferences. Our findings demonstrate the usefulness of the LCF model in modeling ranking data while taking into account particular response biases.
Descriptors: Evaluation Methods, Social Science Research, Sociology, Structural Equation Models, Multivariate Analysis, Foreign Countries, Online Surveys, Response Style (Tests), Statistical Analysis, Responses, Models
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: email@example.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A
Identifiers - Location: Netherlands
Grant or Contract Numbers: N/A