ERIC Number: EJ783183
Record Type: Journal
Publication Date: 2007
Reference Count: 0
Reducing the Length of Questionnaires through Structurally Incomplete Designs: An Illustration
Smits, Niels; Vorst, Harrie C. M.
Learning and Individual Differences, v17 n1 p25-34 2007
This paper serves as an illustration of the usefulness of structurally incomplete designs as an approach to reduce the length of educational questionnaires. In structurally incomplete test designs, respondents only fill out a subset of the total item set, while all items are still provided to the whole sample. The scores on the unadministered items are subsequently dealt with by using methods for the estimation of missing data. Two structurally incomplete test designs--one recording two thirds, and the other recording a half of the potentially complete data--were applied to the complete item scores on 8 educational psychology scales. The incomplete item scores were estimated with missing data method Data Augmentation. Complete and estimated test data were compared at the estimates of total scores, reliability, and predictive validity of an external criterion. The reconstructed data yielded estimates that were very close to the values in the complete data. As expected the statistical uncertainty was higher in the design that recorded fewer item scores. It was concluded that the procedure of applying incomplete test designs and subsequently dealing with the missing values is very fruitful for reducing questionnaire length.
Descriptors: Educational Psychology, Predictive Validity, Illustrations, Test Construction, Questionnaires, Test Reliability
Elsevier. 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126; Tel: 407-345-4020; Fax: 407-363-1354; e-mail: firstname.lastname@example.org; Web site: http://www.elsevier.com
Publication Type: Journal Articles; Reports - Descriptive
Education Level: N/A
Authoring Institution: N/A