ERIC Number: EJ1047056
Record Type: Journal
Publication Date: 2014-Nov
Abstractor: As Provided
Generalizability and Decision Studies to Inform Observational and Experimental Research in Classroom Settings
Bottema-Beutel, Kristen; Lloyd, Blair; Carter, Erik W.; Asmus, Jennifer M.
American Journal on Intellectual and Developmental Disabilities, v119 n6 p589-605 Nov 2014
Attaining reliable estimates of observational measures can be challenging in school and classroom settings, as behavior can be influenced by multiple contextual factors. Generalizability (G) studies can enable researchers to estimate the reliability of observational data, and decision (D) studies can inform how many observation sessions are necessary to achieve a criterion level of reliability. We conducted G and D studies using observational data from a randomized control trial focusing on social and academic participation of students with severe disabilities in inclusive secondary classrooms. Results highlight the importance of anchoring observational decisions to reliability estimates from existing or pilot data sets. We outline steps for conducting G and D studies and address options when reliability estimates are lower than desired.
Descriptors: Generalization, Observation, Social Development, Student Participation, Severe Disabilities, Inclusion, Secondary School Students, Reliability, Decision Making
American Association on Intellectual and Developmental Disabilities. P.O. Box 1897, Lawrence, KS 66044-1897. Tel: 785-843-1235; Fax: 785-843-1274; e-mail: AJMR@allenpress.com; Web site: http://aaidd.allenpress.com
Publication Type: Journal Articles; Reports - Research
Education Level: Secondary Education
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R324A100391