NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1047056
Record Type: Journal
Publication Date: 2014-Nov
Pages: 17
Abstractor: As Provided
ISSN: ISSN-1944-7515
Generalizability and Decision Studies to Inform Observational and Experimental Research in Classroom Settings
Bottema-Beutel, Kristen; Lloyd, Blair; Carter, Erik W.; Asmus, Jennifer M.
American Journal on Intellectual and Developmental Disabilities, v119 n6 p589-605 Nov 2014
Attaining reliable estimates of observational measures can be challenging in school and classroom settings, as behavior can be influenced by multiple contextual factors. Generalizability (G) studies can enable researchers to estimate the reliability of observational data, and decision (D) studies can inform how many observation sessions are necessary to achieve a criterion level of reliability. We conducted G and D studies using observational data from a randomized control trial focusing on social and academic participation of students with severe disabilities in inclusive secondary classrooms. Results highlight the importance of anchoring observational decisions to reliability estimates from existing or pilot data sets. We outline steps for conducting G and D studies and address options when reliability estimates are lower than desired.
American Association on Intellectual and Developmental Disabilities. P.O. Box 1897, Lawrence, KS 66044-1897. Tel: 785-843-1235; Fax: 785-843-1274; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R324A100391