NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
ERIC Number: ED613901
Record Type: Non-Journal
Publication Date: 2021-Jun
Pages: 61
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-
EISSN: N/A
An Evaluation of the Literacy-Infused Science Using Technology Innovation Opportunity (LISTO) i3 Evaluation (Valid 45) Final Report
Wolf, Rebecca; Cook, Michael; Reid, Alan; Neitzel, Amanda; Ross, Steven; Risman, Kelsey
Grantee Submission
The purpose of this study was to evaluate the Literacy-Infused Science Using Technology Innovation Opportunity (LISTO) validation project (Valid 45). LISTO was funded by the Investing in Innovation (i3) Fund and involved a multi-year intervention that provided virtual professional development and coaching, and literacy-infused science curricula to fifth-grade science teachers who taught predominantly low-income students and in predominantly rural public schools in Texas. The overarching goal of LISTO is to validate, via a 5-year longitudinal randomized controlled trial (RCT) study, literacy-infused science (LIS) instructional and curricular innovations to increase instructional capacity of teachers and to improve students' science and reading/writing literacy achievement in rural/non-rural schools for economically challenged (EC), inclusive of English language learners (ELL) students. Outcomes collected in the 2017-18 school year were considered to be exploratory, given the timing of Hurricane Harvey, which impacted Texas in August of 2017. Outcomes in the 2018-19 school year served as the confirmatory contrasts. LISTO resulted in increased teacher capacity to implement research-based strategies while teaching science content, yet this improvement did not necessarily translate into improved student achievement in science or reading. The LISTO professional development and coaching covered pedagogical strategies for teaching science, including those that have been shown to improve literacy and be particularly effective for ELs. There was a negative impact on students' science achievement in both 2017-18 (ES = -0.10) and in 2018--19 (ES = -0.13). There was a negative program impact on students' science interest (ES = -0.14), as measured by a survey, in 2017-18, and no impact in 2018-19. These quantitative findings were in conflict with qualitative data collected from LISTO teachers, who indicated that the program led to improvements in both science vocabulary and engagement and self-efficacy in science for students. LISTO had positive effects on teacher practices for a subsample of teachers, specifically on increased delivery of research-based instruction to teach science content as rated on a rubric by external reviewers (ES = +1.12). LISTO appeared to improve instructional practices for a sample of teachers who implemented the program for two years with complete data but did not positively impact student or teacher outcomes more broadly. However, results should be cautiously interpreted due to limitations of delayed and incomplete implementation in the first year of the project due to Hurricane Harvey. Encouragingly, teachers' overall positive reactions to the program suggest its potential to improve student affect and learning, but more extensive implementation experience by teachers and multi-year exposure by students starting from early grades may be needed to yield measurable benefits. Clearly, such focuses emerge as a highly recommended topic for future research.
Publication Type: Reports - Research
Education Level: Elementary Education; Grade 5; Intermediate Grades; Middle Schools
Audience: N/A
Language: English
Sponsor: Office of Innovation and Improvement (ED), Investing in Innovation (i3)
Authoring Institution: Johns Hopkins University, Center for Research and Reform in Education (CRRE)
Identifiers - Location: Texas
Identifiers - Assessments and Surveys: Iowa Tests of Basic Skills
Grant or Contract Numbers: U411B160011
What Works Clearinghouse Reviewed: Meets Evidence Standards with Reservations