This study tested the theory that district use of STEMscopes Science curriculum may increase reading and mathematics proficiency through increases in science proficiency. Academic learning and achievement is often a synergistic process, with student learning in one subject potentially bolstering learning in other subjects. We proposed that exposure to the STEMscopes Science curriculum not only increases students' science proficiency but possibly their reading and math as well. Specifically, we suggested a process such that: STEMscopes Science curriculum increased science proficiency which, in turn, increased reading and/or math proficiency (see figure). STEMscopes Science supports science instruction that (among other things) includes and targets the specialized language used within science (e.g., vocabulary), comprehension, and leveled reading. It also targets computation skills within scientific observational settings and investigations that are part of realistic problem-based and experiential learning. As student learning in science increases, in turn, we may expect increases in reading and math learning.

To test this possibility, we used a mediation model with scores from the 2021 State of Texas Assessments of Academic Readiness (STAARTM). Mediation models are models that include multiple simultaneous regressions and test a process regarding how an outcome (such reading and math proficiency) is associated with a predictor (use of STEMscopes science curriculum by a district) through an additional variable such as science proficiency. Within a mediation model, we can also include other important predictors of science, reading and math proficiency to ensure that results of the model are not due to one of these other predictors instead of STEMscopes. Within this large mediation model, we evaluated whether the added "pathway" or process whereby STEMscopes Science curriculum affects reading and math proficiency through science proficiency is significant, and what potential effect it has on proficiency in reading and math. Districts were identified as STEMscopes districts if they had a subscription to STEMscopes science for students in 5th and/or 8th grade and showed usage of STEMscopes based on the analytics data. Please note analyses were run separately by grade. The state of Texas creates proficiency benchmarks in science, reading, and math; identifying students as not proficient, approaching grade-level proficiency, meeting grade-level proficiency, and mastering grade-level proficiency. The percentage of students who approach grade-level performance is used by the state as the district passing rate for science, reading and math and was used here. We also accounted for other important predictors of science, reading and math including 2018-2019 passing rates as well as district demographics, including the size of the district, whether the district was a charter school district, average teacher experience, district attendance rate, and student race/ethnicity, socioeconomic status, and LEP status. In addition, because the 2020-2021 data were collected during the COVID-19 pandemic, we also include %remote as a covariate as many children were not physically in school full time during 2020-2021. 

Results

As noted, in the previous 5th grade Texas Proficiency Report and 8th grade report, STEMscopes Science districts had significantly higher science proficiency rates compared to districts that did not use STEMscopes science (even when controlling for other important variables that influence student proficiency). This is the first path (first step of the process) in the mediation model. The next part of the model tested was whether science proficiency predicted reading and math proficiency (tested separately) for the same year (and tested separately by grade). Results indicated science proficiency rates predicted districts’ reading and math proficiency rates for both 5th and 8th grade students. As an overall test of the two step process (STEMscopes -> science -> reading or math), the final step of a mediation model is to consider both steps together. We can interpret the overall test of the process as “STEMscopes Science curriculum’s effect on reading and math proficiency through science proficiency.” For 5th grade reading (controlling for previous district reading passing rates), districts that used STEMscopes had a 0.91 percent increase in reading proficiency (through STEMscopes effect on science) compared to non-STEMscopes districts. This change was significant and equates to approximately 2,509 more children meeting the reading benchmark within STEMscopes districts. For 5th grade math (controlling for previous math passing rates), districts that used STEMscopes had a 0.94 percent increase in math proficiency (through STEMscopes effect on science) compared to non-STEMscopes districts. This change was also significant and equates to approximately 2,652 more children meeting the math benchmark within STEMscopes districts. We also had significant findings for 8th grade. Specifically, for 8th grade reading (controlling for previous district reading passing rates), districts that used STEMscopes had a 2.00 percent increase in reading proficiency (through STEMscopes effect on science) compared to non-STEMscopes districts. This equates to approximately 2,619 more students meeting the reading benchmark within the tested STEMscopes districts. For 8th grade math (controlling for previous math passing rates), districts that used STEMscopes had a 1.93 percent increase in math proficiency (through STEMscopes effect on science) compared to non-STEMscopes districts. This change was also significant and equates to approximately 2,527 more students meeting the math benchmark within tested STEMscopes districts.