A rigorous study examined the impact of STEMscopes Science usage in grade 5 on school passing rates on the New Mexico Science Assessment of Science Readiness (NM-ASR) during the 2022–2023 school year. Schools who used STEMscopes Science showed a sizeable, statistically significant increase in performance on the NM-ASR compared to matched control schools. Results also indicated sizable school passing rate effects among student sub-populations including students eligible for free and reduced lunch as well as Hispanic/Latinx students.

Overview

Overall, STEMscopes science schools had an average increase of 6.5 percentage points. This is equivalent to an effects size of 0.39 and is considered a medium to large effect based on field standards (Brydges, 2019, Kraft, 2022). Put a different way, the average passing rate for non-STEMscopes schools was 27.4%. The average passing rate for STEMscopes was 33.90%; this represents a 23.7% increase and translates to approximately 204 more New Mexican students passing the NM-ASR in 2022-2023 in STEMscopes districts. This study had similar findings to an independent study conducted by Johns Hopkins University focused on Texas schools. It provides evidence in line with ESSA tier 2 and the What Works Clearinghouse 5.0 Group Design standards with reservations. 

Figure 1 NM-ASR 5th Grade

Figure 1. Note. All comparisons are significant at the p < .05 level.