The current report focuses on evidence that the Math Nation program is effective at raising student achievement on the SAT. We use a post-facto quasi-experimental design (QED) with a matched control group to evaluate potential associations between Math Nation usage and SAT math achievement for 11th graders in Michigan. QEDs with a matching attempt to overcome the barriers of “non-random” assignment. In this case, the schools that chose to use Math Nation may be different in some ways (e.g., serve different student populations) than the schools that chose not to use Math Nation during the 2022-2023 school year.
Our main analyses focus on whether schools using Math Nation outperformed non-Math Nation schools on the math section of the SAT, as evidenced by average scores and proficiency rates, as well as growth scores. Secondary analyses examine whether schools that have consecutively used Math Nation for more years exhibit higher math performance. Finally, we also include follow-up analyses focused on sub-group findings.
To examine the impact of Math Nation on SAT math performance, we compared SAT math performance in schools using Math Nation compared to schools using other math programs. Our matched sample included 130 schools. Our main analysis focused on comparing SAT math performance in Math Nation schools versus non-Math Nation schools.
11th Grade
Overall, schools using Math Nation had higher percentages of above-average growth (M = 24.80, SD = 11.98) and average growth (M = 37.75, SD = 9.44) compared to non-Math Nation schools (above-average growth: M = 22.70, SD = 14.54; average growth: M = 35.73, SD = 13.95). Collectively, this represents a 4.11% gain in state testing growth in schools using Math Nation.
We also identified a positive trend, such that with each 1-year increase in the number of consecutive years using Math Nation, the percentage of above-average or average growth in the 2022-2023 school year increases. The difference in growth for schools who had used Math Nation for 3 years (M = 22.09) compared to schools who had never used Math Nation (M = 18.38) was a nearly 4% increase in above-average growth. Likewise, schools using Math Nation for 3 consecutive years had approximately 7% more students exhibiting average growth compared to schools who had never used Math Nation (0 years: M = 30.45; 3 years: M = 37.17). For both above-average and average growth metrics, each increase in consecutive years of Math Nation use corresponded with an increase in growth. Read the full report.
This report provides evidence that schools that used Math Nation in the 2022-2023 school year had higher math SAT average scores and above average/average growth rates for all students. Moreover, growth rates improved for all students as schools used Math Nation for more years. Lastly, differences were seen among several sub-groups of students. Collectively, these findings provide consistent evidence of the effectiveness of the Math Nation program.
Designed to make measurable impacts on student achievement, Accelerate Learning Inc. offers you a customized STEM solution for all your students. Learn how you can preview or demo our products for free.
Explore More Research & Case Studies
