Key Findings

Combined Sample, 6^th– 8^th Grade

• Schools using Math Nation scored approximately 3 points higher than schools using other math programs on the FAST, and this difference was statistically significant. See Figure 1.
• Math Nation schools had significantly more students reaching Level 5 proficiency (12.48%) compared to non-Math Nation schools (9.88%). See Figure 2.

Grade Level Comparisons

Sixth Grade

• Math Nation schools had higher percentages of 6^th grade students reaching Level 3 proficiency (24.08%) and Level 5 proficiency (11.52%) than non-Math Nation schools (Level 3: 22.96%, Level 5: 10.96%), although this difference did not reach statistical significance. See Figure 3.
• Math Nation schools had significantly higher percentages of 6^th grade students reaching Level 3 (24.08%) and Level 4 proficiency (24.58%) compared to the 6^th grade statewide averages (Level 3: 21.97%, Level 4: 21.80%). See Figure 4.

Seventh Grade

• The main effect of Math Nation on average FAST scale scores and all proficiency rates were significant at the .05 level, apart from Levels 3 and 4. Additionally, effect sizes for all tests ranged from 0.38-0.46. See Table 1.

• However, the main effect of Math Nation on the percentage of 7^th grade students achieving Level 4 proficiency was marginally significant at p = .06.
• Seventh grade students using Math Nation scored nearly 6 points higher than 7^th grade students who did not use Math Nation. See Figure 5.
• Schools using Math Nation had significantly fewer 7^th grade students at the Level 1 (6.11% less) and Level 2 (3.25% less) proficiency levels. See Figure 6.
• Schools using Math Nation had significantly more 7^th grade students achieving higher proficiency levels, with 3.38% more students achieving Level 4, 5.9% more students achieving Level 5, and 9.46% more students achieving Level 3 or above when compared to 7^th graders at non-Math Nation schools. See Figure 6.

Eighth Grade

• Math Nation schools had slightly higher 8^th grade FAST scores (M = 328.24) than non-Math Nation schools (M = 326.80), although this difference did not reach statistical significance.
• Math Nation schools had lower percentages of 8^th grade students at Levels 1 (19.68%) and Level 2 (21.28%) proficiency than 8^th grade students at non-Math Nation schools (Level 1: 21.48%, Level 2: 22.52%), although this difference did not reach statistical significance. See Figure 7.
• Math Nation schools had higher percentages of 8^th grade students reaching Level 4 (23.72%), Level 5 (11.52%), and Level 3 or above (59.08%) proficiency when compared to 8^th grade students at non-Math Nation schools (Level 4: 21.64%, Level 5: 10.96%, Level 3 or above: 56.04%). However, these differences did not reach statistical significance. See Figure 7.
• Math Nation schools had significantly more students reaching Level 4 proficiency (18.90%) than the state average (14.70%). See Figure 8.

Conclusions

This report provides evidence that schools that used Math Nation in the 2022-2023 school year had higher math achievement in 6^th-8^th grade. Schools that used Math Nation had significantly higher scores and significantly higher percentages of students achieving Level 5 proficiency. Specifically, Math Nation schools scored 2.90 points higher and had 2.60% more students who achieved Level 5 proficiency. Differences were also seen between each grade level. In 6^th grade, schools using Math Nation had 2.11% more students scoring at the Level 3 proficiency level, and 2.78% more students scoring at the Level 4 proficiency level compared to the statewide average. The effects of Math Nation were particularly robust for 7^th grade students. Specifically, schools that used Math Nation in 7^th grade had a significant 6-point increase in scores, had significantly fewer students at Levels 1 and 2, and nearly 6% more students achieving Level 5 proficiency. Moreover, almost 10% more 7^th grade students achieved Level 3 or higher when using Math Nation compared to their non-Math Nation peers. Effect sizes were medium to large based on field standards. Lastly, 8^th grade students using Math Nation had 4% more students achieving Level 4 proficiency when compared to the statewide average, representing a significant increase. Taken together, these findings provide consistent support for the effectiveness of Math Nation.