Stage 1 — EVIDENCE BRIEF
Referee panel: Prof. Olivia Brandt (#57, statistics, C) · Prof. June Takahashi (#17, econometrics, C) · Domain specialist: Prof. Jamal Whitaker (#52, workforce education, C)
Ground rules from the panel: every number below was checked against the linked source during this round (today: 2026-09-24). Where we could not retrieve a primary source, we say "not verified this round" and nobody gets to lean on it. Effect sizes are in student-level standard deviations (SD) unless stated. Rough translation, which we will police: 0.10 SD is a meaningful but modest education effect; 0.40 SD is very large.
---
A. Achievement and the recovery
F1. NAEP 2024, grades 4 & 8 (released Jan 2025). Versus 2022: reading fell 2 points in both grades; 4th-grade math rose 2; 8th-grade math flat. All four remain below 2019. Below NAEP Basic: ~40% of 4th graders in reading (largest share since 2002), ~33% of 8th graders in reading (largest ever), ~25% 4th-grade math, ~40% 8th-grade math. NAGB: the lowest performers score "about 100 points below the highest-performing students," with the gap widening since roughly 2010. Only two state/grade/subject cells beat 2019: Louisiana 4th-grade reading, Alabama 4th-grade math. — NAGB release, 2025
F2. NAEP 2024, grade 12 (released Sept 2025). Math and reading each down 3 points vs 2019, the lowest ever reported on each assessment. 45% below Basic in math, 32% below Basic in reading (both records). At the 90th percentile scores held; lower percentiles fell, so the gap widened. More than half of seniors reported acceptance to a four-year college, a higher share than in 2019. — NAGB takeaways, 2025. Share at "college-ready" levels: 33% math (37% in 2019), 35% reading (37%). — Chalkbeat, 2025
F3. Education Recovery Scorecard (Kane/Reardon, Feb 2025; spring 2024 data). Students averaged nearly half a grade level behind 2019 in math and reading. Only 17% of grade 3–8 students are in districts above 2019 in math, 11% in reading, 6% in both. The richest-decile districts were ~4x as likely to have recovered in both as the poorest (14.1% vs 3.9%). The gap between affluent and low-income districts in math grew 11% since the pandemic. ESSER reduced losses in high-poverty districts by ~10% of a grade equivalent; districts that spent on tutoring and summer school recovered more. — Harvard CEPR, 2025
F4. Chronic absenteeism (missing ≥10% of days). ~15% in 2018-19 → 28.5% (2021-22) → 25.4% (2022-23) → 23.5% (2023-24). — AEI/Malkus, 2025. RAND estimates ~22% (~10.8M students) in 2024-25; about half of urban districts had ≥30% chronic absence; one-quarter of youth 12–21 said missing three weeks is "mostly OK." — RAND, 2025
B. Does money matter?
F5. Jackson, Johnson & Persico (QJE 2016). A 10% per-pupil spending increase sustained over all 12 school years, driven by court-ordered finance reforms: +0.27 completed years of schooling, +7.25% adult wages, −3.67 pp annual adult poverty; effects concentrated among low-income children. — NBER w20847
F6. Jackson & Mackevicius meta-analysis (AEJ: Applied 2024). $1,000 more per pupil for four years → +0.0316 SD test scores and +2.8 pp college-going; larger effects for disadvantaged students; capital and operating spending have similar marginal returns. — AEA
F7. Handel & Hanushek (Evaluation Review 2024). Using 16 test-score and 18 attainment studies: median effect of a 10% spending increase = 0.07 SD, but estimates range from −0.244 to +0.543 SD; half the test-score variance and over three-quarters of attainment variance reflect true differences across contexts that no study characteristic explains. Their warning is about generalizability, not sign. — Handel & Hanushek 2024 (PDF)_0.pdf)
F8. ESSER (CALDER WP 301, 2025). $1,000 more ESSER per pupil → +0.008 SD in district math (significant); reading similar but not significant. Full recovery at that rate would take $9,000–$13,000 more per pupil. — CALDER, 2025
C. Tutoring
F9. Saga/Match in Chicago (Guryan, Ludwig et al.). Two RCTs with 9th and 10th graders: +0.16 SD math in the first, +0.37 SD in the replication; cost $3,500–$4,300 per student per year. — NBER w28531
F10. Hybrid tech-assisted tutoring RCT (~4,000 students, 2 districts). 1:4 tutoring alternating with computer work → +0.23 SD math, about 30% cheaper than 1:2. — NBER w32510
F11. Kraft, Schueler & Falken (2024 working paper; Review of Educational Research 2026). Across 265 RCTs the pooled effect is 0.42 SD. For programs serving ≥1,000 students (US, standardized tests) it is 0.14 SD, and 0.21–0.25 SD for 400–999 students. Effects at scale are "a third to a half" of pilot effects. — EdWorkingPaper ai24-1031; J-PAL's earlier review (Nickow, Oreopoulos & Quan) is the baseline this updates: J-PAL
D. Reading and the "Southern surge"
F12. Mississippi NAEP 2024. 4th-grade reading 219 vs national 214, the first time above the national average; 4th-grade math 239 vs 237; 8th-grade reading 253 vs 257. With demographic adjustment (Urban Institute) Mississippi ranks first in 4th-grade reading and math and in 8th-grade math, and fourth in 8th-grade reading. — Mississippi First, 2025; discussion in Gelman blog, Dec 2025
F13. Mississippi's mechanism: the 2013 Literacy-Based Promotion Act. It combines coaches and phonics-focused training, K-3 screening three times a year, individual reading plans, and 3rd-grade retention (~6.5% retained in 2023). — Wikipedia summary. Fordham's 2019 retention critique noted 8% of K-3 students held back in 2018-19. Its 2022 update found the average age of 4th-grade NAEP takers was "almost identical in 2002 and 2017," so retention was not a major contributor. — Fordham
E. School choice
F14. Louisiana Scholarship Program (lottery, AEJ:Applied 2018). −0.4 SD math after one year, with negative effects in reading, science and social studies. The authors point to selection of low-quality private schools into the program. — AEA
F15. Indiana Choice Scholarship (Waddington & Berends). Public-to-private switchers: math −0.146, −0.163, −0.156 SD in years 1–3; ELA mostly null. — PMC
F16. Ohio EdChoice. Test scores: voucher users did worse than comparable public students, while eligible public schools improved modestly under competition. — Fordham/Figlio & Karbownik 2016. Attainment (Urban Institute, 2025): college enrollment 64% vs 48%, four-year 45% vs 30%, bachelor's degree 23% vs 15%, plus modest positive spillovers to eligible public schools. The design is matched comparison, not a lottery. — Urban 2025
F17. DC Opportunity Scholarship (lottery, 2010). High school graduation 82% with a voucher offer vs 70% without; math null; reading gain not significant. — Urban
F18. Florida competitive effects. Public schools facing more private-school competition improved more after the tax-credit scholarship began (Figlio & Hart, AEJ:Applied 2014). — AEA. An advocacy synthesis by the American Federation for Children reports Figlio-Hart-Karbownik (2023): ~0.166 SD in reading for high-competition public schools after 15 years. — AFC 2026. Note the source is an advocate.
F19. Arizona universal ESA. 92,362 students (Sept 15, 2025); FY2026 cost estimated at $1,036.9M against a $1,001.7M appropriation; average award $10,349. — Common Sense Institute, 2025. In the first universal year (2022-23), 71.2% of ESA students had not previously attended a public school. — LPI. EdChoice estimates net costs of the universal expansion (after switcher savings) at $178.3M in year 1 and $118.0M in year 2, i.e. 1.1% and 0.7% of AZ K-12 funding. — EdChoice 2025
F20. Federal Tax Credit Scholarship (OBBBA, P.L. 119-21). Up to $1,700 nonrefundable credit per donor starting in tax year 2027. Students qualify at ≤300% of area median income. JCT: $25.9B over 10 years. Participation is state opt-in. — BPC, ECS. 27 states had opted in by June 8, 2026. — IRS IR-2026-76
F21. Charters (CREDO NCSS3, 2023). Charter students gained +16 days of learning in reading and +6 in math per year vs matched TPS peers. CMO schools: +27 reading / +23 math; standalone charters: +10 reading / ~0 math. — CREDO press release; full report
F. Teachers, phones, early childhood
F22. Teacher pay (NEA, 2026 report). Average salary in 2024-25: $74,495 (+3.5% nominal). Average starting salary: $48,112. Average pay is ~5% lower in real terms than a decade ago. — NEA
F23. Teacher pay penalty (EPI, 2023 data). Weekly wages 26.6% below comparable college graduates (6.1% in 1996). Net of benefits the total-compensation penalty is 16.7%. — EPI
F24. Phones. 72% of high school teachers call phone distraction a major problem; 60% of those with a policy say it is hard to enforce. — Pew, 2024. Florida's statewide ban (Figlio & Özek, NBER w34388, Oct 2025): significant test-score gains in the second year and fewer unexcused absences; suspensions rose in year 1, disproportionately for Black students, then moderated. — NBER
F25. Tennessee VPK RCT (Durkin, Lipsey, Farran & Wiesen, Dev. Psych. 2022). 2,990 low-income children randomized by lottery. Children offered pre-K had lower state test scores in grades 3–6, with the largest negative effect in 6th grade, and more disciplinary infractions, worse attendance and more special-education placement. — abstract via EuropePMC, PMID 35007113
G. Higher education
F26. Sticker vs net price, 2025-26 (College Board). Published tuition and fees: public 4-year in-state $11,950; private nonprofit $45,000. Average net tuition at public 4-year in-state is ~$2,300, down from an inflation-adjusted peak of $4,450 in 2012-13. Private nonprofit net fell from $19,810 (2006-07, real) to $16,910. Grant aid has covered public 2-year tuition since 2009-10. — College Board Trends 2025
F27. Completion. Six-year completion rate for the fall-2017 entering cohort: 62.2%, flat vs the 2016 cohort. — NSC Research Center. This is the latest cohort we verified; newer cohorts were not verified this round.
F28. Student debt. $1.65T outstanding in Q2 2026; 10.6% of balances 90+ days delinquent, up from 10.3% the prior quarter. — NY Fed HHDC 2026Q2
F29. Bennett hypothesis. Lucca, Nadauld & Shen find ~60 cents of pass-through to tuition per $1 increase in the subsidized loan maximum, stronger at private and vocational programs. — NY Fed SR 733. Gordon & Hedlund's structural model attributes most of 1987–2010 tuition growth to federal loan expansion. — NBER w21967
F30. "Administrative bloat" (NCES Digest Table 314.20). Fall 1991 → fall 2022 headcounts: faculty 826,252 → 1,507,641 (+82.5%); graduate assistants +101.7%; all "other" (non-faculty) staff 1,521,232 → 1,973,819 (+29.7%). "Other" lumps growing professional and management staff together with shrinking clerical staff, and faculty counts include part-time adjuncts. — NCES
F31. OBBBA student-loan changes (final rule, Fed. Reg. May 1, 2026). Effective July 1, 2026:
- A new Repayment Assistance Plan: tiered % of AGI, $10 minimum payment, dependent adjustment.
- Grad PLUS ends for new borrowers.
- Graduate loans capped at $20,500/year and $100,000 aggregate; professional at $50,000/$200,000; lifetime cap $257,500.
- ED estimates net budget impact of −$409.3B (cohorts 1994–2035).
H. Career-technical and the federal role
F32. Career Academies RCT (MDRC). Over 8 years earnings rose 11% ($2,088/yr); for young men +17% ($3,731/yr). No reduction in college-going; diploma and postsecondary credential rates were similar across groups. — MDRC
F33. Germany. About half of German school leavers enter the dual VET (apprenticeship) system. — BIBB. US Registered Apprenticeship counts and P-TECH RCT figures: we could not retrieve the DOL or MDRC pages this round, so they are not verified. No one may cite specific numbers for them.
F34. Department of Education. Headcount fell from 4,133 (Jan 2025) to ~2,183 after the March 2025 reduction in force, about half, including ~600 voluntary separations. — ED press release, Mar 2025. Later transfers of program offices to Labor, HHS and other agencies (interagency agreements, late 2025), and the Supreme Court's July 2025 stay in McMahon v. New York, are widely reported but not re-verified this round.
---
Contested evidence (where the literature genuinely disagrees)
- Money. Jackson-Johnson-Persico and Jackson-Mackevicius find money matters, especially for poor kids. Handel-Hanushek agree the sign is usually positive but say magnitudes are unpredictable. CALDER's ESSER estimate (0.008 SD per $1,000) is roughly a quarter of the Jackson-Mackevicius per-$1,000 benchmark (0.0316 SD over four years; the time frames differ). Takahashi: the ESSER money was one-time, spent fast, and spent in a pandemic. That is weak evidence about recurring formula money, and equally weak evidence for it.
- Tutoring at scale. Pilots show 0.3–0.4 SD; at-scale programs show 0.14 SD (Kraft et al.). Both are real. The disagreement is over whether the gap reflects fixable implementation (dosage, in-school scheduling) or regression toward the true effect.
- Vouchers: test scores vs attainment. Test effects in the post-2012 programs (LA, IN, OH) are negative: huge in Louisiana, modest in Indiana. Attainment effects are positive or null (DC lottery grad +12 pp; Ohio's matched college results). Brandt: one of these must be mismeasured, or test scores are a poor proxy in private-school settings. We do not know which.
- Competition effects. Figlio-Hart (Florida) and Figlio-Karbownik (Ohio) find positive spillovers to public schools. Magnitudes are modest and come from specific designs.
- Mississippi. Real gains in grade 4; smaller in grade 8. The retention-artifact hypothesis was weakened by Fordham's age data but is not dead. No 12th-grade state NAEP exists to test persistence.
- Pre-K. Tennessee's RCT is negative through 6th grade. Perry and Abecedarian were tiny, intensive 1960s–70s programs whose long-run gains are widely cited (specific figures not re-verified this round). Boston's lottery-based studies are reported as positive on college-going (not re-verified this round). The disagreement is about program quality vs pre-K per se.
- Bennett hypothesis. 60-cent pass-through (Lucca et al.) vs falling real net prices at public 4-years since 2012-13 (College Board). Those can coexist, because states and institutions have raised grant aid, but advocates on each side cite only half.
- Administrative bloat. The raw NCES headcount does not show non-faculty staff outgrowing faculty since 1991. The category is too coarse to settle whether professional and administrative staff specifically outgrew instruction.
— Brandt, Takahashi, Whitaker