When the Every Student Succeeds Act took effect in December 2015, it attached evidence labels to federal education spending in a way no prior federal law had. Products and strategies used under Title I schoolwide plans and school improvement grants are expected to fall into defined evidence tiers, and vendors noticed: within a few years, nearly every sales deck in K-12 claimed to be «evidence-based.» Districts that understand what the tiers actually require — and how loosely the phrase is marketed — buy better.
What are the four ESSA evidence tiers?
The law defines tiers by study design, not by effect size or quality of the finding.
| Tier | ESSA name | What it requires |
|---|---|---|
| 1 | Strong evidence | At least one well-designed randomized controlled trial |
| 2 | Moderate evidence | At least one well-designed quasi-experimental study |
| 3 | Promising evidence | At least one correlational study with statistical controls |
| 4 | Demonstrates a rationale | A logic model and a plan to study effectiveness — no results required |
Two features of this ladder deserve attention. Tier 4, which requires no results at all, still qualifies a product for many uses, including schoolwide Title I strategies. And the tiers grade the design of the study, not the outcome: a well-run randomized trial that finds no effect is stronger evidence than a correlational study claiming large gains.
How do vendors market the tiers?
The recurring patterns are consistent enough to name. «Meets ESSA evidence requirements» often means the vendor believes it qualifies for some tier in some use — sometimes Tier 4, which requires only a rationale. «Proven to raise achievement» usually traces to one study, frequently conducted or commissioned by the vendor itself, on a small sample, in a district unlike yours. «Based on research» most often means the product's design borrows ideas from the science of reading or cognitive psychology, not that the product was tested.
The What Works Clearinghouse, operated by the Institute of Education Sciences, reviews studies against methodological standards and publishes intervention ratings; its reviews are slower than marketing and cover only a fraction of the market. Independent researchers and organizations like Evidence for ESSA at Johns Hopkins University have built searchable summaries aligned to the tiers, giving districts a check on vendor self-assessments.
What questions should a buying committee ask?
Four questions separate the tiers from the taglines. Who funded and who ran the study — the vendor, or an independent team with outcomes data access? What design was it — randomized, matched comparison, or correlational with controls? What population was studied — grade levels, subjects, and whether the district resembles it? And what was the actual outcome, including effect size and whether gains persisted? A vendor that cannot produce the study on request has answered the question regardless.
Why districts still buy weak evidence
The honest answer is that evidence is one input among many. Teachers want tools that reduce workload; administrators must spend categorical funds on allowable activities before deadlines; and the products with the strongest evidence are not always the ones with the best onboarding or the procurement-friendly contract. The workable standard is not «Tier 1 only.» It is: know which tier a claim rests on, require the underlying study, and treat Tier 4 enthusiasm as a reason to pilot with defined success metrics rather than a reason to buy.
What does a credible vendor study look like?
When a vendor does produce research, four hallmarks separate studies worth reading from studies worth filing. The comparison group exists and resembles the treatment schools demographically. Outcome measures are independent of the vendor — state test scores or district-administered assessments, not the product's own progress meter. The sample is large enough and described honestly, including how many schools dropped out. And the report links to the full study, not only the summary graphic on the marketing page.
Timing matters as much as design. A study conducted during the 2020–21 remote year measures something different from ordinary conditions, and a fair vendor acknowledges it. Effects also shrink in independent replication more often than they hold; a product with one vendor-run Tier 2 study and two independent null results is telling a story the marketing will not.
How do the tiers interact with funding rules?
The tiers carry money consequences, which is why marketing leaned in. School improvement funding under ESSA directs the lowest-performing schools toward interventions with strong or moderate evidence, and some state grant programs score applications higher for Tier 1 or Tier 2 products. A district writing those grants needs the evidence documentation anyway — which makes asking the four questions earlier a routine part of grant compliance rather than optional diligence.
A closing note on leverage
One structural imbalance is worth naming: the vendor's marketing team reads every study about its product, and the district's buying committee reads whatever the vendor sends. Free public resources — the clearinghouse, the tier-aligned summaries, the peer districts who ran the same pilot — exist to even that out, but only if someone on the committee is assigned to look. Making evidence review a named role on every purchase above a nominal threshold is the single cheapest procurement reform a district can adopt.
The bottom line for administrators
ESSA created a shared vocabulary for evidence, and vendors learned the vocabulary faster than most buying committees. Districts that ask for the study, not the label, keep the advantage the law intended them to have. Assigning evidence review to a named person on every significant purchase is the cheapest way to start.
For more context, read Retrieval practice works, but not as much as trainers claim.
For more context, read edtech pilots.
For more context, read Why FERPA's vendor exception decides what ed-tech can access.