For years, impact meant waiting for the end-of-year results. This is changing.
“Evidence” and “impact” may be the two most-used words in education right now, and the bar for what counts as evidence is rising. It used to be enough to report how many people an initiative reached, or how positively users described their own experience of it. That’s no longer sufficient. Schools, foundations and municipalities increasingly want to see actual behavior change and real outcomes, not just reach, and not just self-reported benefit.
This shift shows up in how initiatives get funded and evaluated. Impact bonds tie funding to measurable results. Results-based contracts pay providers only when defined outcomes are achieved. Foundations and investors are asking harder questions about the societal value their resources are truly creating.
Why this is hard in education
Proving impact is hard everywhere, but education makes it harder than most fields.
Outcomes take a long time to show up. A student engagement initiative today may not visibly affect test scores, graduation rates, mental health, or lifetime earnings for years, sometimes a decade or more, which makes waiting for “the evidence” close to useless as a way of managing something in real time.
And even when outcome data finally arrives, it rarely isolates the thing you actually changed. Even fairly early outcomes like a test score, an attendance rate, or a dropout figure, are each shaped by dozens of forces at once: home environment, teacher turnover, a new curriculum, a hard year for a particular cohort. Isolating the effect of any single initiative from everything else happening around a child is close to impossible, and building research solid enough to do it properly takes years and real money, by which point, in a fast-moving digital era, the initiative itself has often changed.
The need for certainty isn’t disappearing. But something else is emerging alongside it: attention to what’s happening right now, not just what shows up months or years later. Continuous, real-time signals from inside the classroom, the kind that move long before attendance or test scores do.
The fastest of these is what’s happening in a classroom right now: mood, engagement, the early behavioral shifts that happen weeks or months before anything shows up in a report. Signals at this level are close to the ground and useful almost immediately for the people inside the initiative. But on their own, they don’t tell a funder or a district what happened to test scores, or what any of it is worth five years from now.
For that, schools still lean on the data they already collect: attendance, test scores, behavioral incidents. It’s more familiar, more comparable across schools, and closer to what a district or ministry already reports on. But it’s slow to move, and it bundles together dozens of causes at once, a dip in attendance might reflect a new initiative, a flu season, or nothing in particular. It’s valuable, but it arrives late and rarely tells the whole story.
What this means for the classroom
A class doesn’t have to wait until June to know something is working. If mood or engagement is shifting now, that’s a win a teacher and a class can feel and see together, months before it would ever show up in a yearly outcome.
That matters for more than information. Motivation doesn’t survive on faith alone. A class that can see its own progress has something to point to: we tried this, and it’s working. That’s what keeps a practice alive past the first few weeks of enthusiasm, when most new initiatives quietly lose steam.
What this means for the school
Most schools are running several initiatives at once, all aimed, eventually, at the same handful of outcomes: better test scores, better attendance, fewer behavioral incidents. Real-time, initiative-level signals let a school follow each one closer to where it actually happens, rather than waiting for all of them to blur together in a single yearly number.
That means a school can better see which initiative is moving the needle, not just that the needle moved. It’s the difference between “our numbers went up this year” and “this specific initiative is what moved them.” And that’s something a school can act on: keep funding what’s working, expand it with confidence, or learn from why it worked, and apply that somewhere else.
Students can see how their whole class is doing without ever being exposed themselves. And when that data shows a classroom wellbeing shift and holds over time, not just a good day, that’s what we call a Pattern Break: real sustained change. Now, we seek to observe and measure that Pattern Break and its relationship to other key indicators at school: attendance, behavior and learning outcomes.
Lea Crusey, Teach For America alumna and Co-founder of WOOF
