Evaluating a Predictive Model

Montana Early Warning System

Sponsored by the National Center for Education Research

 

Decorative Image

Based on what educators say, many traits stood out about high adoption schools. The EWS tool supported school reforms that differed in scope and intensity. Having the tool there kept the reforms in the forefront. Dropout is a complex phenomena with many intervening variables that enable students to stay in school or leave. In high adoption schools, stakeholders focused on the vision to implement the reforms, the values to engage the tool and produce positive outcomes, and the dissemination of the EWS data to make interventions targeted and effective. Without the leadership of the principals and the ability of the teachers to help students belong, reforms such as Multi Tierred System of Support and its ability to address dropout would not have been possible.

These high adoptions schools had the same characteristics of schools that tried the Early Warning System, but did not implement them. These schools are relatively high poverty but high adopting schools tended to be less well off than schools that tried and left. There was a shared demand to use the tool evidenced by low graduation rates, low test scores, and challenges with attendance. What made the high adoption school stand out was that there was support for teachers. Teachers earned more in high adoption schools than low adoption schools and stayed in their schools longer. More than student characteristics, these teacher characteristics showed why high adoption schools moved that needle to enable students to stay in school.


"I just think it gives us great access to information that really helps us identify those most at risk kids, so that our teachers can swoop in and do what they do best in terms of building relationships and helping that sense of belonging in school and adding those supports and intervention pieces that those students need to have the potential to be successful."

- Principal


Based on the numbers, we know that in schools supported by the Montana EWS there were increases in dropout rates. We can tell based on taking all high adoption schools and comparing them with non adoption schools. We can also tell by the increase in graduation rates in these schools. First, the system was accurate. An increase in student average risk score by 1% was associated with a 1.07% increase in dropout rates. Second, the tool was effective. Students that received an EWS score were 3% more likely to graduate. For high adoption schools, who generated scores more frequently, the more years a student was scored, the higher their possibility of graduating on time.

Click here for an EWS Summary

Decorative Image


"I think without the EWS data we would beat our heads against the wall trying to figure it out and identify a lot of those students. We don’t have the time or the resources to do what the EWS does. You know it’s quick and easy for us to identify students, but it would be a drain on us financially in terms of time and resources. I imagine all the time I’d spend trying to compile all that data. The per student cost is minimal compared to what it would cost without the EWS."

- Principal


Decorative Image

Publications


OPI Staff are here to help:

GEMS Helpdesk, opigemshelpdesk@mt.gov, 406-444-5222

Robin Clausen, SLDS Program Manager, 406-444-3793

 

 

Return to Data & Research Home