Many changes are starting to ripple down to the classroom level as Ohio moves forward with its efforts to implement corporate education reform. One of those changes is the creation and increasing use of teacher level value add reports. We provided some basic background on value add here if you need a refresher.
One of the most important steps in producing these complex reports for each teacher is to know which teacher taught which student, in which subject, and for how long. We need to know this for every student and every teacher. It's a process called "linkage". Without this linkage teachers could not be credited with the instruction they provided to each student.
By 2013, it will not be just RttT districts and Battelle for Kids’ projects that will require this linkage to occur, but all school districts must “implement a classroom-level value-added program (HB 153; Section 3319.112(A)(7)).
These teacher-level value-added reports will be used to determine teacher effectiveness and will be a significant factor in teacher evaluations. So it is clear that being able to accurately link student to teacher per subject is going to be critical if this system has any hope of working fairly.
If one imagines common scenarios such as students moving, teachers getting sick and having a sub, and one multiplies that by over 120,000 teachers in Ohio and almost 2 million students - the opportunity for linkage error is simply massive, only surpassed by the sheer magnitude of the administrative effort needed to keep this whole enterprise from unravelling.
Battelle for Kids has spent part of the summer providing some training and webinars on this issue.
Everytime a student moves, someone will have to go into a computer system and remove them from each teacher's roster, and then when that student enrolls in a new school, someone will have to go into a computer system and add them to each of their new teacher's rosters. Ditto for students changing classes, ditto for teachers needing to be replaced and on and on. Hundreds of thousands of changes throughout the school year will need to be performed, and all this on top of hoping the initial set up of millions of teacher/student linkages is error free each year to begin with!
Because Value add is longitudinal, i.e. results from previous years are used to make current year calculations, any errors from previous years will also be carried over, so it isn't like each year allows for a fresh start either. Indeed, as time rolls by, the errors may be compounding.
According to Battelle's own presentation this system hasn't worked to date in South Carolina, Texas, Oklahoma, nor Ohio - which is set to expand it to every school district.
How much confidence can anyone have in a system that will be used for high stakes decisions such as pay and employment, that relies on such gargantuan administrative tracking that has proven to be as utterly unreliable as this?