153

Making The Mandate Work For Both Teachers And Students

We were lucky enough to snag the latest edition of the the Ohio Education Association's (OEA) Ohio Schools magazine. It has a lot of great stuff in it, but one article we want to pull out and republish.

HB 153 And The Ohio Teacher Evaluation Framework - Making The Mandate Work For Both Teachers And Students*

Recent research, especially The new Teacher Project’s controversial The Widget Effect that criticizes many current teacher evaluation practices, has brought to national policy-makers’ attention a fact that educators have known for quite some time—most teacher evaluations are poorly designed, are irregularly and sometimes unfairly implemented, and provide little useful information about teacher performance for either teachers or their evaluators. This national wave of teacher evaluation reform includes federal initiatives like Race to the Top and state-level policy changes. Ohio is one of the many states that have addressed the issue through new legislation and one of 13 states that now require student performance as a significant factor in teacher evaluation.

House Bill 153 (hB 153), signed into law on June 30, 2011, significantly changes the way teachers in Ohio will be evaluated. hB 153 creates mandates at both the state and local level that will shape teacher evaluation policy development and teacher evaluation practices and procedures over the next several years. NeA and OeA have long advocated for teacher evaluation systems that are reliable, valid and focused on helping all teachers become more effective. It’s true that hB 153 presents many challenges; however, the legislation also requires that local teacher evaluation policy be developed in consultation with the district’s teachers, representing an opportunity for OeA members to make substantive and transformative changes in their districts. And if local associations commit to take the lead as the architects of this process in each district, they can build high-quality local teacher evaluation systems that work for teachers and students and strengthen the teaching profession.

The state board followed by adopting the framework below in November 2011. This framework must form the foundation for all locally developed evaluation systems as well as the Ohio Teacher evaluation System (OTeS) Model.

in the state framework, 50 percent of each teacher’s evaluation will be based on multiple student growth measures.

Teachers will be assigned a student growth rating (Below, expected, Above) based on the level at which they meet the student growth standard of one year’s growth in one year’s time.

If value-added data is available for a teacher, it must be used as one of the student growth measures. Additional assessments to determine student growth will be identified by the Ohio Department of education (ODe), and they will also provide guidelines for locally created measures of student growth. ODe will develop guidance for the specific categories of student growth measures that can be used by each district for teachers in both tested and untested grades and subjects. The approved assessment list and guidance will be available in June 2012, and information about using student growth measures will be addressed in an upcoming issue of Ohio Schools.

The other 50 percent of the evaluation will be calculated from multiple measures of teacher performance based on the seven Ohio Standards for the Teaching Profession.

Teachers will be assigned a rating (Accomplished, Proficient, Developing, Ineffective) based on the multiple measures included in the local evaluation system. Districts will need to determine how teachers provide evidence relative to each of these standards in their locally developed evaluation policies, processes and procedures. Observation is the one measure that is required by law; however, many aspects of teaching (collabora- tion, communication, professional growth) cannot be effectively evaluated through classroom observation, so districts will need to create tools that will allow teachers to provide evidence of their practice in these areas.

A final summative evaluation rating will be assigned to each teacher based on the following matrix that combines the ratings in Student growth Measures and Teacher Performance. (See graphic above.)

Evaluators and credentialing

Ohio Revised Code (Section 3319.111) requires that a person who evaluates a teacher must hold the following licenses or designation:

  • superintendent
  • assistant superintendent
  • Principal
  • Vocational director
  • supervisor
  • Person designated to conduct evaluations under an agreement providing for peer review (Par)

Under the new state framework, one of the most significant changes to how teacher evaluation is conducted in Ohio is that upon implementation of the revised teacher evaluation system, every district evaluator must be credentialed in addition to having the appropriate license or PAR designation. This means that having one of the licenses or PAR designation above is no longer the sole criterion to be an evaluator.

The credentialing process will be a three-day face-to-face training in which evaluators view a variety of teaching videos and learn to score accurately and with fidelity using the OTeS observation rubric. following the training, evaluators will then need to pass an online assessment that requires them to observe a teaching segment and rate the teacher within an acceptable range on the rubric to be fully credentialed. Districts are free to adopt or develop models and tools of their own (e.g. Danielson, Marzano and others), but all of the state training will be conducted using the OTeS observation rubric.

The Ohio Department of education (ODe) is in the process of selecting a company to develop the online assessment and will spend the spring of 2012 training state trainers who will provide the evaluator credential- ing training regionally beginning in June 2012. The training roll out will be similar to the training for Resident educator mentors. Training will be offered free of charge in the first year. Race to the Top districts that plan to implement revised evaluation systems prior to 2013 should take advantage of training this year. In subsequent years, there will likely be a cost for the training.

evaluators will need to be periodi- cally add terms for a person and reassessed, and once the initial train- ing has rolled out, ODe will begin work on developing those compo- nents. The credentialing process fills a great void in many districts where administrators who evaluate teachers have little or no training in how to observe and use observation evidence to rate teacher performance.

Student growth measures and evaluator selection

The state framework also contains provisions regarding a teacher’s selection of credentialed evaluators based on the Student Growth Measure rating earned by that teacher. Please note that this is not based on the Teacher Performance rating or overall summative rating, but the Student Growth Measure rating only.

  • teachers with above-expected levels of student growth will develop a professional growth plan and may choose their credentialed evaluator for the evaluation cycle.
  • teachers with expected levels of student growth will develop a profes- sional growth plan collaboratively with the credentialed evaluator and will have input on their credentialed evaluator for the evaluation cycle.
  • teachers with below-expected levels of student growth will develop an improvement plan with their credentialed evaluator. the administration will assign the credentialed evaluator for the evaluation cycle and approve the improvement plan.

Next steps Although the deadline for adopting a local policy is July 1, 2013, there is a great deal of work that needs to be underway, as soon as possible, for districts to be able to meet the requirements in both hB 153 and the state-adopted framework. The local association must prepare now to take the lead in bargaining and building the local evaluation system and ensuring it is implemented fairly and effectively. Race to the Top districts should have a local Scope of Work that outlines the processes and timelines for evaluation reform work through 2013-2014. districts that are not participating in Race to the Top will need to begin the work in order to have their policy in place and ready for implementation by the deadline.

Below are some general steps to consider as you look forward to bargaining revisions in your current teacher evaluation system.

  • identify and engage a district evaluation team, including teachers from various grade levels, content areas, specialty and non-classroom assignments
  • review and analyze current teacher evaluation policies, procedures and practices
  • conduct ode evaluation gaP analysis n review effective evaluation models including the otes (revised version will be available June 2012)
  • select/develop a district evaluation system and tools
  • Map and develop local student assessments that will provide student growth data
  • create local training on the new system for evaluators and teachers
  • construct a pilot timeline (one evaluation cycle)
  • send evaluators for credentialing training
  • have volunteer teachers and evaluators pilot the system
  • review and revise the system based on pilot data
  • implement the new evaluation system

The timeline for developing local evaluation policy and a highly effective teacher evaluation system to go along with it is short, and some Race to the Top districts may be on an accelerated schedule depending on the timeline in their local Scope of Work. It is imperative that local leaders take the initiative to move teacher evaluation work forward in their districts. The stakes are high, and OEA is committed to lead the way in advocating for public education, public educators and the learners we serve by promoting and supporting high-quality teacher evaluation systems that work for teachers and students.

*Remember any changes to the local teacher evalution system must be made through the collective bargaining process.

State requirements

hB 153 required the state board of education to develop a standards-based framework for teacher evaluation by december 31, 2011, that includes the following nine elements (orc 3319.112):
1. Provides for multiple evaluation factors, including student academic growth that counts for 50 percent of each evaluation
2. is aligned with the ohio standards for the teaching Profession
3. requires at least two formal observations of the teacher by the evaluator of at least 30 min- utes in addition to classroom walkthroughs*
4. assigns a rating on each evaluation of accomplished, Proficient, developing or ineffective
5. requires each teacher to be provided with a written report of the results of the teacher's evaluation
6. identifies measures of student academic growth for grade levels and subjects for which value-added data is not available
7. implements a classroom-level, value-added program developed by a nonprofit organization
8. Provides for professional development to accelerate and continue teacher growth and provide support to poorly performing teachers
9. Provides for the allocation of financial resources to support professional development
*the ohio department of education is defining “classroom walkthrough” as an informal observation less than 30 minutes in length. this is not the classroom walkthrough system utilized by many districts for gathering formative assessment information at the building level to guide professional development.

Local district requirements

hB 153 requires all public school districts to revise their teacher evaluation systems to align to the state framework described above. The local association must become the lead architect in bargaining and updating or rebuilding the local system. Some districts may have teacher evaluation systems in place that need minimal changes in order to align with new requirements, and some districts may choose to adopt the Ohio Teacher evaluation System model. Regardless, all districts will have to include student growth measures as 50 percent of a teacher’s evaluation in addition to meeting all of the requirements below (ORC 3319.111):
1. Local boards of education have until July 1, 2013, to adopt a standards- based teacher evaluation policy that conforms to the framework above.
2. the policy shall become operative at the expiration of any collective bargaining agreement covering teachers employed by the board that is in effect as of september 29, 2011 (the effective date of the legislation) and must be included in any renewal or extension of such an agreement.
3. Measures of student academic growth must include value-added data if it is available. for teachers in untested grades and subjects, the board will administer assessments on the list developed by ode or local student growth measures that follow the state guidelines (not yet available).
4. the board is required to evaluate every teacher at least once each year to be completed by the first day of april. the teacher must receive a written report of the results of the evaluation by the 10th day of april.
5. if the board has entered into a limited contract or extended limited contract with a teacher, the board must evaluate the teacher at least twice in any school year in which the board may wish to declare its intention not to re-employ the teacher. one evaluation must be completed by January 15, and the teacher must receive a written report of the results by January 25. the second evaluation must be completed between february 10 and april 1 and the teacher must receive a written report of the results by april 10.
6. the board may adopt a resolution to evaluate each teacher who received a rating of accomplished once every two school years.
In addition to all of the requirements above, hB 153 mandates that the local teacher evaluation policy include procedures for using the evaluation results for retention and promotion decisions and for removal of poorly-performing teachers and does not allow seniority to be the basis for teacher retention decisions, except when deciding between teachers who have comparable evaluations.
finally, hB 153 requires the local board of education to provide for the allocation of financial resources to support professional development that both accelerates teacher growth and provides support for teachers who have been identified as underperforming.

What teachers are telling the Governor: Day 2

Day 2 of our odyssey into comments provided to the Governor by educators and other random internet commentors. Day 1 can be found here.

People asking to be on a committee or board to develop an evaluation and merit pay system are by far the most common submissions.

Subject: merit pay
Governor Kasich,
I am a Nationally Board Certified teacher with nearly 20 years of experience. I have a Lead Professional Educator license in Ohio. I have a Ph.D. in Educational Psychology. I score the SAT essays for CollegeBoard, the AP English tests for CollegeBoard, and I write content for the ACT English test. I currently work in a high achieving district, but I have also worked in a very challenging school district. I am currently also working for ETS in the MET scoring pilot, which is a Bill and Melinda Gates foundation project for teacher evaluation. My wife is an elementary music teacher, so I also understand the perspective of that age level as well as how those teachers fit into merit pay. I would be happy to discuss my ideas with you; as you can see, I have multiple levels of experience that all will need to factor in to the merit pay issue.

Please contact me if you would like to discuss my ideas on education and merit pay.

Sincererly,

--------------

I have not been contacted by anyone from the Governor's office. Please have someone contact me to let me know that he is notinterested in my input, if that is the case. If not, please have someone contact me to let me know the name of the contact person who is heading up this process.
Thank you.

The next email also follows a very common theme expressed by large numbers of educators.

Subject: Guidelines for Merit-Based Pay System
Governor Kasich,
I am a teacher and responding to your invitation to email suggesdted guidelines for a merit-based pay system. I have no suggested guidelines to offer because research has not shown that merit pay in education works towards increasing student achievement. I do request that SB5 provisions be removed from HB153.
Thank you,
Subject: have you read this yet?
The High Cost of Low Teacher Salaries from the NYT:

http://nyti.ms/m55fWj

Subject:HB 153
Dear Governor Kasich,
I am writing to urge you to oppose including provisions that are the same or similar to those in Senate Bill 5 in the budget bill. HB 153 makes sweeping changes to compensation, evaluation and contractual rights of Ohio's teachers. Similar changes were included in SB 5 which, as you know, is being challenged by referendum.

Passage of provisions like this in the budget bill would serve to undercut the rights of voters to decide the fate of SB 5 in the November election. I ask that you respect the voice of voters and not circumvent the "citizens' veto" by including portions of SB 5 in other legislation. Please act to have these provisions removed from HB 153.
Sincerely,

Subject:HB 153
Dear Governor Kasich,
As a parent, community member and educator, I am in total opposition of merit pay for teachers. The current pay structure is objective and gives order to the process of determining salaries for employees. Merit pay, on the other hand, would be a cumbersome and potentially unfair, subjective process. Moreover, merit pay would not ensure that poor teachers would be motivated to improve or find different careers. Your administration has done nothing but hurt education in the state of Ohio through budget cuts and the elimination of collective bargaining. Why not listen to the professionals involved in education to determine what is necessary to support education?
Sincerely,

We hope this wasn't sent while driving! Just Kidding...

Subject: Hey!
I am not a teacher but I really believe teachers r under paid. I just drive a school bus. Seen too much happening in the schools.
Sent via BlackBerry by AT&T

We'll bring you more tomorrow.

Substitute House Bill 153 COMPARISON DOCUMENT As Reported by Senate Finance

Here's the HB153 comparison document as reported out of the Senate finance committee yesterday. The full senate vote is expected later today. The bill still contains draconian cuts to public education, and provisions to retest teachers in the bottom 10% of schools. However, merit pay and for profit charter provisions, along with 12/12 STRS cost shifting is not included.

Substitute House Bill 153 COMPARISON DOCUMENT As Reported by Senate Finance

A Columbus Teacher Testifies against HB153

OEA and CEA member Philip Hayes' opposition testimony to HB 153

Written Testimony
Ohio Senate
Senate Finance Committee, Chris Widener, Chair
Testimony in Opposition to Sub. HB 153 by:
Philip W. Hayes, Educator,
Brookhaven High School
Columbus City Schools

Tuesday, May 17, 2011
Good morning Chair Widener, Vice Chair Jones, Ranking Member Skindell, and members of the Senate Finance Committee. I thank you for giving me the opportunity today to speak candidly and personally regarding my opposition to Substitute House Bill 153.

I am a high school social studies teacher at Brookhaven High School in Columbus, Ohio. It is my first and only teaching assignment; I’ve taught there since 1998 and cannot imagine teaching anywhere else.

I want to tell you all that for the past four months, I wake up each morning at 5 a.m., angry. I go to bed each night, often at 10 or 11 p.m., tired, frustrated, hoarse from talking and arguing, and wake up angry again the next day, only to start the process over.

I am angry because of the various pieces of legislation that have been proposed or passed by the Ohio General Assembly that deal with education matters. This includes the items in HB 153 that threaten to change my profession, my calling, my life’s work into something much less—a job. Teaching is not what I do; it is who I am. Most importantly, the proposed changes will affect my students.

Who are my students? According to the latest state report card, each class of 30 students at Brookhaven has 25 that qualify for free or reduced-price lunch. Seven of the 30 have transferred from another school. Five students have an identified learning disability. Three students were learning how to read, write and speak English as they were being instructed in that language. Roughly one student in each class of 30 was homeless.

Here are just some of the proposed “solutions” that have been included in HB 153 that will affect my students, my colleagues and their students. Why has an overall K-12 funding decrease been touted as a state foundation increase? While the promise has been made that the state will not increase taxes, the truth is that local school districts will have to put levies on the ballot at an ever-increasing rate to make up for the shortfall in state funding. This proposed budget shifts the burden from the state to local governments.

I take issue with the provision that gives teachers a $50 bonus if their students achieve more than a year’s worth of academic growth. This transforms our students from human beings into fifty-dollar bills. Why would you want to create a situation where a teacher walks into a class and sees their students with dollar signs hovering over their head? Our students are equal human beings, and should be treated as people, not profits.

I disagree with the section that calls for retesting teachers that teach in core academic areas if they work in a school that is identified as one of the lowest 5 percent statewide. We have already passed a national test, selected for use by the state’s Department of Education to establish our subject area competence. Just weighing a pig doesn’t make it fatter.

I object to the House’s inclusion of teacher evaluation provisions from SB 5 into HB 153. It is, at its best, disingenuous; at its worst, it is duplicitous, divisive and devious.

The basis of merit pay within the bill, as proposed, is completely without merit. There are many areas where state achievement test scores or growth data cannot be used to inform the evaluation process. How can anyone possibly determine the worth of an art, music or physical education teacher that inspires and motivates a student to become an artist, musician or more physically fit, enriching, changing and perhaps saving their lives?

For the past four years, I have my students pick the best teacher they’ve ever had and write them a letter, thanking them and explaining why they were chosen. Often times, those teachers write back to my students and their share stories and recollections from when my students were in their classroom.

Over the course of those four years, none of the student letters have contained the sentence “Thank you for helping me pass the test.” Not one. But these are the best teachers these students have ever had; they have made their subject come alive for them, encouraged them, inspired them, fought for them, laughed with them and cried with them. All of those are teacher attributes that cannot be tested, surveyed or measured.

Chair Widener, Vice Chair Jones, Ranking Member Skindell, and members of the Senate Finance Committee, I thank you for your time and attention. I would be happy to answer any questions you might have at this time.

Please contact your State Senator and urge them to remove the SB5 provisions from HB153 (the budget bill).

A Worthington teacher testifies against HB153

OEA member and WEA President Mark Hill's written testimony against HB 153

Chairman Widener, Ranking Member Skindell, and members of the Senate Finance Committee, my name is Mark Hill. I am a math teacher in the Worthington City Schools currently serving as president of the Worthington Education Association. Thank you for allowing me to offer testimony on HB153.

I come today to talk to you about the teacher accountability provisions in HB 153. I have some concerns about the structure for accountability that is in the version passed out of the House.

I would like to begin by saying that I don’t have a problem with a rigorous evaluation system for teachers nor do I disagree with the notion of removing ineffective teachers from the classroom. That may sound unusual coming from a leader of a local teachers union but I am a parent, too, and I care about access to a high quality education for my kids. The teachers I represent take a great deal of pride in teaching in an excellent school district; many of them live in the district and all of them want it to remain excellent; none of them want to work alongside a bad teacher.

HB153, as passed by the House, goes too far. It requires teachers to be rated highly effective, effective, needs improvement, or unsatisfactory based on an evaluation in which 50% of the score is measuring student growth through value added scores averaged over three years. It requires the Superintendent of Public Instruction to set a minimum level value added measure for a teacher for each of the rating levels. Furthermore, it imposes draconian penalties for teachers who are rated as unsatisfactory or needs improvement including imposition of unpaid leave on a teacher rated at those levels if their principal does not consent to placing them in their building the next year effectively ending their careers.

Value added scores are a great concept but as a statistical measure, they are fraught with error. Scores fluctuate by random error; in Houston’s value added system only 38% of the top fifth remained in the top rating the next year. 23% of the top fifth in performance ended up being in the bottom fifth the next year and vice versa. Fluctuations like that defy reason; it is highly unlikely that a fourth of the top teachers in Houston one year were poor performers the next.

According to another study done for the US Department of Education’s National Center for Education Evaluation found that, using three years of data, a teacher who should be rated as average has a 25% chance of being rated significantly below average. A teacher who should be rated as a top performer has a 10% chance of being rated significantly below average. This means under HB 153, 25% of the average teachers in Ohio and 10% of the good teachers in Ohio would be in jeopardy of losing their jobs due to statistical error. I hope the Ohio General Assembly would not want to add a “Wheel of Fortune” element to teachers’ careers.

Under this system, who would take care of the kids? There are teachers who ask for the students with behavior problems and learning disabilities because they care about them and believe they deserve an education. Under HB 153, these teachers would be putting their career at risk to do so. My own son has Aspergers Syndrome, which is a condition on the autism spectrum – who will want to teach him? Under HB153, math and reading teachers are far more at risk for losing their jobs than other teachers because those are the only areas with enough scores to build a value-added modeling system. Who would want to work in an area where you are constantly worrying about losing your job due to a statistical error?

I don’t come just to complain but to offer solutions. First, you’ve already passed this framework for evaluation in Senate Bill 5. There is no logical reason to duplicate it in HB153 – frankly, I don’t believe it belongs in either bill but should be a subject of debate on its own.

Second, instead of mandating 50% value added, allow the local education agency to decide how to best fit value added in their evaluations. This is the system under Race to the Top – Worthington is a Race to the Top district, so we have already agreed to rate teachers’ effectiveness through evaluation using value added modeling. A top down statewide approach will have serious unintended consequences.

Thank you for listening.

Please contact your State Senator and ask them to remove the SB5 provisions from HB153 (the budget bill).