framework

HB555 FAQ for teacher evaluations

We've just got our hands on this document put out by the Ohio Department of Education. It's an updated framework for teacher evaluations based on the changes that were slipped into HB555 in the dead of night.

Is there a more ridiculously convoluted and complex framework for evaluating any other professions job performance? How is any teacher expected to understand all this enough to know where to focus improvement efforts, especially since the Value-added formula itself is secret and proprietary.

HB 555 FAQ with regard to teacher evaluations by

Major evaluation change slipped into HB555

Over the Holidays, the Governor signed the latest education bill, HB 555. StateImpact has a decent rundown of most of the items that were addressed in the bill. However, one major piece of policy change made in HB555 has gone totally unreported, not surprisingly since it was done in the 11th hour, with no testimony or hearings. Indeed, we're doubtful many lawmakers even knew it had been slipped in there.

Sec. 3319.112. (A) Not later than December 31, 2011, the state board of education shall develop a standards-based state framework for the evaluation of teachers. The state board may update the framework periodically by adoption of a resolution. The framework shall establish an evaluation system that does the following:

(1) Provides for multiple evaluation factors, including student academic growth which shall account for fifty per cent of each. One factor shall be student academic growth which shall account for fifty per cent of each evaluation. When applicable to the grade level or subject area taught by a teacher, the value-added progress dimension established under section 3302.021 of the Revised Code or an alternative student academic progress measure if adopted under division (C)(1)(e) of section 3302.03 of the Revised Code shall be used in the student academic growth portion of an evaluation in proportion to the part of a teacher's schedule of courses or subjects for which the value-added progress dimension is applicable.

If a teacher's schedule is comprised only of courses or subjects for which the value-added progress dimension is applicable, one of the following applies:

(a) Beginning with the effective date of this amendment until June 30, 2014, the majority of the student academic growth factor of the evaluation shall be based on the value-added progress dimension.

(b) On or after July 1, 2014, the entire student academic growth factor of the evaluation shall be based on the value-added progress dimension. In calculating student academic growth for an evaluation, a student shall not be included if the student has sixty or more unexcused absences for the school year.

If you're not familiar with legislative language, here's the summary

HB 555 radically changes the method of calculating evaluations for about 1/3 of Ohio's teachers. If a teacher's schedule is comprised only of courses or subjects for which the value-added progress dimension is applicable - then only their value-add score can now be used as part of the 50% of an evaluation based on student growth. Gone is the ability to use multiple measures of student growth - ie Student Learning Objectives or SLO's.

Teachers and school districts have spent countless months collaborating on the development and implementation of an evaluation system originally detailed in HB153 - only to now find the rules of the game changed at the 11th hour. Furthermore, the change is regressive. We have detailed the growing list of research that demonstrates the very real and serious problems with heavy reliance on value-add, and the need to offset these problems by using multiple measures of student growth. See here, here, here, and here for examples.

SB316 analysis Part II

We published our first look at SB316, the mid biennium review education bill, here. OEA has just published their analysis of the bill, which you can read in full, here (pdf).

We'd like to pull out a few sections that go into greater detail than our original analysis, specifically on teacher evaluations and school choice.

Teacher evaluations

  • Extends the annual deadline for completing teacher evaluations from April 1 to May 1.
  • Specifies that the statutory requirements regarding teacher evaluation in Ohio Revised Code Section 3319.111 prevail over conflicting provisions of collective bargaining agreements entered into on or after the bill’s effective date rather than on or after September 29, 2011. (OEA supports the date change that fixed the back dating issue, but continues to oppose this language and its placement because it restricts educators’ voices in teacher evaluation.)
  • Specifies that a teacher be evaluated under the teacher evaluation framework, only if the teacher spends at least 50 percent of their time employed providing student instruction.
  • Allows for third-party evaluators, such as Educational Service Centers, to be contracted by the board to perform evaluations (requires that an evaluator must hold a credential from the Ohio Department of Education). Does not require individuals hired by third parties to conduct evaluations to possess a superintendent, assistant superintendent, principal, vocational director, administrative specialist or supervisor license.
  • Restores current law allowing teacher evaluations to be conducted by persons designated in a peer review agreement entered into by an employer and its teachers.
  • Allows a teacher who is rated “accomplished” to complete a project instead of the second observation of an evaluation.
  • Requires only one annual evaluation instead of two for teachers on limited or extended contracts.
  • Requires at least three formal observations instead of two observations for teachers who are under consideration for nonrenewal.
  • Excludes students who have 60 or more unexcused absences for the school year in the calculation of student academic growth data for an evaluation.
  • Requires the State Board of Education to develop by June 30, 2013 a standards-based teacher evaluation framework for state agencies that employ teachers. Further, requires these state agencies to adopt the framework. (Note: Teachers employed by County Boards of Developmental Disabilities will fall under the ODE teacher evaluation framework.)
  • Requires the district to annually report the number of teachers receiving each evaluation rating aggregated by the teacher preparation programs for which the teachers graduated and graduation year to ODE. Also requires ODE to establish guidelines for the report and explicitly prohibits using teachers’ names or other personally identifiable information.
  • Requires the State Board of Education to adopt a resolution when they update the teacher evaluation framework.

School "Choice"

  • Removes provision creating regional gifted charter schools.
  • Removes changes to community school sponsor rankings (will likely be addressed in HB 555).
  • Specifies that unless the General Assembly enacts performance standards, a report card rating system, and closure criteria for community schools that operate dropout prevention and recovery programs by March 31, 2013, those schools are subject to permanent closure under the existing criteria that applies to other community schools. Stipulates that only the performance ratings issued to schools that operate dropout programs for the 2012-2013 school year and later count in determining if a school meets the closure criteria.
  • Allows for single-gender community schools without a comparable school for the other gender.
  • Requires ODE to post community school contracts on the Internet.
  • Revises the definition of a community school sponsor to explicitly include the local school district boards, educational services centers that agree to the conversion of a school building, and “grandfathered” sponsors.
  • Permits a person from serving on five instead of two governing authorities of start-up community schools at the same time.
  • Allows a community school to operate in a residential care facility, as long as the school was operating in Ohio prior to May 1, 2005, regardless of whether the school was operating from or in the facility on that date.
  • Retains current law on community school sponsorship and trigger for prohibiting an entity from sponsoring additional schools.
  • Requires that each time a school district completes an evaluation of a child with a disability or reviews a child’s IEP that the district send by letter or electronic means a notice to the child’s parent about voucher programs.
  • Requires the State Board of Education to adopt rules establishing procedures for awarding EdChoice vouchers to students already attending a nonpublic school when the school receives its charter.
  • Requires ODE to disaggregate data by grade not age for students participating in the EdChoice Voucher or Cleveland Voucher programs.

Making The Mandate Work For Both Teachers And Students

We were lucky enough to snag the latest edition of the the Ohio Education Association's (OEA) Ohio Schools magazine. It has a lot of great stuff in it, but one article we want to pull out and republish.

HB 153 And The Ohio Teacher Evaluation Framework - Making The Mandate Work For Both Teachers And Students*

Recent research, especially The new Teacher Project’s controversial The Widget Effect that criticizes many current teacher evaluation practices, has brought to national policy-makers’ attention a fact that educators have known for quite some time—most teacher evaluations are poorly designed, are irregularly and sometimes unfairly implemented, and provide little useful information about teacher performance for either teachers or their evaluators. This national wave of teacher evaluation reform includes federal initiatives like Race to the Top and state-level policy changes. Ohio is one of the many states that have addressed the issue through new legislation and one of 13 states that now require student performance as a significant factor in teacher evaluation.

House Bill 153 (hB 153), signed into law on June 30, 2011, significantly changes the way teachers in Ohio will be evaluated. hB 153 creates mandates at both the state and local level that will shape teacher evaluation policy development and teacher evaluation practices and procedures over the next several years. NeA and OeA have long advocated for teacher evaluation systems that are reliable, valid and focused on helping all teachers become more effective. It’s true that hB 153 presents many challenges; however, the legislation also requires that local teacher evaluation policy be developed in consultation with the district’s teachers, representing an opportunity for OeA members to make substantive and transformative changes in their districts. And if local associations commit to take the lead as the architects of this process in each district, they can build high-quality local teacher evaluation systems that work for teachers and students and strengthen the teaching profession.

The state board followed by adopting the framework below in November 2011. This framework must form the foundation for all locally developed evaluation systems as well as the Ohio Teacher evaluation System (OTeS) Model.

in the state framework, 50 percent of each teacher’s evaluation will be based on multiple student growth measures.

Teachers will be assigned a student growth rating (Below, expected, Above) based on the level at which they meet the student growth standard of one year’s growth in one year’s time.

If value-added data is available for a teacher, it must be used as one of the student growth measures. Additional assessments to determine student growth will be identified by the Ohio Department of education (ODe), and they will also provide guidelines for locally created measures of student growth. ODe will develop guidance for the specific categories of student growth measures that can be used by each district for teachers in both tested and untested grades and subjects. The approved assessment list and guidance will be available in June 2012, and information about using student growth measures will be addressed in an upcoming issue of Ohio Schools.

The other 50 percent of the evaluation will be calculated from multiple measures of teacher performance based on the seven Ohio Standards for the Teaching Profession.

Teachers will be assigned a rating (Accomplished, Proficient, Developing, Ineffective) based on the multiple measures included in the local evaluation system. Districts will need to determine how teachers provide evidence relative to each of these standards in their locally developed evaluation policies, processes and procedures. Observation is the one measure that is required by law; however, many aspects of teaching (collabora- tion, communication, professional growth) cannot be effectively evaluated through classroom observation, so districts will need to create tools that will allow teachers to provide evidence of their practice in these areas.

A final summative evaluation rating will be assigned to each teacher based on the following matrix that combines the ratings in Student growth Measures and Teacher Performance. (See graphic above.)

Evaluators and credentialing

Ohio Revised Code (Section 3319.111) requires that a person who evaluates a teacher must hold the following licenses or designation:

  • superintendent
  • assistant superintendent
  • Principal
  • Vocational director
  • supervisor
  • Person designated to conduct evaluations under an agreement providing for peer review (Par)

Under the new state framework, one of the most significant changes to how teacher evaluation is conducted in Ohio is that upon implementation of the revised teacher evaluation system, every district evaluator must be credentialed in addition to having the appropriate license or PAR designation. This means that having one of the licenses or PAR designation above is no longer the sole criterion to be an evaluator.

The credentialing process will be a three-day face-to-face training in which evaluators view a variety of teaching videos and learn to score accurately and with fidelity using the OTeS observation rubric. following the training, evaluators will then need to pass an online assessment that requires them to observe a teaching segment and rate the teacher within an acceptable range on the rubric to be fully credentialed. Districts are free to adopt or develop models and tools of their own (e.g. Danielson, Marzano and others), but all of the state training will be conducted using the OTeS observation rubric.

The Ohio Department of education (ODe) is in the process of selecting a company to develop the online assessment and will spend the spring of 2012 training state trainers who will provide the evaluator credential- ing training regionally beginning in June 2012. The training roll out will be similar to the training for Resident educator mentors. Training will be offered free of charge in the first year. Race to the Top districts that plan to implement revised evaluation systems prior to 2013 should take advantage of training this year. In subsequent years, there will likely be a cost for the training.

evaluators will need to be periodi- cally add terms for a person and reassessed, and once the initial train- ing has rolled out, ODe will begin work on developing those compo- nents. The credentialing process fills a great void in many districts where administrators who evaluate teachers have little or no training in how to observe and use observation evidence to rate teacher performance.

Student growth measures and evaluator selection

The state framework also contains provisions regarding a teacher’s selection of credentialed evaluators based on the Student Growth Measure rating earned by that teacher. Please note that this is not based on the Teacher Performance rating or overall summative rating, but the Student Growth Measure rating only.

  • teachers with above-expected levels of student growth will develop a professional growth plan and may choose their credentialed evaluator for the evaluation cycle.
  • teachers with expected levels of student growth will develop a profes- sional growth plan collaboratively with the credentialed evaluator and will have input on their credentialed evaluator for the evaluation cycle.
  • teachers with below-expected levels of student growth will develop an improvement plan with their credentialed evaluator. the administration will assign the credentialed evaluator for the evaluation cycle and approve the improvement plan.

Next steps Although the deadline for adopting a local policy is July 1, 2013, there is a great deal of work that needs to be underway, as soon as possible, for districts to be able to meet the requirements in both hB 153 and the state-adopted framework. The local association must prepare now to take the lead in bargaining and building the local evaluation system and ensuring it is implemented fairly and effectively. Race to the Top districts should have a local Scope of Work that outlines the processes and timelines for evaluation reform work through 2013-2014. districts that are not participating in Race to the Top will need to begin the work in order to have their policy in place and ready for implementation by the deadline.

Below are some general steps to consider as you look forward to bargaining revisions in your current teacher evaluation system.

  • identify and engage a district evaluation team, including teachers from various grade levels, content areas, specialty and non-classroom assignments
  • review and analyze current teacher evaluation policies, procedures and practices
  • conduct ode evaluation gaP analysis n review effective evaluation models including the otes (revised version will be available June 2012)
  • select/develop a district evaluation system and tools
  • Map and develop local student assessments that will provide student growth data
  • create local training on the new system for evaluators and teachers
  • construct a pilot timeline (one evaluation cycle)
  • send evaluators for credentialing training
  • have volunteer teachers and evaluators pilot the system
  • review and revise the system based on pilot data
  • implement the new evaluation system

The timeline for developing local evaluation policy and a highly effective teacher evaluation system to go along with it is short, and some Race to the Top districts may be on an accelerated schedule depending on the timeline in their local Scope of Work. It is imperative that local leaders take the initiative to move teacher evaluation work forward in their districts. The stakes are high, and OEA is committed to lead the way in advocating for public education, public educators and the learners we serve by promoting and supporting high-quality teacher evaluation systems that work for teachers and students.

*Remember any changes to the local teacher evalution system must be made through the collective bargaining process.

State requirements

hB 153 required the state board of education to develop a standards-based framework for teacher evaluation by december 31, 2011, that includes the following nine elements (orc 3319.112):
1. Provides for multiple evaluation factors, including student academic growth that counts for 50 percent of each evaluation
2. is aligned with the ohio standards for the teaching Profession
3. requires at least two formal observations of the teacher by the evaluator of at least 30 min- utes in addition to classroom walkthroughs*
4. assigns a rating on each evaluation of accomplished, Proficient, developing or ineffective
5. requires each teacher to be provided with a written report of the results of the teacher's evaluation
6. identifies measures of student academic growth for grade levels and subjects for which value-added data is not available
7. implements a classroom-level, value-added program developed by a nonprofit organization
8. Provides for professional development to accelerate and continue teacher growth and provide support to poorly performing teachers
9. Provides for the allocation of financial resources to support professional development
*the ohio department of education is defining “classroom walkthrough” as an informal observation less than 30 minutes in length. this is not the classroom walkthrough system utilized by many districts for gathering formative assessment information at the building level to guide professional development.

Local district requirements

hB 153 requires all public school districts to revise their teacher evaluation systems to align to the state framework described above. The local association must become the lead architect in bargaining and updating or rebuilding the local system. Some districts may have teacher evaluation systems in place that need minimal changes in order to align with new requirements, and some districts may choose to adopt the Ohio Teacher evaluation System model. Regardless, all districts will have to include student growth measures as 50 percent of a teacher’s evaluation in addition to meeting all of the requirements below (ORC 3319.111):
1. Local boards of education have until July 1, 2013, to adopt a standards- based teacher evaluation policy that conforms to the framework above.
2. the policy shall become operative at the expiration of any collective bargaining agreement covering teachers employed by the board that is in effect as of september 29, 2011 (the effective date of the legislation) and must be included in any renewal or extension of such an agreement.
3. Measures of student academic growth must include value-added data if it is available. for teachers in untested grades and subjects, the board will administer assessments on the list developed by ode or local student growth measures that follow the state guidelines (not yet available).
4. the board is required to evaluate every teacher at least once each year to be completed by the first day of april. the teacher must receive a written report of the results of the evaluation by the 10th day of april.
5. if the board has entered into a limited contract or extended limited contract with a teacher, the board must evaluate the teacher at least twice in any school year in which the board may wish to declare its intention not to re-employ the teacher. one evaluation must be completed by January 15, and the teacher must receive a written report of the results by January 25. the second evaluation must be completed between february 10 and april 1 and the teacher must receive a written report of the results by april 10.
6. the board may adopt a resolution to evaluate each teacher who received a rating of accomplished once every two school years.
In addition to all of the requirements above, hB 153 mandates that the local teacher evaluation policy include procedures for using the evaluation results for retention and promotion decisions and for removal of poorly-performing teachers and does not allow seniority to be the basis for teacher retention decisions, except when deciding between teachers who have comparable evaluations.
finally, hB 153 requires the local board of education to provide for the allocation of financial resources to support professional development that both accelerates teacher growth and provides support for teachers who have been identified as underperforming.

Are we serious about evaluations?

We were reaing an interesting article on development of teacher evaluations in California, that has this passage

The Los Angeles Unified School District rolled out its technology-based teacher evaluation system in August. Seven hundred fifty “pioneer” teachers volunteered to test the new system, featuring a newly-negotiated set of teaching and learning standards. The new framework was devised with input from over 1,000 educators working in small groups. To begin the process, teachers grade themselves (from “ineffective” to “highly effective”) on 63 teaching standards, then fill in a lesson plan template, identifying which of the 63 standards their lesson addresses, and to what degree. Trained observers download the lesson, observe the teacher using it, and enter their own data. Everything but the observation itself is managed online.

Teachers at the September conversation showed a real willingness to reform their own approach to evaluation; not one spoke up to say they would not participate, or be against the new system. Of course, many stated historical concerns: did we really expect that a new system would foster collaboration, when the current system supposedly depends on collaboration but doesn’t produce enough of it? What about principals who are not experts in the teacher’s content area? Are we really going to continue using standardized test scores, when there is so much evidence that many learning gains happen in ways the tests cannot measure?

Cue the screech to a halt sound effect. "The new framework was devised with input from over 1,000 educators working in small groups"

In Ohio, the evaluation system has been half crafted in closed door, smoked filled legislative chambers, with the rest done through a half-baked online comment form and just 18 "meetings" with hand picked teachers.

Are we serious?

Teacher Evaluation Budget Language

Here's the language surrounding the creation of teacher evaluations contained in the budget bill

Sec. 3319.112. (A) Not later than December 31, 2011, the state board of education shall develop a standards-based state framework for the evaluation of teachers. The framework shall establish an evaluation system that does the following:
(1) Provides for multiple evaluation factors, including student academic growth which shall account for fifty per cent of each evaluation;
(2) Is aligned with the standards for teachers adopted under section 3319.61 of the Revised Code;
(3) Requires observation of the teacher being evaluated,including at least two formal observations by the evaluator of at least thirty minutes each and classroom walkthroughs;
(4) Assigns a rating on each evaluation in accordance with division (B) of this section;
(5) Requires each teacher to be provided with a written report of the results of the teacher's evaluation;
(6) Identifies measures of student academic growth for grade levels and subjects for which the value-added progress dimension prescribed by section 3302.021 of the Revised Code does not apply;
(7) Implements a classroom-level, value-added program developed by a nonprofit organization described in division (B) of section 3302.021 of the Revised Code;
(8) Provides for professional development to accelerate and continue teacher growth and provide support to poorly performing teachers;
(9) Provides for the allocation of financial resources to support professional development.
(B) For purposes of the framework developed under this section, the state board also shall do the following:
(1) Develop specific standards and criteria that distinguish between the following levels of performance for teachers and principals for the purpose of assigning ratings on the evaluations conducted under sections 3319.02 and 3319.111 of the Revised Code:
(a) Accomplished;
(b) Proficient;
(c) Developing;
(d) Ineffective.
(2) For grade levels and subjects for which the assessments prescribed under sections 3301.0710 and 3301.0712 of the Revised Code and the value-added progress dimension prescribed by section 3302.021 of the Revised Code do not apply, develop a list of student assessments that measure mastery of the course content for the appropriate grade level, which may include nationally normed standardized assessments, industry certification examinations, or end-of-course examinations.
(C) The state board shall consult with experts, teachers and principals employed in public schools, and representatives of stakeholder groups in developing the standards and criteria required by division (B)(1) of this section.
(D) To assist school districts in developing evaluation policies under sections 3319.02 and 3319.111 of the Revised Code, the department shall do both of the following:
(1) Serve as a clearinghouse of promising evaluation procedures and evaluation models that districts may use;
(2) Provide technical assistance to districts in creating evaluation policies."