Teaching Profession

Teachers’ Ratings Still High Despite New Measures

By Stephen Sawchuk — February 05, 2013 7 min read
  • Save to favorites
  • Print

The figures are resoundingly familiar.

In Michigan, 98 percent of teachers were rated effective or better under new teacher-evaluation systems recently put in place. In Florida, 97 percent of teachers were deemed effective or better .

Principals in Tennessee judged 98 percent of teachers to be “at expectations” or better last school year, while evaluators in Georgia gave good reviews to 94 percent of teachers taking part in a pilot evaluation program.

Those results, among the first trickling out from states’ newly revamped yardsticks, paint a picture of a K-12 system that remains hesitant to differentiate between the best and the weakest performers—as well as among all those in the middle doing a solid job who still have room to improve.

The data are also raising new questions about the observation components of the systems, which tended to produce the highest scores.

“Most of these districts are trying really hard to think about teacher evaluation in a good way and to use it developmentally, but there’s still some cultural challenges,” Sarah W. Lenhoff, the assistant director of policy and research at the Education Trust-Midwest, said about the Michigan results. The Royal Oak, Mich.-based advocacy group has issued several reports on the overhaul of evaluation in that state.

“Although teachers may be getting more feedback and talking about their practice more, it hasn’t trickled down to variations in rating,” Ms. Lenhoff continued. “And that’s going to take time.”

Some teachers’ unions, though, see the data as an affirmation of teachers’ hard work.

“Despite all the rhetoric blaming teachers for all the problems in education, most teachers are doing a good job, given their limited resources,” said Doug Pratt, a spokesman for the Michigan Education Association.

Changes Ahead


More than half of states will be implementing revised teacher-evaluation systems in the next three years.

Some early adopters have already begun to make or propose changes to key aspects, such as the weight given to quantitative measures, based on early results and feedback from teachers.


SOURCE: Education Week

While only a handful of states already have a year or more of evaluation data, a host of others are now in the midst of full-scale implementation and will release initial results later this year.

Dozens of states have taken steps in recent years to overhaul their teacher-evaluation systems, often in response to federal incentives. Such changes have also been promoted by an influential lineup of organizations that calls for greater accountability in the teaching profession. The states hope to use the systems to strengthen teaching practices and dismiss poorly performing teachers.

Translating Results

In Florida, where every district was required to implement a new teacher-evaluation system in 2011-12, data released in December show that 97 percent of teachers received one of the top ratings. That figure, while high, is still lower than the 99.9 percent from before the revisions, state officials noted.

“We know that in the first year, most districts exercised an abundance of caution,” said Kathy Hebda, the state chancellor for educator quality. “We said upfront that our plan was to start together, and to get better every year. We do think it was a really good start, considering how big we are, and how much work there was to do.”

Evaluation data in Georgia, also released in December, have so far been limited to 26 districts participating in the state’s federal Race to the Top grant. In 2012, administrators there essentially had to navigate two evaluation systems: the pilot program and the one required by the terms of existing laws and board policies.

“It’s not likely that many principals are going to rate teachers differently on the pilot system than the system they’re using for [human resources] purposes,” said Martha Ann Todd, the state’s associate superintendent for teacher and leader effectiveness.

Michigan’s high numbers, released in November, could point to uncertainty in that state about the process, which remains somewhat in flux. A council working to outline a model state system for districts has not yet made its recommendations to the legislature.

Scores High

The early results offer several possible interpretations. As scholars have pointed out, there is no consensus about the percentage of teachers who should be identified as underperforming or superior in any given year.

“I do think we are still in a space of trying to do the research ... as these systems are being implemented, making sure that we are following up on things like alignment between the different measures,” said Laura Goe, a research scientist in the Learning and Teacher Research Center of the N.J.-based Educational Testing Service.

“We just don’t have enough large-scale research studies yet to say that this is the right way to do it at the school level, the district level, or the state level,” she said.

One of the key areas of congruence throughout the state data from Florida, Tennessee, and Georgia is the generally high scores given to teachers during classroom observations, a finding that comes right as new research is revealing clues about the properties of such observations and how they are shaped by the norms within schools.

A 2010 study on a pilot system in Chicago found, for instance, that when using the high end of the scale, principals often inflated their ratings compared to other observers, in part because of cultural expectations. And researchers have also found that having several different people observe teachers helped make their judgments more consistent over time and mitigate such bias.

Some districts say they worked deliberately to reach more nuanced findings. Florida’s Lee County showed a broader range of scores than most other districts in the state. Under its system, about 1.5 percent of teachers received unsatisfactory ratings, compared with 0.2 percent statewide.

Most Lee County teachers’ instruction was deemed solid, but the district reserved the highest category for only the top 10 percent of teachers. (Statewide, 23 percent of teachers earned that “highly effective” rating.)

Officials for the school district say they worked jointly with the local teachers’ union to agree on how state-generated test-score data would be interpreted, and took pains to make the evaluation instrument clear, to help make those finer distinctions in performance.

“We’re still working on developing training. It’s huge, and very important, because our goal is to bring about the real consistency in our schools about how we evaluate,” said Greg Adkins, the chief negotiator for the 85,000-student Lee County district.

Multiple Measures

The introduction of quantitative, supposedly objective data also might help ensure a broader range of scores.

“With value-added in particular, you are essentially ranking results for teachers, so ... you have some who are necessarily going to be closer to the bottom. Whereas with observations you can have all the teachers on the top,” said Ms. Goe, who also advises the Great Teachers and Leaders Center, a federally funded technical-assistance provider housed at the American Institutes for Research.

“Value added” is a statistical method of estimating the effect of a teacher’s instruction on his or her students’ test scores.

Tennessee’s data released last summer show, for instance, that observers gave only 0.2 percent of teachers the lowest score, compared to quantitative measures that put 16.5 percent of teachers in that category.

Georgia officials are still examining the quantitative portion of the pilot data, but preliminary reports on “student learning objectives"—district-determined common growth measures—showed more variability than did observations.

Disparities between different measures ought to invite more investigation, Ms. Goe of the ETS said. It could mean that “there is a mismatch between what we can see the teacher doing and how the learning is taking place,” she said, “or that there are other factors entering into the situation.”

Tennessee has already begun such analyses. This school year, the state sent “coaches” to 73 schools that had high teacher ratings and low levels of student-growth in 2011-12. The goal was to help support and retrain evaluators on how to document teacher practice.

“We’ve committed to a process of continuous improvement for this evaluation system, and when we saw this need, we acted on it,” said Kelli Gauthier, a spokeswoman for the Tennessee education department.

Midyear data suggest that results from those schools are likely to be distributed more broadly, although a majority of teachers will still pass muster.

Georgia officials are also redoubling efforts to improve consistency across raters. So far, the state has trained about 3,400 evaluators in face-to-face or online sessions, Ms. Todd, the associate superintendent, said. Some districts are also creating libraries of teaching videos to help refresh evaluators’ memories of exemplary performance at each level. The challenges for ensuring inter-rater reliability are somewhat greater for states that have given more discretion to their districts regarding training.

“I think there’s a huge incentive for the state to invest in principal training,” said Ms. Lenhoff said of Michigan, “and make sure every principal understands and has practiced how to observe teacher behavior, how to take notes, how to give feedback to teachers.”

Coverage of policy efforts to improve the teaching profession is supported by a grant from the Joyce Foundation, at www.joycefdn.org/Programs/Education.
A version of this article appeared in the February 06, 2013 edition of Education Week as High Ratings For Teachers Are Still Seen


Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Reading & Literacy Webinar
Science of Reading: Emphasis on Language Comprehension
Dive into language comprehension through a breakdown of the Science of Reading with an interactive demonstration.
Content provided by Be GLAD
English-Language Learners Webinar English Learners and the Science of Reading: What Works in the Classroom
ELs & emergent bilinguals deserve the best reading instruction! The Reading League & NCEL join forces on best practices. Learn more in our webinar with both organizations.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Teaching Profession Bilingual Teachers Are in Short Supply. How 3 Districts Solved That Problem
Helping bilingual paraprofessionals obtain bachelor's degrees and teaching credentials leads to more bilingual teachers, districts found.
9 min read
Elizabeth Alonzo works as a bilingual aide with 2nd grade student Esteycy Lopez Perez at West Elementary in Russellville, Ala., on Dec. 9, 2022.
Elizabeth Alonzo works as a bilingual aide with 2nd grade student Esteycy Lopez Perez at West Elementary in Russellville, Ala., on Dec. 9, 2022. Alonzo obtained her bachelor's degree through a partnership with Reach University and the Russellville city schools district.
Tamika Moore for Education Week
Teaching Profession Opinion How I’m Keeping Ahead of Burnout: 4 Tips for Teachers
An English teacher shares her best advice for battling the long-haul blahs until spring break.
Kelly Scott
4 min read
Young woman cartoon character making step from gloomy grey rainy weather to sunny clear day.
iStock/Getty + Education Week
Teaching Profession Opinion Why Is the Nation Invested in Tearing Down Public Education?
Education professor Deborah Loewenberg Ball argues that panic over test scores keeps us from building on the strengths of our children.
Deborah Loewenberg Ball
5 min read
Illustration of school text books and wrecking ball.
F. Sheehan for Education Week / Getty
Teaching Profession Teachers Censor Themselves on Socio-Political Issues, Even Without Restrictive State Laws
A new survey from the RAND Corporation found that two-thirds of teachers limit their instruction on political and social issues in class.
4 min read
Civics teacher Aedrin Albright stands before her class at Chatham Central High School in Bear Creek, N.C., on Tuesday, Nov. 5, 2019. The class is debating whether President Trump should be impeached. The House impeachment inquiry into Trump’s dealings with Ukraine has become a teachable moment in classrooms around the country as educators incorporate the events in Washington into their lesson plans.
Civics teacher Aedrin Albright stands before her class at Chatham Central High School in Bear Creek, N.C., on Tuesday, Nov. 5, 2019. The class was debating whether President Trump should be impeached. A new national survey found that a majority of teachers are now limiting instruction on political and social issues in class.
Allen G. Breed/AP