Opinion
Teaching Profession Opinion

The High Stakes of Teacher Evaluation

By Jack Schneider — June 05, 2012 6 min read
  • Save to favorites
  • Print

Teacher behavior matters less than student learning. That’s the new mantra in education reform. From coast to coast, classroom observations are being replaced by student-achievement scores as the coin of the realm in teacher evaluation.

In state after state, 20 to 50 percent of teacher-effectiveness ratings are now determined by such data, and if the trend continues, that number will only rise. It won’t be long before high-stakes personnel decisions—hiring, firing, and divvying up pay raises—are conducted by computers running algorithms rather than by administrators toting clipboards.

Teachers and union leaders, for their part, have strongly resisted this shift, channeling their opposition into two primary criticisms, neither of which has been particularly effective.

The first argument is that teacher-evaluation reform is a Trojan horse. Its real purpose, they argue, is to undermine job security. As one union representative put it: “They’re not focused on improvement; they’re focused on kicking people out.” To draw on a poker analogy, reformers are raising the stakes of the game and forcing teachers to go all in. In other words, win or go home.

The second argument is that evaluation schemes based on student-achievement data produce inconsistent results from year to year. To stick with the analogy, reformers are appraising poker skill based on the results of a single hand. A bad player, of course, will occasionally win, just as a good player will lose. But that’s not skill; that’s chance.

Evaluating teachers through multiple-choice-based tests of student learning is like using the rules of Go Fish to assess poker skill."

These concerns are valid. Yet such arguments have largely failed to curb policymakers or sway the public because reformers have so effectively countered them, portraying teachers as self-interested impediments to reform.

Consider the question of undercutting job security. Reformers make no apologies for the fact that quantification schemes will erode tenure and cultivate a castigatory atmosphere. Why, they ask, should that not be the case? Ineffective educators don’t belong in the classroom, and our current approaches to evaluation have failed to weed out that entrenched minority. In many cases, highly superficial classroom observations are conducted once per year, and most teachers receive the highest possible rating. As Indiana’s assistant state superintendent for innovation and improvement, Dale Chu, framed it in comments last year, a quarter of the state’s 3rd graders “are reading or computing at a minimal level,” yet “99 percent of teachers in Indiana are rated as effective or highly effective.” The status quo, reformers assert, is poker with no stakes.

BRIC ARCHIVE

No wonder, then, that they want to dump the old system and adopt a new one. Student-achievement data is objective and uncompromising. Sure, the stakes are high, and there will be losers. But, as they tend to point out, there will also be big winners. In the District of Columbia schools, under the school district’s new teacher-evaluation model, highly effective teachers can make up to $140,000 annually. As Jason Kamras, the district’s chief of human capital, declared last year: “We want to make great teachers rich.” Good poker players, in other words, don’t fear high stakes; they seek them out.

Responding to the second argument, reformers will concede that their data systems tend to be somewhat erratic. Of course, that would be hard not to admit. In study after study, researchers have found that even the most advanced models produce significantly different results from year to year. Teachers from the top 20 percent one year can end up in the bottom 20 percent the next. And according to a 2010 Mathematica study, the error rate for comparing teacher performance with one year of data is likely to be 35 percent. Sixty-five percent accuracy, in the world of U.S. education, generally earns a D.

Not to worry, reformers argue, the numbers eventually smooth out. In one hand of poker, anything can happen—luck can bring garbage or it can bring four aces. Over time, however, results regress to the true mean. Talent will out, and bad players will go bust.

In city after city and state after state, this is how the argument goes. Teachers express their concerns, and reformers counter. And the end result is that the momentum behind data-driven teacher-evaluation schemes continues to build.

But there is another case that teachers might make—a criticism that would level a blow to the radical overhaul of teacher evaluation, and, more importantly, one that just might help students learn. And the case is this: Achievement, as we measure it, is not really about achievement. As determined by multiple-choice tests—the dominant way that we measure it in the United States—achievement is not about how students can think or write or persuade. It is not about how they can perform experiments or produce original research. It is not about their prowess in art or civics or robotics. Instead, it is about memorized minutiae and good guesses. We accept this approach to measurement only because it is so common. And it is common not because it actually measures achievement, but because it is time-efficient and cost-effective.

BRIC ARCHIVE

Simply put, we’re using the wrong instrument. Evaluating teachers through multiple-choice-based tests of student learning is like using the rules of Go Fish to assess poker skill. Instead of learning how to evaluate complex hands like flushes, straights, and full houses, we’re asking teachers if they have any sevens. It’s a much simpler and, ultimately, much less interesting game.

This doesn’t mean that we should turn our backs on data or stop trying to gauge teacher quality. It doesn’t mean that outstanding teachers need go unrewarded or that their ineffective peers must be protected. Instead, to paraphrase Stanford University emeritus professor Rich Shavelson, it means we need to take audacious steps to measure a fuller set of learning outcomes—outcomes valued by teachers, scholars, and the American public. It means moving beyond multiple-choice tests and developing assessments oriented toward performance and habits of mind.

In the meantime, firing teachers based on deficient measures of effectiveness is a reckless proposition, and educators are right to oppose it. But they need to be savvier about the way they are taking on this fight. Job security is not a winning argument. Tenure and seniority, after all, are poor indicators of teacher quality, and in backing the status quo, educators allow themselves to be portrayed as barriers to change. The weakness of the statistical measures is also not a winning talking point. The math involved is too complicated for laypeople to decipher, and the aggregate research is easily cherry-picked.

The real issue, and the one that teachers need to take a stand on, is that high-stakes personnel decisions based on Go Fish measurements will have one of two destructive outcomes. The first—a drastic dumbing-down of instruction—has already started to take place as a result of the No Child Left Behind Act’s crude accountability measures. But when teachers’ jobs are on the line, the floodgates will open; overall quality of instruction will decline not by degree, but by orders of magnitude.

The second outcome, equally likely and equally problematic, is a potential exodus of great teachers from the profession. Many, of course, will take their lumps. They will continue teaching students to think, to write, to play the violin, or to take carbon dioxide gas samples; and they may suffer for it. But others will leave. Unwilling to play a thoughtless and artless game, they will stand up and leave the table. And they won’t come back.

A version of this article appeared in the June 06, 2012 edition of Education Week as The High Stakes of Teacher Evaluation

Events

Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
English-Language Learners Webinar English Learners and the Science of Reading: What Works in the Classroom
ELs & emergent bilinguals deserve the best reading instruction! The Reading League & NCEL join forces on best practices. Learn more in our webinar with both organizations.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
Challenging the Stigma: Emotions and STEM
STEM isn't just equations and logic. Join this webinar and discover how emotions fuel innovation, creativity, & problem-solving in STEM!
Content provided by Project Lead The Way

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Teaching Profession Bilingual Teachers Are in Short Supply. How 3 Districts Solved That Problem
Helping bilingual paraprofessionals obtain bachelor's degrees and teaching credentials leads to more bilingual teachers, districts found.
9 min read
Elizabeth Alonzo works as a bilingual aide with 2nd grade student Esteycy Lopez Perez at West Elementary in Russellville, Ala., on Dec. 9, 2022.
Elizabeth Alonzo works as a bilingual aide with 2nd grade student Esteycy Lopez Perez at West Elementary in Russellville, Ala., on Dec. 9, 2022. Alonzo obtained her bachelor's degree through a partnership with Reach University and the Russellville city schools district.
Tamika Moore for Education Week
Teaching Profession Opinion How I’m Keeping Ahead of Burnout: 4 Tips for Teachers
An English teacher shares her best advice for battling the long-haul blahs until spring break.
Kelly Scott
4 min read
Young woman cartoon character making step from gloomy grey rainy weather to sunny clear day.
iStock/Getty + Education Week
Teaching Profession Opinion Why Is the Nation Invested in Tearing Down Public Education?
Education professor Deborah Loewenberg Ball argues that panic over test scores keeps us from building on the strengths of our children.
Deborah Loewenberg Ball
5 min read
Illustration of school text books and wrecking ball.
F. Sheehan for Education Week / Getty
Teaching Profession Teachers Censor Themselves on Socio-Political Issues, Even Without Restrictive State Laws
A new survey from the RAND Corporation found that two-thirds of teachers limit their instruction on political and social issues in class.
4 min read
Civics teacher Aedrin Albright stands before her class at Chatham Central High School in Bear Creek, N.C., on Tuesday, Nov. 5, 2019. The class is debating whether President Trump should be impeached. The House impeachment inquiry into Trump’s dealings with Ukraine has become a teachable moment in classrooms around the country as educators incorporate the events in Washington into their lesson plans.
Civics teacher Aedrin Albright stands before her class at Chatham Central High School in Bear Creek, N.C., on Tuesday, Nov. 5, 2019. The class was debating whether President Trump should be impeached. A new national survey found that a majority of teachers are now limiting instruction on political and social issues in class.
Allen G. Breed/AP