Opinion Blog

Rick Hess Straight Up

Education policy maven Rick Hess of the American Enterprise Institute think tank offers straight talk on matters of policy, politics, research, and reform. Read more from this blog.

Education Opinion

Teacher Evaluation: What Do We Want to Measure?

By Guest Blogger — May 27, 2014 4 min read
  • Save to favorites
  • Print

Note: Andrew McEachin, an assistant professor of educational policy analysis and program evaluation at NC State University, is guest posting this week.

I want to thank Rick for giving me the chance to (at least partially) fill his large shoes. The current education policy landscape has no shortage of interesting topics. I thought about starting the week by blaming the Common Core for my tomato plants’ lack of output (since recent commentary on the Common Core has gotten a tad out of hand). But instead, I’ll spend the first three days talking about teacher and school accountability and the last day on the role summers play on accountability and education policy.

A good teacher can forever change a student’s life. It is in this vein that teacher evaluation and accountability policy has continued to be analyzed and discussed in the public as well as the research community. Two specific recent examples come to mind. The first is a study by Drs. Morgan Polikoff and Andy Porter funded by the Gates Foundation which garnered a lot of discussion in the popular press and social media (example reactions here and here). In this study, the authors found a limited, to no, association between teachers’ student achievement gains and classroom observations, student surveys, or measures of instructional alignment. The second is a report released by the Brookings Institute that evaluated the validity and reliability of teacher evaluation systems in four districts. While the authors found that all four evaluation systems passed a validity and reliability assessment, they also found that observational measures of teacher practice have similar measurement issues to measures of teachers’ impact on students’ achievement--e.g., teachers with higher achieving students also get higher scores on the observational protocols. These two papers highlight a few important considerations for future policy work on teacher evaluation.

First, it is unclear, to me at least, what measure of teacher quality should be used to benchmark other measures, or if such a benchmark measure currently exists. Those who like measure A will use it to gauge the quality of measures B, C, D, and so on. Take the Polikoff paper as an example; it is unclear whether the measures of instructional alignment, classroom observations, student surveys, or student achievement growth should serve as measure A. In other words, there are a number of normative judgments that must be made about which measure, or measures, capture the key underlying traits of a good teacher.

Second, a number of subjective decisions must be made about which short- and long-term student outcomes to prioritize in a teacher evaluation system. We know that teachers have a lasting impact on students’ achievement and labor-market outcomes, but we know less about how teachers influence students’ cognitive and non-cognitive abilities. Granted, the latter two measures are quite difficult to measure in a typical school setting. However, the narrow focus of teachers’ instructional quality and impact on students’ achievement may miss the more important role teachers play in the development of students’ social, emotional, and intellectual development.

Third, while nearly everyone agrees that context matters in teacher evaluations, designing a system to address context often leads to difficult discussions. The Brookings paper, as well as work by Cory Koedel et al (among others), discuss the importance of removing factors out of a teacher’s control from the evaluation of her practice and impact of student achievement. Adjusting for differences among teachers’ classrooms and schools, however, is often seen as setting different standards for different subgroups of students (more on this later in the week). Yet by not adjusting the evaluations for non-school related contextual differences, policymakers are making it even harder to staff the schools that need the best teachers.

And finally, the discussions about the design of teacher evaluation systems often do not spend enough attention on curating the current human capital that exists within the public education system. The best schools in the country, whether they are public or charter, voucher or magnet, spend a considerable amount of time on fostering a learning and professional development environment within their school building. Simply holding teachers accountable for their students’ outcomes is unlikely to have a meaningful impact on the achievement gap without first ensuring every teacher has the knowledge and skills needed to maximize their students’ outcomes.

It is clear that the policy landscape (e.g., the ESEA waivers) has quickly moved past asking “Should we hold teachers accountable?” to “How should we hold teachers and school accountable?” Yet, it appears that all too often we do not start with the two most important questions: What qualities and practices characterize the ideal teacher? What are the skills and knowledge we want students to obtain from our schools? In trying to answer these questions, it is clear that not only are there many dimensions of instruction and student outcomes to be measured, but also that parents’ and other stakeholders’ preferences of which dimensions to measure will vary quite dramatically. Tomorrow I focus on a few interesting ideas that take these issues head-on when designing a teacher accountability model.

--Andrew McEachin

The opinions expressed in Rick Hess Straight Up are strictly those of the author(s) and do not reflect the opinions or endorsement of Editorial Projects in Education, or any of its publications.

Commenting has been disabled on edweek.org effective Sept. 8. Please visit our FAQ section for more details. To get in touch with us visit our contact page, follow us on social media, or submit a Letter to the Editor.


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Teaching Webinar
6 Key Trends in Teaching and Learning
As we enter the third school year affected by the pandemic—and a return to the classroom for many—we come better prepared, but questions remain. How will the last year impact teaching and learning this school
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Curriculum Webinar
How Data and Digital Curriculum Can Drive Personalized Instruction
As we return from an abnormal year, it’s an educator’s top priority to make sure the lessons learned under adversity positively impact students during the new school year. Digital curriculum has emerged from the pandemic
Content provided by Kiddom
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Equity & Diversity Webinar
Leadership for Racial Equity in Schools and Beyond
While the COVID-19 pandemic continues to reveal systemic racial disparities in educational opportunity, there are revelations to which we can and must respond. Through conscientious efforts, using an intentional focus on race, school leaders can
Content provided by Corwin

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education More States Are Requiring Schools to Teach Native American History and Culture
Advocates say their efforts have gained some momentum with the nation’s reckoning over racial injustice since the killing of George Floyd.
3 min read
A dancer participates in an intertribal dance at Schemitzun on the Mashantucket Pequot Reservation in Mashantucket, Conn., Saturday, Aug. 28, 2021. Connecticut and a handful of other states have recently decided to mandate students be taught about Native American culture and history. (AP Photo/Jessica Hill)
Education Judge's Temporary Order Allows Iowa Schools to Mandate Masks
A federal judge ordered the state to immediately halt enforcement of a law that prevents school boards from ordering masks to be worn.
4 min read
Iowa Gov. Kim Reynolds speaks to reporters following a news conference, Thursday, Aug. 19, 2021, in West Des Moines, Iowa. Reynolds lashed out at President Joe Biden Thursday after he ordered his education secretary to explore possible legal action against states that have blocked school mask mandates and other public health measures meant to protect students against COVID-19. Reynolds, a Republican, has signed a bill into law that prohibits school officials from requiring masks, raising concerns as delta variant virus cases climb across the state and schools resume classes soon. (AP Photo/Charlie Neibergall)
Education Hurricane Ida Deals New Blow to Louisiana Schools Struggling to Reopen
The opening of the school year offered teachers a chance to fully assess the pandemic's effects, only to have students forced out again.
8 min read
Six-year-old Mary-Louise Lacobon sits on a fallen tree beside the remnants of her family's home destroyed by Hurricane Ida, in Dulac, La., on Sept. 4, 2021. Louisiana students, who were back in class after a year and a half of COVID-19 disruptions kept many of them at home, are now missing school again after Hurricane Ida. A quarter-million public school students statewide have no school to report to, though top educators are promising a return is, at most, weeks away, not months.
Six-year-old Mary-Louise Lacobon sits on a fallen tree beside the remnants of her family's home destroyed by Hurricane Ida, in Dulac, La., on Sept. 4, 2021.
John Locher/AP
Education Massachusetts National Guard to Help With Busing Students to School
250 guard personnel will be available to serve as drivers of school transport vans, as districts nationwide struggle to hire enough drivers.
1 min read
Massachusetts National Guard soldiers help with logistics in this Friday, April 17, 2020 file photo, at a food distribution site outside City Hall, in Chelsea, Mass. Mass. Gov. Charlie Baker on Monday, Sept. 13, 2021, activated the state's National Guard to help with busing students to school as districts across the country struggle to hire enough drivers.
Massachusetts National Guard soldiers help with logistics in this Friday, April 17, 2020 file photo, at a food distribution site outside City Hall, in Chelsea, Mass.
Michael Dwyer/AP