Teaching Profession

Principals Aren’t Tapping Teacher-Effectiveness Data, Says Study

By Denisa R. Superville — September 09, 2014 5 min read
  • Save to favorites
  • Print

Despite a trove of data on teacher effectiveness that has accumulated from the rollout of teacher-evaluation systems in recent years, many principals are not using that information to guide decisions about hiring, assignments, and professional development, according to the findings in a report scheduled for release this week by Vanderbilt University researchers.

When principals do avail themselves of that information, they are more likely to rely on classroom-observation data, rather than on value-added measures of students’ test scores or parent, student, and teacher surveys. They viewed the surveys, particularly those of parents, as less “valid, specific, and transparent” when compared with other measures, the researchers found. For example, only 14 percent of principals saw parent surveys as valid to a large degree, while 84 percent viewed teacher-observation data to be valid to that extent, and 56 percent said the same about student achievement or growth.

A host of barriers — including access to the data, the availability of value-added measures when decisions are being made, a lack of understanding of the statistical models used in the evaluation systems, and the absence of training in using the data — help explain why teacher-effectiveness data are not more widely used in human-resources decisions, according to the researchers.

Principal Perceptions of the Validity of Teacher-Effectiveness Measures

BRIC ARCHIVE

SOURCE: Peabody College of Education and Human Development, Vanderbilt University

“Much of the emphasis has been on student-assessment data helping to drive instructional decisions,” said Ellen B. Goldring, a professor of education policy and leadership at Vanderbilt’s Peabody College of Education and Human Development, in Nashville.

“There has been much less attention [paid] to teacher effectiveness data for talent-management decisions. It’s really important to widen the discussion of how school leaders can use data for school improvement, and we found a number of consistent barriers to why principals are not using the data or are not able to use the data,” she said.

Teacher evaluations have been fraught with controversy — over whether and to what extent they should include value-added measures, and whether those evaluations should form the basis for decisions about firing workers.

Barriers Identified

The study, “Principal Use of Teacher Effectiveness Measures for Talent Management Decisions,” by Ms. Goldring, Christine M. Neumerski, Mollie Rubin, Marisa Cannata, Timothy Drake, Jason A. Grissom and Patrick Schuermann, was funded by the Seattle-based Bill & Melinda Gates Foundation. (The foundation also supports some news coverage in Education Week.)

It was conducted during the 2012-13 school year, and focused on six urban districts and two charter-management organizations that were implementing — or had already implemented — teacher-evaluation systems that included multiple measures. The participating school systems were in Shelby County and Metropolitan Nashville, Tennessee; Baltimore city; Hillsborough County, Fla.; Houston; Denver; and the Green Dot and Alliance College-Ready charter school networks in Los Angeles.

In many cases, particularly in districts with newer teacher-evaluation systems, principals faced challenges in accessing and using the data, which the researchers distilled to five major categories: time, timing, technology, training, and a lack of trust. Eighty-three percent of principals, for example, said timing was a minor to strong barrier in using teacher-effectiveness data. Student-achievement data, teacher value-added scores, and survey results, for example, arrived after decisions about renewals and placements had been made. And 75 percent of the principals listed a lack of time as a barrier to using the data.

Researchers also found that principals, in some cases, were already using teacher-effectiveness data to identify their teachers’ strengths and weaknesses and to target support and professional development. In those districts, the central office had acknowledged the importance of data use, communicated to staff the kind of data that should be used for specific decisions, and made it easier for staff members to access the data. Some provided professional support to help principals, Ms. Goldring said.

Unpacking Perceptions

Douglas N. Harris, a professor of economics at Tulane University and the director of the Education Research Alliance for New Orleans, said the results confirmed feedback he had received from other educators about the challenges in using teacher-evaluation systems.

“The data that they are producing and these analyses are useful for understanding how the principals perceive the data — what they understand, what they don’t understand, what they trust, and what they don’t trust,” said Mr. Harris, who has studied teacher-evaluation systems. “And that’s really important if we are going to understand how [the evaluation systems] are being implemented and how we might [make] these systems better.”

Randi Weingarten, the president of the American Federation of Teachers, said both principals and teachers want “the tools, time, and trust to do their jobs well and to use data properly.”

“Great teaching involves rich engagement between teachers and students, which principals can evaluate only if given the time for observations,” Ms. Weingarten said in a statement.

Michael J. Petrilli, the president of the Thomas B. Fordham Institute, a Washington-based research and advocacy group, said while earlier reports noted that principals were not widely using valued-added measures in human-resources decisions, the Vanderbilt study provides insight into the reasons why.

“We have these systems that just are not yet working in terms of getting information into the hands of principals,” Mr. Petrilli said. “And until that happens, principals are doing the most logical thing, which is using the information they do have to make these decisions.”

With the roadblocks identified, efforts should now focus on making it easier for principals to get the information they need to make the best decisions, Mr. Petrilli said.

Overall, the researchers recommend that districts clarify their expectations for how principals should use data and what data sources should be used for specific human-resources decisions. They recommend training for principals on using value-added estimates, openly encouraging discussions about data use, and clarifying the roles of value-added estimates and observation scores.

A version of this article appeared in the September 10, 2014 edition of Education Week as Study: Teacher Data Remain Untapped

Events

Classroom Technology Webinar How Pandemic Tech Is (and Is Not) Transforming K-12 Schools
The COVID-19 pandemic—and the resulting rise in virtual learning and big investments in digital learning tools— helped educators propel their technology skills to the next level. Teachers have become more adept at using learning management
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
Building Teacher Capacity for Social-Emotional Learning
Set goals that support adult well-being and social-emotional learning: register today!


Content provided by Panorama
Jobs October 2021 Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Teaching Profession Opinion Advice to New Teachers From a 20-Year Veteran
These seven lessons are especially important during the pandemic, and they will continue to serve you through the rest of your teaching career.
Stephen Guerriero
4 min read
Illustration of hands holding up lightbulbs representing ideas.
Vanessa Solis/Education Week and Feodora Chiosea/iStock
Teaching Profession Joe and Jill Biden Honor Teachers at Long-Delayed White House Ceremony
The president, with the first lady in attendance, called teachers the "single most consequential people in the world beyond our parents."
4 min read
First lady Jill Biden hugs Juliana Urtubey, 2021 National Teacher of the Year, at a ceremony to honor the 2021 State and National Teachers of the Year, on the South Lawn of the White House Oct. 18.
First lady Jill Biden stands beside Juliana Urtubey, 2021 National Teacher of the Year, at a ceremony to honor the 2020 and 2021 State and National Teachers of the Year at the White House on Monday.
Evan Vucci/AP
Teaching Profession Opinion Wellness Can't Be Just Another Task for Teachers to Do
If we want teachers to remain in the profession, state departments of education, school districts, and parent groups must step up.
Beth Pandolpho
4 min read
Vibrant hand drawn illustration depicting mindfulness concept
DigitalVision Vectors/Getty
Teaching Profession Thousands of Teachers Who Were Denied Loan Forgiveness Will Get a Second Chance
A settlement between the American Federation of Teachers and the U.S. Department of Education establishes a review process for borrowers.
4 min read