School & District Management

Is Judging Principals by Test Scores a Mistake?

By Lauraine Langreo — August 23, 2022 5 min read
Tight crop of a student holding a pencil doing classwork or taking a test.
  • Save to favorites
  • Print

Decades of research shows that principals can significantly benefit student outcomes, such as grades and college plans.

But what about standardized test scores? A new study suggests that a principal’s impact on test scores is likely much smaller than previously believed.

The study, a working paper published by the Annenberg Institute at Brown University and not yet peer-reviewed, found that existing approaches linking principals to test scores are flawed and attribute to principals effects that aren’t under their control.

“This is not a study that says that principals are not important. Principals are absolutely important,” said Brendan Bartanen, lead author of the study and an assistant professor of education policy at the University of Virginia, in an interview.

Instead, what the study suggests is that “we need to be very careful about trying to infer the performance of a principal on the basis of the [test-score] outcomes of students,” Bartanen added.

Existing research on the topic has used test scores to measure the effectiveness the of certain school leadership policies and practices. For example, one research study found that replacing a below-average principal with someone in the above-average category can add more months of learning in math and in reading during a single school year. Another found that students who attended schools with principals trained by a certain program had slightly higher achievement scores than students who didn’t attend a school with principals in the program.

And principals who spoke with Education Week insisted that they do believe they have a major impact on all student outcomes—and that includes test scores.

“I feel like as the building leader, you’re the person who’s charged with altering the trajectory of a child,” said Ronnie Harvey Jr., the 2022 Louisiana Principal of the Year. “The principal plays a major part in setting the climate and the culture inside of a school building. If the culture of the school is very chaotic—it’s not conducive to learning—that’s gonna play a part in how instruction is given out on that campus.”

“If that tone is not set, then I guarantee there’s going to be a direct correlation seen in outcomes,” Harvey added.

See Also

Carrie P. Meek/Westview K-8 Center principal Marchel Woods, center rear, greets parents dropping off their children for class on Oct. 5, 2020, at the Carrie P. Meek/Westview K-8 Center in Miami.
Principal Marchel Woods, center rear, greets parents dropping off children at the Carrie P. Meek/Westview K-8 Center in Miami. A new study quantifies the connection between principal effectiveness and students' academic achievement.
Wilfredo Lee/AP

Nearly all states include measures of student progress over time, or what researchers call “value-added” measures, into their principal-evaluation systems. To analyze whether this is an effective metric, Bartanen and his co-authors reviewed data from New York City, Oregon, and Tennessee and compared the variations in student achievement within schools.

They expected that if principals were a primary cause of student success, schools that had the same principal for extended periods of time would see less variability, and schools that changed principals would see more variability. But neither was the case, the researchers found.

Instead, they found that other school factors unconnected to principals seemed to be driving these variations. Though there might be a correlation between student performance and principal effectiveness, there doesn’t appear to be a cause-and-effect relationship, Bartanen said.

The researchers concluded that these value-added measures produce “biased estimates of principal effects.”

The use of value-added measures in education has long been controversial. States rushed to integrate them into systems for evaluating teachers in the 2010s, but many have since backed off. Teachers’ unions in particular said the systems didn’t fairly evaluate their work.

Evaluating effectiveness through other metrics

Principals who spoke with Education Week said using student test scores as a metric in evaluating their effectiveness as a leader isn’t a bad idea, but other factors should also be considered.

“I see nothing wrong with looking at test scores,” said Larry Haynes, who has been a principal at Oak Mountain Middle School in Birmingham, Ala., for 18 years. But it’s also important to consider other outcomes, such as whether students are ready for the next grade level or whether they’re college and career ready, he said.

Harvey said principals should also be evaluated on the “compassion and the social-emotional wellbeing of our staff and our students.”

“You have to be the CEO of your campus, and when I say that I mean chief empathy officer,” said Harvey, who was the principal of Washington-Marion Magnet High School in Lake Charles, La., for four years. He’s now an administrative director of special education and alternative programs for the Calcasieu Parish school district.

“As a principal, you have to worry about creating a culture where everyone feels love, everyone feels the compassion, and everyone feels like they have the opportunity to be able to grow—as a student, as an individual, as a responsible adult that’ll be an asset for your community,” Harvey said.

See Also

Photo of principal in school hallway.
Getty

Teachers, students, and parents should also have the opportunity to evaluate their principals and should play a big part in that, said Haynes, the 2022 Alabama Principal of the Year.

Bartanen hopes this research leads education policymakers and district leaders to reexamine “what we look for when we’re thinking about effective leaders” and the “perceived connection between principal performance and student outcomes.”

There’s more work to be done when it comes to figuring out how to measure a principal’s effectiveness—a task that is more challenging than measuring a teacher’s effectiveness, Bartanen said.

“Principals aren’t providing direct instruction to students in classrooms,” he said. “If there are impacts on student outcomes or student test scores, that’s mediated through their influence over school-level things that are directly related to their job,” such as hiring and retaining effective teachers, managing budgets, setting a strong vision for the school, and implementing teacher evaluation systems.

Bartanen said the research suggests there shouldn’t be a heavy reliance on student test scores to try to understand whether a principal is doing their job well, Bartanen said. When there isn’t such a hyper focus on test scores, principals will be able “to focus on other aspects of their role and other aspects of students’ lives,” he added.

See also

A Black female elementary school principal sits in a circle of chairs with two students. She holds a clipboard as she waves a finger at a student.
iStock/Getty Images Plus
School & District Management Evaluating Principals Through Test Scores: Harder Than You'd Think
Jaclyn Zubrzycki, December 17, 2012
3 min read

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Recruitment & Retention Webinar
Be the Change: Strategies to Make Year-Round Hiring Happen
Learn how to leverage actionable insights to diversify your recruiting efforts and successfully deploy a year-round recruiting plan.
Content provided by Frontline
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Equity & Diversity Webinar
Critical Ways Leaders Can Build a Culture of Belonging and Achievement
Explore innovative practices for using technology to build an environment of belonging and achievement for all staff and students.
Content provided by DreamBox Learning
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Professional Development Webinar
Strategies for Improving Student Outcomes with Teacher-Student Relationships
Explore strategies for strengthening teacher-student relationships and hear how districts are putting these methods into practice to support positive student outcomes.
Content provided by Panorama Education

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management Download A Visual Guide to Nonverbal Communication (Download)
Understanding nonverbal communication can help you improve interactions and get your message across.
1 min read
v42 8SR Nonverbal Communication Share Image
Gina Tomko/Education Week and Getty
School & District Management Ensure Your Staff Gets the Message: 3 Tips for School Leaders
School staff are inundated with information. Here's a few ways to ensure they will actually hear you.
3 min read
Image showing a female and male in business attire connecting speech bubble puzzle pieces.
iStock/Getty Images Plus
School & District Management Keep School Staff Motivated All Year Long: Advice From Principals
Here are some of the things—big and small—that school leaders do and say to keep teachers excited about the job.
13 min read
Teachers and faculty play a game of Kahoot! to get to know one another better during a Welcome Back training at CICS Bucktown on Monday, Aug. 15, 2022 in Chicago, Ill.
Teachers and faculty play a game to get to know one another better during a Welcome Back training at Chicago's CICS Bucktown in August.
Taylor Glascock for Education Week
School & District Management How District Leaders Can Make Social Media Work for Them
Two school district leaders with impressive followings share best practices for using social media.
3 min read
Two diverse educators with laptops sitting on an oversize cellphone with communication symbols and text bubbles on the phone and in the air around them.
Gina Tomko/Education Week and DigitalVision Vectors