Teaching Profession

Performance-Pay Studies Show Few Achievement Gains

Findings reinforce view that compensation plans require more work.
By Vaishali Honawar — March 03, 2008 5 min read

Includes updates and/or revisions.

A handful of new studies that scrutinize performance-pay initiatives nationwide have found mixed results on how they affect student achievement. That conclusion reinforces views that more work is needed on such plans, despite a recent surge in their popularity, before they can replace the traditional single salary schedule.

At a recent conference here organized by the National Center on Performance Incentives at Vanderbilt University, some researchers concluded that positive effects of performance-based pay were small or none, while others found varying levels of increases in student achievement.

The most positive results were reported by researchers who studied a small-scale pilot program in Little Rock, Ark., that paid bonuses to teachers for simply raising student test scores—a model some educators actually warn against because it can force teachers to teach to the test.

Among the programs that did not show large-scale gains was the Missouri career-ladder program, in place since 1987, which uses a mix of teacher performance, tenure, and extra responsibilities to determine bonuses. Researchers, who examined the program’s effects on student achievement by looking at the mathematics and reading data of more than 500 schools over a nine-year period, concluded that while the program did result in small positive increases in math scores, no significant improvement in reading occurred.

“If there is a positive effect, it is going to be very small,” said Kevin Booker, a researcher with Mathematica Policy Research in Princeton, N.J., who co-wrote the study.

It concludes that a possible outcome of the program could be that the career ladder could help the districts attract and retain higher-quality teachers.

Calls for Experimentation

In recent years, the single salary schedule, which is fiercely protected by teachers’ unions and which sets salary largely by seniority and education credits, has attracted criticism from policymakers under pressure to meet standards under federal education law and eager to hold teachers accountable for student achievement. A number of states—Florida, Minnesota, North Carolina, and Texas—and districts—Denver, Houston, Nashville, and New York City, among them—now offer varying versions of performance-pay programs. More states and districts are weighing them.

But observers and educators present at the conference sounded a warning note against rushing to adopt such plans without adequate experimentation.

BRIC ARCHIVE

“I worry that our enthusiasm for professional pay has gotten way ahead of our knowledge,” said Kate Walsh, the president of the National Council on Teacher Quality, a Washington-based research and advocacy group, pointing to the “many failures across the country and some glimmers of hope.”

“Both [national] unions are really not against such plans, but we are against full-scale implementation without experimentation,” Howard Nelson, the lead researcher at the American Federation of Teachers, said of his organization and the National Education Association.

Unintended Consequences

Evidence emerging from the reports presented at the Feb. 27-29 conference demonstrates that some plans can indeed have unintended consequences. For instance, in North Carolina, researchers found that a program that rewards bonuses of $1,500 to teachers in schools that show test-score gains above a specified threshold could have resulted in higher rates of teacher turnover in low-performing schools.

While 70 percent of the schools got bonuses each year, some schools, such as those with higher numbers of minority and high-poverty students, were disproportionately unlikely to get bonuses. As a result, researchers said, teachers could view jobs in advantaged schools as more attractive.

The study also found that the program, in effect since 1996, resulted in an improvement in overall test scores, particularly in math, but there was less evidence to show that achievement gaps had narrowed.

Despite those drawbacks, Jacob L. Vigdor, an associate professor of public policy and economics at Duke University in Durham, N.C., said the program has been politically popular. Teachers in the right-to-work state, he said, also widely support the program and want to see the bonuses expanded. “They want every school to participate,” he added.

In Little Rock, meanwhile, a three-year performance-pay pilot program did appear to improve student achievement, more so among students whose teachers were previously less effective at producing learning gains.

BRIC ARCHIVE

Researchers at the University of Arkansas looked at the program implemented at five public schools from 2004 to 2007. The program, said co-author and researcher Jay P. Greene, was remarkably simple: A cash bonus was assigned to an increase in student achievement. There was no evaluation, no professional development, and no supervisory assessment involved.

The results showed that student achievement improved when the teacher became eligible for the bonuses. “There is much to be learned, but the initial results are encouraging,” said Mr. Greene.

Teacher Involvement

Some conference participants offered the perspective that models involving teachers from the outset and not relying solely on test scores are the most successful.

A study by Julia E. Koppich, an education consultant based in San Francisco, concluded that the most comprehensive programs, such as those in Denver, Minneapolis, New York, and Toledo, Ohio, use multiple measures to gauge the extent to which teachers are contributing to increases in student learning. For instance, in Denver, Minneapolis, and Toledo, teachers are paid based on knowledge and skills and the responsibility they assume, as well as student growth.

Ms. Koppich said that all four programs are not punitive, retain echoes of the single salary schedule, and reflect careful planning and transparency.

What’s more, all are products of joint union-management undertakings, she said.

“Teacher involvement in developing and implementing these programs is essential. Those districts that choose to go behind closed doors and implement programs found they didn’t work very well,” Ms. Koppich said, noting the importance of bringing teachers’ unions on board while considering such plans.

A version of this article appeared in the March 12, 2008 edition of Education Week as Performance-Pay Studies Show Few Achievement Gains

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
Meeting the Moment: Accelerating Equitable Recovery and Transformative Change
Educators are deciding how best to re-establish routines such as everyday attendance, rebuild the relationships for resilient school communities, and center teaching and learning to consciously prioritize protecting the health and overall well-being of students
Content provided by Campaign for Grade-Level Reading
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Reading & Literacy Webinar
Addressing Learning Loss: What Schools Need to Accelerate Reading Instruction in K-3
When K-3 students return to classrooms this fall, there will be huge gaps in foundational reading skills. Does your school or district need a plan to address learning loss and accelerate student growth? In this
Content provided by PDX Reading
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Equity & Diversity Webinar
Culturally Relevant Pedagogy to Advance Educational Equity
Schools are welcoming students back into buildings for full-time in-person instruction in a few short weeks and now is the perfect time to take a hard look at both our practices and systems to build
Content provided by PowerMyLearning

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Teaching Profession Opinion Only 15 Students Showed Up for Online Class. Then, Teachers Got Creative
When COVID-19 closed school buildings, teachers worked to exhaustion but also felt proud.
Lora Bartlett
1 min read
A teacher shares her pandemic experience.
Vanessa Solis/Education Week and PeopleImages/iStock
Teaching Profession Opinion Teachers Were Told to 'Give Grace' as the Pandemic Started. They Did That and Much More
Districts offered little guidance otherwise, writes researcher Lora Bartlett.
Lora Bartlett
4 min read
Illustration of teachers working
F. Sheehan/Getty
Teaching Profession Educators of Color: Schools Need to Better Support Racial Justice Efforts
A new survey of educators of color finds that few received any training for addressing racism and violence with their students.
5 min read
Image of a teacher and students.
nadia_bormotova/iStock/Getty
Teaching Profession Opinion I've Studied Teachers for 20 Years. The Pandemic Was Their Ultimate Challenge
Researcher Lora Bartlett wondered what was happening behind the scenes as teachers' cheerful voices radiated from her daughters' computers.
Lora Bartlett
4 min read
Opinion Bartlett1 KNOW THYSELF LINCOLN
Lincoln Agnew for Education Week