Student Well-Being

Merit Pay for Students Fails to Raise Scores, Study Finds

By Dakarai I. Aarons — April 16, 2010 4 min read
BRIC ARCHIVE

A multicity experiment to test the effect of paying students for performance succeeded in increasing achievement when the payments were tied to specific behaviors related to learning, such as reading books, but not when the awards depended directly on test scores, new findings show.

“Providing incentives for achievement-test scores has no effect on any form of achievement we can measure,” wrote Harvard University economist Roland G. Fryer in a working paper published last week by the National Bureau of Economic Research.

Still, he concluded, if cash rewards are linked to behavior that can contribute to better student outcomes, “incentives can be a cost-effective strategy to raise achievement even among the poorest students in the lowest-performing schools.”

Mr. Fryer, who is the chief executive officer of Harvard’s Education Innovation Laboratory, conducted the experiment during the 2007-08 and 2008-09 school years in more than 250 urban schools in Chicago, Dallas, the District of Columbia, and New York City. In all, roughly 38,000 students collectively received a total of $6.3 million. The experiment was paid for with both public and private funding.

While the experiment shows providing monetary rewards for good practices can boost achievement in a more cost-effective way than other education reforms, such as lowering class size, Mr. Fryer concluded, they are not a cure-all to education’s ills.

“Incentives alone, like these other reforms, are not powerful enough to close the achievement gap,” he says in the working paper.

Brian A. Jacob, a professor of education policy and economics at the University of Michigan in Ann Arbor, said Mr. Fryer’s experiment is especially valuable for educators and policymakers because most studies looking at extrinsic motivation have been done in the context of a psychology lab, not in schools.

“I think what this does is provide a baseline for other researchers and practitioners to experiment with other financial incentives,” Mr. Jacob said. “What I would take away from this if I were a district superintendent or a policymaker is that it is certainly worth continuing to look at this, although I wouldn’t change a statewide policy on the basis of this study alone.”

The experiments were all school-based randomized trials and they varied from city to city in what students were rewarded for, how often, and how much.

New York City 4th and 7th graders were paid based on their performance on a series of 10 interim exams given to all students in district schools. Students could earn as much as $500 over the course of the school year. On average, 4th graders earned $139.43, and 7th graders collected $231.55.

Ninth graders in the Windy City were paid every five weeks based on grades in five core courses. Those students could earn up to nearly $2,000 per year. Chicago students on average earned $695.61, and the highest achiever collected $1,875.

Chicago schools discontinued the program this year because of a lack of funding for a new cohort of students, but will finish making payments to those who were taking part in the program, said spokeswoman Monique D. Bond.

Middle schoolers in the District of Columbia were paid monetary awards based on measures that included attendance and behavior. The maximum amount was based on the size of the school. On average, students earned $532.85 for the year, with the highest-earning student receiving $1,322.

Dallas 2nd graders were paid $2 for every book up to 20 per semester that they read, as long as they also could pass a quiz testing their comprehension on the book. On average, students received $13.81 out of a maximum of $80.

Mr. Fryer declined to comment.

Lost in Translation

There were minimal effects on test scores for the students paid in New York City, and minimal increases in grade point averages for Chicago students. No overall increase in achievement for students in either city was seen.

The Dallas 2nd graders saw statistically significant increases in reading comprehension, vocabulary, and language, posting test-score gains that continued even after the experiment was over. D.C. students saw “moderate gains” in their reading and math scores after middle schoolers were paid for factors including attendance, behavior, turning in homework, and wearing school uniforms.

The Chicago and Dallas results were both surprising, Mr. Jacob said: High school students generally know what it takes to produce better grades in their classes, and yet the money did not seem to motivate the Chicago 9th graders to do better. The relatively limited scope of the reading intervention in Dallas produced significant gains, just by getting students to read more books, Mr. Jacob said.

The study’s mixed results, Mr. Fryer writes, suggest that students lack the know-how to translate excitement about receiving the financial awards into actions that would boost their achievement.

A version of this article appeared in the April 21, 2010 edition of Education Week as Rewards for Students Spawn Mixed Results, Four-City Study Finds

Events

School & District Management Live Event EdWeek Leadership Symposium
Education Week's Premier Leadership Event for K12 School & District Leaders.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Law & Courts Webinar
The Future of Criminal Justice Reform: A Sphere Education Initiative Conversation
America’s criminal justice system is in crisis and calls for reform are dominating the national debate. Join Cato’s Sphere Education Initiative and Education Week for a webinar on criminal justice and policing featuring the nation’s
Content provided by Cato Institute
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
Equity, Care and Connection: New SEL Tools and Practices to Support Students and Adults
As school districts plan to welcome students back into buildings for the upcoming school year, this is the perfect time to take a hard look at both our practices and our systems to build a
Content provided by Panorama Education

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Whitepaper
The Complete Guide to SEL
This guide illustrates why SEL is more important now and what you should look for when implementing a social-emotional curriculum.
Content provided by Navigate360
Student Well-Being How Educators Are Approaching Summer Learning This Year
After a difficult year, schools adjust what's best for students as they customize summer learning, enrichment, and play opportunities.
9 min read
Image of kids with backpacks running outdoors.
iStock/Getty
Student Well-Being Cardona Releases First Wave of Aid to Help Schools Identify, Assist Homeless Students
Citing the urgency of identifying homeless students, the Education Department will release some relief aid targeted at their needs.
3 min read
Rycc Smith welcomes Montello Elementary School students as they board his bus outside the Lewiston, Maine school after the first day back in nearly a month on Jan. 21, 2021. The entire school district switched to all remote learning after an uptick in COVID-19 cases last month.
Elementary school students board a bus in Lewiston, Maine, after their first day back to in-person school in nearly a month on Jan. 21. Advocates say it has been more difficult to identify homelessness during remote learning, in part because they can't track changes in students' use of school transportation.
Russ Dillingham/Sun Journal via AP
Student Well-Being Spotlight Spotlight on Post-Pandemic Communications
In this Spotlight, review lessons from other leaders, evaluate what can be done to address the situations experienced and more.