Assessment

Reading Scores Given ‘Bump’ By Student Incentives, Study Finds

June 04, 2008 4 min read

School-based reward programs that offer students such incentives as cash, free MP3 players, or other gifts appear to produce improved reading scores across grade levels, preliminary findings from an ongoing research project suggest.

The analysis, which looked only at charter schools because of the prevalence of incentive programs in the independent public schools, found no impact on students’ performance in mathematics.

Released May 27 by the Center for Research on Education Outcomes at Stanford University, the study comes as a growing number of school districts and charter schools around the country are experimenting with such reward programs in the hope of improving student learning and behavior. The analysis suggests that incentive programs may well be a cost-effective measure to help raise achievement.

“It’s not a silver bullet, but for very little investment, you seem to get a pretty consistent bump,” Margaret E. Raymond, the director of the Stanford center and the study’s author, said in an interview.

The study found an average gain of 4 percentile points in students’ performance on standardized state reading tests for each year they participated in a rewards program. So, Ms. Raymond said by way of illustration, an elementary student who started out at the 50th percentile in reading could be expected to move up to the 65th percentile after several years in a school that uses an incentive system. The gains would be in addition to academic improvements the student would typically be expected to make.

“While this analysis is exploratory and based on a small number of cases, it shows consistent impact of incentive and reward programs across grades and designs in terms of student-achievement gains on state achievement tests in reading,” Ms. Raymond writes in an executive summary of the study.

Reward Systems Vary

The study was based on a survey of 250 charter schools. Of the 186 respondents, 106, or 57 percent, reported that they use a system of rewards and incentives with their students. Most of the systems combined student behavior, academic effort, and academic results in their reward structures, the report said.

A smaller subset of 47 schools was used for the academic analysis. The analysis focused on charter schools, the report says, because student-incentive programs have become a “widespread practice,” owing to such schools’ operational flexibility.

Across the incentive systems, classroom behavior was rated in 93 percent of the schools, followed by completion of assignments in 89 percent. Student-adult interactions, such as speaking respectfully or accepting direction,were rated in 86 percent of the schools.

The analysis looked at a variety of rewards, such as obtaining “access to select activities,” receiving certificates of merit, getting credit to purchase items at the school store, and receiving cash, a college-fund contribution, or other rewards.

It found stronger gains in schools where the adults share a common belief in the value of such incentive programs.

“When we look inside the black box,” Ms. Raymond said, “it turns out that having all the adults in the school on the same page makes a big difference.”

Eric P. Bettinger, an associate professor of economics at Case Western Reserve University in Cleveland, who recently published his own study on performance incentives in one school district, said that while Ms. Raymond’s research holds considerable potential to shed more light on the impact of incentive programs, its academic results to date should be interpreted with caution. (“Certified Urban Educators Seen Less Likely to Be Put In 9th Grade Classrooms,” April 20, 2005.)

Caution Urged

Mr. Bettinger pointed to a caveat noted in the study that schools that adopt reward programs “may be systematically different in some unmeasured way from those that do not use them,” as the report’s executive summary puts it. If that were the case, that “selection bias” could skew the results.

“In this paper, the clear worry is that the selection bias may be driving the results,” Mr. Bettinger said. “As she gathers more data,” he said of Ms. Raymond, “we’ll have a much clearer picture of how much is an achievement effect versus how much is driven by confounding factors.”

To test for selection bias, the analysis did try to take into account the increased tendency of schools to have rewards systems if they are located in neighborhoods in which high numbers of adults lack a high school diploma. When that factor was considered, the apparent impact of the reward systems disappeared.

But the study emphasizes that the sample of schools was too small to draw strong conclusions in testing for selection bias, and that the addition of more data and more schools would help interpret the results with more confidence.

“We do not have any certainty that there is selection bias going on,” Ms. Raymond said. “You can never prove there is selection bias.”

Mr. Bettinger said he was pleased the study’s survey had gathered information on various types of incentives schools use. Yet he noted that the study does not differentiate which incentives may have the strongest effects, as the programs are lumped together for the academic analysis.

“I hope [Ms. Raymond] can really separate the various types of incentive programs” in future research, he said. “All the incentive programs are very, very different in nature.” Ms. Raymond said she hopes in later research to provide such differentiated analysis.

A version of this article appeared in the June 04, 2008 edition of Education Week as Reading Scores Given ‘Bump’ By Student Incentives, Study Finds

Events

Jobs The EdWeek Top School Jobs Virtual Career Fair
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Mathematics Webinar
Engaging Young Students to Accelerate Math Learning
Join learning scientists and inspiring district leaders, for a timely panel discussion addressing a school district’s approach to doubling and tripling Math gains during Covid. What started as a goal to address learning gaps in
Content provided by Age of Learning & Digital Promise, Harlingen CISD
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Curriculum Webinar
How to Power Your Curriculum With Digital Books
Register for this can’t miss session looking at best practices for utilizing digital books to support their curriculum.
Content provided by OverDrive

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Assessment Whitepaper
Facing the Future Together: Digital Innovative Solutions
Join us to discuss how digital innovative solutions can enrich the educational experience in the K-12 environment. We’ll share how these ...
Content provided by Pearson
Assessment Opinion What Federally Mandated State Tests Are Good For (And What They Aren’t)
Spring 2021 testing is happening. That can be a good thing—if the goal is about more than school accountability.
Stuart Kahl
5 min read
Two people analyze test data
Visual Generation/iStock/Getty
Assessment Opinion The National Assessment Governing Board’s Troubling Gag Order
NAGB's recently released restrictions on how its board members can communicate set a troubling precedent.
3 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Assessment Whitepaper
How Are Kids Really Performing This Year?
Has the academic impact of COVID-19 narrowed since last fall? How much progress have students made at each grade level? Get the answers i...
Content provided by Renaissance Learning