Assessment

Reading Scores Given ‘Bump’ By Student Incentives, Study Finds

June 04, 2008 4 min read

School-based reward programs that offer students such incentives as cash, free MP3 players, or other gifts appear to produce improved reading scores across grade levels, preliminary findings from an ongoing research project suggest.

The analysis, which looked only at charter schools because of the prevalence of incentive programs in the independent public schools, found no impact on students’ performance in mathematics.

Released May 27 by the Center for Research on Education Outcomes at Stanford University, the study comes as a growing number of school districts and charter schools around the country are experimenting with such reward programs in the hope of improving student learning and behavior. The analysis suggests that incentive programs may well be a cost-effective measure to help raise achievement.

“It’s not a silver bullet, but for very little investment, you seem to get a pretty consistent bump,” Margaret E. Raymond, the director of the Stanford center and the study’s author, said in an interview.

The study found an average gain of 4 percentile points in students’ performance on standardized state reading tests for each year they participated in a rewards program. So, Ms. Raymond said by way of illustration, an elementary student who started out at the 50th percentile in reading could be expected to move up to the 65th percentile after several years in a school that uses an incentive system. The gains would be in addition to academic improvements the student would typically be expected to make.

“While this analysis is exploratory and based on a small number of cases, it shows consistent impact of incentive and reward programs across grades and designs in terms of student-achievement gains on state achievement tests in reading,” Ms. Raymond writes in an executive summary of the study.

Reward Systems Vary

The study was based on a survey of 250 charter schools. Of the 186 respondents, 106, or 57 percent, reported that they use a system of rewards and incentives with their students. Most of the systems combined student behavior, academic effort, and academic results in their reward structures, the report said.

A smaller subset of 47 schools was used for the academic analysis. The analysis focused on charter schools, the report says, because student-incentive programs have become a “widespread practice,” owing to such schools’ operational flexibility.

Across the incentive systems, classroom behavior was rated in 93 percent of the schools, followed by completion of assignments in 89 percent. Student-adult interactions, such as speaking respectfully or accepting direction,were rated in 86 percent of the schools.

The analysis looked at a variety of rewards, such as obtaining “access to select activities,” receiving certificates of merit, getting credit to purchase items at the school store, and receiving cash, a college-fund contribution, or other rewards.

It found stronger gains in schools where the adults share a common belief in the value of such incentive programs.

“When we look inside the black box,” Ms. Raymond said, “it turns out that having all the adults in the school on the same page makes a big difference.”

Eric P. Bettinger, an associate professor of economics at Case Western Reserve University in Cleveland, who recently published his own study on performance incentives in one school district, said that while Ms. Raymond’s research holds considerable potential to shed more light on the impact of incentive programs, its academic results to date should be interpreted with caution. (“Certified Urban Educators Seen Less Likely to Be Put In 9th Grade Classrooms,” April 20, 2005.)

Caution Urged

Mr. Bettinger pointed to a caveat noted in the study that schools that adopt reward programs “may be systematically different in some unmeasured way from those that do not use them,” as the report’s executive summary puts it. If that were the case, that “selection bias” could skew the results.

“In this paper, the clear worry is that the selection bias may be driving the results,” Mr. Bettinger said. “As she gathers more data,” he said of Ms. Raymond, “we’ll have a much clearer picture of how much is an achievement effect versus how much is driven by confounding factors.”

To test for selection bias, the analysis did try to take into account the increased tendency of schools to have rewards systems if they are located in neighborhoods in which high numbers of adults lack a high school diploma. When that factor was considered, the apparent impact of the reward systems disappeared.

But the study emphasizes that the sample of schools was too small to draw strong conclusions in testing for selection bias, and that the addition of more data and more schools would help interpret the results with more confidence.

“We do not have any certainty that there is selection bias going on,” Ms. Raymond said. “You can never prove there is selection bias.”

Mr. Bettinger said he was pleased the study’s survey had gathered information on various types of incentives schools use. Yet he noted that the study does not differentiate which incentives may have the strongest effects, as the programs are lumped together for the academic analysis.

“I hope [Ms. Raymond] can really separate the various types of incentive programs” in future research, he said. “All the incentive programs are very, very different in nature.” Ms. Raymond said she hopes in later research to provide such differentiated analysis.

Related Tags:

A version of this article appeared in the June 04, 2008 edition of Education Week as Reading Scores Given ‘Bump’ By Student Incentives, Study Finds

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
Measuring & Supporting Student Well-Being: A Researcher and District Leader Roundtable
Students’ social-emotional well-being matters. The positive and negative emotions students feel are essential characteristics of their psychology, indicators of their well-being, and mediators of their success in school and life. Supportive relationships with peers, school
Content provided by Panorama Education
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
Making Digital Literacy a Priority: An Administrator’s Perspective
Join us as we delve into the efforts of our panelists and their initiatives to make digital skills a “must have” for their district. We’ll discuss with district leadership how they have kept digital literacy
Content provided by Learning.com
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
How Schools Can Implement Safe In-Person Learning
In order for in-person schooling to resume, it will be necessary to instill a sense of confidence that it is safe to return. BD is hosting a virtual panel discussing the benefits of asymptomatic screening
Content provided by BD

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Assessment Opinion AP Exams Can't Be Business as Usual This Year
The College Board seems unconcerned with the collateral damage of its pandemic approach, writes an assistant superintendent of curriculum and instruction.
Pete Bavis
5 min read
Illustration of large boat in turbulent waters with other smaller boats falling into the abyss.
iStock/Getty Images Plus
Assessment Federal Lawmakers Urge Miguel Cardona to Let States Cancel Tests, Highlighting Discord
A letter from Democratic members to the new education secretary calls for an end to the "flawed" system of annual standardized exams.
3 min read
Jamaal Bowman speaks to reporters after voting at a polling station inside Yonkers Middle/High School in Yonkers, N.Y. on June 23, 2020.
Jamaal Bowman speaks to reporters after voting at a polling station inside Yonkers Middle/High School in Yonkers, N.Y. on June 23, 2020.
John Minchillo/AP
Assessment How Two Years of Pandemic Disruption Could Shake Up the Debate Over Standardized Testing
Moves to opt out of state tests and change how they're given threaten to reignite fights over high-stakes assessments.
9 min read
Image of a student at a desk.
patat/iStock/Getty
Assessment A Plan for Standardized Test Scores During the Pandemic Has Gotten States' Attention
A testing expert says his idea would provide helpful data with key context, but said other measures about student well-being are crucial.
7 min read
HS class 1257213326
Getty