School & District Management

Schoolwide Reform Improves Test Scores, Analysis Finds

By Debra Viadero — December 11, 2002 3 min read

A team of Johns Hopkins University researchers, looking at studies on 29 popular schoolwide improvement programs, has concluded that the comprehensive models are better than the status quo when it comes to raising student achievement.

Read the 44- page report, “Comprehensive School Reform and Student Achievement: A Meta-Analysis,” from the Center for Research on the Education of Students Placed at Risk. (Requires Adobe’s Acrobat Reader.)

The analysis, which was published online last week by the university’s Center for Research on the Education of Students Placed at Risk, is the first to take a look across a wide range of different programs to gauge whether such schoolwide strategies, overall, make a difference in student achievement. It found that students in schools taking part in such programs outperformed 55 percent of their counterparts in nonparticipating schools.

While that kind of performance edge may seem slight, the researchers said it beats more conventional approaches to educating students from poor families, such as the “pullout” programs schools traditionally provided with federal Title I grants.

“It’s a big effect when you look at it in the context of other sorts of interventions that preceded comprehensive school reforms,” said Geoffrey D. Borman, the lead researcher on the two-year project. The other authors are Gina Hewes and Laura Overman, both researchers from the university in Baltimore, and Shelly Brown, who has since moved to the University of North Carolina at Greensboro.

Schoolwide approaches to improving student achievement got a boost from the federal government in 1998. That year, Congress enacted the Comprehensive School Reform Demonstration Program, which provides grants for schools to try out comprehensive improvement models. Now, researchers estimate that thousands of schools across the country are using such approaches, which include many popular, off-the-shelf programs such as Success for All and Core Knowledge.

The movement also spawned a handful of practical, Consumer Reports-style reviews that were intended to help educators sort out which programs had a strong research base and which didn’t.

Strong Evidence

Like earlier reports, the new study identifies three programs with the “strongest” evidence of effectiveness.

They are: Direct Instruction, an approach developed in the 1960s by University of Oregon professor Siegfried Engelmann; the School Development Program, a model created by Yale University’s Dr. James P. Comer to address students’ social and emotional as well academic needs; and Success for All, a program pioneered by Robert Slavin and Nancy Madden, also from Johns Hopkins.

The Hopkins reviewers delved deeper, however, and took a look at whether common elements of programs were linked to improved student achievement and whether the results varied when different methodologies were used or when the developers conducted the studies themselves.

One of the team’s findings is that results were stronger the longer a program was in place. The positive effects for schools with programs in place for five years, for example, were 21/2 times larger than those for all programs combined.

But the research team found no evidence linking particular elements of schoolwide programs, such as whether they require specific pedagogical practices or curricular materials, to improved academic performance by students.

Of 11 such characteristics analyzed, only one—whether a program involves parents and the community in running the school— seemed to affect achievement. That association, however, was negative. One reason for that finding, the report suggests, may be that such efforts sidetrack schools from the main purpose of improving student achievement.

In comparison, studies yielded much stronger positive effects when the results were measured through test-score gains of a single group of students, rather than by more experimental approaches comparing students in participating and nonparticipating schools.

Studies conducted by program developers also produced much bigger effect sizes than those by third-party evaluators.

A version of this article appeared in the December 11, 2002 edition of Education Week as Schoolwide Reform Improves Test Scores, Analysis Finds

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Future of Work Webinar
Digital Literacy Strategies to Promote Equity
Our new world has only increased our students’ dependence on technology. This makes digital literacy no longer a “nice to have” but a “need to have.” How do we ensure that every student can navigate
Content provided by Learning.com
Mathematics Online Summit Teaching Math in a Pandemic
Attend this online summit to ask questions about how COVID-19 has affected achievement, instruction, assessment, and engagement in math.
School & District Management Webinar Examining the Evidence: Catching Kids Up at a Distance
As districts, schools, and families navigate a new normal following the abrupt end of in-person schooling this spring, students’ learning opportunities vary enormously across the nation. Access to devices and broadband internet and a secure

EdWeek Top School Jobs

Special Education Teachers
Lancaster, PA, US
Lancaster Lebanon IU 13
Speech Therapists
Lancaster, PA, US
Lancaster Lebanon IU 13
Elementary Teacher
Madison, Wisconsin
One City Schools
Elementary Teacher - Scholars Academy
Madison, Wisconsin
One City Schools

Read Next

School & District Management Opinion A Road Map for Education Research in a Crisis
Here are five basic principles for a responsible and timely research agenda during the COVID-19 pandemic.
Robin J. Lake
4 min read
Two opposing sides reaching out to work together
J.R. Bee for Education Week
School & District Management 1,000 Students, No Social Distancing, and a Fight to Keep the Virus Out
A principal describes the "nightmare" job of keeping more than 1,000 people safe in the fast-moving pandemic.
4 min read
Dixie Rae Garrison, principal of West Jordan Middle School, in West Jordan, Utah.
Dixie Rae Garrison, principal of West Jordan Middle School in West Jordan, Utah, would have preferred a hybrid schedule and other social distancing measures.
Courtesy of Dixie Rae Garrison
School & District Management A School Leader Who Calls Her Own Shots on Battling the Coronavirus
A charter school founder uses her autonomy to move swiftly on everything from classroom shutdowns to remote schooling.
3 min read
Nigena Livingston, founder and head of School at the URBAN ACT Academy in Indianapolis, Ind.
Nigena Livingston, founder and head of school at the URBAN ACT Academy in Indianapolis, makes swift decisions in responding to the threat of COVID-19 in her school community.
Courtesy of Nigena Livingston
School & District Management A COVID-19 Lull Gives Way to ‘Borderline Insanity’
When the number of cases started to rise steeply, a school community hammered out a routine. Then a basketball player tested positive.
3 min read
Andy McGill, K-12 assistant principal at West Liberty-Salem Local School District in West Liberty, Ohio.
Andy McGill, K-12 assistant principal at West Liberty-Salem Local School District in Ohio, includes coronavirus response among his administrative duties.
Courtesy of Andy McGill