School & District Management

Schoolwide Reform Improves Test Scores, Analysis Finds

By Debra Viadero — December 11, 2002 3 min read
  • Save to favorites
  • Print

A team of Johns Hopkins University researchers, looking at studies on 29 popular schoolwide improvement programs, has concluded that the comprehensive models are better than the status quo when it comes to raising student achievement.

Read the 44- page report, “Comprehensive School Reform and Student Achievement: A Meta-Analysis,” from the Center for Research on the Education of Students Placed at Risk. (Requires Adobe’s Acrobat Reader.)

The analysis, which was published online last week by the university’s Center for Research on the Education of Students Placed at Risk, is the first to take a look across a wide range of different programs to gauge whether such schoolwide strategies, overall, make a difference in student achievement. It found that students in schools taking part in such programs outperformed 55 percent of their counterparts in nonparticipating schools.

While that kind of performance edge may seem slight, the researchers said it beats more conventional approaches to educating students from poor families, such as the “pullout” programs schools traditionally provided with federal Title I grants.

“It’s a big effect when you look at it in the context of other sorts of interventions that preceded comprehensive school reforms,” said Geoffrey D. Borman, the lead researcher on the two-year project. The other authors are Gina Hewes and Laura Overman, both researchers from the university in Baltimore, and Shelly Brown, who has since moved to the University of North Carolina at Greensboro.

Schoolwide approaches to improving student achievement got a boost from the federal government in 1998. That year, Congress enacted the Comprehensive School Reform Demonstration Program, which provides grants for schools to try out comprehensive improvement models. Now, researchers estimate that thousands of schools across the country are using such approaches, which include many popular, off-the-shelf programs such as Success for All and Core Knowledge.

The movement also spawned a handful of practical, Consumer Reports-style reviews that were intended to help educators sort out which programs had a strong research base and which didn’t.

Strong Evidence

Like earlier reports, the new study identifies three programs with the “strongest” evidence of effectiveness.

They are: Direct Instruction, an approach developed in the 1960s by University of Oregon professor Siegfried Engelmann; the School Development Program, a model created by Yale University’s Dr. James P. Comer to address students’ social and emotional as well academic needs; and Success for All, a program pioneered by Robert Slavin and Nancy Madden, also from Johns Hopkins.

The Hopkins reviewers delved deeper, however, and took a look at whether common elements of programs were linked to improved student achievement and whether the results varied when different methodologies were used or when the developers conducted the studies themselves.

One of the team’s findings is that results were stronger the longer a program was in place. The positive effects for schools with programs in place for five years, for example, were 21/2 times larger than those for all programs combined.

But the research team found no evidence linking particular elements of schoolwide programs, such as whether they require specific pedagogical practices or curricular materials, to improved academic performance by students.

Of 11 such characteristics analyzed, only one—whether a program involves parents and the community in running the school— seemed to affect achievement. That association, however, was negative. One reason for that finding, the report suggests, may be that such efforts sidetrack schools from the main purpose of improving student achievement.

In comparison, studies yielded much stronger positive effects when the results were measured through test-score gains of a single group of students, rather than by more experimental approaches comparing students in participating and nonparticipating schools.

Studies conducted by program developers also produced much bigger effect sizes than those by third-party evaluators.

A version of this article appeared in the December 11, 2002 edition of Education Week as Schoolwide Reform Improves Test Scores, Analysis Finds

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Assessment Webinar
The State of Assessment in K-12 Education
What is the impact of assessment on K-12 education? What does that mean for administrators, teachers and most importantly—students?
Content provided by Instructure
Jobs January 2022 Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Reading & Literacy Webinar
Proven Strategies to Improve Reading Scores
In this webinar, education and reading expert Stacy Hurst will provide a look at some of the biggest issues facing curriculum coordinators, administrators, and teachers working in reading education today. You will: Learn how schools
Content provided by Reading Horizons

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management Opinion If You Can’t Maintain an Initiative, Maybe You Shouldn’t Do It
Schools are often really good at finding new initiatives to implement but aren't always good at maintaining. Here's a model to consider.
5 min read
Screen Shot 2022 01 21 at 7.57.56 AM
Shutterstock
School & District Management Schools Are Desperate for Substitutes and Getting Creative
Now in the substitute-teacher pool: parents, college students, and the National Guard.
10 min read
Zackery Kimball, a substitute teacher at Bailey Middle School, works with two classes of students at the school's theater hall on Friday, Dec. 10, 2021, in Las Vegas. Many schools have vacant teaching and/or support staff jobs and no available substitutes to cover day-to-day absences.
Zackery Kimball, a substitute teacher at Bailey Middle School in Las Vegas, works with two classes of students at the school's theater hall on a Friday in December 2021.
Bizuayehu Tesfaye/Las Vegas Review-Journal via AP
School & District Management 3 Ways School Districts Can Ease the Pain of Supply Chain Chaos
Have a risk management plan, pay attention to what's happening up the supply chain, and be adaptable when necessary.
3 min read
Cargo Ship - Supply Chain with products such as classroom chairs, milk, paper products, and electronics
iStock/Getty Images Plus
School & District Management Vulnerable Students, Districts at Greater Risk as Natural Disasters Grow More Frequent
New federal research indicates the harm from fires and storms to school facilities, learning, and mental health is disproportionate.
4 min read
Helina Thorp, right, 14, expresses frustration while unsuccessfully trying to log in to her school distance-learning classes in Placerville, Calif., after Pacific Gas & Electric intentionally shut off power to prevent wildfires amid high winds in September 2020.
Helina Thorp, right, 14, expresses frustration while unsuccessfully trying to log in to her school distance-learning classes in Placerville, Calif., after Pacific Gas & Electric shut off power to prevent wildfires amid high winds in September 2020.
Daniel Kim/The Sacramento Bee via AP