Assessment

Data Reanalysis Finds Test-Score Edge for Private Schools

By Mary Ann Zehr — August 08, 2006 3 min read
  • Save to favorites
  • Print

Harvard University researchers publicized findings last week calling into question the methodology of recent studies finding that students at public schools did as well as or better than their private school peers on some standardized tests when scores were adjusted for certain student characteristics.

Paul E. Peterson, a professor at Harvard’s John F. Kennedy School of Government, found that when he and graduate student Elena Llaudet reanalyzed data from the National Assessment of Educational Progress using different variables to adjust for student characteristics, students at private schools came out on top of those in public schools in almost all areas.

That conclusion was nearly the opposite of a study recently released by the U.S. Department of Education, as well as an earlier study by two University of Illinois professors. (“Public Schools Fare Well Against Private Schools in Study,” July 26, 2006.)

“On the Public-Private School Achievement Debate” is available from the Program on Education Policy and Governance at Harvard University.

In all three studies, researchers adjusted for characteristics such as race and socioeconomic status, but they based the adjustment on different information that had been reported to NAEP.

Mr. Peterson said that none of the three studies can conclude with any confidence that one group of schools does better than the other, because the NAEP data provide only a snapshot of how students did on tests at one point in time, rather than what they learned over a period of time.

“We aren’t offering this study as definitive evidence,” Mr. Peterson said. “We’re offering it as strong evidence that the methods used by the other two studies are defective.”

Henry Braun, the senior author of the NCES report and a senior educational researcher for the Educational Testing Service in Princeton, N.J., acknowledged that Mr. Peterson has raised some important issues regarding the variables used in the NCES study. But he said the variables used by Mr. Peterson are equally problematic.

“Because of the variables he’s using, it may be that he is underadjusting for disadvantage in the public school sector,” he said.

Christopher Lubienski and Sarah Theule Lubienski, a husband-and-wife research team at the University of Illinois at Urbana-Champaign who published a study in January that Mr. Peterson is revisiting, argued in an interview last week that the variables chosen by Mr. Peterson are flawed and inferior to the ones they used.

Different Classifications?

The Harvard team relied largely on information about student characteristics reported by the students themselves, rather than information reported by public and private school administrators. Mr. Peterson contends that in comparisons of public and private schools, data reported by administrators based on their schools’ participation in federal programs, such as the federal subsidized lunch program, is not reliable because both kinds of schools have very different involvement in those programs and classify their students in different ways.

Ms. Lubienski acknowledged that classification differences between public and private schools pose a problem. But she argued that the Harvard team is “throwing the baby out with the bath water” to exclude data such as whether students are identified as having limited proficiency in English or have individualized education programs when controlling for student background.

She said some of the variables Mr. Peterson accounts for also have flaws. He controls for the education level of students’ parents, for example, which Ms. Lubienski sees as a problem because some 4th graders who reported that information to NAEP likely don’t know their parents’ education levels.

Mr. Braun added that Mr. Peterson’s use of parental education to adjust for socioeconomic level is flawed because he didn’t account for such nuances as whether both parents or only one has a college education.

The federal study, released July 14 by the National Center for Education Statistics, found that when data are adjusted for student characteristics, 4th and 8th grade public school students perform as well as or better than private school students in reading and math, with the exception of 8th grade reading, where children in private schools do better than their public school peers.

Those results were similar to those found by the Lubienskis, though they looked only at NAEP math scores.

Related Tags:

A version of this article appeared in the August 09, 2006 edition of Education Week as Data Reanalysis Finds Test-Score Edge for Private Schools

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
Attend to the Whole Child: Non-Academic Factors within MTSS
Learn strategies for proactively identifying and addressing non-academic barriers to student success within an MTSS framework.
Content provided by Renaissance
Classroom Technology K-12 Essentials Forum How to Teach Digital & Media Literacy in the Age of AI
Join this free event to dig into crucial questions about how to help students build a foundation of digital literacy.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Assessment Should Teachers Be Tough Graders? Here's What They Have to Say
Teachers on social media give their opinions on whether stricter grading helps their students learn more.
2 min read
Close cropped photo of a teacher's grade on an essay graded 'F' in red with the words "See Me"
iStock/Getty
Assessment The State of Teaching Where Teachers Say the Pressure to Change Grades Comes From
Teachers are more likely to be pressured by parents than school leaders.
4 min read
Conceptul image in blues of a teacher handing out graded papers.
Liz Yap/Education Week and E+
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Assessment Sponsor
Testing Season: Who Are We Really Testing For? Transforming Assessments from Obstacles to Opportunities
As another testing season approaches, a familiar question weighs heavily on our minds: who are these tests serving?
Content provided by Achievement Network
Assessment What the Research Says AI and Other Tech Can Power Better Testing. Can Teachers Use the New Tools?
Assessment experts call for better educator supports for technology use.
3 min read
Illustration of papers and magnifying glass
iStock / Getty Images Plus