Find your next job fast at the Jan. 28 Virtual Career Fair. Register now.
School Choice & Charters

More Than One Way To Read Voucher Study

By Mark Walsh — September 27, 2000 3 min read

The research war over private school vouchers rages on.

In August, researchers led by Paul E. Peterson, a professor at Harvard University, reported results from a three-city voucher experiment indicating that black students using vouchers to attend private schools had averaged 6 percentile points higher on a standardized test after two years than a control group that had applied for the vouchers but remained in public schools.

The study involved recipients of privately financed vouchers in New York City, Washington, and Dayton, Ohio. (“Privately Financed Vouchers Help Black Students, Two Studies Find,” Sept. 6, 2000.)

But on Sept. 15, a research organization involved in the New York City portion of the study issued a more detailed report of the results, as well as a caution that “voucher claims of success are premature” in that city.

For More Information

Both the Harvard study and the Mathematica study are available online. (Require Adobe’s Acrobat Reader.)

Mathematica Policy Research Inc., based in Princeton, N.J., expressed concern that the New York City results were being overstated because only black 6th graders had shown statistically significant test gains after two years, while African-American students in three other grades tested showed no gains.

“My caution is, when you put a lot of weight on the average, you want to be comfortable with it,” said David Myers, the project director for Mathematicas research on the New York program. “In my view, its premature to conclude that, in New York, vouchers have an impact on the test scores of African-American students.”

The Mathematica release generated a round of stories in the news media that raised questions about the three-city study. And it provided new ammunition for critics of Mr. Peterson, who have long contended that his research is biased in favor of vouchers, a charge the researcher denies.

For example, People for the American Way, a Washington advocacy group that strongly opposes vouchers, said in a release last week that Mr. Peterson had been “rebuked” by his own research partner.

Small Disagreement

But upon close examination, there appears to be more complexity to Mathematica’s concerns about the study.

For one thing, the more detailed report on New York City bears not only Mr. Myers name as an author, but also that of Mr. Peterson.

The Harvard professor said last week that he had no disagreement with the Mathematica report on New York City. He disagrees with Mr. Myers only about the validity of relying on an average that is based on a particularly strong effect in one grade.

“The range of disagreement is really very small,” Mr. Peterson said.

He also defended the practice of averaging the results from the three cities. African- American voucher recipients scored an average of 4.3 percentage points better than their public school peers on a standardized test in New York City, 6.5 points better in Dayton, and 9 points better in Washington, for an overall average difference of 6.3 percentage points.

“This looks reasonably robust when you find similar results in three locations,” Mr. Peterson said. “The aggregated effect is more likely to be a stable finding than when you disaggregate.”

Mr. Myers said he agreed that looking across the three cities for similar results was valid.

“But when you see [some gains] so concentrated, it makes you want to pause,” he said. “I want to understand this better before I put much policy weight on it.”

Jennifer Hochschild, a professor of politics and government at Princeton University who critiqued Mr. Peterson’s three-city report for a recent political science meeting, said she had some concerns about the rush to draw policy conclusions from the results.

“I don’t think all the evidence was laid in this paper in a way that was convincing,” said Ms. Hochschild, who has since joined the government department in Harvard’s college of arts and sciences. “What is interesting is how much weight people are placing on a relatively small program. It’s the politics of vouchers, I guess.”

Related Tags:


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
School & District Management Webinar
Branding Matters. Learn From the Pros Why and How
Learn directly from the pros why K-12 branding and marketing matters, and how to do it effectively.
Content provided by EdWeek Top School Jobs
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
School & District Management Webinar
How to Make Learning More Interactive From Anywhere
Join experts from Samsung and Boxlight to learn how to make learning more interactive from anywhere.
Content provided by Samsung
Teaching Live Online Discussion A Seat at the Table With Education Week: How Educators Can Respond to a Post-Truth Era
How do educators break through the noise of disinformation to teach lessons grounded in objective truth? Join to find out.

EdWeek Top School Jobs

Director of Information Technology
Montpelier, Vermont
Washington Central UUSD
Great Oaks AmeriCorps Fellow August 2021 - June 2022
New York City, New York (US)
Great Oaks Charter Schools
Director of Athletics
Farmington, Connecticut
Farmington Public Schools
Head of Lower School
San Diego, California
San Diego Jewish Academy

Read Next

School Choice & Charters Home Schooling Is Way Up With COVID-19. Will It Last?
The shift could have lasting effects on both public schools and the home-schooling movement.
10Homeschool IMG
School Choice & Charters Opinion Challenging 3 Common Critiques of School Choice
A new volume from Corey DeAngelis and Neal McCluskey challenges some of the familiar but suspect assertions that pepper public debates about school choice.
3 min read
School Choice & Charters Briefly Stated Briefly Stated: Stories You May Have Missed
A collection of stories from the previous week that you may have missed.
8 min read
School Choice & Charters Opinion COVID-19 Has Capsized the Case Against School Choice
Amid the pandemic, public schools aren't able to deliver on their promises. This makes it hard to denounce school choice's tapestry of options as an inadequate or immoral alternative.
2 min read