School Choice & Charters

More Than One Way To Read Voucher Study

By Mark Walsh — September 27, 2000 3 min read
  • Save to favorites
  • Print

The research war over private school vouchers rages on.

In August, researchers led by Paul E. Peterson, a professor at Harvard University, reported results from a three-city voucher experiment indicating that black students using vouchers to attend private schools had averaged 6 percentile points higher on a standardized test after two years than a control group that had applied for the vouchers but remained in public schools.

The study involved recipients of privately financed vouchers in New York City, Washington, and Dayton, Ohio. (“Privately Financed Vouchers Help Black Students, Two Studies Find,” Sept. 6, 2000.)

But on Sept. 15, a research organization involved in the New York City portion of the study issued a more detailed report of the results, as well as a caution that “voucher claims of success are premature” in that city.

For More Information

Both the Harvard study and the Mathematica study are available online. (Require Adobe’s Acrobat Reader.)

Mathematica Policy Research Inc., based in Princeton, N.J., expressed concern that the New York City results were being overstated because only black 6th graders had shown statistically significant test gains after two years, while African-American students in three other grades tested showed no gains.

“My caution is, when you put a lot of weight on the average, you want to be comfortable with it,” said David Myers, the project director for Mathematicas research on the New York program. “In my view, its premature to conclude that, in New York, vouchers have an impact on the test scores of African-American students.”

The Mathematica release generated a round of stories in the news media that raised questions about the three-city study. And it provided new ammunition for critics of Mr. Peterson, who have long contended that his research is biased in favor of vouchers, a charge the researcher denies.

For example, People for the American Way, a Washington advocacy group that strongly opposes vouchers, said in a release last week that Mr. Peterson had been “rebuked” by his own research partner.

Small Disagreement

But upon close examination, there appears to be more complexity to Mathematica’s concerns about the study.

For one thing, the more detailed report on New York City bears not only Mr. Myers name as an author, but also that of Mr. Peterson.

The Harvard professor said last week that he had no disagreement with the Mathematica report on New York City. He disagrees with Mr. Myers only about the validity of relying on an average that is based on a particularly strong effect in one grade.

“The range of disagreement is really very small,” Mr. Peterson said.

He also defended the practice of averaging the results from the three cities. African- American voucher recipients scored an average of 4.3 percentage points better than their public school peers on a standardized test in New York City, 6.5 points better in Dayton, and 9 points better in Washington, for an overall average difference of 6.3 percentage points.

“This looks reasonably robust when you find similar results in three locations,” Mr. Peterson said. “The aggregated effect is more likely to be a stable finding than when you disaggregate.”

Mr. Myers said he agreed that looking across the three cities for similar results was valid.

“But when you see [some gains] so concentrated, it makes you want to pause,” he said. “I want to understand this better before I put much policy weight on it.”

Jennifer Hochschild, a professor of politics and government at Princeton University who critiqued Mr. Peterson’s three-city report for a recent political science meeting, said she had some concerns about the rush to draw policy conclusions from the results.

“I don’t think all the evidence was laid in this paper in a way that was convincing,” said Ms. Hochschild, who has since joined the government department in Harvard’s college of arts and sciences. “What is interesting is how much weight people are placing on a relatively small program. It’s the politics of vouchers, I guess.”

Related Tags:

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Data Webinar
Drive Instruction With Mastery-Based Assessment
Deliver the right data at the right time—in the right format—and empower better decisions.
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Profession Webinar
How Does Educator Well-Being Impact Social-Emotional Awareness in Schools?
Explore how adult well-being is key to promoting healthy social-emotional behaviors for students. Get strategies to reduce teacher stress.
Content provided by International Baccalaureate
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
IT Infrastructure Webinar
A New Era In Connected Learning: Security, Accessibility and Affordability for a Future-Ready Classroom
Learn about Windows 11 SE and Surface Laptop SE. Enable students to unlock learning and develop new skills.
Content provided by Microsoft Surface

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School Choice & Charters Mich. Public School Advocates Launch Effort to Stop DeVos-Backed Proposal
The former secretary of education is backing an initiative that advocates say would create an unconstitutional voucher system.
Samuel J. Robinson, mlive.com
4 min read
Student with backpack.
surasaki/iStock/Getty
School Choice & Charters The Pandemic Pushed More Families to Home School. Many Are Sticking With It
These parents have a common desire to take control of their children's education at a time when control feels elusive for so many people.
Laura Newberry, Los Angeles Times
6 min read
Karen Mozian homeschools her sixth-grade son, Elijah, age 9, at their home in Redondo Beach, California on Jan. 13, 2022. Mozian says her son wasn't getting the kind of help he needed at school. On his study breaks, he enjoys skateboarding and practicing drums.
Karen Mozian homeschools her 6th grade son, Elijah, age 9, at their home in Redondo Beach, California on Jan. 13, 2022. Mozian says her son wasn't getting the kind of help he needed at school. On his study breaks, he enjoys skateboarding and practicing drums.
Carolyn Cole/Los Angeles Times via TNS
School Choice & Charters Bloomberg Launches $750 Million Fund to Grow Charter Schools Amid 'Broken' K-12 System
Former New York City mayor and one-time presidential hopeful Michael R. Bloomberg aims to add 150,000 charter school seats over five years.
5 min read
New York's Mayor Michael Bloomberg, second from left, and Schools Chancellor Dennis Walcott, far left, meeting with senior students at the Bedford Academy High School in New York on Dec. 3, 2013. Bloomberg campaigned on gaining control of the nation's largest public school system. left his mark by championing charter schools, expanding school choice, giving schools letter grades, and replacing scores of struggling institutions with clusters of small schools.
Then-New York City Mayor Michael Bloomberg, second from left, and former Schools Chancellor Dennis Walcott, far left, meet with senior students at Bedford Academy High School in New York in 2013.
Bebeto Matthews/AP
School Choice & Charters Opinion The Kind of School Reform That Parents Actually Want
Parents' inclination to focus on solving specific problems rather than system change helps explain the appetite for novel school options.
3 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty