School & District Management

Study: No Academic Gains From Vouchers for Black Students

By Catherine Gewertz — April 09, 2003 3 min read

African-American students who received vouchers to attend private schools in New York City derived no academic benefit from them, a Princeton University researcher has concluded.

The report, “Another Look at the New York City School Voucher Experiment,” is available from the Education Research Section at Princeton University. (Requires Adobe’s Acrobat Reader.)

Paul E. Peterson’s study “School Choice in New York City After Three Years: An Evaluation of the School Choice Scholarship Program” is available from the Mathematica Research Policy Inc. (Requires Adobe’s Acrobat Reader.)

The findings, released last week, emerged from an analysis of data that yielded a different conclusion a little more than a year ago.

In February 2002, Paul E. Peterson, a professor of government at Harvard University, unveiled the results of a study he had conducted with Mathematica Policy Research Inc. The study showed that African-American students who had won privately financed tuition vouchers in a 1997 lottery scored 5.5 national percentile points higher on standardized tests three years later than did black peers who had sought but did not receive the vouchers. The researchers called the difference a “statistically significant positive impact.” (“Voucher Plans’ Test Data Yield Puzzling Trends,” Feb. 27, 2002.)

Alan B. Krueger

Intrigued by the Peterson study’s finding that black students appeared to benefit from the vouchers while Hispanic students did not, Alan B. Krueger, a professor of economics and public policy at Princeton, sought to examine the data. Mathematica, a private, Princeton, N.J.-based group, made it available.

At an April 1 news conference here, Mr. Krueger argued that design features of the original study had produced misleading conclusions.

“This research has really been blown out of proportion,” said Mr. Krueger, accompanied by his Princeton co-researcher, Pei Zhou, and two of the Mathematica researchers who had worked with Mr. Peterson.

“For the most representative sample of black elementary school students,” he said, “offering a voucher had no statistically discernible impact on achievement scores in the New York City experiment.”

Standing Firm

Mr. Peterson, who was invited to the news conference but did not attend, said he is working on a paper to respond to the technical questions raised by Mr. Krueger’s analysis. He said he stands by his original findings.

“Our original estimates, at least as far as we know at this point, are the best available estimates of the impact of the voucher program,” Mr. Peterson said.

Mr. Krueger, in detailing the aspects of the earlier study that he contends produced skewed results, pointed to the exclusion of large numbers of children from the sample. While 2,666 needy K-4 pupils were placed either in a group that received vouchers or a control group that applied for but did not get them, more than 500 were excluded from the study because they did not take the baseline standardized test.

Bringing those children back into the study sample increased its size by 44 percent, Mr. Krueger said.

The definition of race proved pivotal as well, he said. The original study inferred a child’s race or ethnicity by asking the female parent or guardian to choose one from a list of racial and ethnic groups to describe herself. That method excluded many children, including those of mixed race and those whose fathers might belong to a racial or ethnic minority.

Adding those children back in increased the sample size by another 10 percent, he said. With those additions, and more revisions made to control for other demographic factors, Mr. Krueger and his colleagues found that black children who had received vouchers scored only 1.44 percentile points higher on tests three years later than did their black peers who did not receive vouchers.

Mathematica researcher David E. Myers said the re-evaluation had been “collegial,” and a model of how social scientists should share their findings and allow the data to be subjected to multiple examinations. But he lamented what he sees as the way some academics and reporters magnified the differential between black voucher recipients and nonrecipients. They overlooked what he considers the most significant finding, he said, which is unchanged by Mr. Krueger’s analysis: In the overall group of students studied, obtaining vouchers provided no academic benefit.

Events

Student Well-Being Webinar Boosting Teacher and Student Motivation During the Pandemic: What It Takes
Join Alyson Klein and her expert guests for practical tips and discussion on how to keep students and teachers motivated as the pandemic drags on.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
A Holistic Approach to Social-Emotional Learning
Register to learn about the components and benefits of holistically implemented SEL.
Content provided by Committee for Children
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
How Principals Can Support Student Well-Being During COVID
Join this webinar for tips on how to support and prioritize student health and well-being during COVID.
Content provided by Unruly Studios

EdWeek Top School Jobs

CCLC Program Site Director
Thornton, CO, US
Adams 12 Five Star Schools
Customer Support Specialist, Tier 1
Portland, OR, US
Northwest Evaluation Association
Customer Support Specialist, Tier 1
Portland, OR, US
Northwest Evaluation Association
Customer Support Specialist, Tier 1
Portland, OR, US
Northwest Evaluation Association

Read Next

School & District Management San Francisco School Board Pauses Renaming 44 Schools, Promises to Consult Historians
The renaming of 44 schools in the San Francisco Unified School District is apparently being put on hold after intense blowback.
Greg Keraghosian
1 min read
A pedestrian walks below a sign for Dianne Feinstein Elementary School in San Francisco, on Dec. 17, 2020. The San Francisco Unified School District put the renaming of 44 schools, including Dianne Feinstein Elementary School, on hold after local and national blowback.
A pedestrian walks below a sign for Dianne Feinstein Elementary School in San Francisco, on Dec. 17, 2020. The San Francisco Unified School District put the renaming of 44 schools, including Dianne Feinstein Elementary School, on hold after local and national blowback.<br/><br/>
Jeff Chiu/AP
School & District Management Superintendent Who Led During COVID-19 School Shutdowns Gets Top Honors
Michelle Reid of Washington state's Northshore district, one of the very first to close schools last March, was named National Superintendent of the Year.
3 min read
Michelle Reid, superintendent of the Northshore district in Washington
Michelle Reid, the superintendent of the Northshore district in Washington, was named National Superintendent of the Year.
courtesy of AASA, the School Superintendents Association
School & District Management Is Lunchtime the 'Weak Link' in School Reopening Plans?
It's risky when students are inside and unmasked, experts say. Here are five ways to mitigate that risk and make in-school meals safer.
11 min read
Elementary students in Brownsville, Texas, eat a socially distanced lunch in the school cafeteria. Experts say there are ways to mitigate the risk of contracting COVID-19 even when kids take their masks off to eat.
Elementary students in Brownsville, Texas, eat a socially distanced lunch in the school cafeteria. Experts say there are ways to mitigate the risk of contracting COVID-19 when kids take their masks off to eat.
Denise Cathey/The Brownsville Herald via AP
School & District Management Los Angeles Unified Shrinks Police Budget. Money Will Support Black Student Achievement
The board overseeing the Los Angeles Unified School District has cut $25 million from the budget for school police and will use the money to help fund an achievement plan for Black students.
1 min read
Demonstrators holds signs during a protest to demand the defunding of the Los Angeles school district police outside of the school board headquarters on June 23, 2020, in Los Angeles.
Demonstrators holds signs during a protest to demand the defunding of the Los Angeles school district police outside of the school board headquarters on June 23, 2020, in Los Angeles.
Marcio Jose Sanchez/AP