Student Achievement

Study of Harlem Children’s Zone Finds Gaps Closing

November 17, 2009 4 min read

The Harlem Children’s Zone, a high-profile New York City initiative that combines charter schools with wrap-around community services for minority students and their low-income families, is showing dramatic academic gains that effectively close the black-white achievement gap in most categories examined, a new study finds.

What’s less clear, the researchers say, is whether the improved performance can be explained by the quality of the schools alone, or by the combination of the schooling with the web of community supports, such as early-childhood programs, parenting workshops, and asthma and anti-obesity initiatives.

That question is of particular consequence now, since the Obama administration has touted the Harlem Children’s Zone as a model anti-poverty strategy it hopes to help replicate in other urban areas. (“President Envisions Anti-Poverty Efforts Like Harlem’s ‘Zone’,” March 11, 2009.)

Geoffrey Canada, the president and chief executive officer of the Harlem Children’s Zone, speaks in the East Room of the White House in June before President Barack Obama delivered remarks highlighting innovative nonprofit programs.

The report’s evidence suggests that “either the ... public charter schools are the main driver of the results or the interaction of the schools and the community investments is the impetus for such success,” write the co-authors, Roland G. Fryer Jr., an economics professor at Harvard University, and Will S. Dobbie, a graduate student at Harvard’s Kennedy School of Government. “Community investments alone cannot explain the results.”

The report was published this month as a “working paper” by the National Bureau of Economic Research. It is in the process of being peer-reviewed.

The findings come as U.S. Secretary of Education Arne Duncan last week talked up the Harlem Children’s Zone at a conference the nonprofit organization hosted in New York City.

“Children born today in Harlem have a continuum of support that middle-class children take for granted, but is shamefully rare for disadvantaged students,” he said. “President Obama was so impressed by [the effort] that he made it the template of his Promise Neighborhoods proposal during the campaign.”

Mr. Obama has requested $10 million in fiscal 2010 for that program.

Cautions Offered

Edmund W. Gordon, a professor emeritus of psychology and education at Teachers College, Columbia University, and at Yale University, said he believes the results are “cause for celebration,” but he expressed concern that the Obama administration may be moving “unselectively” to reproduce the model, when it may need to be adapted to local conditions.

He also cautioned that the study does not offer evidence of the effectiveness of the community supports as key to the success.

“What I’m hesitant to endorse is the idea that the whole package is ready for generalized replication,” said Mr. Gordon, who is the chairman of a research advisory committee for the Harlem Children’s Zone. “I think the idea of wrap-around student services needs a lot more nuanced study.”

Longer School Day, Year

The Harlem Children’s Zone runs a broad-based program to meet the educational, health, and social-service needs of residents in a 97-block area of New York City, including two charter schools that serve some 1,200 students in elementary, middle, and high school grades.

To gauge the academic results of the effort, the researchers used two statistical strategies. One was a randomized-lottery method comparing a group of students who won the lottery and enrolled in the schools with a control group of students who applied but did not win the lottery. The second strategy used the schools’ start date and institutional features of the Harlem Children’s Zone to construct a valid control group.

The study finds that a “treatment group” of students enrolled in the Harlem charter schools showed academic gains over three years in elementary mathematics and English language arts, and in middle school math, that were strong enough to close the achievement gap between those students and the average score for white students in New York City public schools, based on their performance on New York state tests. The black-white achievement gap for middle schoolers was reduced in English language arts by about half.

Put another way, the typical student before entering a Harlem Children’s Zone middle school was outscoring only about 20 percent of New York City’s white students in math, but after three years in the charter, was outscoring 45 percent of white students, the report finds. After adjusting for gender and free-lunch eligibility, the typical Harlem Children’s Zone student was outscoring 54 percent of white students.

Mr. Dobbie, the report’s co-author, said the gains were remarkably strong, far outpacing the benefits seen by many other interventions, such as reducing class sizes from 24 students to 16.

The report also examined the students’ performance on the Iowa Tests of Basic Skills. Here, the results were “similar, if more modest,” but there were no control-group scores available for comparison, making the findings “only suggestive,” the report says.

The researchers note that the charter schools themselves have a range of characteristics that may help students, from an extended school day and year to an emphasis on high-quality teachers, providing free medical and dental care, and offering students financial incentives for achievement.

The study also examined two of the community initiatives, a parenting program and a preschool program, but found no evidence that they were positively associated with student achievement.

Richard Rothstein, a research associate at the Economic Policy Institute in Washington, said the effort shows promise. But he suggested the positive but less dramatic gains on the Iowa tests provide “a much better indicator of what’s going on,” because they are “not subject to the score inflation of high-stakes exams like the New York state tests.”

A version of this article appeared in the November 18, 2009 edition of Education Week as Study of Harlem Children’s Zone Finds Achievement Gaps Closing

Events

Jobs The EdWeek Top School Jobs Virtual Career Fair
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Curriculum Webinar
How to Power Your Curriculum With Digital Books
Register for this can’t miss session looking at best practices for utilizing digital books to support their curriculum.
Content provided by OverDrive
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
Embracing Student Engagement: The Pathway to Post-Pandemic Learning
As schools emerge from remote learning, educators are understandably worried about content and skills that students would otherwise have learned under normal circumstances. This raises the very real possibility that children will face endless hours
Content provided by Newsela

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Student Achievement Quiz Quiz: How Much Do You Know About Education/Workforce Readiness?
Quiz Yourself: How are students doing with education and workforce readiness?
Student Achievement New Data on the Ways Full-Time Remote Learners Lost Out
A new report by the RAND Corp. shows that students who were in fully remote schools had less instructional time and worse outcomes.
9 min read
Kelly Mack works on her laptop to teach remotely from her early 1940s vintage camper/trailer in her backyard at home in Evanston, Ill., on Sept. 2, 2020. Most students in Illinois have been starting remote learning this fall, according to results from an Illinois State Board of Education survey. Mack teaches math at Nichols Middle School in Evanston.
Kelly Mack, a math teacher at Nichols Middle School in Evanston, Ill., works on her laptop to teach remotely from her camper/trailer.
Nam Y. Huh/AP
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Achievement Whitepaper
Accelerate Post Pandemic Learning Recovery: A Few Big Bets
This panel presents an overview of three of the “big bets” being promoted by the Campaign for Grade Level Reading to the local funders, c...
Content provided by The Campaign for Grade-Level Reading
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Achievement Whitepaper
The Road to Recovery: Removing the Blocks to Student Engagement
Let’s identify the rocks on the road for all students and understand what it takes to remove them.
Content provided by Newsela