School & District Management

Second Study Gives Thumbs Up to N.Y.C. Charters

By Debra Viadero — January 05, 2010 5 min read

Students in New York City’s charter elementary and middle schools make bigger learning gains than their regular public school counterparts in math and reading, according to the second report in five months to find good results for the independently run public schools in the nation’s largest school system.

The findings are attracting a lot of attention because they come from a Stanford University research group that issued a critical national study of charter schools last June. In that study, which looked at 2,403 charter schools in 15 states and the District of Columbia, the Center for Research on Education Outcomes, or CREDO, found that students in more than 80 percent of those schools performed the same as—or worse than—students in regular public schools on mathematics tests.

In contrast, CREDO’s new study, released Jan. 5, found that:

• On a student level, the academic advantage for charter school students amounts to an average of 2 points in reading and 5 points in math on a scale in which students’ scores across the state range, at the 4th grade level, from 430 to 775 points.

Significantly Better

With the students they have enrolled, a study shows that New York City charter schools provide significantly better results for:

READING

All students
Students enrolled for 2 years
Students enrolled for 3 years
Blacks
Hispanics

MATH

All students
Students enrolled for 1 year
Students enrolled for 2 years
Students enrolled for 3 years
Blacks
Hispanics

Significantly Worse

At the same time, the analysis shows charters performed significantly worse with:

READING

Students enrolled for 1 year

MATH

Retained students

For the remaining groups in the analysis, no discernible differences appeared between charter and traditional public school performance.

SOURCE: Center for Research on Education Outcomes

• On a school-by-school basis, 51 percent of New York City charter schools are producing academic gains in math for students that are statistically larger than students would have achieved in regular public schools. In reading, however, 30 percent of charters perform better on average than their local public alternatives.

• Black and Hispanic students, as well as struggling learners, do better on average in charter schools than they would have in their regular public schools, but charter schools do not appear to boost learning significantly for English-language learners, special education students, or students who have been held back a grade.

“I don’t think the two studies are inconsistent,” said Margaret E. Raymond, CREDO’s director. “Remember that in looking at the distribution of quality [in the previous study], we found hundreds of charter schools doing really well. What New York City provides us with is an opportunity to step back and say, how is it possible that one market can have as robust a quality sector, where in other markets they’re not able to get that kind of performance?”

Unlikely Consensus

The earlier study did not include data from any schools in New York state. Ms. Raymond said the center decided to apply the same research methodology to New York City schools in response to a request from district officials, although the New York analysis was unfunded. The researchers said they hope to integrate the data from New York, as well as from other states, into the larger study later on.

The results are being closely watched, because charter schools—which are public schools allowed to operate largely independent of many traditional school district rules—are a major focus of the Obama administration’s education plans. Federal education officials, in fact, give some points to states with charter-friendly environments in the competition for economic-stimulus funds from the $4 billion Race to the Top program.

<center><bsp-image data-state="{&quot;image&quot;:{&quot;bex.rteImporter.imageIngestedUrl&quot;:&quot;https://www.edweek.org/media/2010/01/15/18charter_raymond.jpg&quot;,&quot;bex.rteImporter.imageIngestedDate&quot;:1606011341193,&quot;file&quot;:{&quot;storage&quot;:&quot;s3&quot;,&quot;path&quot;:&quot;b8/10/0ac5cb515e558c46af2b06a2232b/18charter-raymond.jpg&quot;,&quot;contentType&quot;:&quot;image/jpeg&quot;,&quot;metadata&quot;:{&quot;Huffman&quot;:{&quot;Number of Tables&quot;:&quot;4 Huffman tables&quot;},&quot;width&quot;:66,&quot;File Type&quot;:{&quot;Detected File Type Long Name&quot;:&quot;Joint Photographic Experts Group&quot;,&quot;Detected File Type Name&quot;:&quot;JPEG&quot;,&quot;Detected MIME Type&quot;:&quot;image/jpeg&quot;,&quot;Expected File Name Extension&quot;:&quot;jpg&quot;},&quot;XMP&quot;:{&quot;XMP Value Count&quot;:&quot;149&quot;},&quot;JPEG&quot;:{&quot;Component 3&quot;:&quot;Cr component: Quantization table 1, Sampling factors 1 horiz/1 vert&quot;,&quot;Compression Type&quot;:&quot;Baseline&quot;,&quot;Data Precision&quot;:&quot;8 bits&quot;,&quot;Number of Components&quot;:&quot;3&quot;,&quot;Component 2&quot;:&quot;Cb component: Quantization table 1, Sampling factors 1 horiz/1 vert&quot;,&quot;Component 1&quot;:&quot;Y component: Quantization table 0, Sampling factors 2 horiz/2 vert&quot;,&quot;Image Height&quot;:&quot;92 pixels&quot;,&quot;Image Width&quot;:&quot;66 pixels&quot;},&quot;JFIF&quot;:{&quot;Resolution Units&quot;:&quot;none&quot;,&quot;Version&quot;:&quot;1.1&quot;,&quot;Thumbnail Height Pixels&quot;:&quot;0&quot;,&quot;Thumbnail Width Pixels&quot;:&quot;0&quot;,&quot;X Resolution&quot;:&quot;1 dot&quot;,&quot;Y Resolution&quot;:&quot;1 dot&quot;},&quot;height&quot;:92,&quot;http.headers&quot;:{&quot;Content-Length&quot;:[&quot;10659&quot;],&quot;Content-Type&quot;:[&quot;image/jpeg&quot;],&quot;Cache-Control&quot;:[&quot;public, max-age=31536000&quot;]}}},&quot;_id&quot;:&quot;00000175-edbc-de5b-a77d-ffbe49890000&quot;,&quot;_type&quot;:&quot;ce92fd90-6aed-3dc0-880e-f485361c67c1&quot;},&quot;_id&quot;:&quot;00000175-edbc-de5b-a77d-ffbe49890001&quot;,&quot;_type&quot;:&quot;23ac712d-8839-31ed-81b0-4bf6cfff37a2&quot;}">Image</bsp-image></center>

The new findings out of New York City echo those from a study released in September by Caroline M. Hoxby, another Stanford University researcher. Using a different research strategy, Ms. Hoxby found that charter school students on average outperformed students who applied to the same schools but failed to win seats in them. She also concluded that the gains helped narrow achievement gaps between the inner-city students and their better-off counterparts in suburban Scarsdale, N.Y.

At the same time that Ms. Hoxby issued those findings, she also challenged the earlier CREDO study, saying that it suffered from a “serious mathematical mistake” that skewed the findings—a charge that the CREDO researchers later rebutted.

“Now you have two different studies using two different methods and finding consistent results,” said Robin Lake, the associate director of the Center on Reinventing Public Education at the University of Washington. “That’s pretty strong evidence that something is going on in New York City.”

But Sean F. Reardon, an associate professor of education and sociology at Stanford, said both the CREDO and Hoxby studies may be statistically flawed in the same way, although Ms. Raymond disagrees.

“While I’m not convinced that either the CREDO or the Hoxby study is definitive regarding the magnitudes of the effect,” he added in an e-mail, “the direction is likely positive.”

What’s harder to tell, he wrote, is “if the larger effect of charter schooling in [New York City] is because N.Y.C. charter schools are better than charter schools elsewhere, or if it’s because N.Y.C.’s traditional public schools are worse than traditional public schools elsewhere.”

The city’s 4th graders scored at about the national average, for both states and for a smaller number of urban school districts, on the latest National Assessment of Educational Progress tests in math.

Reasons Why

For their latest study, the CREDO researchers drew on six years of citywide data, beginning with the 2003-04 school year and ending with 2008-09, for students in grades 3-8. The study included 20,640 charter school students from 49 of the 52 charter schools in the city serving that particular age group. For each charter student, researchers created a “virtual twin” matched by race and ethnicity, family income level, special education participation, English-language status, and starting test scores.

Ms. Raymond said the math gains for charter students show up the first year a student enrolls, but reading gains take longer to materialize. Compared with their regular school “virtual twins,” students tend to lose ground in reading when they move to a charter school, but make more progress in the second and third years.

If charter schools are doing a better job in New York than they are in other places, Ms. Raymond said, it may be because the schools are more mature in that city, get more political support, undergo a stronger authorizing process, and get more backing from charter-support organizations.

“That is not something you see nationwide,” she added.

Experts said the study, in fact, points up the need for research to probe more deeply the reasons why charter schools succeed or fail.

“For national policymakers, this combination of findings suggests that there should be less attention to the question of whether charters in general are superior to traditional public schools,” Jeffrey Henig, a professor of political science and education at Teachers College, Columbia University, wrote in an e-mail, “and much more recognition of the fact that charter schools may or may not succeed, depending on state and local policy designs; authorizer practices; localized foundation support; and other state and local contextual factors that we don’t yet fully understand.”

A version of this article appeared in the January 20, 2010 edition of Education Week as Debate Over Charters Continues as Research Finds Gains in N.Y.C.

Let us know what you think!

We’re looking for feedback on our new site to make sure we continue to provide you the best experience.

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Future of Work Webinar
Digital Literacy Strategies to Promote Equity
Our new world has only increased our students’ dependence on technology. This makes digital literacy no longer a “nice to have” but a “need to have.” How do we ensure that every student can navigate
Content provided by Learning.com
Mathematics Online Summit Teaching Math in a Pandemic
Attend this online summit to ask questions about how COVID-19 has affected achievement, instruction, assessment, and engagement in math.
School & District Management Webinar Examining the Evidence: Catching Kids Up at a Distance
As districts, schools, and families navigate a new normal following the abrupt end of in-person schooling this spring, students’ learning opportunities vary enormously across the nation. Access to devices and broadband internet and a secure

EdWeek Top School Jobs

Data Analyst
New York, NY, US
New Visions for Public Schools
Project Manager
United States
K12 Inc.
High School Permanent Substitute Teacher
Woolwich Township, NJ, US
Kingsway Regional School District
MS STEM Teacher
Woolwich Township, NJ, US
Kingsway Regional School District

Read Next

School & District Management Student Mental Health and Learning Loss Continue to Worry Principals
Months into the pandemic, elementary principals say they still want training in crucial areas to help students who are struggling.
3 min read
Student sitting alone with empty chairs around her.
Maria Casinos/iStock/Getty
School & District Management Opinion A Road Map for Education Research in a Crisis
Here are five basic principles for a responsible and timely research agenda during the COVID-19 pandemic.
Robin J. Lake
4 min read
Two opposing sides reaching out to work together
J.R. Bee for Education Week
School & District Management 1,000 Students, No Social Distancing, and a Fight to Keep the Virus Out
A principal describes the "nightmare" job of keeping more than 1,000 people safe in the fast-moving pandemic.
4 min read
Dixie Rae Garrison, principal of West Jordan Middle School, in West Jordan, Utah.
Dixie Rae Garrison, principal of West Jordan Middle School in West Jordan, Utah, would have preferred a hybrid schedule and other social distancing measures.
Courtesy of Dixie Rae Garrison
School & District Management A School Leader Who Calls Her Own Shots on Battling the Coronavirus
A charter school founder uses her autonomy to move swiftly on everything from classroom shutdowns to remote schooling.
3 min read
Nigena Livingston, founder and head of School at the URBAN ACT Academy in Indianapolis, Ind.
Nigena Livingston, founder and head of school at the URBAN ACT Academy in Indianapolis, makes swift decisions in responding to the threat of COVID-19 in her school community.
Courtesy of Nigena Livingston