School & District Management

Second Study Gives Thumbs Up to N.Y.C. Charters

By Debra Viadero — January 05, 2010 5 min read
  • Save to favorites
  • Print

Includes updates and/or revisions.

Students in New York City’s charter elementary and middle schools make bigger learning gains than their regular public school counterparts in math and reading, according to the second report in five months to find good results for the independently run public schools in the nation’s largest school system.

The findings are attracting a lot of attention because they come from a Stanford University research group that issued a critical national study of charter schools last June. In that study, which looked at 2,403 charter schools in 15 states and the District of Columbia, the Center for Research on Education Outcomes, or CREDO, found that students in more than 80 percent of those schools performed the same as—or worse than—students in regular public schools on mathematics tests.

In contrast, CREDO’s new study, released Jan. 5, found that:

• On a student level, the academic advantage for charter school students amounts to an average of 2 points in reading and 5 points in math on a scale in which students’ scores across the state range, at the 4th grade level, from 430 to 775 points.

Significantly Better

With the students they have enrolled, a study shows that New York City charter schools provide significantly better results for:

READING

All students
Students enrolled for 2 years
Students enrolled for 3 years
Blacks
Hispanics

MATH

All students
Students enrolled for 1 year
Students enrolled for 2 years
Students enrolled for 3 years
Blacks
Hispanics

Significantly Worse

At the same time, the analysis shows charters performed significantly worse with:

READING

Students enrolled for 1 year

MATH

Retained students

For the remaining groups in the analysis, no discernible differences appeared between charter and traditional public school performance.

SOURCE: Center for Research on Education Outcomes

• On a school-by-school basis, 51 percent of New York City charter schools are producing academic gains in math for students that are statistically larger than students would have achieved in regular public schools. In reading, however, 30 percent of charters perform better on average than their local public alternatives.

• Black and Hispanic students, as well as struggling learners, do better on average in charter schools than they would have in their regular public schools, but charter schools do not appear to boost learning significantly for English-language learners, special education students, or students who have been held back a grade.

“I don’t think the two studies are inconsistent,” said Margaret E. Raymond, CREDO’s director. “Remember that in looking at the distribution of quality [in the previous study], we found hundreds of charter schools doing really well. What New York City provides us with is an opportunity to step back and say, how is it possible that one market can have as robust a quality sector, where in other markets they’re not able to get that kind of performance?”

Unlikely Consensus

The earlier study did not include data from any schools in New York state. Ms. Raymond said the center decided to apply the same research methodology to New York City schools in response to a request from district officials, although the New York analysis was unfunded. The researchers said they hope to integrate the data from New York, as well as from other states, into the larger study later on.

The results are being closely watched, because charter schools—which are public schools allowed to operate largely independent of many traditional school district rules—are a major focus of the Obama administration’s education plans. Federal education officials, in fact, give some points to states with charter-friendly environments in the competition for economic-stimulus funds from the $4 billion Race to the Top program.

<center><bsp-image data-state="{&quot;image&quot;:{&quot;bex.rteImporter.imageIngestedUrl&quot;:&quot;https://www.edweek.org/media/2010/01/15/18charter_raymond.jpg&quot;,&quot;bex.rteImporter.imageIngestedDate&quot;:1606011341193,&quot;file&quot;:{&quot;storage&quot;:&quot;s3&quot;,&quot;path&quot;:&quot;b8/10/0ac5cb515e558c46af2b06a2232b/18charter-raymond.jpg&quot;,&quot;contentType&quot;:&quot;image/jpeg&quot;,&quot;metadata&quot;:{&quot;Huffman&quot;:{&quot;Number of Tables&quot;:&quot;4 Huffman tables&quot;},&quot;width&quot;:66,&quot;File Type&quot;:{&quot;Detected File Type Long Name&quot;:&quot;Joint Photographic Experts Group&quot;,&quot;Detected File Type Name&quot;:&quot;JPEG&quot;,&quot;Detected MIME Type&quot;:&quot;image/jpeg&quot;,&quot;Expected File Name Extension&quot;:&quot;jpg&quot;},&quot;XMP&quot;:{&quot;XMP Value Count&quot;:&quot;149&quot;},&quot;JPEG&quot;:{&quot;Component 3&quot;:&quot;Cr component: Quantization table 1, Sampling factors 1 horiz/1 vert&quot;,&quot;Compression Type&quot;:&quot;Baseline&quot;,&quot;Data Precision&quot;:&quot;8 bits&quot;,&quot;Number of Components&quot;:&quot;3&quot;,&quot;Component 2&quot;:&quot;Cb component: Quantization table 1, Sampling factors 1 horiz/1 vert&quot;,&quot;Component 1&quot;:&quot;Y component: Quantization table 0, Sampling factors 2 horiz/2 vert&quot;,&quot;Image Height&quot;:&quot;92 pixels&quot;,&quot;Image Width&quot;:&quot;66 pixels&quot;},&quot;JFIF&quot;:{&quot;Resolution Units&quot;:&quot;none&quot;,&quot;Version&quot;:&quot;1.1&quot;,&quot;Thumbnail Height Pixels&quot;:&quot;0&quot;,&quot;Thumbnail Width Pixels&quot;:&quot;0&quot;,&quot;X Resolution&quot;:&quot;1 dot&quot;,&quot;Y Resolution&quot;:&quot;1 dot&quot;},&quot;height&quot;:92,&quot;http.headers&quot;:{&quot;Content-Length&quot;:[&quot;10659&quot;],&quot;Content-Type&quot;:[&quot;image/jpeg&quot;],&quot;Cache-Control&quot;:[&quot;public, max-age=31536000&quot;]}}},&quot;_id&quot;:&quot;00000175-edbc-de5b-a77d-ffbe49890000&quot;,&quot;_type&quot;:&quot;ce92fd90-6aed-3dc0-880e-f485361c67c1&quot;},&quot;_id&quot;:&quot;00000175-edbc-de5b-a77d-ffbe49890001&quot;,&quot;_type&quot;:&quot;23ac712d-8839-31ed-81b0-4bf6cfff37a2&quot;}">Image</bsp-image></center>

The new findings out of New York City echo those from a study released in September by Caroline M. Hoxby, another Stanford University researcher. Using a different research strategy, Ms. Hoxby found that charter school students on average outperformed students who applied to the same schools but failed to win seats in them. She also concluded that the gains helped narrow achievement gaps between the inner-city students and their better-off counterparts in suburban Scarsdale, N.Y.

At the same time that Ms. Hoxby issued those findings, she also challenged the earlier CREDO study, saying that it suffered from a “serious mathematical mistake” that skewed the findings—a charge that the CREDO researchers later rebutted.

“Now you have two different studies using two different methods and finding consistent results,” said Robin Lake, the associate director of the Center on Reinventing Public Education at the University of Washington. “That’s pretty strong evidence that something is going on in New York City.”

But Sean F. Reardon, an associate professor of education and sociology at Stanford, said both the CREDO and Hoxby studies may be statistically flawed in the same way, although Ms. Raymond disagrees.

“While I’m not convinced that either the CREDO or the Hoxby study is definitive regarding the magnitudes of the effect,” he added in an e-mail, “the direction is likely positive.”

What’s harder to tell, he wrote, is “if the larger effect of charter schooling in [New York City] is because N.Y.C. charter schools are better than charter schools elsewhere, or if it’s because N.Y.C.’s traditional public schools are worse than traditional public schools elsewhere.”

The city’s 4th graders scored at about the national average, for both states and for a smaller number of urban school districts, on the latest National Assessment of Educational Progress tests in math.

Reasons Why

For their latest study, the CREDO researchers drew on six years of citywide data, beginning with the 2003-04 school year and ending with 2008-09, for students in grades 3-8. The study included 20,640 charter school students from 49 of the 52 charter schools in the city serving that particular age group. For each charter student, researchers created a “virtual twin” matched by race and ethnicity, family income level, special education participation, English-language status, and starting test scores.

Ms. Raymond said the math gains for charter students show up the first year a student enrolls, but reading gains take longer to materialize. Compared with their regular school “virtual twins,” students tend to lose ground in reading when they move to a charter school, but make more progress in the second and third years.

If charter schools are doing a better job in New York than they are in other places, Ms. Raymond said, it may be because the schools are more mature in that city, get more political support, undergo a stronger authorizing process, and get more backing from charter-support organizations.

“That is not something you see nationwide,” she added.

Experts said the study, in fact, points up the need for research to probe more deeply the reasons why charter schools succeed or fail.

“For national policymakers, this combination of findings suggests that there should be less attention to the question of whether charters in general are superior to traditional public schools,” Jeffrey Henig, a professor of political science and education at Teachers College, Columbia University, wrote in an e-mail, “and much more recognition of the fact that charter schools may or may not succeed, depending on state and local policy designs; authorizer practices; localized foundation support; and other state and local contextual factors that we don’t yet fully understand.”

A version of this article appeared in the January 20, 2010 edition of Education Week as Debate Over Charters Continues as Research Finds Gains in N.Y.C.

Events

Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
Ed-Tech Policy Webinar Artificial Intelligence in Practice: Building a Roadmap for AI Use in Schools
AI in education: game-changer or classroom chaos? Join our webinar & learn how to navigate this evolving tech responsibly.
Education Webinar Developing and Executing Impactful Research Campaigns to Fuel Your Ed Marketing Strategy 
Develop impactful research campaigns to fuel your marketing. Join the EdWeek Research Center for a webinar with actionable take-aways for companies who sell to K-12 districts.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management Fewer of Today's Superintendents Are at Retirement Age
A new survey of superintendents adds to what we know about the people who lead the nation's school districts.
4 min read
Conceptual illustration of money, salaries and data.
iStock/Getty
School & District Management 3 Tips to Help Districts Navigate Educator Layoffs
Keep cuts in line with the district's overarching goals, an expert advises.
3 min read
Illustration of scissors cutting row of paper dolls.
iStock / Getty Images Plus
School & District Management Teachers Hate All Those Meetings. Can Principals Find a Workaround?
Principals can't do away with every meeting, but they can reduce some and make others more effective.
4 min read
Image of a staff meeting.
E+/Getty
School & District Management Q&A When This Principal Talks About Mental Health, People Listen. Here's Why
The NASSP Advocacy Champion of the year said he used stories from his school and community to speak with his state’s legislators.
6 min read
Chris Young, a principal from Vermont, poses for a photo in front of a Senate office building in Washington, D.C.
Chris Young, a principal from Vermont, stands in front of a Senate office building in Washington on March 13, 2024. Young was among the secondary principals to meet with legislators urging them to keep federal funding for schools stable.
Olina Banerji/Education Week