Education Opinion

Trouble in Gotham

By Eduwonkette — July 20, 2008 3 min read
  • Save to favorites
  • Print

Over the past six years, we’ve done everything possible to narrow the achievement gap – and we have. In some cases, we’ve reduced it by half." -Mayor Michael Bloomberg, testifying before the House Committee on Education and Labor, July 17, 2008 "Our African-American and Latino students have gained on their white and Asian peers....What does this show? Achievement for high-needs students is not a dream. It’s happening." -NYC Chancellor Joel Klein, testifying in the same House Committee hearing

New York City Mayor Michael Bloomberg and Chancellor Joel Klein seem intent on taking the “New York City miracle” national. However, a close review of racial and ethnic achievement gaps in New York City over their tenure suggests that Bloomberg and Klein would do well to get their own house in order first.

Analyzing data from the NAEP Trial Urban District Assessment from 2003-2007, I will show over the course of this week that in every grade and subject, achievement gaps separating New York City’s white and Asian students and their African-American and Hispanic counterparts are unchanged. What’s more, there’s some suggestive evidence that Asian-black and Asian-Hispanic gaps are actually growing.

You ask, “But Bloomberg and Klein say the achievement gap is closing. Are they lying?” It’s not lying as much as it’s finessing with the intention of providing a rosier picture of progress than is warranted. But the hard facts - for example, that in 2007, the average black 8th grader in New York City performed at the 20th percentile of the white distribution in reading and in math, and there has been no statistically significant change in the size of that gap since 2003 - makes Bloomberg’s victory march, as he likes to say, unconscionable.

Why? First, any respectable psychometrician would advise against measuring achievement gaps by using proficiency rates. I have explained why comparing group differences in proficiency rates provides a misleading measure of between-group inequality here: When Measuring Achievement Gaps, Beware the Proficiency Gap and Scale Score Magic! Why We Shouldn’t Rely on Proficiency Rates to Measure Academic Achievement. The central problem is that the black-white achievement gap can be increasing even as the difference between the proficiency of black and white students is closing. (If you are asking yourself, “What the heck are scale scores?”, see skoolboy’s excellent testing primer.)

Second, the Department of Education has refused to release average scale scores for racial and ethnic groups on the New York state tests. As a result, it’s tough to tell what’s really going on on the state test. It is possible that gaps in average scale scores are unchanged on the NAEP, but closing on the state test. If this is the case, one possible explanation is that students from historically disadvantaged groups are increasingly drilled in skills that pump up their scores on the state test, but do not generalize to other measures of achievement. (See Why We Should Care About Test Score Inflation.)

Everyone’s favorite “but they’re different tests” argument has some validity when we are looking at overall levels of achievement. We should not expect state and NAEP tests to track each other perfectly. But that argument is highly suspect in explaining why the size of gaps varies significantly between tests. It’s also possible that gaps as measured by the group differences in average scale scores on the state test are unchanged, but small gains by black and Hispanic “bubble” students across the proficiency cut score have led to large increases in proficiency.

To adjudicate between those two explanations, I requested scale score data from Truth Squad captain David Cantor almost a week ago, and was told I would receive these data by last Thursday. I guess the data got lost in the Internets. Unfortunately, denying data access appears to be a growing Department of Education strategy - in this case, the DOE failed to release data, and in other cases, they have released data only in PDF formats that no one can analyze. There is something deeply troubling about an administration that bows down at the altar of “data-driven decision making” but refuses the public access to data that rightfully should be available in a spreadsheet on their website.

Luckily for us, data from the NAEP Trial Urban District Assessment are publicly available, so the Department of Education doesn’t get the last word on the size of achievement gaps in New York City. Nor do you have to take my word for it. The National Center for Educational Statistics analyzed the NAEP TUDA scale scores, and found that in every subject and grade level, racial and ethnic achievement gaps have not closed in NYC between 2003-2007. You can find all of these data, as well as NCES’s own conclusions about changes in NYC achievement gaps, here. (Click on Advanced --> select a grade level and subject --> under “Jurisdiction,” select “Urban District” and “New York City” --> under “Variables,” select “Gaps and Changes in Gaps” for “all assessments.”)

I hope you will join me this week in trying to make sense of the persistence of achievement gaps in New York City schools and the Department of Education’s unflinching willingness to cast facts aside and tell the public otherwise.

The opinions expressed in eduwonkette are strictly those of the author(s) and do not reflect the opinions or endorsement of Editorial Projects in Education, or any of its publications.


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Teaching Webinar
6 Key Trends in Teaching and Learning
As we enter the third school year affected by the pandemic—and a return to the classroom for many—we come better prepared, but questions remain. How will the last year impact teaching and learning this school
Content provided by Instructure
Teaching Profession Live Online Discussion What Have We Learned From Teachers During the Pandemic?
University of California, Santa Cruz, researcher Lora Bartlett and her colleagues spent months studying how the pandemic affected classroom teachers. We will discuss the takeaways from her research not only for teachers, but also for
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Student Well-Being Webinar
Trauma-Informed Practices & the Construction of the Deep Reading Brain
Join Ryan Lee-James, Ph.D. CCC-SLP, director of the Rollins Center for Language and Literacy, with Renée Boynton-Jarrett, MD, ScD., Vital Village Community Engagement Network; Neena McConnico, Ph.D, LMHC, Child Witness to Violence Project; and Sondra
Content provided by Rollins Center

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education Hundreds of Conn. Bus Drivers Threaten to Walk Off the Job Over Vaccine Mandate
More than 200 school bus drivers could walk off the job in response to a vaccination mandate that goes into effect Monday.
1 min read
Rows of school buses are parked at their terminal, in Zelienople, Pa. Reopening schools during the coronavirus pandemic means putting children on school buses, and districts are working on plans to limit the risk.
Rows of school buses are parked at their terminal, in Zelienople, Pa. Reopening schools during the coronavirus pandemic means putting children on school buses, and districts are working on plans to limit the risk. <br/>
Keith Srakocic/AP Photo
Education Briefly Stated: September 22, 2021
Here's a look at some recent Education Week articles you may have missed.
9 min read
Education Schools Get the Brunt of Latest COVID Wave in South Carolina
In the past few weeks, South Carolina has set records for COVID-19 hospitalizations and new cases have approached peak levels of last winter.
4 min read
Two Camden Elementary School students in masks listen as South Carolina Gov. Henry McMaster talks about steps the school is taking to fight COVID-19, Wednesday, Sept. 15, 2021, in Camden, S.C. McMaster has adamantly and repeatedly come out against requiring masks in schools even as the average number of daily COVID-19 cases in the state has risen since early June. (AP Photo/Jeffrey Collins)
Education More States Are Requiring Schools to Teach Native American History and Culture
Advocates say their efforts have gained some momentum with the nation’s reckoning over racial injustice since the killing of George Floyd.
3 min read
A dancer participates in an intertribal dance at Schemitzun on the Mashantucket Pequot Reservation in Mashantucket, Conn., Saturday, Aug. 28, 2021. Connecticut and a handful of other states have recently decided to mandate students be taught about Native American culture and history. (AP Photo/Jessica Hill)