N.Y.C. District Issues ‘Value Added’ Grades for Schools
In an unusual step for a school district, New York City has assigned letter grades to its public schools, prompting a debate in the nation’s largest school system about whether the ratings represent a reliable gauge of school quality.
Mayor Michael R. Bloomberg and Schools Chancellor Joel I. Klein released the grades this week in a high-profile announcement at a Manhattan elementary school. Of the 1,224 schools graded, 23 percent received A’s, 38 percent got B’s, and 25 percent got C’s. Eight percent received D’s, and 4 percent got F’s. More than 150 schools have not been graded yet because they haven’t been open long enough or their data were still under review. The city’s 60 charter schools did not administer the survey that forms part of the grade.
The grades are part of New York City’s effort to improve its schools by expanding the authority it gives school principals, and how it makes them answer for their students’ performance. The grades will be factored into such decisions as whether principals will keep their jobs, a signal Mayor Bloomberg said was a “wake-up call” for school staff members.
Schools that got A’s and performed well in “school quality reviews” conducted last year by outside teams can get extra money if they agree to serve as “demonstration sites” for other schools. Those that received D’s or F’s must detail in writing how they plan to improve. D and F schools that also fared poorly in the quality reviews could be closed or have their staffs changed. Students in F schools will be permitted to transfer, though city officials said they did not expect huge numbers to do so.
Some states, such as Florida, assign letter grades to schools as part of their accountability systems. But experts said they knew of no other large school districts that do so, and no others that have created their own accountability systems.
New York City takes a “value added” approach to its ratings, emphasizing student test-score progress over time much more than a single year’s test scores. Fifty-five percent of a school’s grade is based on how much each student improves his or her scores on state reading and mathematics tests.
Another 30 percent derives from students’ scores on the most recent tests. The remaining 15 percent relies on parent, teacher, and student surveys gauging school “environment” factors, including safety and academic expectations.
Highs and Lows
The release of school grades by the 1.1 million-student district sparked debate over their meaning. One of the most frequent criticisms was that some schools’ grades did not seem to jibe with their performance on state tests.
What does this grade mean? Schools are assigned letter grades based on their overall progress-report scores. Schools that get A’s and B’s are eligible for rewards. Schools that get D’s and F’s, or three C’s in a row, face consequences.
How did this school perform?
• This school’s overall score for 2006–07 is 35.1.
• This score places the school in the 8.3 percentile of all middle schools citywide (i.e., 8.3 percent of those schools scored lower than this school).
• This school’s target score for 2007–08 is 52.6.
How scores translate to grades:
• Schools receive letter grades based on their overall scores.
• Schools with overall scores between 30.9 and 38.8 receive a letter grade of D.
• 9.7% of schools earned a D in 2006–07.
This school’s 2006–07 quality-review score is P. To see a school’s quality-review report, locate the school at http://schools.nyc.gov/, click “statistics,” and scroll down to quality-review report.
2006-07 State Accountability Status
Based on its 2005-06 performance, this school is “in good standing.” This measure, determined by New York state as part of the federal No Child Left Behind Act, is not a factor in the progress-report grade.
“We’ve got high-performing schools that got low grades, low-performing schools that got high grades,” said Tim Johnson, the president of a local education council in Manhattan. “It has a bit of an Alice-in-Wonderland quality about it.”
His own daughter’s school, Intermediate School 289 in Manhattan, recently won a prestigious blue ribbon from the U.S. Department of Education. Eighty-three percent of its students showed proficiency on state reading tests, and 85 percent did so on state math tests. But it earned a D under the city’s rating system, largely because its students had not improved sufficiently over their previous year’s scores.
“Our principal should be teaching other principals, not being slapped for not making progress,” Mr. Johnson said.
Mayor Bloomberg saw the results as an opportunity for improvement and a truer judgment of school quality.
“Across the board, these progress reports have challenged our perception about individual schools. And that’s a very positive thing,” he said at the Nov. 5 press conference. “We should be asking ourselves why some of the schools we thought were doing well aren’t serving students as effectively as other, similar schools. And we should be asking ourselves how to motivate even very good schools to do better.”
Margaret Goertz, a co-director of the Consortium for Policy Research in Education, based at the University of Pennsylvania, in Philadelphia, commended the city for examining multiple measures of school performance. But she expressed worry about the potential confusion of two appraisal systems, citing the requirements of the federal No Child Left Behind Act.
“When you have different factors than under NCLB, it’s going to lead to different grades,” Ms. Goertz said. “If those things aren’t coordinated in some way, and you’re a building principal or a parent, trying to figure out if a school is good, you’re getting very mixed messages.”
Andrew Jacob, a spokesman for the city department of education, said the grading system complements the method used under the almost 6-year-old federal law because it puts more weight on how well a school helps its students improve.
“A lot of schools think they get recognition they didn’t get under NCLB,” he said.
The union representing the city’s principals is concerned about the accuracy of the data used in the school grades, and the groupings created to compare schools with similar schools. It asked its members to report problems, and has refrained from endorsing the grades until it can analyze the data and results.
“The ramifications are too great, especially for students in schools that may be mislabeled and the people whose jobs may be on the line,” Ernest A. Logan, the president of the Council of School Supervisors and Administrators, told members in an e-mail the day the grades were released.
The United Federation of Teachers, the city’s teachers’ union, called for schools to be judged less by standardized tests and more by additional factors such as class size and access to college-level coursework.
“There is something wrong with the design of an accountability system when schools that have an established track record of solid performance are stigmatized by subpar grades,” Randi Weingarten, the president of the American Federation of Teachers affiliate, said in a statement.
Vol. 27, Issue 12, Page 6Published in Print: November 14, 2007, as N.Y.C. District Issues ‘Value Added’ Grades for Schools