Accountability Opinion

Accounting Is Not Accountability

By Norm Fruchter — December 18, 2007 4 min read
  • Save to favorites
  • Print

Accountability in public education requires a balance of audit and inspection. Audit assesses school performance, by comparing past results (usually student achievement-test scores) to current outcomes, or comparing schools to each other, or to a local or national standard. Inspection involves processes of observation and inquiry that analyze school performance and determine how it might be improved. Public education accountability in the United States has always emphasized audit. But the recent issuing of letter-grade report cards to every New York City public school is a triumph of audit that disserves all our public schools. (“N.Y.C. District Issues ‘Value Added’ Grades for Schools,” Nov. 14, 2006.)

At its most technical levels, the New York City accountability system is problematic. The city’s department of education has acknowledged substantial data error, inevitable when multiple large databases are aggregated to produce a single score for 1,200 individual schools. Inexplicably, the department used only two years of testing results for its comparisons, yet much research indicates that year-to-year school level fluctuation in test scores makes such comparisons meaningless. Sophisticated bloggers throughout the city have found multiple flaws in the department’s construction of similar school-comparison groups and its scoring intervals. The ability of prestigious city schools to get their grades changed suggests the political manipulability of the entire process.

But the city’s report card system is fundamentally flawed in conception as well as in execution. Audit—the measurement of schooling outcomes—cannot improve schools; it can only identify schools that are performing well or poorly. The theory behind audit systems is that when school performance is quantified, we can identify and reward the effective schools, punish the ineffective ones, and improvement in student achievement, presumably the goal of the audit effort, will result.

Audit—the measurement of schooling outcomes—cannot improve schools; it can only identify schools that are performing well or poorly.

But can school improvement result from audit efforts? If poorly performing schools knew how to improve their outcomes, surely they would do so rather than risk the public identification and shaming inherent in an audit. Suppose, instead, that limited capacity is the critical problem of poorly performing schools. Suppose they suffer from inexperienced leadership, high staff attrition that results in a large percentage of new teachers every year, a level of teaching skills too limited to effectively teach the curricula, or an inability to adapt instructional approaches to students’ learning needs. If these key capacity issues bedevil poorly performing schools, how will audit efforts that assign failing grades contribute to improving such schools?

Improving the outcomes of poorly performing schools requires building their capacity for more effective performance. Inspection processes help improve schools’ capacity because they analyze what schools are doing—or, more important, not doing—that produces poor student achievement. Once inspection identifies what poorly performing schools should do to improve, such schools can build their capacity for effective performance—if they are given the appropriate supports. Thus an inspection system, with sufficient support and assistance, can contribute to improving poorly performing schools. An audit system, like accounting, can only report good and bad news.

The ultimate irony is that New York City has developed an inspection system, the Quality Review process, that observes and analyzes the processes of teaching and learning in all district schools. But comparing the findings of these quality reviews with the schools’ report card grades yields conflicting outcomes. Many schools receiving positive quality reviews get D’s and F’s on their report cards, while many receiving A’s and B’s get quite critical quality reviews. The education department has not attempted to explain or adjust these disparate outcomes. Worse, the results of the inspection system are not factored into the report card grades.

Thus, the New York City Department of Education, at a cost of more than $80 million, has imposed what amounts to an elaborate accounting system on the city’s public schools. But accounting is not accountability; many schools will be irreparably harmed, with a few well served, by this formula-driven exercise. Furthermore, the department has, as usual, ignored history. The practice of letter-grade school report cards has been tried and discarded in many settings, Florida’s negative experience being only the most recent example.

Less than two years remain before the New York state legislature must reauthorize, revise, or terminate mayoral control of New York City’s public schools. One can hope that a citywide dialogue will begin, to debate the wisdom of unfettered control over public schooling that produces the kind of quantitative hubris that the report cards represent.

A version of this article appeared in the December 19, 2007 edition of Education Week as Accounting Is Not Accountability


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Data Webinar
Working Smarter, Not Harder with Data
There is a new paradigm shift in K-12 education. Technology and data have leapt forward, advancing in ways that allow educators to better support students while also maximizing their most precious resource – time. The
Content provided by PowerSchool
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
School & District Management Webinar
Deepen the Reach and Impact of Your Leadership
This webinar offers new and veteran leaders a unique opportunity to listen and interact with four of the most influential educational thinkers in North America. With their expert insights, you will learn the key elements
Content provided by Solution Tree
Science K-12 Essentials Forum Teaching Science Today: Challenges and Solutions
Join this event which will tackle handling controversy in the classroom, and making science education relevant for all students.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Accountability Opinion The Pandemic Disrupted Testing. States Should Seize Untapped Accountability Opportunities
Under the Every Student Succeeds Act, states have more freedom to revamp their testing and accountability systems than they did under NCLB.
4 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
Accountability States Make It Hard to Tell How Much Schools Are Spending, Report Says
The vast majority of states aren't publishing spending data in a visually appealing or comprehensive way, according to EdTrust.
3 min read
Group of people with large pens, coins, calculator, clip board, magnifying glass and studying numbers, charts and receipts.
iStock/Getty Images Plus
Accountability Did Washington D.C.'s Education Overhaul Help Black Children? This Study Says Yes
Researchers said the district's "market-based" reforms accelerated achievement versus other districts and states.
5 min read
Accountability Opinion What Next-Gen Accountability Can Learn From No Child Left Behind
As we ponder what's next for accountability and assessment, we’d benefit from checking the rearview mirror more attentively and more often.
4 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty