Education Letter to the Editor

No ‘Quality’ Method for Rating States’ Performance

February 03, 2009 2 min read
  • Save to favorites
  • Print

To the Editor:

We applaud Education Week for collecting education statistics about all 50 states. The latest of your annual Quality Counts reports (Jan. 8, 2009) is indeed an invaluable starting point. It goes a step too far, however, when it pools together disparate measures to arrive at each state’s overall score. This may not be problematic for education scholars, but policymakers might (and do) inaccurately treat a state’s overall rating as meaningful.

In fact, Quality Counts averages so much incommensurable data that we are reminded of the old joke of a beggar sitting on the streets of New York, with a sign reading, “Wars, 2; Legs Lost, 1; Wives Who Left Me, 2; Children, 3; Lost Jobs, 2. TOTAL: 10.”

First, the “school finance” measure rewards states for spending more money, whether or not that leads to actual results. The problem is most obvious when the “spending” measure is averaged with the measure for “K-12 achievement.” In theory, a high-spending state with low achievement—perhaps combining extravagance and incompetence—could get an overall score equal to that of a state with low spending and high achievement. But, all else being equal, the latter state obviously has a more efficient education system.

Second, the Chance-for-Success Index gives states higher grades for having fewer disadvantaged students. Unsurprisingly, Massachusetts does quite well on this measure, while Mississippi is near the bottom. This is certainly useful information, but it makes no sense that a state’s score here is averaged together with “K-12 achievement” to produce an overall score. (We were so baffled that we took the trouble of checking the scores of several states, just to be sure that this was what had been done.)

Thus, Quality Counts downgrades a state that produces A-level achievement for impoverished students, while upgrading another state simply for being blessed with privileged students. Imagine two states, equal on all measures but three. The first produces high achievement for poor kids using little money, while the second produces low achievement for rich kids using lots of the public’s resources. It is clear which system is doing better. Unfortunately, Quality Counts misses the point.

Stuart Buck

Research Associate

Gary Ritter

Endowed Chair in Education Policy

Department of Education Reform

University of Arkansas

Fayetteville, Ark.

To the Editor:

Although I am a proud Marylander, I was amazed that such a credible publication as Education Week could rank my home state No. 1 in its Quality Counts 2009 report even though our students score 20th on national tests and SAT scores are declining—this despite that fact that we are the wealthiest state in the country and have nearly doubled education spending over the past five years. Clearly, there is a problem with Quality Counts’ methodology.

Achievement is only a minor part of the formula, and a state that spends a lot and with fewer economically disadvantaged students is ranked higher than a poorer state that attains the same results with less. Increased spending is not considered at all, even though expectations should be higher.

While no scoring system is perfect, Education Week needs to rethink a methodology that defies common sense and rewards inefficiency.

Matthew Joseph

Executive Director

Advocates for Children and Youth

Baltimore, Md.

A version of this article appeared in the February 04, 2009 edition of Education Week as No ‘Quality’ Method for Rating States’ Performance


Classroom Technology Webinar Building Better Blended Learning in K-12 Schools
The pandemic and the increasing use of technology in K-12 education it prompted has added renewed energy to the blended learning movement as most students are now learning in school buildings (and will likely continue
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Student Well-Being Webinar
A Whole Child Approach to Supporting Positive Student Behavior 
To improve student behavior, it’s important to look at the root causes. Social-emotional learning may play a preventative role.

A whole child approach can proactively support positive student behaviors.

Join this webinar to learn how.
Content provided by Panorama
Student Achievement Webinar Examining the Evidence: What We’re Learning From the Field About Implementing High-Dosage Tutoring Programs
Tutoring programs have become a leading strategy to address COVID-19 learning loss. What evidence-based principles can district and school leaders draw on to design, implement, measure, and improve high-quality tutoring programs? And what are districts

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education Briefly Stated: November 17, 2021
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education Nearly a Million Kids Vaccinated in Week 1, White House Says
Experts say there are signs that it will be difficult to sustain the initial momentum.
4 min read
Leo Hahn, 11, gets the first shot of the Pfizer COVID-19 vaccine, Tuesday, Nov. 9, 2021, at the University of Washington Medical Center in Seattle. Last week, U.S. health officials gave the final signoff to Pfizer's kid-size COVID-19 shot, a milestone that opened a major expansion of the nation's vaccination campaign to children as young as 5. (AP Photo/Ted S. Warren)
Education How Schools Are Getting Kids the COVID Shot, and Why Some Aren’t
Some district leaders say offering vaccine clinics, with the involvement of trusted school staff, is key to helping overcome hesitancy.
5 min read
A girl walks outside of a mobile vaccine unit after getting the first dose of her COVID-19 vaccine, outside P.S. 277, Friday, Nov. 5, 2021, in the Bronx borough of New York. (AP Photo/Eduardo Munoz Alvarez)
Education Biden Administration Urges Schools to Provide COVID-19 Shots, Information for Kids
The Biden administration is encouraging local school districts to host vaccine clinics for kids and information on benefits of the shots.
2 min read
President Joe Biden, and first lady Jill Biden walk to board Marine One on the South Lawn of the White House in Washington, Saturday, Nov. 6, 2021. Biden is spending the weekend at his home in Rehoboth Beach, Del. (AP Photo/Alex Brandon)