Opinion
Education Letter to the Editor

No ‘Quality’ Method for Rating States’ Performance

February 03, 2009 2 min read
  • Save to favorites
  • Print

To the Editor:

We applaud Education Week for collecting education statistics about all 50 states. The latest of your annual Quality Counts reports (Jan. 8, 2009) is indeed an invaluable starting point. It goes a step too far, however, when it pools together disparate measures to arrive at each state’s overall score. This may not be problematic for education scholars, but policymakers might (and do) inaccurately treat a state’s overall rating as meaningful.

In fact, Quality Counts averages so much incommensurable data that we are reminded of the old joke of a beggar sitting on the streets of New York, with a sign reading, “Wars, 2; Legs Lost, 1; Wives Who Left Me, 2; Children, 3; Lost Jobs, 2. TOTAL: 10.”

First, the “school finance” measure rewards states for spending more money, whether or not that leads to actual results. The problem is most obvious when the “spending” measure is averaged with the measure for “K-12 achievement.” In theory, a high-spending state with low achievement—perhaps combining extravagance and incompetence—could get an overall score equal to that of a state with low spending and high achievement. But, all else being equal, the latter state obviously has a more efficient education system.

Second, the Chance-for-Success Index gives states higher grades for having fewer disadvantaged students. Unsurprisingly, Massachusetts does quite well on this measure, while Mississippi is near the bottom. This is certainly useful information, but it makes no sense that a state’s score here is averaged together with “K-12 achievement” to produce an overall score. (We were so baffled that we took the trouble of checking the scores of several states, just to be sure that this was what had been done.)

Thus, Quality Counts downgrades a state that produces A-level achievement for impoverished students, while upgrading another state simply for being blessed with privileged students. Imagine two states, equal on all measures but three. The first produces high achievement for poor kids using little money, while the second produces low achievement for rich kids using lots of the public’s resources. It is clear which system is doing better. Unfortunately, Quality Counts misses the point.

Stuart Buck

Research Associate

Gary Ritter

Endowed Chair in Education Policy

Department of Education Reform

University of Arkansas

Fayetteville, Ark.

To the Editor:

Although I am a proud Marylander, I was amazed that such a credible publication as Education Week could rank my home state No. 1 in its Quality Counts 2009 report even though our students score 20th on national tests and SAT scores are declining—this despite that fact that we are the wealthiest state in the country and have nearly doubled education spending over the past five years. Clearly, there is a problem with Quality Counts’ methodology.

Achievement is only a minor part of the formula, and a state that spends a lot and with fewer economically disadvantaged students is ranked higher than a poorer state that attains the same results with less. Increased spending is not considered at all, even though expectations should be higher.

While no scoring system is perfect, Education Week needs to rethink a methodology that defies common sense and rewards inefficiency.

Matthew Joseph

Executive Director

Advocates for Children and Youth

Baltimore, Md.

A version of this article appeared in the February 04, 2009 edition of Education Week as No ‘Quality’ Method for Rating States’ Performance

Events

Classroom Technology K-12 Essentials Forum Making Technology Work Better in Schools
Join experts for a look at the steps schools are taking (or should take) to improve the use of technology in schools.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Budget & Finance Webinar
The ABCs of ESSER: How to Make the Most of Relief Funds Before They Expire
Join a diverse group of K-12 experts to learn how to leverage federal funds before they expire and improve student learning environments.
Content provided by Johnson Controls
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
Modernizing Principal Support: The Road to More Connected and Effective Leaders
When principals are better equipped to lead, support, and maintain high levels of teaching and learning, outcomes for students are improved.
Content provided by BetterLesson

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education Briefly Stated: April 27, 2022
Here's a look at some recent Education Week articles you may have missed.
9 min read
Education Briefly Stated: April 6, 2022
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education Briefly Stated: March 30, 2022
Here's a look at some recent Education Week articles you may have missed.
6 min read
Education Briefly Stated: March 16, 2022
Here's a look at some recent Education Week articles you may have missed.
7 min read