Opinion
Education Letter to the Editor

No ‘Quality’ Method for Rating States’ Performance

February 03, 2009 2 min read
  • Save to favorites
  • Print

To the Editor:

We applaud Education Week for collecting education statistics about all 50 states. The latest of your annual Quality Counts reports (Jan. 8, 2009) is indeed an invaluable starting point. It goes a step too far, however, when it pools together disparate measures to arrive at each state’s overall score. This may not be problematic for education scholars, but policymakers might (and do) inaccurately treat a state’s overall rating as meaningful.

In fact, Quality Counts averages so much incommensurable data that we are reminded of the old joke of a beggar sitting on the streets of New York, with a sign reading, “Wars, 2; Legs Lost, 1; Wives Who Left Me, 2; Children, 3; Lost Jobs, 2. TOTAL: 10.”

First, the “school finance” measure rewards states for spending more money, whether or not that leads to actual results. The problem is most obvious when the “spending” measure is averaged with the measure for “K-12 achievement.” In theory, a high-spending state with low achievement—perhaps combining extravagance and incompetence—could get an overall score equal to that of a state with low spending and high achievement. But, all else being equal, the latter state obviously has a more efficient education system.

Second, the Chance-for-Success Index gives states higher grades for having fewer disadvantaged students. Unsurprisingly, Massachusetts does quite well on this measure, while Mississippi is near the bottom. This is certainly useful information, but it makes no sense that a state’s score here is averaged together with “K-12 achievement” to produce an overall score. (We were so baffled that we took the trouble of checking the scores of several states, just to be sure that this was what had been done.)

Thus, Quality Counts downgrades a state that produces A-level achievement for impoverished students, while upgrading another state simply for being blessed with privileged students. Imagine two states, equal on all measures but three. The first produces high achievement for poor kids using little money, while the second produces low achievement for rich kids using lots of the public’s resources. It is clear which system is doing better. Unfortunately, Quality Counts misses the point.

Stuart Buck

Research Associate

Gary Ritter

Endowed Chair in Education Policy

Department of Education Reform

University of Arkansas

Fayetteville, Ark.

To the Editor:

Although I am a proud Marylander, I was amazed that such a credible publication as Education Week could rank my home state No. 1 in its Quality Counts 2009 report even though our students score 20th on national tests and SAT scores are declining—this despite that fact that we are the wealthiest state in the country and have nearly doubled education spending over the past five years. Clearly, there is a problem with Quality Counts’ methodology.

Achievement is only a minor part of the formula, and a state that spends a lot and with fewer economically disadvantaged students is ranked higher than a poorer state that attains the same results with less. Increased spending is not considered at all, even though expectations should be higher.

While no scoring system is perfect, Education Week needs to rethink a methodology that defies common sense and rewards inefficiency.

Matthew Joseph

Executive Director

Advocates for Children and Youth

Baltimore, Md.

A version of this article appeared in the February 04, 2009 edition of Education Week as No ‘Quality’ Method for Rating States’ Performance

Events

English-Language Learners Webinar Helping English-Learners Through Improved Parent Outreach: Strategies That Work
Communicating with families is key to helping students thrive – and that’s become even more apparent during a pandemic that’s upended student well-being and forced constant logistical changes in schools. Educators should pay particular attention
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Mathematics Webinar
Addressing Unfinished Learning in Math: Providing Tutoring at Scale
Most states as well as the federal government have landed on tutoring as a key strategy to address unfinished learning from the pandemic. Take math, for example. Studies have found that students lost more ground
Content provided by Yup Math Tutoring
Classroom Technology Webinar Building Better Blended Learning in K-12 Schools
The pandemic and the increasing use of technology in K-12 education it prompted has added renewed energy to the blended learning movement as most students are now learning in school buildings (and will likely continue

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education Nearly a Million Kids Vaccinated in Week 1, White House Says
Experts say there are signs that it will be difficult to sustain the initial momentum.
4 min read
Leo Hahn, 11, gets the first shot of the Pfizer COVID-19 vaccine, Tuesday, Nov. 9, 2021, at the University of Washington Medical Center in Seattle. Last week, U.S. health officials gave the final signoff to Pfizer's kid-size COVID-19 shot, a milestone that opened a major expansion of the nation's vaccination campaign to children as young as 5. (AP Photo/Ted S. Warren)
Education How Schools Are Getting Kids the COVID Shot, and Why Some Aren’t
Some district leaders say offering vaccine clinics, with the involvement of trusted school staff, is key to helping overcome hesitancy.
5 min read
A girl walks outside of a mobile vaccine unit after getting the first dose of her COVID-19 vaccine, outside P.S. 277, Friday, Nov. 5, 2021, in the Bronx borough of New York. (AP Photo/Eduardo Munoz Alvarez)
Education Biden Administration Urges Schools to Provide COVID-19 Shots, Information for Kids
The Biden administration is encouraging local school districts to host vaccine clinics for kids and information on benefits of the shots.
2 min read
President Joe Biden, and first lady Jill Biden walk to board Marine One on the South Lawn of the White House in Washington, Saturday, Nov. 6, 2021. Biden is spending the weekend at his home in Rehoboth Beach, Del. (AP Photo/Alex Brandon)
Education Civil Rights Groups Sue Tennessee Over Law Against Transgender Student Athletes
The state law bars transgender athletes from playing public high school or middle school sports aligned with their gender identity.
3 min read
Amy Allen, the mother of an 8th grade transgender son, speaks after a Human Rights Campaign round table discussion on anti-transgender laws in Nashville, Tenn. on May 21, 2021.
Amy Allen, the mother of an 8th grade transgender son, speaks after a Human Rights Campaign round table discussion on anti-transgender laws in Nashville, Tenn. on May 21, 2021.
Mark Humphrey/AP