The ‘Fundamental Flaw’ in Test-Scoring Systems

Article Tools
  • PrintPrinter-Friendly
  • EmailEmail Article
  • ReprintReprints
  • CommentsComments

To the Editor:

In response to Randi Weingarten’s Commentary "Accountability That Works," (May 14, 2008):

I was impressed with the general tone and content of Ms. Weingarten’s proposition for a four-pillared school evaluation system. Her thoughts are penetrating and appropriate, particularly with respect to administrative accountability.

I take issue, however, with a couple of her details. To begin with, she writes about “absolute” academic achievement. Perhaps she has forgotten: The bell curve extends to infinity. We have no way of knowing where the average score resides. When scoring based on the total number of correct responses, we compare the results for known “marker items.” This information tells us what is, not what could be. The numbers are based on the test items’ histories and are in no way absolute.

Second, Ms. Weingarten says that “much of the variation in test scores over a single year is random.” My organization’s research shows that this commonly held notion is false. Students give the best answers they can, based on what they know and how they think. This information comes from the answers they give or choose. It is lost when we score items “right” or “wrong.”

The “right” answers are subject to an additional problem, that they can be supplied from memorization in the absence of understanding, or from procedures less mature than those the markers had expected.

Finally, when we add up the number of correctly answered items, we no longer know which questions were missed. In short, almost all the helpful information for teaching is gone before we start interpreting test results.

Although Ms. Weingarten’s accountability model is excellent as a general approach, until the fundamental flaw in our test-scoring procedures has been corrected, her admirable efforts and those of hundreds of thousands of other dedicated educators will be to no avail.

Jay C. Powell
Better Schooling Systems
Pittsburgh, Pa.

Vol. 27, Issue 41, Page 26

Published in Print: June 11, 2008, as The ‘Fundamental Flaw’ In Test-Scoring Systems
Related Stories
Notice: We recently upgraded our comments. (Learn more here.) If you are logged in as a subscriber or registered user and already have a Display Name on edweek.org, you can post comments. If you do not already have a Display Name, please create one here.
Ground Rules for Posting
We encourage lively debate, but please be respectful of others. Profanity and personal attacks are prohibited. By commenting, you are agreeing to abide by our user agreement.
All comments are public.

Back to Top Back to Top

Most Popular Stories





Sponsor Insights

Free Ebook: How to Implement a Coding Program in Schools

Successful Intervention Builds Student Success

Effective Ways to Support Students with Dyslexia

Stop cobbling together your EdTech

Integrate Science and ELA with Informational Text

Can self-efficacy impact growth for ELLs?

Disruptive Tech Integration for Meaningful Learning

Building Community for Social Good

5 Resources on the Power of Interoperability from Unified Edtech

New campaign for UN World Teachers Day

5 Game-Changers in Today’s Digital Learning Platforms

Hiding in Plain Sight - 7 Common Signs of Dyslexia in the Classroom

The research: Reading Benchmark Assessments

Shifting Mindsets: A Guide for Training Paraeducators to Think Differently About Challenging Behavior

All Students Are Language Learners: The Imagine Learning Language Advantage™

Shifting Mindsets: A Guide for Training Paraeducators to Think Differently About Challenging Behavior

How to Support All Students with Equitable Pathways

2019 K-12 Digital Content Report

3-D Learning & Assessment for K–5 Science

Climate Change, LGBTQ Issues, Politics & Race: Instructional Materials for Teaching Complex Topics

Closing the Science Achievement Gap

Evidence-based Coaching: Key Driver(s) of Scalable Improvement District-Wide

Advancing Literacy with Large Print

Research Sheds New Light on the Reading Brain

Tips for Supporting English Learners Through Personalized Approaches

Response to Intervention Centered on Student Learning

The Nonnegotiable Attributes of Effective Feedback

SEE MORE Insights >