Opinion
Education Letter to the Editor

The ‘Fundamental Flaw’ in Test-Scoring Systems

June 09, 2008 1 min read
  • Save to favorites
  • Print

To the Editor:

In response to Randi Weingarten’s Commentary “Accountability That Works,” (May 14, 2008):

I was impressed with the general tone and content of Ms. Weingarten’s proposition for a four-pillared school evaluation system. Her thoughts are penetrating and appropriate, particularly with respect to administrative accountability.

I take issue, however, with a couple of her details. To begin with, she writes about “absolute” academic achievement. Perhaps she has forgotten: The bell curve extends to infinity. We have no way of knowing where the average score resides. When scoring based on the total number of correct responses, we compare the results for known “marker items.” This information tells us what is, not what could be. The numbers are based on the test items’ histories and are in no way absolute.

Second, Ms. Weingarten says that “much of the variation in test scores over a single year is random.” My organization’s research shows that this commonly held notion is false. Students give the best answers they can, based on what they know and how they think. This information comes from the answers they give or choose. It is lost when we score items “right” or “wrong.”

The “right” answers are subject to an additional problem, that they can be supplied from memorization in the absence of understanding, or from procedures less mature than those the markers had expected.

Finally, when we add up the number of correctly answered items, we no longer know which questions were missed. In short, almost all the helpful information for teaching is gone before we start interpreting test results.

Although Ms. Weingarten’s accountability model is excellent as a general approach, until the fundamental flaw in our test-scoring procedures has been corrected, her admirable efforts and those of hundreds of thousands of other dedicated educators will be to no avail.

Jay C. Powell

Director

Better Schooling Systems

Pittsburgh, Pa.

A version of this article appeared in the June 11, 2008 edition of Education Week as The ‘Fundamental Flaw’ In Test-Scoring Systems

Events

Ed-Tech Policy Webinar Artificial Intelligence in Practice: Building a Roadmap for AI Use in Schools
AI in education: game-changer or classroom chaos? Join our webinar & learn how to navigate this evolving tech responsibly.
Education Webinar Developing and Executing Impactful Research Campaigns to Fuel Your Ed Marketing Strategy 
Develop impactful research campaigns to fuel your marketing. Join the EdWeek Research Center for a webinar with actionable take-aways for companies who sell to K-12 districts.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Privacy & Security Webinar
Navigating Cybersecurity: Securing District Documents and Data
Learn how K-12 districts are addressing the challenges of maintaining a secure tech environment, managing documents and data, automating critical processes, and doing it all with limited resources.
Content provided by Softdocs

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education Briefly Stated: January 17, 2024
Here's a look at some recent Education Week articles you may have missed.
9 min read
Education In Their Own Words The Stories That Stuck With Us, 2023 Edition
Our newsroom selected five stories as among the highlights of our work. Here's why.
4 min read
102523 IMSE Reading BS
Adria Malcolm for Education Week
Education Opinion The 10 Most-Read Opinions of 2023
Here are Education Week’s most-read Opinion blog posts and essays of 2023.
2 min read
Collage of lead images for various opinion stories.
F. Sheehan for Education Week / Getty
Education Letter to the Editor EdWeek's Most-Read Letters of 2023
Read the most-read Letters to the Editor of the past year.
1 min read
Illustration of a line of diverse hands holding up speech bubbles in front of a subtle textured newspaper background
iStock/Getty