Opinion
Teaching Profession Opinion

When Test Scores Become a Commodity

By Jonathan F. Keiler — December 05, 2011 4 min read
  • Save to favorites
  • Print

The recent spate of cheating scandals in cities like Atlanta, Chicago, Los Angeles, and Washington presents an interesting conundrum. Those opposed to education reform schemes tied to the evaluation of student test scores and teacher compensation, or “value added” evaluation, claim that the teachers and administrators who were caught cheating were the victims, compelled to cheat out of fear for their livelihoods. On the other hand, value-added advocates solemnly pronounce that there is no excuse for cheating and that, moreover, cheating teachers and administrators provide the very evidence that reform is necessary. Both positions are valid. Can we work our way out?

The best way to resolve a conundrum, short of dramatically cutting the knot, Alexander-style (which requires chutzpah and a certain genius), is to clarify what the knot is, how it is tied, and then figure out how to undo it. And the reason this particular problem is so knotty—to overuse the metaphor—is that value-added reform systems create one of the most unpredictable and complex artifacts of human societies: a market.

Value-added evaluations both directly and indirectly monetize student performance, and because money is a basic commodity, the process then turns student scores into a commodity. Of course, that performance is not monetized for the students; it is monetized for the teachers and administrators. By making student scores the basis for evaluation, the students and their scores create a market for the teachers and administrators whose livelihoods depend upon the results. And in systems, such as the District of Columbia’s, where scores are not only the basis for teacher retention but also for direct incentives tied to bonus schemes, the market can be even more difficult and complex.

Within a market economy, commodities can be unpredictable and volatile. Investing in commodities, for most people, is tantamount to just plain gambling. In fact, the average commodity investor would have a better chance at blackjack or craps than in the commodity market. Simply put, commodity markets encourage cheating. And when cheating occurs, it occurs because market players view the risk of getting caught worth the reward of greater wealth. And even if direct cheating doesn’t take place, these markets reward questionable practices that, while not technically cheating, are close to the edge.

Value-added evaluations both directly and indirectly monetize student performance, and because money is a basic commodity, the process then turns student scores into a commodity."

A good example of this would be the commodity markets that don’t actually reward excellence in production. In some cases, as farms overproduce and prices drop, the government must step in to stabilize the free-fall, often through schemes that pay farmers not to grow crops. By essentially monetizing student test scores, we do the same thing to education. We are rewarding teachers for turning out kids with good test scores, even if they are not necessarily well educated.

In the first cheating scandals, we already saw some of this dynamic occurring. The cheating was organized and carried out by numerous teachers and administrators working in concert, the same way less productive farmers might attempt to pressure more successful colleagues, through social and political pressure first, but then, in desperation, sometimes through active protest or sabotage. It’s not right, but it happens.

When student scores become like orange juice, pork bellies, or yen, the people with the greatest incentive to cheat are the weakest teachers and administrators. These people might be weak, but that doesn’t mean they are stupid. Weak but clever educators will inevitably find ways to game the system, sometimes by cheating, but more often by coming close, but not stepping over the line: Educators could turn their courses into nothing but test-prep machines; they could refuse to collaborate with colleagues; they could curry favor with students to encourage better results; or take other steps we can’t imagine. Many of these weaker teachers, even short of cheating, might well end up with excellent “value added” scores, while stronger teachers who are honest and don’t play the sharp game end up looking bad.

This is not just a possible bad outcome, it is inevitable. It is inevitable because markets generate such behavior and dislocations, and the more volatile the market, the greater the undesirable behavior and dislocations will be.

So when we speak about value-added evaluations, let’s be clear about what kind of knot we’ve tied. It is a system that turns student scores into a market and, as such, creates cheating, disreputable practices, and dislocations. On the flip side, let’s also talk straight about the cheaters. Like dishonest or corrupt traders, the educators are not the victims, but rather sophisticated, savvy players. Many will get away with it and be honored for their work, as some cheating administrators and teachers were before they were caught. And many teachers and administrators who don’t technically cheat, but find ways to game the market “legally” will also be duly honored. Where could this lead? Schools could become little more than test-preparation institutes, ignoring subjects and skills that are not assessed, with faculty members who resent and distrust one another. Meanwhile, many honest and dutiful teachers will go down in flames.

If this is the kind of public school system the American people want, then fine. Let’s just be honest about it.

Related Tags:

A version of this article appeared in the December 07, 2011 edition of Education Week as When Test Scores Become a Commodity

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Reading & Literacy Webinar
(Re)Focus on Dyslexia: Moving Beyond Diagnosis & Toward Transformation
Move beyond dyslexia diagnoses & focus on effective literacy instruction for ALL students. Join us to learn research-based strategies that benefit learners in PreK-8.
Content provided by EPS Learning
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
Cohesive Instruction, Connected Schools: Scale Excellence District-Wide with the Right Technology
Ensure all students receive high-quality instruction with a cohesive educational framework. Learn how to empower teachers and leverage technology.
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School Climate & Safety Webinar
How to Use Data to Combat Bullying and Enhance School Safety
Join our webinar to learn how data can help identify bullying, implement effective interventions, & foster student well-being.
Content provided by Panorama Education

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Teaching Profession How Teachers Plan to Beat the 'October Blues' This Year
In education, October can be a slog. Here's how these teachers are getting through it.
2 min read
Illustration of an educator with long white hair, wearing a dark blue dress and walking off to the right of the frame with a low battery hovering above her head showing one red bar.
iStock/Getty
Teaching Profession Video What a 63-Year Teaching Veteran Thinks of AI
Martha Strever has built her life around Linden Avenue Middle School.
1 min read
Teaching Profession Opinion 3 Ways Educators Can Make Hard Conversations Easier
Conversations around hot-button topics can catch teachers and school leaders off guard. Avoidance isn't the answer.
6 min read
shutterstock 1094129717
Shutterstock
Teaching Profession This Teacher Is in Her 64th Year in the Classroom. She Has No Plans to Quit
Martha Strever has, in some cases, taught three generations of students from the same family.
8 min read
Martha Strever, a math teacher at Linden Avenue Middle School in Red Hook, N.Y., addresses her class on Sept. 6, 2024.
Martha Strever, a math teacher at Linden Avenue Middle School in Red Hook, N.Y., addresses her class on Sept. 6, 2024.
Flynn Larsen for Education Week