Opinion
Teaching Profession Opinion

When Test Scores Become a Commodity

By Jonathan F. Keiler — December 05, 2011 4 min read
  • Save to favorites
  • Print

The recent spate of cheating scandals in cities like Atlanta, Chicago, Los Angeles, and Washington presents an interesting conundrum. Those opposed to education reform schemes tied to the evaluation of student test scores and teacher compensation, or “value added” evaluation, claim that the teachers and administrators who were caught cheating were the victims, compelled to cheat out of fear for their livelihoods. On the other hand, value-added advocates solemnly pronounce that there is no excuse for cheating and that, moreover, cheating teachers and administrators provide the very evidence that reform is necessary. Both positions are valid. Can we work our way out?

The best way to resolve a conundrum, short of dramatically cutting the knot, Alexander-style (which requires chutzpah and a certain genius), is to clarify what the knot is, how it is tied, and then figure out how to undo it. And the reason this particular problem is so knotty—to overuse the metaphor—is that value-added reform systems create one of the most unpredictable and complex artifacts of human societies: a market.

Value-added evaluations both directly and indirectly monetize student performance, and because money is a basic commodity, the process then turns student scores into a commodity. Of course, that performance is not monetized for the students; it is monetized for the teachers and administrators. By making student scores the basis for evaluation, the students and their scores create a market for the teachers and administrators whose livelihoods depend upon the results. And in systems, such as the District of Columbia’s, where scores are not only the basis for teacher retention but also for direct incentives tied to bonus schemes, the market can be even more difficult and complex.

Within a market economy, commodities can be unpredictable and volatile. Investing in commodities, for most people, is tantamount to just plain gambling. In fact, the average commodity investor would have a better chance at blackjack or craps than in the commodity market. Simply put, commodity markets encourage cheating. And when cheating occurs, it occurs because market players view the risk of getting caught worth the reward of greater wealth. And even if direct cheating doesn’t take place, these markets reward questionable practices that, while not technically cheating, are close to the edge.

Value-added evaluations both directly and indirectly monetize student performance, and because money is a basic commodity, the process then turns student scores into a commodity."

A good example of this would be the commodity markets that don’t actually reward excellence in production. In some cases, as farms overproduce and prices drop, the government must step in to stabilize the free-fall, often through schemes that pay farmers not to grow crops. By essentially monetizing student test scores, we do the same thing to education. We are rewarding teachers for turning out kids with good test scores, even if they are not necessarily well educated.

In the first cheating scandals, we already saw some of this dynamic occurring. The cheating was organized and carried out by numerous teachers and administrators working in concert, the same way less productive farmers might attempt to pressure more successful colleagues, through social and political pressure first, but then, in desperation, sometimes through active protest or sabotage. It’s not right, but it happens.

When student scores become like orange juice, pork bellies, or yen, the people with the greatest incentive to cheat are the weakest teachers and administrators. These people might be weak, but that doesn’t mean they are stupid. Weak but clever educators will inevitably find ways to game the system, sometimes by cheating, but more often by coming close, but not stepping over the line: Educators could turn their courses into nothing but test-prep machines; they could refuse to collaborate with colleagues; they could curry favor with students to encourage better results; or take other steps we can’t imagine. Many of these weaker teachers, even short of cheating, might well end up with excellent “value added” scores, while stronger teachers who are honest and don’t play the sharp game end up looking bad.

This is not just a possible bad outcome, it is inevitable. It is inevitable because markets generate such behavior and dislocations, and the more volatile the market, the greater the undesirable behavior and dislocations will be.

So when we speak about value-added evaluations, let’s be clear about what kind of knot we’ve tied. It is a system that turns student scores into a market and, as such, creates cheating, disreputable practices, and dislocations. On the flip side, let’s also talk straight about the cheaters. Like dishonest or corrupt traders, the educators are not the victims, but rather sophisticated, savvy players. Many will get away with it and be honored for their work, as some cheating administrators and teachers were before they were caught. And many teachers and administrators who don’t technically cheat, but find ways to game the market “legally” will also be duly honored. Where could this lead? Schools could become little more than test-preparation institutes, ignoring subjects and skills that are not assessed, with faculty members who resent and distrust one another. Meanwhile, many honest and dutiful teachers will go down in flames.

If this is the kind of public school system the American people want, then fine. Let’s just be honest about it.

Related Tags:

A version of this article appeared in the December 07, 2011 edition of Education Week as When Test Scores Become a Commodity

Events

Ed-Tech Policy Webinar Artificial Intelligence in Practice: Building a Roadmap for AI Use in Schools
AI in education: game-changer or classroom chaos? Join our webinar & learn how to navigate this evolving tech responsibly.
Education Webinar Developing and Executing Impactful Research Campaigns to Fuel Your Ed Marketing Strategy 
Develop impactful research campaigns to fuel your marketing. Join the EdWeek Research Center for a webinar with actionable take-aways for companies who sell to K-12 districts.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Privacy & Security Webinar
Navigating Cybersecurity: Securing District Documents and Data
Learn how K-12 districts are addressing the challenges of maintaining a secure tech environment, managing documents and data, automating critical processes, and doing it all with limited resources.
Content provided by Softdocs

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Teaching Profession Opinion What My Professors Never Told Me About Teaching
In graduate school, I learned how to set up a classroom—but not how to survive one.
4 min read
Illustration of a black female on the side of a steep terrain pushing an oversized apple uphill. The sky is stormy and there are papers flying through the air. The terrain shows an old school desk, a chalkboard with math equations and a clock, both stuck in the side of the steep hill.
Jess Suttner for Education Week
Teaching Profession 'Here’s a Room. Here’s a Book. Good Luck': Veteran Teachers Reflect on How Their Careers Began
A little bit of support in the first year of teaching can go a long way, and older teachers are willing to mentor their new colleagues.
5 min read
Two female teachers in a school hallway having a discussion.
E+
Teaching Profession The State of Teaching It's 'a Passion, It’s Not Just a Paycheck': Teachers' Advice on Joining the Profession
If you go into the job with open eyes, it's worth it, say five teachers featured in EdWeek's The State of Teaching project.
Fourth grade students have fun interacting in a math class taught by Helen Chan at South Loop Elementary School on Nov. 15, 2023, in Chicago, Ill.
Fourth grade students have fun interacting in a math class taught by Helen Chan at South Loop Elementary School on Nov. 15, 2023, in Chicago.
Jamie Kelter Davis for Education Week
Teaching Profession The Finalists for National Teacher of the Year Have Ideas for Boosting Teacher Morale
The four award-winning teachers also met with U.S. lawmakers to advocate for their education causes of choice.
5 min read
Illustration of hands holding speech bubbles.
iStock / Getty Images Plus