Education Opinion

Overconfidence in the Value of Measurement

By Walt Gardner — March 23, 2011 3 min read
  • Save to favorites
  • Print

If there’s one thing that defines today’s accountability movement in education, it’s the sanctity of measurement. Reformers relentlessly demand hard data that students are learning. Without objective evidence, they claim that schools will never improve.

They point to business as a model. But despite what is widely assumed, numbers are rarely the sole consideration in evaluating employees in the private sector. When they are, they result in collateral damage in the form of depersonalization throughout the ranks and a false sense of assurance in the executive suite.

The latest to address the issue was Samuel Culbert, professor of management at the UCLA Anderson School. His op-ed in The New York Times on Mar. 1 argued that performance reviews “corrupt the system by getting employees to focus on pleasing the boss, rather than on achieving desired results” (“Why Your Boss Is Wrong About You”). In short, “nothing could be less fair.”

For teachers facing increasing pressure to boost test scores or face possible dismissal, the implications are especially timely. New York State serves as a case study. On Mar. 1, Gov. Andrew Cuomo introduced a compromise plan that would allow merit to be considered instead of only seniority. His proposal was in response to criticism about using LIFO (last in, first out) as the basis for layoffs. (New York is one of 14 states that makes it illegal to consider anything except a teacher’s length of service in making layoff decisions.)

In the absence of length of service, which is totally objective, what would substitute in determining layoffs? If only measurable outcomes were considered, then teachers would overlook non-cognitive results, which are every bit as important in education, and would be given no credit for serendipity, which can yield valuable results.

The Washington Post published a story that illustrates these perils (“Evaluation of D.C. teachers is a delicate conversation,” Mar. 17). The District of Columbia uses a system of teacher evaluation known as IMPACT, which contains nine standards. The teacher in question was penalized for not strictly adhering to the objective for the day’s lesson. Apparently, IMPACT does not take into account a teacher’s sensitivity to cues that arise spontaneously.

Moreover, there is the issue of whether it’s better to motivate groups, rather than individuals, in order to get the best overall results. In a working paper issued by the National Bureau of Economic Research, researchers found that group incentive pay and hourly pay play a greater role in motivating workers in manufacturing settings than individual incentive pay (“Social Science Palooza II,” New York Times, Mar. 17).

This conclusion has particular relevance to today’s debate in education over identifying effective teachers. That’s because teaching by its very nature is a collaborative profession. Teachers openly share ideas in department meetings and in faculty lounges. They do so because they are all working toward a common goal. Those teachers who do not do their job well in one grade force other teachers to pick up their load.

In an essay published in Education Week, Andrea Gabor, chair of business journalism at Baruch College, CUNY, put the issue this way: “Individualized pay incentives also run counter to the logic of a systems approach to organizations” (“Why Pay Incentives Are Destined to Fail,” Sept. 22, 2010). Teachers are “interlinked actors” who learn from each other and from outside experts.

Numerical goals have their place in schools. But they don’t deserve to be elevated to the throne in making decisions. That’s the mistake reformers make time and again.

The opinions expressed in Walt Gardner’s Reality Check are strictly those of the author(s) and do not reflect the opinions or endorsement of Editorial Projects in Education, or any of its publications.

Commenting has been disabled on edweek.org effective Sept. 8. Please visit our FAQ section for more details. To get in touch with us visit our contact page, follow us on social media, or submit a Letter to the Editor.


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Teaching Webinar
6 Key Trends in Teaching and Learning
As we enter the third school year affected by the pandemic—and a return to the classroom for many—we come better prepared, but questions remain. How will the last year impact teaching and learning this school
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Equity & Diversity Webinar
Evaluating Equity to Drive District-Wide Action this School Year
Educational leaders are charged with ensuring all students receive equitable access to a high-quality education. Yet equity is more than an action. It is a lens through which we continuously review instructional practices and student
Content provided by BetterLesson
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Student Well-Being Webinar
Attendance Awareness Month: The Research Behind Effective Interventions
More than a year has passed since American schools were abruptly closed to halt the spread of COVID-19. Many children have been out of regular school for most, or even all, of that time. Some
Content provided by AllHere

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education Schools Get the Brunt of Latest COVID Wave in South Carolina
In the past few weeks, South Carolina has set records for COVID-19 hospitalizations and new cases have approached peak levels of last winter.
4 min read
Two Camden Elementary School students in masks listen as South Carolina Gov. Henry McMaster talks about steps the school is taking to fight COVID-19, Wednesday, Sept. 15, 2021, in Camden, S.C. McMaster has adamantly and repeatedly come out against requiring masks in schools even as the average number of daily COVID-19 cases in the state has risen since early June. (AP Photo/Jeffrey Collins)
Education More States Are Requiring Schools to Teach Native American History and Culture
Advocates say their efforts have gained some momentum with the nation’s reckoning over racial injustice since the killing of George Floyd.
3 min read
A dancer participates in an intertribal dance at Schemitzun on the Mashantucket Pequot Reservation in Mashantucket, Conn., Saturday, Aug. 28, 2021. Connecticut and a handful of other states have recently decided to mandate students be taught about Native American culture and history. (AP Photo/Jessica Hill)
Education Judge's Temporary Order Allows Iowa Schools to Mandate Masks
A federal judge ordered the state to immediately halt enforcement of a law that prevents school boards from ordering masks to be worn.
4 min read
Iowa Gov. Kim Reynolds speaks to reporters following a news conference, Thursday, Aug. 19, 2021, in West Des Moines, Iowa. Reynolds lashed out at President Joe Biden Thursday after he ordered his education secretary to explore possible legal action against states that have blocked school mask mandates and other public health measures meant to protect students against COVID-19. Reynolds, a Republican, has signed a bill into law that prohibits school officials from requiring masks, raising concerns as delta variant virus cases climb across the state and schools resume classes soon. (AP Photo/Charlie Neibergall)
Education Hurricane Ida Deals New Blow to Louisiana Schools Struggling to Reopen
The opening of the school year offered teachers a chance to fully assess the pandemic's effects, only to have students forced out again.
8 min read
Six-year-old Mary-Louise Lacobon sits on a fallen tree beside the remnants of her family's home destroyed by Hurricane Ida, in Dulac, La., on Sept. 4, 2021. Louisiana students, who were back in class after a year and a half of COVID-19 disruptions kept many of them at home, are now missing school again after Hurricane Ida. A quarter-million public school students statewide have no school to report to, though top educators are promising a return is, at most, weeks away, not months.
Six-year-old Mary-Louise Lacobon sits on a fallen tree beside the remnants of her family's home destroyed by Hurricane Ida, in Dulac, La., on Sept. 4, 2021.
John Locher/AP