Opinion
IT Infrastructure Opinion

Turning Children Into Data

By Alfie Kohn — August 20, 2010 6 min read
  • Save to favorites
  • Print

Not everything that counts can be counted, and not everything that can be counted counts.
—Albert Einstein

Programs with generic-sounding names that offer techniques for measuring (and raising) student achievement have been sprouting like fungi in a rainforest: “Learning-Focused Schools,” “Curriculum-Based Measurements,” “Professional Learning Communities,” and many others whose names include “data,” “progress,” or “RTI.” Perhaps you’ve seen their ads in periodicals like this one. Perhaps you’ve pondered the fact that they can afford these ads, presumably because of how much money they’ve already collected from struggling school districts.

When I’m asked about one of these programs, I have to confess that I just can’t keep up with every new stall that opens in this bazaar—and the same is true of the neighboring marketplace that’s packed with discipline and classroom-management programs. (Hint: Here, extreme skepticism is warranted whenever the name includes the word “behavior.”) Still, it is possible to sketch some criteria for judging any given program—preferably before someone requests a purchase order.

BRIC ARCHIVE

So let’s imagine that your community is buzzing about something called ABA: “Achievement-Based Assessment”—or, perhaps, “Assessment-Based Achievement”—whose website boasts of “monitoring and improving each student’s learning with proven data-focused strategies.”

Worth a try? Well, we certainly can’t decide on the basis of how ABA markets itself. Just about any descriptor that might seem appealing, even progressive, has been co-opted by now: Every outfit claims to help teachers “collaborate” in order to focus on the “learning” (rather than just the teaching) as they look at “authentic” outcomes and “differentiate” the instruction with a “developmental” approach that emphasizes “critical (or higher-order) thinking” skills—in order to prepare your students for (drumroll) the “21st century.”

Obviously, we’re going to have to look a little deeper and ask a few pointed questions.

1. What is its basic conception of assessment? To get a sense of how well things are going and where help is needed, we ought to focus on the actual learning that students do over a period of time—ideally, deep learning that consists of more than practicing skills and memorizing facts. If you agree, then you’d be very skeptical about a program that relies on discrete, contrived, testlike assessments. You’d object to any procedure that seems mechanical, in which standardized protocols like rubrics supplant teachers’ professional judgments based on personal interaction with their students. And the only thing worse than “benchmark” tests (tests in between the tests) would be computerized monitoring tools, which the reading expert Richard Allington has succinctly characterized as “idiotic.”

2. What is its goal? Ask not only what the program does but why it exists. Lots of talk about “student achievement”—as opposed to, say, “students’ achievements”—suggests that the program’s raison d’être is not to help kids understand ideas and become thoughtful questioners, but merely to raise their scores on standardized tests. (Elsewhere, I’ve reviewed evidence showing not only that these tests are completely inadequate for assessing important intellectual proficiencies, but also that high scores are actually correlated with a superficial approach to learning.) Obviously, anyone who harbors doubts about the validity or value of standardized tests wouldn’t want to have anything to do with a program that’s designed mostly with them in mind.

3. Does it reduce everything to numbers? If all the earnest talk about “data” (in the context of educating children) doesn’t make you at least a little bit uneasy, it’s time to recharge your crap detector. Most assessment systems are based on an outdated behaviorist model that assumes nearly everything can—and should—be quantified. But the more educators allow themselves to be turned into accountants, the more trivial their teaching becomes and the more their assessments miss.

That’s why I was heartened recently to receive a note describing how some teachers on a Midwestern high school’s improvement team took a long, hard look at the Professional Learning Communities model and said no thanks. They were put off by its designers’ frank admiration of for-profit corporations as well as its “misguided premise that every subject area can be broken down into core concepts which then have to be quantified.” The teachers understood that learning doesn’t have to be measured in order to be assessed. And they feared that “true learning and engagement”—along with a commitment to be “responsive to students’ needs [and] lives”—might be lost.

The more educators allow themselves to be turned into accountants, the more trivial their teaching becomes and the more their assessments miss.

These teachers ultimately decided to reject the technocratic PLC approach in favor of an alternative they designed themselves. It focused on teachers’ personal “connection[s] with our subject area” as the basis for helping students think “like mathematicians or historians or writers or scientists, instead of drilling them in the vocabulary of those subject areas or breaking down the skills.” In a word, the teachers put kids before data.

Of course, this powerful exercise in professional development never would have happened if the school administration had simply imposed PLCs (or a similar program) on the teachers, treating them like technicians who merely carry out orders. Which brings us to …

4. Is it about “doing to” or “working with”? Steer clear of any program whose curriculum or assessments are so prescriptive and prefabricated that teachers lack any real autonomy. By now, we ought to know that systems intended to be “teacher proof” are not only disrespectful but chimerical: They are the perpetual-motion machines of education. One sure sign of disrespect is the use of incentives or sanctions to make teachers get with the program, including compensation that hinges on compliance or on some measure of student achievement.

Likewise, you’d want to make sure that students’ autonomy is respected, since kids should have a lot to say about their assessment. If they feel controlled, even a cleverly designed program is unlikely to have a constructive effect. Again, any use of carrots and sticks should set off alarms. As Jerome Bruner once said, we want to create an environment where students can “experience success and failure not as reward and punishment but as information.” That pretty much rules out grades or similar ratings.

Steer clear of any program whose curriculum or assessments are so prescriptive and prefabricated that teachers lack any real autonomy.

5. Is its priority to support kids’ interest? In attempting to track and boost achievement, do we damage what’s most critical to long-term quality of learning: students’ desire to learn? It’s disturbing if a program is so preoccupied with data and narrowly defined skills that it doesn’t even bother to talk about this issue. More important, look at the real-world effects: Once a school adopts the program, are kids more excited about what they’re doing—or has learning been made to feel like drudgery?

6. Does it avoid excessive assessment? Distilling a large body of research, psychologists Martin Maehr and the late Carol Midgley reminded us that “an overemphasis on assessment can actually undermine the pursuit of excellence.” That’s true even with reasonably good assessments, let alone with those that are standardized. The more that students are led to focus on how well they’re doing, the less engaged they tend to become with what they’re doing. Instead of stuff they want to figure out, the curriculum just becomes stuff at which they’re required to get better. A school that’s all about achievement and performance is a school that’s not really about discovery and understanding.

Even intelligent educators can be remarkably credulous, nodding agreeably at descriptions of programs that ought to elicit fury or laughter, avidly copying down hollow phrases from a consultant’s PowerPoint presentation, awed by anything that’s borrowed from the business world or involves digital technology.

Many companies and consultants thrive on this credulity, and also on teachers’ isolation, fatalism, and fear (of demands by clueless officials to raise test scores at any cost). With a good dose of critical thinking and courage, a willingness to say, “This is bad for kids, and we won’t have any part of it,” we could drive these outfits out of business—and begin to take back our schools.

Related Tags:

A version of this article appeared in the August 25, 2010 edition of Education Week as Turning Children Into Data

Events

English-Language Learners Webinar Helping English-Learners Through Improved Parent Outreach: Strategies That Work
Communicating with families is key to helping students thrive – and that’s become even more apparent during a pandemic that’s upended student well-being and forced constant logistical changes in schools. Educators should pay particular attention
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Mathematics Webinar
Addressing Unfinished Learning in Math: Providing Tutoring at Scale
Most states as well as the federal government have landed on tutoring as a key strategy to address unfinished learning from the pandemic. Take math, for example. Studies have found that students lost more ground
Content provided by Yup Math Tutoring
Classroom Technology Webinar Building Better Blended Learning in K-12 Schools
The pandemic and the increasing use of technology in K-12 education it prompted has added renewed energy to the blended learning movement as most students are now learning in school buildings (and will likely continue

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

IT Infrastructure The Infrastructure Bill Includes Billions for Broadband. What It Would Mean for Students
Students who struggle to access the internet at home may get some relief through $65 billion in funding for broadband, approved by Congress in the new infrastructure bill.
2 min read
Chromebooks, to be loaned to students in the Elk Grove Unified School District, await distribution at Monterey Trail High School in Elk Grove, Calif., on April 2, 2020.
Even as school-issued devices such as Chromebooks, shown above, have proliferated in the pandemic, many students still lack internet access at home, putting them at a disadvantage for completing homework assignments.
Rich Pedroncelli/AP
IT Infrastructure Privacy Group Cautions Schools on Technology That Flags Children at Risk of Self-Harm
Software that scans students’ online activity and flags children believed to be at risk of self-harm comes with significant risks, a new report warns.
6 min read
Conceptual image of students walking on data symbols.
Laura Baker/Education Week and Orbon Alija/E+
IT Infrastructure School Districts Seek Billions in New Federal Money for Connectivity, FCC Announces
The Federal Communications Commission received $5.1 billion in requests for new funding to purchase devices and improve internet access.
2 min read
Image shows two children ages 5 to 7 years old and a teacher, an African-American woman, holding a digital tablet up, showing it to the girl sitting next to her. They are all wearing masks, back to school during the COVID-19 pandemic, trying to prevent the spread of coronavirus.
iStock/Getty Images Plus
IT Infrastructure School District Data Systems Are Messed Up. A New Coalition Wants to Help
Organizations representing states and school districts have teamed up with ISTE to help make data systems more user-friendly and secure.
3 min read
Conceptual collage of arrows, icon figures, and locks
Sean Gladwell/Moment/Getty