Reading & Literacy

Scantronning Shakespeare

By Kevin Bushweller — August 10, 2006 2 min read
  • Save to favorites
  • Print

English teacher Aleeta Johnson first saw an advertisement for essay-grading software while attending a Florida Educational Technology Conference in Orlando six years ago. Her initial reaction was skepticism, bordering on disbelief.

“I thought, oh, that’s too good to be true,” says Johnson, who works at Farragut High School in Knoxville, Tennessee. “How could a computer grade an essay?”


But since then, Johnson has become a true believer in the power of essay-grading technology—especially Educational Testing Service’s Criterion Online Writing Evaluation, which is used in her district. Now the 22-year-teaching veteran can’t imagine life without Criterion because it has freed up her time to assign an “astronomically” higher number of writing assignments than she did before she used the technology.

Many other teachers have also seen the wisdom of writing-evaluating software, fueling the proliferation of titles such as Writing Roadmap 2.0, a product of CTB/McGraw-Hill; IntelliMetric by Vantage Learning; WriteToLearn by Pearson Knowledge Technologies; and SAGrader by Idea Works Inc.Each program works a little differently. Some, such as Criterion, assess the quality of sentence organization, grammar, usage, and style, but do not evaluate content. Others use artificial intelligence to evaluate the quality of an essay on a particular topic.

Shortly before Johnson attended that Florida technology conference, I wrote a story about essay-grading software. At the time, I was also very skeptical that it would somehow revolutionize the teaching of writing. It seemed more hype than reality, and there was debate raging among researchers about the accuracy and effectiveness of the essay-grading engines. Plus, as a writer and editor, the thought that a machine could replace the craft of evaluating a piece of writing made me cringe a bit. Writing, to me, has always been a quintessentially human experience.

But I do not have to teach writing to more than 150 students in the course of a school year, as Johnson does. And that’s why her experience, not my perspective, carries more weight. In 2002-03, when Criterion was used to grade essays at all 12 of her district’s high schools, writing scores on a subsequent standardized test of 11th graders’ persuasive writing rose 8 points. At one high school where a writing-across-the-curriculum program was put in place in tandem with Criterion, 11th graders’ scores jumped 19 points that year.

Even so, Criterion and other essay-grading technologies have their limitations. They can’t judge the creativity of a writing style or the inventiveness of metaphors and symbolism. And I remain skeptical that artificial intelligence can effectively differentiate between a good essay and a truly excellent one.

Johnson acknowledges that Criterion is not a good tool for very sophisticated writers. It wouldn’t appreciate the skill and creativity of a budding Shakespeare, for example.

But the reality, Johnson says, is that budding Shakespeares make up less than 1 percent of her students. The other 99 percent, she says, are best served by the modern duo of teacher and machine.

Related Tags:


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
School Climate & Safety Webinar
Praise for Improvement: Supporting Student Behavior through Positive Feedback and Interventions
Discover how PBIS teams and educators use evidence-based practices for student success.
Content provided by Panorama Education
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
IT Management Webinar
Build a Digitally Responsive Educational Organization for Effective Digital-Age Learning
Chart a guided pathway to digital agility and build support for your organization’s mission and vision through dialogue and collaboration.
Content provided by Bluum
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Data Webinar
Drive Instruction With Mastery-Based Assessment
Deliver the right data at the right time—in the right format—and empower better decisions.
Content provided by Instructure

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Reading & Literacy What the Research Says Concerns Raised Over Reading Recovery's Long-Term Effects
The popular literacy intervention showed dramatic benefits for 1st graders, but follow-up research points to drawbacks years later.
5 min read
Image of a young boy selecting books in the library.
Reading & Literacy Students Write Their Way to Hope, Courage: Read Their Poems
Five poems from students in Los Angeles and Miami, written to make sense of difficult times.
2 min read
Conceptual image of poetry.
Laura Baker/Education Week (Images: Digital VisionVectors, E+, Pateresca/iStock)
Reading & Literacy ‘It Can Save Lives’: Students Testify to the Power of Poetry
For National Poetry Month, see how teachers and students are exploring the art form.
5 min read
In a Wednesday, April 19, 2017 photo, Eric Charles, left, smiles after performing his poem, "Goodbye to High School Football," for classmates at Sharpstown High School in Houston. Charles compared the rush of performing to the emotions he felt during a football game. Charles had played football since young age, and he planned to play at an elite level in college. However, after injuring his left knee a second time, he found he enjoyed poetry and writing. "That's the glory in me getting hurt," he said.
Eric Charles, left, smiles after performing his poem, "Goodbye to High School Football" for classmates at Sharpstown High School in Houston in 2017. For some students and their teachers, studying and writing poetry has been transformative amid the losses of the pandemic and the wrenching national dialogue about racial justice.
Jon Shapley/Houston Chronicle via AP
Reading & Literacy What the 'Science of Reading' Should Look Like for English-Learners. It's Not Settled
ELLs need additional supports for, and bring different strengths to, early reading instruction, experts say.
10 min read
Sarah Mireles kneels down to work on reading skills with students at Maplewood Elementary in Greeley, Colo., in January of 2018.
Sarah Mireles kneels down to work with Abdigani Hussein, 10, left, and Muhammod Amanullah, 10, during class on at Maplewood Elementary in Greeley, Colo., on Jan. 30, 2018. (Joshua Polson/The Daily Tribune via AP)
Joshua Polson/The Daily Tribune via AP