Reading & Literacy

Scantronning Shakespeare

By Kevin Bushweller — August 10, 2006 2 min read

English teacher Aleeta Johnson first saw an advertisement for essay-grading software while attending a Florida Educational Technology Conference in Orlando six years ago. Her initial reaction was skepticism, bordering on disbelief.

“I thought, oh, that’s too good to be true,” says Johnson, who works at Farragut High School in Knoxville, Tennessee. “How could a computer grade an essay?”

01classtech robot

But since then, Johnson has become a true believer in the power of essay-grading technology—especially Educational Testing Service’s Criterion Online Writing Evaluation, which is used in her district. Now the 22-year-teaching veteran can’t imagine life without Criterion because it has freed up her time to assign an “astronomically” higher number of writing assignments than she did before she used the technology.

Many other teachers have also seen the wisdom of writing-evaluating software, fueling the proliferation of titles such as Writing Roadmap 2.0, a product of CTB/McGraw-Hill; IntelliMetric by Vantage Learning; WriteToLearn by Pearson Knowledge Technologies; and SAGrader by Idea Works Inc.Each program works a little differently. Some, such as Criterion, assess the quality of sentence organization, grammar, usage, and style, but do not evaluate content. Others use artificial intelligence to evaluate the quality of an essay on a particular topic.

Shortly before Johnson attended that Florida technology conference, I wrote a story about essay-grading software. At the time, I was also very skeptical that it would somehow revolutionize the teaching of writing. It seemed more hype than reality, and there was debate raging among researchers about the accuracy and effectiveness of the essay-grading engines. Plus, as a writer and editor, the thought that a machine could replace the craft of evaluating a piece of writing made me cringe a bit. Writing, to me, has always been a quintessentially human experience.

But I do not have to teach writing to more than 150 students in the course of a school year, as Johnson does. And that’s why her experience, not my perspective, carries more weight. In 2002-03, when Criterion was used to grade essays at all 12 of her district’s high schools, writing scores on a subsequent standardized test of 11th graders’ persuasive writing rose 8 points. At one high school where a writing-across-the-curriculum program was put in place in tandem with Criterion, 11th graders’ scores jumped 19 points that year.

Even so, Criterion and other essay-grading technologies have their limitations. They can’t judge the creativity of a writing style or the inventiveness of metaphors and symbolism. And I remain skeptical that artificial intelligence can effectively differentiate between a good essay and a truly excellent one.

Johnson acknowledges that Criterion is not a good tool for very sophisticated writers. It wouldn’t appreciate the skill and creativity of a budding Shakespeare, for example.

But the reality, Johnson says, is that budding Shakespeares make up less than 1 percent of her students. The other 99 percent, she says, are best served by the modern duo of teacher and machine.

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Professional Development Webinar
Building Leadership Excellence Through Instructional Coaching
Join this webinar for a discussion on instructional coaching and ways you can link your implement or build on your program.
Content provided by Whetstone Education/SchoolMint
Teaching Webinar Tips for Better Hybrid Learning: Ask the Experts What Works
Register and ask your questions about hybrid learning to our expert panel.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Families & the Community Webinar
Family Engagement for Student Success With Dr. Karen Mapp
Register for this free webinar to learn how to empower and engage families for student success featuring Karen L. Mapp.
Content provided by Panorama Education & PowerMyLearning

EdWeek Top School Jobs

[2021-2022] Founding Middle School Academic Dean
New York, NY, US
DREAM Charter School
Hiring Bilingual and Special Education Teachers NOW!
Newark, New Jersey
Newark Public Schools
DevOps Engineer
Portland, OR, US
Northwest Evaluation Association
User Experience Analyst
Portland, OR, US
Northwest Evaluation Association

Read Next

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Reading & Literacy Whitepaper
These Top 5 Tips will help you get 90% of your Students Reading at Grade Level
So what does it take to get to achieve over 90% of students reading at or above grade level? Read our top 5 tips to find out!
Content provided by Learning Ovations
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Reading & Literacy Whitepaper
The Best Kept Secret Every K-3 Literacy Initiative Needs
In this whitepaper, you will read about how our professional support system has been proven to get over 90% of students reading at, or above, grade-level.
Content provided by Learning Ovations
Reading & Literacy 5 Ways to Remotely Support Students With Dyslexia
The COVID-19 pandemic has shed light on the needs of students with dyslexia, but also made it more difficult to support them.
7 min read
Image of a child interacting with a teacher through the computer.
E+
Reading & Literacy Spotlight Spotlight on the Science of Reading
In this Spotlight, review what the science says about reading and rediscover the struggles commonly seen.