Assessment

Errors on Tests in Nevada And Georgia Cost Publisher Harcourt

By Caroline Hendrie — September 04, 2002 4 min read

Nevada has imposed steep penalties on Harcourt Educational Measurement for errors in administering statewide exams, and Georgia is poised to do the same, following scoring glitches typical of the kind that have plagued state- sponsored testing programs in recent years.

Nevada has imposed steep penalties on Harcourt Educational Measurement for errors in administering statewide exams, and Georgia is poised to do the same, following scoring glitches typical of the kind that have plagued state- sponsored testing programs in recent years.

A divided Nevada state school board agreed last week to a settlement that requires the San Antonio-based company to pay penalties totaling $425,000 because of a mistake that threw off the scores of nearly 31,000 high school students who took the state’s high school-exit exam in mathematics last spring. Harcourt also has agreed to change its quality-control procedures to prevent similar errors and to pick up any summer school costs incurred by the 736 10th and 11th graders who were mistakenly told they had failed the test.

“It’s very unfortunate,” Jack W. McLaughlin, Nevada’s superintendent of public instruction, said last week of the scoring error. “On the other hand, ... they’ve really gone the extra mile to ensure that it won’t happen again.”

Georgia officials, meanwhile, have decided not to pay Harcourt for this year’s administration of state-mandated, nationally normed tests because of scoring problems that tainted the results, said Cathy Henson, the chairwoman of the state school board. State officials concluded last month that the results of the Stanford Achievement Test-9th Edition, given last spring to some 340,000 students, were no longer worth trying to salvage.

This marks the second consecutive year of problems for Harcourt in the Peach State: The company was late in delivering the scores from the spring 2001 administration of the Stanford-9, prompting state officials to insert penalty clauses in this year’s contract. That $552,000 contract expired June 30, and the board had already decided not to renew it before this year’s problem surfaced, said Harcourt spokesman Rick Blake. He declined to comment on whether Harcourt expected to be paid for the contract.

Harcourt is not alone in facing difficulties in carrying out its contracts to run standardized programs for states. Errors leading to stiff penalties for several major testing contractors have cropped up with increasing frequency in recent years as states have ramped up their testing. (“States Face Limited Choices in Assessment Market,” March 8, 2000.)

Problems Could Worsen

Some experts predict such problems will get worse as states push to comply with new federal requirements for annual student testing in grades 3-8 and one high school grade.

In an Aug. 26 statement about the settlement in Nevada, Harcourt President Dean Nafziger said the payment to the state would come in the form of “cash, teacher instruction, library books, and materials.” Nevada’s testing director, Paul M. La Marca, said that $275,000 of the penalty would be in the form of cash discounts on the contract.

The state’s $2.36 million, 18-month contract with Harcourt to administer the state’s high school exam extends through next June. The company also has a $2.5 million contract covering the same period to write and administer standards-based state tests for grades 3-8, state officials said.

The Nevada state board approved the $425,000 agreement with Harcourt Aug. 26, but also stipulated that another “significant” error by the company would result in the contract’s immediate termination, Mr. McLaughlin said. Some board members denounced the company for failing to provide greater personal compensation for the students who were erroneously told they had flunked, he added.

The mistake occurred because of an improperly formatted computer file and took place during the process used to “equate” the results from the April 2002 administration of the math test to those from tests given previously, according to Mr. La Marca.

Results Deemed Too Late

Georgia education officials suspected a problem after seeing sharp spikes and drop-offs in students’ average scores in certain subjects from 2001 and 2002, Ms. Henson said.

Harcourt officials told the state that the company might be able to correct the problem, given more time. But after consulting with an independent panel of testing experts, state board members concluded that even if valid results were eventually made available, they would be too late to be useful, Ms. Henson said. Some districts use the results to make decisions about student placements and merit pay for employees, and the state wanted to use the results to help see how Georgia students stack up against their peers nationwide.

But the state also administers what are called criterion-referenced tests—ones, in this instance, that are aligned with its academic standards—and it is those that are used in making certain major decisions under the state’s accountability system, such as which schools are placed on the list of those needing improvement.

Harcourt officials said the raw scores from the 2002 Georgia tests were correct, but that the problem arose during the equating process, which is designed to allow for scores to be compared from one year to the next.

Related Tags:

Events

School & District Management Live Online Discussion A Seat at the Table: Strategies & Tips for Complex Decision-Making
Schools are working through the most disruptive period in the history of modern education, facing a pandemic, economic problems, social justice issues, and rapid technological change all at once. But even after the pandemic ends,
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Education Funding Webinar
From Crisis to Opportunity: How Districts Rebuild to Improve Student Well-Being
K-12 leaders discuss the impact of federal funding, prioritizing holistic student support, and how technology can help.
Content provided by Salesforce.org
Classroom Technology Online Summit Technology & the Pandemic: What’s Next for Schools?
When it comes to the use of technology, what’s next for schools?  Join the discussion to tackle issues surrounding this important question.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Assessment Opinion The National Assessment Governing Board’s Troubling Gag Order
NAGB's recently released restrictions on how its board members can communicate set a troubling precedent.
3 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Assessment Whitepaper
INVALSI Addresses Italy’s COVID-19 Learning Loss
Find out how INVALSI worked with TAO to develop a plan of action that can serve as a model for other education leaders grappling with the...
Content provided by TAO by Open Assessment Technologies
Assessment Biden Administration's Level of Tolerance for Cutting Standardized Tests Comes Into Focus
A distinction has grown between states having to make tests available, and districts deciding it's not practical to make students take them.
8 min read
Image of a test sheet.
sengchoy/iStock/Getty
Assessment Opinion Alternatives to Standardized Tests During a Pandemic Year
Three educators suggest alternatives to federally mandated standardized testing during this year undercut by COVID-19.
7 min read
Images shows colorful speech bubbles that say "Q," "&," and "A."
iStock/Getty