Assessment

Testing Glitch Prompts N. Carolina To Order System Audit

By Kathleen Kennedy Manzo — May 30, 2001 3 min read
  • Save to favorites
  • Print

North Carolina education officials last week ordered a major audit of the state’s testing and accountability program to determine the soundness of the system after problems emerged over interim scoring measures for the state’s end- of-grade math exam.

The scores used to determine whether students demonstrated proficiency on the test were set too low, resulting in unexpectedly high passing rates for the state’s elementary and middle school students. The miscalculation reduces the number of students who would have been held back a grade under the state’s tough new promotion requirements.

“We are concerned that the reputation of this program has been tarnished by recent problems, and we are committed to taking every step necessary to correct any problems identified in an audit of this program,” state schools Superintendent Michael E. Ward and state board Chairman Philip J. Kirk Jr., said in a statement.

The audit, which will be conducted with the assistance of the Southern Regional Education Board, will review the technical standard-setting process and examine the school rating system.

Some of the state’s 119 districts alerted state officials this month that as many as 95 percent of their students had scored in the “proficient” range in mathematics, despite officials’ contention that the test was more rigorous than in previous years. The test, given in math and reading in grades 3-8, was restructured this year to match new state standards.

“Our goal was to make the test as rigorous and challenging as is reasonable,” said Mildred G. Bazemore, who heads the testing section of the North Carolina Department of Public Instruction. “But we are now aware that the standards were pretty lenient,” she said. “We erred on the side of the kids.”

A new policy is being phased in this school year—beginning with the 5th grade—to limit the promotion of students who do not perform at grade level on the tests. Many districts have already begun requiring all students to prove they have mastered the material for their respective grade levels in order to advance to the next grade.

Students Motivated

The cutoff scores used to determine whether students are proficient in math were based on a field test of the new questions conducted as part the state’s regular exam last year. But the benchmarks did not take into account that students might try harder once strict consequences were attached to the test, Ms. Bazemore said.

“The field-tested questions were embedded in the [regular] tests last year, which would make one believe that we were getting pretty good data” about student-performance expectations, she said. “But the projections that were made could not take into consideration that once the tests had high stakes for the students, they were motivated to perform well.”

Some districts realized the scoring system was faulty as soon as they received the results.

“We saw unusually high scores,” said Patricia O. Hester, the director of instruction and accountability for the 22,000-student Johnston County district, south of Raleigh. “We’re not saying that our kids did not do better. We knew they would improve, but in an amount that would be believable.”

About 95 percent of the students in the county who took the tests scored in the proficient range, about 10 percentage points higher than last year, Ms. Hester said. By comparison, the county saw an improvement of about 1 percentage point on the reading test.

State officials are advising districts to take other factors into consideration besides the test scores to make decisions about promoting students. The state will adjust the scoring standards for next year.

In the meantime, the glitch will not affect the performance ratings given to schools. Nor will bonuses for staff members at schools that meet or exceed state expectations be affected, because the rewards are based on average scale scores instead of achievement levels.

A version of this article appeared in the May 30, 2001 edition of Education Week as Testing Glitch Prompts N. Carolina To Order System Audit

Events

Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Assessment Cardona Says Standardized Tests Haven't Always Met the Mark, Offers New Flexibility
The U.S. Department of Education is seeking to reinvigorate a little-used pilot program to create new types of assessments.
7 min read
Education Secretary Miguel Cardona speaks during an interview with The Associated Press in his office at the Department of Education on Sept. 20, 2023 in Washington.
Education Secretary Miguel Cardona speaks during an interview with The Associated Press in his office at the Department of Education on Sept. 20, 2023 in Washington.
Mark Schiefelbein/AP
Assessment Opinion The 4 Common Myths About Grading Reform, Debunked
Grading reformers and their critics all have the same goal: grades that truly reflect student learning. Here’s how we move forward.
Sarah Ruth Morris & Matt Townsley
5 min read
Venn diagram over a macro shot of A- on white results sheet. Extremely shallow focus. Letter grades are highlighted.
E+/Getty + Vanessa Solis/Education Week
Assessment If ChatGPT Can Write Virtually Anything, What Should a National Writing Exam Test?
That's a question the board that oversees the National Assessment of Educational Progress is confronting amid AI's rapid ascendance.
6 min read
Image of a person using a computer, with glasses, papers, and pencil on the desk too.
iStock/Getty
Assessment From Our Research Center Few Educators Say A-F and Numeric Grades Offer 'Very Effective' Feedback for Students
Fewer than 1 in 6 educators—13 percent— say that A through F or numeric grades are a “very effective way” to give feedback to students.
3 min read
Cropped image of teacher standing in front of a blurred classroom of students with test results in hand showing the letter A in red.
E+