Assessment

Panel Details Shortcomings Of N.C.'s Testing Program

By Kathleen Kennedy Manzo — December 12, 2001 4 min read
  • Save to favorites
  • Print

North Carolina has devoted insufficient time, money, and staff to its testing program over the past few years—shortcomings that, if not properly addressed, could continue to jeopardize its overall reliability and credibility, a panel of testing experts told the state school board last week.

Read the report, “Independent Audit Panel Review of North Carolina Testing and Accountability Issues,”, from North Carolina public schools. (Requires Adobe’s Acrobat Reader.)

While the panel’s audit praised the state’s accountability program for raising student achievement, it warned that without clearly documented testing policies, the state may have difficulty defending itself against lawsuits that could result as the stakes for individual students rise.

“In spite of the fact that North Carolina has a good program, [the state] is trying to do more at this point than it is willing to devote the time and staff to,” said Mark D. Musick, the president of the Southern Regional Education Board in Atlanta, which oversaw the independent audit. “The testing program has grown, the responsibilities of the testing staff have grown, and the stakes have grown, but the money and the staffing haven’t kept pace.”

The report urges policymakers to yield their demand for expediency whenever it threatens to compromise the complex technical operations of statewide assessment systems.

Louis M. Fabrizio, the director of accountability services for the North Carolina Department of Public Instruction, said, “I was happy that the report pointed out that developing valid and reliable tests for a statewide testing program is a much more complicated and involved and time-consuming process than most folks understand.”

Problems in the state’s testing program arose last spring when local and state education officials discovered that the scores used to determine whether students demonstrated proficiency in mathematics were set too low. As a result, far more elementary and middle school students passed the exam than expected, and fewer 5th graders were held back as the state began to phase in tough new promotion requirements. (“Testing Glitch Prompts N. Carolina to Order System Audit,”, May 30, 2001.)

Changes Made Hastily

The tests were designed to reflect a more rigorous math curriculum that had been phased in over the previous two years. But experts believe the sweeping adjustments were made too quickly, in response to tight deadlines set by the state board. Similar criticisms have been leveled at testing programs in other states as well.

And the task stretched North Carolina’s testing staff beyond reasonable limits, the panel said. The process of field-testing new questions for the exams, for example, was rushed, and not enough time was built into the grading process to check for problems with the cutoff scores used to determine proficiency levels.

State legislators on both sides of the aisle have shown unprecedented support for the state’s 5-year-old accountability program. As a result, teachers and staff members involved in improving schools have shared as much $140 million each year in bonus money. But the $12 million testing program has lacked the necessary monetary and technical support, according to the audit panel.

The state education department has 10 employees to oversee all aspects of crafting and administering the testing program. The program includes annual tests in math and reading in grades 3 through 8, a writing assessment in 4th, 7th, and 10th grades, a computer-skills exam for 8th graders, and a high school exit test.

The testing staff also oversees a high school competency test and alternative assessments for students with special needs, and helps create and field-test new test items.

The state board had asked the legislature to expand the payroll for the division for seven new positions in its 2002-2003 biennial budget. But under the constraints of a nearly $1 billion budget shortfall, the division instead lost one position.

State education officials agreed with some of the panel’s recommendations. State board Chairman Philip J. Kirk Jr. acknowledged that he and his colleagues on the board, particularly those experienced in business management, may have pressed for speed over quality.

“It seems to at least the business members of the state board that it takes too long to get tests validated and in use,” he said. “However, this study has convinced us that it is better to go a little slower and get it right than to proceed and take some shortcuts.”

Critics Not Appeased

The report, which was commissioned by the state board, did little to quell critics of the accountability plan. The questions undertaken by the audit panel may be beside the point, according to John Hood, the president of the John Locke Foundation, a conservative think tank in Raleigh. Mr. Hood has argued that the current testing program offers a narrow view of achievement among the state’s 1.3 million students.

“Our annual testing data are useful only to the extent that they compare us to ourselves,” said Mr. Hood. He has advocated the use of a nationally normed test, which would measure North Carolina students against those throughout the country. “We don’t get a good sense if the yardstick we’re using is the right length.”

Related Tags:

A version of this article appeared in the December 12, 2001 edition of Education Week as Panel Details Shortcomings Of N.C.'s Testing Program

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Reading & Literacy Webinar
Your Questions on the Science of Reading, Answered
Dive into the Science of Reading with K-12 leaders. Discover strategies, policy insights, and more in our webinar.
Content provided by Otus
Mathematics Live Online Discussion A Seat at the Table: Breaking the Cycle: How Districts are Turning around Dismal Math Scores
Math myth: Students just aren't good at it? Join us & learn how districts are boosting math scores.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Achievement Webinar
How To Tackle The Biggest Hurdles To Effective Tutoring
Learn how districts overcome the three biggest challenges to implementing high-impact tutoring with fidelity: time, talent, and funding.
Content provided by Saga Education

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Assessment The 5 Burning Questions for Districts on Grading Reforms
As districts rethink grading policies, they consider the purpose of grades and how to make them more reliable measures of learning.
5 min read
Grading reform lead art
Illustration by Laura Baker/Education Week with E+ and iStock/Getty
Assessment As They Revamp Grading, Districts Try to Improve Consistency, Prevent Inflation
Districts have embraced bold changes to make grading systems more consistent, but some say they've inflated grades and sent mixed signals.
10 min read
Close crop of a teacher's hands grading a stack of papers with a red marker.
E+
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Assessment Sponsor
Fewer, Better Assessments: Rethinking Assessments and Reducing Data Fatigue
Imagine a classroom where data isn't just a report card, but a map leading students to their full potential. That's the kind of learning experience we envision at ANet, alongside educators
Content provided by Achievement Network
Superintendent Dr. Kelly Aramaki - Watch how ANet helps educators
Photo provided by Achievement Network
Assessment Opinion What's the Best Way to Grade Students? Teachers Weigh In
There are many ways to make grading a better, more productive experience for students. Here are a few.
14 min read
Images shows colorful speech bubbles that say "Q," "&," and "A."
iStock/Getty