Glitches, Data Errors Delay Illinois Test-Score Release

By Michele McNeil — December 05, 2006 4 min read
  • Save to favorites
  • Print

More than eight months after taking Illinois’ achievement test, about 1 million of that state’s public school students and their districts still don’t know the results because of incomplete testing materials, scoring glitches, and data-entry errors.

The lengthy delay means the state can’t identify which schools are struggling and which are making adequate yearly progress, as required by the federal No Child Left Behind Act. And the test results won’t be known until January, at the earliest.

For students, the holdup means they could be missing out on free tutoring or the ability to transfer out of schools, because the state can’t identify which schools have failed persistently in making progress in improving student achievement.

Illinois is one of two states yet to release achievement-test results from the 2005-06 academic year, but the only one to do so unexpectedly. Montana, which will release its results early next year, is doing so with advance approval from the U.S. Department of Education, according to Tara Jensen, a Montana Office of Public Instruction spokeswoman.

Though the states can be fined if their assessment systems are not in compliance with the No Child Left Behind law, the federal Education Department won’t penalize Illinois, said Chad Colby, a department spokesman. Illinois state board of education officials say they’ve kept federal officials updated throughout the delays.

The state isn’t sure when the test results from the spring of 2006 will be ready or how many students could be missing out on the extra academic help, which is provided as part of the nearly 5-year-old federal education law. The law has a goal of having all students academically proficient by 2014, and state tests are used to determine whether schools are making progress in raising student achievement. Students in schools that persistently fail to make progress are eligible to receive tutoring or the option of transferring to another school.

The Illinois Standards Achievement Test, or ISAT, is the test given to students annually in grades 3 to 8 in reading and mathematics, and in grades 4 and 7 in science. Generally, the state releases results before Oct. 31.

Although scoring is complete on the Illinois tests, the testing company, San Antonio-based Harcourt Assessment, must do clean-up work because hundreds of tests still can’t be matched with the appropriate students. Once the data are complete, it will be four or five weeks before student-score reports are done and the school and district report cards can be completed, according to state education officials.

The delay forced the 421,000-student Chicago school system to make educated guesses about which students would be entitled to free tutoring under NCLB.

Elizabeth F. Swanson, the director of the Chicago district’s office of after-school and community school programs, said the district used preliminary dataandprojectionsto decide which schools would fail to make adequate yearly progress and thus qualify for federally funded tutoring. For schools that were on the edge, she said, the district used its own funds to pay for tutoring. Once the test scores are out, school officials can make budgetary adjustments later in the year to ensure that federal funds were spent on the appropriate schools.

“We just had to move forward,” said Ms. Swanson, whose program provides tutoring for about 53,000 of the district’s students.

Technical Glitches

The testing problems involved the testing company and district officials, who were trying to implement a new student-identifier data system, both parties acknowledge.

Harcourt had problems getting tests to schools on time, and some of the tests that were delivered had missing or duplicate pages. Harcourt spokesman Russell Schweiss said his company, which has testing contracts in 10 states, chartered planes to get the tests to schools on time, but ran into problems tracking the materials. Once the tests came back to be scored, Harcourt discovered a scoring glitch that further delayed the results.

“We went to some pretty extreme lengths to resolve the issues,” Mr. Schweiss said.

But the biggest, most time-consuming problem, Mr. Schweiss said, was in verifying student data submitted by school officials across the state, part of the state’s initiative to track individual students’ progress on tests using a new data system. The system relies on local officials to enter demographic data for each student’s test.

About 11,000 tests had missing or incorrect demographic data, and the company had to make thousands of calls to districts to correct the information, Mr. Schweiss said. The company has whittled that number down to fewer than 700 tests that still need to be matched to individual students.

The state provided training to school officials on data entry, but problems in that area contributed to the delay, according to state board of education spokeswoman Meta Minton.

The testing problems have cost the Illinois education department an undetermined amount of money in legal costs and extra staffing time, she said.

In addition, the delays cost Harcourt Assessment part of its contract with the state. In October, the Illinois Board of Education awarded the scoring, printing, and distribution portions of its assessment system to Iowa City, Iowa-based Pearson Educational Measurement for three years, a contract worth $32.9 million. Harcourt still will be responsible for developing each year’s test.

Associate Editor David J. Hoff contributed to this report.

A version of this article appeared in the December 06, 2006 edition of Education Week as Glitches, Data Errors Delay Illinois Test-Score Release


Jobs October 2021 Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Data Webinar
Using Integrated Analytics To Uncover Student Needs
Overwhelmed by data? Learn how an integrated approach to data analytics can help.

Content provided by Instructure
Professional Development Online Summit What's Next for Professional Development: An Overview for Principals
Join fellow educators and administrators in this discussion on professional development for principals and administrators.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Federal National School Board Group's Apology for 'Domestic Terrorism' Letter May Not Quell Uproar
The National School Boards Association voices "regret" for how it sought federal aid to address threats and harassment of school officials.
4 min read
Seminole County, Fla., deputies remove parent Chris Mink of Apopka from an emergency meeting of the Seminole County School Board in Sanford, Fla., Thursday, Sept. 2, 2021. Mink, the parent of a Bear Lake Elementary School student, opposes a call for mask mandates for Seminole schools and was escorted out for shouting during the standing-room only meeting.
Deputies remove a parent from an emergency meeting of the Seminole County School Board in Sanford, Fla., after the parent, who opposes a call for mask mandates for Seminole schools, shouts during the standing-room only meeting.
Joe Burbank/Orlando Sentinel via AP
Federal 'A Snitch Line on Parents.' GOP Reps Grill AG Over Response to Threats on School Officials
Attorney General Merrick Garland said his effort is meant to address violent threats against school boards, not to stifle parents' dissent.
5 min read
LEFT: Attorney General Merrick Garland speaks during a House Judiciary Committee oversight hearing of the Department of Justice on Capitol Hill in Washington, Thursday, Oct. 21, 2021. RIGHT: Rep. Jim Jordan, R-Ohio, questions Attorney General Merrick Garland.
Attorney General Merrick Garland, left, speaks during a House Judiciary Committee oversight hearing of the U.S. Department of Justice on Capitol Hill on Thursday, questioned by Rep. Jim Jordan, R-Ohio, right, among others.
Greg Nash via AP, Andrew Harnik/AP
Federal School Boards, 'Domestic Terrorism,' and Free Speech: Inside the Debate
From critical race theory to COVID policy, the heat on schools has raised issues involving free speech and the safety of public officials.
13 min read
Brenda Stephens, a school board member with Orange County Public Schools in Hillsborough, N.C. has purchased a weapon and taken a concealed carry class over concerns for her personal safety.
Brenda Stephens, a school board member in Hillsborough, N.C., says board members face threats and bullying, an atmosphere far different from what she's encountered in years of board service.
Kate Medley for Education Week
Federal Senate Confirms Catherine Lhamon to Civil Rights Post; Kamala Harris Casts Decisive Vote
Joe Biden's controversial pick to lead the Education Department's office for civil rights held that job in the Obama administration.
2 min read
Catherine Lhamon, nominee to be assistant secretary for civil rights at the Department of Education, testifies during a Senate Health, Education Labor and Pensions Committee confirmation hearing in Dirksen Building on Tuesday, July 13, 2021.
Catherine Lhamon, then-nominee to be assistant secretary for civil rights at the U.S. Department of Education, testifies during a Senate Health, Education Labor and Pensions Committee confirmation hearing in July.
Tom Williams/CQ Roll Call via AP Images