Assessment

Online Testing Glitches Causing Distrust in Technology

By Michelle R. Davis — May 06, 2014 4 min read
  • Save to favorites
  • Print

For the second year in a row, a handful of states experienced significant disruptions in online testing, creating such a high level of distrust with the technology-based process that some districts chose to revert to paper-and-pencil tests in an effort to avoid problems.

Florida, Kansas, and Oklahoma all suspended online testing at some point during testing windows in April because of computer glitches that led to slow load times or kicked students out of the assessment systems. Indiana districts reported problems during the week of April 21, as they did practice testing, but, as of mid-week last week, officials from the state’s department of education reported that only one district was beset by significant glitches.

In each of those states, the testing problems were attributed to the assessment provider. In Oklahoma, where 8,100 students in grades 6-12 experienced disruptions, the trouble arose from CTB/McGraw-Hill, which reported a hardware malfunction. That same issue was blamed for problems in Indiana, which also contracts with Monterey, Calif.-based CTB/McGraw-Hill, during the practice-testing period.

In Florida, where 26 of 67 districts reported a variety of disruptions, test-provider Pearson, based in New York City, cited “degraded administrative functions” and quickly fixed the problems, said Joe Follick, a spokesman for the state’s department of education. And early in April, Kansas education officials were forced to suspend administration of state exams after testing vendor the Center for Education Testing and Evaluation, based at the University of Kansas, in Lawrence, was overwhelmed with attacks from unidentified hackers.

‘Extreme’ Angst

The fallout from the disruptions comes as many states are moving toward online testing—some prompted by the expectation that assessments tied to the Common Core State Standards be given online by 2014-15. But publicity surrounding the breakdowns is creating a wariness about testing technology and its ability to operate successfully.

In the 31,000-student Fort Wayne school system in Indiana, Superintendent Wendy Y. Robinson announced last week that students would take state tests using paper and pencils instead of online, following disruptions during practice tests. That meant, however, that testing will be delayed until the end of May, when CTB/McGraw-Hill can deliver printed test booklets.

"[W]e lost confidence that testing could take place without the extensive interruptions students experienced last year,” Ms. Robinson said.

As occurred last year, when Indiana, Kentucky, Minnesota, and Oklahoma became mired in online-testing breakdowns, the test problems caused angst for educators and students. In Oklahoma, CTB/McGraw-Hill officials apologized and said this year’s disruptions were unrelated to the server overload which caused widespread problems in 2013.

But CTB/McGraw-Hill’s explanation of this year’s technical difficulties didn’t assuage some educators.

Keith Ballard, the superintendent of the 42,000-student Tulsa public schools, said about 2,000 students in grades 6-12 were affected by the testing complications and called the problems a “colossal meltdown.” The emphasis on high-stakes testing in the state means “the stakes are just huge,” he said.

Mr. Ballard faulted state Superintendent of Public Instruction Janet Barresi for awarding a $13 million contract to CTB/McGraw-Hill this year after last year’s problems. At that time, Oklahoma education officials did not believe there was time to rebid the contract, said Tricia Pemberton, a spokeswoman for the Oklahoma education department. Last year, CTB/McGraw-Hill paid more than $1.2 million to the state to cover damages suffered by students and teachers during testing.

This year, Ms. Barresi called for the state to not renew CTB/McGraw-Hill’s contract for the upcoming, 2014-15 school year. “It is an understatement to say I am outraged,” she said.

At a meeting with the Oklahoma State Board of Education April 24, CTB/McGraw-Hill’s President Ellen Haley apologized for the disruptions and said her company was dedicated to providing a high-quality product.

“We will do everything in our power to make sure nothing happens from here on,” she said.

But some board members were not satisfied, saying the company’s poor performance cast doubt on standardized and online testing. “People are rising up against testing, and you’re giving them ammunition,” said board member Amy Anne Ford.

Test of Confidence

The public and policymakers are right to have doubts about the reliability of online testing, which is relatively new in some states, argued Robert A. Schaeffer, the public eduction director of FairTest, which objects to increased standardized testing and is based in Jamaica Plain, Mass. The recent, high-profile disruptions reveal that “the market has gotten ahead of the developing and testing of the product,” he said, which is likely to undermine the credibility of such testing.

Brandt Redd, the chief technology officer of the Smarter Balanced Assessment Consortium—one of two major consortia developing common- core tests—said he worries that negative perceptions could taint common-core online testing overall. However, he said field-testing of Smarter Balanced tests has gone more smoothly than expected. “We can manage any [negative] message by pointing out how well it’s gone elsewhere,” Mr. Redd said.

Laura Slover, the chief executive officer for the Partnership for Assessment of Readiness for College and Careers, or PARCC, which is also developing common-core tests, agreed, saying the benefits of online testing—the accessibility, fast results, and interactivity—outweigh technological risks. And, she said, today’s computer users understand that glitches sometimes occur.

“The vast majority of us use computers every day, and now and again our computers freeze up and you need to reboot,” Ms. Slover said. “Those are the known variables of 21st-century technology.”

Coverage of entrepreneurship and innovation in education and school design is supported in part by a grant from the Carnegie Corporation of New York. Education Week retains sole editorial control over the content of this coverage.
A version of this article appeared in the May 07, 2014 edition of Education Week as Online Testing Glitches Causing Distrust in Technology

Events

Jobs October 2021 Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Data Webinar
Using Integrated Analytics To Uncover Student Needs
Overwhelmed by data? Learn how an integrated approach to data analytics can help.

Content provided by Instructure
Classroom Technology Webinar How Pandemic Tech Is (and Is Not) Transforming K-12 Schools
The COVID-19 pandemic—and the resulting rise in virtual learning and big investments in digital learning tools— helped educators propel their technology skills to the next level. Teachers have become more adept at using learning management

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Assessment State Test Results Are In. Are They Useless?
While states, districts, and schools pore over data from spring 2021 tests, experts urge caution over how to interpret and use the results.
9 min read
FILE - In this Jan. 17, 2016 file photo, a sign is seen at the entrance to a hall for a college test preparation class in Bethesda, Md. The $380 million test coaching industry is facing competition from free or low-cost alternatives in what their founders hope will make the process of applying to college more equitable. Such innovations are also raising questions about the relevance and the fairness of relying on standardized tests in admissions process.
A sign is posted at the entrance to a hall for a test-preparation class. Assessment experts say educators should use data from spring 2021 tests with caution.
Alex Brandon/AP
Assessment Data Young Adolescents' Scores Trended to Historic Lows on National Tests. And That's Before COVID Hit
The past decade saw unprecedented declines in the National Assessment of Educational Progress's longitudinal study.
3 min read
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Assessment Whitepaper
Proven Techniques for Assessing Students with Technology
Dr. Doug Fisher’s proven assessment techniques help your students become active learners and increase their chances for higher learning g...
Content provided by Achieve3000
Assessment Long a Testing Bastion, Florida Plans to End 'Outdated' Year-End Exams
Florida Gov. Ron DeSantis said the state will shift to "progress monitoring" starting in the 2022-23 school year.
5 min read
Florida Governor Ron DeSantis speaks at the opening of a monoclonal antibody site in Pembroke Pines, Fla., on Aug. 18, 2021.
Florida Gov. Ron DeSantis said he believes a new testing regimen is needed to replace the Florida Standards Assessment, which has been given since 2015.
Marta Lavandier/AP