Assessment

Online Testing Demands Careful Planning

By Andrew Trotter — June 20, 2007 5 min read
  • Save to favorites
  • Print

Beef up your digital networks. Marshal enough computers for test days. Ensure that all students have user names. Have a backup plan if the system fails.

Those are some of the important steps school technology leaders need to take before their schools use online assessments, experts on such testing say. Without proper planning, they say, districts are likely to encounter all kinds of problems, turning online testing into more of a liability than an asset for improving student achievement.

“You definitely don’t want a glitch during testing,” says Jim Hirsch, the associate superintendent for academic and technology services for the 33,000-student Plano, Texas, school system.

See Also

For more stories on this topic see Testing and Accountability.

Nine states now offer computer-based assessments of one sort or another to all students, while another 14 offer computer-based assessments to at least some students, according to the Editorial Projects in Education Research Center. Some of those assessments are not delivered via the Internet.

Among the leaders, Oregon and Virginia are using online assessments for their standardized state tests, at least as an option for schools. In Texas, online assessments are used as an option for students with special needs, for a reading proficiency test, and for some parts of the state’s standardized tests. In addition, online assessment is being pilot-tested in Texas for certain end-of-course exams.

Capacity Crunch

But online assessments can overburden a school’s technology, authorities caution.

For instance, South Dakota discontinued the online version of its state assessment in 2003 even though it had been recognized for its pioneering efforts in online testing. State officials had grown increasingly concerned that imbalances in technology capacity across the state and possible technical glitches would affect the accuracy of the test results. And in May of this year, many public high school students in Virginia had their state-mandated online test-taking interrupted by three major glitches, which hit sporadically across the state. Officials blamed the problems on software or server problems in the online testing system provided by an outside contractor and on Internet congestion caused by the large number of students taking the test at once.

At the local level, online testing demands careful allocation of school technological resources, says Edwin J. Zaiontz, the executive director of information services for the 40,000-student Round Rock school district in Texas.

He learned that lesson recently during a trial of new Texas end-of-course assessments in biology and geometry. Initially, Zaiontz thought that all five of the district’s high schools would be involved and testing about 1,500 students.

Because test security required roughly simultaneous testing of all the students, that posed some problems. If Zaiontz turned the schools’ media centers, which have about 50 computers each, into test centers, the testing would occupy them for 15 school days, he calculated.

BRIC ARCHIVE

1.Make sure that enough network-connected computers are available for the number of students to be tested.

2. Reschedule network maintenance so as not to interfere with the schedule for online testing.

3. Plan for different possible glitches, depending on whether the tests are downloaded from a testing company to student computers or hosted entirely from the company’s Web site.

4. Verify that all students have valid user-identification names and passwords for the testing.

5. Use network-management systems to prevent test-takers from using online chats, e-mail, or discussion boards.

6. Check whether other software on computers may be incompatible with the software used in testing.

7. Allow ample time for preliminary tasks, such as students’ typing of their names on electronically submitted assignments.

8. Make sure that technical support is available during the administration of the exams, and that backup procedures are in place for emergencies, such as system crashes or loss of power.

9. Be sure that the server and network being used are reliable.

10. Isolate the server containing the exam questions from the Internet to maintain test security.

“Going without the library for three weeks—that wasn’t a good alternative,” he says. “You’re closing the library at a time when students are needing to use it for research or projects.”

But using high school computer labs would bring to a halt courses in computer-assisted drafting, Web design, and journalism “because computers are key to instruction that is occurring,” Zaiontz notes.

As it turned out, only 300 students at one district high school took part in the field test, which the school accomplished by using the library plus one computer lab for three days.

What might have been a third option—using sets of laptop computers on carts with wireless connections to the Internet—was ruled out for the trial. NCS Pearson Inc., which the state hired to run the online test, considered wireless less reliable, Zaiontz says, and students’ performance could be adversely affected by laptops’ small screens, keyboards, and trackballs.

Still, as online testing becomes more common and as students become more familiar with laptops, the smaller computers might be the best way to go, he says, because they would allow students to take tests in their classrooms.

Adaptive Assessments

Other types of online assessment pose fewer potential problems because they do not count for such high stakes, some experts point out.

For example, Agile Mind Inc., based in Grapevine, Texas, offers complete online curricula in high school math that have multiple types of assessment embedded within lessons and available in large banks of test items for benchmarking.

Other companies, such as Study Island, headquartered in Dallas, develop online tests based on state standards for informal drilling of students to prepare for state tests. School districts can schedule students to take those tests during classes, in study halls, or at home.

One test provider that has acquired a strong following in school districts is the nonprofit Northwest Evaluation Association, based in Lake Oswego, Ore., which provides standards-based tests for kindergarten through grade 10.

Raymond Yeagley, the NWEA’s vice president of product and business development, says the organization does not serve up those tests to students on a secure Web site, as some companies do. Instead, a district downloads the tests and loads them on its own computer server. Students can log in over their schools’ networks and answer the test items that teachers have selected.

The NWEA tests are adaptive, meaning that a student gets easier or harder test items depending on how well he or she is doing. An adaptive test requires much more computer processing than a test that is not adaptive.

“Because of the adaptive nature of the test, bandwidth could become a very serious problem for us—if there is a delay of more than a second, it could have a bad impact on the validity of the test,” Yeagley says.

Future Planning

See Also

Sign up for the Accountability Alert newsletter and stay abreast of the most recent news coverage and ideas on accountability issues.

Michael K. Russell, an associate professor of education at Boston College who conducts research on testing, says that in the next few years, school leaders can expect to see improved forms of adaptive tests that will make them more diagnostic, giving teachers better clues to why students choose particular right or wrong answers.

Technology leaders should also be aware of the growing interest in the use of online assessments that are adapted for students with disabilities, whom federal mandates entitle to accommodations on state tests.

Various adaptations are “much more possible, but not in place yet,” Russell says, citing examples such as read-aloud tests, enlarged text or magnification, masking parts of test items that could be distracting to some students, glossaries to define terms, and switches and other writing devices for students with physical disabilities.

In the future, he says, schools will probably need to provide such accommodations not just when students are taking their state tests, but also when they are practicing for them, or taking other online assessments.

And that, undoubtedly, will require proper planning.

Andrew Trotter, an assistant editor for Education Week, covers technology issues.
A version of this article appeared in the June 20, 2007 edition of Digital Directions as Online Testing Demands Careful Planning

Events

School Climate & Safety K-12 Essentials Forum Strengthen Students’ Connections to School
Join this free event to learn how schools are creating the space for students to form strong bonds with each other and trusted adults.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Reading & Literacy Webinar
Creating Confident Readers: Why Differentiated Instruction is Equitable Instruction
Join us as we break down how differentiated instruction can advance your school’s literacy and equity goals.
Content provided by Lexia Learning
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
IT Infrastructure & Management Webinar
Future-Proofing Your School's Tech Ecosystem: Strategies for Asset Tracking, Sustainability, and Budget Optimization
Gain actionable insights into effective asset management, budget optimization, and sustainable IT practices.
Content provided by Follett Learning

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Assessment What the Research Says What Teachers Should Know About Integrating Formative Assessment With Instruction
Teachers need to understand how tests fit into their larger instructional practice, experts say.
3 min read
Students with raised hands.
E+ / Getty
Assessment AI May Be Coming for Standardized Testing
An international test may offer clues on how AI can help create better assessments.
4 min read
online test checklist 1610418898 brightspot
champpixs/iStock/Getty
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Assessment Whitepaper
Design for Improvement: The Case for a New Accountability System
Assessments in more frequent intervals provide useful feedback on what students actually study. New curriculum-aligned assessments can le...
Content provided by Cognia
Assessment The 5 Burning Questions for Districts on Grading Reforms
As districts rethink grading policies, they consider the purpose of grades and how to make them more reliable measures of learning.
5 min read
Grading reform lead art
Illustration by Laura Baker/Education Week with E+ and iStock/Getty