Assessment

Plans to Give NAEP Via Computer Face Obstacles

By Sean Cavanagh — May 19, 2008 4 min read
  • Save to favorites
  • Print

The architects of the nation’s leading test of student academic progress are taking steps to move that exam into the computer age—and coping with the common frustrations of school-based technology.

Federal officials who oversee the National Assessment of Educational Progress have arranged to give a portion of the upcoming science test and the entire future writing test at two grade levels by computer, rather than have students take it with paper and pencil. But at a meeting May 16, they heard reports detailing the technological and logistical hurdles the government faces in trying to administer that prominent exam, often called “the nation’s report card.”

An early test of federal officials’ ability to give NAEP by computer will come in 2009, when they plan to have a relatively small number of students conduct computerized science investigations as part of the national test in that subject for grades 4, 8, and 12. Those officials said they are confident the relatively modest computerized venture will go smoothly.

But a much larger trial will come in 2011, when the plan is, for the first time, to give the entire NAEP writing tests for grades 8 and 12 via computer.

The National Assessment Governing Board, which sets policy for NAEP, decided to move to a computerized writing test in the belief that students today do the bulk of their writing via computer keyboards, rather than sketching it out longhand. Using computer technology, they reasoned, is thus a more appropriate way to gauge students’ writing skills in today’s society.

In their early efforts to plan for that large-scale computerized testing, however, federal officials have found that participating schools use a wide range of incompatible and outdated computer programs, Mark S. Schneider, the commissioner of the National Center for Education Statistics, said in a presentation at the governing board’s quarterly meeting. His arm of the U.S. Department of Education administers NAEP.

In some cases, the computer-security systems in schools would make it difficult to administer NAEP in a secure and reliable way, Mr. Schneider told the board members. And despite widespread advances in school technology in recent years, federal officials found some schools still using programs as old as Windows 95.

“It’s a mess out there,” Mr. Schneider said, summing up the hodgepodge of school computer systems.

More Accurate Measurements Expected

See Also

For more stories on this topic see Technology and Testing and Accountability.

A small proportion of students taking the 2009 NAEP in science will be given “interactive computer tasks,” which pose a scientific problem to students, asking them to use databases and come up with conclusions on computers. Those tasks offer a better alternative to trying to gauge students’ ability to do certain hands-on experiments and solve complex scientific questions, a blueprint for the 2009 science test explained.

Federal officials will be able to handle that task, most likely by distributing laptop computers, which would be used by different student groups at different times, Peggy Carr, the associate NCES commissioner, said in an interview at the governing-board meeting.

But the 2011 writing test poses a much greater challenge, because so many more students will need access to computers. Federal officials are considering several options, such as using a wireless technology to give the writing tests, or using small flash drives that include the exam material and could be inserted into computers used by test-takers, Mr. Schneider said.

Having students take the test with laptops is also possible, Mr. Schneider said. But the difficulty of delivering those machines to so many schools, and paying for them, could exclude that option, even though laptop prices have fallen, he added.

“We’re working on solutions,” Mr. Schneider told the board, though “none of them are going to be easy, and none of them are going to be cheap.”

The board’s decision to move to a computerized writing test mirrors the action of a number of states, which have also sought to administer exams in that subject area on computers. State and national officials have reasoned that not only do most students today write primarily with computers, but they are also expected to be familiar with that technology in college and the workplace. Testing their writing on a computer more accurately measures essential skills, the thinking goes.

The governing board reviewed the experiences of states administering computer-based exams and was aware of the challenges in bringing that technology to NAEP, said member Amanda P. Avallone. She served on a committee that oversaw the revision of the writing test.

One of the main challenges was crafting a computer-based test that could navigate around and be compatible with various school district “firewalls” or security systems, said Ms. Avallone, an 8th grade English teacher. Even so, she said she was confident that those barriers could be overcome.

“Anyone who knows technology and knows how quickly it changes,” Ms. Avallone said, “knew there would be challenges.”

Events

English-Language Learners Webinar Helping English-Learners Through Improved Parent Outreach: Strategies That Work
Communicating with families is key to helping students thrive – and that’s become even more apparent during a pandemic that’s upended student well-being and forced constant logistical changes in schools. Educators should pay particular attention
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Mathematics Webinar
Addressing Unfinished Learning in Math: Providing Tutoring at Scale
Most states as well as the federal government have landed on tutoring as a key strategy to address unfinished learning from the pandemic. Take math, for example. Studies have found that students lost more ground
Content provided by Yup Math Tutoring
Classroom Technology Webinar Building Better Blended Learning in K-12 Schools
The pandemic and the increasing use of technology in K-12 education it prompted has added renewed energy to the blended learning movement as most students are now learning in school buildings (and will likely continue

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Assessment State Test Results Are In. Are They Useless?
While states, districts, and schools pore over data from spring 2021 tests, experts urge caution over how to interpret and use the results.
9 min read
FILE - In this Jan. 17, 2016 file photo, a sign is seen at the entrance to a hall for a college test preparation class in Bethesda, Md. The $380 million test coaching industry is facing competition from free or low-cost alternatives in what their founders hope will make the process of applying to college more equitable. Such innovations are also raising questions about the relevance and the fairness of relying on standardized tests in admissions process.
A sign is posted at the entrance to a hall for a test-preparation class. Assessment experts say educators should use data from spring 2021 tests with caution.
Alex Brandon/AP
Assessment Data Young Adolescents' Scores Trended to Historic Lows on National Tests. And That's Before COVID Hit
The past decade saw unprecedented declines in the National Assessment of Educational Progress's longitudinal study.
3 min read
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Assessment Whitepaper
Proven Techniques for Assessing Students with Technology
Dr. Doug Fisher’s proven assessment techniques help your students become active learners and increase their chances for higher learning g...
Content provided by Achieve3000
Assessment Long a Testing Bastion, Florida Plans to End 'Outdated' Year-End Exams
Florida Gov. Ron DeSantis said the state will shift to "progress monitoring" starting in the 2022-23 school year.
5 min read
Florida Governor Ron DeSantis speaks at the opening of a monoclonal antibody site in Pembroke Pines, Fla., on Aug. 18, 2021.
Florida Gov. Ron DeSantis said he believes a new testing regimen is needed to replace the Florida Standards Assessment, which has been given since 2015.
Marta Lavandier/AP