Reading & Literacy

Study Eyes 4th Graders’ Readiness for Writing Tests on Computer

By Liana Loewus — August 05, 2014 3 min read
  • Save to favorites
  • Print

Fourth graders are capable of using a computer to type, organize, and write well enough to be assessed, according to a pilot study released last month by the National Center for Education Statistics. However, whether the results of a computer-based test offer a true measure of students’ writing abilities has yet to be determined.

The study also presents ideas for making computer-based exams more accessible to 4th graders, including by simplifying and reading aloud directions. It comes as the majority of states prepare to roll out common-core-aligned tests, most of which will be taken on computers next spring.

The NCES, which is part of the U.S. Department of Education and administers the National Assessment of Educational Progress, is also getting ready to expand its own computer-based assessment. In 2012, results were released for the first computer-based NAEP writing test for 8th and 12th graders. One quarter of students scored at the proficient level or higher.

In 2011, the NCES performed a small-scale usability study to see how well 4th graders could access the assessment platform used for the 8th and 12th grade NAEP writing tests, according to a July 24 press release from the NCES. That 60-student study found that “4th grade students varied in their ability to write using the computer, and that while some features seemed intuitive to students, others were more difficult to access.” Specifically, students had trouble reading and understanding the lengthy directions, and many skipped them altogether.

Based on those results, the NCES developed a modified assessment platform that had fewer words for the directions, presented one direction at a time, and included voiceovers to read the directions.

In 2012, the NCES administered a new writing test using the modified platform to a nonrepresentative sample of 13,000 4th graders. The students took two 30-minute or three 20-minute tests using a laptop and headphones. Overall, 61 percent of students scored at least a 3 on a 1-to-6 scale (with a 6 being the top score). That means the majority of students “wrote enough to be assessed, included ideas that were mostly on topic and used simple organizational strategies in most of their writing,” the NCES news release said.

‘An Initial Look’

But Ebony Walton, a researcher with the NCES, said “the performance piece is really just an initial look.” The results, she said, were not weighted and the pilot study is “just a snapshot. It was not necessarily to make definitive statements about students’ ability or how their use of these tools are related to ... performance.”

One glaring question not tackled by the study is how well students perform on the computer-based writing test compared with on the paper-and-pencil exam. That is, can 4th graders demonstrate their true writing ability using a computer, or is it a barrier for at least some?

The study does offer one comparison, focused on word count. On the NAEP paper-and-pencil writing test in 2010, 4th grade students wrote, on average, 159 words per response. With the computer-based test, which was 10 minutes longer, they wrote an average of 110 words.

Considering that the higher-scoring papers tend to have more words, as the 2012 data show, it’s possible students may not be showing their true abilities on the computer.

Ms. Walton said an overall performance comparison to paper-and-pencil scores “would have to be done empirically with another type of study.”

Scott Marion, the associate director of the Dover, N.H.-based National Center for the Improvement of Educational Assessment, said he’d like to see a study in which students are each given two writing prompts, responding to one on paper and one on computer.

The NCES plans to release a more in-depth study on how well students do with computer-based writing tests by the end of the year.

A version of this article appeared in the August 06, 2014 edition of Education Week as Study Eyes 4th Graders’ Readiness for Writing Tests on Computer

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Reading & Literacy Webinar
The Future of the Science of Reading
Join us for a discussion on the future of the Science of Reading and how to support every student’s path to literacy.
Content provided by HMH
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
College & Workforce Readiness Webinar
From Classrooms to Careers: How Schools and Districts Can Prepare Students for a Changing Workforce
Real careers start in school. Learn how Alton High built student-centered, job-aligned pathways.
Content provided by TNTP
Student Well-Being Live Online Discussion A Seat at the Table: The Power of Emotion Regulation to Drive K-12 Academic Performance and Wellbeing
Wish you could handle emotions better? Learn practical strategies with researcher Marc Brackett and host Peter DeWitt.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Reading & Literacy Trump School Funding Freeze Has Some Districts Scrambling to Save 'Science of Reading' PD
Teachers need ongoing assistance to make difficult shifts in teaching reading. Some districts had counted on the withheld Title II funding.
4 min read
Third-grader Fallon Rawlinson reads a book at Good Springs Elementary School in Good Springs, Nev., on March 30, 2022. For decades, there has been a clash between two schools of thought on how to best teach children to read, with passionate backers on each side of the so-called reading wars. But the approach gaining momentum lately in American classrooms is the so-called science of reading.
Third-grader Fallon Rawlinson reads a book at Good Springs Elementary School in Good Springs, Nev., on March 30, 2022. Many more states and districts are emphasizing evidence-based practices, including phonics, in reading programs. But the U.S. Department of Education's withholding of teacher-training funding could stymie some of those efforts.
Steve Marcus/Las Vegas Sun via AP
Reading & Literacy ‘A Good Deal of Nostalgia’: New York’s Uneven Embrace of the Science of Reading
Educators say that they're mixing new approaches with the curricula and teaching strategies they've previously used, a new survey finds.
6 min read
Dylan Mayes, left, reads from a book about Willie Mays during a reading circle in class on Oct. 20, 2022, in Niagara Falls, N.Y.
Dylan Mayes, left, reads from a book about Willie Mays during a reading circle in class on Oct. 20, 2022, in Niagara Falls, N.Y. After the state launched a "science of reading" initiative in 2024, implementation has been piecemeal, a new survey finds.
Joshua Bessex/AP
Reading & Literacy How a Teacher Used an AI Tool to Help Her Students' Reading Comprehension
A 6th grade language arts teacher discusses how AI image creators can help boost reading comprehension.
2 min read
Jessica Pack, a 6th grade language arts teacher at James Workman Middle School in Riverside County, Calif., speaks on AI and literacy at the ISTELive 25 + ASCD Annual Conference 25 in San Antonio on July 1, 2025.
Jessica Pack, a 6th grade language arts teacher at James Workman Middle School in Riverside County, Calif., speaks about AI and literacy at the ISTELive 25 + ASCD Annual Conference 25 in San Antonio on July 1, 2025.
Kaylee Domzalski/Education Week
Reading & Literacy Quiz Quiz Yourself: How Much Do You Know About Early Literacy Learning?
Answer 7 questions about building strong family and school connections.