Assessment

Board Plunges into Thorny Issue Of Revising NAEP Reading Outline

By Kathleen Kennedy Manzo — November 20, 2002 3 min read

Two groups of reading and assessment experts offered divergent proposals last week for retooling the National Assessment of Educational Progress in reading. One pushes for improvements to the current framework that guides what is on the test, while the other recommends a dramatic shift in how students’ proficiency in the subject is gauged.

In presentations here to a committee of the National Assessment Governing Board, which sets policy for NAEP, the groups outlined in competing issues papers the types of changes they believe are necessary to bring the test into better alignment with the latest research in the field, as well as state standards.

The governing board hired a contractor last month to design the reading framework that will guide development of test questions, beginning with its 2007 administration. For the first time, the contract does not require that future tests yield results comparable with those on previous NAEP exams.

Competing Views

In its paper, the contractor, the American Institutes for Research, a nonprofit research organization based in Washington, suggested that the board could build on the existing framework while constructing questions that better reflect the types of reading tasks children tackle each day, such as technology-based text and graphical presentations. The test should also consider the varied reading experiences and background knowledge of all test-takers and scale back the length and complexity of some reading passages, according to Terry Sallinger, a chief scientist with AIR.

The opposing paper, by the Washington-based Education Leaders Council, a national network of state and local officials, and the Thomas B. Fordham Foundation, a research and school reform organization led by former Assistant Secretary of Education Chester E. Finn Jr., argues that the current framework gauges students’ reading-comprehension skills at a more “superficial level” than state tests, and it recommends “changes in the way reading/literacy is defined and measured” by the test.

Chester E. Finn Jr.

The ELC and the Fordham Foundation suggest that NAEP, which broadly assesses reading comprehension and critical-thinking skills, require more specific tasks of students, such as analyzing arguments or making deductions.

The test should also include a more explicit check of students’ vocabulary knowledge and reading fluency, they say, as well as passages that are better aligned to the grade levels of the students by using readability formulas. Questions that ask for students’ opinions should be eliminated, the paper maintains.

In addition, that proposal urges the board to align the test more closely with state standards and assessments in the subject to allow states to monitor progress, as will be required under the “No Child Left Behind” Act of 2001.

But such wholesale changes could make it difficult, or impossible, to compare student performance on the new test with results from previous years, a trend many experts and policymakers look to as a key indicator of whether achievement is improving.

No More Consensus?

NAGB set a precedent in commissioning two sets of literature reviews and issue papers, an acknowledgment of the intense debate in the field over how children learn to read and to comprehend text, and how proficiency is best assessed.

“The board believes it is important to consider different points of view on reading assessment,” Roy Truby, the longtime executive director of the governing board, said before he retired last month. “Then, the two issues papers will help the board frame the issues it wants to be considered in deciding how NAEP will test reading comprehension in the future.”

In 1990, the committee charged with writing the current framework was asked only to reach a consensus among researchers and educators in the field, said Mr. Finn of the Fordham Foundation, who was then a member of the governing board.

“The word ‘science’ never appeared in 1990 in any of the statutory backdrop,” he said at the meeting last week. “Consensus was the goal, not research. We know a whole lot more about reading ... and the science [of reading] now.”

AIR will assemble several committees over the coming months to draft the new framework. The governing board will also seek input from scholars, educators, and the public.

Related Tags:

A version of this article appeared in the November 20, 2002 edition of Education Week as Board Plunges into Thorny Issue Of Revising NAEP Reading Outline

Events

Jobs The EdWeek Top School Jobs Virtual Career Fair
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Mathematics Webinar
Engaging Young Students to Accelerate Math Learning
Join learning scientists and inspiring district leaders, for a timely panel discussion addressing a school district’s approach to doubling and tripling Math gains during Covid. What started as a goal to address learning gaps in
Content provided by Age of Learning & Digital Promise, Harlingen CISD
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Curriculum Webinar
How to Power Your Curriculum With Digital Books
Register for this can’t miss session looking at best practices for utilizing digital books to support their curriculum.
Content provided by OverDrive

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Assessment Whitepaper
Facing the Future Together: Digital Innovative Solutions
Join us to discuss how digital innovative solutions can enrich the educational experience in the K-12 environment. We’ll share how these ...
Content provided by Pearson
Assessment Opinion What Federally Mandated State Tests Are Good For (And What They Aren’t)
Spring 2021 testing is happening. That can be a good thing—if the goal is about more than school accountability.
Stuart Kahl
5 min read
Two people analyze test data
Visual Generation/iStock/Getty
Assessment Opinion The National Assessment Governing Board’s Troubling Gag Order
NAGB's recently released restrictions on how its board members can communicate set a troubling precedent.
3 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Assessment Whitepaper
How Are Kids Really Performing This Year?
Has the academic impact of COVID-19 narrowed since last fall? How much progress have students made at each grade level? Get the answers i...
Content provided by Renaissance Learning