Assessment

New NAEP Reading Framework Would Signal Trend Line’s End

By Kathleen Kennedy Manzo — August 11, 2004 3 min read
  • Save to favorites
  • Print

The end is in sight for the trend line that has served as a gauge of student achievement in reading nationwide for more than a decade.

Late last week, the board that sets policy for the National Assessment of Educational Progress was poised to adopt a new framework for the NAEP reading test that would change the content significantly enough to prevent the continuation of comparisons among tests. A new trend line would begin.

The framework would guide development of reading-test questions beginning with the 2009 administration for 4th, 8th, and 12th grades. The current framework, which has been used since 1992, will be retained through 2007, during which time the reading test will be given three more times. With those results, there will be 15 years of trend data on that test in total.

If the new framework is adopted, as expected, NAEP would test students’ reading comprehension on two types of texts: literary, which could include fiction and literary nonfiction, such as narrative essays, speeches, and biographies, as well as poetry; and informational, such as explanatory texts, persuasive writing, documents, and graphic presentations. For the first time, the test would also include items that explicitly measure students’ vocabulary knowledge. Students would be asked to answer questions about the meanings of words in the context of selected passages.

“We believe the framework will provide a rich and accurate measure of the reading comprehension and analytical skills that students need both for their schooling and for their lives,” the National Assessment Governing Board, the policy-setting body, says in the framework. “The governing board hopes that this reading framework will serve not only as the means to report on reading achievement but also as a catalyst to improve it for the benefit of students themselves and for the nation.”

Vocabulary Questions

In line with NAEP policy, says the proposed framework, the new test would not endorse particular instructional methods. The framework, however, reflects “research based” practice as required by the No Child Left Behind Act. The addition of the vocabulary component—one of the key elements of effective instruction identified by research—signals a movement in the field toward explicit teaching of basic reading skills.

Still, some officials said the development of the framework transcended the field’s historical debates over teaching methods and found a compromise among experts who subscribe to literature- and skills-based instructional approaches alike.

“Both constructivists and traditionalists came together in this framework,” said Denny Palmer Wolf, a board member and a researcher for the Annenberg Institute for School Reform, located in Providence, R.I. “This framework provides a much more precise instrument … for measuring students’ abilities to comprehend what they read in English.”

The 19-member steering committee included educators, researchers, and representatives from education organizations and publishers. The group worked well together to build consensus on the framework, despite a range of views on the best approaches to teaching reading, said Alan E. Farstrup, a committee member.

“It’s a very well-thought-out framework that builds on previous ones,” said Mr. Farstrup, the executive director of the International Reading Association in Newark, Del. “It does more with [skills-related] questions of vocabulary, for example, but still builds in a lot of very powerful open-ended response items.”

The new test would provide additional indicators of student performance. Separate results for the literary and informational questions, as well as for the vocabulary items, would provide more specific information on how students perform on different reading tasks.

Lost in the new test, however, would be the ability to compare student achievement from previous years. Since the board announced the plans for a new framework, which was drafted by the Washington-based American Institutes for Research, members have struggled to balance the need for change with the importance of maintaining trend data.

Some experts lament the loss of the trend information, but acknowledge the practical need for doing so. A different test, the so-called long-term trend NAEP in the subject, will still be given annually, as it has been over the past 30 years.

“It would be silly to restrict the test in order to continue the trend line,” said the IRA’s research director, Cathy Roller. “We need an assessment of what’s important today.”

Related Tags:

Events

Artificial Intelligence K-12 Essentials Forum How AI Use Is Expanding in K-12 Schools
Join this free virtual event to explore how AI technology is—and is not—improving K-12 teaching and learning.
Federal Webinar The Trump Budget and Schools: Subscriber Exclusive Quick Hit
EdWeek subscribers, join this 30-minute webinar to find out what the latest federal policy changes mean for K-12 education.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Curriculum Webinar
End Student Boredom: K-12 Publisher's Guide to 70% Engagement Boost
Calling all K-12 Publishers! Student engagement flatlining? Learn how to boost it by up to 70%.
Content provided by KITABOO

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Assessment Opinion Our Grading System Was Setting Students Up to Fail—Until This Change
Our first reaction to standards-based grading was despair. Then, slowly, things began to change.
Matthew Ebert
5 min read
A student climbs up stairs as letter grades fall around her. In the background a teacher is grading a test.
Vanessa Solis/Education Week via Canva
Assessment In Case You Missed It: How Schools Are Measuring Student Success
Explore stories about grading practices, what truly reflects student achievement, and more.
5 min read
Grading and assessment SR
Robert Neubecker for Education Week
Assessment Quiz Quiz Yourself: How Much Do You Know About Standardized Testing & Improving Student Outcomes?
Answer 7 questions about improving standardized testing and student outcomes.
Assessment Fewer Subjects, Students, Data Points: Feds to Scale Back NAEP
Some 4th and 12th grade tests won't proceed as planned, following sweeping cuts to the U.S. Department of Education research arm last month.
5 min read
Evaluate Score, Forecast, Businessman Holding Telescope on Performance Measure
iStock/Getty