Assessment

NAEP Results Offer Scant Insight Into Best Reading Strategies

By Kathleen Kennedy Manzo — January 10, 2006 3 min read

As educators look for evidence of what works and what doesn’t in teaching reading to struggling students, it may be tempting to draw comparisons between the 11 big-city districts that took part in the 2005 National Assessment of Educational Progress.

But given their vast differences in demographics and instructional approaches, and their mostly incremental improvements in scores over the past few years, the data provide little insight, observers say, into which strategies are paying off.

See Also

Read the related story,

In North Carolina’s 120,000-student Charlotte-Mecklenburg district, where schools have been teaching a highly structured commercial reading program for fiveyears, 4th and 8th graders scored above the national average on the tests, as they did two years ago.

In Los Angeles, that same reading program helped the district improve overall scores by a few points since 2002. But the 747,000-student district, with a much larger proportion of English-language learners, still trails the national average by some 20 points, and scores fell slightly for Hispanic and black students there. Houston, with a similar approach to reading, saw slight improvement overall.

But New York City, the nation’s largest district with 1.1 million students, and Atlanta, the smallest to participate in the NAEP study with 51,000 students, stood alone in charting significantly higher scores, suggesting the districts’ less-structured and more holistic approaches are having an effect. In those cities, more students moved from the “below basic” performance level to “basic” at the 4th grade level.

Such a broader approach, however, did not help Chicago’s students to improve their scores overall. The Windy City’s 4th and 8th graders registered no significant improvement since the test was first administered in 2002.

“The data are not easily interpretable,” G. Michael Pressley, a reading researcher at Michigan State University in East Lansing, said in an e-mail. In general, “what works in the big cities is what works everywhere: intensive instruction more driven by the higher-order (e.g., comprehension, composition) than the lower-order skills, although instruction balanced to provide both the higher- and lower-order skills.”

Small Victories

The results, released last month, have drawn mixed reactions.

Many of the districts saw gains greater than those made statewide on NAEP, though most of the gains were not considered statistically significant and the students in all but two of the cities scored below the national average. And after directing unprecedented resources toward reading instruction in the early grades, officials were highlighting the positive, amid admittedly limited improvement.

In Chicago, for example, officials celebrated promising results for Hispanic 8th graders, who scored above the national average in reading and mathematics, while downplaying overall low scores. And district officials in Los Angeles and Houston said that a bump of a few points for 4th graders over the 2003 reading results, though not statistically significant, gave them greater confidence in the structured reading approaches they’ve instituted over the past several years, particularly given that schools there are serving large proportions of English-learners.

But critics lamented that the scores continued to stagnate and the achievement gaps between minority and white students persisted despite concentrated efforts to improve reading instruction.

“I’m surprised that the nation is not outraged by the lack of progress,” said Sheila Ford, a recently retired public school principal in the District of Columbia and a vice chairwoman of the board that sets policy for NAEP. “But I’m excited about some opportunities for growth. … In New York City, where they’ve been concentrating on strategies for reading comprehension, practicing reading, and explicit instruction on the reading-comprehension skills, they’ve elevated the achievement of children.”

New York City has tried to integrate a mix of those “higher-order” and “lower-order” strategies, including skills-based lessons, daily literature study, and writing activities, despite harsh criticism that the district should undertake a more stringent approach to building basic skills. The city’s 4th graders gained 7 points since 2002, and came within a few points of the national average.

Atlanta 4th graders improved 6 points in that span. A variety of instructional approaches are used in the city’s public schools, primarily integrating literature and a number of commercial textbooks.

Related Tags:

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Equity & Diversity Webinar
Culturally Relevant Pedagogy to Advance Educational Equity
Schools are welcoming students back into buildings for full-time in-person instruction in a few short weeks and now is the perfect time to take a hard look at both our practices and systems to build
Content provided by PowerMyLearning
Classroom Technology Webinar Making Big Technology Decisions: Advice for District Leaders, Principals, and Teachers
Educators at all levels make decisions that can have a huge impact on students. That’s especially true when it comes to the use of technology, which was activated like never before to help students learn
Professional Development Webinar Expand Digital Learning by Expanding Teacher Training
This discussion will examine how things have changed and offer guidance on smart, cost-effective ways to expand digital learning efforts and train teachers to maximize the use of new technologies for learning.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Assessment How Can Teachers Better Understand Students? A New Breed of Assessment Will Try to Help
Researchers will work to create formative assessments that can give teachers a window into students’ emerging identities and strengths
4 min read
In this Nov. 19, 2020, file photo, sixth-grade students listen to instruction in class at Cape Cod Lighthouse Charter School in East Harwich, Mass.
Researchers hope to create new assessments to help teachers gain deeper insights into the identities and strengths of their students, like these 6th graders at Cape Cod Lighthouse Charter School in East Harwich, Mass.
Elise Amendola/AP
Assessment Opinion It's Time We Begin Using Assessments to Look Forward, Instead of Back
Schools do not get much value from high-stakes tests. Many are now allowing schools to use better assessments to guide student learning.
Seth Feldman
5 min read
shutterstock 19525837
Shutterstock
Assessment Opinion Grading Has Always Been an Imperfect Exercise. COVID-19 Made It Worse
It’s hard reducing the complexity of each student’s social, emotional, and academic learning to a letter grade. Maybe we’re doing it wrong.
Lory Walker Peroff
4 min read
A student's grades are unknown
Robert Neubecker for Education Week
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Assessment Whitepaper
Facing the Future Together: Digital Innovative Solutions
Join us to discuss how digital innovative solutions can enrich the educational experience in the K-12 environment. We’ll share how these ...
Content provided by Pearson