Reading & Literacy

Fed Officials Defend ‘Rigorous’ Reading Study

November 21, 2008 1 min read
  • Save to favorites
  • Print

When the interim report of the Reading First Impact Study came out in May, there was an uproar from fans of the federal program who said the methodology was seriously flawed. As I reported here, they cited the likely “contamination” of the comparison schools, meaning that even though they didn’t receive the grant money they were implementing many of the same policies and practices as participating schools. Given that many of the RF and non-RF schools were potentially benefiting from the same professional development, instructional materials, and practices, the critics argued, it would be surprising if the evaluation found much of a difference in achievement among the students.

With the release of the final impact study this week, the same argument is being made to temper the disappointing findings. But during the media briefing held Tuesday to explain all the findings to reporters, IES director Russ Whitehurst, and project director Beth Gamse, made a point of stressing the quality of the study.

“The study fulfills the legistlative mandate for a rigorous, scientifically valid and quantitative evaluation of Reading First,” Gamse said. The “quite large” sample of more than 30,000 students, “makes this one of the largest and also one of the most methodologically rigorous studies that this department has ever undertaken.”

Whitehurst said that contamination is a non-issue, given that the classroom observations and surveys show that reading instruction in the classrooms in RF schools is significantly different than in the comparison schools.

Even without this complication, however, neither group turned in a particularly stellar performance. There was no significant improvement in the scale scores, or in the percentage of students meeting proficiency, in 2nd or 3rd grades between 2005 and 2007, for either the RF or non-RF schools.

A version of this news article first appeared in the Curriculum Matters blog.


Special Education Webinar Reading, Dyslexia, and Equity: Best Practices for Addressing a Threefold Challenge
Learn about proven strategies for instruction and intervention that support students with dyslexia.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Personalized Learning Webinar
No Time to Waste: Individualized Instruction Will Drive Change
Targeted support and intervention can boost student achievement. Join us to explore tutoring’s role in accelerating the turnaround. 
Content provided by Varsity Tutors for Schools
Student Well-Being K-12 Essentials Forum Social-Emotional Learning: Making It Meaningful
Join us for this event with educators and experts on the damage the pandemic did to academic and social and emotional well-being.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Reading & Literacy Nation's Second-Largest School System Plans to 'Embrace' the Science of Reading
Los Angeles Superintendent Alberto Carvalho's remarks also echo New York leaders' promises to support an early-reading overhaul.
3 min read
Alberto Carvalho, Superintendent, Los Angeles Unified School District, the nation's second-largest school district, comments on an external cyberattack on the LAUSD information systems during the Labor Day weekend, at a news conference in Los Angeles Tuesday, Sept. 6, 2022. Despite the ransomware attack, schools in the nation's second-largest district opened as usual Tuesday morning.
Alberto Carvalho, who leads the Los Angeles Unified School District, the nation's second-largest school district, speaks at a news conference in Los Angeles on Sept. 6, 2022.
Damian Dovarganes/AP
Reading & Literacy As Revised Lucy Calkins Curriculum Launches, Educators Debate If Changes Are Sufficient
Researchers and educators who have reviewed excerpts offer mixed reviews on their potential to shift classroom instruction.
8 min read
Letters and a magnifying glass.