Opinion
Education Letter to the Editor

‘Reading First’ Story Shows Limits of Using Isolated Data

January 29, 2008 1 min read
  • Save to favorites
  • Print

To the Editor:

Your front-page article “Massive Funding Cuts to ‘Reading First’ Generate Worries for Struggling Schools” (Jan. 16, 2008) includes a discussion of the David Hill Elementary School in the Hillsboro district in Oregon. According to Hillsboro administrators, David Hill “more than doubled the proportion of its 3rd graders meeting state benchmarks—to 76 percent—from 2003 to 2005,” an improvement attributed to the Reading First program, which was implemented at the school in the fall of 2003.

The picture looks different when we consider more data. From the Oregon Department of Education’s Web site, here are the percentages of 3rd graders at David Hill meeting or exceeding grade-level achievement since the 2000-01 school year: in 2000-01, 82 percent (or 18 of 22 students); 2001-02, 65 percent (17 of 26); 2002-03, 33 percent (14 of 42); 2003-04, 79 percent (34 of 43); 2004-05, 73 percent (32 of 44); 2005-06, 67 percent (35 of 52); and 2006-07, 67 percent (24 of 36).

The number of children under discussion is quite small, a range of from 22 to 52. Also, scores are very similar over the years, except for an unusually low score in 2002-03, the year just before Reading First was introduced. They were not low before this.

In other words, the claim that Reading First worked is based on the scores of a few children on one test. If 14 more children had reached the benchmark in 2002-03, it would have looked just like the other years. We cannot judge the efficacy of a program on the basis of the scores of 14 children on one test.

A colleague alerted me to the presence of the pre-2003 data and has pointed out that data could be misused to argue against Reading First: The percentage of David Hill students meeting or exceeding the benchmark has declined almost steadily since 2003-04. Should we conclude, then, that the longer a school uses Reading First, the less effective it is? Clearly, the sample sizes are much too small to arrive at such a conclusion. And clearly, we need to look at more than a few isolated percentages to come to conclusions about the effectiveness of programs.

Stephen Krashen

Professor Emeritus

Rossier School of Education

University of Southern California

Los Angeles, Calif.

A version of this article appeared in the January 30, 2008 edition of Education Week as ‘Reading First’ Story Shows Limits of Using Isolated Data

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Mathematics Webinar
Pave the Path to Excellence in Math
Empower your students' math journey with Sue O'Connell, author of “Math in Practice” and “Navigating Numeracy.”
Content provided by hand2mind
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Recruitment & Retention Webinar
Combatting Teacher Shortages: Strategies for Classroom Balance and Learning Success
Learn from leaders in education as they share insights and strategies to support teachers and students.
Content provided by DreamBox Learning
Classroom Technology K-12 Essentials Forum Reading Instruction and AI: New Strategies for the Big Education Challenges of Our Time
Join the conversation as experts in the field explore these instructional pain points and offer game-changing guidance for K-12 leaders and educators.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education Briefly Stated: September 20, 2023
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education From Our Research Center What's on the Minds of Educators, in Charts
Politics, gender equity, and technology—how teachers and administrators say these issues are affecting the field.
1 min read
Stylized illustration of a pie chart
Traci Daberko for Education Week
Education Briefly Stated: August 30, 2023
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education Briefly Stated: August 23, 2023
Here's a look at some recent Education Week articles you may have missed.
9 min read