Opinion
Education Letter to the Editor

‘Reading First’ Story Shows Limits of Using Isolated Data

January 29, 2008 1 min read
  • Save to favorites
  • Print

To the Editor:

Your front-page article “Massive Funding Cuts to ‘Reading First’ Generate Worries for Struggling Schools” (Jan. 16, 2008) includes a discussion of the David Hill Elementary School in the Hillsboro district in Oregon. According to Hillsboro administrators, David Hill “more than doubled the proportion of its 3rd graders meeting state benchmarks—to 76 percent—from 2003 to 2005,” an improvement attributed to the Reading First program, which was implemented at the school in the fall of 2003.

The picture looks different when we consider more data. From the Oregon Department of Education’s Web site, here are the percentages of 3rd graders at David Hill meeting or exceeding grade-level achievement since the 2000-01 school year: in 2000-01, 82 percent (or 18 of 22 students); 2001-02, 65 percent (17 of 26); 2002-03, 33 percent (14 of 42); 2003-04, 79 percent (34 of 43); 2004-05, 73 percent (32 of 44); 2005-06, 67 percent (35 of 52); and 2006-07, 67 percent (24 of 36).

The number of children under discussion is quite small, a range of from 22 to 52. Also, scores are very similar over the years, except for an unusually low score in 2002-03, the year just before Reading First was introduced. They were not low before this.

In other words, the claim that Reading First worked is based on the scores of a few children on one test. If 14 more children had reached the benchmark in 2002-03, it would have looked just like the other years. We cannot judge the efficacy of a program on the basis of the scores of 14 children on one test.

A colleague alerted me to the presence of the pre-2003 data and has pointed out that data could be misused to argue against Reading First: The percentage of David Hill students meeting or exceeding the benchmark has declined almost steadily since 2003-04. Should we conclude, then, that the longer a school uses Reading First, the less effective it is? Clearly, the sample sizes are much too small to arrive at such a conclusion. And clearly, we need to look at more than a few isolated percentages to come to conclusions about the effectiveness of programs.

Stephen Krashen

Professor Emeritus

Rossier School of Education

University of Southern California

Los Angeles, Calif.

A version of this article appeared in the January 30, 2008 edition of Education Week as ‘Reading First’ Story Shows Limits of Using Isolated Data

Events

Teaching Profession K-12 Essentials Forum New Insights Into the Teaching Profession
Join this free virtual event to get exclusive insights from Education Week's State of Teaching project.
Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and K-12 education jubs at the EdWeek Top School Jobs virtual career fair.
Mathematics K-12 Essentials Forum Helping Students Succeed in Math

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education Quiz What is a Project 2025 Author Doing at the Education Department? Take This Weekly Quiz
Test your knowledge on the latest news and trends in education.
1 min read
Education Briefly Stated: June 11, 2025
Here's a look at some recent Education Week articles you may have missed.
5 min read
Education Quiz What Is the #1 Factor Boosting Students' STEM Motivation? Take This Weekly Quiz
Test your knowledge on the latest news and trends in education.
1 min read
Education Briefly Stated: June 4, 2025
Here's a look at some recent Education Week articles you may have missed.
8 min read