Opinion
Education Letter to the Editor

‘Reading First’ Story Shows Limits of Using Isolated Data

January 29, 2008 1 min read
  • Save to favorites
  • Print

To the Editor:

Your front-page article “Massive Funding Cuts to ‘Reading First’ Generate Worries for Struggling Schools” (Jan. 16, 2008) includes a discussion of the David Hill Elementary School in the Hillsboro district in Oregon. According to Hillsboro administrators, David Hill “more than doubled the proportion of its 3rd graders meeting state benchmarks—to 76 percent—from 2003 to 2005,” an improvement attributed to the Reading First program, which was implemented at the school in the fall of 2003.

The picture looks different when we consider more data. From the Oregon Department of Education’s Web site, here are the percentages of 3rd graders at David Hill meeting or exceeding grade-level achievement since the 2000-01 school year: in 2000-01, 82 percent (or 18 of 22 students); 2001-02, 65 percent (17 of 26); 2002-03, 33 percent (14 of 42); 2003-04, 79 percent (34 of 43); 2004-05, 73 percent (32 of 44); 2005-06, 67 percent (35 of 52); and 2006-07, 67 percent (24 of 36).

The number of children under discussion is quite small, a range of from 22 to 52. Also, scores are very similar over the years, except for an unusually low score in 2002-03, the year just before Reading First was introduced. They were not low before this.

In other words, the claim that Reading First worked is based on the scores of a few children on one test. If 14 more children had reached the benchmark in 2002-03, it would have looked just like the other years. We cannot judge the efficacy of a program on the basis of the scores of 14 children on one test.

A colleague alerted me to the presence of the pre-2003 data and has pointed out that data could be misused to argue against Reading First: The percentage of David Hill students meeting or exceeding the benchmark has declined almost steadily since 2003-04. Should we conclude, then, that the longer a school uses Reading First, the less effective it is? Clearly, the sample sizes are much too small to arrive at such a conclusion. And clearly, we need to look at more than a few isolated percentages to come to conclusions about the effectiveness of programs.

Stephen Krashen

Professor Emeritus

Rossier School of Education

University of Southern California

Los Angeles, Calif.

A version of this article appeared in the January 30, 2008 edition of Education Week as ‘Reading First’ Story Shows Limits of Using Isolated Data

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Data Webinar
Working Smarter, Not Harder with Data
There is a new paradigm shift in K-12 education. Technology and data have leapt forward, advancing in ways that allow educators to better support students while also maximizing their most precious resource – time. The
Content provided by PowerSchool
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
Deepen the Reach and Impact of Your Leadership
This webinar offers new and veteran leaders a unique opportunity to listen and interact with four of the most influential educational thinkers in North America. With their expert insights, you will learn the key elements
Content provided by Solution Tree
Science K-12 Essentials Forum Teaching Science Today: Challenges and Solutions
Join this event which will tackle handling controversy in the classroom, and making science education relevant for all students.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education Briefly Stated: January 12, 2022
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education School Bus Driver Retires After 48 Years Behind Wheel
Charles City school bus driver Betty Flick sat behind the wheel for the final time last week, wrapping up a 48-year career for the district.
3 min read
Charles City school bus driver Betty Flick poses with one of her farewell signs. Flick has been driving for Charles City School District for 48 years.
Betty Flick quickly fell in love with the job and with the kids, which is what has had her stay in the district for this long.
Courtesy of Abby Koch/Globe Gazette
Education Briefly Stated: December 1, 2021
Here's a look at some recent Education Week articles you may have missed.
9 min read
Education Briefly Stated: November 17, 2021
Here's a look at some recent Education Week articles you may have missed.
8 min read