Reading & Literacy

Reading Results Hard to Translate, Panel Concludes

By Kathleen Kennedy Manzo — August 23, 2007 | Corrected: February 22, 2019 3 min read
  • Save to favorites
  • Print

Corrected: An earlier version of this story misidentified one state receiving targeted-assistance grants.

State-by-state data on the federal Reading First program were released with fanfare this past spring by the U.S. Department of Education as evidence that the initiative was fueling “tremendous progress” among students and teachers. The Reading First Advisory Committee, a federal panel that met for the first time here last week, found that information on student achievement in participating schools far less definitive and has asked for more time and technical assistance in evaluating the data from the $1 billion-a-year program.

“It seems like there are no standards anyone can interpret,” said committee member Frank R. Vellutino, a prominent reading researcher from the State University of New York at Albany.

He was referring to the variations among states in the assessments used to gauge students’ reading skills, as well as differences in cutoff scores used to determine whether children are on track toward becoming “proficient” readers.

See Also

Read more stories on the Reading First program.

“It’s going to be a job and a half to come to any conclusion whether states are meeting their responsibilities” in improving achievement in Reading First schools, Mr. Vellutino said.

The committee was given a thick binder filled with test-score data from grantees, which states must submit to the department each year. The information is based on the assessments and proficiency benchmarks set by each state as part of its Reading First plan.

Some Results ‘Impressive’

Members assigned to a subcommittee to review the information more closely described some of the data as “impressive.” But they also questioned whether the goals set by each state are appropriate, particularly those states that appear to have low expectations for student proficiency.

“I’ve never seen any test where 40 percent was considered proficient,” said Susan Brady, an early- reading expert at the University of Rhode Island and Haskins Laboratory in New Haven, Conn. “One needs to scrutinize what these levels are and what are the skills behind these cut scores.”

Advisory Committee Members

● Laurie Cutting
Kennedy Krieger Institute

● Maria Carlo
University of Miami

● Fred Morrison
University of Michigan

● Donna Scanlon
State University of New York at Albany

● Frank Vellutino
State University of New York at Albany

● Nonie K. Lesaux
Harvard University

● Kris Gutierrez
University of California, Los Angeles

● Annemarie Sullivan Palincsar
University of Michigan

● Charles Perfetti
University of Pittsburgh

● Katherine Mitchell
Alabama Department of Education

● John Lloyd
University of Virginia

● Susan Brady
University of Rhode Island

SOURCE: U.S. Department of Education

In measuring fluency, many states are consistent. Nearly 40 of the 54 states and other jurisdictions, for example, use the same test and cutoff score. But there are more differences in how states gauge comprehension skills. Arkansas and Idaho, for example, set proficiency at the 40th percentile on the Iowa Tests of Basic Skills. Other states, such as Georgia and Michigan, define the 50th percentile as proficient.

The data include test results for 1st through 3rd graders from 2002 to 2006. Results are broken down into subgroups by race and socioeconomic status, as well as for English-language learners and students with disabilities. The committee, which met Aug. 20-22, has asked the Education Department to assign a statistician to the task of reviewing the data and suggesting ways to analyze the information and compare results across states.

A more rigorous analysis of student achievement in participating schools commissioned by the department’s Institute of Education Sciences, is under way, and results are expected later this year.

Reading First came under scrutiny by federal auditors after complaints from several commercial vendors that federal officials and consultants favored particular reading textbooks, assessments, and approaches over others and directed states to use certain products, a level of federal prescriptiveness that the NCLB law prohibits.

Puerto Rico Grant Review

Secretary of Education Margaret Spellings formed the advisory committee to review ongoing issues in the program. The committee will make recommendations to the department, but they are not binding.

The panel also recommended that Puerto Rico make additional changes to its grant proposal. The self-governing U.S. territory is the last eligible jurisdiction still awaiting its grant award under the program, which was designed to improve reading instruction in the United States’ most disadvantaged school districts.

Puerto Rico’s latest proposal for its $35.6 million Reading First grant has been revised about a dozen times. An earlier version was approved in 2003, but allocation of the funding was held up when new leaders of Puerto Rico’s school system rejected some of the tenets of the plan. (“Puerto Rico Still Has No Reading First Funds,” Nov. 30, 2005.)

A version of this article appeared in the August 29, 2007 edition of Education Week

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
College & Workforce Readiness Webinar
From Student Trends to Counselor Action: Turning Insight Into Impact
Find out what is changing in how students approach planning for life after graduation and how schools can help.
Content provided by PowerSchool
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
McKinney-Vento Transportation Strategies: Managing Cost & Protecting Access
Explore McKinney-Vento transportation strategies to manage costs, respond quickly to changing needs, and protect student access.
Content provided by HopSkipDrive
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Families & the Community Webinar
Celebrate Family Engagement Day With Strategies That Work
Join National PTA and AASA to explore practical systems-wide family engagement strategies in celebration of National Family Engagement Day.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Reading & Literacy How Should States Evaluate Reading Curricula? Debate in California Heats Up
Groups say California's proposed list doesn’t give districts enough information to make good choices.
6 min read
Kristen Koeller, a reading specialist in San Jose , teaches a phonics program to other teachers in San Jose, Calif. , on Thursday, Aug. 7, 2025.
Reading specialist Kristen Koeller teaches a phonics program to other teachers in San Jose, Calif., on Aug. 7, 2025. The state's list of approved reading programs, created in response to science of reading legislation passed last year, has come under fire from groups that say it doesn't give districts enough detail to make informed choices.
Shae Hammond/Bay Area News Group via TNS
Reading & Literacy Students Don’t Read for Fun. Here’s How to Change That
Three strategies to get students to read more.
4 min read
Parents read through “Just Ask! Be Different, Be Brave, Be You” by Sonia Sotomayor and discuss engaging with students outside of the classroom during a community night hosted by Turning the Page at Lee Montessori-East End in Washington, D.C., on Thursday, Oct. 15, 2026.
Parents read through “Just Ask! Be Different, Be Brave, Be You” by Sonia Sotomayor during a community night hosted by Turning the Page at Lee Montessori-East End in Washington, D.C., on Oct. 15, 2026. Schools are trying new tactics to encourage students to read for pleasure.
Eric Lee for Education Week
Reading & Literacy How Much Time Should Elementary Teachers Spend Reading Aloud?
Research doesn't offer a prescription. But quality is more important than quantity, experts say.
5 min read
Kindergarten teacher Christin Labriola reads the book "Dumpling Soup" to her class, incorporating Asian American and Pacific Islander subjects in her class at Webster Hill Elementary School in West Hartford, Conn., on Dec. 2, 2025.
Kindergarten teacher Christin Labriola reads the book <i>Dumpling Soup</i> to her class at Webster Hill Elementary School in West Hartford, Conn., on Dec. 2, 2025. It's important for teachers to engage students in conversation about the books they use for read-alouds, researchers say.
Jessica Hill/AP
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Reading & Literacy Whitepaper
Joy, Efficacy, and the Science of Reading for Secondary Students
Discover how research-informed literacy practices can foster joy, build on students’ strengths, and help adolescents become more confiden...
Content provided by Students Achievement Partners