Federal

ECS Removes Data on School Improvement

By David J. Hoff — April 12, 2005 4 min read
  • Save to favorites
  • Print

A prominent state education group has recalled an online report that presented the number and percentage of schools that states have identified as needing improvement under the No Child Left Behind Act.

Saying that journalists had used the data to make “unwarranted negative assessments” of the quality of states’ schools, the Education Commission of the States said in a widely distributed e-mail on March 31 that it had removed the six-page document from its Web site and wouldn’t distribute it further.

The document warned against judging states based on the number and percentage of schools failing to make adequate yearly progress, or AYP, under the federal law. But the disclaimer didn’t explain specifically that judging the quality of state school systems by comparing the data isn’t valid because each state sets its own AYP standards.

Though ECS officials said the data were accurate, they withdrew the report because of the way the information was being interpreted.

“What I felt was not there, was the correct interpretation of what [the numbers] meant,” Piedad F. Robertson, the president of the bipartisan, Denver-based clearinghouse on state education policies said in an interview last week.

‘Bottom-Feeder Ranking’

The incident is the latest example of the way newly accessible data are changing how the public views schools. It also demonstrates why state officials are wary of efforts that produce state-by-state data on student achievement.

Piedad F. Robertson, the president of the Education Commission of the States, said the media did not accurately represent recent data.

For example, a new Web site produced by Standard & Poor’s and state officials allows users to compare schools’ student-achievement data within their own states. That kind of comparison is valid, state officials say, because those schools administer the same tests and are expected to hold students to the same standards. (“Online Tools For Sizing Up Schools Debut,” March 30, 2005.)

But if the site’s users want to compare a state’s student achievement with another state’s, they are able to look only at scores on the National Assessment of Educational Progress and college-entrance exams—the only testing programs given in every state.

The ECS report, which was released online last month, documented the number and percentage of schools in every state that are in various stages of school improvement under the federal law. Those stages range from the mandate that schools in the first year of an improvement plan offer students a transfer to another public school, to the implementation of a state-approved school improvement plan in the fifth year.

The data were presented in a state-by-state table at the end of the report.

The report explained that the numbers and percentages of schools not making AYP vary between states because of a variety of differences in the ways states are implementing the 3-year-old law, a reauthorization of the Elementary and Secondary Education Act. It said states’ standards differ, as do the difficulty of their tests and their short-term goals for making adequate progress.

But some journalists glossed over such warnings in their reporting, ECS officials said.

In Hawaii, for example, the Honolulu Star-Bulletin ran a story headlined: “Isle Schools Fare the Worst.” The story highlighted the ECS report’s finding that 10 percent of Hawaii’s schools were in their fifth and last year of needing improvement—the highest percentage in the nation.

Hawaii has 28 of its 284 schools at that stage because it has set ambitious AYP targets, a state spokesman said. It was unfair to label the state’s schools as the worst in the nation because those schools might actually have higher student achievement than in states with lower AYP goals, said Greg Knudsen, the spokesman for the state department of education.

State-to-state comparisons of AYP numbers are unfair “because states have such different standards and different timetables,” Mr. Knudsen said.

In the only other news story cited by ECS officials, a March 29 story in the Arkansas Democrat-Gazette said Arkansas “has some of the highest percentages in the nation of public schools categorized as academically troubled.”

Two days later, an editorial said the report gives “Arkansas its usual, bottom-feeder ranking” on school quality.

The information collected does include worthwhile data, Mr. Knudsen of the Hawaii education department and Todd Ziebarth, the author of the report, agreed.

Useful Information

State officials could look at the number of schools each state is identifying as failing to achieve AYP, said Mr. Ziebarth, a policy analyst for Augenblick, Palaich and Associates, a Denver-based consulting firm that conducted the research for the ECS.

In doing so, he suggested, they can determine if they are labeling too many or too few schools as not reaching their goals. He said states also could find other states that have had experience with the interventions available for schools needing help, such as restructuring of those schools’ programs and staffs. “It helps to provoke states to think about how their system compares to others,” he said.

But Ms. Robertson said that while such information is useful, the ECS plans to produce reports that highlight states’ progress in complying with the law.

“What we need to concentrate on is working with every individual state,” said Ms. Robertson, a former president of Santa Monica College near Los Angeles who became president of the ECS Feb. 1.

Events

Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
Ed-Tech Policy Webinar Artificial Intelligence in Practice: Building a Roadmap for AI Use in Schools
AI in education: game-changer or classroom chaos? Join our webinar & learn how to navigate this evolving tech responsibly.
Education Webinar Developing and Executing Impactful Research Campaigns to Fuel Your Ed Marketing Strategy 
Develop impactful research campaigns to fuel your marketing. Join the EdWeek Research Center for a webinar with actionable take-aways for companies who sell to K-12 districts.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Federal Biden Calls for Teacher Pay Raises, Expanded Pre-K in State of the Union
President Joe Biden highlighted a number of his education priorities in a high-stakes speech as he seeks a second term.
5 min read
President Joe Biden delivers the State of the Union address to a joint session of Congress at the Capitol on March 7, 2024, in Washington.
President Joe Biden delivers the State of the Union address to a joint session of Congress at the Capitol on March 7, 2024, in Washington.
Shawn Thew/Pool via AP
Federal Low-Performing Schools Are Left to Languish by Districts and States, Watchdog Finds
Fewer than half of district plans for improving struggling schools meet bare minimum requirements.
11 min read
A group of silhouettes looks across a grid with a public school on the other side.
Vanessa Solis/Education Week via Canva
Federal Biden Admin. Says New K-12 Agenda Tackles Absenteeism, Tutoring, Extended Learning
The White House unveiled a set of K-12 priorities at the start of an election year.
4 min read
U.S. Education Secretary Miguel Cardona participates in a roundtable discussion with students from Dartmouth College on Jan. 10, 2024, on the school's campus, in Hanover, N.H.
U.S. Education Secretary Miguel Cardona participates in a roundtable discussion with students from Dartmouth College on Jan. 10, 2024, on the school's campus, in Hanover, N.H.
Steven Senne/AP
Federal Lawmakers Want to Reauthorize a Major Education Research Law. What Stands in the Way?
Lawmakers have tried and failed to reauthorize the Education Sciences Reform Act over the past nearly two decades.
7 min read
Sen. Bill Cassidy, R-La., left, joins Senate Health, Education, Labor and Pensions Committee Chairman Bernie Sanders, I-Vt., left, as Starbucks founder Howard Schultz answers questions about the company's actions during an ongoing employee unionizing campaign, at the Capitol in Washington, on March 29, 2023.
Sen. Bill Cassidy, R-La., left, joins Senate Health, Education, Labor and Pensions Committee Chairman Bernie Sanders, I-Vt., left, at the Capitol in Washington, on March 29, 2023. The two lawmakers sponsored a bill to reauthorize the Education Sciences Reform Act.
J. Scott Applewhite/AP