School & District Management Federal File

Statistical Errors?

By Debra Viadero — January 30, 2007 2 min read
  • Save to favorites
  • Print

Research advisory panel splits over NCES studies of cause and effect

The fallout over a pair of controversial studies released last year by the Department of Education’s chief statistics branch raged on last week when a national research advisory board met in Washington.

The studies—one comparing student achievement in public and private schools, and the other comparing achievement in charter schools with that of regular public schools—caused an uproar last year when they were published by the National Center for Education Statistics. That’s in part because the reports had made statistical adjustments to account for socioeconomic differences between the comparison groups.

Critics, including some top Education Department officials, said the analyses overstepped the NCES’ mission as a purely statistics-gathering agency and jeopardized its credibility.

Among the critics was the congressionally mandated National Board for Education Sciences, the panel that met last week. In September, the board approved a resolution recommending that the NCES refrain from commissioning or publishing studies that “purport” to explore the causal effects of policies. (“‘Physics First’ Is Moving Slowly Into Nation’s High Schools,” Sept. 6, 2006.)

At the board’s Jan. 23-24 meeting, though, the two board members who spearheaded the original resolution said the wording didn’t go far enough. Arguing that the earlier language failed to capture their intent, Eric A. Hanushek and Caroline M. Hoxby, both prominent economists, put forth a new proposal to delete the word “purport” and recommend instead that the NCES avoid studies “that could reasonably be interpreted” to be analyzing policy effects.

Mr. Hanushek, a senior fellow at Stanford University’s Hoover Institution, said the broader terms were needed because the reports had not purported to be cause-and-effect studies, either. They each carried disclaimers cautioning against reading too much into their findings, yet the results were widely misinterpreted to mean that charter schools, or private schools, didn’t work.

The new proposal drew a heated response from Mark S. Schneider, the NCES commissioner and a critic himself of the much-debated reports, which were commissioned before his watch. He said the new proposal was too open to interpretation and ran counter to the federal law prescribing his agency’s mission.

“We’re trying to fix something we all agree was a mistake,” he argued. The board narrowly agreed, voting 6-5 to scratch the new proposal.

Related Tags:

A version of this article appeared in the January 31, 2007 edition of Education Week

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Reading & Literacy Webinar
The Future of the Science of Reading
Join us for a discussion on the future of the Science of Reading and how to support every student’s path to literacy.
Content provided by HMH
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
College & Workforce Readiness Webinar
From Classrooms to Careers: How Schools and Districts Can Prepare Students for a Changing Workforce
Real careers start in school. Learn how Alton High built student-centered, job-aligned pathways.
Content provided by TNTP
Mathematics K-12 Essentials Forum Helping Students Succeed in Math

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management Worried About Withheld Education Funding? Here's How Leaders Can Speak Up
Education leaders must communicate the consequences of withheld K-12 funding to Congress and their own communities.
6 min read
Superintendents Dr. Alex Marrero, Alberto Carvalho, and Joe Gothard
Denver Superintendent Alex Marrero, left, Madison Superintendent Joe Gothard, and Los Angeles Superintendent Alberto Carvalho are among district leaders who've pushed for the release of withheld federal K-12 funding. The three have also sought to explain the consequences to their own communities.
David Zalubowski/AP, Andy Clayton-King/AP, Anthony Behar/AP
School & District Management Opinion ‘You’re Woke’: A Former Superintendent Responds to Intense Backlash
My critics hurled “woke” at me like a verbal grenade—but we need education leaders who are wide awake.
Robert Sokolowski
4 min read
Diverse group of multiethnic multicultural people silhouette. The weaponization of woke.
iStock/Getty Images
School & District Management Women, People of Color Still Underrepresented in Superintendent Ranks
Superintendents are getting younger, earning slightly more, and working longer hours, yet their pay still lags behind inflation, AASA found.
4 min read
Illustration of a Black woman professional carrying a briefcase and dressed in red and walking alongside an oversized male dressed in blue pants with his white hand also carrying a briefcase.
DigitalVision Vectors/Getty
School & District Management Why These K-12 Administrators Left Education—and What They Did Next
What do a nurse, an emergency responder, and an AI expert have in common? They used to work in schools.
7 min read
11 people walk through a large, dark room towards the exit door, which lights up the scene in a dramatic way. People carry boxes and various bags, indicating that they are relocating or have been laid off from work. Vector illustration.
DigitalVision Vectors