School & District Management Federal File

Statistical Errors?

By Debra Viadero — January 30, 2007 2 min read
  • Save to favorites
  • Print

Research advisory panel splits over NCES studies of cause and effect

The fallout over a pair of controversial studies released last year by the Department of Education’s chief statistics branch raged on last week when a national research advisory board met in Washington.

The studies—one comparing student achievement in public and private schools, and the other comparing achievement in charter schools with that of regular public schools—caused an uproar last year when they were published by the National Center for Education Statistics. That’s in part because the reports had made statistical adjustments to account for socioeconomic differences between the comparison groups.

Critics, including some top Education Department officials, said the analyses overstepped the NCES’ mission as a purely statistics-gathering agency and jeopardized its credibility.

Among the critics was the congressionally mandated National Board for Education Sciences, the panel that met last week. In September, the board approved a resolution recommending that the NCES refrain from commissioning or publishing studies that “purport” to explore the causal effects of policies. (“‘Physics First’ Is Moving Slowly Into Nation’s High Schools,” Sept. 6, 2006.)

At the board’s Jan. 23-24 meeting, though, the two board members who spearheaded the original resolution said the wording didn’t go far enough. Arguing that the earlier language failed to capture their intent, Eric A. Hanushek and Caroline M. Hoxby, both prominent economists, put forth a new proposal to delete the word “purport” and recommend instead that the NCES avoid studies “that could reasonably be interpreted” to be analyzing policy effects.

Mr. Hanushek, a senior fellow at Stanford University’s Hoover Institution, said the broader terms were needed because the reports had not purported to be cause-and-effect studies, either. They each carried disclaimers cautioning against reading too much into their findings, yet the results were widely misinterpreted to mean that charter schools, or private schools, didn’t work.

The new proposal drew a heated response from Mark S. Schneider, the NCES commissioner and a critic himself of the much-debated reports, which were commissioned before his watch. He said the new proposal was too open to interpretation and ran counter to the federal law prescribing his agency’s mission.

“We’re trying to fix something we all agree was a mistake,” he argued. The board narrowly agreed, voting 6-5 to scratch the new proposal.

Related Tags:

A version of this article appeared in the January 31, 2007 edition of Education Week


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Professional Development Webinar
Strategies for Improving Student Outcomes with Teacher-Student Relationships
Explore strategies for strengthening teacher-student relationships and hear how districts are putting these methods into practice to support positive student outcomes.
Content provided by Panorama Education
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Classroom Technology Webinar
Transform Teaching and Learning with AI
Increase productivity and support innovative teaching with AI in the classroom.
Content provided by Promethean
Curriculum Webinar Computer Science Education Movement Gathers Momentum. How Should Schools React?
Discover how schools can expand opportunities for students to study computer science education.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management How District Leaders Can Make Sure Teachers Don't Miss the Loan-Forgiveness Deadline
Many teachers and other public employees may not know they qualify for a student loan-forgiveness waiver that has an Oct. 31 deadline.
4 min read
Young adult woman cutting the ball and chain labeled "Debt" which is attached as the tassel hanging from a graduate's mortarboard
iStock/Getty Images Plus
School & District Management Download A Visual Guide to Nonverbal Communication (Download)
Understanding nonverbal communication can help you improve interactions and get your message across.
1 min read
v42 8SR Nonverbal Communication Share Image
Gina Tomko/Education Week and Getty
School & District Management Ensure Your Staff Gets the Message: 3 Tips for School Leaders
School staff are inundated with information. Here's a few ways to ensure they will actually hear you.
3 min read
Image showing a female and male in business attire connecting speech bubble puzzle pieces.
iStock/Getty Images Plus
School & District Management Keep School Staff Motivated All Year Long: Advice From Principals
Here are some of the things—big and small—that school leaders do and say to keep teachers excited about the job.
13 min read
Teachers and faculty play a game of Kahoot! to get to know one another better during a Welcome Back training at CICS Bucktown on Monday, Aug. 15, 2022 in Chicago, Ill.
Teachers and faculty play a game to get to know one another better during a Welcome Back training at Chicago's CICS Bucktown in August.
Taylor Glascock for Education Week