Opinion
Education Letter to the Editor

‘Statistical Noise’ Can Affect Child-Poverty Analysis

September 16, 2014 1 min read
  • Save to favorites
  • Print

To the Editor:

For decades, “free and reduced-price school lunch” data have served as the major—and often the only—measure of child poverty in educational research and evaluation. “Analysts Rethinking Popular Indicator of Child Poverty” notes important recent criticisms of the adequacy of these data. These criticisms include analytic challenges posed by patterns of program participation, program-eligibility changes, and so on.

As statisticians say, these data are “noisy.” While readily available, “school lunch” data, based on eligibility and program participation, are at best a crude measure of poverty and disadvantage because students are merely “eligible” or not. And factors affecting participation mean that the data also include large amounts of random and nonrandom error due to social forces, program implementation, and so on.

Your article fails to note that the more random error in a measure, the smaller any real effects will appear to be in analyses. Even in well-designed studies, statistical noise can lead to underestimates of the impacts of child poverty on teaching and learning.

We now have decades of educational research and program evaluations built on school lunch data that often report findings of little or no significant effect. Because of their reliance on crude measures of key variables—such as child poverty—it is hard to know whether such findings are real or just statistical noise.

Good measurement matters. We must do better.

Danièle Rodamar

Associate Professor

World Languages and Culture

American University

Washington, D.C.

A version of this article appeared in the September 17, 2014 edition of Education Week as ‘Statistical Noise’ Can Affect Child-Poverty Analysis

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Law & Courts Webinar
Future of the First Amendment:Exploring Trends in High School Students’ Views of Free Speech
Learn how educators are navigating student free speech issues and addressing controversial topics like gender and race in the classroom.
Content provided by The John S. and James L. Knight Foundation
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
Start Strong With Solid SEL Implementation: Success Strategies for the New School Year
Join Satchel Pulse to learn why implementing a solid SEL program at the beginning of the year will deliver maximum impact to your students.
Content provided by Satchel Pulse
Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education Briefly Stated: June 8, 2022
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education Briefly Stated: June 1, 2022
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education Briefly Stated: May 11, 2022
Here's a look at some recent Education Week articles you may have missed.
9 min read
Education Briefly Stated: April 27, 2022
Here's a look at some recent Education Week articles you may have missed.
9 min read