Assessment

New Student-Poverty Measures Proposed for National Tests

By Sarah D. Sparks — December 11, 2012 5 min read
  • Save to favorites
  • Print

Aiming to get a clearer picture of how students’ home and community resources affect their academic achievement, America’s best-known K-12 education barometer, the National Assessment of Educational Progress, is building a comprehensive new way to gauge socioeconomic status.

The new measure, being developed by the National Assessment Governing Board and the National Center for Education Statistics, is intended to look beyond a traditional measure of family income to a child’s family, community, and school supports for learning.

“This issue has just been on the burner for so, so long,” said Maria V. Ferguson, the executive director of the Washington-based Center on Education Policy. “When NAGB starts talking about it, that does elevate it to a place where it could be part of a bigger policy debate,” she said. “I wonder if the folks at NAGB are hoping this could be an opening salvo into a bigger conversation about how [different SES measures] might affect other programs.”

The governing board commissioned eight researchers in education, economics, statistics, human development, and sociology that have been working on the new indicators since 2010. The panel released its initial proposal at a NAGB meeting here Nov. 29.

“We rapidly learned that socioeconomic status contains multiple dimensions and categories that don’t neatly collapse back to ‘low’ versus ‘high,’ ” said Charles D. Cowan, the chief executive officer of the San Antonio-based research group Analytic Focus and a member of the governing board’s expert panel. “Over the last 10 to 15 years, there’s been an explosion in the data available” on student characteristics, Mr. Cowan said. “Perhaps now is the time to think about alternative measures of SES simply because now we are able to think about it.”

Beyond Free Lunch

Socioeconomic Status Reconsidered

The National Assessment Governing Board is considering a new method of identifying a student’s socioeconomic status when disaggregating the results of the National Assessment of Educational Progress. NAEP researchers now rely primarily on a student’s eligibility for the National School Lunch Program—which as of 2011 provided free or low-cost meals to more than 31 million students in poverty each day—as a proxy for socioeconomic status. This traditional indicator is bolstered by background questions on home possessions, such as washing machines, encyclopedias, and mobile phones.

Proposed New “Core” SES Indicators

• Family income and indicators of home possessions and that have been shown to be linked to educational access, such as Internet availability and number of books in the home
• Parents’ educational attainment
• Parents’ occupational status

Potential “Expanded” SES Indicators

Family: For example, family structure, stability, and the presence of extended family and other supportive adults
Neighborhood: Including the concentration of poverty or linguistic isolation, the percentage of unemployed adults, and the availability of museums, parks, or safe walking routes
School: The aggregate SES composition of students at the school the child attends, as distinct from the neighborhood SES level

Potential Additional Context Indicators

Physical stressors: Local rates of illness or environmental problems
Psychological stressors: Levels of crime in the school and community
Psychological protectors: Student perception of parent involvement and expectations

SOURCE: National Assessment Governing Board

For decades, the universal proxy for students’ socioeconomic status—for NAEP and nearly every federal education and child-health program—has been just such a high-low indicator: eligibility for subsidized meals under the National School Lunch Program.

Federal food aid does capture a huge swath of students in poverty: The school lunch program alone provides meals for more than 31 million children, at reduced cost to those living at or below 185 percent of the federal poverty line, and free to those who are at or below 130 percent of the poverty line or who are homeless, in foster care, or in certain other programs. In 2012 in the lower 48 states and the District of Columbia, children living in a family of four on $40,000 or less a year would be eligible for reduced price meals; the free-lunch cut-off for the same family would be $30,000.

From a research and policy perspective, however, experts say food-aid eligibility gives an incomplete picture of the resources of students in poverty, and no information about students who don’t qualify. Moreover, those poverty counts notoriously underrepresent students as they get older and more self-conscious about applying for free or reduced-price lunch.

“There are many problems regarding the use of free and reduced-cost lunch,” said Henry M. Levin, a research panelist and an economics and education professor at Teachers College, Columbia University, who is now on sabbatical at Peking University in Beijing.

“It does not distinguish in a sensitive way differences along the entire spectrum of SES,” he noted in an email to Education Week. “Even for the poor or relatively poor, there are large differences” within the range of free-lunch eligibility.

The governing board has tried in the past to fill in the gaps using the background questionnaire students complete along with NAEP, according to William Ward, a senior research scientist for assessment at NCES, which administers NAEP. But some of those questions have become outdated or have not been found to be relevant to a child’s real socioeconomic status.

“We used to ask, ‘Do you have a washer-dryer?’ but now everyone has a washer-dryer,” Mr. Cowan said. “We used to ask, ‘Do you have a cellphone?’ Now, do any of your students not have a cellphone?”

More Than Income

The updated measure of socioeconomic status will look at broader resources and learning supports, Mr. Cowan said.

It will start with the “big three": the family’s income, parents’ level of educational attainment, and whether and where they are employed. This year’s administration of NAEP has also tried out new background questions, including how long the child has lived in the United States, how many family members live with the child, and how many adults in the home have a job.

Because elementary students in particular may have difficulty identifying these, the governing board is considering supplementing the data with information from the U.S. Census Bureau’s American Community Survey, an annual study of a representative sample of 3.5 million households nationwide that asks about family structure, employment and income, transportation, and other details.

The NAEP student survey would still include questions about home possessions that research has shown to be related to student achievement, such as access to the Internet and the number of books in the home, Mr. Ward said. But the board is considering supplementing the “core” SES measures with other indicators of resources in the child’s neighborhood and school that could highlight differences between students living at the same income level in different areas.

For example, an 8th grader in New York’s Spanish Harlem neighborhood could still have access to libraries and museums, while a peer in rural southern Utah may have no local library but live a bike ride away from national parks.

Indicators of school and neighborhood supports also may be pulled from administrative data and from the Census Bureau, such as the degree of concentration of poverty or linguistic isolation, the average educational degree earned, and the employment levels in the neighborhood.

The governing board panel plans to present its proposed socioeconomic indicators at the annual meeting of the American Educational Research Association in April before piloting their use in 2014 and reporting the results in 2015.

A version of this article appeared in the December 12, 2012 edition of Education Week as NAEP Seeks to Test New Measure of Student Poverty

Events

Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
Ed-Tech Policy Webinar Artificial Intelligence in Practice: Building a Roadmap for AI Use in Schools
AI in education: game-changer or classroom chaos? Join our webinar & learn how to navigate this evolving tech responsibly.
Education Webinar Developing and Executing Impactful Research Campaigns to Fuel Your Ed Marketing Strategy 
Develop impactful research campaigns to fuel your marketing. Join the EdWeek Research Center for a webinar with actionable take-aways for companies who sell to K-12 districts.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Assessment Whitepaper
Design for Improvement: The Case for a New Accountability System
Assessments in more frequent intervals provide useful feedback on what students actually study. New curriculum-aligned assessments can le...
Content provided by Cognia
Assessment The 5 Burning Questions for Districts on Grading Reforms
As districts rethink grading policies, they consider the purpose of grades and how to make them more reliable measures of learning.
5 min read
Grading reform lead art
Illustration by Laura Baker/Education Week with E+ and iStock/Getty
Assessment As They Revamp Grading, Districts Try to Improve Consistency, Prevent Inflation
Districts have embraced bold changes to make grading systems more consistent, but some say they've inflated grades and sent mixed signals.
10 min read
Close crop of a teacher's hands grading a stack of papers with a red marker.
E+
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Assessment Sponsor
Fewer, Better Assessments: Rethinking Assessments and Reducing Data Fatigue
Imagine a classroom where data isn't just a report card, but a map leading students to their full potential. That's the kind of learning experience we envision at ANet, alongside educators
Content provided by Achievement Network
Superintendent Dr. Kelly Aramaki - Watch how ANet helps educators
Photo provided by Achievement Network