Assessment

NAEP Board Sets Rules For Background Questions

By Debra Viadero — September 03, 2003 3 min read
  • Save to favorites
  • Print

The board that sets policy for the National Assessment of Educational Progress has approved new guidelines aimed at reducing and better focusing the nonacademic questions that students and educators are asked to answer as part of the federally sponsored exams.

Besides testing what students know in specific subjects, such as reading and mathematics, the NAEP tests have long included some “noncognitive” or background questions on everything from the amount of time students spend on homework to the kinds of reading materials they use in class.

Members of the National Assessment Governing Board, the independent body that oversees the testing program, were concerned that the additional questions made the exams too cumbersome and yielded results that could be misinterpreted.

Grover J. “Russ” Whitehurst, the director of the Department of Education’s Institute of Education Sciences, shared some of the concerns. He opted on recent printed copies of NAEP reports to drop analyses of the data yielded by the background questions. (“‘Report Card’ Lacking Usual Background Data,” July 9, 2003.)

By law, the exams are required to gather information on race, ethnicity, gender, socioeconomic status, disability, and English-language proficiency for the students participating in the assessment. Those questions will continue to be part of future exams, according to the final guidelines approved by the governing board at its Aug. 1 meeting here.

The new guidelines allow for a trimmer set of questions on socioeconomic status, however, with some appearing in every assessment and some popping up periodically or accompanying only limited samples of tests.

Likewise, the exams could also include questions on “contextual variables,” such as student mobility, school safety issues, or discipline, but only if those topics have been shown through other research to have an impact on academic achievement.

The same holds true for subject-specific background questions. Queries in that category might probe relevant course content, teacher preparation, or other factors related to student achievement.

Experts’ Advice

In all, the framework approved last month says, background questions should not take up more than 10 minutes of students’ time, 20 minutes for teachers, and 30 minutes for school administrators. To keep within those limits, the guidelines encourage the Education Department to try to get some of the same information from other sources, such as school transcripts and other federal surveys.

In addition, since 4th grade test-takers can’t be counted on to provide reliable information on their parents’ income levels, the framework encourages federal test designers to try developing a wider index of proxy variables that might give a more accurate reading of a family’s socioeconomic status than the ones that are currently used.

“We think if we do a good job of reforming the NAEP, it will continue to be an important source of data for the research community,” said John H. Stevens, the executive director of the Texas Business and Education Coalition and the NAGB member who spearheaded the revision of the background questions.

While generally supportive of the board’s new direction on background questions, some researchers and national education groups expressed disappointment that the board had dropped earlier plans to set up an advisory board to help select appropriate questions.

“I don’t know where the capacity is to do the good work that the board wants to do,” Gerald E. Sroufe, the director of government relations for the Washington-based American Educational Research Association, told a board committee last month. “You need people really steeped in theory and research to suggest where the field is.”

And, while the guidelines say that analyses of the background data should be included in federal NAEP reports, they don’t require it.

When the data are presented, the framework says, the Education Department should refrain from suggesting any cause-and-effect relationships between the background factors and any variations in student achievement. Drawn from cross- sectional samples of students, the best such findings can do is suggest possible links for others to probe further, the guidelines note.

Related Tags:

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
Stronger Together: Integrating Social and Emotional Supports in an Equity-Based MTSS
Decades of research have shown that when schools implement evidence-based social and emotional supports and programming, academic achievement increases. The impact of these supports – particularly for students of color, students from low-income communities, English
Content provided by Illuminate Education
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
A Whole Child Approach to Supporting Positive Student Behavior 
To improve student behavior, it’s important to look at the root causes. Social-emotional learning may play a preventative role.

A whole child approach can proactively support positive student behaviors.

Join this webinar to learn how.
Content provided by Panorama
Recruitment & Retention Live Online Discussion A Seat at the Table: Why Retaining Education Leaders of Color Is Key for Student Success
Today, in the United States roughly 53 percent of our public school students are young people of color, while approximately 80 percent of the educators who lead their classrooms, schools, and districts are white. Racial

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Assessment Data Young Adolescents' Scores Trended to Historic Lows on National Tests. And That's Before COVID Hit
The past decade saw unprecedented declines in the National Assessment of Educational Progress's longitudinal study.
3 min read
Assessment Long a Testing Bastion, Florida Plans to End 'Outdated' Year-End Exams
Florida Gov. Ron DeSantis said the state will shift to "progress monitoring" starting in the 2022-23 school year.
5 min read
Florida Governor Ron DeSantis speaks at the opening of a monoclonal antibody site in Pembroke Pines, Fla., on Aug. 18, 2021.
Florida Gov. Ron DeSantis said he believes a new testing regimen is needed to replace the Florida Standards Assessment, which has been given since 2015.
Marta Lavandier/AP
Assessment Spotlight Spotlight on Assessment in 2021
In this Spotlight, review newest assessment scores, see how districts will catch up with their supports for disabled students, plus more.
Assessment 'Nation's Report Card' Has a New Reading Framework, After a Drawn-Out Battle Over Equity
The new framework for the National Assessment of Educational Progress will guide development of the 2026 reading test.
10 min read
results 925693186 02
iStock/Getty