Federal

Inclusion a Nettlesome Issue for NAEP Officials

By Christina A. Samuels — March 12, 2013 4 min read
  • Save to favorites
  • Print

The latest round of testing for the National Assessment of Educational Progress wrapped up last week, but the board that sets policy for the test known as “the nation’s report card” is still grappling with issues related to expanding participation of students with disabilities and students learning English.

At a March 1 meeting, board members learned that their recently adopted policy aimed at reducing the number of students excluded from taking the assessment could make it hard to compare results from year to year. Trend data are among the most important pieces of NAEP.

The National Center for Education Statistics, which administers the tests, plans to follow the method for calculating scores that it has used in the past, even though that diverges from board policy.

The center will present information to the board on what a change in calculation might mean to scores once the agency has a chance to evaluate results from the most recent test administration, said Arnold A. Goldstein, the program director for design, analysis, and reporting for the assessment division of the NCES.

The issue of test inclusion is not limited to NAEP, a voluntary test of a nationally representative sample of students. The tests, administered every other year, are given in grades 4, 8, and 12 in math and reading, with other subjects assessed periodically.

The groups tasked with creating tests to assess students on the Common Core State Standards adopted by nearly all the states are also working out their own test-accommodation policies, and in some cases are facing criticism from special education advocates who say that the policies are too restrictive.

Comparing Results

In 2010, the National Assessment Governing Board, which oversees NAEP, created a policy that would limit how many students with disabilities and English-language learners could be excluded from the testing pool. States were asked to test at least 95 percent of the students in the sample selected for assessment, including 85 percent of students with disabilities and 85 percent of students learning English.

The policy was meant to ensure that only students with severe cognitive disabilities or English-learners who had been in the country for less than a year would be excluded from taking the tests.

Before that policy change, there was no directive from the board on what percentage of students could be excluded by states from taking the test. Some states chose to exclude a higher proportion of students with disabilities and English-learners from the test than others, making NAEP results difficult to compare across states.

The policy change was in effect for the test’s 2011 administration, and the NCES at first made a “pretty informal effort” to follow it, said Cornelia Orr, the governing board’s executive director. However, states were aware of the change, and many made adjustments on their own.

The NCES noted that 45 states assessed fewer than 85 percent of the students with disabilities and English-language learners in 2009. By 2011, the number of states assessing less than that percentage dropped to 18. Even more states are expected to meet the policy goals this year.

To push states in the direction of inclusion, the 2010 policy is to count students who don’t take the tests as “refusing” to take them instead of counting them as excluded from the assessment.

New Issues

But that change distorts some of the statistical analysis the NCES uses, according to the agency’s presentation to the board.

The policy also encourages states to have students who would take a state test with accommodations to take NAEP without those accommodations.

There’s a concern that doing so can drive down test scores, said Andrés A. Alonso, the superintendent of the 85,000-student Baltimore school district and the chairman of the board’s reporting and dissemination committee. His district is one of the 21 urban districts for which NAEP scores are reported individually in the Trial Urban District Assessment, or TUDA.

“If you’re a TUDA district, it’s a different dynamic of perception and conversation,” said Mr. Alonso in a telephone interview after the meeting.

Louis M. Fabrizio, the chairman of the board’s committee on standards, design, and methodology and the director of accountability policy and communications for the North Carolina education department, was on the board when the change was made to promote greater inclusion. The board was unaware of some of the reporting issues that would result from the change, he said.

Similar Issues

Though NAEP has some unique issues connected to the way it samples students, Mr. Fabrizio said he sees that Smarter Balanced Assessment Consortium and the Partnership for Assessment of Readiness for College and Careers, the two groups creating common-core tests, will have similar issues. PARCC has released draft language that would exclude certain students from using accommodations on the test.

“All students will end up affected by these accommodation decisions,” Mr. Fabrizio said.

A version of this article appeared in the March 13, 2013 edition of Education Week as Inclusion Remains Nettlesome Topic for NAEP Officials

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Assessment Webinar
Rethinking STEM Assessment: Strategies for Administrators
School and district leaders will explore strategies to enhance STEM assessment practices across their district, within schools and classrooms.
Content provided by Project Lead The Way
Federal Webinar Keeping Up with the Trump Administration's Latest K-12 Moves: Subscriber-Exclusive Quick Hit
EdWeek subscribers, join this 30-minute webinar to find out what the latest federal policy changes mean for K-12 education.
Artificial Intelligence Live Online Discussion A Seat at the Table: Math & Technology: Finding the Recipe for Student Success
How should we balance AI & math instruction? Join our discussion on preparing future-ready students.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Federal Trump Admin. Was Moving Ed. Dept. Programs Elsewhere Before a Court Intervened
The department had penned agreements with the U.S. departments of Labor and the Treasury to move programs, but was halted by court order.
8 min read
A Morehouse College student lines up before the school commencement, May 19, 2024, in Atlanta. The Education Department announced on July 18, 2024, that it is cancelling an additional $1.2 billion in student loans for borrowers who work in public service.
A Morehouse College student lines up before the school commencement on May 19, 2024, in Atlanta. The U.S. Department of Education had started to work with the U.S. Department of the Treasury on transferring its student loan portfolio, a new court filing shows.
Seth Wenig/AP
Federal Trump Admin. Adds Project 2025 Author to Education Department Staff
The appointment comes as Trump has already begun to embrace plans outlined in the controversial 900-page conservative policy agenda.
4 min read
A copy of Project 2025 is held during the Democratic National Convention, Aug. 21, 2024, in Chicago.
A copy of Project 2025 is held during the Democratic National Convention, Aug. 21, 2024, in Chicago. The Trump administration has added the author of the conservative policy document's chapter on education to the U.S. Department of Education's staff.
J. Scott Applewhite/AP
Federal Trump Admin. Pauses Ed. Dept. Layoffs After Judge's Order
The U.S. Department of Education is slowly complying with a federal court order to reinstate staff.
3 min read
Phil Rosenfelt, center, an attorney with the Office of the General Counsel at the Department of Education, is greeted by supporters after retrieving personal belongings from the Education Department building in Washington on March 24, 2025.
Phil Rosenfelt, center, an attorney with the office of general counsel at the U.S. Department of Education, is greeted by supporters after retrieving personal belongings from the Education Department building in Washington on March 24, 2025, the last day of work for hundreds of agency employees. The Trump administration has had to bump back the day it planned to stop paying laid-off staff.
Jose Luis Magana/AP
Federal Tutoring, After-School, and Other Student Services at Risk as Trump Cuts AmeriCorps
Deep cuts to programs across the federal government have left students without programming they'd come to count on.
8 min read
Members of the City Year program work at Isaac Newton Middle School for Math and Science in East Harlem during the MLK Day of Service on Jan. 20, 2025, in New York City.
Members of the City Year program work at Isaac Newton Middle School for Math and Science in East Harlem during the MLK Day of Service on Jan. 20, 2025, in New York City. City Year places AmeriCorps volunteers in underserved schools, but cuts to the federal service agency have led City Year to scale back some of its AmeriCorps volunteer-powered programs.
Courtesy of City Year New York