Blog

Your Education Road Map

Politics K-12®

ESSA. Congress. State chiefs. School spending. Elections. Education Week reporters keep watch on education policy and politics in the nation’s capital and in the states. Read more from this blog.

Federal

Education Department Restarts Peer-Review of Tests

By Alyson Klein — September 25, 2015 6 min read
  • Save to favorites
  • Print

By guest blogger Catherine Gewertz

States that have adopted new tests, or made significant changes to their old ones, will have to undergo peer review by the U.S. Department of Education within the next four to eight months, according to department officials.

That timetable made its debut alongside the issuance of much-awaited new federal guidance on the peer-review process. That guidance, published Friday, marks the official re-launch of the peer-review process after nearly three years of suspension. It details the requirements states must meet to undergo the federally mandated reviews by panels of experts.

The document itself says that states must undergo peer review within six months of when they first give a new, or substantially changed, assessment.

But in an interview with Education Week, Ann Whalen, a special adviser to U.S. Secretary of Education Arne Duncan, said that states actually will have three review periods to choose from: January, March, or May.

They will be expected to submit detailed documentation several weeks in advance, and the department will work with states to help them select a period that works for them, said Whalen, who has been delegated the duties of the assistant secretary of elementary and secondary education.

The testing landscape shifted profoundly in 2014-15, with many states giving new tests to reflect the common core, and half using federally funded tests by two state consortia--PARCC and Smarter Balanced.

One-Time-Only Tests Can Skip Review

But some states plan to move to a new test in 2015-16, and they worried privately that they’d have to undergo peer review--notoriously time- and labor-intensive--for a test they’d used for only one year and then left behind. Whalen said states would not have to do that. The department would rather have them focus on ensuring that their 2015-16 tests “are high-quality and will sail through peer review,” she said.

Elements of the guidance were reorganized and expanded to emphasize their importance, and to reflect 2014 updates to the testing industry’s Bible, the Standards for Educational and Psychological Testing. Sections requiring states to submit evidence that their assessment systems include adequate security measures and properly protect student data privacy, for instance, have new prominence and detail. (See the previous version of peer review guidance here.)

Another aspect of the updated approach to federal review is an emphasis on ensuring that states’ tests seek to measure students’ “higher-order thinking skills.” The kinds of evidence that states might submit to show that “critical element” in the review might include test blueprints, or samples of test-question specifications that lay out the questions’ “cognitive complexity.”

A Spotlight on Numbers Taking, Skipping, Tests

Participation data, too, has a new prominence in the updated guidance. States were always required to report the numbers of students who took state-mandated assessments, to show that the tests are being given to “all students,” as required by law. But the new version sets off the participation data requirement by itself, with a grid to illustrate that states must supply the number of students enrolled, and the number and percent of students tested, in each grade 3-8, and at the high school grade level chosen for testing. That data takes on new resonance for the 2014-15 testing season, since rising antipathy to testing sparked a massive opt-out movement in some places.

The peer-review process was suspended in December 2012 to enable the department to revise its guidelines in light of many states’ new standards and tests, and the changes affecting assessment because of technology. States have been impatiently awaiting the new guidance, which was originally slated to come out in summer 2014, but was repeatedly delayed.

The reviews, required by the Elementary and Secondary Education Act, are aimed at demonstrating that states meet federal requirements to have, among other things, rigorous academic standards and high-quality, valid, and reliable assessments.

Evaluating Evidence

The panels of assessment experts, appointed by the department, review evidence of those things, rather than reviewing the standards and tests themselves.

To show that its standards are rigorous, for instance, states must submit stacks of various kinds of information, such as endorsements by their state university system that the standards reflect college-ready expectations, or documentation that content-matter experts were involved in the standards’ creation.

Early Reaction

Importantly, states that are participating in one of the two consortia--or are using another test that’s common to a significant number of states, can work on their peer-review submissions together.

That could give states that are using tests from either the Partnership for Assessment of Readiness for College and Careers or the Smarter Balanced Assessment consortia an easier road, especially given the relatively tight timeline for peer review, said Scott Marion, the associate director of the Center for Assessment.

“I think the six-month timeline for submission is too fast for states,” Marion said in an email. “Look at all the analyses required for fairness, comparability, validity, etc. A six-month timeline implies that the state has all necessary analyses conducted and they just need to package things up. This is a tremendous advantage for the consortia, which is fine with me, but [the department] needs to acknowledge this.”

But Wes Bruce, the former chief assessment director in Indiana, had a different take. “I think there’s probably a little bit of truth to the fact that this encourages consortia or collaboration writ large,” he said in an interview.

But he added, “I don’t think it favors any set of consortia; PARCC and Smarter Balanced aren’t more advantaged than if Alaska and Hawaii got together and decided to build” their own test.

And Bruce thinks the time-frame is doable, especially for state assessment officials who have experience with peer review.

“There may be some folks in some states who are surprised by this, [especially] if you haven’t already had to do peer review,” he said. “There certainly are some changes and it’s not going to be a slam dunk,” but, he added, “I don’t think it’s a lot of scrambling.”

And Louisiana’s former assessment director, Scott Norton, who is now the director of standards, accountability, and assessment at the Council of Chief School Officers agreed.

“States will step up and meet the challenge,” he said. But, “it’s a big amount of work for the assessment staff to take on.” The key new elements make sense, however, he said, including the new focus on data privacy and test security, and the changes for states that are using computer-adaptive tests.

The CCSSO, he said, will be lending a hand. The organization is already planning to get state assessment directors on the phone for initial reaction, and it will host a one-day meeting for directors in November, with experts on call to help field questions. And most importantly, he said, the CCSSO will work with the department on any common issues that emerge as states move forward with the review process.

Another key question, raised by Chris Domaleski, a senior assoicate at the Center for Assessment: How will the guidance on policies for including all students work for states that have adopted, or are considering, opt-out laws?

Here is a map of the six “critical elements,” and subcategories of those elements, that the education department reviewers will examine. The guidance includes many examples--though not a complete list--of the kinds of evidence states can submit to gain approval.

Assistant Editor Alyson Klein contributed to this report.


Follow us on Twitter at @PoliticsK12.


Commenting has been disabled on edweek.org effective Sept. 8. Please visit our FAQ section for more details. To get in touch with us visit our contact page, follow us on social media, or submit a Letter to the Editor.


Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
6 Key Trends in Teaching and Learning
As we enter the third school year affected by the pandemic—and a return to the classroom for many—we come better prepared, but questions remain. How will the last year impact teaching and learning this school
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Equity & Diversity Webinar
Leadership for Racial Equity in Schools and Beyond
While the COVID-19 pandemic continues to reveal systemic racial disparities in educational opportunity, there are revelations to which we can and must respond. Through conscientious efforts, using an intentional focus on race, school leaders can
Content provided by Corwin
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Equity & Diversity Webinar
Evaluating Equity to Drive District-Wide Action this School Year
Educational leaders are charged with ensuring all students receive equitable access to a high-quality education. Yet equity is more than an action. It is a lens through which we continuously review instructional practices and student
Content provided by BetterLesson

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Federal Feds Add Florida to List of States Under Investigation Over Restrictions on Mask Mandates
The Education Department told the state Sept. 10 it will probe whether its mask rule is violating the rights of students with disabilities.
3 min read
Surrounded by lawmakers, Florida Gov.Ron DeSantis speaks at the end of a legislative session on April 30, 2021, in Tallahassee, Fla.
Surrounded by lawmakers, Florida Gov.Ron DeSantis speaks at the end of a legislative session on April 30, 2021, in Tallahassee, Fla.
Wilfredo Lee/AP
Federal How Biden Will Mandate Teacher Vaccines, Testing in Some States That Don't Require Them
President Joe Biden's COVID-19 plan will create new teacher vaccination and testing requirements in some states through worker safety rules.
4 min read
Nurse Sara Muela, left, administers the Johnson & Johnson COVID-19 vaccine to educator Rebecca Titus at a vaccination site setup for teachers and school staff at the Berks County Intermediate Unit in Reading, Pa., on March 15, 2021.
Nurse Sara Muela administers a COVID-19 vaccine to educator Rebecca Titus at a vaccination site for at the Berks County Intermediate Unit in Reading, Pa.
Matt Rourke/AP
Federal Biden Pushes Schools to Expand COVID-19 Testing, Get More Teachers Vaccinated
President Joe Biden set teacher vaccine requirements for federally operated schools as part of a new effort to drive down COVID's spread.
7 min read
President Joe Biden speaks in the State Dining Room at the White House, Thursday, Sept. 9, 2021, in Washington. Biden is announcing sweeping new federal vaccine requirements affecting as many as 100 million Americans in an all-out effort to increase COVID-19 vaccinations and curb the surging delta variant.
President Joe Biden in a speech from the White House announces sweeping new federal vaccine requirements and other efforts in an renewed effort to stem the COVID-19 pandemic.
Andrew Harnik/AP
Federal Education Department Opens Civil Rights Probes in 5 States That Ban School Mask Mandates
The move on behalf of students with disabilities deepens the fight over masks between the Biden administration and GOP governors.
4 min read
Kindergarten students sit in their classroom on the first day of in-person learning at Maurice Sendak Elementary School in Los Angeles on April 13, 2021.
Kindergarten students sit in their classroom on the first day of in-person learning at Maurice Sendak Elementary School in Los Angeles in April 2021.
Jae C. Hong/AP