Assessment

Teachers Say Those Ubiquitous, Every-Few-Months Tests Don’t Always Capture What’s Taught

By Sarah Schwartz — August 23, 2023 5 min read
Student in classroom taking test.
  • Save to favorites
  • Print

At some point during the year, most students in U.S. schools will take a benchmark test.

These tests, also called interim assessments, are designed to measure students’ progress toward instructional goals and are given every few months. Districts can purchase off the shelf versions—MAP, i-Ready, and Star are common tools, for example—or create their own tests.

But even though the vast majority of schools use these assessments, teachers and principals have different perceptions of their effectiveness.

More than 80 percent of principals say that, for the most part, the tests they use align to state standards and the end-of-year state-administered tests used for school accountability.

But about a third of teachers say that these interim tests don’t align with the curriculum and don’t accurately measure what students have learned. And teachers who report this mismatch are more likely to say that it’s difficult for them to figure out how the tests should inform their instruction.

These are the findings in a report this week from the RAND Corporation, which analyzed nationally representative survey data from about 1,500 principals and over 6,000 math and English/language arts teachers.

“We know that many education leaders and school systems are working really hard to help kids recover from the effects of the pandemic,” said Ashley Woo, an assistant policy researcher at RAND and the lead author on the paper. “Part of that work entails knowing where students are and how to adjust learning to meet students’ needs.”

The findings underscore an important feature of interim tests: Different assessments are designed to serve different purposes. While some are meant to measure how well students will do on a state summative test, others claim to show whether students have mastered skills and knowledge taught in the curriculum.

Understanding each test’s intended purpose is crucial to using the data it produces well, assessment experts have stressed. That’s challenging because the commercial marketplace for these tests is a bit of a black box: Not much is known about the technical properties or assumptions that undergird most of the popular off-the-shelf exams.

While this RAND survey measures educators’ perceptions of interim assessments, other recent initiatives have tried to offer external evaluations.

Last year, the nonprofit curriculum reviewer EdReports announced that it planned to release reviews of commercially available interim tests, evaluating them for technical quality and alignment to commonly used curricula.

But in May, the group said that the plan had been paused after several providers of the tests wouldn’t commit to participation.

How schools use interim assessments

An overwhelming majority of schools—99 percent—use some sort of interim assessment, the researchers found.

Most principals report using both commercially available tests and ones that are locally created—developed by states, districts, or schools. But elementary and middle schools are slightly more likely to use purchased assessments, while high schools are slightly more likely to use those that were locally created.

Using multiple types of tests was common, according to the principal survey. On average, schools administered three different benchmark assessments in both ELA and math—though the report notes that not all tests would necessarily be given to all students.

This could be because different types of tests are better suited to different purposes, Woo said.

“For instance, you might have something like an i-Ready or an NWEA MAP test, which is more standardized and allows you to compare student progress across different schools and districts because lots of different schools and districts are using these assessments,” she said.

Others might measure whether students have learned the skills and knowledge teachers cover in class—think unit tests, term papers, or other major assignments. “Those kinds of assessments that are specifically designed to align with curriculum are the kinds of assessments that are giving teachers more real-time data,” Woo said.

The report also tracked test use over time, including during the pandemic. The researchers found small but steady growth in schools’ use of commercial assessments between the 2018-19 and 2021-22 school years.

Use of the locally created assessments fluctuated, declining during the 2020-21 school year, and then jumped back up during 2021-22. Some of this change could stem from pandemic-related shifts in instruction and assessment, Woo said.

The overall trend in locally created test use during the period of the study is positive, though.

Where principals’ and teachers’ perspectives on interim tests differ

Principals generally thought that interim assessments could gauge whether students were meeting broad instructional goals. More than 80 percent of principals said that the interim tests they used aligned to state standards and end-of-year summative assessments.

The surveys asked teachers about a different metric: curriculum alignment. A majority, 64 percent, said that interim assessments did align with their curriculum. Still, though, about a third of teachers said they only partially aligned with the curriculum, or didn’t align at all.

These numbers varied slightly across different groups. For example, ELA teachers were less likely than math teachers to say that their assessments were aligned. Teachers who created their own interim assessments, and teachers who spent more time in professional development analyzing test data, were both more likely to report curriculum alignment.

In general, it seems somewhat difficult for teachers to figure out how interim test data should inform their instruction. Only 37 percent said that was easy to do; another 37 percent said it was difficult, and about a quarter said it was neither.

It was especially difficult for teachers who felt that the interim assessments weren’t well-aligned with their curriculum: Among those teachers, just 14 percent said it was easy to address student needs identified by their benchmark tests.

In interviews that the researchers conducted with 45 teachers, several mentioned unclear messaging from leadership about how to use the data that these tests provided.

“This is probably the biggest, most frustrating thing of our district,” said one elementary ELA teacher. “They have adopted so many different ways to benchmark our kids, different formats and different resources. … And all of these different tests are all different standards, and they don’t align to our curriculum necessarily. … Looking at the data, it’s sometimes hard for us as teachers to know which data [are] important, which do I need to use to show that my children are progressing.”

Guidance from district and school leaders is necessary, Woo said. Leaders should know whether benchmark tests align to standards, year-end state tests, curriculum, or some combination—and then use that information to convey messages to teachers about how to use them, she said.

“We think it’s important for state and local leaders to consider the slate of assessments … and the role that they expect each assessment to fulfill,” said Woo.

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Artificial Intelligence Webinar
Teaching Students to Use Artificial Intelligence Ethically
Ready to embrace AI in your classroom? Join our master class to learn how to use AI as a tool for learning, not a replacement.
Content provided by Solution Tree
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
Empowering Students Using Computational Thinking Skills
Empower your students with computational thinking. Learn how to integrate these skills into your teaching and boost student engagement.
Content provided by Project Lead The Way
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
IT Infrastructure & Management Webinar
The Reality of Change: How Embracing and Planning for Change Can Shape Your Edtech Strategy
Promethean edtech experts delve into the reality of tech change and explore how embracing and planning for it can be your most powerful strategy for maximizing ROI.
Content provided by Promethean

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Assessment Massachusetts Voters Poised to Ditch High School Exit Exam
The support for nixing the testing requirement could foreshadow public opinion on state standardized testing in general.
3 min read
Tight cropped photograph of a bubble sheet test with  a pencil.
E+
Assessment This School Didn't Like Traditional Grades. So It Created Its Own System
Principals at this middle school said the transition to the new system took patience and time.
6 min read
Close-up of a teacher's hands grading papers in the classroom.
E+/Getty
Assessment Opinion 'Academic Rigor Is in Decline.' A College Professor Reflects on AP Scores
The College Board’s new tack on AP scoring means fewer students are prepared for college.
4 min read
The United States Capitol building as a bookcase filled with red, white, and blue policy books in a Washington DC landscape.
Luca D'Urbino for Education Week
Assessment Opinion Students Shouldn't Have to Pass a State Test to Graduate High School
There are better ways than high-stakes tests to think about whether students are prepared for their next step, writes a former high school teacher.
Alex Green
4 min read
Reaching hands from The Creation of Adam of Michelangelo illustration representing the creation or origins of of high stakes testing.
Frances Coch/iStock + Education Week