Standards

D.C. Will Invalidate 2 Years of Science-Test Scores

By Stephen Sawchuk — January 19, 2018 3 min read
  • Save to favorites
  • Print

UPDATED

The District of Columbia will cancel two years of students’ science assessment scores, alleging that its test contractor, WestEd, bungled its handling of the tests.

“Serious errors” in the tests will mean invalidating the 2016 and 2017 scores; the 2017 scores will not be publicly released, officials from D.C. Office of the State Superintendent of Education said in a Friday news release. What’s more, the D.C. school system won’t be administering science assessments this year, and will seek out a new test creator moving forward.

The news comes just as many states have begun to overhaul their science standards and put in place matching tests. The District of Columbia was one of the first places seeking to measure students’ grasp of the Next Generation Science Standards, which have been adopted in about 18 states.

In Washington, science tests are administered in grades 5, 8, and the year the student takes biology at the high school level. About 13,000 students take them annually. Federal law requires all states to administer science assessments three times over a student’s trajectory—once in the elementary grades, once in middle school, and once in high school.

The agency has cancelled its contact with WestEd, worth $370,000 this year, which covered the construction and scoring of the exam. It is also hinting at a possible lawsuit: OSSE is working with D.C.'s procurement office to seek legal remedy, including possible damages.

“Assessments are an important part of understanding how well our students are doing and we, our educators, and our students devote significant time and resources to taking them seriously,” D.C. Superintendent of Education Hanseul Kang said in a statement. “Any action by a vendor that contradicts that commitment is unacceptable.”

Federal Waiver?

The delay caused by the errors means that D.C. will need to seek approval from the U.S. Department of Education to forgo science testing for 2018. In the release, OSSE said it has worked “amiably” with the Education Department to meet its reporting requirements under the law, known as the Every Student Succeeds Act.

The cancellation doesn’t otherwise affect D.C.'s plan under ESSA; unlike other states, the district decided not to factor science-test results into school ratings.

In an FAQ also posted on the OSSE website, OSSE said it noticed during an audit “unusual results” on the 8th grade test compared to the prior year and to other grade levels, and that further inquiry by OSSE and WestEd found additional problems. In an email, the agency said that the errors involved scoring and “psychometric services"—which generally means making sure that the test meets validity and reliability standards and is fair for different groups of students—not something intrinsic to the test items.

The Washington Post reported that the errors made it impossible to compare the 2017 and 2016 results. That appears to be what’s called in testing jargon a problem with equating, or ensuring that scores are comparable from different test forms.

Max McConkey, the chief policy and communications officer for WestEd, said that the organization didn’t agree with all of OSSE’s conclusions. “We believe we’ve responded to concerns in the past, and have a very different interpretation of the history,” he said. “We just couldn’t resolve it in a way they were happy with.”

OSSE said in its statement it had already put out an RFP seeking a new vendor for a replacement exam, to debut in 2019.

The NGSS standards put an emphasis on teaching students the scientific process—including how to craft a hypothesis, conduct experiments, and analyze results—as well as on scientific content. Only a handful of other states were on track to use an NGSS-aligned test in 2018; one of them, Illinois, had an agreement to use some of D.C.'s science-test questions, but OSSE officials said that that state uses a separate contractor and test design, so it shouldn’t be impacted by these errors.

As we’ve reported, the standards necessitated testing experts to think about how to create tests that could measure across the NGSS’ science practices, content, and “cross-cutting themes” like engineering.

This story will be updated.

A version of this news article first appeared in the Curriculum Matters blog.


Commenting has been disabled on edweek.org effective Sept. 8. Please visit our FAQ section for more details. To get in touch with us visit our contact page, follow us on social media, or submit a Letter to the Editor.


Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
6 Key Trends in Teaching and Learning
As we enter the third school year affected by the pandemic—and a return to the classroom for many—we come better prepared, but questions remain. How will the last year impact teaching and learning this school
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Equity & Diversity Webinar
Leadership for Racial Equity in Schools and Beyond
While the COVID-19 pandemic continues to reveal systemic racial disparities in educational opportunity, there are revelations to which we can and must respond. Through conscientious efforts, using an intentional focus on race, school leaders can
Content provided by Corwin
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Equity & Diversity Webinar
Evaluating Equity to Drive District-Wide Action this School Year
Educational leaders are charged with ensuring all students receive equitable access to a high-quality education. Yet equity is more than an action. It is a lens through which we continuously review instructional practices and student
Content provided by BetterLesson

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Standards Opinion How the Failure of the Common Core Looked From the Ground
Steve Peha shares insights from his on-site professional-development work about why the common core failed, in a guest letter to Rick Hess.
4 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
Standards Opinion Common Core Is a Meal Kit, Not a Nothingburger
Caroline Damon argues Rick Hess and Tom Loveless sold the common core short, claiming the issue was a matter of high-quality implementation.
5 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
Standards How New Common Core Research Connects to Biden's Plans for Children and Families
A study of national test scores indicate the early phase of the Common Core State Standards did not help disadvantaged students.
5 min read
results 925693186 02
iStock/Getty
Standards Opinion After All That Commotion, Was the Common Core a Big Nothingburger?
The Common Core State Standards may not have had an impact on student outcomes, but they did make school improvement tougher and more ideological.
3 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty