Opinion Blog


Rick Hess Straight Up

Education policy maven Rick Hess of the American Enterprise Institute think tank offers straight talk on matters of policy, politics, research, and reform. Read more from this blog.

Education Opinion

To Get It Right, Focus on Tests and Curriculum

By Guest Blogger — February 21, 2014 4 min read
  • Save to favorites
  • Print

Note: Morgan Polikoff, assistant professor at the University of Southern California, is guest posting this week. You can follow him on Twitter at @mpolikoff.

For my last day here at RHSU, I’m going to go a bit into the weeds to talk about what I think are the two most important technical issues that will affect Common Core implementation. These are the quality and alignment of both assessments and curriculum materials. This post is based on an upcoming brief I’m releasing through the Center for American Progress on assessment in the Common Core era, as well as a research paper on textbooks I am presenting today to the Education Writers Association here in Los Angeles.

As is well known by now, assessment in the NCLB era suffered from a number of serious problems. For example, state tests were poorly aligned with the state standards they were intended to assess (which undermined standards implementation). They routinely focused on content on lower-level skills such as memorization and procedures and left vast swaths of the standards unassessed. They tended to reliably sample the same content over and over again, leading to score inflation. The proficiency cuts were all over the place, so proficiency became basically meaningless. Furthermore, the requirement to assess only grade-level standards led to poor measurement at both the top and the bottom of the achievement distribution. Finally, many were dissatisfied with the almost exclusive emphasis on multiple choice items, which may be limited in their ability to measure certain complex skills.

The two assessment consortia are working hard to improve upon prior state tests, and there is good reason to think they will succeed at least somewhat in their efforts. For instance, they are building constructed response and performance items to assess hard-to-test standards. States participating in the consortia are expected to adopt common proficiency targets. And computer-adaptive testing (in Smarter Balanced) could help with assessing achievement at the extremes of the distribution. It goes without saying that the consortia need to create strong tests that cover the full domain of the standards, including the more conceptual skills. If the tests end up looking like NCLB bubble tests on a computer screen, they will certainly undermine the standards. I offer more specific assessment suggestions in my forthcoming CAP brief.

The second major threat to Common Core implementation lies with curriculum materials. We’ve all heard the anecdotes of publishers slapping “Common Core aligned” stickers on everything with words. There should be real concern about these claims, and I set out to begin evaluating them in a recent project.

While the research on curriculum materials is not as great as that on assessments, there is no question that textbooks have historically suffered from many of the same tendencies as standards and assessments--excessively broad and shallow, covering too many topics at a superficial level of depth. We also know that textbooks vary in their effects on student achievement, and scholars have recently called for more research and data on textbook quality and effectiveness.

As a proof of concept for what I hope will be a larger study, I chose four popular textbook series published by Pearson, Houghton Mifflin Harcourt, Macmillan/McGraw Hill, and Saxon at one grade level--fourth grade mathematics. The first three claimed Common Core alignment and the last did not. I worked with teams of content analysts to examine the books from cover to cover using the only established alignment technique shown to be useful for analyzing alignment among instruction, curriculum materials, standards, and assessments. We also analyzed the Common Core.

The results of our alignment analyses, which I’m debuting today at a meeting of the Education Writers Association (and presenting at a couple conferences this spring), are both stunning and totally predictable. Despite the presence of the “Common Core aligned” labels, all textbooks studied had notably large areas of misalignment. All textbooks systematically failed to include content (far less than 1% of total content) on advanced levels of cognitive demand like generalization and application, even though about 10% of the standards content is on those skills. A substantial chunk (10-20% of the textbooks’ 100+ lessons) was on content not in the corresponding standards, and about 15% of the standards were not in the texts. Finally, I compared the textbooks to prior versions of the same textbook series that claimed alignment to Florida’s standards. I found substantial agreement (60-95%, depending how defined) indicating that publishers used much of the same material to cover Common Core as to cover Florida’s standards. This is despite the fact that the two sets of standards ask for very different content.

I hope this work will be the first in a line of research investigating curriculum materials, their content, and their influence on student learning. Given the ubiquity of these materials and their effects on teachers’ instruction, there is a great deal more to be learned. As with assessments, having high-quality, aligned curriculum materials will almost certainly be essential to helping teachers understand and teach the standards. And if the standards aren’t well implemented, they will not have the effects many are hoping for.

--Morgan Polikoff

The opinions expressed in Rick Hess Straight Up are strictly those of the author(s) and do not reflect the opinions or endorsement of Editorial Projects in Education, or any of its publications.

Events

Classroom Technology Webinar How Pandemic Tech Is (and Is Not) Transforming K-12 Schools
The COVID-19 pandemic—and the resulting rise in virtual learning and big investments in digital learning tools— helped educators propel their technology skills to the next level. Teachers have become more adept at using learning management
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
Building Teacher Capacity for Social-Emotional Learning
Set goals that support adult well-being and social-emotional learning: register today!


Content provided by Panorama
Jobs October 2021 Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education Tiny Wrists in Cuffs: How Police Use Force Against Children
An investigation finds children as young as 6 and a disproportionate amount of Black children have been handled forcibly by police officers.
15 min read
Jhaimarion, 10, reacts as he listens to his mother, Krystal Archie talking with an Associated Press reporter in Chicago on Sept. 23, 2021. Archie’s three children were present when police, on two occasions, just 11 weeks apart, kicked open her front door and tore through their home searching for drug suspects. She’d never heard of the people they were hunting. Her oldest child, Savannah was 14 at the time; her youngest, Jhaimarion, was seven. They were ordered to get down on the floor.
Jhaimarion, 10, reacts as he listens to his mother, Krystal Archie talking with an Associated Press reporter in Chicago on Sept. 23, 2021. Archie’s three children were present when police, on two occasions, just 11 weeks apart, kicked open her front door and tore through their home searching for drug suspects. She’d never heard of the people they were hunting. Her oldest child, Savannah was 14 at the time; her youngest, Jhaimarion, was seven. They were ordered to get down on the floor.
Nam Y. Huh/AP
Education Gunman in 2018 Parkland School Massacre Pleads Guilty
A jury will decide whether Nikolas Cruz will be executed for one of the nation’s deadliest school shootings.
3 min read
Annika Dworet and her husband, Mitch Dworet, wipe away tears as their son's name is read aloud during Marjory Stoneman Douglas High School shooter Nikolas Cruz's guilty plea on all 17 counts of premeditated murder and 17 counts of attempted murder in the 2018 shootings, at the Broward County Courthouse in Fort Lauderdale, Fla. on Wednesday, Oct. 20, 2021. The Dworet's son, Nicholas Dworet, 17, was killed in the massacre.
Annika Dworet and her husband, Mitch Dworet, wipe away tears as their son's name is read aloud during Marjory Stoneman Douglas High School shooter Nikolas Cruz's guilty plea on all 17 counts of premeditated murder and 17 counts of attempted murder in the 2018 shootings, at the Broward County Courthouse in Fort Lauderdale, Fla. on Wednesday, Oct. 20, 2021. The Dworet's son, Nicholas Dworet, 17, was killed in the massacre.
Amy Beth Bennett/South Florida Sun Sentinel via AP
Education Briefly Stated: October 20, 2021
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education Gunman in Parkland School Massacre to Plead Guilty
The gunman who killed 14 students and three staff members at a Florida high school will plead guilty to their murders, his attorneys said.
4 min read
Parkland school shooter Nikolas Cruz is sworn in before pleading guilty, Friday, Oct. 15, 2021, at the Broward County Courthouse in Fort Lauderdale, Fla., on all four criminal counts stemming from his attack on a Broward County jail guard in November 2018, Cruz's lawyers said Friday that he plans to plead guilty to the 2018 massacre at a Parkland high school.
Parkland school shooter Nikolas Cruz is sworn in before pleading guilty, Friday, Oct. 15, 2021, at the Broward County Courthouse in Fort Lauderdale, Fla., on all four criminal counts stemming from his attack on a Broward County jail guard in November 2018, Cruz's lawyers said Friday that he plans to plead guilty to the 2018 massacre at a Parkland high school.
Amy Beth Bennett/South Florida Sun Sentinel via AP