Assessment Opinion

How the Brown Center Report Got it Wrong: No Relationship Between Academic Standards and Student Performance?

By Marc Tucker — February 22, 2012 5 min read
  • Save to favorites
  • Print

The recent report of the Brown Center on Education Policy at the Brookings Institution, by Tom Loveless, titled “How Well Are American Students Learning?,” nicely illustrates, I think, some of the enduring problems associated with certain aspects of the way education research and policy analysis is done in the United States.

This is the first of two pieces I intend to write on Loveless’ report. In this one, I will address his assertion that the academic standards a state or nation sets have no bearing on the academic achievement of its students. Loveless comes to that conclusion by analyzing the relationship between the average scores of students in several states on NAEP assessments and the ratings of the official academic standards adopted by those states as rated by the Fordham Foundation. He finds that there is no consistent relationship between these two sets of data. Students in states with high ratings for standards achieve at widely differing levels on the NAEP assessments and students with high average scores on the NAEP assessments have adopted standards that vary widely in the ratings they have received from the Fordham standards raters. Ergo sum: the achievement of your states’ students is unrelated to the rigor of the state’s formal academic standards. The reasonable conclusion to be drawn from this finding, of course, is that we can add school reform strategies based on setting internationally benchmarked academic standards to the large and growing scrap heap of failed education strategies. “Despite all the money and effort devoted to developing the Common Core State Standards--not to mention the simmering controversy over their adoption in the several states--the study foresees little to no impact on student learning,” Loveless writes in the introduction of the report.

Few among those of us who have advocated the use of academic standards to raise student achievement over the years have ever suggested that raising standards alone would accomplish that objective. In my own case, my commitment to this strategy came from years of study of the countries with the most successful education systems in the world. Virtually all, I noted, included a focus on academic standards as a core strategy for improving student performance. But I also reported that raising academic standards was, without exception, an integral component of a much more complex web of strategies adding up to the development of a powerful state instructional system.

Countries that have had success with this strategy--and I know of none that have been successful that have not employed it--have carefully documented the standards of the leading countries and set their own standards in the light of those adopted by their principal competitors. They have defined the end-point of the common curriculum, usually at about the end of what we call 10th grade or age 16, and then worked backward, grade by grade, or by groups of grades, to define a curriculum framework describing the topics to be studied in each subject for each grade or for each small group of grades. At the high school level, they have specified syllabi for each course across the whole required curriculum (far more than their native language and mathematics). They have developed very high quality examinations for each of the courses defined by those syllabi. And they have made a major investment in making sure that their teachers are well qualified and trained to teach those courses.

What I am describing is a whole instructional system, each part of which is essential to the success of the others, of which standards are only a part.

No one in his right mind who has studied this system would believe that doing only one part of it would result in any significant change in student performance. It is the system, not its individual components, that produces the effects we see in the international league tables of student performance, in nation after nation.

But the entire discussion in “How Well Are American Students Learning?” is about dyadic relationships--between standards and student performance, between student cut scores and student performance, between standards and within-state variation in student performance.

Toward the end of section one of his report, Loveless asks why standards don’t make much of a difference to student achievement. Answering his own question, he says that, in the United States, standards are actually mostly aspirational and are not operationalized in a way that is likely to make a difference. To illustrate his point, he cites the work of the International Association for the Evaluation of Educational Achievement, which distinguishes among the intended, implemented and achieved curriculums. The intended curriculum is what the state says it is. The implemented curriculum is what teachers teach and the achieved curriculum is what students learn. And he goes on to say that, in the United States, the implemented and achieved curriculums bear very little relationship to the intended curriculum.

That is true. So what we are left with is a very interesting problem. If standards continue to be largely aspirational, then they are likely to continue to be largely unrelated to student achievement and mostly a waste of time. However if our aim is to produce the kinds of improvement in student performance we see in the most successful nations and if we want the standards to have an important effect on student performance, then they have to be operational, not aspirational, and that means that we will have to put in place whole aligned instructional systems of the kind I described above, because there is no model anywhere in the world of a national or state education system that has achieved high standards that has not developed such a system.

Loveless got the question wrong. It is not whether standards can by themselves greatly improve student performance. It is what other elements must be combined with what features of a standards system to make them a powerful tool for improving student performance. Loveless is hardly alone. Americans are in a never-ending search for silver bullets, single-factor solutions for problems that will only yield to systemic solutions.

The search for silver bullets is chimerical and doomed. We are not likely to move beyond the current impasse until American researchers refocus on methodologies designed to assess the effectiveness of systemic solutions. Right now, that seems to be a distant prospect.

The opinions expressed in Top Performers are strictly those of the author(s) and do not reflect the opinions or endorsement of Editorial Projects in Education, or any of its publications.

Commenting has been disabled on edweek.org effective Sept. 8. Please visit our FAQ section for more details. To get in touch with us visit our contact page, follow us on social media, or submit a Letter to the Editor.


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Teaching Webinar
6 Key Trends in Teaching and Learning
As we enter the third school year affected by the pandemic—and a return to the classroom for many—we come better prepared, but questions remain. How will the last year impact teaching and learning this school
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
School & District Management Webinar
Ensuring Continuity of Learning: How to Prepare for the Next Disruption
Across the country, K-12 schools and districts are, again, considering how to ensure effective continuity of learning in the face of emerging COVID variants, politicized debates, and more. Learn from Alexandria City Public Schools superintendent
Content provided by Class
Teaching Profession Live Online Discussion What Have We Learned From Teachers During the Pandemic?
University of California, Santa Cruz, researcher Lora Bartlett and her colleagues spent months studying how the pandemic affected classroom teachers. We will discuss the takeaways from her research not only for teachers, but also for

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Assessment Spotlight Spotlight on Assessment in 2021
In this Spotlight, review newest assessment scores, see how districts will catch up with their supports for disabled students, plus more.
Assessment 'Nation's Report Card' Has a New Reading Framework, After a Drawn-Out Battle Over Equity
The new framework for the National Assessment of Educational Progress will guide development of the 2026 reading test.
10 min read
results 925693186 02
Assessment Opinion Q&A Collections: Assessment
Scores of educators share commentaries on the use of assessments in schools.
5 min read
Images shows colorful speech bubbles that say "Q," "&," and "A."
Assessment Standardized Tests Could Be in Jeopardy in Wake of Biden Decisions, Experts Say
Has the Biden administration shored up statewide tests this year only to risk undermining long-term public backing for them?
6 min read
Image of a test sheet.