Opinion
Federal Opinion

Research and Effectiveness

By Robert E. Slavin — October 17, 2006 6 min read
  • Save to favorites
  • Print

—Patti Raine

BRIC ARCHIVE

Over the summer, an insightful essay in these pages contrasted two conflicting philosophies embedded within the No Child Left Behind Act: one dedicated to “what works,” the other to “whatever works.” (“What Works vs. Whatever Works,” July 26, 2006.) The “what works” philosophy, explained the author, expects the federal law to promote the use of proven programs. The “whatever works” philosophy, in contrast, seeks to set tough accountability standards but then allow great freedom for schools to do whatever it is that results in success for children. The struggle between adherents of these opposing philosophies, he argued, will determine the future course of the federal legislation.

This description by former U.S. Department of Education official Michael J. Petrilli of the two “theories of action” and their centrality to the debate over the law’s upcoming reauthorization is perceptive. But No Child Left Behind in theory does not resemble No Child Left Behind in fact. Despite the legislation’s many references to “scientifically based research,” evidence of effectiveness is not yet a significant factor in its implementation.

Early on in the “No Child” era, Education Department leaders seemed serious about the “what works” philosophy. But they faced a dilemma in putting it into practice. They felt there was too little high-quality research on too few programs, and too few reviews of research on practical programs, to make confident statements about what works in most arenas. They abandoned the idea of promoting programs with strong evidence of effectiveness and instead applied a far lower standard of evidence, promoting programs “based on scientifically-based evidence,” meaning that they somehow incorporate elements that have been successfully evaluated, even if the programs themselves have not.

Accountability alone is insufficient. American education has been pursuing accountability-only policies for a quarter-century, with little to show for it.

At the same time, the reconfigured federal research entity, the Institute of Education Sciences, under the leadership of Grover J. “Russ” Whitehurst, set to work to add to the research base for educational practice. Since 2002, the IES has funded scores of high-quality, randomized evaluations of all sorts of programs and practices, prekindergarten to grade 12. It also is funding development of many new programs, as well as basic research it hopes will ultimately lead to applied programs. The IES established the What Works Clearinghouse to review existing research, and is now talking about a second “promising practices” initiative. Meanwhile, the National Institute of Child Health and Human Development and private foundations, especially the W.T. Grant Foundation, are also funding much high-quality research and development on practical programs for schools.

All of this unprecedented R&D activity focused on directly improving educational practice is now beginning to bear fruit. As the No Child Left Behind Act heads toward reauthorization, it is time to think about how the law can capitalize on the advances in research set in motion.

Instead of being set in opposition to each other, the “what works” and “whatever works” philosophies should be seen as partners: two approaches to reform that complement each other. Some form of accountability for student achievement is necessary, and government has little reason to prescribe programs or practices to schools that are demonstrably succeeding.

But accountability alone is insufficient. American education has been pursuing accountability-only policies for a quarter-century, with little to show for it. National Assessment of Educational Progress reading scores have hardly changed since 1980, when the accountability movement got under way.

Educational practice will not change for the better until educators have and use more-effective tools, such as programs, technologies, and practices known from rigorous evaluation research to be effective. Accountability pressure should lead educators to seek effective programs and implement them with integrity. When educators feel pressure to increase scores but do not have available proven solutions, they all too often resort to gamesmanship, adopting practices that increase scores without increasing learning, such as narrowing the curriculum, holding more students back, and emphasizing test-taking skills over important learning.

The question for policymakers serious about using the No Child Left Behind law as a lever to bring about genuine change is how to balance a focus on proven programs with a need for flexibility and local control. In general, the rule should be that as long as a school is meeting performance standards and is not seeking additional federal funding, the federal government has no business telling local educators what to do. But when schools are not meeting standards, and especially when they are seeking discretionary funding, the federal government has the right and the responsibility to encourage the use of programs known to be effective.

One approach that might produce the proper balance would be to include in a broad category of federal requests for applications for schools, districts, and states a bonus of up to 10 points, on a scale of 100, if the applicant commits to the use of programs with strong evidence of effectiveness. “Strong evidence of effectiveness” means that the program has been evaluated in comparison to randomized or matched control groups in studies that, for example, meet the standards of the What Works Clearinghouse. If the program area had not yet been reviewed by the clearinghouse, applicants could present evidence from other reviews using similar standards. If applicants were participating in or carrying out bona fide randomized evaluations of promising programs not yet known to be effective, they might also qualify for the bonus.

When educators feel pressure to increase scores but do not have available proven solutions, they all too often resort to gamesmanship.

Proposers would receive the bonus only if they committed to fully implementing whatever research-proven program they selected, with adequate professional development and follow-up. The bonus would be available for discretionary programs, such as Reading First, Striving Readers, and others intended to increase student achievement. Schools not meeting standards might be given 10 bonus points if their applications for additional funding to help them achieve their goals promised to implement proven programs. In fact, the same principle might be applied to funding in any area in which there are programs with strong evidence of effectiveness.

The effect of such a bonus would be dramatic. No grant writer lightly ignores the possibility of 10 points. Yet the offer of the bonus would not force anyone to do anything.

Moreover, the 10 percent bonus could have a substantial effect on the entire R&D enterprise, as developers, publishers, and technology companies would have a strong incentive to carry out or commission high-quality research on promising programs. Government, especially at the federal level, would also have a strong incentive to fund R&D on promising programs, as policymakers would know that successfully evaluated programs were likely to be broadly disseminated.

Any successful initiative to promote the use of proven programs could finally move the practice of education toward the kind of progress over time that medicine, agriculture, and other fields have experienced when government action has broken through resistance to innovation. Such an initiative could unleash the creative power of American innovators, who could find effective solutions to educational problems if they were certain that these solutions would be widely adopted. This approach is essentially cost-free, as it would simply put to better use funds that federal, state, and local governments already are spending on programs for struggling schools.

America can solve its educational problems the way it has solved so many others—through innovation, creativity, and research and development. It is time for government to take the actions that fit the words in the No Child Left Behind Act promoting the use of proven programs.

A version of this article appeared in the October 18, 2006 edition of Education Week as Research and Effectiveness

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Artificial Intelligence Webinar
Teaching Students to Use Artificial Intelligence Ethically
Ready to embrace AI in your classroom? Join our master class to learn how to use AI as a tool for learning, not a replacement.
Content provided by Solution Tree
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
Empowering Students Using Computational Thinking Skills
Empower your students with computational thinking. Learn how to integrate these skills into your teaching and boost student engagement.
Content provided by Project Lead The Way
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
IT Infrastructure & Management Webinar
The Reality of Change: How Embracing and Planning for Change Can Shape Your Edtech Strategy
Promethean edtech experts delve into the reality of tech change and explore how embracing and planning for it can be your most powerful strategy for maximizing ROI.
Content provided by Promethean

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Federal 5 Trump Education Priorities for a Second Term
With key players appointed to their cabinet positions, the scaffolding for President-elect Donald Trump's second term is taking shape.
7 min read
President-elect Donald Trump takes the stage before speaking at the FOX Nation Patriot Awards on Dec. 5, 2024, in Greenvale, N.Y.
President-elect Donald Trump takes the stage before speaking at the FOX Nation Patriot Awards on Dec. 5, 2024, in Greenvale, N.Y. With the frameworks now in place, Trump has laid priorities for education.
Heather Khalifa/AP
Federal Here's How Much Linda McMahon's Foundation Has Donated to Education Causes
The president-elect's pick for education secretary has long given to education causes through her family foundation.
5 min read
Linda McMahon, former Administrator of Small Business Administration, speaks during the Republican National Convention on July 18, 2024, in Milwaukee.
Linda McMahon, former Administrator of Small Business Administration, speaks during the Republican National Convention on July 18, 2024, in Milwaukee. McMahon, Trump's choice to lead the U.S. Department of Education in his second term, has a long history of giving to education causes through her family foundation.
J. Scott Applewhite/AP
Federal Republicans Preview Their Education Priorities in a Second Trump Term
In a hearing, Republicans called for more civics education and expressed concerns over "critical race theory" in schools.
5 min read
Rep. Aaron Bean, R-Fla., Chair of the House Subcommittee on Early Childhood, Elementary, and Secondary Education, speaks during a hearing on antisemitism in K-12 public schools, Wednesday, May 8, 2024, on Capitol Hill in Washington.
Rep. Aaron Bean, R-Fla., chair of the House Subcommittee on Early Childhood, Elementary, and Secondary Education, speaks during a hearing on antisemitism in K-12 public schools on May 8, 2024, in Washington. At a hearing on Dec. 4, 2024, the subcommittee discussed civics and government curriculum.
Jacquelyn Martin/AP
Federal Opinion The Trump Administration Should 'Devolve the Ed Dept.'s Responsibilities to the States'
After six years helming the House ed. committee, U.S. Rep. Virginia Foxx cuts loose on high points and frustrations of her tenure.
8 min read
The United States Capitol building as a bookcase filled with red, white, and blue policy books in a Washington DC landscape.
Luca D'Urbino for Education Week