Opinion
Federal Opinion

Research and Effectiveness

By Robert E. Slavin — October 17, 2006 6 min read
  • Save to favorites
  • Print

—Patti Raine

BRIC ARCHIVE

Over the summer, an insightful essay in these pages contrasted two conflicting philosophies embedded within the No Child Left Behind Act: one dedicated to “what works,” the other to “whatever works.” (“What Works vs. Whatever Works,” July 26, 2006.) The “what works” philosophy, explained the author, expects the federal law to promote the use of proven programs. The “whatever works” philosophy, in contrast, seeks to set tough accountability standards but then allow great freedom for schools to do whatever it is that results in success for children. The struggle between adherents of these opposing philosophies, he argued, will determine the future course of the federal legislation.

This description by former U.S. Department of Education official Michael J. Petrilli of the two “theories of action” and their centrality to the debate over the law’s upcoming reauthorization is perceptive. But No Child Left Behind in theory does not resemble No Child Left Behind in fact. Despite the legislation’s many references to “scientifically based research,” evidence of effectiveness is not yet a significant factor in its implementation.

Early on in the “No Child” era, Education Department leaders seemed serious about the “what works” philosophy. But they faced a dilemma in putting it into practice. They felt there was too little high-quality research on too few programs, and too few reviews of research on practical programs, to make confident statements about what works in most arenas. They abandoned the idea of promoting programs with strong evidence of effectiveness and instead applied a far lower standard of evidence, promoting programs “based on scientifically-based evidence,” meaning that they somehow incorporate elements that have been successfully evaluated, even if the programs themselves have not.

Accountability alone is insufficient. American education has been pursuing accountability-only policies for a quarter-century, with little to show for it.

At the same time, the reconfigured federal research entity, the Institute of Education Sciences, under the leadership of Grover J. “Russ” Whitehurst, set to work to add to the research base for educational practice. Since 2002, the IES has funded scores of high-quality, randomized evaluations of all sorts of programs and practices, prekindergarten to grade 12. It also is funding development of many new programs, as well as basic research it hopes will ultimately lead to applied programs. The IES established the What Works Clearinghouse to review existing research, and is now talking about a second “promising practices” initiative. Meanwhile, the National Institute of Child Health and Human Development and private foundations, especially the W.T. Grant Foundation, are also funding much high-quality research and development on practical programs for schools.

All of this unprecedented R&D activity focused on directly improving educational practice is now beginning to bear fruit. As the No Child Left Behind Act heads toward reauthorization, it is time to think about how the law can capitalize on the advances in research set in motion.

Instead of being set in opposition to each other, the “what works” and “whatever works” philosophies should be seen as partners: two approaches to reform that complement each other. Some form of accountability for student achievement is necessary, and government has little reason to prescribe programs or practices to schools that are demonstrably succeeding.

But accountability alone is insufficient. American education has been pursuing accountability-only policies for a quarter-century, with little to show for it. National Assessment of Educational Progress reading scores have hardly changed since 1980, when the accountability movement got under way.

Educational practice will not change for the better until educators have and use more-effective tools, such as programs, technologies, and practices known from rigorous evaluation research to be effective. Accountability pressure should lead educators to seek effective programs and implement them with integrity. When educators feel pressure to increase scores but do not have available proven solutions, they all too often resort to gamesmanship, adopting practices that increase scores without increasing learning, such as narrowing the curriculum, holding more students back, and emphasizing test-taking skills over important learning.

The question for policymakers serious about using the No Child Left Behind law as a lever to bring about genuine change is how to balance a focus on proven programs with a need for flexibility and local control. In general, the rule should be that as long as a school is meeting performance standards and is not seeking additional federal funding, the federal government has no business telling local educators what to do. But when schools are not meeting standards, and especially when they are seeking discretionary funding, the federal government has the right and the responsibility to encourage the use of programs known to be effective.

One approach that might produce the proper balance would be to include in a broad category of federal requests for applications for schools, districts, and states a bonus of up to 10 points, on a scale of 100, if the applicant commits to the use of programs with strong evidence of effectiveness. “Strong evidence of effectiveness” means that the program has been evaluated in comparison to randomized or matched control groups in studies that, for example, meet the standards of the What Works Clearinghouse. If the program area had not yet been reviewed by the clearinghouse, applicants could present evidence from other reviews using similar standards. If applicants were participating in or carrying out bona fide randomized evaluations of promising programs not yet known to be effective, they might also qualify for the bonus.

When educators feel pressure to increase scores but do not have available proven solutions, they all too often resort to gamesmanship.

Proposers would receive the bonus only if they committed to fully implementing whatever research-proven program they selected, with adequate professional development and follow-up. The bonus would be available for discretionary programs, such as Reading First, Striving Readers, and others intended to increase student achievement. Schools not meeting standards might be given 10 bonus points if their applications for additional funding to help them achieve their goals promised to implement proven programs. In fact, the same principle might be applied to funding in any area in which there are programs with strong evidence of effectiveness.

The effect of such a bonus would be dramatic. No grant writer lightly ignores the possibility of 10 points. Yet the offer of the bonus would not force anyone to do anything.

Moreover, the 10 percent bonus could have a substantial effect on the entire R&D enterprise, as developers, publishers, and technology companies would have a strong incentive to carry out or commission high-quality research on promising programs. Government, especially at the federal level, would also have a strong incentive to fund R&D on promising programs, as policymakers would know that successfully evaluated programs were likely to be broadly disseminated.

Any successful initiative to promote the use of proven programs could finally move the practice of education toward the kind of progress over time that medicine, agriculture, and other fields have experienced when government action has broken through resistance to innovation. Such an initiative could unleash the creative power of American innovators, who could find effective solutions to educational problems if they were certain that these solutions would be widely adopted. This approach is essentially cost-free, as it would simply put to better use funds that federal, state, and local governments already are spending on programs for struggling schools.

America can solve its educational problems the way it has solved so many others—through innovation, creativity, and research and development. It is time for government to take the actions that fit the words in the No Child Left Behind Act promoting the use of proven programs.

A version of this article appeared in the October 18, 2006 edition of Education Week as Research and Effectiveness

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Budget & Finance Webinar
Innovative Funding Models: A Deep Dive into Public-Private Partnerships
Discover how innovative funding models drive educational projects forward. Join us for insights into effective PPP implementation.
Content provided by Follett Learning
Budget & Finance Webinar Staffing Schools After ESSER: What School and District Leaders Need to Know
Join our newsroom for insights on investing in critical student support positions as pandemic funds expire.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Achievement Webinar
How can districts build sustainable tutoring models before the money runs out?
District leaders, low on funds, must decide: broad support for all or deep interventions for few? Let's discuss maximizing tutoring resources.
Content provided by Varsity Tutors for Schools

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Federal A Bipartisan Bill Aims to Boost AI Education for K-12 Teachers
A new bill would create a grant program at the National Science Foundation focused on AI and K-12 schools.
4 min read
Highway directional sign for AI Artificial Intelligence
Matjaz Boncina/iStock/Getty
Federal K-12 Leaders Denounce Antisemitism But Reject That It's Rampant in Schools
Three school district leaders said they're committed to rooting out antisemitism during a hearing in Congress.
6 min read
From left, David Banks, chancellor of New York Public schools, speaks next to Karla Silvestre, President of the Montgomery Count (Md.) Board of Education, Emerson Sykes, Staff Attorney with the ACLU, and Enikia Ford Morthel, Superintendent of the Berkeley United School District, during a hearing on antisemitism in K-12 public schools, at the House Subcommittee on Early Childhood, Elementary, and Secondary Education, on May 8, 2024, on Capitol Hill in Washington.
From left, David Banks, chancellor of New York City schools, speaks next to Karla Silvestre, president of the Montgomery County, Md., school board; Emerson Sykes, staff attorney with the ACLU; and Enikia Ford Morthel, superintendent of the Berkeley Unified school district in Berkeley, Calif., during a hearing on antisemitism in K-12 public schools, at the House Subcommittee on Early Childhood, Elementary, and Secondary Education, on May 8, 2024, in Washington.
Jacquelyn Martin/AP
Federal Miguel Cardona in the Hot Seat: 4 Takeaways From a Contentious House Hearing
FAFSA, rising antisemitism, and Title IX dominated questioning at a U.S. House hearing with Education Secretary Miguel Cardona.
6 min read
Secretary of Education Miguel Cardona testifies during a House Committee on Education and Workforce hearing on Capitol Hill, Tuesday, May 7, 2024, in Washington.
U.S. Secretary of Education Miguel Cardona testifies during a House Committee on Education and Workforce hearing on Capitol Hill on May 7 in Washington.
Mariam Zuhaib/AP
Federal Arming Teachers Could Cause 'Accidents and More Tragedy,' Miguel Cardona Says
"This is not in my opinion a smart option,” the education secretary said at an EdWeek event.
4 min read
U.S. Secretary of Education Miguel Cardona speaks during Education Week’s 2024 Leadership Symposium at the Hyatt Regency Crystal City in Arlington, Va., on May 2, 2024.
U.S. Secretary of Education Miguel Cardona speaks during Education Week’s 2024 Leadership Symposium at the Hyatt Regency Crystal City in Arlington, Va., on May 2, 2024.
Sam Mallon/Education Week