Opinion
Student Achievement Opinion

Why We Need to Study the Tutors

By Megan Beckett — January 19, 2010 4 min read
  • Save to favorites
  • Print

Based on the results of statewide standardized tests, more than 15 percent of U.S. schools are in need of improvement. The students attending these schools need help.

Under the federal No Child Left Behind Act, billions of dollars have been dedicated to providing them with better educational opportunities. Up to 20 percent of districts’ Title I funds, for example, must be set aside to transport such students to higher-performing schools, or to provide their parents with the option of enrolling them, at no cost to the family, in supplemental educational services chosen from a list of state-approved providers. The providers may be for-profit companies, nonprofit organizations, or even school districts themselves, and they can offer tutoring, remediation, or other academic instruction.

BRIC ARCHIVE

In this era of accountability and competition, one might expect that providers of supplemental educational services, or SES, would be evaluated according to how well they help the students they are paid to serve. But as it stands now, NCLB emphasizes ensuring that all providers have access to parents, over rigorous evaluation of the providers.

Unfortunately, states are effectively precluded from conducting the most rigorous evaluations of whether supplemental educational services benefit students, and, if so, which providers are most (and least) effective.

The No Child Left Behind law effectively bars states from employing one of the most important techniques for evaluating the effectiveness of a tutor, a new medicine, or any other intervention: randomization. Allowing states to randomly assign the children of consenting parents to a specific SES provider among those available, or to receive no supplemental educational services, would add greatly to what can now be inferred about provider quality. While the prohibition against this evaluation method may have been put in place to promote parent choice, the result has been that parents lack sufficient information from which to choose a provider. And it is unlikely that providers have strong incentives to compete on quality with the minimum level of reporting now required.

In other contexts, so-called social experiments of this kind have not only been permitted by states, but congressionally mandated as well. The Housing Assistance Supply Experiment, funded by the U.S. Department of Housing and Urban Development in the mid-1970s, showed policymakers that cash housing allowances benefited the neediest families more than constructing public housing, and cost less. Similarly, the Health Insurance Experiment of that decade, also federally funded, randomly assigned families to insurance plans ranging from free care to 95 percent payment. It found that families with free care used 50 percent more health services than those in cost-sharing arrangements or health maintenance organizations, with negligible benefits to the average person’s health.

Such experiments provide critical insight into what social policies work, and have been instrumental in improving policy.

There are other ways evaluators try to compare groups of people who do and do not receive services. For example, although on average fewer than 20 percent of students eligible for supplemental services sign up to receive them, a small number of school districts are oversubscribed—more students sign up than can be accommodated. In such a district, one can compare changes in achievement outcomes for students selected to receive services with those who signed up but were not served.

Such a design is being used for a national evaluation of supplemental-services providers. But ultimately, it is not clear how the results from these few districts, where SES providers may be much better or parents and students more motivated, can tell us about the effectiveness of supplemental services in the majority of school districts.

The pending reauthorization of the Elementary and Secondary Education Act—the law that’s been known as No Child Left Behind since its last revision eight years ago—provides an excellent opportunity to set up a powerful system to evaluate supplemental-services providers, one modeled on the best social experiments of the 1970s.

Congress could permit, incentivize, or mandate state demonstration projects so that states could more easily use some of their SES funds for rigorous comparative-effectiveness research. During the initial phase of such a project, rather than allowing parents to choose among tutors, students could be randomly assigned to a certified provider offering services in the area. Changes in their academic results would then be compared with those of other groups of students.

Congress should, in addition, allocate financial resources to enable states to undertake rigorous evaluations of SES providers. This simple, yet powerful, evaluation method using random assignment, combined with other approaches, would not deny tutoring to students, but would tell us if better performance of the students assigned to one provider is due to the provider, or if some providers merely attract better students. In the end, all students would benefit.

A version of this article appeared in the January 20, 2010 edition of Education Week as Why We Need to Study the Tutors

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Equity & Diversity Webinar
Classroom Strategies for Building Equity and Student Confidence
Shape equity, confidence, and success for your middle school students. Join the discussion and Q&A for proven strategies.
Content provided by Project Lead The Way
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Professional Development Webinar
Disrupting PD Day in Schools with Continuous Professional Learning Experiences
Hear how this NC School District achieved district-wide change by shifting from traditional PD days to year-long professional learning cycles
Content provided by BetterLesson
Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Student Achievement Spotlight Spotlight on Online Tutoring
This Spotlight will help you examine research outlining the benefits of online tutoring, identify best practices, and more.

Student Achievement Clearing the Hurdles to Effective School Tutoring Programs
What makes tutoring work? What are the challenges? Two researchers and a principal discuss.
3 min read
A woman points at a line on a work sheet while a male student watches.
iStock/Getty
Student Achievement Talking High-Dosage Tutoring: A Researcher and Schools Chief Share Strategies
Two champions of high-dosage tutoring explain what makes a successful program.
1 min read
Charvi Goyal, 17, gives an online math tutoring session to a junior high student Monday, Jan. 4, 2021, in Plano, Texas. Goyal is part of a group of high school students that put together their own volunteer online tutoring service to help k-12 during the pandemic.
Charvi Goyal, 17, gives an online math tutoring session to a junior high student on Monday, Jan. 4, 2021, in Plano, Texas. Virtual tutoring was used in another Texas district to scale up a high-dosage tutoring program.
LM Otero/AP
Student Achievement 'Don't Reinvent The Wheel': How One District Made a Tutoring Program That Works
A North Carolina superintendent turned to tutoring to help students catch up long before COVID-19 pushed others in that direction.
1 min read
Andrew Houlihan, left, is the superintendent in Union County and developed a high-dosage tutoring strategy to combat student learning loss. Pictured here on Dec. 16, 2021 as he talks with Porter Ridge High School students Eriana Tucker and Lillie Curtis following lunch in the cafeteria.
Andrew Houlihan, left, is the superintendent in Union County and developed a high-dosage tutoring strategy to combat student learning loss. Pictured here on Dec. 16, 2021 as he talks with Porter Ridge High School students Eriana Tucker and Lillie Curtis following lunch in the cafeteria.
Alex Boerner for Education Week