Federal

Debate About Impact of Ed Tech on Test Scores Fueled by Study

By Jason Kazi — September 13, 2016 5 min read
  • Save to favorites
  • Print

The latest attempt by researchers to determine the impact of educational technology investments on student achievement suggests that federal E-rate program subsidies that schools receive are unlikely to improve student test scores.

This new study could fuel debates about the link between technology investments and student achievement. But several ed-tech experts said the premise of the study is largely misguided and some of the methodology is flawed.

The research—conducted by scholars at Clemson University’s Department of Economics and the Georgetown Center for Business and Public Policy—shows no direct correlation between the use of annual E-rate subsidies and SAT scores in North Carolina’s public schools.

In North Carolina, composite SAT test scores fell as E-rate funding increased. That led the researchers to suggest that districts aren’t getting the return on investment that they should from spending thousands of dollars on added technology in their classrooms.

“The argument that was made to increase the [E-rate] funding up to $4 billion per year was that there was a positive outcome,” said Thomas Hazlett, a professor of economics at Clemson and one of the study’s authors. “We need to show increased test scores to be able to support the next $4 billion of investments.”

But suggesting that the districts are not getting a valuable return on investment based solely on SAT scores is a conclusion full of problems, several experts said.

To begin with, both K-12 leaders and the Federal Communications Commission agree that the intended purpose of the E-rate program from the very beginning has always been to provide a level playing field for all school districts in terms of access to technology, not as a direct means to increase test scores. Plus, they say it is problematic to suggest that E-rate funding would have a direct link to test scores, because there are so many other factors that influence academic performance.

Mixed Picture

The findings show that as E-rate funding rose in North Carolina during the 2009-2013 period, average mathematics SAT test scores actually dropped from 493 to 481. The average written SAT test score also dropped from 454 in 2009 to 448 in 2013. However, average critical reading SAT test scores saw a slight increase.

While the study claims to “adjust for demographic differences,” it does not clearly outline which factors are being used to distinguish a wealthy school district from a poorer school district.

Academic Return From the E-rate?

A new study conducted by researchers at Clemson and Georgetown universities attempts to examine the link between the E-rate program and student achievement.

The study:

  • COMPARES rising E-rate investments with SAT scores for students across North Carolina between 1999 and 2013;
  • EXAMINES the performance of students in Mooresville, N.C., a district with an international reputation for its extensive use of digital learning;
  • BASES its conclusions on the performance of students in 374 high schools in 119 districts;
  • CONCLUDES that, in most cases, the correlation between E-rate funding and SAT scores is negative;
  • SUGGESTS that policymakers need to take a harder look at the return on investment from the E-rate program.

Source: Clemson University, Georgetown University

The study also specifically examined the Mooresville County schools, a district with an international reputation for its extensive use of educational technology. The results from Mooresville present a mixed picture.

They show that as E-rate funding rose in North Carolina during the 2009-2013 period, average mathematics SAT test scores for the district dropped to a low of 499 in 2012 before returning to 520 in 2013. The average written SAT test scores in Mooresville dropped to a low of 457 in 2011 before returning to 482 in 2013. Additionally, the average critical reading SAT test scores dropped to a low of 478 in 2011 before returning to 500 in 2013.

“The article attempts to correlate SAT performance with federal E-rate program spending,” said Brendan Desetti, the director of education policy at The Software & Information Industry Association. “However, only about half of all high school students take the SAT and the majority of test takers are not low-income students. The E-rate program, on the other hand, provides subsidies for broadband connectivity to schools and libraries based on the number of low-income individuals served. Higher-income students, those more likely to participate in the SAT, are also shown to be more likely to have access to high-speed internet and other technology outside of the classroom.”

Other studies cloud the picture about the impact of technology investments on student achievement. For instance, a 2015 study by the Organization for Economic Cooperation and Development found that ed-tech investments made in 31 countries did not lead to improved student achievement. However, a Michigan State University meta-analysis released in 2016 showed a link between improved test scores and access to computers.

EducationSuperHighway, a nonprofit working to bring internet to every classroom in the United States to enhance digital learning opportunities, has been a big advocate for E-rate funding across the country.

“The most important thing with the E-rate program is for it to continue to focus on how we are achieving the goals and to make sure that schools and school districts (the beneficiaries) have the tools that they need to be the most effective purchasers of broadband that they can be,” said Evan Marwell, the founder and CEO of EducationSuperHighway. “They can ensure that the taxpayers’ money is used in the best way possible.”

Study ‘Fundamentally Flawed’

The FCC overhauled and modernized the E-rate program in late 2015 by using data to drive its policy changes.

In collaboration with educational nonprofit organizations, the FCC felt the need to move the program away from basic telephone lines to fiber-optic broadband connectivity. The policy changes expanded the options school districts had to build up their Wi-Fi infrastructure.

Most educational experts say today’s classrooms must be both broadband and Wi-Fi-capable to allow teachers and students to use technology in the most effective ways.

According to data gathered by EducationSuperHighway, 5 million public schools had broadband in 2014. That number grew to 27 million public schools in 2015. This increase can largely be attributed to the FCC’s modernization of the E-rate program, according to ed-tech experts. FCC data also caused the agency to make all of its E-rate data pertaining to who’s buying what, from whom, and at what price open to the public. As a result, the cost paid by schools for broadband has been cut in half since 2014, from $22 per megabit to $11 per megabit.

“I think that overall the study [by Clemson and Georgetown] is fundamentally flawed,” said Marwell. “The E-rate program has made a level playing field by providing every student and teacher in the country with equal and efficient access to the Internet. The E-rate program is about access, not achievement. The people who know teaching and learning the best are in the classroom and improving learning for children.”

FCC officials echoed Marwell.

“The Telecommunications Act of 1996 directed the FCC to provide schools and libraries with broadband, which is exactly what the E-rate program is doing,” said Mark Wigfield, deputy director of the office of media relations at the FCC. “While we can’t comment on the study’s analysis of educational outcomes, the demand for E-rate funding from schools and libraries makes it clear that access to broadband is essential to learning today.”

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Reading & Literacy Webinar
(Re)Focus on Dyslexia: Moving Beyond Diagnosis & Toward Transformation
Move beyond dyslexia diagnoses & focus on effective literacy instruction for ALL students. Join us to learn research-based strategies that benefit learners in PreK-8.
Content provided by EPS Learning
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
Cohesive Instruction, Connected Schools: Scale Excellence District-Wide with the Right Technology
Ensure all students receive high-quality instruction with a cohesive educational framework. Learn how to empower teachers and leverage technology.
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School Climate & Safety Webinar
How to Use Data to Combat Bullying and Enhance School Safety
Join our webinar to learn how data can help identify bullying, implement effective interventions, & foster student well-being.
Content provided by Panorama Education

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Federal What JD Vance and Tim Walz Said About School Safety in VP Debate
Education came up in the vice presidential debate, unlike the debate between Donald Trump and Kamala Harris.
3 min read
Republican vice presidential nominee Sen. JD Vance, R-Ohio, and Democratic vice presidential nominee Minnesota Gov. Tim Walz participate in a vice presidential debate hosted by CBS News Tuesday, Oct. 1, 2024, in New York.
Republican vice presidential nominee Sen. JD Vance, R-Ohio, and Democratic vice presidential nominee Minnesota Gov. Tim Walz participate in a vice presidential debate hosted by CBS News Tuesday, Oct. 1, 2024, in New York.
Matt Rourke/AP
Federal Opinion Project 2025's Education Lead on the Controversial Policy Agenda
Here’s what the lead author of the education section in the Heritage Foundation’s proposal has to say.
9 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
Federal Moms for Liberty Co-Founder Would Be 'Honored' to Be Trump's Education Secretary
The conservative education activist is "as much in the mix as anyone," according to a former GOP congressional staffer.
8 min read
Republican presidential nominee former President Donald Trump dances with Moms for Liberty co-founder Tiffany Justice during an event at the group's annual convention in Washington, Friday, Aug. 30, 2024.
Republican presidential nominee former President Donald Trump dances with Moms for Liberty co-founder Tiffany Justice during an event at the group's annual convention in Washington, Friday, Aug. 30, 2024.
Mark Schiefelbein/AP
Federal Opinion Project 2025 Might Feel New, But Its Roots Reach Back Decades
It represents the culmination of a movement to gut public education, writes Bettina L. Love.
4 min read
A group of school children is stopped from entering a bright red doorway by a large hand.
Vanessa Solis/Education Week + Getty Images