Federal

Debate About Impact of Ed Tech on Test Scores Fueled by Study

By Jason Kazi — September 13, 2016 5 min read
  • Save to favorites
  • Print

The latest attempt by researchers to determine the impact of educational technology investments on student achievement suggests that federal E-rate program subsidies that schools receive are unlikely to improve student test scores.

This new study could fuel debates about the link between technology investments and student achievement. But several ed-tech experts said the premise of the study is largely misguided and some of the methodology is flawed.

The research—conducted by scholars at Clemson University’s Department of Economics and the Georgetown Center for Business and Public Policy—shows no direct correlation between the use of annual E-rate subsidies and SAT scores in North Carolina’s public schools.

In North Carolina, composite SAT test scores fell as E-rate funding increased. That led the researchers to suggest that districts aren’t getting the return on investment that they should from spending thousands of dollars on added technology in their classrooms.

“The argument that was made to increase the [E-rate] funding up to $4 billion per year was that there was a positive outcome,” said Thomas Hazlett, a professor of economics at Clemson and one of the study’s authors. “We need to show increased test scores to be able to support the next $4 billion of investments.”

But suggesting that the districts are not getting a valuable return on investment based solely on SAT scores is a conclusion full of problems, several experts said.

To begin with, both K-12 leaders and the Federal Communications Commission agree that the intended purpose of the E-rate program from the very beginning has always been to provide a level playing field for all school districts in terms of access to technology, not as a direct means to increase test scores. Plus, they say it is problematic to suggest that E-rate funding would have a direct link to test scores, because there are so many other factors that influence academic performance.

Mixed Picture

The findings show that as E-rate funding rose in North Carolina during the 2009-2013 period, average mathematics SAT test scores actually dropped from 493 to 481. The average written SAT test score also dropped from 454 in 2009 to 448 in 2013. However, average critical reading SAT test scores saw a slight increase.

While the study claims to “adjust for demographic differences,” it does not clearly outline which factors are being used to distinguish a wealthy school district from a poorer school district.

Academic Return From the E-rate?

A new study conducted by researchers at Clemson and Georgetown universities attempts to examine the link between the E-rate program and student achievement.

The study:

  • COMPARES rising E-rate investments with SAT scores for students across North Carolina between 1999 and 2013;
  • EXAMINES the performance of students in Mooresville, N.C., a district with an international reputation for its extensive use of digital learning;
  • BASES its conclusions on the performance of students in 374 high schools in 119 districts;
  • CONCLUDES that, in most cases, the correlation between E-rate funding and SAT scores is negative;
  • SUGGESTS that policymakers need to take a harder look at the return on investment from the E-rate program.

Source: Clemson University, Georgetown University

The study also specifically examined the Mooresville County schools, a district with an international reputation for its extensive use of educational technology. The results from Mooresville present a mixed picture.

They show that as E-rate funding rose in North Carolina during the 2009-2013 period, average mathematics SAT test scores for the district dropped to a low of 499 in 2012 before returning to 520 in 2013. The average written SAT test scores in Mooresville dropped to a low of 457 in 2011 before returning to 482 in 2013. Additionally, the average critical reading SAT test scores dropped to a low of 478 in 2011 before returning to 500 in 2013.

“The article attempts to correlate SAT performance with federal E-rate program spending,” said Brendan Desetti, the director of education policy at The Software & Information Industry Association. “However, only about half of all high school students take the SAT and the majority of test takers are not low-income students. The E-rate program, on the other hand, provides subsidies for broadband connectivity to schools and libraries based on the number of low-income individuals served. Higher-income students, those more likely to participate in the SAT, are also shown to be more likely to have access to high-speed internet and other technology outside of the classroom.”

Other studies cloud the picture about the impact of technology investments on student achievement. For instance, a 2015 study by the Organization for Economic Cooperation and Development found that ed-tech investments made in 31 countries did not lead to improved student achievement. However, a Michigan State University meta-analysis released in 2016 showed a link between improved test scores and access to computers.

EducationSuperHighway, a nonprofit working to bring internet to every classroom in the United States to enhance digital learning opportunities, has been a big advocate for E-rate funding across the country.

“The most important thing with the E-rate program is for it to continue to focus on how we are achieving the goals and to make sure that schools and school districts (the beneficiaries) have the tools that they need to be the most effective purchasers of broadband that they can be,” said Evan Marwell, the founder and CEO of EducationSuperHighway. “They can ensure that the taxpayers’ money is used in the best way possible.”

Study ‘Fundamentally Flawed’

The FCC overhauled and modernized the E-rate program in late 2015 by using data to drive its policy changes.

In collaboration with educational nonprofit organizations, the FCC felt the need to move the program away from basic telephone lines to fiber-optic broadband connectivity. The policy changes expanded the options school districts had to build up their Wi-Fi infrastructure.

Most educational experts say today’s classrooms must be both broadband and Wi-Fi-capable to allow teachers and students to use technology in the most effective ways.

According to data gathered by EducationSuperHighway, 5 million public schools had broadband in 2014. That number grew to 27 million public schools in 2015. This increase can largely be attributed to the FCC’s modernization of the E-rate program, according to ed-tech experts. FCC data also caused the agency to make all of its E-rate data pertaining to who’s buying what, from whom, and at what price open to the public. As a result, the cost paid by schools for broadband has been cut in half since 2014, from $22 per megabit to $11 per megabit.

“I think that overall the study [by Clemson and Georgetown] is fundamentally flawed,” said Marwell. “The E-rate program has made a level playing field by providing every student and teacher in the country with equal and efficient access to the Internet. The E-rate program is about access, not achievement. The people who know teaching and learning the best are in the classroom and improving learning for children.”

FCC officials echoed Marwell.

“The Telecommunications Act of 1996 directed the FCC to provide schools and libraries with broadband, which is exactly what the E-rate program is doing,” said Mark Wigfield, deputy director of the office of media relations at the FCC. “While we can’t comment on the study’s analysis of educational outcomes, the demand for E-rate funding from schools and libraries makes it clear that access to broadband is essential to learning today.”

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Data Webinar
Education Insights with Actionable Data to Create More Personalized Engagement
The world has changed during this time of pandemic learning, and there is a new challenge faced in education regarding how we effectively utilize the data now available to educators and leaders. In this session
Content provided by Microsoft
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
Accelerate Learning with Project-Based Learning
Earlier this year, the George Lucas Educational Foundation released four new studies highlighting how project-based learning (PBL) helps accelerate student learning—across age groups, multiple disciplines, and different socio-economic statuses. With this year’s emphasis on unfinished
Content provided by SmartLab Learning
School & District Management Live Online Discussion Principal Overload: How to Manage Anxiety, Stress, and Tough Decisions
According to recent surveys, more than 40 percent of principals are considering leaving their jobs. With the pandemic, running a school building has become even more complicated, and principals' workloads continue to grow. If we

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Federal What Is a School Shooting? Members of Congress Seek a Federal Definition, Reliable Data
A new bill would direct federal departments to track data related to school shootings, a term for which there is no federal definition.
Daniela Altimari, Hartford Courant
4 min read
Police respond to the scene of a shooting at Heritage High School in Newport News, Va., on Saturday Sept. 20, 2021. Newport News police Chief Steve Drew said two students were shot and taken to the hospital and neither injury was thought to be life-threatening. The chief said authorities believe the suspect and victims knew one another but did not provide details.
Police respond to the scene of a shooting at Heritage High School in Newport News, Va., on Saturday Sept. 20, 2021.
John C. Clark/AP Photo
Federal Is the Justice Dept. Silencing Parents or Stepping Up to Protect Educators?
Merrick Garland's move to use the FBI to help protect school officials from violence and harassment has drawn anger and praise.
5 min read
Sen. Josh Hawley, R-Mo., speaks during the Senate Judiciary Committee hearing to examine Texas's abortion law, Wednesday, Sept. 29, 2021 on Capitol Hill in Washington.
Sen. Josh Hawley, R-Mo., speaks during the Senate Judiciary Committee hearing to examine Texas's abortion law, Wednesday, Sept. 29, 2021 on Capitol Hill in Washington.
Tom Williams/Pool via AP
Federal Don't Use Federal COVID Aid to Undermine School Mask Rules, U.S. Treasury Tells Governor
Arizona Gov. Doug Ducey violated the intent of COVID aid programs by using them to discourage school mask mandates, an agency letter says.
2 min read
Arizona Gov. Doug Ducey speaks at the Arizona Capitol in Phoenix on Nov. 30, 2020. A program announced by Arizona's Republican governor last month to give private school vouchers to students whose parents object to school mask requirements has seen a surge of applications, with twice as many either completed or started than can be funded with the $10 million in federal coronavirus relief cash he earmarked for the program.
A program announced by Arizona's Republican Gov. Doug Ducey in September earmarks federal money to give private school vouchers to students whose parents object to public school mask requirements.
Ross D. Franklin/AP
Federal Districts Would Have to Show Equity for High-Poverty Schools Under Proposed Biden Rule
The U.S. Department of Education says the move would promote transparency and accountability for schools getting COVID-19 aid.
4 min read
Illustration of a helping hand with dollar bill bridging economy gap during coronavirus pandemic, assisting business people to overcome financial difficulties.
Feodora Chiosea/iStock/Getty Images Plus