School & District Management

Digital Learning Tools Are Everywhere, But Gauging Effectiveness Remains Elusive, Survey Shows

By Alyson Klein — September 17, 2019 5 min read
  • Save to favorites
  • Print

Educators are using digital tools to boost student learning more than ever. But few believe there’s good information available about which resources are going to be effective in the classroom.

That’s the takeaway from a survey released last week by the NewSchools Venture Fund, a nonprofit venture-philanthropy firm that works with K-12 schools, and by Gallup, a polling organization.

The survey found that about two-thirds of teachers—65 percent—use digital tools every day and about 53 percent say they would like to use technology more often. (Those findings present something of a contrast with an Education Week survey conducted earlier this year, which found that only 29 percent of teachers felt strongly that ed tech supports innovation in their own classrooms.)

Despite the enthusiasm for technology found in the NewSchools-Gallup survey, teachers and administrators also reported that they don’t have as much information as they’d like about which digital tools actually help students master content.

Wanted: Proof of Effectiveness

A new survey shows the percentages of teachers in specific subject areas who report having a lot of information about the effectiveness of the digital learning tools they use.

Reading: 35%

English-language learning: 31%

History/Social Studies: 28%

Math: 27%

Special education: 27%

English/Language arts: 25%

Science: 21%

Source: The Education Technology Use in Schools report, NewSchools Venture Fund/Gallup

In fact, only about a quarter of teachers—27 percent—said they had a lot of information about the effectiveness of the digital tools they used. And only about 25 percent of principals and 18 percent of administrators say there’s a lot of evidence-based information available about the effectiveness of digital-learning tools used in their districts.

‘A Healthy Dynamic’

More than a third of teachers cited a tool’s ability to provide “actionable data on students’ progress” at the top of their list of criteria in selecting digital resources for the classroom.

And nearly two-thirds of the educators who took the survey—65 percent—said they’ve jettisoned a digital tool that they had initially piloted or adopted. Forty-one percent cited lack of improvement in student learning outcomes as a primary reason for ditching a digital resource. And 27 percent mentioned cost.

That’s not necessarily all bad, said Stacey Childress, the chief executive officer of the NewSchools Venture Fund.

“You could be of two minds about this,” Childress said. “In many ways, [it’s] a good sign that folks aren’t locked in to things that aren’t working well. That’s a healthy dynamic.”

On the flip side, though, 65 percent is “pretty high,” she added. “We need to ensure that by the time the tool gets to the classroom, the product-development process and small-scale evaluation process have made sure the product works for the situation in which it’s being implemented—so that more of these are likely to work by the time they get to classrooms.”

And she said teachers and administrators need more specifics about what context a digital tool might be suited for.

“There are big gaps between teachers’ optimism about what technology can bring to the classroom and their desire to use it even more—and the information that is available to them,” Childress said.

In the absence of clear evidence, though, educators say they are testing out digital tools largely through trial and error.

“We end up just kind of trying them out to see if they are going to be a great tool,” said Jamie Richardson, the principal of LaCreole Middle School in Dallas, Ore. “You have to get in there and try it out and see how easy or functional it is.”

He asks his teachers to regularly share resources that have worked for them. And he speaks often to other administrators to get their advice on the best tools available.

Lack of Training Is a Problem

In fact, 94 percent of teachers say they are most likely to get information on digital-learning tools from other teachers. Eighty-five percent get the information from their school or district. Nearly half choose from a list provided by their district. And 58 percent say they get input on new tools by looking at social media.

“I fall down that rabbit hole of Twitter way too often,” said Kristina MacBury, the principal of Sarah Pyle Academy, a public school in Wilmington, Del., that offers a nontraditional dropout-prevention program and is part of the Christina school district. Seeing how other schools are using new technology “build[s] a snowball of excitement.”

Substantial barriers to using technology in the classroom still exist, the survey found. More than half of teachers—56 percent—cited lack of training as a “significant” or “extremely significant” problem. Nearly half say that some teachers believe nondigital tools are more effective. And 46 percent said the problem was that they weren’t sure which tools to use.

“We do believe the survey results show, overall, a very positive view among educators about the current use of technology and optimism about using it in the future. It’s higher than what was expected,” Childress said. “The real story in the survey is a little deeper, in the way that teachers are using it in classrooms. There are things they wish digital tools were better supporting them on.”

Still, educators are optimistic about the potential impact of education technology. Ninety percent of teachers say that it’s helpful in doing research or searches for information. And 71 percent of teachers, and 78 percent of principals, view it as a good tool to get students to work on projects with others.

“Technology helps kids collaborate and think more creatively,” said Darren Ellwein, the principal of South Middle School in Harrisburg, S.D. “It really helps facilitate creativity and innovation.”

Educators are ponying up their own money for digital resources, too. In fact, more than 4 in 10 teachers reported that they had used money out of their own pockets to cover the cost of classroom technology, according to the survey.

That’s happened at Sarah Pyle Academy.

“I always say no, let me reimburse you,” MacBury said. But sometimes teachers will “get excited [about something] and say, ‘I want to try this out,’ or they want to bring it to me with some solid evidence that it’s working or why it’s working.”

The NewSchools-Gallup survey was generated from a sample of 3,210 P-12 teachers, 1,163 principals, 1,219 district-level administrators, and 2,696 public school students. The surveys were conducted from Jan. 29 to March 25 of this year. The survey has a margin of error of 2.1 for teachers, 3.5 for principals, 3.2 for district administrators, and 2.3 for students.

EdWeek Market Brief Managing Editor Sean Cavanagh contributed to this report.
A version of this article appeared in the September 18, 2019 edition of Education Week as Digital Tools Are Everywhere, But Evidence of Impact Is Not

Events

Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
Ed-Tech Policy Webinar Artificial Intelligence in Practice: Building a Roadmap for AI Use in Schools
AI in education: game-changer or classroom chaos? Join our webinar & learn how to navigate this evolving tech responsibly.
Education Webinar Developing and Executing Impactful Research Campaigns to Fuel Your Ed Marketing Strategy 
Develop impactful research campaigns to fuel your marketing. Join the EdWeek Research Center for a webinar with actionable take-aways for companies who sell to K-12 districts.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management Teachers Hate All Those Meetings. Can Principals Find a Workaround?
Principals can't do away with every meeting, but they can reduce some and make others more effective.
4 min read
Image of a staff meeting.
E+/Getty
School & District Management Q&A When This Principal Talks About Mental Health, People Listen. Here's Why
The NASSP Advocacy Champion of the year said he used stories from his school and community to speak with his state’s legislators.
6 min read
Chris Young, a principal from Vermont, poses for a photo in front of a Senate office building in Washington, D.C.
Chris Young, a principal from Vermont, stands in front of a Senate office building in Washington on March 13, 2024. Young was among the secondary principals to meet with legislators urging them to keep federal funding for schools stable.
Olina Banerji/Education Week
School & District Management Teacher Layoffs Are Mounting. How Districts Can Soften the Blow
Layoffs are coming in districts large and small. Here's how district leaders can handle them.
8 min read
Pencil Eraser Erasing Drawn Figure
AndreyPopov/iStock/Getty
School & District Management Opinion 5 Strategies to Combat Student Disengagement
When principals get serious about building a more inclusive school community, it doesn’t just benefit students, but teachers as well.
Michelle Singh
5 min read
Illustration of a bright vibrant school where students feel welcomed. In the background the sky is filled with enthusiastic raised hands.
Vanessa Solis/Education Week via Canva