Classroom Technology

What Factors Make-or-Break Ed-Tech Implementation? Study Takes a Look

By Michele Molnar — March 17, 2020 4 min read
  • Save to favorites
  • Print

When an ed-tech product doesn’t get much traction in the school district that bought it, someone inevitably asks: What went wrong?

The EdTech Genome Project last year started to tackle that problem to help educators and district administrators make better-informed decisions about education technology.

The “genome” project—a collaborative effort involving more than 100 education research and advocacy organizations—is mapping the many factors that influence the outcome of an ed-tech product’s usage.

Ultimately, they identified about 80 variables. And recently, they winnowed the field to what they deemed to be the 10 most worthy of more study this year. Those implementation factors are:

  • Adoption plans
  • Competing priorities
  • Foundational resources, such as technology and financial resources and operational tech support
  • Implementation plans
  • Professional development/learning and support
  • School or staff culture
  • Support from school and district administration
  • Teacher agency or autonomy
  • Teachers’ beliefs about technology/self-efficacy and technological pedagogical-content knowledge
  • Vision for teaching and learning with technology

Each variable is being evaluated further by a working group that will build consensus about how to define and measure them those factors, said Bart Epstein, the president and CEO of the Jefferson Education Exchange, which is leading the project. JEX is a nonprofit affiliated with the University of Virginia Curry School of Education and Human Development.

These variables that make or break implementation echo comments Johns Hopkins University has heard in its longitudinal studies of school districts’ ed-tech initiatives, said Steven M. Ross, a senior research scientist and professor at the Center for Research and Reform in Education there.

Although Johns Hopkins has not studied the same 10 factors, many of them have been mentioned as important by teachers and administrators in the center’s ongoing work with such districts as 111,000-student Baltimore County in Maryland and 188,000-student Fairfax County in Virginia, he said.

“All of those factors are valuable to look at,” said Ross, “but, ultimately, the question is, ‘What raises achievement and what doesn’t?’”

What the Research Reflects

Having good implementation doesn’t necessarily mean math scores will go up, he said. “That may depend on the teacher.”

Epstein said the genome project identified the variables by reviewing academic research that showed they could be responsible for the success or failure of various interventions. Some studies found that it was impossible to get statistically significant data because a product or program wasn’t used enough, he said.

Among the working-group members trying to get more clarity by studying specific variables are representatives from school districts, research organizations, nonprofits, and companies across the country.

Eventually, the collaborating organizations plan to publish an implementation framework for educators, companies, and other interested parties late this year.

“Education is overdue to do what every other industry has done, which is to develop shared instruments of measurement and language to describe how the tools of their trade are applied,” said Epstein.

The lack of a common language and means of monitoring progress has created a challenge for teachers and administrators alike, according to Epstein.

“One thing that keeps coming up over and over is how much frustration there is in education when we have to rely on anecdotes,” he said. “When you go into a school and ask, ‘How much agency and authority do teachers have about the decision to bring in technology?,’ you’re almost sure to get anecdotes.”

The point of conducting this research is to “help schools understand how ready they are—or are not—for different products, programs, and policies,” said Epstein. “Districts across the U.S. are spending billions of dollars on well-intentioned efforts that fail because they don’t have the data to understand that their environment is not conducive to the success of what they’re buying.”

Did Specific Tools Work?

Ross commended the project’s intention to help districts conduct self-evaluations in areas they want to improve, and, he said the variables may be a useful checklist with “good discussion points” for educators and administrators alike. But he said they should have “reasonable expectations” about outcomes since “the jury is out as to what degree these tools and resources are actually used to make changes.”

Meanwhile, plans are underway for the next phase of study on implementation.

Next year, JEX expects to develop a platform that will allow districts to document the technologies in their classrooms, how they were chosen, and what the implementation is like. “In the interim, we’re collecting research manually and paying cash stipends to large numbers of educators in return for their taking the time to provide this information,” Epstein said.

The teachers document their experiences and perspectives to help ed-tech decisionmakers and policymakers understand and explain why any given ed-tech tool can work in some environments but not in others.

“The goal,” Epstein said, “is to avoid educators’ buying things that won’t work.”

A version of this article appeared in the March 18, 2020 edition of Education Week as Project Probes Gaps in Districts’ Ed-Tech Usage

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Families & the Community Webinar
Celebrate Family Engagement Day With Strategies That Work
Join National PTA and AASA to explore practical systems-wide family engagement strategies in celebration of National Family Engagement Day.
College & Workforce Readiness Webinar What Are the Fastest-Growing Career- and Work-Based Education Programs?
Join us to explore EdWeek Research Center survey data on which areas of CTE are expected to grow the fastest over the next 5 years.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Reading & Literacy Webinar
Prove What Works: How to Know Which Literacy Evidence to Trust
Learn how to evaluate literacy research, question claims, understand outcomes, and make more confident, evidence-based decisions.
Content provided by Lexia Learning

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Classroom Technology Students Made More Math, Reading Progress After Their Schools Banned Phones
A new study looked at student achievement over the long run in schools that adopted strict cellphone bans.
4 min read
A student at Glover Middle School in Spokane, Wash., checks their phone before the start of school on Dec. 3, 2025.
Student cellphones at Glover Middle School in Spokane, Wash., before the start of school on Dec. 3, 2025. A new study finds that schools' with bell-to-bell cellphone bans saw their students' math and reading achievement grow faster.
Kaylee Domzalski/Education Week
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Classroom Technology Sponsor
Choosing the Right Interactive Display for K-12 Classrooms
Discover how to choose the right interactive classroom displays based on technology needs, budgets, security, and long-term value.
Content provided by ViewSonic
A teacher points to a digital display showing diagrams of animal and plant cells during a science class.
Photo provided by ViewSonic
Classroom Technology From Our Research Center 'Techlash' Is Strongest in Suburban and Rural Schools
Attitudes of parents toward digital tools appear to vary by location, the EdWeek Research Center found.
2 min read
Collage art of a student, clock, and laptop.
Collage by Laura Baker/Education Week + Getty
Classroom Technology From Our Research Center Newer Educators Are Less Likely to Say Tech Helps Students Learn
Many teachers new to the profession are more sketpical than veterans about the value of devices.
2 min read
Katrina Sacurom, a teacher at Shawnee Trail Elementary School, in Frisco, Texas, works with her educator peers on Feb. 11, 2026. Sacurom has personalized her school's AI tool to mimic her writing style. A survey conducted by the EdWeek Research Center finds that educators who are relatively new to the profession are more skeptical that tech can positively influence learning than are veterans in the profession.
Emily Bennett teaches freshman algebra at DeTour High School/DeTour Arts and Technology Academy De Tour Village, Mich. on September 22, 2025. She is a first-year high school math teacher.
John T. Greilick/The Detroit News via TNS