Ed-Tech Policy Opinion

Eight Steps to Improve the Ed-Tech Industry

By Susan H. Fuhrman — February 21, 2017 5 min read
  • Save to favorites
  • Print

No responsible investor would invest in a health-care-technology product that wasn’t thoroughly researched by top medical scientists. No one would invest in energy technology whose potential was unsupported by the studies and practices of relevant experts. Yet when it comes to education technology, the logical connection between evidence of effectiveness and the wisdom of investment decisions is often ignored.

It’s not for lack of relevant research. Throughout my tenure as president of Teachers College, I have marveled at how disconnected the instructional technology products have been from the groundbreaking work of our faculty and students (and of researchers elsewhere) in the learning sciences, classroom use of technology, learning analytics, and evaluation. The work of other major research universities is similarly overlooked by the ed-tech industry. Investors in other sectors, such as health and energy, eagerly draw on a wealth of researcher consultants and even firms to facilitate the connection between evidence and investment decisions. In education, however, aside from some big companies that can afford substantial studies, I have noted a hesitancy to invest in research on effectiveness, particularly among startup developers and venture capitalists.

Eight Steps to Improve the Ed-Tech Industry: The disconnect between ed-tech products and education research is failing students, writes the president of Teachers College, Columbia University.

I’ve heard many reasons for this hesitancy: an insufficient rate of investment opportunity in ed tech; a dysfunctional market, where educator purchasers value user testimonies and personal connections over evidence of effectiveness; and concerns that sharing data with researchers will expand the circle of those who might endanger student privacy. I also infer some deeper issues, including the age-old sentiment that anyone who went to school knows what works, as well as a distrust of researcher jargon and studies that appear inaccessible.

I also suspect a lack of appreciation within the ed-tech industry for how much investment good research requires. Educational research encompasses everything from studies that inform initial design to formal evaluation once a product has already been in use for a sufficient period of time. Research includes a variety of methodologies, including keystroke data analysis, classroom observation, and student outcome comparisons. While relatively inexpensive market research can produce data about the extent of usage or page views, which may be helpful in sales, those data do not tell us whether educational products are working. Research that aims at producing evidence of effectiveness is likely to be much more expensive.

But as is true in other industries, I believe that investing in better research will lead to increased market share and economic value over time. The throw-it-against-the-wall mentality—the notion that if one thing fails, something else will quickly take its place—is an inefficient alternative to research-based investment. Worse, it’s an upsetting failure of responsibility to students, who go through school only once. They don’t have time to keep trying bad products. Nor should scarce taxpayer money be gambled on products that will end up being a waste of time.

All this leads me to proclaim a set of resolutions for the ed-tech industry:

1. Use what we know about learning to develop product designs. Instead of building instructional products around an idea of learning, seek research and advice about how best to teach a particular topic, order concepts, present challenging tasks and assess learner knowledge. (The ABCs of How We Learn: 26 Scientifically Proven Approaches, How They Work, and When to Use Them by Daniel L. Schwartz, Jessica M. Tsang, and Kristen P. Blair is a great primer on the subject.)

The throw-it-against-the-wall mentality is an inefficient alternative to research-based investment."

2. Put educators or researchers on advisory boards of startups. Right now, investors serve on advisory boards, providing much-needed business-organization, marketing, sales, and financial expertise. Educational expertise—about learning and about how products work in classrooms and with various curricula—is just as critical for developing new ed-tech products.

3. Try products out in real settings, revising them again and again until they show promise for delivering results. Ideally, involve researchers in this task so trials provide valid and usable information.

4. Invest in teacher and school-leader professional development. School-based products are most effective when teachers know how to use them well, how to fit them into lessons or use them to supplement teacher-designed lessons, and how to guide and assess productive student use. Similarly, leaders should support teacher technology use and know how to determine whether teachers are using products effectively.

5. View implementation as an essential part of the process. Does the hardware work? How do the schools access the product most easily? Are data useful and usefully displayed? Include technical assistance, or coordination with in-school technology specialists, as part of the price package.

6. Work with buyers to determine how they judge effectiveness. Are they focusing on standardized tests as sole measures, or are they interested in other measures of effectiveness, such as teacher reports and student engagement? Make sure products can produce evidence on the measures valued by users.

7. Safeguard student privacy. The data collected through software use are intimate data about student learning that provide important insights about how students think. Therefore, security issues and protecting student identities are very important to educators and parents. Many school districts have developed contract language to assure such protections; both sellers and buyers should learn from one another about effective approaches. Researchers, too, must attend to privacy concerns; in the past, the field has not educated itself about adequate security.

8. Document when evidence about effectiveness helps sales and increases market share. Over time, research about the value of research may be the most important evidence we can gather to make the case for a focus on effectiveness.

I realize these are ambitious resolutions. But given the urgency of improving education in our country, especially in this pivotal moment, we can’t afford to settle for less.


Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
English-Language Learners Webinar English Learners and the Science of Reading: What Works in the Classroom
ELs & emergent bilinguals deserve the best reading instruction! The Reading League & NCEL join forces on best practices. Learn more in our webinar with both organizations.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Teaching Webinar
Challenging the Stigma: Emotions and STEM
STEM isn't just equations and logic. Join this webinar and discover how emotions fuel innovation, creativity, & problem-solving in STEM!
Content provided by Project Lead The Way

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Ed-Tech Policy Q&A Need an AI Policy for Your Schools? This District Used ChatGPT to Craft One
The Peninsula School District in Washington state was one of the first school systems in the country to craft AI policy guidance.
5 min read
a person and a robot study a cylinder filled with AI elements
Kathleen Fu for Education Week
Ed-Tech Policy From Our Research Center Schools Are Taking Too Long to Craft AI Policy. Why That's a Problem
Nearly 8 of every 10 educators say their districts don’t have clear AI policies, according to an EdWeek Research Center survey.
8 min read
A person sits at a computer and tries to figure out a cloud of AI Policy Confusion
Kathleen Fu for Education Week
Ed-Tech Policy The 'Homework Gap' Is About to Get Worse. What Should Schools Do?
The looming expiration of a federal program has districts worried that many students will not have adequate home internet access.
4 min read
A young boy does homework with a tablet at the kitchen table.
Ilona Titova/iStock
Ed-Tech Policy These State Lawmakers Want All School Districts to Craft AI Policies. Will Others Follow?
The vast majority of districts in the country have not released AI guidance, even though educators say they need it.
2 min read
Woman using a computer chatting with an intelligent artificial intelligence.