School & District Management

Brain Imaging Eyed as Path to Better Education Software

By Benjamin Herold — August 18, 2016 5 min read
BRIC ARCHIVE
  • Save to favorites
  • Print

What if we could read students’ brains and see what they’re thinking?

It’s a question increasingly being posed by researchers sitting at the nexus of neuroscience and education. Among them: John Anderson, a professor of psychology and computer science at Carnegie Mellon University, where a cross-disciplinary team of researchers is seeking to use new brain-imaging technologies to push the boundaries of adaptive educational software.

Anderson’s most recent paper, “Hidden Patterns of Cognition Revealed in Patterns of Brain Activation,” was published last month in the journal Psychological Science. The basic premise: Researchers can now use functional magnetic-resonance imaging, or fMRI, tools to identify the mental stages humans go through while solving math problems.

From there, they can use machine-learning algorithms to find the connections between patterns of human brain activity and patterns in the data generated by students as they interact with math software. Armed with that information, the researchers hope, they can build better educational software programs capable of quickly detecting how students are attempting to solve a given problem, then responding in a personalized way.

Another leading researcher in the field describes the work as “tremendously useful.”

“So often in education, we have to depend on self-reported measures of what children say they know,” said Richard Lamb, an assistant professor at the University of Buffalo, who previously helmed the Educational Neuroscience Laboratory at Washington State University.

“I think this work is extremely valuable in the sense that it can give a sense of where we can step in to help students and where support structures need to be,” he said.

Building ‘Cognitive Models’

Carnegie Mellon has long been at the fore of the adaptive-learning field. Two decades ago, researchers at the Pittsburgh-based university pioneered the software that eventually became known as Cognitive Tutor. Now owned by an independent spinoff company called Carnegie Learning, the adaptive tools are in use by roughly half a million K-12 students per year.

The CMU team’s calling card has always been what they dub “cognitive models.” Essentially, the idea is that good software, like a good teacher, needs to have a deep understanding of not only each step that students must go through in order to solve a problem, but also the common misunderstandings and wrong turns they’re likely to encounter.

Historically, building those cognitive models and incorporating them into software has been a labor-intensive process: content-area and learning-science experts construct a schema, developers bake it into the software, researchers collect extensive data on how students interact with the software, the schema is refined, and the whole cycle starts over again.

Introducing brain-activity scanning into the equation holds the potential to improve that process and bring it to much deeper, more creative problem-solving exercises than is currently possible, Anderson believes.

Imagine, for example, a student trying to solve a complex math problem through a “brute force” approach of random calculations, rather than by developing a formula. Instead of idling while the student flounders, such software would be able to recognize the student’s lack of a problem-solving strategy and quickly intervene, perhaps by redirecting the student to problems with built-in “scaffolds” that would help him or her learn how to develop the necessary formula.

Up until 2012, Anderson said, he and his colleagues were using such techniques to identify students’ brain-activity patterns when they were solving problems for which the researchers had well-established cognitive models. To use a rough analogy, the researchers already knew when a student was taking a left turn; the goal was to figure out what taking a left turn looked like in the brain. Big picture, the idea was to map out the connections between the math problem-solving patterns researchers already knew and the brain activity they could now observe.

Diagnosing Wrong Turns

Over the past few years, though, Anderson and his team have developed the capability to use brain-imaging technology to find entirely new problem-solving patterns. In other words, in situations where the researchers previously only knew that a student had gotten lost, they might now be capable of figuring out exactly where a student made the wrong turn, as well as mapping the unknown territory in which the student now finds himself or herself.

In the new research paper, for example, the team was able to identify the brain-activity patterns associated with four distinct stages of problem-solving involving a particular type of complex math problem: encoding, planning, solving, and responding.

After identifying those different stages, the researchers then measured how long each study participant spent planning how to solve a given problem.

Previously, the invisible mental processes that people used to solve such problems were a “total mystery,” Anderson said in a statement issued by the university to announce the publication of the new research study.

“Now, when students are sitting there thinking hard, we can tell what they are thinking each second,” he said.

Parent Concerns

Some parents, in particular, are likely to be uncomfortable with that concept, said Lamb, the University of Buffalo researcher. Of particular concern are worries about “Big Brother”-type surveillance and lack of clarity around potential benefits for students themselves.

“With every good technology, bad things can potentially happen,” Lamb said. “I think parents see both sides of that. They ultimately want to know if a [new technology] is going to help their children learn more efficiently.”

There are also some limitations to the current technology.

At the moment, Anderson said, researchers are limited to measuring how much time students are spending in a given problem-solving stage.

But in time, he believes, they will be able to recognize each arithmetic computation the brain is engaged in, and possibly even the specific numbers that a student is thinking about.

And the “bleeding-edge, future work,” Anderson said, will come around tracking and responding in real-time to students’ actual brain activity, as opposed to the indirect process that happens now. With the advent of cheaper new tools such as high-quality commercial eye-tracking technology and even wearable EEG reading devices, that future might not be as far off as it sounds.

It’s that potential for such immediate insight that has Lamb most excited.

“Direct feedback to students is the most constructive information we can provide,” he said. “Any ways that technology can provide that can kind of immediacy, the better off we are, I think.”

A version of this article appeared in the August 24, 2016 edition of Education Week as Brain Imaging Eyed as Key to Building Better Ed. Software

Events

Classroom Technology Webinar Building Better Blended Learning in K-12 Schools
The pandemic and the increasing use of technology in K-12 education it prompted has added renewed energy to the blended learning movement as most students are now learning in school buildings (and will likely continue

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management Polls About Lessons on Racism in Schools Can Be Eye-Opening, and Misleading
Opinion surveys may help district leaders host more-productive conversations, but how they're framed can lead to wildly different results.
11 min read
Hand holding smartphone with voting app. Online voting with mini people concept flat vector illustration with smartphone screen, voting box and voters making decisions.
iStock/Getty Images Plus
School & District Management Pandemic-Seasoned Principals Share Hard-Earned Leadership Lessons
The COVID crisis has tested principals’ resolve to an unprecedented degree, but many have gleaned valuable takeaways from the experience.
6 min read
Boat on the water with three people inside. Leader pointing  forward. In the water around them are coronavirus pathogens.
iStock/Getty Images Plus
School & District Management This Intensive Internship Helps Principals Get Ready For the Job
A two-year program in Columbus City Schools gives aspiring principals the chance to dive deep into the job before actually taking the reins.
10 min read
Sarah Foster, principal of North Linden Elementary School, talks with Katina Perry in Columbus, Ohio on November 30, 2021. Columbus City Schools has a program that lets principal “test out” the principal role, before actually fully taking it on. Through the program, they work in a school for two years under a mentor principal and fill in as principal at different schools during that time.
Katina Perry, right, principal of Fairmoor Elementary School in Columbus, Ohio, meets with Sarah Foster, principal of North Linden Elementary School and Perry's mentor in a school leader internship program.
Maddie McGarvey for Education Week
School & District Management Q&A School Libraries and Controversial Books: Tips From the Front Lines
A top school librarian explains how districts can prepare for possible challenges to student reading materials and build trust with parents.
6 min read
Image of library shelves of books.
mikdam/iStock/Getty