School & District Management

Brain Imaging Eyed as Path to Better Education Software

By Benjamin Herold — August 18, 2016 5 min read
1 Brain scan getty 600

What if we could read students’ brains and see what they’re thinking?

It’s a question increasingly being posed by researchers sitting at the nexus of neuroscience and education. Among them: John Anderson, a professor of psychology and computer science at Carnegie Mellon University, where a cross-disciplinary team of researchers is seeking to use new brain-imaging technologies to push the boundaries of adaptive educational software.

Anderson’s most recent paper, “Hidden Patterns of Cognition Revealed in Patterns of Brain Activation,” was published last month in the journal Psychological Science. The basic premise: Researchers can now use functional magnetic-resonance imaging, or fMRI, tools to identify the mental stages humans go through while solving math problems.

From there, they can use machine-learning algorithms to find the connections between patterns of human brain activity and patterns in the data generated by students as they interact with math software. Armed with that information, the researchers hope, they can build better educational software programs capable of quickly detecting how students are attempting to solve a given problem, then responding in a personalized way.

Another leading researcher in the field describes the work as “tremendously useful.”

“So often in education, we have to depend on self-reported measures of what children say they know,” said Richard Lamb, an assistant professor at the University of Buffalo, who previously helmed the Educational Neuroscience Laboratory at Washington State University.

“I think this work is extremely valuable in the sense that it can give a sense of where we can step in to help students and where support structures need to be,” he said.

Building ‘Cognitive Models’

Carnegie Mellon has long been at the fore of the adaptive-learning field. Two decades ago, researchers at the Pittsburgh-based university pioneered the software that eventually became known as Cognitive Tutor. Now owned by an independent spinoff company called Carnegie Learning, the adaptive tools are in use by roughly half a million K-12 students per year.

The CMU team’s calling card has always been what they dub “cognitive models.” Essentially, the idea is that good software, like a good teacher, needs to have a deep understanding of not only each step that students must go through in order to solve a problem, but also the common misunderstandings and wrong turns they’re likely to encounter.

Historically, building those cognitive models and incorporating them into software has been a labor-intensive process: content-area and learning-science experts construct a schema, developers bake it into the software, researchers collect extensive data on how students interact with the software, the schema is refined, and the whole cycle starts over again.

Introducing brain-activity scanning into the equation holds the potential to improve that process and bring it to much deeper, more creative problem-solving exercises than is currently possible, Anderson believes.

Imagine, for example, a student trying to solve a complex math problem through a “brute force” approach of random calculations, rather than by developing a formula. Instead of idling while the student flounders, such software would be able to recognize the student’s lack of a problem-solving strategy and quickly intervene, perhaps by redirecting the student to problems with built-in “scaffolds” that would help him or her learn how to develop the necessary formula.

Up until 2012, Anderson said, he and his colleagues were using such techniques to identify students’ brain-activity patterns when they were solving problems for which the researchers had well-established cognitive models. To use a rough analogy, the researchers already knew when a student was taking a left turn; the goal was to figure out what taking a left turn looked like in the brain. Big picture, the idea was to map out the connections between the math problem-solving patterns researchers already knew and the brain activity they could now observe.

Diagnosing Wrong Turns

Over the past few years, though, Anderson and his team have developed the capability to use brain-imaging technology to find entirely new problem-solving patterns. In other words, in situations where the researchers previously only knew that a student had gotten lost, they might now be capable of figuring out exactly where a student made the wrong turn, as well as mapping the unknown territory in which the student now finds himself or herself.

In the new research paper, for example, the team was able to identify the brain-activity patterns associated with four distinct stages of problem-solving involving a particular type of complex math problem: encoding, planning, solving, and responding.

After identifying those different stages, the researchers then measured how long each study participant spent planning how to solve a given problem.

Previously, the invisible mental processes that people used to solve such problems were a “total mystery,” Anderson said in a statement issued by the university to announce the publication of the new research study.

“Now, when students are sitting there thinking hard, we can tell what they are thinking each second,” he said.

Parent Concerns

Some parents, in particular, are likely to be uncomfortable with that concept, said Lamb, the University of Buffalo researcher. Of particular concern are worries about “Big Brother”-type surveillance and lack of clarity around potential benefits for students themselves.

“With every good technology, bad things can potentially happen,” Lamb said. “I think parents see both sides of that. They ultimately want to know if a [new technology] is going to help their children learn more efficiently.”

There are also some limitations to the current technology.

At the moment, Anderson said, researchers are limited to measuring how much time students are spending in a given problem-solving stage.

But in time, he believes, they will be able to recognize each arithmetic computation the brain is engaged in, and possibly even the specific numbers that a student is thinking about.

And the “bleeding-edge, future work,” Anderson said, will come around tracking and responding in real-time to students’ actual brain activity, as opposed to the indirect process that happens now. With the advent of cheaper new tools such as high-quality commercial eye-tracking technology and even wearable EEG reading devices, that future might not be as far off as it sounds.

It’s that potential for such immediate insight that has Lamb most excited.

“Direct feedback to students is the most constructive information we can provide,” he said. “Any ways that technology can provide that can kind of immediacy, the better off we are, I think.”

A version of this article appeared in the August 24, 2016 edition of Education Week as Brain Imaging Eyed as Key to Building Better Ed. Software

Events

Student Well-Being Webinar Boosting Teacher and Student Motivation During the Pandemic: What It Takes
Join Alyson Klein and her expert guests for practical tips and discussion on how to keep students and teachers motivated as the pandemic drags on.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
A Holistic Approach to Social-Emotional Learning
Register to learn about the components and benefits of holistically implemented SEL.
Content provided by Committee for Children
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
How Principals Can Support Student Well-Being During COVID
Join this webinar for tips on how to support and prioritize student health and well-being during COVID.
Content provided by Unruly Studios

EdWeek Top School Jobs

Interdisciplinary STEAM Specialist
Smyrna, Georgia
St. Benedict's Episcopal School
Interdisciplinary STEAM Specialist
Smyrna, Georgia
St. Benedict's Episcopal School
Arizona School Data Analyst - (AZVA)
Arizona, United States
K12 Inc.
Software Engineer
Portland, OR, US
Northwest Evaluation Association

Read Next

School & District Management New York City's Equity-Minded Schools Chief Resigns
Richard A. Carranza, the chancellor of the New York City schools, announced Feb. 26 he will step down from the job next month.
4 min read
Richard Carranza, Chancellor of the New York City Department of Education, arrives to Public School 188 The Island School as students arrive for in-person classes, on, Sept. 29, 2020, in the Manhattan borough of New York.
Richard A. Carranza announced he will depart the top New York City schools job in March.
John Minchillo/AP
School & District Management Opinion New Resource Tracks School System Reopening
The Return to Learn Tracker identifies the current instructional model of all regular public school districts with three or more schools.
5 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
School & District Management San Francisco School Board Pauses Renaming 44 Schools, Promises to Consult Historians
The renaming of 44 schools in the San Francisco Unified School District is apparently being put on hold after intense blowback.
Greg Keraghosian
1 min read
A pedestrian walks below a sign for Dianne Feinstein Elementary School in San Francisco, on Dec. 17, 2020. The San Francisco Unified School District put the renaming of 44 schools, including Dianne Feinstein Elementary School, on hold after local and national blowback.
A pedestrian walks below a sign for Dianne Feinstein Elementary School in San Francisco, on Dec. 17, 2020. The San Francisco Unified School District put the renaming of 44 schools, including Dianne Feinstein Elementary School, on hold after local and national blowback.<br/><br/>
Jeff Chiu/AP
School & District Management Superintendent Who Led During COVID-19 School Shutdowns Gets Top Honors
Michelle Reid of Washington state's Northshore district, one of the very first to close schools last March, was named National Superintendent of the Year.
3 min read
Michelle Reid, superintendent of the Northshore district in Washington
Michelle Reid, the superintendent of the Northshore district in Washington, was named National Superintendent of the Year.
courtesy of AASA, the School Superintendents Association