Special Report
College & Workforce Readiness

Computers ‘Read’ Students’ Faces to Measure Engagement

By Holly Kurtz — June 02, 2014 2 min read
  • Save to favorites
  • Print

Even for a teacher with eyes in the back of her head, it is not always possible to see who is on task and who is staring out the window at the sky.

So in recent years, researchers have been experimenting with cameras and computers to identify facial expressions and body language associated with lower and higher levels of student engagement.

For instance, in an article published in April in the peer-reviewed journal IEEE Transactions on Affective Computing, researchers had humans observe video clips of college students learning to play mentally challenging games on an iPad. The researchers then “taught” computers to use the clips to make judgments about students’ levels of engagement. The computer classifications were just as reliable as those of human observers. Students also took tests before and after the computer games on the skills the games were intended to teach. And researchers found that the video-based engagement scores predicted the post-test scores better than the pretest scores could. The work is a project of the National Science Foundation-funded Temporal Dynamics of Learning Center at the University of California, San Diego.

In actual K-12 settings, camera-based engagement measures are still rare to nonexistent. But UC-San Diego research professor Javier Movellan, who helped conduct the iPad study, believes the technology is ready for prime time in schools. His evidence is a focus group conducted by Interscope Research and the for-profit company Emotient, which Mr. Movellan co-founded to develop and distribute software that recognizes human expressions.

The focus-group setting was physically similar to that of many classrooms in that 35 people sat in rows facing the front of the room, rather than in front of a computer. Yet researchers successfully used cameras and software to classify the facial expressions of 35 Denver Broncos and Seattle Seahawks fans as they watched the 2014 Super Bowl and the advertisements that ran during the game. Based on the facial images, the software rated the emotional impact of each commercial and the growing frustration of the Denver fans as their team fell behind.

Mr. Movellan suggested the expression-recognition software could have multiple potential uses in the K-12 field—for teachers, educational researchers, and computerized instruction.

Of course, anytime cameras appear in classrooms, privacy issues emerge. At this point, Mr. Movellan said, the technology cannot tell one person from another. But he said privacy was “a very important concern” and one that “students and teachers and educators eventually need to figure out how to deal with.”

Coverage of school climate and student behavior and engagement is supported in part by grants from the Atlantic Philanthropies, the NoVo Foundation, the Raikes Foundation, and the California Endowment. Education Week retains sole editorial control over the content of this coverage.


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Mathematics Webinar
Addressing Unfinished Learning in Math: Providing Tutoring at Scale
Most states as well as the federal government have landed on tutoring as a key strategy to address unfinished learning from the pandemic. Take math, for example. Studies have found that students lost more ground
Content provided by Yup Math Tutoring
Classroom Technology Webinar Building Better Blended Learning in K-12 Schools
The pandemic and the increasing use of technology in K-12 education it prompted has added renewed energy to the blended learning movement as most students are now learning in school buildings (and will likely continue

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
College & Workforce Readiness Whitepaper
Root Causes of Students Stopping Out of College
Many postsecondary access and success programs successfully support students to enroll in a degree or credential program after high schoo...
Content provided by OneGoal
College & Workforce Readiness Opinion The High School Network Providing Students With On-the-Job Training
Rick Hess speaks with Cristo Rey Network President Elizabeth Goettl about the network's innovative work-study program.
7 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
College & Workforce Readiness From Our Research Center Class of COVID: 2021's Graduates Are Struggling More and Feeling the Stress
COVID-19 disrupted the class of 2020’s senior year. A year later, the transition to college has in some ways gotten worse.
7 min read
Conceptual illustration of young adults in limbo
Vanessa Solis/Education Week and Klaus Vedfelt/DigitalVision/Getty
College & Workforce Readiness From Our Research Center Helping Students Plan How to Pay for College Is More Important Than Ever: Schools Can Help
Fewer and fewer high school graduates have applied for federal financial aid for college since the pandemic hit.
4 min read
Conceptual Illustration of young person sitting on top of a financial trend line.
Vanessa Solis/Education Week and Klaus Vedfelt/DigitalVision<br/>