Computers ‘Read’ Students’ Faces to Measure Engagement
Special Report
Special Report
College & Workforce Readiness

Computers ‘Read’ Students’ Faces to Measure Engagement

By Holly Kurtz — June 02, 2014 2 min read
  • Save to favorites
  • Print

Even for a teacher with eyes in the back of her head, it is not always possible to see who is on task and who is staring out the window at the sky.

So in recent years, researchers have been experimenting with cameras and computers to identify facial expressions and body language associated with lower and higher levels of student engagement.

For instance, in an article published in April in the peer-reviewed journal IEEE Transactions on Affective Computing, researchers had humans observe video clips of college students learning to play mentally challenging games on an iPad. The researchers then “taught” computers to use the clips to make judgments about students’ levels of engagement. The computer classifications were just as reliable as those of human observers. Students also took tests before and after the computer games on the skills the games were intended to teach. And researchers found that the video-based engagement scores predicted the post-test scores better than the pretest scores could. The work is a project of the National Science Foundation-funded Temporal Dynamics of Learning Center at the University of California, San Diego.

In actual K-12 settings, camera-based engagement measures are still rare to nonexistent. But UC-San Diego research professor Javier Movellan, who helped conduct the iPad study, believes the technology is ready for prime time in schools. His evidence is a focus group conducted by Interscope Research and the for-profit company Emotient, which Mr. Movellan co-founded to develop and distribute software that recognizes human expressions.

The focus-group setting was physically similar to that of many classrooms in that 35 people sat in rows facing the front of the room, rather than in front of a computer. Yet researchers successfully used cameras and software to classify the facial expressions of 35 Denver Broncos and Seattle Seahawks fans as they watched the 2014 Super Bowl and the advertisements that ran during the game. Based on the facial images, the software rated the emotional impact of each commercial and the growing frustration of the Denver fans as their team fell behind.

Mr. Movellan suggested the expression-recognition software could have multiple potential uses in the K-12 field—for teachers, educational researchers, and computerized instruction.

Of course, anytime cameras appear in classrooms, privacy issues emerge. At this point, Mr. Movellan said, the technology cannot tell one person from another. But he said privacy was “a very important concern” and one that “students and teachers and educators eventually need to figure out how to deal with.”

Coverage of school climate and student behavior and engagement is supported in part by grants from the Atlantic Philanthropies, the NoVo Foundation, the Raikes Foundation, and the California Endowment. Education Week retains sole editorial control over the content of this coverage.

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Families & the Community Webinar
Celebrate Family Engagement Day With Strategies That Work
Join National PTA and AASA to explore practical systems-wide family engagement strategies in celebration of National Family Engagement Day.
College & Workforce Readiness Webinar What Are the Fastest-Growing Career- and Work-Based Education Programs?
Join us to explore EdWeek Research Center survey data on which areas of CTE are expected to grow the fastest over the next 5 years.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Reading & Literacy Webinar
Prove What Works: How to Know Which Literacy Evidence to Trust
Learn how to evaluate literacy research, question claims, understand outcomes, and make more confident, evidence-based decisions.
Content provided by Lexia Learning

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

College & Workforce Readiness Video Getting More Girls Into Cybersecurity: One District’s Approach
Mentorship and networking opportunities encourage young girls to pursue the male-dominated field.
1 min read
Gloria Fritsch, 18, a freshman at Purdue University and graduate of the Lakota school district’s cybersecurity program, is photographed at Lakota East High School in Liberty Township, Ohio, while mentoring high school students on Tuesday, Oct. 13, 2026.
Gloria Fritsch, 18, a freshman at Purdue University and graduate of the Lakota school district’s cybersecurity program, is photographed at Lakota East High School in Liberty Township, Ohio, while mentoring high school students on Tuesday, Oct. 13, 2026.
College & Workforce Readiness These Students Are Often Left Out of CTE Programs. Here’s How to Fix It
An expert warns that English learners are often shut out of career pathways.
3 min read
LEANDER, TEXAS - DECEMBER 18: Students in a welding class work on skills and building a cattle trailer at Glenn High School, Dec. 18, 2025. Leander is one school district that measures success through a community-based accountability system, which includes students achievement in industry based education as well as other, more common metrics like STAAR test scores.
Students in a welding class at Glenn High School in Leander, Texas, work on building a cattle trailer on Dec. 18, 2025. Advocates say it's important to ensure career and technical education programs are accessible to students from diverse backgrounds.
Sara Diggins/The Austin American-Statesman via Getty Images
College & Workforce Readiness Opinion 21st-Century Skills Were All the Rage. Are They Still Relevant?
An early proponent of these skills explains how the concept of “knowledge” needs to be modernized.
•
5 min read
The United States Capitol building as a bookcase filled with red, white, and blue policy books in a Washington DC landscape.
Luca D'Urbino for Education Week
College & Workforce Readiness Quiz Quiz Yourself: How Much Do You Know About the Future of Career Readiness?
Are schools preparing students for tomorrow's workforce? Test your knowledge of the trends and challenges shaping career readiness in K-12.