Special Report
College & Workforce Readiness

Computers ‘Read’ Students’ Faces to Measure Engagement

By Holly Kurtz — June 02, 2014 2 min read
  • Save to favorites
  • Print

Even for a teacher with eyes in the back of her head, it is not always possible to see who is on task and who is staring out the window at the sky.

So in recent years, researchers have been experimenting with cameras and computers to identify facial expressions and body language associated with lower and higher levels of student engagement.

For instance, in an article published in April in the peer-reviewed journal IEEE Transactions on Affective Computing, researchers had humans observe video clips of college students learning to play mentally challenging games on an iPad. The researchers then “taught” computers to use the clips to make judgments about students’ levels of engagement. The computer classifications were just as reliable as those of human observers. Students also took tests before and after the computer games on the skills the games were intended to teach. And researchers found that the video-based engagement scores predicted the post-test scores better than the pretest scores could. The work is a project of the National Science Foundation-funded Temporal Dynamics of Learning Center at the University of California, San Diego.

In actual K-12 settings, camera-based engagement measures are still rare to nonexistent. But UC-San Diego research professor Javier Movellan, who helped conduct the iPad study, believes the technology is ready for prime time in schools. His evidence is a focus group conducted by Interscope Research and the for-profit company Emotient, which Mr. Movellan co-founded to develop and distribute software that recognizes human expressions.

The focus-group setting was physically similar to that of many classrooms in that 35 people sat in rows facing the front of the room, rather than in front of a computer. Yet researchers successfully used cameras and software to classify the facial expressions of 35 Denver Broncos and Seattle Seahawks fans as they watched the 2014 Super Bowl and the advertisements that ran during the game. Based on the facial images, the software rated the emotional impact of each commercial and the growing frustration of the Denver fans as their team fell behind.

Mr. Movellan suggested the expression-recognition software could have multiple potential uses in the K-12 field—for teachers, educational researchers, and computerized instruction.

Of course, anytime cameras appear in classrooms, privacy issues emerge. At this point, Mr. Movellan said, the technology cannot tell one person from another. But he said privacy was “a very important concern” and one that “students and teachers and educators eventually need to figure out how to deal with.”

Coverage of school climate and student behavior and engagement is supported in part by grants from the Atlantic Philanthropies, the NoVo Foundation, the Raikes Foundation, and the California Endowment. Education Week retains sole editorial control over the content of this coverage.

Events

Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
Challenging the Stigma: Emotions and STEM
STEM isn't just equations and logic. Join this webinar and discover how emotions fuel innovation, creativity, & problem-solving in STEM!
Content provided by Project Lead The Way
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Professional Development Webinar
Leveraging Student Voice for Teacher Retention & Development
Join our webinar on using student feedback to improve teacher performance, retention & student achievement.
Content provided by Panorama Education

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

College & Workforce Readiness Infographic Students Feel Good About Their College Readiness. These Charts Tell a Different Story
In charts and graphs, a picture unfolds of high school students’ lack of preparedness for college.
2 min read
Student hanging on a tearing graduate cap tassel
DigitalVision Vectors/Getty
College & Workforce Readiness How International Baccalaureate and Advanced Placement Programs Compare
Both the IB and AP programs allow students to earn college credit in high school. Though how the program operate can differ.
1 min read
Marilyn Baise gives a lecture on Feng Shui and Taoism in her world religions class at Riverview High School in Sarasota, Fla., on Jan. 23, 2024.
Marilyn Baise gives a lecture on Feng Shui and Taoism in her world religions class at Riverview High School in Sarasota, Fla., on Jan. 23, 2024.
Zack Wittman for Education Week
College & Workforce Readiness Dartmouth and Yale Are Backtracking on ‘Test-Optional’ Admissions. Why That Matters
The Ivy League schools say test scores help them make better decisions, but most schools are keeping tests optional.
6 min read
Image of a bank of computers in a library.
baona/E+
College & Workforce Readiness States Are Making Work-Based Learning a Top Policy Priority
Interest in career and technical education continues to grow in schools nationwide, new report shows.
3 min read
Kermir Highsmith, left, Dynasty McClurk, center, and Nevaeh Williams, work in their culinary arts class at Westinghouse High School in Pittsburgh, Pa., on Dec. 13, 2022.
Kermir Highsmith, left, Dynasty McClurk, center, and Nevaeh Williams, work in their culinary arts class at Westinghouse High School in Pittsburgh, Pa., on Dec. 13, 2022.
Nate Smallwood for Education Week