Special Report
College & Workforce Readiness

Computers ‘Read’ Students’ Faces to Measure Engagement

By Holly Kurtz — June 02, 2014 2 min read
  • Save to favorites
  • Print

Even for a teacher with eyes in the back of her head, it is not always possible to see who is on task and who is staring out the window at the sky.

So in recent years, researchers have been experimenting with cameras and computers to identify facial expressions and body language associated with lower and higher levels of student engagement.

For instance, in an article published in April in the peer-reviewed journal IEEE Transactions on Affective Computing, researchers had humans observe video clips of college students learning to play mentally challenging games on an iPad. The researchers then “taught” computers to use the clips to make judgments about students’ levels of engagement. The computer classifications were just as reliable as those of human observers. Students also took tests before and after the computer games on the skills the games were intended to teach. And researchers found that the video-based engagement scores predicted the post-test scores better than the pretest scores could. The work is a project of the National Science Foundation-funded Temporal Dynamics of Learning Center at the University of California, San Diego.

In actual K-12 settings, camera-based engagement measures are still rare to nonexistent. But UC-San Diego research professor Javier Movellan, who helped conduct the iPad study, believes the technology is ready for prime time in schools. His evidence is a focus group conducted by Interscope Research and the for-profit company Emotient, which Mr. Movellan co-founded to develop and distribute software that recognizes human expressions.

The focus-group setting was physically similar to that of many classrooms in that 35 people sat in rows facing the front of the room, rather than in front of a computer. Yet researchers successfully used cameras and software to classify the facial expressions of 35 Denver Broncos and Seattle Seahawks fans as they watched the 2014 Super Bowl and the advertisements that ran during the game. Based on the facial images, the software rated the emotional impact of each commercial and the growing frustration of the Denver fans as their team fell behind.

Mr. Movellan suggested the expression-recognition software could have multiple potential uses in the K-12 field—for teachers, educational researchers, and computerized instruction.

Of course, anytime cameras appear in classrooms, privacy issues emerge. At this point, Mr. Movellan said, the technology cannot tell one person from another. But he said privacy was “a very important concern” and one that “students and teachers and educators eventually need to figure out how to deal with.”

Coverage of school climate and student behavior and engagement is supported in part by grants from the Atlantic Philanthropies, the NoVo Foundation, the Raikes Foundation, and the California Endowment. Education Week retains sole editorial control over the content of this coverage.

Events

Special Education Webinar Reading, Dyslexia, and Equity: Best Practices for Addressing a Threefold Challenge
Learn about proven strategies for instruction and intervention that support students with dyslexia.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
The Key to Better Learning: Indoor Air Quality
Learn about the importance of improved indoor air quality in schools, and how to pick the right solutions for educators, students, and staff.
Content provided by Delos
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
Leading Systemic Redesign: Strategies from the Field
Learn how your school community can work together to redesign the school system, reengineer instruction, & co-author personalized learning.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

College & Workforce Readiness Biden Administration Urges Schools to Expand Apprenticeships and Career Learning
In too many schools, "it's a four-year college or bust mentality," Education Secretary Miguel Cardona said.
4 min read
First Lady Jill Biden steers a robot while robotics students Ethan Salibio and Kaitlyn De Loncker watch at Rolling Meadows High School on Monday, Nov. 14, 2022, in Rolling Meadows, Ill. Biden, along with U.S. Secretary of Commerce Gina Raimondo, U.S. Secretary of Labor Marty Walsh, and U.S. Secretary of Education Miguel Cardona are in the Chicago area promoting apprenticeship and career-connected learning opportunities.
First lady Jill Biden steers a robot while students Ethan Salibio and Kaitlyn De Loncker watch at Rolling Meadows High School Monday, in Rolling Meadows, Ill. Biden, along with U.S. Secretary of Commerce Gina Raimondo, U.S. Secretary of Labor Marty Walsh, and U.S. Secretary of Education Miguel Cardona are in the Chicago area promoting apprenticeship and career-connected learning opportunities.
Stacey Wescott/Chicago Tribune via AP
College & Workforce Readiness Opinion Searching for Common Ground: Student-Loan Forgiveness and the Cost of Higher Ed.
Who is responsible for the high cost of higher education? And will the student-loan forgiveness plan solve the rising cost?
6 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
College & Workforce Readiness What the Research Says More Students in Class of 2022 Seek Financial Aid for College
Financial aid applications may be an early sign of students regaining interest in higher education post-pandemic.
2 min read
Hand holding a graduate's cap turned upside down and full of money.
DigitalVision Vectors
College & Workforce Readiness What the Research Says New Graduates' ACT Scores Hit a 30-Year Low
College-placement test scores sank for the graduating class of 2022, even as more students retook the test.
4 min read
Arrows, with focus on downward turn.
panom73/iStock/Getty