Special Report
College & Workforce Readiness

Computers ‘Read’ Students’ Faces to Measure Engagement

By Holly Kurtz — June 02, 2014 2 min read
  • Save to favorites
  • Print

Even for a teacher with eyes in the back of her head, it is not always possible to see who is on task and who is staring out the window at the sky.

So in recent years, researchers have been experimenting with cameras and computers to identify facial expressions and body language associated with lower and higher levels of student engagement.

For instance, in an article published in April in the peer-reviewed journal IEEE Transactions on Affective Computing, researchers had humans observe video clips of college students learning to play mentally challenging games on an iPad. The researchers then “taught” computers to use the clips to make judgments about students’ levels of engagement. The computer classifications were just as reliable as those of human observers. Students also took tests before and after the computer games on the skills the games were intended to teach. And researchers found that the video-based engagement scores predicted the post-test scores better than the pretest scores could. The work is a project of the National Science Foundation-funded Temporal Dynamics of Learning Center at the University of California, San Diego.

In actual K-12 settings, camera-based engagement measures are still rare to nonexistent. But UC-San Diego research professor Javier Movellan, who helped conduct the iPad study, believes the technology is ready for prime time in schools. His evidence is a focus group conducted by Interscope Research and the for-profit company Emotient, which Mr. Movellan co-founded to develop and distribute software that recognizes human expressions.

The focus-group setting was physically similar to that of many classrooms in that 35 people sat in rows facing the front of the room, rather than in front of a computer. Yet researchers successfully used cameras and software to classify the facial expressions of 35 Denver Broncos and Seattle Seahawks fans as they watched the 2014 Super Bowl and the advertisements that ran during the game. Based on the facial images, the software rated the emotional impact of each commercial and the growing frustration of the Denver fans as their team fell behind.

Mr. Movellan suggested the expression-recognition software could have multiple potential uses in the K-12 field—for teachers, educational researchers, and computerized instruction.

Of course, anytime cameras appear in classrooms, privacy issues emerge. At this point, Mr. Movellan said, the technology cannot tell one person from another. But he said privacy was “a very important concern” and one that “students and teachers and educators eventually need to figure out how to deal with.”

Coverage of school climate and student behavior and engagement is supported in part by grants from the Atlantic Philanthropies, the NoVo Foundation, the Raikes Foundation, and the California Endowment. Education Week retains sole editorial control over the content of this coverage.

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Reading & Literacy Webinar
Literacy Success: How Districts Are Closing Reading Gaps Fast
67% of 4th graders read below grade level. Learn how high-dosage virtual tutoring is closing the reading gap in schools across the country.
Content provided by Ignite Reading
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Artificial Intelligence Webinar
AI and Educational Leadership: Driving Innovation and Equity
Discover how to leverage AI to transform teaching, leadership, and administration. Network with experts and learn practical strategies.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School Climate & Safety Webinar
Investing in Success: Leading a Culture of Safety and Support
Content provided by Boys Town

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

College & Workforce Readiness Can the AP Model Work for CTE? How the College Board Is Embracing Career Prep
The organization known for AP courses and the SAT is getting more involved in helping students explore potential careers.
5 min read
David Coleman, CEO of the College Board, speaks at the organization's annual conference in Austin, Texas, on Oct. 21, 2024.
David Coleman, CEO of the College Board, speaks at the organization's annual conference in Austin, Texas, on Oct. 21, 2024. Long an institution invested in preparing students for college, the College Board increasingly has an eye on illuminating career options.
Ileana Najarro/Education Week
College & Workforce Readiness The Way Schools Offer CTE Classes Is About to Change. Here's How
The revision could lead to significant shifts in the types of jobs schools highlight, and the courses students are able to take.
4 min read
Photo of student working with surveying equipment.
E+
College & Workforce Readiness Even in Academic Classes, Schools Focus on Building Students' Workforce Skills
Schools work on meeting academic standards. What happens when they focus on different sets of skills?
11 min read
Students participate in reflections after a day of learning in Julia Kromenacker’s 3rd grade classroom at Old Mill Elementary School in Mt. Washington, Ky. on Wednesday, October 16, 2024.
Students participate in reflections after a day of learning in Julia Kromenacker’s 3rd grade classroom at Old Mill Elementary School in Mt. Washington, Ky., on Wednesday, Oct. 16, 2024. The Bullitt County district that includes Old Mill Elementary has incorporated a focus on building more general life skills, like collaboration, problem-solving, and communication, that community members and employers consistently say they want from students coming out of high school.
Sam Mallon/Education Week
College & Workforce Readiness Preparing for the Workforce Can Start as Early as 1st Grade. What It Looks Like
Preparing students for college and career success starts well before high school—and it doesn’t only involve occupation-specific training.
5 min read
Jenna Bray, a 1st grade teacher at Old Mill Elementary School in Mt. Washington, Ky., helps her student Lucas Joiner on an online learning assignment on Wednesday, October 16, 2024.
Jenna Bray, a 1st grade teacher at Old Mill Elementary School in Mt. Washington, Ky., helps student Lucas Joiner on an online learning assignment on Wednesday, Oct. 16, 2024. The Bullitt County district, which includes Old Mill Elementary, has incorporated a focus on equipping students with more general life skills—like communication, critical thinking, and problem-solving—that employers and community members consistently say they want from students coming out of high school.
Sam Mallon/Education Week