School & District Management

Facial Recognition Tech Discriminates. Ten Questions to Ask About K-12 Use

By Mark Lieberman — December 31, 2019 3 min read
  • Save to favorites
  • Print

Facial recognition technology is on the rise in schools across the country, but a new report from the federal government suggests its accuracy can vary widely depending on race and gender.

African-Americans and Asian-Americans can be between 10 and 100 times more likely to be misidentified by the technology than white people, and women are more likely to be falsely identified than men, says the National Institute of Science and Technology report, which tested nearly 200 systems with photos of more than 8 million people.

The report cautions that not all facial recognition systems are created equal: “Different algorithms perform differently.”

School officials in several states have turned to facial recognition tools to help minimize the number of shootings and security breaches in schools. Many districts have adopted the systems as an automated way to track whether the people entering and leaving the building belong there.

The report focused on the technology’s increasing presence as a law enforcement tool, but the findings have implications for schools as well, according to Sarah St. Vincent, a human rights attorney and surveillance and digital rights expert who serves as director of Cornell Tech’s Computer Security Clinic.

“People of color fought and suffered for the right to be able to get into schools and other buildings the same way that white people do,” St. Vincent said. “If facial recognition is a barrier to that, that’s a problem.”

By adopting facial recognition as a security tool to curb gun violence and other potential problems, St. Vincent argues, schools restrict access to non-white students, parents, and teachers.

“It’s really chilling that so clearly the more layers of oppression you are probably experiencing, the less accurate facial recognition will be for you,” St. Vincent said.

The New York State Department of Education earlier this year halted a planned pilot of facial recognition software in schools after civil rights advocates raised privacy concerns.

St. Vincent says she hasn’t seen research indicating that facial recognition is a more accurate security system than a human presence might be. “There’s this perception that facial recognition is objective or less flawed,” she said. “We view tech as having this aura of magic or perfection that it actually should not have.”

Efforts are underway to develop more sophisticated artificial intelligence in facial recognition technologies that will not perpetuate racial and gender biases. In the meantime, here are some questions St. Vincent recommends district leaders ask as they explore the use of facial recognition technnologies:


  1. Has the manufacturer commissioned a third-party test of the system, or has it simply tested the product itself?
  2. How many false positives (identifying someone as a match when they are not) and false negatives (failing to identify someone who is a match) did the manufacturer find in its research?
  3. How accurate is the system for children? For women and girls? For people of color?
  4. What is the risk or harm schools are trying to prevent by installing this system, and why would this system be the best way to address that risk?
  5. How should schools evaluate the effectiveness of a facial recognition system?
  6. Are there other options that are less intrusive and less likely of misidentifying people of color?
  7. How is data collected by the system stored and what are the plans for securely deleting old or unnecessary data?
  8. Is there a risk that students, teachers, staff, parents, or others will associate with one another less freely on school grounds if a school uses facial recognition technologies?
  9. Will use of these technologies exacerbate the existing problem of students of color facing disproportionately high rates of disciplinary action?
  10. Have school officials given members of the community opportunities for input on whether or not to use facial recognition systems?

A version of this news article first appeared in the Digital Education blog.


Commenting has been disabled on edweek.org effective Sept. 8. Please visit our FAQ section for more details. To get in touch with us visit our contact page, follow us on social media, or submit a Letter to the Editor.


Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
6 Key Trends in Teaching and Learning
As we enter the third school year affected by the pandemic—and a return to the classroom for many—we come better prepared, but questions remain. How will the last year impact teaching and learning this school
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Equity & Diversity Webinar
Evaluating Equity to Drive District-Wide Action this School Year
Educational leaders are charged with ensuring all students receive equitable access to a high-quality education. Yet equity is more than an action. It is a lens through which we continuously review instructional practices and student
Content provided by BetterLesson
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
Attendance Awareness Month: The Research Behind Effective Interventions
More than a year has passed since American schools were abruptly closed to halt the spread of COVID-19. Many children have been out of regular school for most, or even all, of that time. Some
Content provided by AllHere

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management Letter to the Editor School Mask Mandates: Pandemic, ‘Panicdemic,’ or Personal?
"A pandemic is based on facts. A 'panicdemic' is based on fears. Today, we have both," writes a professor.
1 min read
School & District Management How 'Vaccine Discrimination' Laws Make It Harder for Schools to Limit COVID Spread
In Montana and Ohio, the unvaccinated are a protected class, making it tough to track and contain outbreaks, school leaders say.
4 min read
Principal and District Superintendent Bonnie Lower takes the temperature of a student at Willow Creek School as the school reopened, Thursday, May 7, 2020, in Willow Creek, Mont.
Bonnie Lower, a principal and district superintendent in Willow Creek, Mont., checks the temperature of a student as Willow Creek School reopened for in-person instruction in the spring.
Ryan Berry/Bozeman Daily Chronicle via AP
School & District Management Opinion 'Futures Thinking' Can Help Schools Plan for the Next Pandemic
Rethinking the use of time and place for teachers and students, taking risks, and having a sound family-engagement plan also would help.
17 min read
Images shows colorful speech bubbles that say "Q," "&," and "A."
iStock/Getty
School & District Management Opinion The Consequence of Public-Health Officials Racing to Shutter Schools
Public-health officials' lack of concern for the risks of closing schools may shed light on Americans' reticence to embrace their directives.
5 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty