College & Workforce Readiness Q&A

College-Success Algorithms Often Get It Wrong for Students of Color

By Sarah D. Sparks — August 02, 2024 3 min read
Illustration of pop up windows and notifications of different programs and applications
  • Save to favorites
  • Print

Higher education programs increasingly use algorithms based on students’ background, academic achievement, and other factors to predict whether they will complete a degree.

These tools can help direct resources to struggling students, but they can also give a biased picture of students’ potential, according to a new study published by AERA Open, a journal of the American Educational Research Association.

The study describes yet another way that predictive tools can be prone to “algorithmic bias,” in which lacking or missing data make such tools less accurate, or even misleading, when applied to certain demographic populations.

Hadis Anahideh, an assistant professor of industrial engineering at the University of Illinois, Chicago, and her colleagues analyzed federal longitudinal data on students who were 10th graders in 2002 and later entered four-year degree programs. They used a variety of “college success” models to predict the likelihood that students would complete a bachelor’s degree within eight years of their high school graduation, and then compared those predictions to students’ actual reported educational attainment.

“It makes [admissions officers’] job easier because they don’t have to go through the data one by one,” Anahideh said. “If they use these models, which are very powerful, they can estimate, OK, if this is the performance of the new student coming in, based on their high school variable and based on their background information, will they be a successful student? Can they graduate from the program or not?”

College-success algorithms falsely predicted failure for about 1 in 5 Black and Hispanic students, the researchers found. By contrast, only 12 percent of white students and 6 percent of Asian students were tapped as likely to fail, when they actually went on to complete a bachelor’s degree. This kind of flag can be used to target interventions to struggling students, but Anahideh said they could also put students at a disadvantage in admissions and scholarships.

The models also tended to dramatically overestimate how well white and Asian students would do in college relative to other students. Seventy-three percent of Asian students and 65 percent of white students who did not earn a four-year degree in eight years had been predicted to do so. Only a third of Black students and 28 percent of Hispanic students were incorrectly tagged for success.

“There is a bias right in the system,” Anahideh said. “But the surprising thing in this study was, these common [bias]-mitigation techniques are not really effective. ... There isn’t one unique solution to address the bias.”

Prior research has found datasets used to train predictive tools often don’t include enough diverse students to teach the tools how to estimate what a successful student of color looks like in the system. But Anahideh and her colleagues found that adding in more examples of successful students from different backgrounds wasn’t enough to remove bias from the system.

That’s because certain indicators are linked, increasing the weight they have in the model. For example, average ACT and SAT scores are highly predictive of later college achievement—but they are also closely linked to race, and low exam scores can be a less accurate predictor of earning a degree for Black and Hispanic students than white students, the study found.

Educators who work with students transitioning to college can help buffer their students against the effects of algorithmic bias, she said, by “learning from this historical data and what the model estimates for these students ... and try to advise them accordingly to be more successful.”

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Artificial Intelligence Webinar
AI and Educational Leadership: Driving Innovation and Equity
Discover how to leverage AI to transform teaching, leadership, and administration. Network with experts and learn practical strategies.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School Climate & Safety Webinar
Investing in Success: Leading a Culture of Safety and Support
Content provided by Boys Town
Assessment K-12 Essentials Forum Making Competency-Based Learning a Reality
Join this free virtual event to hear from educators and experts working to implement competency-based education.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

College & Workforce Readiness The Way Schools Offer CTE Classes Is About to Change. Here's How
The revision could lead to significant shifts in the types of jobs schools highlight, and the courses students are able to take.
4 min read
Photo of student working with surveying equipment.
E+
College & Workforce Readiness Even in Academic Classes, Schools Focus on Building Students' Workforce Skills
Schools work on meeting academic standards. What happens when they focus on different sets of skills?
11 min read
Students participate in reflections after a day of learning in Julia Kromenacker’s 3rd grade classroom at Old Mill Elementary School in Mt. Washington, Ky. on Wednesday, October 16, 2024.
Students participate in reflections after a day of learning in Julia Kromenacker’s 3rd grade classroom at Old Mill Elementary School in Mt. Washington, Ky., on Wednesday, Oct. 16, 2024. The Bullitt County district that includes Old Mill Elementary has incorporated a focus on building more general life skills, like collaboration, problem-solving, and communication, that community members and employers consistently say they want from students coming out of high school.
Sam Mallon/Education Week
College & Workforce Readiness Preparing for the Workforce Can Start as Early as 1st Grade. What It Looks Like
Preparing students for college and career success starts well before high school—and it doesn’t only involve occupation-specific training.
5 min read
Jenna Bray, a 1st grade teacher at Old Mill Elementary School in Mt. Washington, Ky., helps her student Lucas Joiner on an online learning assignment on Wednesday, October 16, 2024.
Jenna Bray, a 1st grade teacher at Old Mill Elementary School in Mt. Washington, Ky., helps student Lucas Joiner on an online learning assignment on Wednesday, Oct. 16, 2024. The Bullitt County district, which includes Old Mill Elementary, has incorporated a focus on equipping students with more general life skills—like communication, critical thinking, and problem-solving—that employers and community members consistently say they want from students coming out of high school.
Sam Mallon/Education Week
College & Workforce Readiness What the Research Says How Well Do Dual-Credit Students Do in College? A Look in Charts
New data show some students get more access—and more leverage—from taking postsecondary classes in high school.
3 min read
Illustration of students
Muhamad Chabib alwi/iStock/Getty