Higher Ed’s Adoption of AI Outpaces Student Guards

Artificial intelligence has wormed its way into almost every aspect of college operations, from admissions and hiring to teaching and learning. The technology may have the power to revolutionize higher education, but protections for students haven’t kept pace with innovation, according to a new report from Student Defense’s SHAPE—Safeguarding Higher-Ed Through AI Practices & Ethics—AI initiative. 

In the report, Students at Stake: Risks of AI Deployment in Higher Education, higher education leaders and researchers say they are concerned about how AI is used, specifically in admissions, student services and education delivery. They identify risks related to bias; data privacy; the loss of learning communities; and disclosure, transparency and credibility. 

Dan Zibel, co-founder and chief counsel of Student Defense, said in a statement that leaders “cannot afford to adopt AI first and ask questions later.”

“The pursuit of higher education involves some of the most consequential decisions a student can make. Although certain uses of AI have  tremendous potential, colleges and universities must understand the risks, establish clear guardrails, and ensure strong student protections keep pace with the technology,” Zibel said. “At a time when many Americans are questioning the value of a college degree, strong institutional governance is necessary to ensure that colleges are using AI only to add value, rather than cheapening the educational experience.”

Using AI in admissions, recruitment and financial aid raises concerns about which students are contacted by colleges, what messages they’re receiving, how aid is distributed and whether students understand the true cost of college, the authors write. Unchecked use could lead to misleading representations, discriminatory targeting or manipulation of student choice. 

The use of AI in advising, counseling and student services is especially risky, they note; it could encourage students to be particularly vulnerable and potentially expose them to incorrect guidance or result in other academic or financial consequences. 

AI could also negatively impact the delivery of education, including the quality of teaching, academic freedom and student privacy, according to the report. 

The report advises college leaders to ask themselves specific questions before implementing AI products: What problem are we trying to solve? Do we have adequate policies and governance structures in place to ensure functionality, guarantee accountability and manage risks? Are we being transparent? Is this creating value for students?

“Human judgment and behavior are also imperfect. But the speed, power, and probabilistic nature of AI can amplify risks in ways that are difficult to understand,” the report says. “These risks persist even when the technology appears to function flawlessly yet contains errors—such as hallucinations—that produce mistakes a human substitute would be unlikely to make.”

In response to the report, U.S. Congresswoman Suzanne Bonamici, an Oregon Democrat, said in a statement that AI in higher education shouldn’t be a substitute for critical thinking and implementation of the technology should be grounded in ethics, transparency and fairness.

“As colleges and universities expand their use of AI, students and educators need clear guardrails and resources so this technology can expand opportunities, not widen gaps,” Bonamici said.