KUALA LUMPUR: The misuse of artificial intelligence (AI) to create sexually explicit images of female students is raising serious concerns over student safety, digital literacy and schools’ preparedness to address emerging forms of online sexual harassment.
Although the images may be fabricated, the humiliation, emotional distress and damage to a victim’s reputation can have lasting consequences.
A case reported by Sinar Harian on Oct 17 involving AI-manipulated images of female students at a secondary school in Seremban highlights the growing challenges faced by educational institutions. Police received five reports involving students aged between 14 and 17.
The incident raises questions about whether schools have adequate procedures to protect students when digital technology is misused.
Fake images, real trauma
Victims of AI-generated sexual images may face ridicule, bullying and anxiety over the possibility of the content being shared repeatedly, despite never having participated in the acts depicted.
In some cases, victims may remain silent because they fear being blamed, embarrassed or subjected to further harassment.
Unlike face-to-face misconduct, digital content can be copied, stored and circulated across multiple platforms within minutes. Removing one post does not necessarily end the harm.
Digital skills must include ethical responsibility
As AI becomes increasingly integrated into education, digital literacy must go beyond teaching students how to operate applications and generate content.
Students must also understand consent, privacy and the right to control the use of their own images.
The ability to manipulate an image using AI does not give anyone the right to use another person’s face to create sexual content without consent.
Education on AI should therefore address the social, moral and legal consequences of its misuse, including digital sexual harassment, privacy violations and the distribution of non-consensual content.
Are schools prepared to protect students?
Cases involving AI-manipulated sexual images should prompt schools to review their procedures for handling complaints.
Teachers need clear guidance on identifying and responding to such incidents, while students must have access to safe and confidential reporting channels.
Schools should not dismiss the creation or circulation of fake sexual images as a joke or an ordinary dispute between classmates. Such acts can cause serious psychological harm and may constitute sexual harassment.
Protecting victims must be the priority. Their identities and emotional well-being should be safeguarded, and they should never be blamed for sharing ordinary photographs of themselves online.
Schools should also provide counselling, help prevent further circulation of the images and ensure that evidence is handled safely for investigations by the relevant authorities.
Teachers and school administrators need appropriate training to understand emerging forms of AI misuse and respond consistently without adding to victims’ distress.
Protecting students is a shared responsibility
Teaching responsible AI use is essential, but education alone is insufficient.
Parents, schools, digital platforms and technology developers all have a role in creating safer online environments.
Parents should encourage children to report harassment without fear of punishment or blame. Technology companies should strengthen safeguards, improve complaint-handling procedures and reduce the risk of their services being used to generate non-consensual sexual content, particularly involving minors.
Authorities and educational institutions must also work together to establish clearer guidelines, strengthen preventive measures and ensure reporting mechanisms are accessible.
Student protection cannot depend solely on action taken after harmful content has spread.
Progress must not come at the expense of students
AI offers significant educational benefits, from helping teachers develop learning materials to creating more engaging learning experiences. However, these advantages must be accompanied by safeguards for vulnerable users.
The Seremban case should prompt a broader review of Malaysia’s digital education priorities.
The success of AI integration in schools should not be measured only by the number of applications introduced or students’ technical abilities. It must also reflect the education system’s ability to protect every student’s safety, privacy and dignity.
Ultimately, the challenge is not whether AI will benefit or harm society, but whether people and institutions can ensure the technology is not turned into a weapon against those who need protection most.
If technology continues to advance while safeguards fall behind, students must not be left to pay the price through damage to their dignity and future.
-AWANI
