High school is becoming a cesspool of sexually explicit deepfakes, a reality we can no longer ignore. Generative AI has transformed creativity, but its dark side has emerged with alarming consequences. Children are facing a new threat—nonconsensual, sexually explicit images and videos created using AI technology.

Recent studies reveal that millions of students are affected by this issue, either as direct victims or as witnesses to the exploitation of their peers. Today, I want to delve into this urgent topic and explore the implications for our schools and society.

Understanding the Scope of the Problem

A recent report from the Center for Democracy and Technology (CDT) sheds light on the shocking prevalence of nonconsensual intimate imagery (NCII) among high school students. Here are some key findings:

• 15% of high school students reported hearing about deepfake images depicting someone from their school in a sexually explicit manner.

• 11% of American children aged 9 to 17 know peers who have used AI to create nude images of others.

• A survey conducted by a UN institute noted that over 50% of law enforcement had encountered AI-generated child sexual abuse material (CSAM).

These statistics reflect a growing trend that cannot be ignored. The rise of AI technology has increased both the victims and perpetrators in this disturbing landscape.

The Dark Side of Generative AI

Generative AI’s ability to create hyper-realistic images has opened the door for abuse. The technology that can streamline mundane tasks and aid in medical research has also made it easier for individuals to exploit minors. This paradox is alarming.

• AI-generated CSAM is often easier to create and distribute than traditional abusive images, leading to a spike in such content.

• The combination of social media, messaging apps, and accessible AI tools creates an environment where nonconsensual imagery can thrive.

The Numbers Don’t Lie

Reports indicate that AI-generated CSAM is rising dramatically. For instance:

• In one month, over 3,500 examples of AI-generated CSAM were uploaded to a single dark-web forum.

• Estimates suggest that thousands of new abusive images are generated daily.

This “perfect storm” of technology and societal changes makes it increasingly challenging to combat the issue.

The Challenge of Policing AI Abuse

Policing this new form of abuse is incredibly complicated. Most people use social and encrypted messaging apps for innocent purposes. However, the potential for misuse is staggering.

• Traditional methods of detecting CSAM are less effective against AI-generated content. For instance, tech companies rely on digital “fingerprints” of known abusive images, but this method is easy to circumvent with new AI-generated content.

• The generation of altered or entirely new abusive images can quickly outpace efforts to combat them.

The Role of Tech Companies

While tech companies have made strides in detecting conventional CSAM, they face significant hurdles with AI-generated content. Some solutions have been proposed, such as:

• Machine learning models that can detect unknown CSAM, but training these models poses ethical and legal challenges.

• Collaborative efforts between tech companies, law enforcement, and schools are crucial for creating effective intervention strategies.

Schools: A Frontline in the Battle

Schools play a critical role in addressing the rise of deepfake abuse. Unfortunately, many institutions are ill-equipped to handle this crisis. Here are some findings from the CDT survey:

• Less than 20% of high school students reported that their school explained what deepfake NCII is.

• A majority of parents stated that their child’s school had provided no guidance on either authentic or AI-generated NCII.

The Need for Comprehensive Education

Education is vital in addressing this issue. Schools must create an environment where students understand the ramifications of sharing explicit content, whether generated by AI or not.

• Update policies: Schools should amend their sexual harassment policies to include AI-generated images.

• Provide training: Both students and teachers should receive education on the dangers of deepfakes and how to report incidents.

What Can Be Done?

The challenge of combating deepfake abuse is immense, but not insurmountable. There are steps we can take to mitigate this issue:

• Awareness Campaigns: Schools, parents, and communities must raise awareness about the risks of deepfake technology.

• Collaborative Efforts: Tech companies, educators, and law enforcement must work together to establish effective interventions.

• Legislation: Governments should consider laws specifically addressing the use of AI in creating nonconsensual imagery.

A Window of Opportunity

Experts believe there is still a chance to address the crisis before it spirals further out of control. Recent commitments from major tech companies and government initiatives show promise, but these must be backed by action.

• Ongoing Monitoring: Tracking the prevalence of deepfake abuse is essential for effective policy-making.

• Support Systems: Establishing support networks for victims is crucial for their recovery.

Conclusion: Taking Action Against Deepfake Abuse

The rise of deepfake technology has ushered in a new era of challenges, particularly for our youth. The alarming trend of sexually explicit deepfakes in high schools is a crisis that demands immediate attention.

By fostering education, collaboration, and robust policies, we can create a safer environment for all students. The time for action is now—let’s not miss this critical window of opportunity.

Suggested links for further info.

• Nonconsensual intimate imagery: Learn More About NCII
• Child sexual abuse material: Understanding CSAM
• Generative AI risks: AI and Its Dangers
• Deepfake technology: What Are Deepfakes?
• School policies on NCII: Creating Safe Schools