As a longtime advocate for survivors of domestic violence, I have observed an important trend: while technology evolves, the pattern of violence remains consistent. Perpetrators continually adapt to new tools to inflict harm and exert control.
Consider the technological shifts over the decades: In the 1980s, Polaroid cameras emerged as a tool for documenting exploitation without the oversight of photo labs. During the 1990s, Caller ID became a mechanism for stalkers to track individuals fleeing their grasp. The 2010s saw smart technologies like doorbell cameras and location tracking apps becoming enablers of control.
Recently, an unsettling trend has emerged: online applications known as “nudify” and “kissing” apps. These digital tools utilize artificial intelligence to generate counterfeit nude or intimate images without the subject’s consent, permeating all parts of the internet heavily.
Such actions are not merely unethical; sharing real or fabricated intimate images without consent is often illegal and leads to severe consequences, disproportionately affecting women and girls. As a response, I collaborate with safety teams to eliminate these apps, associated advertisements, and creators from online platforms. AI aids these efforts by enhancing the review of signals, including ad content and landing pages, to identify disguised harmful content cloaked in emojis, coded language, or appearing as innocent photo-editing tools.
Moreover, tech companies must continually develop strategies to prevent and report abuses, work with other organizations and nonprofits, and support law enforcement to hold offenders accountable. These efforts are not one-time solutions; they require ongoing innovation in tactics to effectively combat these challenges. Perpetrators continuously seek out vulnerabilities and adapt their methods as defenses improve.
The internet transcends borders, and those spreading harmful content do not confine themselves to individual platforms. Hence, a comprehensive response is crucial. Collaboration among tech companies, nonprofits, and civil society is vital for stopping harm and aiding survivors. For instance, the Tech Coalition’s Lantern program facilitates the sharing of URLs related to violating apps and websites among companies, enabling collective action against nonconsensual image dissemination.
While collaborative endeavors mark progress, the key is increasing awareness of protective tools available to individuals. Survivors and potential victims need to know they possess the ability to regain control. By utilizing resources like StopNCII.org, individuals can securely report unwanted sharing of intimate images. Legislating supportive measures, such as the Take It Down Act, is critical, helping firms to assist victims and offer robust reporting mechanisms.
Legal actions against creators and promoters of harmful content further support these initiatives. Nearly a year ago, Meta initiated a lawsuit against Joy Timeline HK Limited, known for AI-generated explicit image apps. An initial court hearing recently took place to chart future steps. In the past year, numerous cease and desist letters targeted companies advertising such apps, including Undressly and Crushlove.
Twenty-six years ago, I established the Safety Net Technology Project to prevent abusers from leveraging technology to harm partners. Transitioning from the nonprofit world to tech, I found a team prioritizing intimate image abuse as a predominant issue. Our efforts are not flawless, yet persistence is vital in empowering survivors and curbing exploitation.
If threatened with online distribution of intimate images, please visit StopNCII.org or TakeItDown.NCMEC.org for assistance.
Cindy Southworth is Head of Women’s Safety at Meta, formerly Executive Vice President of the National Network to End Domestic Violence. The views presented here belong to the author.