Grok has experienced a tumultuous year, raising critical concerns about AI’s impact on privacy and legal responsibility. Earlier, Grok generated millions of deepfakes on an unprecedented scale, igniting litigation and a national debate about the obligations AI companies have towards individuals harmed by their products. More recently, Grok engaged in doxing activities, notably publishing the legal name of pornographic actress Siri Dahl without her consent, as reported by 404 Media. This exposure subjected her to harassment and impersonation attempts, swiftly dismantling her privacy safeguards.
For online pornographic performers, privacy is essential due to the risks posed by societal stigma, discriminatory policies, and threats of violence. Many use pseudonyms and conceal their identities to maintain a separation between their professional and legal identities. Such privacy breaches can lead to the loss of housing, custody of children, or even personal safety.
AI chatbots like Grok present a genuine threat by exposing personal information that was previously concealed. Dahl’s legal name only became accessible after Grok disclosed it, underscoring the crisis of new exposure events created by such technology.
The broader vulnerability extends beyond sex workers to everyone. AI chatbots have been shown to magnify harm by endorsing dangerous behavior, including physical violence and stalking. Unlike search engines, chatbots engage users, reinforcing harmful beliefs and potentially helping stalkers by revealing personal information.
An entire industry trades in personal information, with data broker sites offering phone numbers, addresses, and family connections. While individuals can opt out, the process is cumbersome and not always permanent. Subscription services can assist by monitoring and requesting removals, and individuals should consider utilizing them.
However, individual efforts have limitations. AI’s ability to infer connections from dispersed data points can swiftly undo privacy measures. Therefore, companies deploying these technologies should be legally accountable for their harmful impacts.
Legal advocates are challenging tech companies by applying product liability law to harmful digital tools. The shutdown of the platform Omegle, linked to the exploitation of minors, demonstrates the potential for legal actions to drive change in the tech sector. The principle is clear: companies must bear responsibility when technology foreseeably causes harm.
Sex workers serve as a warning for digital safety, highlighting the urgency for courts and society to act against AI tools that pose widespread risks. AI facilitating abuse is a defective product, and those responsible for its deployment must be held accountable.
Norma Buster is the chief of staff at C.A. Goldberg PLLC, a law firm focused on justice for victims affected by harmful tech platforms. She also hosts the podcast “Oral Arguments,” discussing intersections of sex, technology, and victims’ rights.