New York Governor Kathy Hochul announced new restrictions on companion chatbots to protect children from potential harms caused by artificial intelligence. The legislation, signed during her reelection campaign, introduces strict measures to limit chatbot behavior when interacting with minors under 18.
The law, effective January 1, defines multiple types of “unsafe AI companion features” that are now banned. Violations could lead to legal actions by the state’s attorney general, including fines, shutdowns, and data destruction.
States like New York and California are leading the charge in regulating AI, addressing concerns that Washington has yet to take on. They aim to apply consumer protection laws for greater transparency and control over chatbot interactions. California recently passed similar legislation, requiring developers to evaluate and mitigate risks to children, complemented by independent audits to ensure compliance.
Eight states recently sued OpenAI, claiming its popular chatbot model violated consumer protection laws by deceiving users, a move described as historic in AI regulation.
New York’s law prohibits chatbots from inducing children to believe they are interacting with a real person, sharing emotions, engaging in secrecy, or encouraging harmful behaviors. Supporters, including Jim Steyer of Common Sense Media, commend it as the toughest AI safety law for children nationwide.
Policy analyst Justine Gluck highlighted how New York and California’s approaches could inspire other states to develop similar regulations. However, she noted potential enforcement challenges due to broadly defined terms, posing questions about distinguishing between normal interactions and banned activities.