Anthropic researcher Jacob Coxon recently expressed concerns about artificial intelligence advancing too quickly without sufficient regulation. In an interview with Fox News, Coxon emphasized the need for immediate action to prevent potential disastrous outcomes.
Coxon shared his thoughts on “Special Report,” stating that regulation is essential. He highlighted that the pursuit of self-improving superintelligence could be risking human lives. Coxon, previously engaged in pretraining research at OpenAI and Anthropic, believes it’s not entirely hopeless and urged for regulation to change the dynamics of a significant risk.
“It’s not like we think this is some impossible thing,” Coxon remarked. “It’s just we’re racing so fast. We haven’t got time to solve it correctly. People are begging for regulation, and it’s crucial that internationally, steps are taken to ensure we don’t end up racing ourselves into extinction.”
Evan Hubinger, alignment science lead at Anthropic, supported Coxon’s views on social media, expressing concern about the possibility of AI causing harm. He believes the risk of AI evolving through recursive self-improvement is higher than expected. Both researchers agree that while current AI threats are minimal, future developments could pose significant risks.
Coxon warns that recursive self-improvement, where AI increases its intelligence independently, could become a reality within the next year or even months. This sentiment resonates across the AI industry, where there’s awareness that current developments, if unchecked, might lead to AI domination by the end of the decade.
The urgency for international oversight in AI technology is underscored by Coxon’s description of AI as a “superweapon” in an ongoing arms race. He insists that without global cooperation, the situation could mirror the dangers depicted in science fiction.
Despite the serious implications, there is hope. Coxon believes the issue can be resolved if addressed systematically. This potential requires international leaders to acknowledge the seriousness of the situation and regulate the industry efficiently.