Policy

King Charles urges OpenAI and Nvidia to control AI

King Charles hosted a private summit with leaders from Nvidia, OpenAI, and Anthropic, urging them to establish controls on artificial intelligence before the technology poses existential threats.

TechCrunch AI2 days agoPolicy
Image: TechCrunch AI

King Charles hosted a private summit at Dumfries House, his foundation's 18th-century estate in Ayrshire, bringing together top technology executives and government officials to discuss the trajectory of artificial intelligence. The high-profile guest list included Nvidia chief executive Jensen Huang, OpenAI chief financial officer Sarah Friar, and Anthropic global affairs lead Tino Cuéllar. They were joined by the United Kingdom's new AI minister, Kanishka Narayan, the head of the British foreign intelligence service, and Paolo Benanti, who advises the pope on AI technology.

During his 20-minute appearance, the British monarch stepped into the highly politicized debate by urging attendees to implement sufficient means of control over AI before it becomes too late. He acknowledged the technology's potential to save lives in medicine and science, but warned of its darker capacities to do harm if left unchecked. The warning follows the recent resignation of an Anthropic researcher who cautioned that humanity might not survive the race to build superhuman machines. It also comes amid shifting deployment strategies, such as Anthropic restricting access to its Fable and Mythos models exclusively to United States customers, raising concerns about international AI sovereignty.

The royal summit highlights a deepening divide within the tech sector over the pace of AI development. While industry figures like OpenAI's Sam Altman, Elon Musk, and Anthropic's Dario Amodei have recently called for a deceleration in development, others have firmly rejected those demands. Nvidia's Huang and U.S. President Donald Trump have pushed back against slowing down, with Trump emphasizing the geopolitical necessity of maintaining a lead over China. This ongoing tension has real-world business consequences; OpenAI recently stalled its plans for an initial public offering due to persistent safety concerns.

For AI practitioners and developers, this high-level political intervention signals that regulatory scrutiny and national security boundaries will increasingly dictate software deployment. As companies face pressure from both sovereign governments and internal safety advocates, developers must prepare for a more fragmented global landscape. The restriction of specific models to certain geographic regions suggests that building globally accessible AI products will become significantly more complex as political leaders demand tighter controls.

This is our own summary of reporting by TechCrunch AI

More in Policy