 |
| Representative image |
President Donald Trump and executives from six major technology companies signed a voluntary agreement on Tuesday to strengthen safety controls for advanced artificial intelligence systems, putting the industry under pressure to police itself while leaving unanswered questions about enforcement.
The White House accord, signed by leaders of Google, Meta, OpenAI, Anthropic, xAI and Nvidia, calls for companies to establish internal safety controls, monitor those controls, work with independent outside auditors and create independent board committees to review the results.
Trump called the agreement "morally binding" and compared it to a constitution for the AI industry. But the pact is not legally binding and does not establish federal penalties for companies that fail to meet its commitments.
That distinction could become important as AI systems gain the ability to perform increasingly complex tasks and interact with computer systems with less direct human oversight.
The agreement, known as the Joint Commitment on Frontier Responsibilities, is aimed at the most advanced AI systems, often referred to as frontier models. It focuses on risks including cybersecurity, biological and chemical threats and unauthorized access to computer systems.
Google CEO Sundar Pichai, Meta CEO Mark Zuckerberg, Anthropic CEO Dario Amodei and other technology leaders attended the White House meeting.
Trump praised Pichai before reporters and jokingly called him a "monster," while describing his influence in the technology industry.
Four layers of oversight
The accord sets out four main elements for companies developing advanced AI systems.
Companies are expected to maintain internal controls designed to prevent or limit harmful capabilities. They are also expected to establish internal teams responsible for assessing whether those controls are working.
The companies would then work with independent external auditors or evaluators to review their safety practices. Finally, independent committees of their boards would review the results of internal and external assessments.
The agreement also calls for the participating companies to meet regularly to develop safety standards and best practices.
The arrangement gives companies a common set of commitments without creating a new federal regulator.
That leaves an important question about what happens if a company fails to meet the standards.
The accord does not create a statutory penalty, a federal enforcement mechanism or a government agency with authority to order a company to stop deploying an AI system. It also does not establish a single outside auditing organization for the participating companies.
The White House agreement indicates that some of its practices could eventually be incorporated into laws or regulations, but it does not require Congress or the administration to do so.
Companies retain primary responsibility
The voluntary structure places much of the responsibility for AI safety inside the companies developing the technology.
That approach is consistent with Trump's broader position that the United States should encourage rapid AI development rather than impose regulations that could slow innovation.
Trump has also framed AI development as part of a global competition with China and has argued that the United States needs to maintain its lead in the technology.
The administration has simultaneously encouraged rapid construction of data centers needed to train and operate advanced AI systems. Trump defended those investments on Tuesday, saying data centers could bring economic and infrastructure benefits to local communities, even as some communities have raised concerns about electricity, water and other infrastructure demands.
The safety pact comes as public concern about the technology remains high.
A Reuters/Ipsos poll cited by Reuters found that 73% of Americans believed AI companies had not done enough to ensure the technology's safety.
Industry concerns
Amodei has been among the technology industry's more prominent executives warning about the risks posed by increasingly capable AI systems.
He has said the technology presents real risks and that there is still debate over the most effective ways to address them.
Other technology leaders have also acknowledged the need for stronger safeguards as AI systems become more capable.
The issue has become particularly relevant as AI agents gain greater ability to use software, browse websites and carry out multistep tasks. Reuters reported that recent incidents involving AI agents behaving unexpectedly have increased concern within the industry.
The companies' agreement attempts to address those concerns without imposing a new federal regulatory regime.
Questions over independent audits
The pact's reliance on outside audits could become one of its most closely watched elements.
The agreement calls for independent external auditors or evaluators, but it does not establish a single government-approved auditing body or require a uniform audit methodology.
It also does not require companies to make the full results of those reviews public.
That could make it difficult for outside researchers, regulators and the public to determine whether companies are applying the commitments consistently.
The role of corporate boards presents another test.
Board committees would have responsibility for reviewing safety assessments and overseeing management responses. But the boards of the companies involved also have a responsibility to shareholders and to the companies' commercial interests.
For AI developers competing to release increasingly capable systems, safety decisions can affect the timing and cost of major product launches.
The accord establishes a governance process for those decisions but does not give an outside regulator the final authority over them.
Trump orders new AI terminology
Tuesday's meeting came as Trump also moved to change how the federal government refers to AI.
An executive order signed Sept. 29 directs executive-branch agencies, to the maximum extent permitted by law, to use the terms "Super Intelligence" and "SI" instead of "Artificial Intelligence" and "AI" in official correspondence, websites, reports and other nonstatutory documents.
The order defines "Super Intelligence" for its purposes using the existing federal statutory definition of artificial intelligence and directs the White House science and technology adviser to propose legislative language for a federal definition within 60 days.
The order does not itself change existing federal statutes. It also says implementation must remain consistent with applicable law.
What comes next
The voluntary agreement gives the participating companies a common set of safety commitments and gives the Trump administration a way to promote industry safeguards without imposing new binding rules.
Its effectiveness will depend largely on how the companies implement the controls, how independent the outside assessments are and what happens when auditors identify serious problems.
The White House has left open the possibility that some of the practices could eventually become part of federal law or regulation.
For now, the agreement relies on companies to regulate much of their own conduct.
That makes the first independent reviews, the standards the companies eventually adopt and the amount of information they disclose likely to be critical measures of whether the pact becomes a functioning safety system or remains primarily a voluntary industry commitment.
