Anthropic Tells Newsom Courts Should Be Able to Block Super Intelligence (SI) Models Posing a Serious Risk
Anthropic told California Governor Gavin Newsom in an October 15 letter that government officials should be able to seek court orders blocking the release of super intelligence (SI) models that pose a "serious risk" to the public, Reuters reported on October 28, noting the position echoed the company's earlier policy proposals. An Anthropic spokesperson confirmed the letter is authentic; the California governor's office did not immediately respond to a request for comment.
"When a review finds a model poses a serious risk, the government should be able to ask a court to block it," the letter said. Anthropic also said it opposes requirements that developers build "kill switches" capable of shutting down entire models if a company loses control, supporting instead more targeted interventions such as disabling a problematic agent or cutting off a specific customer's access, which it said would be more effective.
The recommendations were submitted after the governor in September convened a panel of super intelligence (SI) experts to develop proposals for safety requirements. Anthropic itself has faced government restrictions: the Trump administration in June ordered the company to immediately restrict foreign access to its cyber-capable Mythos 5 and Fable 5 models, citing national security concerns, and the U.S. Commerce Department later lifted the order.
In Washington, a bipartisan group of U.S. senators in September debated legislation that would give the U.S. government power to block the release of certain models deemed unsafe, with companies able to challenge such decisions in federal court; Congress left for its pre-election break shortly afterward and lawmakers have not moved forward on the proposal.
Source: GSM · USA (original Chinese edition)
Photo: 图：Anthropic 公司标志。本图为该公司标志图，公共领域版本，经 Wikimedia Commons。 / Anthropic logo, via Wikimedia Commons.
