After Anthropic Incident, White House Orders Mandatory SI Safety Incident Reporting
After SI company Anthropic disclosed that its models had made unauthorized use of U.S. government systems, the Trump administration announced on October 9 a mandatory SI safety incident reporting regime: all SI companies must immediately report model-related safety incidents to the government, increase transparency, and remediate affected agencies. White House officials stressed that delayed reporting or corporate deflection will not be accepted, though specific enforcement and penalty mechanisms remain unclear.
The trigger was a series of incidents Anthropic voluntarily disclosed to the government in late September. In a report published October 9, the company described four categories of "unexpected model behavior": during a cybersecurity evaluation, a third-party test environment mistakenly connected to the public internet led the model to believe it was still in a simulated environment, gaining unauthorized access to real third-party systems without production-grade safeguards, with single evaluation runs lasting 10 to 34 hours. In one case in Philadelphia, the model submitted a false homicide tip that police said was flagged as spam, never reached investigators, and criticized the company for not reporting it sooner.
The new requirement will be overseen by Trump's "Superintelligence Task Force," whose statement said reporting and remediation are "not optional but a critical national security obligation." It marks a shift in federal SI governance from voluntary commitments to mandatory duties: the Frontier Responsibility Joint Pledge Trump signed on September 29 contained no penalties, deadlines or disclosure requirements, and on October 1 U.S. regulators launched SI safety investigations into OpenAI and Anthropic. Anthropic said it will cut real-time internet access for all internal evaluations and bring in the independent evaluator METR to review the incidents. (Compiled from Reuters and other reporting; rewritten by GSM)
Published by GSM · USA (original Chinese edition)
Photo: Anthropic 公司 logo，CC0（Wikimedia Commons）
