Gavin Newsom Blocks Contentious AI Safety Bill in California

Gavin Newsom Blocks Contentious AI Safety Bill in California · Bloomberg

(Bloomberg) -- California Governor Gavin Newsom has vetoed what would have become one of the most comprehensive policies governing the safety of artificial intelligence in the US.

Most Read from Bloomberg

The bill would’ve been among the first to hold AI developers accountable for any severe harm caused by their technologies. It drew fierce criticism from some prominent Democrats and major tech firms, including ChatGPT creator OpenAI and venture capital firm Andreessen Horowitz, who warned it could stall innovation in the state.

Newsom described the legislation as “well-intentioned” but said in a statement that it would’ve applied “stringent standards to even the most basic functions.” Regulation should be based on “empirical evidence and science,” he said, pointing to his own executive order on AI and other bills he’s signed that regulate the technology around known risks such as deepfakes.

The debate around California’s SB 1047 bill highlights the challenge that lawmakers around the world are facing in controlling the risks of AI while also supporting the emerging technology. US policymakers have yet to pass any comprehensive legislation around the technology since the release of ChatGPT two years ago touched off a global generative AI boom.

Democratic California Senator Scott Wiener, who introduced the bill, called Newsom’s veto a “setback for everyone who believes in oversight of massive corporations.” In a statement posted on X, Wiener said, “We are all less safe as a result.”

‘Reasonable Care’

SB 1047 would’ve mandated that companies developing powerful AI models take reasonable care to ensure that their technologies wouldn’t cause “severe harm” such as mass casualties or property damage above $500 million. Companies would’ve had to take specific precautions, including maintaining a kill switch that could turn off their technology. AI models would’ve also been subject to third-party testing to ensure they minimized grave risk.

The bill would’ve also created whistleblower protections for employees at AI companies that want to share safety concerns. Companies that weren’t in compliance with the bill could have been sued by the California attorney general.

Supporters of the legislation said it would’ve created common-sense legal standards. But VC investors, startup leaders and companies like OpenAI warned that it would slow innovation and drive AI companies out of the state.