Skip to main content

California governor vetoes expansive AI safety bill

California Governor Gavin Newsom speaking at a lecturn.
Gage Skidmore / Flickr

California Gov. Gavin Newsom has vetoed SB 1047, the Safe and Secure Innovation for Frontier Artificial Models Act, arguing in a letter to lawmakers that it “establishes a regulatory framework that could give the public a false sense of security about controlling this fast-moving technology.”

“I do not believe this is the best approach to protecting the public from real threats posed by the technology,” he wrote. SB 1047 would have required “that a developer, before beginning to initially train a covered model … comply with various requirements, including implementing the capability to promptly enact a full shutdown … and implement a written and separate safety and security protocol.”

Recommended Videos

However, Newsom noted that 32 of the top 50 AI companies are based in California, and that the bill would focus on only the largest firms. “Smaller, specialized models may emerge as equally or even more dangerous than the models targeted by SB 1047,” he stated.

“While well-intentioned, SB 1047 does not take into account whether an Al system is deployed in high-risk environments, involves critical decision-making or the use of sensitive data,” Newsom wrote. “Instead, the bill applies stringent standards to even the most basic functions – so long as a large system deploys it.”

SB 1047 sparked heated debate within the AI industry as it made its way through the legislature. OpenAI stridently opposed the measure, resulting in researchers William Saunders and Daniel Kokotajlo publicly resigning in protest, while xAI CEO Elon Musk came out in favor of the bill. Many in Hollywood also expressed support for SB 1047, including J.J. Abrams, Jane Fonda, Pedro Pascal, Shonda Rhimes, and Mark Hamill.

“We cannot afford to wait for a major catastrophe to occur before taking action to protect the public. California will not abandon its responsibility. Safety protocols must be adopted. Proactive guardrails should be implemented, and severe consequences for bad actors must be clear and enforceable,” Newsom wrote. However, “ultimately, any framework for
effectively regulating Al needs to keep pace with the technology itself.”

Monday’s announcement comes less than a month after the governor signed AB 2602 and AB 1836, both backed by the SAG-AFTRA union. AB 2602 requires performers grant informed consent prior to using their “digital replicas,” while AB 1836 strengthened protections against ripping off the voice and likeness of deceased performers.

Andrew Tarantola
Andrew Tarantola is a journalist with more than a decade reporting on emerging technologies ranging from robotics and machine…
OpenAI’s advanced ‘Project Strawberry’ model has finally arrived
chatGPT on a phone on an encyclopedia

After months of speculation and anticipation, OpenAI has released the production version of its advanced reasoning model, Project Strawberry, which has been renamed "o1." It is joined by a "mini" version (just as GPT-4o was) that will offer faster and more responsive interactions at the expense of leveraging a larger knowledge base.

It appears that o1 offers a mixed bag of technical advancements. It's the first in OpenAI's line of reasoning models designed to use humanlike deduction to answer complex questions on subjects -- including science, coding, and math -- faster than humans can.

Read more
OpenAI could increase subscription prices to as much as $2,000 per month
a phone displaying the ChatGPT homepage on a beige bbackground.

OpenAI recently surpassed 1 million subscribers, each paying $20 (or more, for Teams and Enterprise), but that doesn't seem to be enough to keep the company financially afloat given that hundreds of millions of people use the chatbot for free.

According to The Information, OpenAI is reportedly mulling over a massive rise in its subscription prices to as much as $2,000 per month for access to its latest and models, amid rumors of its potential bankruptcy.

Read more
OpenAI gets called out for opposing a proposed AI safety bill
A person sits in front of a laptop. On the laptop screen is the home page for OpenAI's ChatGPT artificial intelligence chatbot.

Ex-OpenAI employees William Saunders and Daniel Kokotajlo have written a letter to California Gov. Gavin Newsom arguing that the company's opposition to a state bill that would impose strict safety guidelines and protocols on future AI development is disappointing but not surprising.

"We joined OpenAI because we wanted to ensure the safety of the incredibly powerful AI systems the company is developing," Saunders and Kokotajlo wrote. "But we resigned from OpenAI because we lost trust that it would safely, honestly, and responsibly develop its AI systems."

Read more