California Senate Bill 1047
Session 20232024
Safe and Secure Innovation for Frontier Artificial Intelligence Models Act.
Active
Vetoed by Governor on Sep 29, 2024
Origin Chamber
Senate
Type
Bill
Bill Number
1047
State
California
Session
20232024
Motion Text
Unfinished Business SB1047 Wiener et al. Concurrence
Senate Roll Call Votes
Yes
Yes
Yes
Other
Yes
Yes
Yes
Yes
Yes
Summary
Existing law requires the Secretary of Government Operations to develop a coordinated plan to, among other things, investigate the feasibility of, and obstacles to, developing standards and technologies for state departments to determine digital content provenance. For the purpose of informing that coordinated plan, existing law requires the secretary to evaluate, among other things, the impact of the proliferation of deepfakes, defined to mean audio or visual content that has been generated or manipulated by artificial intelligence that would falsely appear to be authentic or truthful and that features depictions of people appearing to say or do things they did not say or do without their consent, on state government, California-based businesses, and residents of the state.
This bill would enact the Safe and Secure Innovation for Frontier Artificial Intelligence Models Act to, among other things, require that a developer, before beginning to initially train a covered model, as defined, comply with various requirements, including implementing the capability to promptly enact a full shutdown, as defined, and implement a written and separate safety and security protocol, as specified. The bill would require a developer to retain an unredacted copy of the safety and security protocol for as long as the covered model is made available for commercial, public, or foreseeably public use plus 5 years, including records and dates of any updates or revisions and would require a developer to grant to the Attorney General access to the unredacted safety and security protocol. The bill would prohibit a developer from using a covered model or covered model derivative for a purpose not exclusively related to the training or reasonable evaluation of the covered model or compliance with state or federal law or making a covered model or a covered model derivative available for commercial or public, or foreseeably public, use, if there is an unreasonable risk that the covered model or covered model derivative will cause or materially enable a critical harm, as defined. The bill would require a developer, beginning January 1, 2026, to annually retain a third-party auditor to perform an independent audit of compliance with those provisions, as prescribed. The bill would require the auditor to produce an audit report, as prescribed, and would require a developer to retain an unredacted copy of the audit report for as long as the covered model is made available for commercial, public, or foreseeably public use plus 5 years. The bill would require a developer to grant to the Attorney General access to the unredacted auditor's report upon request. The bill would exempt from disclosure under the California Public Records Act the safety and security protocol and the auditor's report described above.
This bill would require a developer of a covered model to submit to the Attorney General a statement of compliance with these provisions, as specified. The bill would also require a developer of a covered model to report each artificial intelligence safety incident affecting the covered model or any covered model derivative controlled by the developer to the Attorney General, as prescribed.
This bill would require a person that operates a computing cluster, as defined, to implement written policies and procedures to do certain things when a customer utilizes compute resources that would be sufficient to train a covered model, including assess whether a prospective customer intends to utilize the computing cluster to train a covered model.
This bill would authorize the Attorney General to bring a civil action, as provided. The bill would also provide for whistleblower protections, including by prohibiting a developer of a covered model or a contractor or subcontractor of the developer from preventing an employee from disclosing information, or retaliating against an employee for disclosing information, to the Attorney General or Labor Commissioner if the employee has reasonable cause to believe the information indicates the developer is out of compliance with certain requirements or that the covered model poses an unreasonable risk of critical harm.
This bill would create the Board of Frontier Models within the Government Operations Agency, independent of the Department of Technology, and provide for the board's membership. The bill would require the Government Operations Agency to, on or before January 1, 2027, and annually thereafter, issue regulations to, among other things, update the definition of a "covered model," as provided, and would require the regulations to be approved by the board before taking effect.
This bill would establish in the Government Operations Agency a consortium required to develop a framework for the creation of a public cloud computing cluster to be known as "CalCompute" that advances the development and deployment of artificial intelligence that is safe, ethical, equitable, and sustainable by, among other things, fostering research and innovation that benefits the public, as prescribed. The bill would, on or before January 1, 2026, require the Government Operations Agency to submit a report from the consortium to the Legislature with that framework. The bill would make those provisions operative only upon an appropriation in a budget act for its purposes.
Existing constitutional provisions require that a statute that limits the right of access to the meetings of public bodies or the writings of public officials and agencies be adopted with findings demonstrating the interest protected by the limitation and the need for protecting that interest.
This bill would make legislative findings to that effect.
02/07/24 - Introduced
February 7, 2024
03/20/24 - Amended Senate
March 20, 2024
04/08/24 - Amended Senate
April 8, 2024
04/16/24 - Amended Senate
April 16, 2024
04/30/24 - Amended Senate
April 30, 2024
05/16/24 - Amended Senate
May 16, 2024
06/05/24 - Amended Assembly
June 5, 2024
06/20/24 - Amended Assembly
June 20, 2024
07/03/24 - Amended Assembly
July 3, 2024
08/19/24 - Amended Assembly
August 19, 2024
08/22/24 - Amended Assembly
August 22, 2024
09/03/24 - Enrolled
September 3, 2024
03/29/24- Senate Judiciary
March 29, 2024
04/19/24- Senate Governmental Organization
April 19, 2024
05/03/24- Senate Appropriations
May 3, 2024
05/16/24- Senate Appropriations
May 16, 2024
05/20/24- Sen. Floor Analyses
May 20, 2024
06/17/24- Assembly Privacy and Consumer Protection
June 17, 2024
07/01/24- Assembly Judiciary
July 1, 2024
08/05/24- Assembly Appropriations
August 5, 2024
08/21/24- ASSEMBLY FLOOR ANALYSIS
August 21, 2024
08/23/24- ASSEMBLY FLOOR ANALYSIS
August 23, 2024
08/28/24- Sen. Floor Analyses
August 28, 2024
10/10/24- Sen. Floor Analyses
October 10, 2024
Sort by most recent
09/29/2024
Senate
In Senate. Consideration of Governor's veto pending.
09/29/2024
Senate
Vetoed by the Governor.
09/09/2024
California State Legislature
Enrolled and presented to the Governor at 3 p.m.
08/29/2024
Senate
Assembly amendments concurred in. (Ayes 30. Noes 9. Page 5639.) Ordered to engrossing and enrolling.
08/28/2024
Senate
In Senate. Concurrence in Assembly amendments pending.
08/28/2024
Assembly
Read third time. Passed. (Ayes 48. Noes 16. Page 6719.) Ordered to the Senate.
08/22/2024
Assembly
Ordered to third reading.
08/22/2024
Assembly
Read third time and amended.
08/20/2024
Assembly
Read second time. Ordered to third reading.
08/19/2024
Assembly
Read second time and amended. Ordered to second reading.
08/15/2024
Assembly
From committee: Do pass as amended. (Ayes 11. Noes 3.) (August 15).
08/07/2024
Assembly
August 7 set for first hearing. Placed on suspense file.
07/03/2024
Assembly
Read second time and amended. Re-referred to Com. on APPR.
07/02/2024
Assembly
From committee: Do pass as amended and re-refer to Com. on APPR. (Ayes 9. Noes 1.) (July 2).
06/20/2024
Assembly
Read second time and amended. Re-referred to Com. on JUD.
06/19/2024
Assembly
From committee: Do pass as amended and re-refer to Com. on JUD. (Ayes 8. Noes 0.) (June 18).
06/05/2024
Assembly
From committee with author's amendments. Read second time and amended. Re-referred to Com. on P. & C.P.
06/03/2024
Assembly
Referred to Coms. on P. & C.P. and JUD.
05/22/2024
Assembly
In Assembly. Read first time. Held at Desk.
05/21/2024
Senate
Read third time. Passed. (Ayes 32. Noes 1. Page 4091.) Ordered to the Assembly.
05/20/2024
Senate
Read second time. Ordered to third reading.
05/16/2024
Senate
Read second time and amended. Ordered to second reading.
05/16/2024
Senate
From committee: Do pass as amended. (Ayes 5. Noes 0. Page 3969.) (May 16).
05/10/2024
Senate
Set for hearing May 16.
05/06/2024
Senate
May 6 hearing: Placed on APPR suspense file.
04/30/2024
Senate
From committee with author's amendments. Read second time and amended. Re-referred to Com. on APPR.
04/26/2024
Senate
Set for hearing May 6.
04/23/2024
Senate
From committee: Do pass and re-refer to Com. on APPR. (Ayes 11. Noes 0. Page 3721.) (April 23). Re-referred to Com. on APPR.
04/16/2024
Senate
From committee with author's amendments. Read second time and amended. Re-referred to Com. on G.O.
04/16/2024
Senate
Set for hearing April 23.
04/08/2024
Senate
Read second time and amended. Re-referred to Com. on G.O.
04/04/2024
Senate
From committee: Do pass as amended and re-refer to Com. on G.O. (Ayes 9. Noes 0. Page 3447.) (April 2).
03/20/2024
Senate
From committee with author's amendments. Read second time and amended. Re-referred to Com. on JUD.
03/05/2024
Senate
Set for hearing April 2.
02/14/2024
Senate
Referred to Coms. on JUD. and G.O.
02/08/2024
Senate
From printer. May be acted upon on or after March 9.
02/07/2024
Senate
Introduced. Read first time. To Com. on RLS. for assignment. To print.
Sources
Record Created
Feb 8, 2024 12:20:12 PM
Record Updated
Oct 11, 2024 12:29:37 PM