Lab Employee Statement on Extreme AI Risks

This statement, signed by over 125 employees of frontier AI labs, was submitted to California Governor Newsom on September 9th, 2024. It calls on Governor Newsom to lead on AI regulation and sign California’s Senate Bill 1047 into law.

Dear Governor Newsom,

As current and former employees of frontier AI companies like OpenAI, Google DeepMind, Anthropic, Meta, and xAI, we are writing in our personal capacities to express support for California Senate Bill 1047.

We believe that the most powerful AI models may soon pose severe risks, such as expanded access to biological weapons and cyberattacks on critical infrastructure. It is feasible and appropriate for frontier AI companies to test whether the most powerful AI models can cause severe harms, and for these companies to implement reasonable safeguards against such risks.

Despite the inherent uncertainty in regulating advanced technology, we believe SB 1047 represents a meaningful step forward. We recommend that you sign SB 1047 into law.

Sincerely,

Signatories are actively being added. This list is updated periodically.

Geoffrey Hinton Turing Award Winner; Formerly Google Brain

Christopher Olah Co-Founder and Interpretability Lead, Anthropic; Formerly Interpretability Lead, OpenAI;

Jan Leike Alignment Science Co-lead, Anthropic; Formerly Superalignment Co-lead, OpenAI; Research Scientist, DeepMind

Nicholas Joseph Head of Pretraining, Anthropic; Formerly OpenAI

James Bradbury Head of Compute, Anthropic; Formerly Google DeepMind

Rob Keele Head of Legal, xAI

Scott Aaronson Professor of Computer Science, University of Texas at Austin; Formerly OpenAI

OpenAI

Juan Felipe Cerón Uribe Research Engineer

Leo Gao, Member of Technical Staff

Dan Mossing Member of Technical Staff

Michael Pokorny Research Engineer

Brydon Eastman Research Scientist

Adrien Ecoffet Member of Technical Staff

Kevin Liu Member of Technical Staff

Shantanu Jain Member of Technical Staff

Tim Marple Member of Intelligence & Investigations Staff

Ashvin Nair Member of Technical Staff

Mike Heaton Member of Technical Staff

Chris Hallacy Member of Technical Staff

Anonymous Technical or Policy Staff, OpenAI

Jeffrey Wu Formerly Scalable Alignment Lead, OpenAI

Cullen O'Keefe Formerly Policy Frontiers Research Lead

William Saunders Formerly Interpretability Lead

Daniel Kokotajlo Formerly Member of Policy Staff

Collin Burns Formerly Member of Technical Staff

Jacob Hilton Formerly Member of Technical Staff

Neil Chowdhury Formerly Member of Technical Staff

Girish Sastry Formerly Member of Policy Staff

Ryan Lowe Formerly Member of Technical Staff

Gretchen Krueger Formerly Member of Policy Staff

Anonymous Formerly OpenAI

Google DeepMind

Alexander Turner Research Scientist

Victoria Krakovna Senior Research Scientist

Noah Y. Siegel Senior Research Engineer

Sarah Cogan Software Engineer

Tom Lieberum Research Engineer

János Kramár Senior Research Engineer

Anonymous Researcher, Google DeepMind

Ramana Kumar Formerly Senior Research Scientist

Pedro Ortega Formerly AI Safety Analysis Lead

Summer Yue Formerly Bard RLHF Research Lead

Sherjil Ozair Formerly Senior Research Scientist, Google DeepMind

Vishal Maini Formerly Google DeepMind

Anonymous Formerly Researcher, Google DeepMind

Anthropic

Ethan Perez Adversarial Robustness Team Lead

Kevin Lin Trust & Safety ML Lead

Tristan Hume Performance Optimization Lead

Evan Hubinger Team Lead

Adam Jermyn Team Lead

Scott Johnston Team Lead

Nicholas Schiefer Member of Technical Staff

Samuel Marks Member of Technical Staff

Trenton Bricken Member of Technical Staff

Anne le Roux Responsible Scaling Policy

Carol Chen Member of Technical Staff

Carson Denison Member of Technical Staff

Meg Tong Member of Technical Staff

Ansh Radhakrishnan Member of Technical Staff

Benjamin Wright Member of Technical Staff

Mike Lambert Member of Technical Staff

Kshitij Sachan Member of Technical Staff

David Judd Member of Technical Staff

Adly Templeton Member of Technical Staff

Tim Maxwell Member of Technical Staff

Mrinank Sharma Member of Technical Staff

Zac Hatfield-Dodds Member of Technical Staff

Andrew Callahan Member of Technical Staff

Akbir Khan Member of Technical Staff

Sophia Porter Responsible Scaling Policy

Barret Schlegelmilch Member of Technical Staff

Julia Cabral Member of Technical Staff, Responsible Scaling

Jonathan Uesato Member of Technical Staff

Johannes Treutlein Member of Technical Staff

Tanya Singh Member of Technical Staff

Euan Ong Member of Technical Staff

Andi Peng Member of Technical Staff

Fabien Roger Member of Technical Staff

Brayden McLean Member of Technical Staff

Anonymous Member of Technical Staff Anthropic

Jeffrey Ladish Formerly Anthropic

Shannon Yang Formerly Anthropic

Josh Jacobson Formerly Anthropic

xAI

Louis Barrett Member of Technical Staff

Devin Kim Member of Technical Staff

Keiran Paster Member of Technical Staff

Eric Zelikman Member of Technical Staff

Microsoft

Matt Smith Senior Product Manager

Magic

Alana Xiang Member of Technical Staff

Arun Kumar Member of Technical Staff

Daniel Forester Legal

Cohere

Miles Turpin Formerly ML Research Engineer

David Rein Formerly ML Research Engineer

Multiple affiliations

Vladimir Mikulik Team Lead, Anthropic; Formerly Team Lead, Google DeepMind

Saffron Huang Member of Technical Staff, Anthropic; Formerly Google Deepmind

Mati Roy Human Data Project Lead, xAI; Formerly OpenAI

Daniel Ziegler Member of Technical Staff, Anthropic; Formerly OpenAI

Richard Ngo Member of Policy Staff, OpenAI; Formerly Google DeepMind

Todor Markov Member of Technical Staff, Anthropic; Formerly OpenAI

Jan Hendrik Kirchner Member of Technical Staff, Anthropic; Formerly OpenAI

Carroll L. Wainwright Member of Technical Staff, Anthropic; Formerly OpenAI

Steven Bills Member of Technical Staff, Anthropic; Formerly OpenAI

Peter Hase AI resident, Anthropic; Formerly ML at Google Research and Meta

Mike Schiraldi Member of Technical Staff, Anthropic; Formerly Google

Yuri Burda Researcher, Anthropic; Formerly OpenAI

Johannes Gasteiger Member of Technical Staff Anthropic, Formerly Google Research

Titles and affiliations are for identification purposes only; signatures are made by signatories in their personal capacities and do not represent the views of any company.