Two former OpenAI researchers, William Saunders and Daniel Kokotajlo, have expressed their concerns about OpenAI's opposition to California's proposed AI safety bill, SB 1047, which includes provisions for strict safety protocols and a "kill switch" for AI systems. In a letter shared with Politico and addressed to California Governor Gavin Newsom and other lawmakers, Saunders and Kokotajlo criticized OpenAI's stance, stating that while the company publicly supports AI regulation, it opposes concrete legislative efforts like SB 1047.
The researchers, who resigned from OpenAI due to concerns over the company's commitment to safely and responsibly developing AI, argue that the bill's safety measures are crucial to preventing catastrophic harm from powerful AI systems. They highlight a disconnect between OpenAI CEO Sam Altman's public advocacy for AI regulation and the company's opposition to specific regulatory actions, such as SB 1047. Saunders and Kokotajlo suggest that OpenAI's objections to the bill are not made in good faith and do not constructively contribute to the conversation on AI safety.
OpenAI, through a statement from a spokesperson and a letter from Chief Strategy Officer Jason Kwon to Business Insider, has defended its position on SB 1047. The company argues that while it supports some of the bill's safety provisions, the regulation of AI should be handled at the federal level rather than through state legislation. OpenAI believes that a unified federal approach would better foster innovation and allow the U.S. to lead in developing global AI standards. Kwon's letter, addressed to California Senator Scott Wiener, who introduced the bill, emphasized the potential national security implications of AI development as a reason for federal rather than state-level regulation.
Saunders and Kokotajlo, however, are not convinced by OpenAI's reasoning. They stress the urgency of implementing AI safety regulations and argue that waiting for Congress to act is not a viable option, as federal lawmakers have shown reluctance to pass meaningful AI legislation. They urge the California Legislature and Governor Newsom to pass SB 1047, believing that with proper regulation, OpenAI can still fulfill its mission of safely developing artificial general intelligence (AGI).
“Sam Altman, our former boss, has repeatedly called for AI regulation,” the researchers wrote in a letter which was initially shared with Politico. The letter also urges California governor Gavin Newsom to sign the bill. “Now, when actual regulation is on the table, he opposes it.” The researchers also state that, “With appropriate regulation, we hope OpenAI may yet live up to its mission statement of building AGI safely.”