“On the Proposed California SB 1047” by Zvi

California Senator Scott Wiener of San Francisco introduces SB 1047 to regulate AI. I have put up a market on how likely it is to become law.

“If Congress at some point is able to pass a strong pro-innovation, pro-safety AI law, I’ll be the first to cheer that, but I’m not holding my breath,” Wiener said in an interview. “We need to get ahead of this so we maintain public trust in AI.”

Congress is certainly highly dysfunctional. I am still generally against California trying to act like it is the federal government, even when the cause is good, but I understand.

Can California effectively impose its will here?

On the biggest players, for now, presumably yes.

In the longer run, when things get actively dangerous, then my presumption is no.

There is a potential trap here. If we put our rules [...]

---

Outline:

(02:48) Close Reading of the Bill

(10:50) My High Level Takeaways From the Close Reading

(11:37) Another More Skeptical Reaction to the Same Bill

(13:01) What is a Covered Model Here?

(15:39) Precautionary Principle and Covered Guidance

(18:07) Non-Derivative

(18:28) So What Would This Law Actually Do?

(20:44) Crying Wolf

---

First published:
February 12th, 2024

Source:
https://www.lesswrong.com/posts/oavGczwcHWZYhmifW/on-the-proposed-california-sb-1047

---

Narrated by TYPE III AUDIO.