“AI #69: Nice” by Zvi

Nice job breaking it, hero, unfortunately. Ilya Sutskever, despite what I sincerely believe are the best of intentions, has decided to be the latest to do The Worst Possible Thing, founding a new AI company explicitly looking to build ASI (superintelligence). The twists are zero products with a ‘cracked’ small team, which I suppose is an improvement, and calling it Safe Superintelligence, which I do not suppose is an improvement.

How is he going to make it safe? His statements tell us nothing meaningful about that.

There were also changes to SB 1047. Most of them can be safely ignored. The big change is getting rid of the limited duty exception, because it seems I was one of about five people who understood it, and everyone kept thinking it was a requirement for companies instead of an opportunity. And the literal chamber of commerce fought hard to [...]

---

Outline:

(01:43) Language Models Offer Mundane Utility

(06:13) Language Models Don’t Offer Mundane Utility

(08:21) Fun with Image Generation

(13:05) Deepfaketown and Botpocalypse Soon

(14:12) The Art of the Jailbreak

(15:07) Copyright Confrontation

(16:14) A Matter of the National Security Agency

(21:22) Get Involved

(21:38) Introducing

(23:56) In Other AI News

(29:06) Quiet Speculations

(38:29) AI Is Going to Be Huuuuuuuuuuge

(47:18) SB 1047 Updated Again

(01:00:48) The Quest for Sane Regulations

(01:02:42) The Week in Audio

(01:03:54) The ARC of Progress

(01:13:10) Put Your Thing In a Box

(01:15:50) What Will Ilya Do?

(01:20:54) Actual Rhetorical Innovation

(01:24:19) Rhetorical Innovation

(01:27:48) Aligning a Smarter Than Human Intelligence is Difficult

(01:32:28) People Are Worried About AI Killing Everyone

(01:32:41) Other People Are Not As Worried About AI Killing Everyone

(01:35:38) The Lighter Side

---

First published:
June 20th, 2024

Source:
https://www.lesswrong.com/posts/ytFLs37zLsFBqLHGA/ai-69-nice

---

Narrated by TYPE III AUDIO.