Sveriges mest populära poddar

LessWrong posts by zvi

“Gemini Has a Problem” by Zvi

33 min • 22 februari 2024

Google's Gemini 1.5 is impressive and I am excited by its huge context window. I continue to default to Gemini Advanced as my default AI for everyday use when the large context window is not relevant.

However, while it does not much interfere with what I want to use Gemini for, there is a big problem with Gemini Advanced that has come to everyone's attention.

Gemini comes with an image generator. Until today it would, upon request, create pictures of humans.

On Tuesday evening, some people noticed, or decided to more loudly mention, that the humans it created might not be rather different than humans you requested…

Joscha Bach: 17th Century was wild.

[prompt was] ‘please draw a portrait of a famous physicist of the 17th century.’

Kirby: i got similar results. when I went further and had it tell me who the [...]

---

Outline:

(03:06) The Internet Reacts

(07:10) How Did This Happen?

(13:52) Google's Response

(17:39) Five Good Reasons This Matters

(18:00) Reason 1: Prohibition Doesn’t Work and Enables Bad Actors

(19:06) Reason 2: A Frontier Model Was Released While Obviously Misaligned

(21:53) Reason 3: Potentially Inevitable Conflation of Different Risks From AI

(23:55) Reason 4: Bias and False Refusals Are Not Limited to Image Generation

(26:54) Reason 5: This is Effectively Kind of a Deceptive Sleeper Agent

---

First published:
February 22nd, 2024

Source:
https://www.lesswrong.com/posts/kLTyeG7R8eYpFwe3H/gemini-has-a-problem

---

Narrated by TYPE III AUDIO.

00:00 -00:00