“Gemini 1.0” by Zvi

It's happening. Here is CEO Pichai's Twitter announcement. Here is Demis Hassabis announcing. Here is the DeepMind Twitter announcement. Here is the blog announcement. Here is Gemini co-lead Oriol Vinyals, promising more to come. Here is Google's Chief Scientist Jeff Dean bringing his best hype.

Technical Specifications

Let's check out the specs.

Context length trained was 32k tokens, they report 98% accuracy on information retrieval for Ultra across the full context length. So a bit low, both lower than GPT—4 and Claude and lower than their methods can handle. Presumably we should expect that context length to grow rapidly with future versions.

There are three versions of Gemini 1.0.

Gemini 1.0, our first version, comes in three sizes: Ultra for highly-complex tasks, Pro for enhanced performance and deployability at scale, and Nano for on-device applications. Each size is specifically tailored to [...]

---

Outline:

(00:25) Technical Specifications

(11:20) Level Two Bard

(12:42) Gemini Reactions

---

First published:
December 7th, 2023

Source:
https://www.lesswrong.com/posts/ofYejKKiSFYH2gLBb/gemini-1-0

---

Narrated by TYPE III AUDIO.