“The One and a Half Gemini” by Zvi

Previously: I hit send on The Third Gemini, and within half an hour DeepMind announced Gemini 1.5.

So this covers Gemini 1.5. One million tokens, and we are promised overall Gemini Advanced or GPT-4 levels of performance on Gemini Pro levels of compute.

This post does not cover the issues with Gemini's image generation, and what it is and is not willing to generate. I am on top of that situation and will get to it soon.

One Million Tokens

Our teams continue pushing the frontiers of our latest models with safety at the core. They are making rapid progress. In fact, we’re ready to introduce the next generation: Gemini 1.5. It shows dramatic improvements across a number of dimensions and 1.5 Pro achieves comparable quality to 1.0 Ultra, while using less compute.

It is truly bizarre to launch Gemini Advanced as a paid [...]

---

Outline:

(00:32) One Million Tokens

(04:29) Mixture of Experts

(07:39) Quality Not Quantity

(11:52) What To Do With It?

---

First published:
February 22nd, 2024

Source:
https://www.lesswrong.com/posts/N2Y664LX6pQ8rFiz2/the-one-and-a-half-gemini

---

Narrated by TYPE III AUDIO.