“Notes on Dwarkesh Patel’s Podcast with Sholto Douglas and Trenton Bricken” by Zvi

Dwarkesh Patel continues to be on fire, and the podcast notes format seems like a success, so we are back once again.

This time the topic is how LLMs are trained, work and will work in the future. Timestamps are for YouTube. Where I inject my own opinions or takes, I do my best to make that explicit and clear.

This was highly technical compared to the average podcast I listen to, or that Dwarkesh does. This podcast definitely threated to technically go over my head at times, and some details definitely did go over my head outright. I still learned a ton, and expect you will too if you pay attention.

This is an attempt to distill what I found valuable, and what questions I found most interesting. I did my best to make it intuitive to follow even if you are not technical, but [...]

---

First published:
April 1st, 2024

Source:
https://www.lesswrong.com/posts/dBueknepD4rhuEcmb/notes-on-dwarkesh-patel-s-podcast-with-sholto-douglas-and

---

Narrated by TYPE III AUDIO.