Context windows, computer constraints, and energy consumption with Sarah and Elad

This week on No Priors hosts, Sarah and Elad are catching up on the latest AI news. They discuss the recent developments in AI like Meta’s new AI assistant and the latest in music generation, and if you’re interested in generative AI music, stay tuned for next week’s interview! Sarah and Elad also get into device-resident models, AI hardware, and ask just how smart smaller models can really get. These hardware constraints were compared to the hurdles AI platforms are continuing to face including computing constraints, energy consumption, context windows, and how to best integrate these products in apps that users are familiar with.

Have a question for our next host-only episode or feedback for our team? Reach out to [email protected]

Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil 

Show Notes: 

(0:00) Intro

(1:25) Music AI generation

(4:02) Apple’s LLM

(11:39) The role of AI-specific hardware

(15:25) AI platform updates

(18:01) Forward thinking in investing in AI

(20:33) Unlimited context

(23:03) Energy constraints