#162 - Udio Song AI, TPU v5, Mixtral 8x22, Mixture-of-Depths, Musicians sign open letter

Our 162nd episode with a summary and discussion of last week's big AI news!

Read out our text newsletter and comment on the podcast at https://lastweekin.ai/

Email us your questions and feedback at [email protected] and/or [email protected]

Timestamps + links:

• Tools & Apps
  • (00:02:50) AI-Music Arms Race: Meet Udio, the Other ChatGPT for Music
  • (00:07:42) Anthropic launches external tool use for Claude AI, enabling stock ticker integrations and more
  • (00:11:51) Building LLMs for Code Repair
  • (00:14:16) Early Reviews of Humane AI Pin Aren’t Impressed
  • (00:16:23) Microsoft 365’s Copilot gets a GPT-4 Turbo upgrade and improved image generation
  • (00:18:41) AI editing tools are coming to all Google Photos users
• Applications & Business
  • (00:19:21) Google announces the Cloud TPU v5p, its most powerful AI accelerator yet
  • (00:23:32) Meta unveils its newest custom AI chip as it races to catch up
  • (00:27:27) Intel Unveils New AI Accelerator in Bid to Challenge Nvidia
  • (00:30:46) Adobe Is Buying Videos for $3 Per Minute to Build AI Model
  • (00:32:55) OpenAI transcribed over a million hours of YouTube videos to train GPT-4
  • (00:36:23) Waymo will launch paid robotaxi service in Los Angeles on Wednesday
  • (00:37:23) OpenAI removes Sam Altman's ownership of its Startup Fund
• Projects & Open Source
  • (00:39:51) Mistral AI Stuns With Surprise Launch of New Mixtral 8x22B Model
  • (00:43:54) Google updates its Gemma AI model family with variants for coding and research
  • (00:47:04) Aurora-M: The First Open Source Multilingual Language Model Red-teamed according to the U.S. Executive Order
• Research & Advancements
  • (00:52:08) Mixture-of-Depths: Dynamically allocating compute in transformer-based language models
  • (00:57:41) Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention
  • (01:03:31) Octopus v2: On-device language model for super agent
  • (01:07:54) Bigger is not Always Better: Scaling Properties of Latent Diffusion Models
  • (01:09:54) Many-shot Jailbreaking
• Policy & Safety
  • (01:15:08) Schiff unveils AI training transparency measure
  • (01:20:25) Linwei Ding was a Google software engineer. He was also a prolific thief of trade secrets, say prosecutors.
  • (01:26:11) Responsible Reporting for Frontier AI Development
  • (01:30:08) US govt wants to talk to tech companies about AI electricity demands — eyes nuclear fusion and fission
  • (01:32:39) Washington state judge blocks use of AI-enhanced video as evidence in possible first-of-its-kind ruling
  • (01:36:45) Trudeau announces $2.4 billion for AI-related investments
• Synthetic Media & Art
  • (01:39:26) Billie Eilish, Pearl Jam, Nicki Minaj Among 200 Artists Calling for Responsible AI Music Practices
• Fun!
  • (01:41:52) OpenAI's Sora just made its first music video and it's like a psychedelic trip