OpenAI Has No Moat, Google's Godfather of AI Quits & The Rise of Open Source LLMs | E13

In Episode 13 of This Day in AI We Discuss the Leaked Internal Google Document, "We Have No Moat, and Neither Does OpenAI", Discuss "The Godfather" of AI leaving Google, Discuss The Implications of Open Source LLM Advancement, Cover Open Assistant's Comparable Model to ChatGPT, OpenAI's Code Interrupter and Touch of Democratizing LLM Alignment.

If you like this episode please consider subscribing and liking the episode to help others discover the podcast.

TIMESTAMPS:
====
00:00 - Godfather of AI Quits Google Cold Open
00:17 - Google & OpenAI Have No Moat: Advancement of Open Source LLMs
21:13 - 'Godfather of AI' Quits Google
30:54 - Open Assistant & Training LLMs using AI
40:52 - What Increased Prompt Sizes Mean & Long Range Transformers
50:49 - AI Agents, AI Disruption & Mark Zuckerberg's Agent Plan for Meta

SOURCES
====
https://www.semianalysis.com/p/google-we-have-no-moat-and-neither
https://www.nytimes.com/2023/05/01/technology/ai-google-chatbot-engineer-quits-hinton.html
https://www.theverge.com/2023/4/26/23699633/mark-zuckerberg-meta-generative-ai-chatbots-instagram-facebook-whatsapp
https://arxiv.org/pdf/2305.01625.pdf
https://twitter.com/tanayj/status/1653243500354322436?s=46&t=uXHUN4Glah4CaV-g2czc6Q
https://restofworld.org/2023/chatgpt-taking-kenya-ghostwriters-jobs/
https://www.oneusefulthing.org/p/it-is-starting-to-get-strange
https://www.nvidia.com/en-au/autonomous-machines/embedded-systems/
https://open-assistant.io/chat