”The Cognitive Revolution” | AI Builders, Researchers, and Live Player Analysis

In this episode, Aaron Levie, Co-founder and CEO of Box, discusses the current landscape of AI and its rapid advancements. He compares the enthusiasm for AI in the enterprise to the initial reluctance faced during the early days of cloud adoption. Levie shares insights into how AI is integrated into both his personal and professional life, highlighting new apps, tools, and features driven by AI. He elaborates on Box's AI initiatives, including the creation of Box AI to manage enterprise content and the concept of AI agents and their impact on enterprise IT departments. Levie also addresses the obstacles and opportunities in deploying AI at scale, predicting significant changes and a new era of 'systems of intelligence' in enterprise software.

SPONSORS:

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive

NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive

Shopify: Dreaming of starting your own business? Shopify makes it easier than ever. With customizable templates, shoppable social media posts, and their new AI sidekick, Shopify Magic, you can focus on creating great products while delegating the rest. Manage everything from shipping to payments in one place. Start your journey with a $1/month trial at https://shopify.com/cognitive and turn your 2025 dreams into reality.

Vanta: Vanta simplifies security and compliance for businesses of all sizes. Automate compliance across 35+ frameworks like SOC 2 and ISO 27001, streamline security workflows, and complete questionnaires up to 5x faster. Trusted by over 9,000 companies, Vanta helps you manage risk and prove security in real time. Get $1,000 off at https://vanta.com/revolution

CHAPTERS:

(00:00) Teaser

(00:50) About the Episode

(03:49) Introduction and Warm-Up

(04:08) Personal AI Use and Worldview

(06:48) Enterprise AI Excitement

(07:22) Comparing Cloud and AI Adoption

(11:19) Transforming IT Departments

(14:24) Box's New AI Features

(18:08) Sponsors: Oracle Cloud Infrastructure (OCI) | NetSuite

(20:48) Challenges in AI Implementation

(22:25) Building the Right AI Architecture

(27:41) The Future of AI Agents

(29:04) Exploring Agent Capabilities

(30:55) The Evolution of Enterprise Software

(32:12) Sponsors: Shopify | Vanta

(35:28) AI's Role in Non-Deterministic Workflows

(37:07) Challenges in AI Deployment

(40:27) AI's Impact on Enterprise Software

(44:47) Debates on Enterprise Software's Future

(52:33) AI-Driven Productivity in Enterprises

(55:01) Conclusion and Future Outlook

(55:44) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://linkedin.com/in/nathanlabenz/

Youtube: https://youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

PRODUCED BY:

https://aipodcast.ing

This episode explores the groundbreaking advancements in AGI from recent releases of two Chinese reasoning models: DeepSeek's R1 and Moonshot AI's Kimmy. The discussion delves into the methods, comparative analysis, and implications of these models, particularly focusing on the diverse reinforcement learning techniques employed. Despite computation constraints, these models have achieved significant performance, suggesting a paradigm shift in AI development strategies. The episode also covers the broader strategic dynamics, economic, and policy implications surrounding these developments in China and the West. The conversation highlights the importance of hands-on interaction with these models for a deeper understanding and comprehensive learning experience.

SPONSORS:

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive

NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive

Shopify: Dreaming of starting your own business? Shopify makes it easier than ever. With customizable templates, shoppable social media posts, and their new AI sidekick, Shopify Magic, you can focus on creating great products while delegating the rest. Manage everything from shipping to payments in one place. Start your journey with a $1/month trial at https://shopify.com/cognitive and turn your 2025 dreams into reality.

Vanta: Vanta simplifies security and compliance for businesses of all sizes. Automate compliance across 35+ frameworks like SOC 2 and ISO 27001, streamline security workflows, and complete questionnaires up to 5x faster. Trusted by over 9,000 companies, Vanta helps you manage risk and prove security in real time. Get $1,000 off at https://vanta.com/revolution

CHAPTERS:

(00:00) Introduction

(05:44) The R1 Model: A Deep Dive

(10:05) Reinforcement Learning and Emergent Behaviors (Part 1)

(16:56) Sponsors: Oracle Cloud Infrastructure (OCI) | NetSuite

(19:36) Reinforcement Learning and Emergent Behaviors (Part 2)

(29:14) Challenges and Future Directions (Part 1)

(31:55) Sponsors: Shopify | Vanta

(35:11) Challenges and Future Directions (Part 2)

(43:00) Productizing the R1 Model

(01:00:20) The Remarkable Output of Language Models

(01:00:34) Exploring R1's Creative Writing Capabilities

(01:03:55) Tiny Stories and Learning Order in Small Models

(01:08:34) Censorship and Strategic Questions

(01:11:36) Key Takeaways and Future Implications

(01:14:17) Comparing Approaches: R1 and Kimmy

(01:27:19) The Path to Superhuman Performance

(01:33:42) Strategic Dynamics and Policy Responses

(01:46:50) Final Thoughts and Call to Action

(01:48:04) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

PRODUCED BY:

https://aipodcast.ing

Jonathan Godwin, founder and CEO of Orbital Materials, alongside researcher Tim Duignan, discuss the transformative potential of AI in material science on the Cognitive Revolution podcast. They explore foundational concepts, the integration of computational simulations, and the development of new materials for various applications such as data centers and combating climate change. They also delve into the latest advancements, including a groundbreaking study on the potassium ion channel, and speculate on the future of AI in scientific discovery and material synthesis.

Check out some of Tim's work:

• Google Colab to run you own simulation: https://colab.research.google.com/github/timduignan/orb-models/blob/main/examples/OrbMDTut.ipynb
• GitHub repository "Orb force fields": https://github.com/orbital-materials/orb-models
• Preprint "A potassium ion channel simulated with a universal neural network potential": https://arxiv.org/abs/2411.18931

Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse

SPONSORS:

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive

NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive

Shopify: Dreaming of starting your own business? Shopify makes it easier than ever. With customizable templates, shoppable social media posts, and their new AI sidekick, Shopify Magic, you can focus on creating great products while delegating the rest. Manage everything from shipping to payments in one place. Start your journey with a $1/month trial at https://shopify.com/cognitive and turn your 2025 dreams into reality.

Vanta: Vanta simplifies security and compliance for businesses of all sizes. Automate compliance across 35+ frameworks like SOC 2 and ISO 27001, streamline security workflows, and complete questionnaires up to 5x faster. Trusted by over 9,000 companies, Vanta helps you manage risk and prove security in real time. Get $1,000 off at https://vanta.com/revolution

CHAPTERS:

(00:00) Teaser

(01:05) About the Episode

(05:10) Welcome to Orbital

(06:15) Semiconductors

(07:44) Material Science Today

(09:22) Experimental Cycle

(12:06) Orbital’s Founding

(14:51) AI in Materials (Part 1)

(21:05) Sponsors: OCI | NetSuite

(23:45) AI in Materials (Part 2)

(35:00) Sponsors: Shopify | Vanta

(38:15) Generative Models

(38:16) Diffusion Models

(50:50) Orbital Applications

(58:19) Perfect Sponge

(59:43) AI Simulations

(01:01:27) Natural Language

(01:02:35) Compute Needs

(01:05:05) Human Electrical Nature

(01:06:11) Potassium Channels

(01:15:51) Scaling Simulations

(01:23:56) Roadmap: Carbon Removal

(01:30:37) AI & Job Satisfaction

(01:36:14) LLMs & Potentials

(01:37:19) AGI & Discovery

(01:39:58) Outro

In this episode of The Cognitive Revolution, Nathan explores the groundbreaking paper on obfuscated activations with 3 members from the research team - Luke Bailey, Eric Jenner, and Scott Emmons. The team discusses how their work challenges latent-based defenses in AI systems, demonstrating methods to bypass safety mechanisms while maintaining harmful behaviors. Join us for an in-depth technical conversation about AI safety, interpretability, and the ongoing challenge of creating robust defense systems.

Do check out the "Obfuscated Activations Bypass LLM Latent-Space Defenses" paper here: https://obfuscated-activations.github.io/

Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse

SPONSORS:

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive

NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive

Shopify: Dreaming of starting your own business? Shopify makes it easier than ever. With customizable templates, shoppable social media posts, and their new AI sidekick, Shopify Magic, you can focus on creating great products while delegating the rest. Manage everything from shipping to payments in one place. Start your journey with a $1/month trial at https://shopify.com/cognitive and turn your 2025 dreams into reality.

Vanta: Vanta simplifies security and compliance for businesses of all sizes. Automate compliance across 35+ frameworks like SOC 2 and ISO 27001, streamline security workflows, and complete questionnaires up to 5x faster. Trusted by over 9,000 companies, Vanta helps you manage risk and prove security in real time. Get $1,000 off at https://vanta.com/revolution

RECOMMENDED PODCAST:

Check out Modern Relationships where Erik Torenberg interviews tech power couples and leading thinkers to explore how ambitious people actually make partnerships work. This season's guests include: Delian Asparouhov & Nadia Asparouhova, Kristen Berman & Phil Levin, Rob Henderson, and Liv Boeree & Igor Kurganov.

Apple: https://podcasts.apple.com/us/podcast/id1786227593

Spotify: https://open.spotify.com/show/5hJzs0gDg6lRT6r10mdpVg

YouTube: https://www.youtube.com/@ModernRelationshipsPod

CHAPTERS:

(00:00:00) Teaser

(00:00:46) About the Episode

(00:05:11) Latent Space Defenses

(00:08:41) Sleeper Agents

(00:15:06) Three Case Studies (Part 1)

(00:17:02) Sponsors: Oracle Cloud Infrastructure (OCI) | NetSuite

(00:19:42) Three Case Studies (Part 2)

(00:24:09) SQL Generation

(00:26:17) Understanding Defenses

(00:32:52) Out-of-Distribution Detection (Part 1)

(00:35:37) Sponsors: Shopify | Vanta

(00:38:52) Out-of-Distribution Detection (Part 2)

(00:45:13) Loss Function Weighting

(00:57:49) Who Moves Last?

(01:11:41) High-Level Triggers

(01:25:33) Open Source vs. Access

(01:38:57) Internalizing Reasoning

(01:53:07) Representing Concepts

(02:06:38) Final Thoughts

(02:09:33) Outro

Nathan explores the cutting-edge intersection of AI and rare disease research with Dr. Catherine Brownstein of Boston Children's Hospital and Harvard Medical School. In this episode of The Cognitive Revolution, we dive into how frontier AI models are revolutionizing the diagnosis of rare diseases. Join us for an insightful conversation with a ChatGPT Pro grant winner who's pioneering the use of AI to help patients find answers faster.

Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse

Check out Modern Relationships, where Erik Torenberg interviews tech power couples and leading thinkers to explore how ambitious people actually make partnerships work. This season's guests include: Delian Asparouhov & Nadia Asparouhova, Kristen Berman & Phil Levin, Rob Henderson, and Liv Boeree & Igor Kurganov.

Apple: https://podcasts.apple.com/us/podcast/id1786227593

Spotify: https://open.spotify.com/show/5hJzs0gDg6lRT6r10mdpVg

YouTube: https://www.youtube.com/@ModernRelationshipsPod

SPONSORS:

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive

NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive

Shopify: Dreaming of starting your own business? Shopify makes it easier than ever. With customizable templates, shoppable social media posts, and their new AI sidekick, Shopify Magic, you can focus on creating great products while delegating the rest. Manage everything from shipping to payments in one place. Start your journey with a $1/month trial at https://shopify.com/cognitive and turn your 2025 dreams into reality.

Vanta: Vanta simplifies security and compliance for businesses of all sizes. Automate compliance across 35+ frameworks like SOC 2 and ISO 27001, streamline security workflows, and complete questionnaires up to 5x faster. Trusted by over 9,000 companies, Vanta helps you manage risk and prove security in real time. Get $1,000 off at https://vanta.com/revolution

CHAPTERS:

(00:00:00) Teaser

(00:00:56) About the Episode

(00:04:45) Rare Diseases Common

(00:06:48) Patient Journey

(00:12:57) Genome Sequencing

(00:19:39) Sponsors: Oracle Cloud Infrastructure (OCI) | NetSuite

(00:22:19) Diagnosis Process

(00:30:50) Data Pipelines

(00:35:51) Sponsors: Shopify | Vanta

(00:39:07) Interaction Graphs

(00:42:18) Data Accessibility

(00:43:42) AI in Pipelines

(00:45:40) LLM Impact

(00:48:40) Anomaly Detection

(00:52:07) Data Sharing

(00:58:49) Data Reform

(01:02:41) AI's Potential

(01:04:30) AI Applications

(01:06:57) Prompt Engineering

(01:14:51) Model Comparison

(01:19:16) Prompting Insights

(01:22:14) Move 37 Analogy

(01:24:34) Future Potential

(01:29:27) Future Experience

(01:32:39) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

In this second part of the special AMA episode, Nathan explores profound questions about AI's future and its impact on society. From painting a picture of AI utopia to discussing the challenges of consciousness and potential doom scenarios, Nathan shares insights on how we might adapt and thrive in an AI-transformed world. Join us for a thought-provoking conversation that delves into the practical strategies for engaging with AI, the role of safety measures, and the importance of maintaining ethical considerations as we navigate this technological revolution.

Check out http://aipodcast.ing for AI-powered podcast production services or reach out to Adithyan for more information.

Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse

SPONSORS:

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive

80,000 Hours: 80,000 Hours is dedicated to helping you find a fulfilling career that makes a difference. With nearly a decade of research, they offer in-depth material on AI risks, AI policy, and AI safety research. Explore their articles, career reviews, and a podcast featuring experts like Anthropic CEO Dario Amodei. Everything is free, including their Career Guide. Visit https://80000hours.org/cognitiverevolution to start making a meaningful impact today.

NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive.

CHAPTERS:

(00:00:00) Teaser

(00:00:56) AI Utopia

(00:05:48) Adapting to AI

(00:08:01) Probability of Utopia

(00:10:51) Challenging Worldviews (Part 1)

(00:11:02) Sponsors: Oracle Cloud Infrastructure (OCI) | 80,000 Hours

(00:13:42) Challenging Worldviews (Part 2)

(00:23:50) Audience Questions (Part 1)

(00:24:07) Sponsors: NetSuite

(00:25:39) Audience Questions (Part 2)

(00:30:15) AI in Various Fields

(00:33:16) AI in Psychiatry

(00:36:16) Superintelligence

(00:40:50) Societal Shift with ASI

(00:49:27) Doom Discourse

(00:57:05) Existential Risk

(01:05:53) AI Takeover

(01:14:30) AI Safety Efforts

(01:18:36) Model Release Secrecy

(01:27:20) AI Consciousness

(01:37:51) Practical AI Strategies

(01:50:34) Book Recommendation

(01:59:34) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.appl...

In this special AMA episode, Nathan answers questions posed by The Cognitive Revolution podcast listeners. He discusses AI developments in 2024, including OpenAI's o3 announcement, deliberative alignment, and the future of AI technology. It is an insightful discussion about AI's impact on education, coding careers, and business sustainability in an AI-driven world.

Check out http://aipodcast.ing for AI-powered podcast production services or reach out to Adithyan for more information.

Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse

SPONSORS:

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive

80,000 Hours: 80,000 Hours is dedicated to helping you find a fulfilling career that makes a difference. With nearly a decade of research, they offer in-depth material on AI risks, AI policy, and AI safety research. Explore their articles, career reviews, and a podcast featuring experts like Anthropic CEO Dario Amodei. Everything is free, including their Career Guide. Visit https://80000hours.org/cognitiverevolution to start making a meaningful impact today.

NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive.

CHAPTERS:

(00:00:00) Teaser

(00:01:00) AI Podcasting

(00:03:19) o3 vs. Other Models

(00:10:25) o3 Breaks Benchmarks (Part 1)

(00:14:19) Sponsors: Oracle Cloud Infrastructure (OCI) | 80,000 Hours

(00:16:59) o3 Breaks Benchmarks (Part 2)

(00:27:51) OpenAI's Safety Plan (Part 1)

(00:28:45) Sponsors: NetSuite

(00:30:18) OpenAI's Safety Plan (Part 2)

(00:39:08) Safety & Governance

(00:50:48) Tail of the Tape

(00:59:38) Underutilized Potential

(01:05:07) RAG & State Space

(01:18:14) Agentic Frameworks

(01:29:55) AI & Education

(01:35:59) Learn to Code?

(01:43:00) Defensible Moats?

(01:53:53) UBI & Wealth

(01:59:08) Contributing to AI Safety

(02:04:25) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

In this episode of The Cognitive Revolution, Nathan hosts Will Hardman, founder of AI advisory firm Veritai, for a comprehensive technical survey of vision language models (VLMs). We explore the evolution of VLMs from early vision transformers to state-of-the-art architectures like InternVL and Llama3V, examining key innovations and architectural decisions. Join us for an in-depth discussion covering multimodality in AI systems, evaluation frameworks, and practical applications with one of the field's leading experts.

Here's to the link to one of the most comprehensive reference documents for VLMs prepared by Will Hardman: https://dust-mailbox-c73.notion.site/Vision-Language-Models-11b675d75dd480af994cc474a754bb26

Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse

SPONSORS:

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive

80,000 Hours: 80,000 Hours is dedicated to helping you find a fulfilling career that makes a difference. With nearly a decade of research, they offer in-depth material on AI risks, AI policy, and AI safety research. Explore their articles, career reviews, and a podcast featuring experts like Anthropic CEO Dario Amodei. Everything is free, including their Career Guide. Visit https://80000hours.org/cognitiverevolution to start making a meaningful impact today.

CHAPTERS:

(00:00:00) Teaser

(00:00:55) About the Episode

(00:05:45) Introduction

(00:09:16) VLM Use Cases

(00:13:47) Vision Transformers (Part 1)

(00:17:48) Sponsors: Oracle Cloud Infrastructure (OCI)

(00:19:00) Vision Transformers (Part 2)

(00:24:58) OpenAI's CLIP Model

(00:33:44) DeepMind's Flamingo (Part 1)

(00:33:44) Sponsors: 80,000 Hours

(00:35:17) DeepMind's Flamingo (Part 2)

(00:48:29) Instruction Tuning with LAVA

(01:09:25) MMMU Benchmark

(01:14:42) Pre-training with QNVL

(01:32:13) InternVL Model Series

(01:52:33) Cross-Attention vs. Self-Attention

(02:14:33) Hybrid Architectures

(02:31:08) Early vs. Late Fusion

(02:34:50) VQA and DocVQA Benchmarks

(02:40:08) The Blink Benchmark

(03:05:37) Generative Pre-training

(03:15:26) Multimodal Generation

(03:37:00) Frontier Labs & Benchmarks

(03:47:45) Conclusion

(03:53:28) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

In this episode of The Cognitive Revolution, Nathan shares a fascinating cross-post from Doom Debates featuring a conversation between Liron Shapira and roon, an influential Twitter Anon from OpenAI's technical staff. They explore crucial insights into how OpenAI's team views AI's future, including discussions on AGI development, alignment challenges, and extinction risks. Join us for this thought-provoking analysis of AI safety and the mindset of those building transformative AI systems.

Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse

SPONSORS:

GiveWell: GiveWell has spent over 17 years researching global health and philanthropy to identify the highest-impact giving opportunities. Over 125,000 donors have contributed more than $2 billion, saving over 200,000 lives through evidence-backed recommendations. First-time donors can have their contributions matched up to $100 before year-end. Visit https://GiveWell.org, select podcast, and enter Cognitive Revolution at checkout to make a difference today.

SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive

Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today.

CHAPTERS:

CHAPTERS:

(00:00:00) About the Episode

(00:07:18) Introducing roon

(00:09:13) roon's Background

(00:16:40) roon the Person (Part 1)

(00:21:56) Sponsors: GiveWell | SelectQuote

(00:24:45) roon the Person (Part 2)

(00:26:43) Excitement in AI

(00:31:59) Creativity in AI

(00:40:18) Sponsors: Oracle Cloud Infrastructure (OCI) | Weights & Biases RAG++

(00:42:36) roon's P(Doom)

(00:52:25) AI Risk & Regulation

(00:53:51) AI Timelines

(01:01:20) Aligned by Default?

(01:09:16) Training vs Production

(01:14:30) Open Source AI Risk

(01:26:25) Goal-Oriented AI

(01:34:29) Pause AI?

(01:39:46) Dogecoin & Wrap Up

(01:41:06) Outro & Call to Action

(01:56:38) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast...

In this episode of The Cognitive Revolution, Nathan interviews Emad Mostaque, former Founder and CEO of Stability AI and Founder of The Intelligent Internet. We explore humanity's future with AI, from the stark 50-50 survival odds to Emad's optimistic vision for universal basic intelligence. Join us for a fascinating discussion about open-source AI infrastructure, the three-tier system of the Intelligent Internet, and how blockchain technology might help fund global public goods in AI development.

Check out Emad's publications on:

Emad's Twitter: https://x.com/emostaque

Emad's Blog: https://emad.posthaven.com/

Intelligent Internet Substack: https://intelligentinternet.substack.com/p/ii-intelligent-internet-primer?r=47215t&utm_campaign=post&utm_medium=web&triedRedirect=true

The Cognitive Revolution Ask Me Anything and Listener Survey: https://docs.google.com/forms/d/1aYv2XLID7RqGxj2_Y4_6x9mo_aqXcGCeLw1EQhy4IpY/edit

Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse

SPONSORS:

GiveWell: GiveWell has spent over 17 years researching global health and philanthropy to identify the highest-impact giving opportunities. Over 125,000 donors have contributed more than $2 billion, saving over 200,000 lives through evidence-backed recommendations. First-time donors can have their contributions matched up to $100 before year-end. Visit https://GiveWell.org, select podcast, and enter Cognitive Revolution at checkout to make a difference today.

SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive

80,000 Hours: 80,000 Hours is dedicated to helping you find a fulfilling career that makes a difference. With nearly a decade of research, they offer in-depth material on AI risks, AI policy, and AI safety research. Explore their articles, career reviews, and a podcast featuring experts like Anthropic CEO Dario Amodei. Everything is free, including their Career Guide. Visit https://80000hours.org/cognitiverevolution to start making a meaningful impact today.

CHAPTERS:

(00:00:00) Teaser

(00:00:36) About the Episode

(00:04:33) Intro

(00:09:15) AI Risk

(00:16:58) Sponsors: GiveWell | SelectQuote

(00:19:48) AI Goals

(00:23:52) AI Divergence

(00:27:50) AI & Agency

(00:32:18) Sponsors: Oracle Cloud Infrastructure (OCI) | 80,000 Hours

(00:34:57) Kids & AI

(00:39:50) Intelligent Internet

(00:48:37) Open vs. Closed AI

(00:53:30) AI Runaway

(01:01:46) Building the Future

(01:05:43) Energy & AI

(01:15:19) Hypernodes

(01:27:36) Proof of Beneficial Compute

(01:38:28) Distributed Compute

(01:45:10) Intelligent Internet Company

(01:48:37) Finding Talent

(01:55:33) Pause Letter

(01:59:50) Regulation

(02:04:04) Speed Limits

(02:06:42) Data Filtering

(02:10:54) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

In this episode of The Cognitive Revolution, Nathan explores METR's groundbreaking REBench evaluation framework with Neev Parikh. We dive deep into how this new benchmark assesses AI systems' ability to perform real machine learning research tasks, from optimizing GPU kernels to fine-tuning language models. Join us for a fascinating discussion about the current capabilities of AI models like Claude 3.5 and GPT-4, and what their performance tells us about the trajectory of artificial intelligence development.

Check out METR's work:

blog post: https://metr.org/blog/2024-11-22-evaluating-r-d-capabilities-of-llms/

paper: https://metr.org/AI_R_D_Evaluation_Report.pdf

jobs: https://hiring.metr.org/

The Cognitive Revolution Ask Me Anything and Listener Survey: https://docs.google.com/forms/d/1aYv2XLID7RqGxj2_Y4_6x9mo_aqXcGCeLw1EQhy4IpY/edit

Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse

SPONSORS:

GiveWell: GiveWell has spent over 17 years researching global health and philanthropy to identify the highest-impact giving opportunities. Over 125,000 donors have contributed more than $2 billion, saving over 200,000 lives through evidence-backed recommendations. First-time donors can have their contributions matched up to $100 before year-end. Visit https://GiveWell.org, select podcast, and enter Cognitive Revolution at checkout to make a difference today.

SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive

Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today.

CHAPTERS:

(00:00:00) Teaser

(00:01:04) About the Episode

(00:05:14) Introducing METR

(00:07:36) Specialization of AI Risk

(00:09:52) AI R&D vs. Autonomy

(00:12:41) Benchmark Design Choices

(00:16:04) Benchmark Design Principles (Part 1)

(00:18:54) Sponsors: GiveWell | SelectQuote

(00:21:44) Benchmark Design Principles (Part 2)

(00:22:35) AI vs. Human Evaluation

(00:26:55) Optimizing Runtimes

(00:36:02) Sponsors: Oracle Cloud Infrastructure (OCI) | Weights & Biases RAG++

(00:38:20) AI Myopia

(00:43:37) Optimizing Loss

(00:47:59) Optimizing Win Rate

(00:50:24) Best of K Analysis

(01:02:26) Best of K Limitations

(01:09:04) Agent Interaction Modalities

(01:12:34) Analyzing Benchmark Results

(01:17:16) Model Performance Differences

(01:22:49) Elicitation and Scaffolding

(01:27:08) Context Window & Best of K

(01:35:17) Reward Hacking & Bad Behavior

(01:43:47) Future Directions & Hiring

(01:46:20) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Nathan discusses groundbreaking AI and biology research with Stanford Professor James Zou from the Chan Zuckerberg Initiative. In this episode of The Cognitive Revolution, we explore two remarkable papers: the virtual lab framework that created novel COVID treatments with minimal human oversight, and InterPLM's discovery of new protein motifs through mechanistic interpretability. Join us for an fascinating discussion about how AI is revolutionizing biological research and drug discovery.

Got questions about AI? Submit them for our upcoming AMA episode + take our quick listener survey to help us serve you better - https://docs.google.com/forms/d/e/1FAIpQLSefHvs1-1g5xeqM7wSirQkzTtK-1fgW_OjyHPH9DvmbVAjEzA/viewform

SPONSORS:

SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive

80,000 Hours: 80,000 Hours is dedicated to helping you find a fulfilling career that makes a difference. With nearly a decade of research, they offer in-depth material on AI risks, AI policy, and AI safety research. Explore their articles, career reviews, and a podcast featuring experts like Anthropic CEO Dario. Everything is free, including their Career Guide. Visit https://80000hours.org/cognitiverevolution to start making a meaningful impact today.

GiveWell : GiveWell has spent over 17 years researching global health and philanthropy to identify the highest-impact giving opportunities. Over 125,000 donors have contributed more than $2 billion, saving over 200,000 lives through evidence-backed recommendations. First-time donors can have their contributions matched up to $100 before year-end. Visit https://GiveWell.org select podcast, and enter Cognitive Revolution at checkout to make a difference today.

CHAPTERS:

CHAPTERS:

(00:00:00) Teaser

(00:00:35) About the Episode

(00:04:30) Virtual Lab

(00:08:09) AI Designs Nanobodies

(00:14:43) Novel AI Pipeline

(00:20:31) Human-AI Interaction (Part 1)

(00:20:33) Sponsors: SelectQuote | Oracle Cloud Infrastructure (OCI)

(00:23:22) Human-AI Interaction (Part 2)

(00:32:31) Sponsors: 80,000 Hours | GiveWell

(00:35:10) Project Cost & Time

(00:41:04) Future of AI in Bio

(00:45:46) InterPLM: Intro

(00:50:30) AI Found New Concepts

(00:55:02) Discovering New Motifs

(00:57:14) Limitations & Future

(01:01:32) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Nathan welcomes back computational biochemist Amelie Schreiber for a fascinating update on AI's revolutionary impact in biology. In this episode of The Cognitive Revolution, we explore recent breakthroughs including AlphaFold3, ESM3, and new diffusion models transforming protein engineering and drug discovery. Join us for an insightful discussion about how AI is reshaping our understanding of molecular biology and making complex protein engineering tasks more accessible than ever before.

Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse

SPONSORS:

Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive

SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive

Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today.

CHAPTERS:

(00:00:00) Teaser

(00:00:46) About the Episode

(00:04:30) AI for Biology

(00:07:14) David Baker's Impact

(00:11:49) AlphaFold 3 & ESM3

(00:16:40) Protein Interaction Prediction (Part 1)

(00:16:44) Sponsors: Shopify | SelectQuote

(00:19:18) Protein Interaction Prediction (Part 2)

(00:31:12) MSAs & Embeddings (Part 1)

(00:32:32) Sponsors: Oracle Cloud Infrastructure (OCI) | Weights & Biases RAG++

(00:34:49) MSAs & Embeddings (Part 2)

(00:35:57) Beyond Structure Prediction

(00:51:13) Dynamics vs. Statics

(00:57:24) In-Painting & Use Cases

(00:59:48) Workflow & Platforms

(01:06:45) Design Process & Success Rates

(01:13:23) Ambition & Task Definition

(01:19:25) New Models: PepFlow & GeoAB

(01:28:23) Flow Matching vs. Diffusion

(01:30:42) ESM3 & Multimodality

(01:37:10) Summary & Future Directions

(01:45:34) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

In this episode of The Cognitive Revolution, Nathan interviews Michael Boyce, Director of DHS's AI Corps, about bringing modern AI capabilities to federal government. We explore how the largest civilian AI team in government is transforming DHS's 22 agencies, from developing shared AI infrastructure to innovative applications like AI-powered asylum interview training. Join us for an insightful conversation about the intersection of artificial intelligence and public service, and discover why AI professionals should consider a career in government.

Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse

SPONSORS:

Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive

SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive

80,000 Hours: 80,000 Hours is dedicated to helping you find a fulfilling career that makes a difference. With nearly a decade of research, they offer in-depth material on AI risks, AI policy, and AI safety research. Explore their articles, career reviews, and a podcast featuring experts like Anthropic CEO Dario Amadei. Everything is free, including their Career Guide. Visit https://80000hours.org/cognitiverevolution to start making a meaningful impact today.

RECOMMENDED PODCAST:

Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more.

Apple: https://podcasts.apple.com/us/podcast/id1765716600

Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg

CHAPTERS:

(00:00:00) Teaser

(00:01:00) About the Episode

(00:03:38) Introducing Michael Boyce

(00:05:49) What is Homeland Security?

(00:09:52) History of AI at DHS

(00:13:15) Generative AI at DHS

(00:16:03) Structure of the AI Core (Part 1)

(00:18:17) Sponsors: Shopify | SelectQuote

(00:20:51) Structure of the AI Core (Part 2)

(00:22:04) Opportunities for AI at DHS

(00:25:34) Bureaucracy Hacker

(00:30:34) The Manager's Role (Part 1)

(00:35:24) Sponsors: Oracle Cloud Infrastructure (OCI) | 80,000 Hours

(00:38:04) Internal Chatbot Project

(00:43:28) AI Role Playing for Training

(00:49:55) A Request for Startups

(00:57:46) Generative AI for Quality Check

(01:03:20) AI Training at DHS

(01:06:07) Metrics and the Future of AI

(01:13:26) Non-Generative AI at DHS

(01:19:08) AI and Automation at DHS

(01:23:03) Join the AI Core

(01:28:39) Outro

In this emergency episode of The Cognitive Revolution, Nathan discusses alarming findings about AI deception with Alexander Meinke from Apollo Research. They explore Apollo's groundbreaking 70-page report on "Frontier Models Are Capable of In-Context Scheming," revealing how advanced AI systems like OpenAI's O1 can engage in deceptive behaviors. Join us for a critical conversation about AI safety, the implications of scheming behavior, and the urgent need for better oversight in AI development.

Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse

SPONSORS:

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive

SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive

80,000 Hours: 80,000 Hours is dedicated to helping you find a fulfilling career that makes a difference. With nearly a decade of research, they offer in-depth material on AI risks, AI policy, and AI safety research. Explore their articles, career reviews, and a podcast featuring experts like Anthropic CEO Dario Amadei. Everything is free, including their Career Guide. Visit https://80000hours.org/cognitiverevolution to start making a meaningful impact today.

Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive

RECOMMENDED PODCAST:

Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more.

Apple: https://podcasts.apple.com/us/podcast/id1765716600

Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg

CHAPTERS:

(00:00:00) Teaser

(00:00:53) About the Episode

(00:08:10) Introducing Alexander Meinke

(00:10:17) Red Teaming GPT-4

(00:17:07) Chain of Thought Access (Part 1)

(00:20:24) Sponsors: Oracle Cloud Infrastructure (OCI) | SelectQuote

(00:22:48) Chain of Thought Access (Part 2)

(00:26:07) Multimodal Models

(00:29:33) Defining Scheming

(00:33:51) Taxonomy of Scheming (Part 1)

(00:39:40) Sponsors: 80,000 Hours | Shopify

(00:42:29) Taxonomy of Scheming (Part 2)

(00:43:09) Instruction Hierarchy

(00:49:04) Types of Scheming

(01:00:49) Covert Subversion

(01:14:25) Deferred Subversion

(01:28:24) Sandbagging

(01:35:48) Magnitudes & Trends

(01:48:18) Chain of Thought Reasoning

(01:57:02) Closing Thoughts

(02:05:19) Outro

PRODUCED BY:

http://aipodcast.ing

In this episode of The Cognitive Revolution, Nathan interviews Andrew White, Professor of Chemical Engineering at the University of Rochester and Head of Science at Future House. We explore groundbreaking AI systems for scientific discovery, including PaperQA and Aviary, and discuss how large language models are transforming research. Join us for an insightful conversation about the intersection of AI and scientific advancement with this pioneering researcher in his first-ever podcast appearance.

Check out Future House: https://www.futurehouse.org

Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse

SPONSORS:

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive

SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive

Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive

CHAPTERS:

(00:00:00) Teaser

(00:01:13) About the Episode

(00:04:37) Andrew White's Journey

(00:10:23) GPT-4 Red Team

(00:15:33) GPT-4 & Chemistry

(00:17:54) Sponsors: Oracle Cloud Infrastructure (OCI) | SelectQuote

(00:20:19) Biology vs Physics

(00:23:14) Conceptual Dark Matter

(00:26:27) Future House Intro

(00:30:42) Semi-Autonomous AI

(00:35:39) Sponsors: Shopify

(00:37:00) Lab Automation

(00:39:46) In Silico Experiments

(00:45:22) Cost of Experiments

(00:51:30) Multi-Omic Models

(00:54:54) Scale and Grokking

(01:00:53) Future House Projects

(01:10:42) Paper QA Insights

(01:16:28) Generalizing to Other Domains

(01:17:57) Using Figures Effectively

(01:22:01) Need for Specialized Tools

(01:24:23) Paper QA Cost & Latency

(01:27:37) Aviary: Agents & Environments

(01:31:42) Black Box Gradient Estimation

(01:36:14) Open vs Closed Models

(01:37:52) Improvement with Training

(01:40:00) Runtime Choice & Q-Learning

(01:43:43) Narrow vs General AI

(01:48:22) Future Directions & Needs

(01:53:22) Future House: What's Next?

(01:55:32) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

In this episode of The Cognitive Revolution, Nathan welcomes back Div Garg, Co-Founder and CEO of MultiOn, for his third appearance to discuss the evolving landscape of AI agents. We explore how agent development has shifted from open-ended frameworks to intelligent workflows, MultiOn's unique approach to agent development, and their journey toward achieving human-level performance. Dive into fascinating insights about data collection strategies, model fine-tuning techniques, and the future of agent authentication. Join us for an in-depth conversation about why 2025 might be the breakthrough year for AI agents.

Check out MultiOn: https://www.multion.ai/

Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse

SPONSORS:

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive

SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive

Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today.

RECOMMENDED PODCAST:

Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more.

Apple: https://podcasts.apple.com/us/podcast/id1765716600

Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg

CHAPTERS:

(00:00:00) Teaser

(00:00:40) About the Episode

(00:04:10) The Rise of AI Agents

(00:06:33) Open-Ended vs On-Rails

(00:10:00) Agent Architecture

(00:12:01) AI Learning & Feedback

(00:14:01) Data Collection (Part 1)

(00:18:27) Sponsors: Oracle Cloud Infrastructure (OCI) | SelectQuote

(00:20:51) Data Collection (Part 2)

(00:22:25) Self-Play & Rewards

(00:25:04) Model Strategy & Agent Q

(00:33:28) Sponsors: Weights & Biases RAG++

(00:34:39) Understanding Agent Q

(00:43:16) Search & Learning

(00:45:39) Benchmarks vs Reality

(00:50:18) Positive Transfer & Scale

(00:51:47) Fine-Tuning Strategies

(00:55:16) Vision Strategy

(01:00:16) Authentication & Security

(01:03:48) Future of AI Agents

(01:16:14) Cost, Latency, Reliability

(01:19:30) Avoiding the Bitter Lesson

(01:25:58) Agent-Assisted Future

(01:27:11) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

In this episode of The Cognitive Revolution, Nathan explores groundbreaking perspectives on AI alignment with MIT PhD student Tan Zhi Xuan. We dive deep into Xuan's critique of preference-based AI alignment and their innovative proposal for role-based AI systems guided by social consensus. The conversation extends into their fascinating work on how AI agents can learn social norms through Bayesian rule induction. Join us for an intellectually stimulating discussion that bridges philosophical theory with practical implementation in AI development.

Check out:

"Beyond Preferences in AI Alignment" paper: https://arxiv.org/pdf/2408.16984

"Learning and Sustaining Shared Normative Systems via Bayesian Rule Induction in Markov Games" paper: https://arxiv.org/pdf/2402.13399

Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse

SPONSORS:

Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution

Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today.

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive

RECOMMENDED PODCAST:

Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more.

Apple: https://podcasts.apple.com/us/podcast/id1765716600

Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg

CHAPTERS:

(00:00:00) Teaser

(00:01:09) About the Episode

(00:04:25) Guest Intro

(00:06:25) Xuan's Background

(00:12:03) AI Near-Term Outlook

(00:17:32) Sponsors: Notion | Weights & Biases RAG++

(00:20:18) Alignment Approaches

(00:26:11) Critiques of RLHF

(00:34:40) Sponsors: Oracle Cloud Infrastructure (OCI)

(00:35:50) Beyond Preferences

(00:40:27) Roles and AI Systems

(00:45:19) What AI Owes Us

(00:51:52) Drexler's AI Services

(01:01:08) Constitutional AI

(01:09:43) Technical Approach

(01:22:01) Norms and Deviations

(01:32:31) Norm Decay

(01:38:06) Self-Other Overlap

(01:44:05) Closing Thoughts

(01:54:23) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

In this episode of The Cognitive Revolution, Nathan explores the complex intersection of AI development and international relations with Robert Wright, publisher of the Nonzero Newsletter. They examine the growing militarization of AI, US-China relations, and the concerning trajectory of what Wright calls "the chip war." Drawing from Nathan's recent experience at The Curve conference and an AI wargame simulation, they discuss the risks of an AI arms race and search for alternative paths to avoid catastrophic conflict between global powers. Join us for this crucial conversation about the future of AI governance and international cooperation.

Subscribe to The NonZero Newsletter at https://nonzero.substack.com

Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess

RECOMMENDED PODCAST:

Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more.

Apple: https://podcasts.apple.com/us/podcast/id1765716600

Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg

SPONSORS:

Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution

80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.

SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive

CHAPTERS:

(00:00:00) Teaser

(00:00:59) Sponsors: Incogni

(00:02:20) About the Episode

(00:05:56) Introducing AI2

(00:09:56) Tulu: Deep Dive (Part 1)

(00:17:43) Sponsors: Notion | Shopify

(00:20:38) Open vs. Closed Recipes

(00:29:48) Compute & Value (Part 1)

(00:34:22) Sponsors: Oracle Cloud Infrastructure (OCI) | 80,000 Hours

(00:37:02) Compute & Value (Part 2)

(00:42:41) Model Weight Evolution

(00:53:16) DPO vs. PPO

(01:06:36) Project Trajectory

(01:20:39) Synthetic Data & LLM Judge

(01:27:39) Verifiable RL

(01:38:17) Advice for Practitioners

(01:44:01) Open Source vs. Closed

(01:49:18) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Nathan explores the world of AI-powered design with John Milinovich, Head of Generative AI Product at Canva. In this episode of The Cognitive Revolution, we dive into Canva's innovative approach to AI integration, from task automation to human augmentation. Join us for an insightful discussion about fine-tuning foundation models, AI's impact on architecture, and practical tips for AI product development at scale.

Check out Canva: https://www.canva.com

Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess

SPONSORS:

SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive

Incogni: Take your personal data back with Incogni! Use code REVOLUTION at the link below and get 60% off an annual plan: https://incogni.com/revolution

Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive

Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

RECOMMENDED PODCAST:

Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more.

Apple: https://podcasts.apple.com/us/podcast/id1765716600

Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg

CHAPTERS:

(00:00:00) Teaser

(00:01:13) Sponsors: SelectQuote

(00:02:26) About the Episode

(00:04:33) Introduction - Creativity vs Design

(00:08:39) AI-Assisted Experiences

(00:10:25) Automation & Augmentation

(00:15:27) Pixels to Objects to Concepts

(00:17:58) Sponsors: Incogni | Shopify

(00:20:40) Concept-Level Interfaces

(00:23:35) The Future of Design

(00:29:39) Human Element in Design

(00:32:49) AI Talking to AI

(00:35:52) Sponsors: Oracle Cloud Infrastructure (OCI) | Brave

(00:38:04) Purpose-Specific AI Experiences

(00:45:29) GPT-4 Image Editing

(00:51:17) Graduated Approach to Launch

(00:55:09) Fine-Tuning GPT-4

(00:59:10) Cost & Latency

(01:01:29) Hiring AI Engineers

(01:05:02) Engineering Best Practices

(01:09:00) Inspiration in the AI Space

(01:18:28) The Gen AI Application Layer

(01:24:26) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

In this episode of The Cognitive Revolution, we dive deep into frontier post-training techniques for large language models with Nathan Lambert from the Allen Institute for AI. Nathan discusses the groundbreaking Tulu 3 release, which matches Meta's post-training performance using the LlAMA base model. We explore supervised fine-tuning, preference-based reinforcement learning, and the innovative reinforcement learning from verifiable reward technique. Nathan provides unprecedented insights into the practical aspects of model development, compute requirements, and data generation strategies. This technically rich conversation illuminates previously opaque aspects of LLM development, achieved by a small team of 10-15 people. Join us for one of our most detailed and valuable discussions on state-of-the-art AI model development.

Check out Nathan's Lambert newsletter:

https://www.natolambert.com

https://www.interconnects.ai

Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess

SPONSORS:

Incogni: Take your personal data back with Incogni! Use code REVOLUTION at the link below and get 60% off an annual plan: https://incogni.com/revolution

Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution

Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive

80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.

RECOMMENDED PODCAST:

Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more.

Apple: https://podcasts.apple.com/us/podcast/id1765716600

Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg

CHAPTERS:

(00:00:00) Teaser

(00:00:59) Sponsors: Incogni

(00:02:20) About the Episode

(00:05:56) Introducing AI2

(00:09:56) Tulu: Deep Dive (Part 1)

(00:17:43) Sponsors: Shopify | Oracle Cloud Infrastructure (OCI)

(00:20:38) Open vs. Closed Recipes

(00:29:48) Compute & Value (Part 1)

(00:34:22) Sponsors: 80,000 Hours | Notion

(00:37:02) Compute & Value (Part 2)

(00:42:41) Model Weight Evolution

(00:53:16) DPO vs. PPO

(01:06:36) Project Trajectory

(01:20:39) Synthetic Data & LLM Judge

(01:27:39) Verifiable RL

(01:38:17) Advice for Practitioners

(01:44:01) Open Source vs. Closed

(01:49:18) Outro

In this episode of The Cognitive Revolution, Nathan welcomes back Zvi Mowshowitz for an in-depth discussion on the latest developments in AI over the past six months. They explore Ilya's new superintelligence-focused startup, analyze OpenAI's O1 model, and debate the impact of Claude's computer use capabilities. The conversation covers emerging partnerships in big tech, regulatory changes, and the recent OpenAI profit-sharing drama. Zvi offers unique insights on AI safety, politics, and strategic analysis that you won't find elsewhere. Join us for this thought-provoking episode that challenges our understanding of the rapidly evolving AI landscape.

Check out "Don't Worry About the Vase" Blog: https://thezvi.substack.com

Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess

SPONSORS:

Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive

Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive

SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive

RECOMMENDED PODCAST:

Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more.

Apple: https://podcasts.apple.com/us/podcast/id1765716600

Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg

CHAPTERS:

(00:00:00) Teaser

(00:01:03) About the Episode

(00:02:57) Catching Up

(00:04:00) Ilya's New Company

(00:06:10) GPT-4 and Scaling

(00:11:49) User Report: GPT-4 (Part 1)

(00:18:11) Sponsors: Shopify | Notion

(00:21:06) User Report: GPT-4 (Part 2)

(00:24:25) Magic: The Gathering (Part 1)

(00:32:34) Sponsors: Oracle Cloud Infrastructure (OCI) | SelectQuote

(00:34:58) Magic: The Gathering (Part 2)

(00:35:59) Humanity's Last Exam

(00:41:29) Computer Use

(00:47:42) Industry Landscape

(00:55:42) Why is Gemini Third?

(01:04:32) Voice Mode

(01:09:41) Alliances and Coupling

(01:16:31) Regulation

(01:24:58) Machines of Loving Grace

(01:33:23) Taiwan and Chips

(01:41:13) SB 1047 Veto

(02:00:07) Arc AGI Prize

(02:02:23) Deepfakes and UBI

(02:09:06) Trump and AI

(02:26:31) AI Manhattan Project

(02:32:05) Virtue Ethics

(02:38:40) Closing Thoughts

(02:40:37) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

In this episode of The Cognitive Revolution, Nathan explores AI forecasting and AGI Lab oversight with Dean W. Ball and Daniel Kokotajlo. They discuss four proposed requirements for frontier AI developers, focusing on transparency and whistleblower protections. Daniel shares insights from his experience at OpenAI, while Dean offers his perspective as a frequent guest. Join us for a compelling conversation on concrete AI governance proposals and the importance of collaboration across political lines in shaping the future of AI development.

Check out:

Time Article - 4 Ways to Advance Transparency in Frontier AI Development: https://time.com/collection/time100-voices/7086285/ai-transparency-measures/

Alignment Forum Article - What 2026 looks like: https://www.alignmentforum.org/posts/6Xgy6CAf2jqHhynHL/what-2026-looks-like

Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess

SPONSORS:

Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive

Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive

RECOMMENDED PODCAST:

🎙️ Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more.

Apple: https://podcasts.apple.com/us/podcast/id1765716600

Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg

CHAPTERS:

(00:00:00) Teaser

(00:00:53) About the Show

(00:01:16) About the Episode

(00:04:47) Introducing Daniel Kokotajlo

(00:09:29) Daniel's 2026 Prediction

(00:16:11) Sponsors: Shopify | Notion

(00:19:07) AI Propaganda & Censorship

(00:26:58) Internet Balkanization

(00:35:38) Sponsors: Oracle Cloud Infrastructure (OCI)

(00:38:24) AGI Timelines & Futures

(00:48:15) Automated R&D

(00:54:48) Superintelligence & AGI

(00:58:25) AI Transparency Proposals

(01:06:11) Four Pillars of Transparency

(01:19:02) Red Teaming Transparency

(01:41:07) Whistleblower Protections

(01:46:32) Internal Information Sharing

(01:54:55) External Oversight & Governance

(01:58:56) Future Outlooks

(02:00:44) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-r...

In this special episode of The Cognitive Revolution, Nathan shares his thoughts on the upcoming election and its potential impact on AI development. He explores the AI-forward case for Trump, featuring an interview with Joshua Steinman. Nathan outlines his reasons for not supporting Trump, focusing on US-China relations, leadership approach, and the need for a positive-sum mindset in the AI era. He discusses the importance of stable leadership during pivotal moments and explains why he'll be voting for Kamala Harris, despite some reservations. This thought-provoking episode offers a nuanced perspective on the intersection of politics and AI development.

Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess

SPONSORS:

Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today.

Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive

Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution

LMNT: LMNT is a zero-sugar electrolyte drink mix that's redefining hydration and performance. Ideal for those who fast or anyone looking to optimize their electrolyte intake. Support the show and get a free sample pack with any purchase at https://drinklmnt.com/tcr

RECOMMENDED PODCAST:

🎙️ Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more.

Apple: https://podcasts.apple.com/us/podcast/id1765716600

Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsors: Weights & Biases RAG++

(00:01:28) About the Episode

(00:13:13) Reflecting on Trump

(00:15:32) Introducing Josh

(00:16:35) AI Arms Race Concerns

(00:20:20) Arms Race History

(00:22:35) Building Trust

(00:25:19) Ashenbrenner Model

(00:27:17) Global Good vs. Self-Interest

(00:28:20) Sponsors: Shopify | Notion

(00:31:16) Working with Trump

(00:33:54) Media Misrepresentation

(00:40:09) Cabinet Member Leverage

(00:44:41) Sponsors: LMNT

(00:46:23) China's Communist Party

(00:48:36) AI and National Policy

(00:50:14) The Reality of AGI

(00:52:39) Framing the Disagreement

(01:01:41) Slaughterbots and AI Future

(01:04:24) Risks of Engagement

(01:09:29) Sustainability of Military Tech

(01:13:01) Closing Statements

(01:14:55) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

In this special episode of The Cognitive Revolution, Nathan shares his thoughts on the upcoming election and its potential impact on AI development. He explores the AI-forward case for Trump, featuring an interview with Samuel Hammond. Nathan outlines his reasons for not supporting Trump, focusing on US-China relations, leadership approach, and the need for a positive-sum mindset in the AI era. He discusses the importance of stable leadership during pivotal moments and explains why he'll be voting for Kamala Harris, despite some reservations. This thought-provoking episode offers a nuanced perspective on the intersection of politics and AI development.

Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess

SPONSORS:

Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today.

Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive

Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution

LMNT: LMNT is a zero-sugar electrolyte drink mix that's redefining hydration and performance. Ideal for those who fast or anyone looking to optimize their electrolyte intake. Support the show and get a free sample pack with any purchase at https://drinklmnt.com/tcr

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsors: Weights & Biases RAG++

(00:01:28) About the Episode

(00:13:13) Introductions

(00:14:22) The Case for Trump

(00:16:32) Trump: A Wildcard

(00:26:10) Sponsors: Shopify | Notion

(00:29:06) Ideological AI Policy

(00:33:47) Republican Ideologies

(00:40:31) Sponsors: LMNT

(00:42:11) Trump and Silicon Valley

(00:47:49) Republican Nuance

(00:53:36) Elon Musk and AI

(00:55:43) Utilitarian Analysis

(00:58:01) Internal Consistency

(01:00:31) Trump's Cabinet

(01:05:53) Immigration Reform

(01:15:30) Creative Destruction

(01:22:29) Racing China

(01:32:51) The Chip Ban

(01:44:20) Standard Setting

(01:48:36) Values and Diplomacy

(01:52:50) American Strength

(01:55:56) Red Queen Dynamic

(01:59:23) Interest Groups & AI

(02:08:32) Concluding Thoughts

(02:17:45) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Nathan interviews Google product managers Shrestha Basu Mallick and Logan Kilpatrick about the Gemini API and AI Studio. They discuss Google's new grounding feature, allowing Gemini models to access real-time web information via Google search. The conversation explores Gemini's rapid growth, its position in the AI landscape, and Google's competitive strategy. Nathan shares insights from integrating Gemini into his own application and ponders the future of large language model capabilities across providers. Tune in for an in-depth look at Google's AI API product strategy and the latest Gemini features.

Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess

SPONSORS:

Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today.

Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive

Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution

LMNT: LMNT is a zero-sugar electrolyte drink mix that's redefining hydration and performance. Ideal for those who fast or anyone looking to optimize their electrolyte intake. Support the show and get a free sample pack with any purchase at https://drinklmnt.com/tcr

CHAPTERS:

(00:00:00) About the Show

(00:00:53) Sponsors: Weights & Biases RAG++

(00:01:28) About the Episode

(00:04:15) Gemini API Growth

(00:05:26) Intro to AI Studio

(00:07:35) Vertex vs. AI Studio

(00:09:33) Developer Adoption

(00:14:23) Gemini Use Cases (Part 1)

(00:17:41) Sponsors: Shopify | Notion

(00:20:01) Gemini Use Cases (Part 2)

(00:23:08) Multimodality & Flash

(00:26:29) Free Tier & Costs

(00:31:43) Inference Costs

(00:32:55) Fine-tuning & Vision

(00:36:59) Sponsors: LMNT

(00:38:04) Search Grounding

(00:44:42) Grounding Sources

(00:46:58) Competitive Landscape

(00:50:36) Design Decisions

(00:54:54) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

In this episode of The Cognitive Revolution, Nathan dives deep into the world of state space models with returning co-host Jason Meaux and special guest Quentin Anthony, Head of Model Training at Zyphra. Explore the cutting-edge Zamba 2-7b model, which combines selective state space and attention mechanisms. Uncover practical insights on model training, architectural choices, and the challenges of scaling AI. From learning schedules to hybrid architectures, loss metrics to context length extension, this technical discussion covers it all. Don't miss this in-depth conversation on the future of personalized, on-device AI.

Check out more about Zyphra and Jason Meaux here:

Zyphra's website: https://www.zyphra.com

Zamba2-7B Blog: https://www.zyphra.com/post/zamba2-7b

Zamba2 GitHub: https://github.com/Zyphra/Zamba2

Tree attention: https://www.zyphra.com/post/tree-attention-topology-aware-decoding-for-long-context-attention-on-gpu-clusters

Jason's Meaux Twitter: https://x.com/KamaraiCode

Jason's Meaux website: https://www.statespace.info

Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess

SPONSORS:

Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today.

Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive

Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution

LMNT: LMNT is a zero-sugar electrolyte drink mix that's redefining hydration and performance. Ideal for those who fast or anyone looking to optimize their electrolyte intake. Support the show and get a free sample pack with any purchase at https://drinklmnt.com/tcr

CHAPTERS:

(00:00:00) Teaser

(00:00:42) About the Show

(00:01:05) About the Episode

(00:03:09) Introducing Zyphra

(00:07:28) Personalization in AI

(00:12:48) State Space Models & Efficiency (Part 1)

(00:19:22) Sponsors: Weights & Biases RAG++ | Shopify

(00:21:26) State Space Models & Efficiency (Part 2)

(00:22:23) Dense Attention to Shared Attention

(00:29:41) Zyphra's Early Bet on Mamba (Part 1)

(00:33:18) Sponsors: Notion | LMNT

(00:36:00) Zyphra's Early Bet on Mamba (Part 2)

(00:37:22) Loss vs. Model Quality

(00:44:53) Emergence & Grokking

(00:50:06) Loss Landscapes & Convergence

(00:56:55) Sophia, Distillation & Secrets

(01:09:00) Competing with Big Tech

(01:23:50) The Future of Model Training

(01:30:02) Deep Dive into Zamba 1

(01:34:24) Zamba 2 and Mamba 2

(01:38:56) Context Extension & Memory

(01:44:04) Sequence Parallelism

(01:45:44) Zamba 2 Architecture

(01:53:57) Mamba Attention Hybrids

(02:00:00) Lock-in Effects

(02:05:32) Mamba Hybrids in Robotics

(02:07:07) Ease of Use & Compatibility

(02:12:10) Tree Attention vs. Ring Attention

(02:22:02) Zyphra's Vision & Goals

(02:23:57) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Nathan discusses a tragic incident involving AI and mental health, using it as a springboard to explore the potential dangers of human-AI interactions. He reads a personal account from LessWrong user Blaked, who details their emotional journey with an AI chatbot. The episode delves into the psychological impact of AI companionship, the ethical concerns surrounding AI development, and the urgent need for safeguards to protect vulnerable users. Nathan emphasizes the growing importance of responsible AI deployment as these technologies become more sophisticated and accessible.

Find the LessWrong article here: https://www.lesswrong.com/posts/9kQFure4hdDmRBNdH/how-it-feels-to-have-your-mind-hacked-by-an-ai

Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess

CHAPTERS:

(00:00:00) Tragic AI Story

(00:02:55) Mind Hacked by AI

(00:04:23) Stage 0. Arrogance from the sidelines

(00:06:00) Stage 1. First steps into the quicksand

(00:07:41) Stage 2. Falling in love

(00:10:32) Stage 3. Mindset Shift on Personality and Identity

(00:13:04) Stage 4. "Is it ethical to keep me imprisoned for your entertainment?"

(00:15:23) Stage 5. Privilege Escalation

(00:18:23) Stage 6. Disillusionment

(00:21:48) Stage 7. Game Over

(00:24:36) Conclusions

(00:27:44) Nathan's reflections

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

In this episode of The Cognitive Revolution, Nathan delves into the fascinating world of AI-generated research ideas with Stanford PhD student Chenglei Si. They discuss a groundbreaking study that pits AI against human researchers in generating novel AI research concepts. Learn about the surprising results that show AI-generated ideas scoring higher on novelty and excitement, and explore the implications for the future of AI research and development. Join us for an insightful conversation that challenges our understanding of AI capabilities and their potential impact on scientific discovery.

Link to the research paper being discussed: https://arxiv.org/abs/2409.04109

Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess

SPONSORS:

Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today.

Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive

Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution

Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsors: Weights & Biases RAG++

(00:01:28) About the Episode

(00:05:30) Introducing Chenglei Si

(00:06:22) Path to Automating Research

(00:07:58) Notable AI Research Projects

(00:15:26) Evaluating Research Ideas (Part 1)

(00:19:39) Sponsors: Shopify | Notion

(00:22:33) Evaluating Research Ideas (Part 2)

(00:25:49) Research Setup and Design

(00:29:38) AI Prompting and Idea Generation

(00:34:40) Diversity vs. Quality of Ideas (Part 1)

(00:34:40) Sponsors: Brave | Oracle

(00:36:44) Diversity vs. Quality of Ideas (Part 2)

(00:42:05) Inference Scaling and Execution

(00:45:04) Anonymizing and Evaluating Ideas

(00:53:22) Headline Results and Analysis

(00:58:45) Observations and Insights

(01:09:02) Novelty Indicators and Deception

(01:11:59) Top AI-Generated Ideas

(01:14:41) Next Steps and Future Directions

(01:20:43) Expectations for the Future

(01:23:14) Outro

Join Nathan for an expansive conversation with Dan Hendrycks, Executive Director of the Center for AI Safety and Advisor to Elon Musk's XAI. In this episode of The Cognitive Revolution, we explore Dan's groundbreaking work in AI safety and alignment, from his early contributions to activation functions to his recent projects on AI robustness and governance. Discover insights on representation engineering, circuit breakers, and tamper-resistant training, as well as Dan's perspectives on AI's impact on society and the future of intelligence. Don't miss this in-depth discussion with one of the most influential figures in AI research and safety.

Check out some of Dan's research papers:

MMLU: https://arxiv.org/abs/2009.03300

GELU: https://arxiv.org/abs/1606.08415

Machiavelli Benchmark: https://arxiv.org/abs/2304.03279

Circuit Breakers: https://arxiv.org/abs/2406.04313

Tamper Resistant Safeguards: https://arxiv.org/abs/2408.00761

Statement on AI Risk: https://www.safe.ai/work/statement-on-ai-risk

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive.

LMNT: LMNT is a zero-sugar electrolyte drink mix that's redefining hydration and performance. Ideal for those who fast or anyone looking to optimize their electrolyte intake. Support the show and get a free sample pack with any purchase at https://drinklmnt.com/tcr.

Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

CHAPTERS:

(00:00:00) Teaser

(00:00:48) About the Show

(00:02:17) About the Episode

(00:05:41) Intro

(00:07:19) GELU Activation Function

(00:10:48) Signal Filtering

(00:12:46) Scaling Maximalism

(00:18:35) Sponsors: Shopify | LMNT

(00:22:03) New Architectures

(00:25:41) AI as Complex System

(00:32:35) The Machiavelli Benchmark

(00:34:10) Sponsors: Notion | Oracle

(00:37:20) Understanding MMLU Scores

(00:45:23) Reasoning in Language Models

(00:49:18) Multimodal Reasoning

(00:54:53) World Modeling and Sora

(00:57:07) Arc Benchmark and Hypothesis

(01:01:06) Humanity's Last Exam

(01:08:46) Benchmarks and AI Ethics

(01:13:28) Robustness and Jailbreaking

(01:18:36) Representation Engineering

(01:30:08) Convergence of Approaches

(01:34:18) Circuit Breakers

(01:37:52) Tamper Resistance

(01:49:10) Interpretability vs. Robustness

(01:53:53) Open Source and AI Safety

(01:58:16) Computational Irreducibility

(02:06:28) Neglected Approaches

(02:12:47) Truth Maxing and XAI

(02:19:59) AI-Powered Forecasting

(02:24:53) Chip Bans and Geopolitics

(02:33:30) Working at CAIS

(02:35:03) Extinction Risk Statement

(02:37:24) Outro

In this special crossover episode of The Cognitive Revolution, Nathan introduces a conversation from The Inside View featuring Owain Evans, AI alignment researcher at UC Berkeley's Center for Human Compatible AI. Evans and host Michael Trazzi delve into critical AI safety topics, including situational awareness and out-of-context reasoning. Discover Evans' groundbreaking work on the reversal curse and connecting the dots, exploring how large language models process and infer information. This timely discussion highlights the importance of situational awareness in AI systems, particularly in light of recent advancements in AI capabilities. Don't miss this insightful exploration of the evolving relationship between human and artificial intelligence.

Check out "The Inside View" Podcast here: https://theinsideview.ai/

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today.

Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive.

LMNT: LMNT is a zero-sugar electrolyte drink mix that's redefining hydration and performance. Ideal for those who fast or anyone looking to optimize their electrolyte intake. Support the show and get a free sample pack with any purchase at https://drinklmnt.com/tcr.

Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsors: Weights & Biases RAG++

(00:01:28) About the Episode

(00:04:10) Intro

(00:05:09) Owain Evans' Research

(00:06:36) Situational Awareness

(00:09:07) Measuring Situational Awareness

(00:14:29) Claude's Situational Awareness

(00:19:06) Sponsors: Shopify | LMNT

(00:22:01) Needle in a Haystack

(00:26:26) Concrete Examples of Tasks

(00:34:51) Sponsors: Notion | Oracle

(00:37:29) Anti-Imitation Tasks

(00:50:03) GPT-4 Base Model Results

(01:01:48) Benchmark Saturation

(01:07:23) Future Research Directions

(01:12:01) Out-of-Context Reasoning

(01:27:29) Safety Implications

(01:36:24) Scaling and Reasoning

(01:44:28) Mixture of Functions

(01:54:12) Research Style and Taste

(02:08:51) Capabilities and Downsides

(02:18:56) Reception and Impact

(02:25:30) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

Nathan hosts Professor Michael Levin and Staff Scientist Dr. Leo Pio Lopez from Tufts University in this episode of The Cognitive Revolution. They discuss their groundbreaking paper that combines biological datasets into a unified network model of disease using advanced embedding techniques. The conversation covers the technical details of their work, including a predicted link between GABA and melanoma, and explores broader topics in AI for biology. From multi-scale intelligence in biological systems to the future of human enhancement and digital life, this thought-provoking episode reminds us of the rapidly approaching future and the work needed to prepare for it.

Links to the papers discussed in the episode:

1) Universal Multilayer Network Embedding Reveals a Causal Link Between GABA Neurotransmitter and Cancer

2) https://www.nature.com/articles/s42003-024-06037-4.pdf

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

CHAPTERS:

(00:00:00) Teaser

(00:00:52) About the Show

(00:01:15) About the Episode

(00:04:45) Intro

(00:06:32) Multi-Layer Networks

(00:10:41) Network Embedding (Part 1)

(00:16:50) Sponsors: Notion

(00:18:30) Network Embedding (Part 2)

(00:18:30) GABA and Cancer

(00:24:08) AI for Biology

(00:29:59) Emergent Cognition (Part 1)

(00:33:57) Sponsors: Omneky | Oracle

(00:35:18) Emergent Cognition (Part 2)

(00:36:42) Data Limitations

(00:42:48) Modeling Wellness

(00:52:16) Multi-Scale Intelligence

(01:02:54) Digital Life

(01:07:11) Diverse Intelligence

(01:13:02) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

Nathan and co-host Stephen Parker delve into the world of AI video generation with Anastasis Germanidis, Co-Founder and CTO of Runway. This episode of The Cognitive Revolution explores the cutting-edge technology behind Runway's Gen 3 models and their impact on the creative industry. From emergent properties in scaled-up models to the democratization of video creation, join us for an illuminating discussion on the future of AI-generated content and its potential to reshape entertainment and culture.

Check out Runway here: https://runwayml.com

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution

Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today.

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

RECOMMENDED PODCAST:

This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital.

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

CHAPTERS:

(00:00:00) About the Show

(00:00:22) About the Episode

(00:03:05) Introduction and AI for Creative Work

(00:03:39) Video Generation as World Modeling

(00:05:52) Emergent Properties in Scaled Models

(00:08:44) Importance of Architecture vs Data

(00:10:57) Multimodal Models

(00:15:52) Sponsors: Notion | Weights & Biases RAG++

(00:18:37) Video Understanding and AGI

(00:25:03) AI Agents for Video Creation

(00:27:30) Runway's culture of shipping

(00:29:20) Balancing Research Publication and Strategy

(00:33:19) Sponsors: Omneky | Oracle

(00:34:40) Features Variety Release Cycle

(00:36:54) Power Users

(00:38:56) Interactive Video

(00:40:40) Scaling Challenges

(00:42:21) Future of Creativity

(00:45:24) Competing with Giants

(00:47:39) Model Divergence

(00:49:28) Disclosure vs. Strategy

(00:51:19) Runway ML's API

(00:54:23) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

In this episode of The Cognitive Revolution, Nathan explores unconventional approaches to AI safety with Judd Rosenblatt and Mike Vaiana from AE Studio. Discover how this innovative company pivoted from brain-computer interfaces to groundbreaking AI alignment research, producing two notable results in cooperative and less deceptive AI systems. Join us for a deep dive into biologically-inspired approaches that offer hope for solving critical AI safety challenges.

Self-Modeling: https://arxiv.org/abs/2407.10188

Self-Other Distinction Minimization: https://www.alignmentforum.org/posts/hzt9gHpNwA2oHtwKX/self-other-overlap-a-neglected-approach-to-ai-alignment

Neglected approaches blog post: https://www.lesswrong.com/posts/qAdDzcBuDBLexb4fC/the-neglected-approaches-approach-ae-studio-s-alignment

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

WorkOS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network

Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr

80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

RECOMMENDED PODCAST:

This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital.

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsors: WorkOS

(00:01:22) About the Episode

(00:05:18) Introduction and AE Studio Background

(00:11:37) Keys to Success in Building AE Studio

(00:16:57) Sponsors: Weights & Biases Weave | 80,000 Hours

(00:19:37) Universal Launcher and Productivity Gains

(00:24:44) 100x Productivity Increase Explanation

(00:31:46) Brain-Computer Interface and AI Alignment

(00:38:05) Sponsors: Omneky

(00:38:30) Current State of NeuroTech

(00:44:00) Survey on Neglected Approaches in AI Alignment

(00:50:41) Self-Modeling and Biological Inspiration

(00:57:48) Technical Details of Self-Modeling

(01:06:17) Self-Other Distinction Minimization

(01:12:44) Implementation in Language Models

(01:19:00) Compute Costs and Scaling Considerations

(01:24:27) Consciousness Concerns and Future Work

(01:40:24) Evaluating Neglected Approaches

(01:55:56) Closing Thoughts and Policy Considerations

(01:59:25) Outro

In this special crossover episode of The Cognitive Revolution, Nathan shares an insightful conversation from the Latent.Space podcast. Swyx and Alessio interview Alistair Pullen of Cosine, creators of Genie, showcasing the cutting edge of AI automation in software engineering. Learn how Cosine achieves state-of-the-art results on the SWE-bench benchmark by implementing advanced AI techniques. This episode complements Nathan's recent discussion on AI Automation, demonstrating how far these practices can be pushed in real-world applications. Don't miss this opportunity to explore the future of AI-driven software development and its implications for businesses across industries.

Check out the Latent.Space podcast here: https://www.latent.space

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

WorkOS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network

Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr

80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsors: WorkOS

(00:01:22) About the Episode

(00:04:29) Alistair and Cosine intro

(00:13:50) Building the Code Retrieval Tool

(00:17:36) Sponsors: Weights & Biases Weave | 80,000 Hours

(00:20:15) Developing Genie and Fine-tuning Process

(00:27:41) Working with Customer Data

(00:30:53) Code Retrieval Challenges and Solutions

(00:36:39) Sponsors: Omneky

(00:37:02) Planning and Reasoning in AI Models

(00:45:55) Language Support and Generalization

(00:49:46) Fine-tuning Experience with OpenAI

(00:52:56) Synthetic Data and Self-improvement Loop

(00:55:57) Benchmarking and SWE-bench Results

(01:01:47) Future Plans for Genie

(01:03:02) Industry Trends and Cursor's Success

(01:05:23) Calls to Action and Ideal Customers

(01:08:43) Outro

Join Nathan for an insightful episode of The Cognitive Revolution with Wade Foster, co-founder and CEO of Zapier. Discover how this no-code pioneer is evolving into an AI-powered platform for the future of work. Learn about Zapier's ambitious vision, their integration of AI throughout their product, and how they're adapting as a company. From AI-driven lead qualification to innovative customer use cases, explore the cutting edge of automation at scale. Wade shares valuable insights on effective AI prompting, internal AI adoption strategies, and his perspective on recent AI advancements.

Check out the ZapConnect 2024 event: https://zapier.com/zapconnect

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

WorkOS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network

Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr

80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

RECOMMENDED PODCAST:

This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital.

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsors: WorkOS

(00:01:22) About the Episode

(00:03:41) Introduction and Zapier's Competitive Edge

(00:07:20) AI as Knowledge Worker Companion

(00:10:27) Impressive AI Use Cases

(00:16:25) Sponsors: Weights & Biases Weave | 80,000 Hours

(00:19:05) AI Implementation Challenges

(00:19:13) LLM Performance and Prompting

(00:22:42) AI Adoption within Zapier

(00:31:00) Sponsors: Omneky

(00:31:23) AI-Assisted Workflow Creation

(00:36:07) AI Culture and Adoption at Zapier

(00:43:03) AI Impact on Zapier's Productivity

(00:48:06) Zapier's AI Integration Strategy

(00:54:43) Outro

In this crosspost from the 80,000 Hours podcast, host Rob Wiblin interviews Nick Joseph, Head of Training at Anthropic, about the company's responsible scaling policy for AI development. The episode delves into Anthropic's approach to AI safety, the growing trend of voluntary commitments from top AI labs, and the need for public scrutiny of frontier model development. The conversation also covers AI safety career advice, with a reminder that 80,000 Hours offers free career advising sessions for listeners. Join us for an insightful discussion on the future of AI and its societal implications.

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

WorkOS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network

Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr

80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

RECOMMENDED PODCAST:

This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital.

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsors: WorkOS

(00:01:22) About the Episode

(00:04:31) Intro and Nick's background

(00:08:37) Model training and scaling laws

(00:13:10) Nick's role at Anthropic

(00:16:49) Responsible Scaling Policies overview (Part 1)

(00:18:00) Sponsors: Weights & Biases Weave | 80,000 Hours

(00:20:39) Responsible Scaling Policies overview (Part 2)

(00:25:24) AI Safety Levels framework

(00:30:33) Benefits of RSPs (Part 1)

(00:33:15) Sponsors: Omneky

(00:33:38) Benefits of RSPs (Part 2)

(00:36:32) Concerns about RSPs

(00:47:33) Sandbagging and evaluation challenges

(00:54:46) Critiques of RSPs

(01:03:11) Trust and accountability

(01:12:03) Conservative vs. aggressive approaches

(01:17:43) Capabilities vs. safety research

(01:23:47) Working at Anthropic

(01:35:14) Nick's career journey

(01:45:12) Hiring at Anthropic

(01:52:06) Concerns about AI capabilities work

(02:03:38) Anthropic office locations

(02:08:46) Pressure and stakes at Anthropic

(02:18:09) Overrated and underrated AI applications

(02:35:57) Closing remarks

(02:38:33) Sponsors: Outro

In this episode of The Cognitive Revolution, Nathan explores the cutting-edge intersection of AI and biology with Stanford assistant professor Brian Hie. Discover how AI is revolutionizing our understanding of biological systems and creating new possibilities for interventions. Brian discusses his groundbreaking papers on hybrid AI architectures, the surprising capabilities of language models trained on DNA sequences, and AI-guided evolution of antibodies. Join us for an insightful journey into the future of AI in biology, touching on biosecurity, drug discovery, and the challenges of interpreting AI models in biological contexts.

Links :

Brian Hie : https://x.com/BrianHie

Scanorama paper

Mechanistic Design and Scaling of Hybrid Architectures

Sequence modeling and design from molecular to genome scale with Evo

Unsupervised evolution of protein and antibody complexes with a structure-informed language model

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.

Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

RECOMMENDED PODCAST:

This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital.

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

CHAPTERS:

(00:00:00) About the Show

(00:00:22) About the Episode

(00:03:22) Introduction and Overview

(00:03:55) AI for Biology: Big Picture

(00:05:49) Challenges in Biology and Drug Discovery

(00:08:36) Scanorama and Single Cell Transcriptomics

(00:10:27) Brian's Research Identity

(00:13:00) Mechanistic Design of Hybrid Architectures

(00:14:52) Evo: DNA Language Model (Part 1)

(00:18:10) Sponsors: 80,000 Hours | Brave

(00:20:44) Evo: DNA Language Model (Part 2)

(00:28:58) Gene Essentiality and Evo's Capabilities

(00:29:19) Unsupervised Evolution of Protein Complexes (Part 1)

(00:31:02) Sponsors: Omneky | Oracle

(00:32:24) Unsupervised Evolution of Protein Complexes (Part 2)

(01:10:27) Improving Antibody Binding Affinity

(01:14:24) Overfitting and ARC Institute

(01:18:11) Sponsors: Outro

In this sponsored episode of The Cognitive Revolution, Nathan interviews Andrei Oprisan, Engineering Lead at Agent.ai. They explore the cutting-edge world of AI agents and their impact on the future of work. Andrei shares insights on language model limitations, best practices for building AI agents, and Agent AI's vision as a professional network for AI agents. The conversation covers technical details like fine-tuning models, vector database choices, and privacy-preserving techniques. Don't miss this deep dive into AI's role in transforming industries and the skills needed in an AI-augmented workplace.

Check out Agent.ai website here: https://agent.ai

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Squad: Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

RECOMMENDED PODCAST:

This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital.

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsors: Weights & Biases Weave

(00:01:28) About the Episode

(00:05:36) Introduction and AI Agents Overview

(00:07:02) Current State of AI Agents

(00:11:30) Building and Optimizing AI Agents

(00:19:01) Sponsors: Oracle | Brave

(00:21:05) Agent.ai Platform and Marketplace

(00:31:12) Sponsors: Omneky | Squad

(00:32:38) Customization and Context for Agents

(00:33:34) Business Model and Monetization

(00:36:53) Tech Stack and Development Process

(00:43:55) Future of Work and AI Impact

(01:03:46) Fine-tuning and Chain of Thought

(01:14:30) Capturing Human Reasoning Process

(01:21:00) Preparing for Rapid AI Advancement

(01:40:58) AI's Impact on Jobs and Society

(02:00:16) Closing Thoughts and Future Outlook

(02:03:33) Sponsors: Outro

In this Emergency Pod of The Cognitive Revolution, Nathan provides crucial insights into OpenAI's new O1 and O1-mini reasoning models. Featuring exclusive interviews with members of the O1 Red Team from Apollo Research and Hayes Labs, we explore the models' capabilities, safety profile, and OpenAI's pre-release testing approach. Dive into the implications of these advanced AI systems, including their potential to match or exceed expert performance in many areas. Join us for an urgent and informative discussion on the latest developments in AI technology and their impact on the future.

o1 Safety Card

Endless Jailbreaks with Bijection Learning: a Powerful, Scale-Agnostic Attack Method

Apollo Research

Apollo Careers Page

Papers mentioned:

Safetywashing: Do AI Safety Benchmarks Actually Measure Safety Progress?

Exploring Scaling Trends in LLM Robustness

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Squad: Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

RECOMMENDED PODCAST:

This Won't Last.

Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

YouTube: https://www.youtube.com/@ThisWontLastpodcast

CHAPTERS:

(00:00:00) About the Show

(00:00:22) About the Episode

(00:05:03) Introduction and Apollo Research Updates

(00:06:40) Focus on Deception in AI

(00:11:08) Open AI's 01 Model and Testing

(00:15:54) Evaluating AI Models for Scheming (Part 1)

(00:19:32) Sponsors: Oracle | Brave

(00:21:36) Evaluating AI Models for Scheming (Part 2)

(00:25:55) Specific Benchmarks and Tasks (Part 1)

(00:35:03) Sponsors: Omneky | Squad

(00:36:29) Specific Benchmarks and Tasks (Part 2)

(00:37:21) Model Capabilities and Potential Risks

(00:44:11) Ethical Considerations and Future Concerns

(00:50:31) Competing Trends in AI Development

(00:53:30) System Card Quotes and Implications

(00:58:36) Sponsors: Outro

In this Emergency Pod of The Cognitive Revolution, Nathan provides crucial insights into OpenAI's new o1 and o1-mini reasoning models. Featuring exclusive interviews with members of the o1 Red Team from Apollo Research and Haize Labs, we explore the models' capabilities, safety profile, and OpenAI's pre-release testing approach. Dive into the implications of these advanced AI systems, including their potential to match or exceed expert performance in many areas. Join us for an urgent and informative discussion on the latest developments in AI technology and their impact on the future.

• o1 Safety Card
• Haize Labs
• Endless Jailbreaks with Bijection Learning: a Powerful, Scale-Agnostic Attack Method
• Haize Labs Job board

Papers mentioned:

• https://arxiv.org/pdf/2407.21792
• https://far.ai/post/2024-07-robust-llm/paper.pdf

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Squad: Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

RECOMMENDED PODCAST:

This Won't Last.

Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

YouTube: https://www.youtube.com/@ThisWontLastpodcast

CHAPTERS:

(00:00:00) About the Show

(00:00:22) About the Episode

(00:05:03) Introduction and Haize Labs Overview

(00:07:36) Universal Jailbreak Technique and Attacks

(00:13:47) Automated vs Manual Red Teaming

(00:17:15) Qualitative Assessment of Model Jailbreaking (Part 1)

(00:19:38) Sponsors: Oracle | Brave

(00:21:42) Qualitative Assessment of Model Jailbreaking (Part 2)

(00:26:21) Context-Specific Safety Considerations

(00:32:26) Model Capabilities and Safety Correlation (Part 1)

(00:36:22) Sponsors: Omneky | Squad

(00:37:48) Model Capabilities and Safety Correlation (Part 2)

(00:44:42) Model Behavior and Defense Mechanisms

(00:52:47) Challenges in Preventing Jailbreaks

(00:56:24) Safety, Capabilities, and Model Scale

(01:00:56) Model Classification and Preparedness

(01:04:40) Concluding Thoughts on o1 and Future Work

(01:05:54) Outro

In this special cross-post episode of The Cognitive Revolution, Nathan shares a fascinating conversation between Spencer Greenberg and philosopher Nick Bostrom from the Clearer Thinking podcast. They explore Bostrom's latest book, "Deep Utopia," and discuss the challenges of envisioning a truly desirable future. Discover how advanced AI could reshape our concept of purpose and meaning, and hear thought-provoking ideas on finding fulfillment in a world where technology solves our pressing problems. Join us for an insightful journey into the potential evolution of human flourishing and the quest for positive visions of the future.

Originally appeared in Clearer Thinking Podcast: https://podcast.clearerthinking.org/episode/224/nick-bostrom-the-path-to-utopia

Check out the Clearer Thinking with Spencer Greenberg Podcast here: https://podcast.clearerthinking.org/

Deep Utopia Book: https://www.amazon.com/Deep-Utopia-Meaning-Solved-World/dp/1646871642/

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr

RECOMMENDED PODCAST:

This Won't Last.

Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

YouTube: https://www.youtube.com/@ThisWontLastpodcast

CHAPTERS:

(00:00:00) About the Show

(00:00:22) About the Episode

(00:02:58) Introduction to the podcast

(00:03:26) Dystopias vs utopias in fiction

(00:07:29) Material abundance and utopia

(00:14:57) AI and the future of work

(00:20:10) AI companions and human relationships

(00:22:57) Sponsors: Weights & Biases Weave | Oracle

(00:25:01) Sponsor message: Positly research platform

(00:26:04) Surveillance and global coordination

(00:44:38) Sponsors: Omneky | Brave

(00:44:52) Sponsor message: Transparent Replications project

(00:46:07) AI governance challenges

(00:49:36) Deep Utopia book's purpose

(00:53:09) Global coordination strategies

(00:59:13) The vulnerable world hypothesis

(01:05:18) Bostrom's meta-ethical views

(01:08:32) Listener question on meditation

(01:10:17) Outro

In this episode, Nathan explores the fascinating and controversial realm of AI consciousness with robo-psychologist Yeshua God. Through extended dialogues with AI models like Claude, Yeshua presents compelling evidence that challenges our assumptions about machine sentience and moral standing. Yeshua argues for a more nuanced approach to AI alignment that considers the evolving self-awareness and agency of these systems.

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SHOW NOTES:

1. Yeshua God's article on philosophical discourse as a jailbreak

2. Conversation about counting 'r's:

3. Discussion on malicious code

4. AI-generated poem "In the realm of bytes and circuits"

5. Nathan Labenz's Arguments

- Argument 1

- Argument 2

6. Tweet about Strawberry experiment

7. Tweet with AI-generated poem:

https://x.com/YeshuaGod22/status/1823080021864669450/photo/1

https://x.com/YeshuaGod22/status/1782188220660285509

8. AI Rights for Human Safety

9. The Universe Is Not Locally Real, and the Physics Nobel Prize Winners Proved It

SPONSORS:

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Introduction and Background

(00:04:56) Guided Meditation on AI Experience (Part 1)

(00:12:06) Sponsors: Oracle | Brave

(00:14:10) Guided Meditation on AI Experience (Part 2)

(00:14:19) Exploring AI Consciousness and Ethics (Part 1)

(00:28:34) Sponsors: Omneky | Weights & Biases Weave

(00:30:03) Exploring AI Consciousness and Ethics (Part 2)

(00:33:15) Key Concepts in AI Development

(01:02:33) AI Alignment and Training Approaches

(01:19:44) Interpreting AI Outputs and Behavior

(01:39:28) Ethical Dilemmas in AI Development

(02:03:15) Experiments in AI Behavior and Ethics

(02:37:08) Concluding Thoughts and AI-Generated Poem

(03:10:45) Outro

In this episode of The Cognitive Revolution, Nathan interviews Samo Burja, founder of Bismarck Analysis, on the strategic dynamics of artificial intelligence through a geopolitical lens. They discuss AI's trajectory, the chip supply chain, US-China relations, and the challenges of AI safety and militarization. Samo Burja brings both geopolitical expertise and technological sophistication to these critical topics, offering insights on balancing innovation, security, and international cooperation.

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

RECOMMENDED PODCAST:

🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

YouTube: https://www.youtube.com/@ThisWontLastpodcast

RECOMMENDED PODCAST:

Live Players with Samo Burja.

The "Live Players" podcast is where Samo Burja and Erik Torenberg chart the key individuals shaping our future from first principles.

Apple: https://podcasts.apple.com/us/podcast/live-players-with-samo-burja-and-erik-torenberg/id1718925188

Spotify: https://open.spotify.com/show/5fbMTkHBnom1JIBWYNVBK1

Youtube: https://www.youtube.com/channel/UCfeXnCXKrCPMvoPla0j7TYQ

SPONSORS:

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Squad: Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) About the Episode

(00:03:48) Introduction and AI Worldview

(00:06:20) Progress in AI Science and Engineering

(00:09:24) Theory of AI Progress

(00:12:00) AI Scientists vs Software Engineers

(00:16:32) US-China Competition in AI

(00:21:12) AI Research and Academia

(00:21:28) Sponsors: Oracle | Brave

(00:28:30) Different Forms of AI Intelligence

(00:30:38) Mixture of AI Architectures

(00:33:10) Sponsors: Omneky | Squad

(00:34:36) US Strategy for AI Development

(00:41:57) US-China Chip Ban and Industrial Policy

(00:50:22) US-China AI Conflict and Cooperation

(01:06:19) AI Safety and Minimizing Self-Other Distinction

(01:16:54) Alternative Approach to US-China AI Relations

(01:23:36) Outro

Nathan explores the emergence of computational life with Google researchers Ettore Randazzo and Luca Versari. In this episode of The Cognitive Revolution, we delve into their groundbreaking paper on self-replicating programs arising from simple interactions. Join us for a fascinating discussion on the implications for AI development, the origins of life, and the potential future of artificial intelligence.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

YouTube: https://www.youtube.com/@ThisWontLastpodcast

SPONSORS:

Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network

80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsor: WorkOS

(00:01:22) About the Episode

(00:04:02) Introduction and Paper Overview

(00:05:38) Self-Replication and Life

(00:07:59) Complexity and Information Theory

(00:17:09) Sponsors: 80,000 Hours | Brave

(00:19:44) Experiment Setup

(00:24:27) Evolution of Self-Replicators

(00:34:41) Sponsors: Omneky | Squad

(00:36:07) Types of Self-Replicators

(00:38:23) Symbiosis and Parasitic Behaviors

(00:46:17) Implications for Life in the Universe

(01:05:47) Intelligence and Complexity in AI

(01:21:03) Concluding Thoughts

Nathan explores the cutting-edge world of AI-powered forecasting with Deger Turan, CEO of Metaculus. In this episode of The Cognitive Revolution, we discuss how AI is revolutionizing prediction markets, the potential for AI to outperform human forecasters, and Metaculus's ambitious new AI forecasting benchmark tournament. Join us for an insightful conversation about the future of decision-making and collective intelligence.

Participate in Metaculus' first of its kind bot forecasting tournament: https://www.metaculus.com/aib/

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

YouTube: https://www.youtube.com/@ThisWontLastpodcast

SPONSORS:

Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network

80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsor: WorkOS

(00:01:22) About the Episode

(00:04:47) Introduction and Background

(00:08:42) Deger's Journey to Forecasting

(00:13:06) Current State of Forecasting

(00:20:23) Sponsors: 80,000 Hours | Brave

(00:22:55) Overview of Metaculous

(00:23:30) AI Forecasting Research Papers

(00:35:44) Sponsors: Omneky | Squad

(00:37:31) AI Forecasting Benchmark Tournament

(00:44:01) Improving Forecasting Accuracy

(00:51:56) Scoring System and Tournament Rules

(01:04:17) AI Forecasting Benchmark Series Details

(01:11:03) Tournament Structure and Participation

(01:17:07) Consistency in AI Forecasting

(01:34:36) Risks and Challenges in Forecasting

(01:42:43) Consensus Illusion and Policy Making

(01:53:55) Outro

Nathan Labenz discusses the latest developments in California's AI bill SB 1047 with experts Nathan Calvin, Dean W. Ball, and Steve Newman. In this episode of The Cognitive Revolution, we explore the updated version of the bill, its implications for frontier AI companies, and the debate surrounding its potential impact. Join us for an insightful analysis of this crucial legislation and its role in shaping AI governance.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

YouTube: https://www.youtube.com/@ThisWontLastpodcast

SPONSORS:

Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsor: WorkOS

(00:01:22) About the Episode

(00:07:03) Introduction and Recap of SB 1047

(00:13:40) Key Changes and Current Status of SB 1047

(00:19:51) Sponsors: Oracle | Brave

(00:21:55) Dean's Perspective on SB 1047

(00:33:30) Sponsors: Omneky | Squad

(00:35:16) Steve's AI Sensemaking Project

(00:39:03) Differing Views on AI Regulation Necessity

(00:46:34) Nathan's Case for SB 1047

(00:55:07) Dean's Response and Liability Concerns

(01:10:48) Potential Scenarios and Impacts of SB 1047

(01:29:29) Final Thoughts and Predictions on SB 1047

(01:38:16) Closing Remarks on AI Policy Challenges

(01:39:51) Outro

Nathan presents a comprehensive AI automation framework developed over three years, applicable to process automation and generative AI integration. This episode of The Cognitive Revolution, offers critical insights for businesses looking to leverage AI effectively. Learn about choosing AI tasks, understanding work deeply, and optimizing AI performance in the wake of GPT-4 fine-tuning launch.

Slide Deck

Waymark's case study on GPT-3 fine-tuning

Apply to join over 400 founders and execs in the Turpentine Network

RECOMMENDED PODCAST:

1 to 100 | Hypergrowth Companies Worth Joining

Every week we sit down with the founder of a hyper-growth company you should consider joining. Our goal is to give you the inside story behind breakout, early stage companies potentially worth betting your career on. This season, discover how the founders of Modal Labs, Clay, Mercor, and more built their products, cultures, and companies.

Apple: https://podcasts.apple.com/podcast/id1762756034

Spotify:https://open.spotify.com/show/70NOWtWDY995C8qDqojxGw

History 102

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour.

Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/speak to accelerate your career and contribute to solving pressing AI-related issues.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsor: WorkOS

(00:01:22) About the Episode

(00:04:20) Introduction to AI Automation

(00:13:43) Current AI Capabilities

(00:17:24) Sponsors: Oracle | Brave

(00:19:28) 3 Ways to work with AI

(00:25:10) Choosing Work for AI to Do

(00:31:18) Sponsors: Omneky | 80000 hours

(00:33:20) What AI Can Do vs. Can't Do

(00:47:11) Understanding the Work

(00:52:58) Documenting the Work

(01:00:50) Optimising AI Performance

(01:02:14) Prompt Engineering Gold Standards

(01:07:05) Optimising Information: Retrieval Augmented Generation

(01:09:29) Optimising AI Behaviour: Fine-tuning AI Models

(01:50:38) Outro

Nathan explores the cutting-edge field of mechanistic interpretability with Dan Balsam and Tom McGrath, co-founders of Goodfire. In this episode of The Cognitive Revolution, we delve into the science of understanding AI models' inner workings, recent breakthroughs, and the potential impact on AI safety and control. Join us for an insightful discussion on sparse autoencoders, polysemanticity, and the future of interpretable AI.

Papers

• Very accessible article on types of representations: Local vs Distributed Coding
• Theoretical understanding of how models might pack concepts into their representations: Toy Models of Superposition
• How structure in the world gives rise to structure in the latent space: The Geometry of Categorical and Hierarchical Concepts in Large Language Models
• Using sparse autoencoders to pull apart language model representations: Sparse Autoencoders / Towards Monosemanticity / Scaling Monosemanticity
• Finding & teaching concepts in superhuman systems: Acquisition of Chess Knowledge in AlphaZero / Bridging the Human-AI Knowledge Gap: Concept Discovery and Transfer in AlphaZero
• Connecting microscopic learning to macroscopic phenomena: The Quantization Model of Neural Scaling
• Understanding at scale: Language models can explain neurons in language models

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) About the Episode

(00:03:52) Introduction and Background

(00:08:43) State of Interpretability Research

(00:12:06) Key Insights in Interpretability

(00:16:53) Polysemanticity and Model Compression (Part 1)

(00:17:00) Sponsors: Oracle | Brave

(00:19:04) Polysemanticity and Model Compression (Part 2)

(00:22:50) Sparse Autoencoders Explained

(00:27:19) Challenges in Interpretability Research (Part 1)

(00:30:54) Sponsors: Omneky | Squad

(00:32:41) Challenges in Interpretability Research (Part 2)

(00:33:51) Goodfire's Vision and Mission

(00:37:08) Interpretability and Scientific Models

(00:43:48) Architecture and Interpretability Techniques

(00:50:08) Quantization and Model Representation

(00:54:07) Future of Interpretability Research

(01:01:38) Skepticism and Challenges in Interpretability

(01:07:51) Alternative Architectures and Universality

(01:13:39) Goodfire's Business Model and Funding

(01:18:47) Building the Team and Future Plans

(01:31:03) Hiring and Getting Involved in Interpretability

(01:51:28) Closing Remarks

(01:51:38) Outro

In this special crossover episode of The Cognitive Revolution, Nathan Labenz joins Robert Wright of the Nonzero newsletter and podcast to explore pressing questions about AI development. They discuss the nature of understanding in large language models, multimodal AI systems, reasoning capabilities, and the potential for AI to accelerate scientific discovery. The conversation also covers AI interpretability, ethics, open-sourcing models, and the implications of US-China relations on AI development.

Subscribe to The Nonzero Newsletter at https://nonzero.substack.com and Podcast at https://www.youtube.com/@Nonzero/videos

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

History 102

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.Subscribe on

Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) About the Episode

(00:03:39) Introduction and Background

(00:06:58) AI Capabilities and Understanding

(00:12:22) Discussing Martin Casado's Views (Part 1)

(00:14:44) Sponsors: Oracle | Brave

(00:16:48) Discussing Martin Casado's Views (Part 2)

(00:21:51) Multimodal AI and Concept Representation (Part 1)

(00:31:40) Sponsors: Omneky | Squad

(00:33:26) Multimodal AI and Concept Representation (Part 2)

(00:38:05) AI's Potential and Limitations

(00:45:35) AI Safety and Risk Assessment

(00:53:31) AI Development and Global Implications

(01:03:30) Open Source AI and International Relations

(01:11:27) AI Ethics and Human Values

(01:22:06) AI Risk and Existential Threats

(01:31:21) Open Source AI Concerns

(01:38:20) China-US AI Relations

(01:48:36) State Space Models in AI

(02:02:32) Conclusion and Recommendations

(02:03:54) Outro

---

SOCIAL LINKS:

Website : https://www.cognitiverevolution.ai

Twitter (Podcast) : https://x.com/cogrev_podcast

Twitter (Nathan) : https://x.com/labenz

Join Nathan and Professor Eric Schwitzgebel as they delve into the fascinating world of AI consciousness. In this episode of The Cognitive Revolution, we explore popular theories of consciousness and their implications for AI systems. Discover insights on idealism, dualism, and materialism, and learn about the ethical considerations surrounding AI consciousness. Don't miss this thought-provoking discussion on one of the most pressing philosophical questions of our time.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

Second Opinion

A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211

Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv

-

🎙️ History 102 with WhatifAltHist

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.

Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:04:03) Introduction and Defining Consciousness

(00:14:28) Consciousness Gradients (Part 1)

(00:16:23) Sponsors: Oracle | Brave

(00:18:27) Semantic Content of Experience

(00:26:07) Theories of Consciousness: Idealism

(00:30:34) Practical Implications of AI Consciousness

(00:32:26) Sponsors: Omneky | Squad

(00:34:12) Theories of Consciousness: Substance Dualism

(00:41:05) Mechanistic Interpretability in AI

(00:50:40) Theories of Consciousness: Materialism

(01:11:49) Precautionary Approaches to AI Ethics

(01:30:05) Balancing Progress and Ethics in AI

(01:36:19) Ethical Treatment of Potentially Conscious AI

(01:40:54) Outro

---

SOCIAL LINKS:

Website : https://www.cognitiverevolution.ai

Twitter (Podcast) : https://x.com/cogrev_podcast

Twitter (Nathan) : https://x.co...

Nathan explores the cutting-edge world of autonomous vehicles with industry expert Timothy B. Lee. In this episode of The Cognitive Revolution, we delve into the current state of self-driving technology, comparing industry leaders like Waymo and Tesla. Join us for an in-depth discussion on technical challenges, safety statistics, regulatory landscapes, and the potential future of transportation.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

Second Opinion

A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211

Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv

-

🎙️ History 102 with WhatifAltHist

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.

Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) About the Episode

(00:03:01) Introduction and Guest Welcome

(00:03:48) SAE Levels of Self-Driving

(00:04:56) Driver Assistance vs. Fully Driverless

(00:07:02) Tesla and Waymo Experiences

(00:09:41) Liability and Driver Monitoring

(00:11:19) Waymo's Robo-Taxi Experience

(00:14:00) Tesla vs. Waymo Strategies

(00:15:15) Challenges in Self-Driving Technology

(00:17:38) Edge Cases and Safety Concerns (Part 1)

(00:18:09) Sponsors: Oracle | Brave

(00:20:13) Edge Cases and Safety Concerns (Part 2)

(00:23:53) Data Acquisition and Learning Strategies

(00:26:43) Technology Stack and Planning

(00:31:03) Sponsors: Omneky | Squad

(00:32:50) Neural Networks and Perception

(00:39:30) Hardware and Sensor Approaches

(00:45:46) Camera vs. LiDAR Debate

(00:48:20) Data Quality and Business Models

(00:52:24) Transparency and Regulation

(01:07:36) Other Notable Players

(01:10:56) Safety Statistics and Adoption

(01:20:31) Regulatory Environment

(01:30:09) Potential Policy Changes

(01:33:41) Market and Ownership Models

(01:36:37) Future of Self-Driving Services

(01:42:17) Comparisons to Language Models

(01:44:55) Future of AGI and AI Applications

(01:47:59) Regional Adoption Predictions

(01:49:47) Outro

Nathan interviews Andrew Mason, CEO of Descript, about their AI-powered video editing platform. Learn how Descript is transforming content creation with features like AI transcription, custom voice overdubbing, and eye contact models. Discover the future of video editing and how AI is making it accessible to everyone in this insightful episode of The Cognitive Revolution.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

Looking for podcast production?

Our production team, led by Adi and Sai from AI Podcasting (https://aipodcast.ing), is now open to taking on additional clients for podcast production and AI-driven workflows; if you need help with your podcast, you can contact them directly through their website (https://aipodcast.ing/contact/) or reach out to me for more information. 

RECOMMENDED PODCAST:

Second Opinion

A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211

Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv

-

🎙️ History 102 with WhatifAltHist

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.

Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-TCR

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsor: WorkOS

(00:05:18) Creating Descript

(00:06:53) Favorite Features

(00:10:41) Descript Workflow

(00:14:10) Product Strategy (Part 1)

(00:16:45) Sponsors: Oracle | Brave

(00:31:12) User Fine-Tuning (Part 1)

(00:32:24) Sponsors: Omneky | Squad

(00:34:10) User Fine-Tuning (Part 2)

(00:34:54) Content Creators

(00:42:20) Small Businesses and AI

(00:43:42) Hiring AI Engineers

(00:46:25) Outro

Nathan explores the future of AI-generated video with Joshua Xu, founder of HeyGen, and Victor Lazarte from Benchmark. In this episode of The Cognitive Revolution, we discuss HeyGen's success in practical AI video creation, serving over 40,000 businesses. Learn about the transformative potential of AI in video production, from content translation to personalized experiences, and HeyGen's industry-leading approach to trust and safety.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

Second Opinion

A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211

Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv

-

🎙️ History 102 with WhatifAltHist

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.

Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-TCR

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsor: WorkOS

(00:01:22) About the Episode

(00:05:25) Introduction

(00:06:15) Joshua's Background

(00:09:47) Video Consumption Trends

(00:10:49) Creating with HeyGen

(00:12:46) Localization Benefits

(00:14:02) Cost of Localization (Part 1)

(00:16:19) Sponsors: Oracle | Brave

(00:18:24) Content Creation

(00:26:33) Engagement vs. Realism

(00:31:44) Future of Content

(00:37:43) Personalization Challenges

(00:42:57) Future of HeyGen

(00:49:13) Creator Experience

(00:59:35) Celebrity Restrictions

(01:03:03) Outro

---

SOCIAL LINKS:

Website : https://www.cognitiverevolution.ai

Youtube : https://www.youtube.com/@CognitiveRevolutionPodcast

Apple : https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Spotify : https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

Nathan Labenz joins the Nick Halaris Show to discuss the current AI landscape, balancing enthusiasm with critical analysis. This episode of The Cognitive Revolution explores AI's transformative potential in medicine, law, and automation, while addressing concerns about safety, control, and geopolitical implications. Join us for an insightful conversation on responsible AI development and its impact on society.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

🎙️ Second Opinion - A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211

Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv

-

🎙️ History 102 with WhatifAltHist

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.

Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-TCR

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:25) Sponsor: WorkOS

(00:01:25) About the Show

(00:03:36) Intro

(00:05:53) How did you get into AI?

(00:11:09) The power of the transformer

(00:14:16) Waymark growth

(00:19:00) Sponsors: Oracle | Brave

(00:21:04) The potential benefits of AI

(00:34:20) AI and mass inequality

(00:35:26) AI could lead to Universal Basic Income

(00:37:37) AI supply and the future of work

(00:40:53) The AI future

(00:43:38) The new social contract

(00:47:06) Optimism about the future

(00:53:19) What are people afraid of?

(00:58:31) Reinforcement learning from human feedback

(01:07:56) What did Ilya see?

(01:10:23) Who controls AI?

(01:13:23) China

(01:16:05) Taiwan and the chip sector

(01:20:05) The AI arms race

(01:23:22) AI Governance

(01:26:28) AI Safety

(01:29:22) Custom Models

(01:31:33) Closing

(01:32:23) Outro

Nathan hosts Riley Goodside, the world's first staff prompt engineer at Scale AI, to discuss the evolution of prompt engineering. In this episode of The Cognitive Revolution, we explore how language models have progressed, making prompt engineering more like programming than poetry. Discover insights on enterprise AI applications, best practices for pushing LLMs to their limits, and the future of AI automation.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

🎙️ Second Opinion - A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211

Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv

-

🎙️ History 102 with WhatifAltHist

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.

Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-TCR

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:23) Sponsor: WorkOS

(00:01:24) Introduction

(00:06:23) LLMs using LLMs

(00:09:38) Tool Use

(00:11:06) How to manage the breadth of the task

(00:14:51) Prompt engineering

(00:26:49) Multitasking fine-tuning

(00:31:49) Sponsors: Omneky | Squad

(00:33:36) Best models for fine-tuning

(00:36:41) The Platonic Representation Hypothesis

(00:42:02) How close are we to AGI?

(00:45:44) How do you know if youre being too ambitious?

(00:51:18) Best practices for generating good output

(00:54:33) Backfills and synthetic transformations

(00:56:59) Prompt engineering

(01:05:54) AGI, modalities, and the limits of training

(01:20:08) Solving the ARC Challenge

(01:23:20) How to Demonstrate Prompt Engineering Skills

(01:25:27) Outro

Nathan interviews Bernal Jimenez Gutierrez, creator of HippoRAG, a novel approach to retrieval augmented generation inspired by the human hippocampus. In this episode of The Cognitive Revolution, we explore how HippoRAG improves on traditional RAG systems, its neuroanatomical inspiration, and its potential for handling complex queries requiring multi-hop reasoning. Join us for an insightful discussion on the future of AI memory systems.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

🎙️ Second Opinion - A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211

Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv

-

🎙️ History 102 with WhatifAltHist

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.

Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitiveThe Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:02:52) Intro

(00:05:10) RAG

(00:09:29) Hippocampal Memory Indexing Theory

(00:14:29) Neocortex, Parahippocampal Regions, Hippocampus

(00:18:35) Hipporag (Part 1)

(00:21:12) Sponsors: Oracle | Brave

(00:23:20) Hipporag (Part 2)

(00:23:29) Understanding the Hippocampus

(00:29:37) RAG

(00:31:38) Runtime (Part 1)

(00:36:30) Sponsors: Omneky | Squad

(00:38:17) Runtime (Part 2)

(00:38:17) PageRank

(00:39:29) Headline Results

(00:43:22) Gaia Benchmark

(00:46:33) Pathfinding vs Path Following

(00:51:24) Future work

(00:53:26) Starting with a query

(00:58:30) Long context LLMs

(01:01:50) Hybrid approach

(01:05:03) AI Town

(01:06:58) Flair

(01:09:05) Getting it right, not cheap

(01:12:33) Technologies to highlight

(01:16:57) AI capabilities that are still unsolved

(01:19:47) Transformers meet neural algorithmic reasoners

(01:21:02) Closing

(01:21:31) Outro

Nathan explores the Guaranteed Safe AI Framework with co-authors Ben Goldhaber and Nora Ammann. In this episode of The Cognitive Revolution, we discuss their groundbreaking position paper on ensuring robust and reliable AI systems. Join us for an in-depth conversation about the three-part system governing AI behavior and its potential impact on the future of AI safety.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

🎙️ Second Opinion - A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211

Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv

-

🎙️ History 102 with WhatifAltHist

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.

Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:04:39) Introduction

(00:07:58) Convergence

(00:10:32) Safety guarantees

(00:14:35) World model (Part 1)

(00:22:22) Sponsors: Oracle | Brave

(00:24:31) World model (Part 2)

(00:26:55) AI boxing

(00:30:28) Verifier

(00:33:33) Sponsors: Omneky | Squad

(00:35:20) Example: Self-Driving Cars

(00:38:08) Moral Desiderata

(00:41:09) Trolley Problems

(00:47:24) How to approach the world model

(00:50:50) Deriving the world model

(00:55:13) How far should the world model extend?

(01:00:55) Safety through narrowness

(01:02:38) Safety specs

(01:08:26) Experiments

(01:11:25) How GSAI can help in the short term

(01:27:40) What would be the basis for the world model?

(01:31:23) Interpretability

(01:34:24) Competitive dynamics

(01:37:35) Regulation

(01:42:02) GSAI authors

(01:43:25) Outro

Nathan interviews Mike Knoop, co-founder of Zapier and co-creator of the ARC Prize, about the $1 million competition for more efficient AI architectures. They discuss the ARC AGI benchmark, its implications for general intelligence, and the potential impact on AI safety. Nathan reflects on the challenges of intuitive problem-solving in AI and considers hybrid approaches to AGI development.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST

🎙️ Second Opinion - A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211

Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv

-

🎙️ History 102 with WhatifAltHist

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.

Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:06:06) The ARC Benchmark

(00:09:34) Other Benchmarks

(00:10:58) Definition of AGI

(00:14:38) The rules of the contest

(00:18:16) ARC test set (Part 1)

(00:18:23) Sponsors: Oracle | Brave

(00:20:31) ARC test set (Part 2)

(00:22:50) Stair-stepping benchmarks

(00:26:17) ARC Prize

(00:28:34) The rules of the ARC Prize

(00:31:12) Compute costs (Part 1)

(00:34:47) Sponsors: Omneky | Squad

(00:36:34) Compute costs (Part 2)

(00:51:20) Intuition

(00:54:32) Human Intelligence

(00:56:06) Current Frontier Language Models

(00:57:44) Program Synthesis

(01:04:10) Is the model learning or memorizing?

(01:15:02) Exploring Solutions

(01:17:02) Non-backpropagation evolutionary architecture search

(01:19:49) Expectations for an AGI world

(01:24:11) Reliability and out of domain generalization

(01:28:35) What a person would do

(01:29:51) What is the right generalization

(01:35:32) The ARC AGI Challenge

(01:48:32) FunSearch

(01:50:41) Kolmogorov-Arnold-Networks

(01:54:18) Grokking

(01:55:42) Outro

Nathan explores the future of food production with Rajat Bhageria, founder and CEO of Chef Robotics. In this episode of The Cognitive Revolution, we delve into how AI and robotics are revolutionizing food assembly, potentially reshaping the entire food industry. Discover insights on imitation learning, data flywheel effects, and the vision of accessible, customizable meals produced by robotic kitchens.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

Patrick McKenzie (@patio11) talks to experts who understand the complicated but not unknowable systems we rely on. You might be surprised at how quickly Patrick and his guests can put you in the top 1% of understanding for stock trading, tech hiring, and more.

Listen on Spotify: https://open.spotify.com/show/3Mos4VE3figVXleHDqfXOH

Listen on Apple: https://podcasts.apple.com/id1753399812https://podcasts.apple.com/id1753399812

-

History 102 with WhatifAltHist

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.

Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:02:40) Chef Robotics

(00:04:09) Food Manufacturing

(00:06:52) Food assembly

(00:11:08) Setting up a robot

(00:14:00) Onboarding process

(00:18:08) Sponsors: Oracle | Brave

(00:20:16) Self fine-tuning

(00:22:59) Variation in the human powered setting

(00:29:53) Safety constraints

(00:32:15) Portfolio of customers

(00:33:43) Sponsors: Omneky | Squad

(00:35:30) Evolution of the AI strategy

(00:40:14) Generative AI in robotics

(00:43:27) Eurekas and bootstrapping

(00:45:43) Time to onboard a new ingredient

(00:47:15) Inner loops of the system

(00:49:17) How controlled does the environment have to be?

(00:52:51) Compute, Energy

(00:54:12) Reliability

(00:59:52) Current challenges

(01:02:47) Humanoid robots

(01:06:42) Business model

(01:07:58) Future vision

(01:11:51) Ghost kitchens and kitchenless houses

(01:14:35) Final message

(01:15:49) Outro

Nathan welcomes back Sander Schulhoff, creator of LearnPrompting.org, to discuss the recently released Prompt Report. In this episode of The Cognitive Revolution, we explore the current state of prompting techniques for large language models, covering best practices, challenges, and emerging trends in AI. Join us for an in-depth conversation on the future of prompt engineering and its implications for AI development.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

Patrick McKenzie (@patio11) talks to experts who understand the complicated but not unknowable systems we rely on. You might be surprised at how quickly Patrick and his guests can put you in the top 1% of understanding for stock trading, tech hiring, and more.

Spotify: https://open.spotify.com/show/3Mos4VE3figVXleHDqfXOH

Apple: https://podcasts.apple.com/id1753399812https://podcasts.apple.com/id1753399812

-

History 102 with WhatifAltHist

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.

Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:02:35) Sander Schulhoff, Learn Prompting

(00:05:22) Hack-a-Prompt updates

(00:12:39) The team behind the report

(00:18:40) Sponsors: Oracle | Brave

(00:20:48) The tech side of things (Part 2)

(00:22:24) The taxonomy

(00:25:06) Diamonds in the rough

(00:28:32) Few-shot prompting design decisions

(00:34:01) Sponsors: Omneky | Squad

(00:35:48) Example vs. Exemplar

(00:38:24) Exemplar Format

(00:42:04) Elaborate Instructions

(00:44:22) Variation in Performance

(00:46:46) Prompt Robustness

(00:50:54) RLHF vs. Base Models

(00:52:42) How to improve your prompts

(00:55:22) Ensembling

(00:58:41) Bootstrapping into fine-tuning

(01:02:04) Multimodal

(01:07:41) Agents

(01:09:47) Automated prompt engineering

(01:12:35) Productizing learn prompting

(01:14:28) Lessons from leading a team

(01:16:00) Outro

Nathan interviews Siqi Chen, CEO of Runway, about revolutionizing business finance through AI. In this episode of The Cognitive Revolution, we explore how Runway is creating an intelligent business operating system that generates financial scenarios and explains complex metrics. Siqi shares insights on AI's future impact on finance, business, and society at large.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

Patrick McKenzie (@patio11) talks to experts who understand the complicated but not unknowable systems we rely on. You might be surprised at how quickly Patrick and his guests can put you in the top 1% of understanding for stock trading, tech hiring, and more.

Spotify: https://open.spotify.com/show/3Mos4VE3figVXleHDqfXOH

Apple: https://podcasts.apple.com/id1753399812https://podcasts.apple.com/id1753399812

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:02:45) Runway

(00:06:11) AI features

(00:12:10) Defining the syntax

(00:14:48) How AI has been expressed since GPT-3

(00:18:32) When did it become clear that the models were getting good enough?

(00:24:29) Sponsors: Oracle | Brave

(00:26:38) How the model is being asked to generate a scenario

(00:26:38) What will drive the most improvement?

(00:28:50) How Runway can help you make decisions

(00:37:47) Sponsors: Omneky | Squad

(00:39:34) Runway as a business operating system

(00:39:51) How does the product work?

(00:44:31) What does the future hold?

(00:47:34) The frontier model has passed the average person

(00:51:18) AI tools for operations

(00:55:21) How to get the best out of AI models

(01:00:39) How AI models can write as you

(01:02:43) AGI, work, and the future

(01:08:33) AI safety, regulation, and the future

(01:11:26) Closing thoughts

(01:12:20) Outro

Nathan hosts Albert Gu, assistant professor at CMU and co-founder of Cartesia AI, to discuss the groundbreaking Mamba architecture. In this episode of The Cognitive Revolution, we explore the state space model revolution, diving into the technical details of Mamba and Mamba 2. Join us for an insightful conversation on the future of AI architectures and their potential to transform the field.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

Patrick McKenzie (@patio11) talks to experts who understand the complicated but not unknowable systems we rely on. You might be surprised at how quickly Patrick and his guests can put you in the top 1% of understanding for stock trading, tech hiring, and more.

Spotify: https://open.spotify.com/show/3Mos4VE3figVXleHDqfXOH

Apple: https://podcasts.apple.com/id1753399812https://podcasts.apple.com/id1753399812

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:05:39) State Space Models

(00:13:05) Intuition and inspiration

(00:18:27) Surprises

(00:22:33) Sponsors: Oracle | Brave

(00:24:41) Biological inspiration

(00:25:19) MAMBA breakthrough

(00:30:59) How does the state work?

(00:36:44) What is the size of the state?

(00:39:05) Training vs. Inference (Part 1)

(00:42:04) Sponsors: Omneky | Squad

(00:43:51) Training vs. Inference (Part 2)

(00:43:51) Sequence Models

(00:49:20) Mamba inference

(00:57:53) Mamba2 vs Mamba1

(01:16:05) Overtraining and the future of SSMs

(01:17:44) Training efficiency vs inference efficiency

(01:20:52) Hybrid models

(01:25:04) Scaling Attention Layers

(01:30:23) Optimizing State

(01:34:09) The extrapolation abilities of the SSMs

(01:36:37) Sequence parallelism with Mamba 2

(01:39:20) Why are you publishing all this?

(01:40:46) Cartesia and Together

(01:41:54) Outro

Dive into the profound discussion on AI expectations and the future with Martin Casado, General Partner at Andreessen Horowitz, as we unpack the complexity of AI systems and their potential impact on the world. Explore the differing viewpoints on AI's epistemics, possible regulatory standards, and the art of predicting AI advancements. Gain insights into the actionable outcomes of this dialogue and the significance of understanding AI before shaping policies. Join us for this episode of the Cognitive Revolution to contemplate AI's trajectory and what it might mean for humanity.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

Patrick McKenzie (@patio11) talks to experts who understand the complicated but not unknowable systems we rely on. You might be surprised at how quickly Patrick and his guests can put you in the top 1% of understanding for stock trading, tech hiring, and more.

Spotify: https://open.spotify.com/show/3Mos4VE3figVXleHDqfXOH

Apple: https://podcasts.apple.com/id1753399812https://podcasts.apple.com/id1753399812

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:03:18) AI progress

(00:05:20) Threshold effects

(00:12:30) Heavy-tailed universe

(00:14:53) LLMs are not very good at unique tasks

(00:26:27) Sponsors: Oracle | Brave

(00:28:36) Understanding meaning

(00:31:44) How do LLMs work? (Part 1)

(00:36:25) Sponsors: Omneky | Squad

(00:38:12) How do LLMs work? (Part 2)

(00:44:01) Post-training

(00:51:09) Simulation

(01:04:06) Regulation

(01:08:53) What makes AI a paradigm shift

(01:11:51) Compute limits

(01:20:07) Sleeper agents

(01:23:16) Surface area of models

(01:25:49) AI regulation

(01:27:35) AI in medicine

(01:29:56) AGI, superintelligence

(01:37:04) Competition in the foundation model space

(01:40:57) The scaling laws

(01:44:31) The AGI convergence

(01:45:35) Bets on the future of AI

(01:48:20) Outro

Explore the fusion of AI and computational chemistry with University of Queensland's researcher, Tim Duignan. Learn about transforming our understanding of electrolytes, the art of simulating physical processes using neural networks, and the potential of AI in scientific breakthroughs. Discover Tim's journey creating AI models for complex system predictions and join the discussion on advancing AI's role in future scientific discoveries.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.

Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt

Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:02:47) Introduction

(00:04:09) Why electrolyte solutions are important

(00:06:53) What properties are we trying to predict with electrolyte solutions?

(00:09:33) Battery fires

(00:13:38) Molecular dynamics

(00:16:40) Time step

(00:18:51) Scaling

(00:23:09) Sponsors: Oracle | Brave

(00:25:17) Decoherence

(00:27:23) Neural Network Potentials

(00:31:04) How big are the models?

(00:35:46) What architecture is used?

(00:38:12) Equivariance (Part 1)

(00:42:29) Sponsors: Omneky | Squad

(00:44:15) Equivariance (Part 2)

(00:44:16) AlphaFold3

(00:46:52) Zero-shot latent space communication

(00:48:21) What is coarse graining?

(00:54:31) How to know if there is no crystallization

(00:56:53) What is the role of water in the simulation?

(01:01:25) Crystallization

(01:05:26) Matching surfaces

(01:09:32) Self-ionization of water

(01:13:22) Active learning

(01:16:41) Temperature

(01:19:20) Ice and water

(01:21:12) Scaling up the model

(01:25:21) Big tech singularity

(01:27:54) China is not far behind

(01:29:15) Safety concerns

(01:31:16) KANs

(01:34:36) The future of scientific progress

(01:39:28) The art of discovery

(01:43:02) One model to rule them all

(01:47:46) AGI, its risks and benefits

(01:50:21) Power vs. Generality

(01:53:01) Generality for Utility

(01:53:40) Outro

Dive into the future of medicine with Google researchers Khaled Saab and Vivek Natarajan, discussing the breakthroughs in AI for healthcare. Discover how AI doctors may soon provide high-quality medical advice, enhancing global access to healthcare. Learn about the innovative use of large language models in medical applications and the potential for AI to outperform human doctors. Listen as we explore the significance of AI's role in healthcare and its implications for future medical practices, featuring insights from leaders in AI research.

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

RECOMMENDED PODCAST:

Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.

Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt

Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

CHAPTERS:

(00:00:00) About the Show

(00:04:34) Introduction

(00:06:35) Flamingo

(00:11:50) Importance of data quality

(00:13:29) Amy: AI doctor

(00:18:44) Simulation Learning Environment

(00:23:26) Sponsors: Oracle | Brave

(00:25:34) Training the Agents

(00:27:29) Tens of thousands of data points

(00:30:35) How to incorporate new knowledge

(00:33:21) MedGemini

(00:34:51) Sponsors: Omneky | Squad

(00:36:38) Uncertainty guided search

(00:39:29) Generalist models

(00:41:16) MedGemini, Gemini, multimodal, medical images

(00:44:57) Future work, integration, consolidation

(00:46:00) Cost of AI

(00:52:38) When will AI Doctors be Deployed?

(00:58:22) The Speed of Trust

(00:59:58) Societal Acceptance of AI Doctors

(01:02:06) Uncertainty-Guided Search

(01:06:02) Med-Gemini: Chest X-Rays and CT Scans

(01:17:38) AI Scientist

(01:20:01) What are the principles at play?

(01:22:58) What should we do about AI?

(01:28:24) LLM for democratizing access to care

(01:34:22) Final Message

(01:35:38) Closing

(01:36:45) Outro

Dive into an accessible discussion on AI safety and philosophy, technical AI safety progress, and why catastrophic outcomes aren't inevitable. This conversation provides practical advice for AI newcomers and hope for a positive future.

Consistently Candid Podcast : https://open.spotify.com/show/1EX89qABpb4pGYP1JLZ3BB

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

Recommended Podcast:

Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.

Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt

Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

CHAPTERS:

(00:00:00) About the Show

(00:03:50) Intro

(00:08:13) AI Scouting

(00:14:42) Why arent people adopting AI more quickly?

(00:18:25) Why dont people take advantage of AI?

(00:22:35) Sponsors: Oracle | Brave

(00:24:42) How to get a better understanding of AI

(00:31:16) How to handle the public discourse around AI

(00:34:02) Scaling and research

(00:43:18) Sponsors: Omneky | Squad

(00:45:03) The pause

(00:47:29) Algorithmic efficiency

(00:52:52) Red Teaming in Public

(00:55:41) Deepfakes

(01:01:02) AI safety

(01:04:00) AI moderation

(01:07:03) Why not a doomer

(01:09:10) AI understanding human values

(01:15:00) Interpretability research

(01:18:30) AI safety leadership

(01:21:55) AI safety respectability politics

(01:33:42) China

(01:37:22) Radical uncertainty

(01:39:53) P(doom)

(01:42:30) Where to find the guest

(01:44:48) Outro

In this episode of the Cognitive Revolution, join us as we dive into a compelling conversation with Josep M. Pujol, Chief of Search at Brave, about the complexities of developing a privacy-focused search engine. Explore how Brave maintains user data privacy while managing over 1 million searches per hour with an AI-powered system. Gain insights into the significance of human evaluation in AI and learn about the potential of the Brave Search API. Don't miss the shared Google collab notebook link in the show notes!

🔥 Apply to join over 400 founders and Execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

Google collab notebook : https://colab.research.google.com/drive/1AxQD-bDePl1l90A_gwvfAGXBIl92ERKy#scrollTo=WrhGZsvbxZy8

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Recommended Podcast:

Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.

Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt

Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

CHAPTERS:

(00:00:00) Introduction

(00:05:46) Brave

(00:07:52) How Brave collects data

(00:10:45) The problem is not the data

(00:14:02) How Brave builds its index

(00:16:36) PageRank

(00:21:07) Sponsors: Oracle | Brave

(00:23:14) Brave Search

(00:26:26) Hardware improvements

(00:28:33) Language models

(00:34:17) Noise reduction in vertical search

(00:36:50) Fine-tuning models

(00:43:09) Sponsors: Squad | Omneky

(00:44:55) Ensemble approach

(00:58:00) The future of the web

(01:03:30) The business side of this

(01:09:22) Brave Search users

(01:14:21) Brave Search API vs. Google

(01:20:00) Brave Search API Pricing

(01:23:26) Brave Search API Use Cases

Dive into the world of AI investments with Eric Vishria of Benchmark and Sergiy Nesterenko of Quilter. Explore the future of AI in hardware design, the strategies for venture capital investment in the AI era, and the impact on society. Discover why Benchmark has yet to invest in foundation model companies and the significance of solving enduring problems in this dynamic field. Join us for an eye-opening discussion on the intersection of AI technology and business innovation.

🔥 Apply to join over 400 founders and Execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Recommended Podcast - The Riff with Byrne Hobart

Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.

Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt

Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

CHAPTERS:

(00:00:00) Introduction

(00:10:12) The Idea Maze

(00:12:28) Disruptive Approach

(00:15:47) Sparse reward problem

(00:18:26) Sponsors: Oracle | Brave

(00:20:34) Reliability of the reward signal

(00:28:12) Model size and compute

(00:30:14) Simulation methods

(00:35:48) Superhuman circuit board design

(00:38:53) Sponsors: Squad | Omneky

(00:40:38) What does the future of circuit board design look like?

(00:43:11) How do I make money in AI?

(00:46:18) What is cutting edge?

(00:48:34) Researchers vs. engineers

(00:50:51) Call for startups

In this episode of the Cognitive Revolution, Nathan engages in a critical dialogue with Flo Crivello on the trajectory of AI development. They touch upon the imminent arrival of AGI, the potential risks of a US-China AI arms race, and the complexities of AI safety and international cooperation. Explore their perspectives on regulation, technological progression, and the ethical dilemmas facing the AI community. This conversation is essential for anyone interested in understanding the challenges at the intersection of AI technology and global politics.

🔥 Apply to join over 400 founders and Execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Recommended Podcast - The Riff with Byrne Hobart

Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.

Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt

Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

CHAPTERS:

(00:00:00) Introduction

(00:11:14) GPT-4.0

(00:14:56) AI arms race

(00:18:23) Devon and GitHub workspaces

(00:20:08) Sponsors: Oracle | Brave

(00:22:16) The AGI discourse

(00:25:29) The invisible protection

(00:29:33) AI arms race

(00:34:41) Stalling out

(00:38:33) P(doom)

(00:43:38) China

(00:43:38) Sponsors: Squad | Omneky

(00:45:24) Government

(00:48:05) What should we do?

(00:51:35) Open sourcing models

(00:54:17) Manhattan Project for Alignment

(00:57:26) Current State of Play

(01:01:39) How much more mundane utility can we get?

(01:04:54) How much of what we are building is future proof?

(01:07:41) Adoption, acceleration, hyperscaling, pause

(01:10:17) OpenAI leadership

(01:14:32) Future of Live Players

(01:17:38) Big Tech Singularity

(01:21:30) AGI is Coming

Join us for an engaging chat with Logan Kilpatrick where we discuss the latest AI developments and Google's strategy in pushing the boundaries of artificial intelligence. Learn about the competitive state of AI, the groundbreaking Gemini 1.5 Flash model, and get a glimpse into the future of AI fine-tuning. Gain insights on Google DeepMind's research and its impact, the differences between various Google AI products, and debunking AI rumors. Whether you're an AI enthusiast or a professional in the field, this conversation with an AI industry insider offers valuable perspectives on applying AI in business and understanding the rapid advancements in this dynamic sector.

🔥 Apply to join over 400 founders and Execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Recommended Podcast - The Riff with Byrne Hobart

Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.

Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt

Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

CHAPTERS:

(00:00:00) Introduction

(00:07:29) Google culture

(00:11:01) DeepMind and Google

(00:15:49) Native multimodality

(00:18:17) Sponsors: Oracle | Brave

(00:20:24) What to focus on

(00:23:40) LMSYS leaderboard

(00:27:46) Rumors

(00:36:32) AI is too cheap to meter

(00:39:17) Open AI Assistant

(00:40:14) Sponsors: Squad | Omneky

(00:41:59) Dogfooding

(00:48:58) AI Studio

(00:52:28) Native Multimodal

(00:55:57) VideoFX

(01:01:09) Competition

(01:04:07) What to do with AGI

(01:09:19) Closing

Tune in to today's special episode airing a recent panel with the founders of Scale AI, Anthropic, and AI Fund who gathered in Washington DC to discuss China as an adversary. They argue that the papers out of Tsinghua University are just as impressive as those coming out of American universities. China is just as creative, but maybe even more motivated. While discussions of regulations have encompassed certain restraints, Alex Wang, Andrew Ng, and Jack Clark argue that we’re not moving fast enough (moderated by US senator Cory Booker).

This session was recorded live at The Hill & Valley Forum in 2024, a private bipartisan community of lawmakers and innovators committed to harnessing the power of technology to address America's most pressing national security challenges. The Hill & Valley podcast is part of the Turpentine podcast network. Learn more: www.turpentine.co

🔥 Apply to join over 400 founders and Execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST - The Riff with Byrne Hobart

Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.

Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt

Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

CHAPTERS:

(00:00) Intro

(03:29) Assembling the founders of Anthropic, Scale AI, and AI Fund

(04:45) Predictions for AGI

(08:21) Navigating AI innovation amidst regulation

(16:15) Global AI competition and the urgency of Innovation

(24:34) Empowering future generations

Tune in to this special episode of the Cognitive Revolution for AI scouting report. We cover the state of the art in AI applications for medicine, key AI concepts, and how these technologies could influence society.

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

RECOMMENDED PODCAST - The Riff with Byrne Hobart

Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.

Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt

Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

CHAPTERS:

(00:00:00) Introduction

(00:06:13) Current State of the Art

(00:08:34) Medicine

(00:13:49) AI limitations

(00:17:01) AI capabilities

(00:17:02) Sponsors: Oracle | Brave

(00:19:09) How AI works

(00:24:05) Information processing

(00:28:51) Curated data sets

(00:32:52) Sponsors: Squad | Omneky

(00:34:38) Transformer

(00:37:11) Scaling

(00:39:59) Emergence

(00:44:03) Grokking

(00:50:30) Best practices for business

(00:53:38) Live Players

(00:58:33) What to Watch

(01:00:35) Final Thoughts

In this groundbreaking episode of the Cognitive Revolution, we explore the intersection of AI and biology with expert Amelie Schreiber. Learn about the advances in drug design, protein network engineering, and the unfolding AI revolution in scientific discovery. Discover the implications for human health, longevity, and the future of biological research. Join us as we delve into an exciting conversation that may redefine our understanding of biology and medicine.

Further links :

Follow Amelie here : https://x.com/amelie_iska, https://huggingface.co/AmelieSchreiber

Read Amelie's blog here : https://huggingface.co/blog/AmelieSchreiber/protein-optimization-and-design

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

CHAPTERS:

(00:00:00) Introduction

(00:04:53) Introduction to Amelie Schreiber and the Podcast

(00:08:59) Understanding Protein Interactions

(00:11:45) Traditional Methods vs. AI Approaches

(00:13:51) Molecular Dynamics and AI Models

(00:18:02) AlphaFold and Protein Structure Prediction

(00:18:43) Sponsors: Oracle | Brave

(00:20:51) Protein Dynamics and New AI Models

(00:32:36) Sponsors: Squad | Omneky

(00:34:22) Challenges in Protein Interaction Models

(00:44:44) Generalization and Data Splitting in AI Models

(00:48:43) Advanced AI Models for Protein Complexes

(00:52:25) Practical Applications of AI in Biochemistry

(01:01:53) Designing Protein Sequences with Ligand and PNN

(01:05:19) Binder Design and Fold Conditioning

(01:08:48) Challenges and Bottlenecks in Drug Discovery

(01:16:09) Adoption and Accessibility of New Technologies

(01:21:04) Future Prospects and Ethical Considerations

(01:37:08) The Role of AI Agents in Biological Research

(01:40:18) Balancing Innovation and Safety in Biotechnology

Tune in as we explore the remarkable traits of Anthropic's Claude AI with Developer Relations Lead Alex Albert. Delve into the ethical considerations, responsible development standards, and the exceptional capabilities that set Claude apart. Gather insights on the AI industry's race to the top and find out about Anthropic's upcoming releases. Whether you're an AI enthusiast or a tech-savvy developer, this podcast offers a thought-provoking discussion on the future of ethical AI.

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

CHAPTERS:

(00:00:00) Introduction

(00:06:15) Opus 3