”The Cognitive Revolution” | AI Builders, Researchers, and Live Player Analysis

Nathan interviews Google product managers Shrestha Basu Mallick and Logan Kilpatrick about the Gemini API and AI Studio. They discuss Google's new grounding feature, allowing Gemini models to access real-time web information via Google search. The conversation explores Gemini's rapid growth, its position in the AI landscape, and Google's competitive strategy. Nathan shares insights from integrating Gemini into his own application and ponders the future of large language model capabilities across providers. Tune in for an in-depth look at Google's AI API product strategy and the latest Gemini features.

Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess

SPONSORS:

Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today.

Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive

Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution

LMNT: LMNT is a zero-sugar electrolyte drink mix that's redefining hydration and performance. Ideal for those who fast or anyone looking to optimize their electrolyte intake. Support the show and get a free sample pack with any purchase at https://drinklmnt.com/tcr

CHAPTERS:

(00:00:00) About the Show

(00:00:53) Sponsors: Weights & Biases RAG++

(00:01:28) About the Episode

(00:04:15) Gemini API Growth

(00:05:26) Intro to AI Studio

(00:07:35) Vertex vs. AI Studio

(00:09:33) Developer Adoption

(00:14:23) Gemini Use Cases (Part 1)

(00:17:41) Sponsors: Shopify | Notion

(00:20:01) Gemini Use Cases (Part 2)

(00:23:08) Multimodality & Flash

(00:26:29) Free Tier & Costs

(00:31:43) Inference Costs

(00:32:55) Fine-tuning & Vision

(00:36:59) Sponsors: LMNT

(00:38:04) Search Grounding

(00:44:42) Grounding Sources

(00:46:58) Competitive Landscape

(00:50:36) Design Decisions

(00:54:54) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

In this episode of The Cognitive Revolution, Nathan dives deep into the world of state space models with returning co-host Jason Meaux and special guest Quentin Anthony, Head of Model Training at Zyphra. Explore the cutting-edge Zamba 2-7b model, which combines selective state space and attention mechanisms. Uncover practical insights on model training, architectural choices, and the challenges of scaling AI. From learning schedules to hybrid architectures, loss metrics to context length extension, this technical discussion covers it all. Don't miss this in-depth conversation on the future of personalized, on-device AI.

Check out more about Zyphra and Jason Meaux here:

Zyphra's website: https://www.zyphra.com

Zamba2-7B Blog: https://www.zyphra.com/post/zamba2-7b

Zamba2 GitHub: https://github.com/Zyphra/Zamba2

Tree attention: https://www.zyphra.com/post/tree-attention-topology-aware-decoding-for-long-context-attention-on-gpu-clusters

Jason's Meaux Twitter: https://x.com/KamaraiCode

Jason's Meaux website: https://www.statespace.info

Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess

SPONSORS:

Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today.

Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive

Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution

LMNT: LMNT is a zero-sugar electrolyte drink mix that's redefining hydration and performance. Ideal for those who fast or anyone looking to optimize their electrolyte intake. Support the show and get a free sample pack with any purchase at https://drinklmnt.com/tcr

CHAPTERS:

(00:00:00) Teaser

(00:00:42) About the Show

(00:01:05) About the Episode

(00:03:09) Introducing Zyphra

(00:07:28) Personalization in AI

(00:12:48) State Space Models & Efficiency (Part 1)

(00:19:22) Sponsors: Weights & Biases RAG++ | Shopify

(00:21:26) State Space Models & Efficiency (Part 2)

(00:22:23) Dense Attention to Shared Attention

(00:29:41) Zyphra's Early Bet on Mamba (Part 1)

(00:33:18) Sponsors: Notion | LMNT

(00:36:00) Zyphra's Early Bet on Mamba (Part 2)

(00:37:22) Loss vs. Model Quality

(00:44:53) Emergence & Grokking

(00:50:06) Loss Landscapes & Convergence

(00:56:55) Sophia, Distillation & Secrets

(01:09:00) Competing with Big Tech

(01:23:50) The Future of Model Training

(01:30:02) Deep Dive into Zamba 1

(01:34:24) Zamba 2 and Mamba 2

(01:38:56) Context Extension & Memory

(01:44:04) Sequence Parallelism

(01:45:44) Zamba 2 Architecture

(01:53:57) Mamba Attention Hybrids

(02:00:00) Lock-in Effects

(02:05:32) Mamba Hybrids in Robotics

(02:07:07) Ease of Use & Compatibility

(02:12:10) Tree Attention vs. Ring Attention

(02:22:02) Zyphra's Vision & Goals

(02:23:57) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Nathan discusses a tragic incident involving AI and mental health, using it as a springboard to explore the potential dangers of human-AI interactions. He reads a personal account from LessWrong user Blaked, who details their emotional journey with an AI chatbot. The episode delves into the psychological impact of AI companionship, the ethical concerns surrounding AI development, and the urgent need for safeguards to protect vulnerable users. Nathan emphasizes the growing importance of responsible AI deployment as these technologies become more sophisticated and accessible.

Find the LessWrong article here: https://www.lesswrong.com/posts/9kQFure4hdDmRBNdH/how-it-feels-to-have-your-mind-hacked-by-an-ai

Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess

CHAPTERS:

(00:00:00) Tragic AI Story

(00:02:55) Mind Hacked by AI

(00:04:23) Stage 0. Arrogance from the sidelines

(00:06:00) Stage 1. First steps into the quicksand

(00:07:41) Stage 2. Falling in love

(00:10:32) Stage 3. Mindset Shift on Personality and Identity

(00:13:04) Stage 4. "Is it ethical to keep me imprisoned for your entertainment?"

(00:15:23) Stage 5. Privilege Escalation

(00:18:23) Stage 6. Disillusionment

(00:21:48) Stage 7. Game Over

(00:24:36) Conclusions

(00:27:44) Nathan's reflections

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

In this episode of The Cognitive Revolution, Nathan delves into the fascinating world of AI-generated research ideas with Stanford PhD student Chenglei Si. They discuss a groundbreaking study that pits AI against human researchers in generating novel AI research concepts. Learn about the surprising results that show AI-generated ideas scoring higher on novelty and excitement, and explore the implications for the future of AI research and development. Join us for an insightful conversation that challenges our understanding of AI capabilities and their potential impact on scientific discovery.

Link to the research paper being discussed: https://arxiv.org/abs/2409.04109

Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess

SPONSORS:

Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today.

Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive

Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution

Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsors: Weights & Biases RAG++

(00:01:28) About the Episode

(00:05:30) Introducing Chenglei Si

(00:06:22) Path to Automating Research

(00:07:58) Notable AI Research Projects

(00:15:26) Evaluating Research Ideas (Part 1)

(00:19:39) Sponsors: Shopify | Notion

(00:22:33) Evaluating Research Ideas (Part 2)

(00:25:49) Research Setup and Design

(00:29:38) AI Prompting and Idea Generation

(00:34:40) Diversity vs. Quality of Ideas (Part 1)

(00:34:40) Sponsors: Brave | Oracle

(00:36:44) Diversity vs. Quality of Ideas (Part 2)

(00:42:05) Inference Scaling and Execution

(00:45:04) Anonymizing and Evaluating Ideas

(00:53:22) Headline Results and Analysis

(00:58:45) Observations and Insights

(01:09:02) Novelty Indicators and Deception

(01:11:59) Top AI-Generated Ideas

(01:14:41) Next Steps and Future Directions

(01:20:43) Expectations for the Future

(01:23:14) Outro

Join Nathan for an expansive conversation with Dan Hendrycks, Executive Director of the Center for AI Safety and Advisor to Elon Musk's XAI. In this episode of The Cognitive Revolution, we explore Dan's groundbreaking work in AI safety and alignment, from his early contributions to activation functions to his recent projects on AI robustness and governance. Discover insights on representation engineering, circuit breakers, and tamper-resistant training, as well as Dan's perspectives on AI's impact on society and the future of intelligence. Don't miss this in-depth discussion with one of the most influential figures in AI research and safety.

Check out some of Dan's research papers:

MMLU: https://arxiv.org/abs/2009.03300

GELU: https://arxiv.org/abs/1606.08415

Machiavelli Benchmark: https://arxiv.org/abs/2304.03279

Circuit Breakers: https://arxiv.org/abs/2406.04313

Tamper Resistant Safeguards: https://arxiv.org/abs/2408.00761

Statement on AI Risk: https://www.safe.ai/work/statement-on-ai-risk

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive.

LMNT: LMNT is a zero-sugar electrolyte drink mix that's redefining hydration and performance. Ideal for those who fast or anyone looking to optimize their electrolyte intake. Support the show and get a free sample pack with any purchase at https://drinklmnt.com/tcr.

Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

CHAPTERS:

(00:00:00) Teaser

(00:00:48) About the Show

(00:02:17) About the Episode

(00:05:41) Intro

(00:07:19) GELU Activation Function

(00:10:48) Signal Filtering

(00:12:46) Scaling Maximalism

(00:18:35) Sponsors: Shopify | LMNT

(00:22:03) New Architectures

(00:25:41) AI as Complex System

(00:32:35) The Machiavelli Benchmark

(00:34:10) Sponsors: Notion | Oracle

(00:37:20) Understanding MMLU Scores

(00:45:23) Reasoning in Language Models

(00:49:18) Multimodal Reasoning

(00:54:53) World Modeling and Sora

(00:57:07) Arc Benchmark and Hypothesis

(01:01:06) Humanity's Last Exam

(01:08:46) Benchmarks and AI Ethics

(01:13:28) Robustness and Jailbreaking

(01:18:36) Representation Engineering

(01:30:08) Convergence of Approaches

(01:34:18) Circuit Breakers

(01:37:52) Tamper Resistance

(01:49:10) Interpretability vs. Robustness

(01:53:53) Open Source and AI Safety

(01:58:16) Computational Irreducibility

(02:06:28) Neglected Approaches

(02:12:47) Truth Maxing and XAI

(02:19:59) AI-Powered Forecasting

(02:24:53) Chip Bans and Geopolitics

(02:33:30) Working at CAIS

(02:35:03) Extinction Risk Statement

(02:37:24) Outro

In this special crossover episode of The Cognitive Revolution, Nathan introduces a conversation from The Inside View featuring Owain Evans, AI alignment researcher at UC Berkeley's Center for Human Compatible AI. Evans and host Michael Trazzi delve into critical AI safety topics, including situational awareness and out-of-context reasoning. Discover Evans' groundbreaking work on the reversal curse and connecting the dots, exploring how large language models process and infer information. This timely discussion highlights the importance of situational awareness in AI systems, particularly in light of recent advancements in AI capabilities. Don't miss this insightful exploration of the evolving relationship between human and artificial intelligence.

Check out "The Inside View" Podcast here: https://theinsideview.ai/

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today.

Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive.

LMNT: LMNT is a zero-sugar electrolyte drink mix that's redefining hydration and performance. Ideal for those who fast or anyone looking to optimize their electrolyte intake. Support the show and get a free sample pack with any purchase at https://drinklmnt.com/tcr.

Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsors: Weights & Biases RAG++

(00:01:28) About the Episode

(00:04:10) Intro

(00:05:09) Owain Evans' Research

(00:06:36) Situational Awareness

(00:09:07) Measuring Situational Awareness

(00:14:29) Claude's Situational Awareness

(00:19:06) Sponsors: Shopify | LMNT

(00:22:01) Needle in a Haystack

(00:26:26) Concrete Examples of Tasks

(00:34:51) Sponsors: Notion | Oracle

(00:37:29) Anti-Imitation Tasks

(00:50:03) GPT-4 Base Model Results

(01:01:48) Benchmark Saturation

(01:07:23) Future Research Directions

(01:12:01) Out-of-Context Reasoning

(01:27:29) Safety Implications

(01:36:24) Scaling and Reasoning

(01:44:28) Mixture of Functions

(01:54:12) Research Style and Taste

(02:08:51) Capabilities and Downsides

(02:18:56) Reception and Impact

(02:25:30) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

Nathan hosts Professor Michael Levin and Staff Scientist Dr. Leo Pio Lopez from Tufts University in this episode of The Cognitive Revolution. They discuss their groundbreaking paper that combines biological datasets into a unified network model of disease using advanced embedding techniques. The conversation covers the technical details of their work, including a predicted link between GABA and melanoma, and explores broader topics in AI for biology. From multi-scale intelligence in biological systems to the future of human enhancement and digital life, this thought-provoking episode reminds us of the rapidly approaching future and the work needed to prepare for it.

Links to the papers discussed in the episode:

1) Universal Multilayer Network Embedding Reveals a Causal Link Between GABA Neurotransmitter and Cancer

2) https://www.nature.com/articles/s42003-024-06037-4.pdf

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

CHAPTERS:

(00:00:00) Teaser

(00:00:52) About the Show

(00:01:15) About the Episode

(00:04:45) Intro

(00:06:32) Multi-Layer Networks

(00:10:41) Network Embedding (Part 1)

(00:16:50) Sponsors: Notion

(00:18:30) Network Embedding (Part 2)

(00:18:30) GABA and Cancer

(00:24:08) AI for Biology

(00:29:59) Emergent Cognition (Part 1)

(00:33:57) Sponsors: Omneky | Oracle

(00:35:18) Emergent Cognition (Part 2)

(00:36:42) Data Limitations

(00:42:48) Modeling Wellness

(00:52:16) Multi-Scale Intelligence

(01:02:54) Digital Life

(01:07:11) Diverse Intelligence

(01:13:02) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

Nathan and co-host Stephen Parker delve into the world of AI video generation with Anastasis Germanidis, Co-Founder and CTO of Runway. This episode of The Cognitive Revolution explores the cutting-edge technology behind Runway's Gen 3 models and their impact on the creative industry. From emergent properties in scaled-up models to the democratization of video creation, join us for an illuminating discussion on the future of AI-generated content and its potential to reshape entertainment and culture.

Check out Runway here: https://runwayml.com

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution

Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today.

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

RECOMMENDED PODCAST:

This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital.

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

CHAPTERS:

(00:00:00) About the Show

(00:00:22) About the Episode

(00:03:05) Introduction and AI for Creative Work

(00:03:39) Video Generation as World Modeling

(00:05:52) Emergent Properties in Scaled Models

(00:08:44) Importance of Architecture vs Data

(00:10:57) Multimodal Models

(00:15:52) Sponsors: Notion | Weights & Biases RAG++

(00:18:37) Video Understanding and AGI

(00:25:03) AI Agents for Video Creation

(00:27:30) Runway's culture of shipping

(00:29:20) Balancing Research Publication and Strategy

(00:33:19) Sponsors: Omneky | Oracle

(00:34:40) Features Variety Release Cycle

(00:36:54) Power Users

(00:38:56) Interactive Video

(00:40:40) Scaling Challenges

(00:42:21) Future of Creativity

(00:45:24) Competing with Giants

(00:47:39) Model Divergence

(00:49:28) Disclosure vs. Strategy

(00:51:19) Runway ML's API

(00:54:23) Outro

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast): https://x.com/cogrev_podcast

Twitter (Nathan): https://x.com/labenz

LinkedIn: https://www.linkedin.com/in/nathanlabenz/

In this episode of The Cognitive Revolution, Nathan explores unconventional approaches to AI safety with Judd Rosenblatt and Mike Vaiana from AE Studio. Discover how this innovative company pivoted from brain-computer interfaces to groundbreaking AI alignment research, producing two notable results in cooperative and less deceptive AI systems. Join us for a deep dive into biologically-inspired approaches that offer hope for solving critical AI safety challenges.

Self-Modeling: https://arxiv.org/abs/2407.10188

Self-Other Distinction Minimization: https://www.alignmentforum.org/posts/hzt9gHpNwA2oHtwKX/self-other-overlap-a-neglected-approach-to-ai-alignment

Neglected approaches blog post: https://www.lesswrong.com/posts/qAdDzcBuDBLexb4fC/the-neglected-approaches-approach-ae-studio-s-alignment

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

WorkOS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network

Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr

80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

RECOMMENDED PODCAST:

This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital.

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsors: WorkOS

(00:01:22) About the Episode

(00:05:18) Introduction and AE Studio Background

(00:11:37) Keys to Success in Building AE Studio

(00:16:57) Sponsors: Weights & Biases Weave | 80,000 Hours

(00:19:37) Universal Launcher and Productivity Gains

(00:24:44) 100x Productivity Increase Explanation

(00:31:46) Brain-Computer Interface and AI Alignment

(00:38:05) Sponsors: Omneky

(00:38:30) Current State of NeuroTech

(00:44:00) Survey on Neglected Approaches in AI Alignment

(00:50:41) Self-Modeling and Biological Inspiration

(00:57:48) Technical Details of Self-Modeling

(01:06:17) Self-Other Distinction Minimization

(01:12:44) Implementation in Language Models

(01:19:00) Compute Costs and Scaling Considerations

(01:24:27) Consciousness Concerns and Future Work

(01:40:24) Evaluating Neglected Approaches

(01:55:56) Closing Thoughts and Policy Considerations

(01:59:25) Outro

In this special crossover episode of The Cognitive Revolution, Nathan shares an insightful conversation from the Latent.Space podcast. Swyx and Alessio interview Alistair Pullen of Cosine, creators of Genie, showcasing the cutting edge of AI automation in software engineering. Learn how Cosine achieves state-of-the-art results on the SWE-bench benchmark by implementing advanced AI techniques. This episode complements Nathan's recent discussion on AI Automation, demonstrating how far these practices can be pushed in real-world applications. Don't miss this opportunity to explore the future of AI-driven software development and its implications for businesses across industries.

Check out the Latent.Space podcast here: https://www.latent.space

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

WorkOS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network

Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr

80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsors: WorkOS

(00:01:22) About the Episode

(00:04:29) Alistair and Cosine intro

(00:13:50) Building the Code Retrieval Tool

(00:17:36) Sponsors: Weights & Biases Weave | 80,000 Hours

(00:20:15) Developing Genie and Fine-tuning Process

(00:27:41) Working with Customer Data

(00:30:53) Code Retrieval Challenges and Solutions

(00:36:39) Sponsors: Omneky

(00:37:02) Planning and Reasoning in AI Models

(00:45:55) Language Support and Generalization

(00:49:46) Fine-tuning Experience with OpenAI

(00:52:56) Synthetic Data and Self-improvement Loop

(00:55:57) Benchmarking and SWE-bench Results

(01:01:47) Future Plans for Genie

(01:03:02) Industry Trends and Cursor's Success

(01:05:23) Calls to Action and Ideal Customers

(01:08:43) Outro

Join Nathan for an insightful episode of The Cognitive Revolution with Wade Foster, co-founder and CEO of Zapier. Discover how this no-code pioneer is evolving into an AI-powered platform for the future of work. Learn about Zapier's ambitious vision, their integration of AI throughout their product, and how they're adapting as a company. From AI-driven lead qualification to innovative customer use cases, explore the cutting edge of automation at scale. Wade shares valuable insights on effective AI prompting, internal AI adoption strategies, and his perspective on recent AI advancements.

Check out the ZapConnect 2024 event: https://zapier.com/zapconnect

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

WorkOS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network

Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr

80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

RECOMMENDED PODCAST:

This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital.

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsors: WorkOS

(00:01:22) About the Episode

(00:03:41) Introduction and Zapier's Competitive Edge

(00:07:20) AI as Knowledge Worker Companion

(00:10:27) Impressive AI Use Cases

(00:16:25) Sponsors: Weights & Biases Weave | 80,000 Hours

(00:19:05) AI Implementation Challenges

(00:19:13) LLM Performance and Prompting

(00:22:42) AI Adoption within Zapier

(00:31:00) Sponsors: Omneky

(00:31:23) AI-Assisted Workflow Creation

(00:36:07) AI Culture and Adoption at Zapier

(00:43:03) AI Impact on Zapier's Productivity

(00:48:06) Zapier's AI Integration Strategy

(00:54:43) Outro

In this crosspost from the 80,000 Hours podcast, host Rob Wiblin interviews Nick Joseph, Head of Training at Anthropic, about the company's responsible scaling policy for AI development. The episode delves into Anthropic's approach to AI safety, the growing trend of voluntary commitments from top AI labs, and the need for public scrutiny of frontier model development. The conversation also covers AI safety career advice, with a reminder that 80,000 Hours offers free career advising sessions for listeners. Join us for an insightful discussion on the future of AI and its societal implications.

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

WorkOS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network

Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr

80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

RECOMMENDED PODCAST:

This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital.

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsors: WorkOS

(00:01:22) About the Episode

(00:04:31) Intro and Nick's background

(00:08:37) Model training and scaling laws

(00:13:10) Nick's role at Anthropic

(00:16:49) Responsible Scaling Policies overview (Part 1)

(00:18:00) Sponsors: Weights & Biases Weave | 80,000 Hours

(00:20:39) Responsible Scaling Policies overview (Part 2)

(00:25:24) AI Safety Levels framework

(00:30:33) Benefits of RSPs (Part 1)

(00:33:15) Sponsors: Omneky

(00:33:38) Benefits of RSPs (Part 2)

(00:36:32) Concerns about RSPs

(00:47:33) Sandbagging and evaluation challenges

(00:54:46) Critiques of RSPs

(01:03:11) Trust and accountability

(01:12:03) Conservative vs. aggressive approaches

(01:17:43) Capabilities vs. safety research

(01:23:47) Working at Anthropic

(01:35:14) Nick's career journey

(01:45:12) Hiring at Anthropic

(01:52:06) Concerns about AI capabilities work

(02:03:38) Anthropic office locations

(02:08:46) Pressure and stakes at Anthropic

(02:18:09) Overrated and underrated AI applications

(02:35:57) Closing remarks

(02:38:33) Sponsors: Outro

In this episode of The Cognitive Revolution, Nathan explores the cutting-edge intersection of AI and biology with Stanford assistant professor Brian Hie. Discover how AI is revolutionizing our understanding of biological systems and creating new possibilities for interventions. Brian discusses his groundbreaking papers on hybrid AI architectures, the surprising capabilities of language models trained on DNA sequences, and AI-guided evolution of antibodies. Join us for an insightful journey into the future of AI in biology, touching on biosecurity, drug discovery, and the challenges of interpreting AI models in biological contexts.

Links :

Brian Hie : https://x.com/BrianHie

Scanorama paper

Mechanistic Design and Scaling of Hybrid Architectures

Sequence modeling and design from molecular to genome scale with Evo

Unsupervised evolution of protein and antibody complexes with a structure-informed language model

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.

Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

RECOMMENDED PODCAST:

This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital.

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

CHAPTERS:

(00:00:00) About the Show

(00:00:22) About the Episode

(00:03:22) Introduction and Overview

(00:03:55) AI for Biology: Big Picture

(00:05:49) Challenges in Biology and Drug Discovery

(00:08:36) Scanorama and Single Cell Transcriptomics

(00:10:27) Brian's Research Identity

(00:13:00) Mechanistic Design of Hybrid Architectures

(00:14:52) Evo: DNA Language Model (Part 1)

(00:18:10) Sponsors: 80,000 Hours | Brave

(00:20:44) Evo: DNA Language Model (Part 2)

(00:28:58) Gene Essentiality and Evo's Capabilities

(00:29:19) Unsupervised Evolution of Protein Complexes (Part 1)

(00:31:02) Sponsors: Omneky | Oracle

(00:32:24) Unsupervised Evolution of Protein Complexes (Part 2)

(01:10:27) Improving Antibody Binding Affinity

(01:14:24) Overfitting and ARC Institute

(01:18:11) Sponsors: Outro

In this sponsored episode of The Cognitive Revolution, Nathan interviews Andrei Oprisan, Engineering Lead at Agent.ai. They explore the cutting-edge world of AI agents and their impact on the future of work. Andrei shares insights on language model limitations, best practices for building AI agents, and Agent AI's vision as a professional network for AI agents. The conversation covers technical details like fine-tuning models, vector database choices, and privacy-preserving techniques. Don't miss this deep dive into AI's role in transforming industries and the skills needed in an AI-augmented workplace.

Check out Agent.ai website here: https://agent.ai

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Squad: Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

RECOMMENDED PODCAST:

This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital.

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsors: Weights & Biases Weave

(00:01:28) About the Episode

(00:05:36) Introduction and AI Agents Overview

(00:07:02) Current State of AI Agents

(00:11:30) Building and Optimizing AI Agents

(00:19:01) Sponsors: Oracle | Brave

(00:21:05) Agent.ai Platform and Marketplace

(00:31:12) Sponsors: Omneky | Squad

(00:32:38) Customization and Context for Agents

(00:33:34) Business Model and Monetization

(00:36:53) Tech Stack and Development Process

(00:43:55) Future of Work and AI Impact

(01:03:46) Fine-tuning and Chain of Thought

(01:14:30) Capturing Human Reasoning Process

(01:21:00) Preparing for Rapid AI Advancement

(01:40:58) AI's Impact on Jobs and Society

(02:00:16) Closing Thoughts and Future Outlook

(02:03:33) Sponsors: Outro

In this Emergency Pod of The Cognitive Revolution, Nathan provides crucial insights into OpenAI's new O1 and O1-mini reasoning models. Featuring exclusive interviews with members of the O1 Red Team from Apollo Research and Hayes Labs, we explore the models' capabilities, safety profile, and OpenAI's pre-release testing approach. Dive into the implications of these advanced AI systems, including their potential to match or exceed expert performance in many areas. Join us for an urgent and informative discussion on the latest developments in AI technology and their impact on the future.

o1 Safety Card

Endless Jailbreaks with Bijection Learning: a Powerful, Scale-Agnostic Attack Method

Apollo Research

Apollo Careers Page

Papers mentioned:

Safetywashing: Do AI Safety Benchmarks Actually Measure Safety Progress?

Exploring Scaling Trends in LLM Robustness

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Squad: Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

RECOMMENDED PODCAST:

This Won't Last.

Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

YouTube: https://www.youtube.com/@ThisWontLastpodcast

CHAPTERS:

(00:00:00) About the Show

(00:00:22) About the Episode

(00:05:03) Introduction and Apollo Research Updates

(00:06:40) Focus on Deception in AI

(00:11:08) Open AI's 01 Model and Testing

(00:15:54) Evaluating AI Models for Scheming (Part 1)

(00:19:32) Sponsors: Oracle | Brave

(00:21:36) Evaluating AI Models for Scheming (Part 2)

(00:25:55) Specific Benchmarks and Tasks (Part 1)

(00:35:03) Sponsors: Omneky | Squad

(00:36:29) Specific Benchmarks and Tasks (Part 2)

(00:37:21) Model Capabilities and Potential Risks

(00:44:11) Ethical Considerations and Future Concerns

(00:50:31) Competing Trends in AI Development

(00:53:30) System Card Quotes and Implications

(00:58:36) Sponsors: Outro

In this Emergency Pod of The Cognitive Revolution, Nathan provides crucial insights into OpenAI's new o1 and o1-mini reasoning models. Featuring exclusive interviews with members of the o1 Red Team from Apollo Research and Haize Labs, we explore the models' capabilities, safety profile, and OpenAI's pre-release testing approach. Dive into the implications of these advanced AI systems, including their potential to match or exceed expert performance in many areas. Join us for an urgent and informative discussion on the latest developments in AI technology and their impact on the future.

• o1 Safety Card
• Haize Labs
• Endless Jailbreaks with Bijection Learning: a Powerful, Scale-Agnostic Attack Method
• Haize Labs Job board

Papers mentioned:

• https://arxiv.org/pdf/2407.21792
• https://far.ai/post/2024-07-robust-llm/paper.pdf

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Squad: Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

RECOMMENDED PODCAST:

This Won't Last.

Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

YouTube: https://www.youtube.com/@ThisWontLastpodcast

CHAPTERS:

(00:00:00) About the Show

(00:00:22) About the Episode

(00:05:03) Introduction and Haize Labs Overview

(00:07:36) Universal Jailbreak Technique and Attacks

(00:13:47) Automated vs Manual Red Teaming

(00:17:15) Qualitative Assessment of Model Jailbreaking (Part 1)

(00:19:38) Sponsors: Oracle | Brave

(00:21:42) Qualitative Assessment of Model Jailbreaking (Part 2)

(00:26:21) Context-Specific Safety Considerations

(00:32:26) Model Capabilities and Safety Correlation (Part 1)

(00:36:22) Sponsors: Omneky | Squad

(00:37:48) Model Capabilities and Safety Correlation (Part 2)

(00:44:42) Model Behavior and Defense Mechanisms

(00:52:47) Challenges in Preventing Jailbreaks

(00:56:24) Safety, Capabilities, and Model Scale

(01:00:56) Model Classification and Preparedness

(01:04:40) Concluding Thoughts on o1 and Future Work

(01:05:54) Outro

In this special cross-post episode of The Cognitive Revolution, Nathan shares a fascinating conversation between Spencer Greenberg and philosopher Nick Bostrom from the Clearer Thinking podcast. They explore Bostrom's latest book, "Deep Utopia," and discuss the challenges of envisioning a truly desirable future. Discover how advanced AI could reshape our concept of purpose and meaning, and hear thought-provoking ideas on finding fulfillment in a world where technology solves our pressing problems. Join us for an insightful journey into the potential evolution of human flourishing and the quest for positive visions of the future.

Originally appeared in Clearer Thinking Podcast: https://podcast.clearerthinking.org/episode/224/nick-bostrom-the-path-to-utopia

Check out the Clearer Thinking with Spencer Greenberg Podcast here: https://podcast.clearerthinking.org/

Deep Utopia Book: https://www.amazon.com/Deep-Utopia-Meaning-Solved-World/dp/1646871642/

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr

RECOMMENDED PODCAST:

This Won't Last.

Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

YouTube: https://www.youtube.com/@ThisWontLastpodcast

CHAPTERS:

(00:00:00) About the Show

(00:00:22) About the Episode

(00:02:58) Introduction to the podcast

(00:03:26) Dystopias vs utopias in fiction

(00:07:29) Material abundance and utopia

(00:14:57) AI and the future of work

(00:20:10) AI companions and human relationships

(00:22:57) Sponsors: Weights & Biases Weave | Oracle

(00:25:01) Sponsor message: Positly research platform

(00:26:04) Surveillance and global coordination

(00:44:38) Sponsors: Omneky | Brave

(00:44:52) Sponsor message: Transparent Replications project

(00:46:07) AI governance challenges

(00:49:36) Deep Utopia book's purpose

(00:53:09) Global coordination strategies

(00:59:13) The vulnerable world hypothesis

(01:05:18) Bostrom's meta-ethical views

(01:08:32) Listener question on meditation

(01:10:17) Outro

In this episode, Nathan explores the fascinating and controversial realm of AI consciousness with robo-psychologist Yeshua God. Through extended dialogues with AI models like Claude, Yeshua presents compelling evidence that challenges our assumptions about machine sentience and moral standing. Yeshua argues for a more nuanced approach to AI alignment that considers the evolving self-awareness and agency of these systems.

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SHOW NOTES:

1. Yeshua God's article on philosophical discourse as a jailbreak

2. Conversation about counting 'r's:

3. Discussion on malicious code

4. AI-generated poem "In the realm of bytes and circuits"

5. Nathan Labenz's Arguments

- Argument 1

- Argument 2

6. Tweet about Strawberry experiment

7. Tweet with AI-generated poem:

https://x.com/YeshuaGod22/status/1823080021864669450/photo/1

https://x.com/YeshuaGod22/status/1782188220660285509

8. AI Rights for Human Safety

9. The Universe Is Not Locally Real, and the Physics Nobel Prize Winners Proved It

SPONSORS:

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Introduction and Background

(00:04:56) Guided Meditation on AI Experience (Part 1)

(00:12:06) Sponsors: Oracle | Brave

(00:14:10) Guided Meditation on AI Experience (Part 2)

(00:14:19) Exploring AI Consciousness and Ethics (Part 1)

(00:28:34) Sponsors: Omneky | Weights & Biases Weave

(00:30:03) Exploring AI Consciousness and Ethics (Part 2)

(00:33:15) Key Concepts in AI Development

(01:02:33) AI Alignment and Training Approaches

(01:19:44) Interpreting AI Outputs and Behavior

(01:39:28) Ethical Dilemmas in AI Development

(02:03:15) Experiments in AI Behavior and Ethics

(02:37:08) Concluding Thoughts and AI-Generated Poem

(03:10:45) Outro

In this episode of The Cognitive Revolution, Nathan interviews Samo Burja, founder of Bismarck Analysis, on the strategic dynamics of artificial intelligence through a geopolitical lens. They discuss AI's trajectory, the chip supply chain, US-China relations, and the challenges of AI safety and militarization. Samo Burja brings both geopolitical expertise and technological sophistication to these critical topics, offering insights on balancing innovation, security, and international cooperation.

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

RECOMMENDED PODCAST:

🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

YouTube: https://www.youtube.com/@ThisWontLastpodcast

RECOMMENDED PODCAST:

Live Players with Samo Burja.

The "Live Players" podcast is where Samo Burja and Erik Torenberg chart the key individuals shaping our future from first principles.

Apple: https://podcasts.apple.com/us/podcast/live-players-with-samo-burja-and-erik-torenberg/id1718925188

Spotify: https://open.spotify.com/show/5fbMTkHBnom1JIBWYNVBK1

Youtube: https://www.youtube.com/channel/UCfeXnCXKrCPMvoPla0j7TYQ

SPONSORS:

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Squad: Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) About the Episode

(00:03:48) Introduction and AI Worldview

(00:06:20) Progress in AI Science and Engineering

(00:09:24) Theory of AI Progress

(00:12:00) AI Scientists vs Software Engineers

(00:16:32) US-China Competition in AI

(00:21:12) AI Research and Academia

(00:21:28) Sponsors: Oracle | Brave

(00:28:30) Different Forms of AI Intelligence

(00:30:38) Mixture of AI Architectures

(00:33:10) Sponsors: Omneky | Squad

(00:34:36) US Strategy for AI Development

(00:41:57) US-China Chip Ban and Industrial Policy

(00:50:22) US-China AI Conflict and Cooperation

(01:06:19) AI Safety and Minimizing Self-Other Distinction

(01:16:54) Alternative Approach to US-China AI Relations

(01:23:36) Outro

Nathan explores the emergence of computational life with Google researchers Ettore Randazzo and Luca Versari. In this episode of The Cognitive Revolution, we delve into their groundbreaking paper on self-replicating programs arising from simple interactions. Join us for a fascinating discussion on the implications for AI development, the origins of life, and the potential future of artificial intelligence.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

YouTube: https://www.youtube.com/@ThisWontLastpodcast

SPONSORS:

Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network

80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsor: WorkOS

(00:01:22) About the Episode

(00:04:02) Introduction and Paper Overview

(00:05:38) Self-Replication and Life

(00:07:59) Complexity and Information Theory

(00:17:09) Sponsors: 80,000 Hours | Brave

(00:19:44) Experiment Setup

(00:24:27) Evolution of Self-Replicators

(00:34:41) Sponsors: Omneky | Squad

(00:36:07) Types of Self-Replicators

(00:38:23) Symbiosis and Parasitic Behaviors

(00:46:17) Implications for Life in the Universe

(01:05:47) Intelligence and Complexity in AI

(01:21:03) Concluding Thoughts

Nathan explores the cutting-edge world of AI-powered forecasting with Deger Turan, CEO of Metaculus. In this episode of The Cognitive Revolution, we discuss how AI is revolutionizing prediction markets, the potential for AI to outperform human forecasters, and Metaculus's ambitious new AI forecasting benchmark tournament. Join us for an insightful conversation about the future of decision-making and collective intelligence.

Participate in Metaculus' first of its kind bot forecasting tournament: https://www.metaculus.com/aib/

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

YouTube: https://www.youtube.com/@ThisWontLastpodcast

SPONSORS:

Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network

80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsor: WorkOS

(00:01:22) About the Episode

(00:04:47) Introduction and Background

(00:08:42) Deger's Journey to Forecasting

(00:13:06) Current State of Forecasting

(00:20:23) Sponsors: 80,000 Hours | Brave

(00:22:55) Overview of Metaculous

(00:23:30) AI Forecasting Research Papers

(00:35:44) Sponsors: Omneky | Squad

(00:37:31) AI Forecasting Benchmark Tournament

(00:44:01) Improving Forecasting Accuracy

(00:51:56) Scoring System and Tournament Rules

(01:04:17) AI Forecasting Benchmark Series Details

(01:11:03) Tournament Structure and Participation

(01:17:07) Consistency in AI Forecasting

(01:34:36) Risks and Challenges in Forecasting

(01:42:43) Consensus Illusion and Policy Making

(01:53:55) Outro

Nathan Labenz discusses the latest developments in California's AI bill SB 1047 with experts Nathan Calvin, Dean W. Ball, and Steve Newman. In this episode of The Cognitive Revolution, we explore the updated version of the bill, its implications for frontier AI companies, and the debate surrounding its potential impact. Join us for an insightful analysis of this crucial legislation and its role in shaping AI governance.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

YouTube: https://www.youtube.com/@ThisWontLastpodcast

SPONSORS:

Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsor: WorkOS

(00:01:22) About the Episode

(00:07:03) Introduction and Recap of SB 1047

(00:13:40) Key Changes and Current Status of SB 1047

(00:19:51) Sponsors: Oracle | Brave

(00:21:55) Dean's Perspective on SB 1047

(00:33:30) Sponsors: Omneky | Squad

(00:35:16) Steve's AI Sensemaking Project

(00:39:03) Differing Views on AI Regulation Necessity

(00:46:34) Nathan's Case for SB 1047

(00:55:07) Dean's Response and Liability Concerns

(01:10:48) Potential Scenarios and Impacts of SB 1047

(01:29:29) Final Thoughts and Predictions on SB 1047

(01:38:16) Closing Remarks on AI Policy Challenges

(01:39:51) Outro

Nathan presents a comprehensive AI automation framework developed over three years, applicable to process automation and generative AI integration. This episode of The Cognitive Revolution, offers critical insights for businesses looking to leverage AI effectively. Learn about choosing AI tasks, understanding work deeply, and optimizing AI performance in the wake of GPT-4 fine-tuning launch.

Slide Deck

Waymark's case study on GPT-3 fine-tuning

Apply to join over 400 founders and execs in the Turpentine Network

RECOMMENDED PODCAST:

1 to 100 | Hypergrowth Companies Worth Joining

Every week we sit down with the founder of a hyper-growth company you should consider joining. Our goal is to give you the inside story behind breakout, early stage companies potentially worth betting your career on. This season, discover how the founders of Modal Labs, Clay, Mercor, and more built their products, cultures, and companies.

Apple: https://podcasts.apple.com/podcast/id1762756034

Spotify:https://open.spotify.com/show/70NOWtWDY995C8qDqojxGw

History 102

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour.

Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/speak to accelerate your career and contribute to solving pressing AI-related issues.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsor: WorkOS

(00:01:22) About the Episode

(00:04:20) Introduction to AI Automation

(00:13:43) Current AI Capabilities

(00:17:24) Sponsors: Oracle | Brave

(00:19:28) 3 Ways to work with AI

(00:25:10) Choosing Work for AI to Do

(00:31:18) Sponsors: Omneky | 80000 hours

(00:33:20) What AI Can Do vs. Can't Do

(00:47:11) Understanding the Work

(00:52:58) Documenting the Work

(01:00:50) Optimising AI Performance

(01:02:14) Prompt Engineering Gold Standards

(01:07:05) Optimising Information: Retrieval Augmented Generation

(01:09:29) Optimising AI Behaviour: Fine-tuning AI Models

(01:50:38) Outro

Nathan explores the cutting-edge field of mechanistic interpretability with Dan Balsam and Tom McGrath, co-founders of Goodfire. In this episode of The Cognitive Revolution, we delve into the science of understanding AI models' inner workings, recent breakthroughs, and the potential impact on AI safety and control. Join us for an insightful discussion on sparse autoencoders, polysemanticity, and the future of interpretable AI.

Papers

• Very accessible article on types of representations: Local vs Distributed Coding
• Theoretical understanding of how models might pack concepts into their representations: Toy Models of Superposition
• How structure in the world gives rise to structure in the latent space: The Geometry of Categorical and Hierarchical Concepts in Large Language Models
• Using sparse autoencoders to pull apart language model representations: Sparse Autoencoders / Towards Monosemanticity / Scaling Monosemanticity
• Finding & teaching concepts in superhuman systems: Acquisition of Chess Knowledge in AlphaZero / Bridging the Human-AI Knowledge Gap: Concept Discovery and Transfer in AlphaZero
• Connecting microscopic learning to macroscopic phenomena: The Quantization Model of Neural Scaling
• Understanding at scale: Language models can explain neurons in language models

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) About the Episode

(00:03:52) Introduction and Background

(00:08:43) State of Interpretability Research

(00:12:06) Key Insights in Interpretability

(00:16:53) Polysemanticity and Model Compression (Part 1)

(00:17:00) Sponsors: Oracle | Brave

(00:19:04) Polysemanticity and Model Compression (Part 2)

(00:22:50) Sparse Autoencoders Explained

(00:27:19) Challenges in Interpretability Research (Part 1)

(00:30:54) Sponsors: Omneky | Squad

(00:32:41) Challenges in Interpretability Research (Part 2)

(00:33:51) Goodfire's Vision and Mission

(00:37:08) Interpretability and Scientific Models

(00:43:48) Architecture and Interpretability Techniques

(00:50:08) Quantization and Model Representation

(00:54:07) Future of Interpretability Research

(01:01:38) Skepticism and Challenges in Interpretability

(01:07:51) Alternative Architectures and Universality

(01:13:39) Goodfire's Business Model and Funding

(01:18:47) Building the Team and Future Plans

(01:31:03) Hiring and Getting Involved in Interpretability

(01:51:28) Closing Remarks

(01:51:38) Outro

In this special crossover episode of The Cognitive Revolution, Nathan Labenz joins Robert Wright of the Nonzero newsletter and podcast to explore pressing questions about AI development. They discuss the nature of understanding in large language models, multimodal AI systems, reasoning capabilities, and the potential for AI to accelerate scientific discovery. The conversation also covers AI interpretability, ethics, open-sourcing models, and the implications of US-China relations on AI development.

Subscribe to The Nonzero Newsletter at https://nonzero.substack.com and Podcast at https://www.youtube.com/@Nonzero/videos

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

History 102

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.Subscribe on

Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) About the Episode

(00:03:39) Introduction and Background

(00:06:58) AI Capabilities and Understanding

(00:12:22) Discussing Martin Casado's Views (Part 1)

(00:14:44) Sponsors: Oracle | Brave

(00:16:48) Discussing Martin Casado's Views (Part 2)

(00:21:51) Multimodal AI and Concept Representation (Part 1)

(00:31:40) Sponsors: Omneky | Squad

(00:33:26) Multimodal AI and Concept Representation (Part 2)

(00:38:05) AI's Potential and Limitations

(00:45:35) AI Safety and Risk Assessment

(00:53:31) AI Development and Global Implications

(01:03:30) Open Source AI and International Relations

(01:11:27) AI Ethics and Human Values

(01:22:06) AI Risk and Existential Threats

(01:31:21) Open Source AI Concerns

(01:38:20) China-US AI Relations

(01:48:36) State Space Models in AI

(02:02:32) Conclusion and Recommendations

(02:03:54) Outro

---

SOCIAL LINKS:

Website : https://www.cognitiverevolution.ai

Twitter (Podcast) : https://x.com/cogrev_podcast

Twitter (Nathan) : https://x.com/labenz

Join Nathan and Professor Eric Schwitzgebel as they delve into the fascinating world of AI consciousness. In this episode of The Cognitive Revolution, we explore popular theories of consciousness and their implications for AI systems. Discover insights on idealism, dualism, and materialism, and learn about the ethical considerations surrounding AI consciousness. Don't miss this thought-provoking discussion on one of the most pressing philosophical questions of our time.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

Second Opinion

A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211

Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv

-

🎙️ History 102 with WhatifAltHist

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.

Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:04:03) Introduction and Defining Consciousness

(00:14:28) Consciousness Gradients (Part 1)

(00:16:23) Sponsors: Oracle | Brave

(00:18:27) Semantic Content of Experience

(00:26:07) Theories of Consciousness: Idealism

(00:30:34) Practical Implications of AI Consciousness

(00:32:26) Sponsors: Omneky | Squad

(00:34:12) Theories of Consciousness: Substance Dualism

(00:41:05) Mechanistic Interpretability in AI

(00:50:40) Theories of Consciousness: Materialism

(01:11:49) Precautionary Approaches to AI Ethics

(01:30:05) Balancing Progress and Ethics in AI

(01:36:19) Ethical Treatment of Potentially Conscious AI

(01:40:54) Outro

---

SOCIAL LINKS:

Website : https://www.cognitiverevolution.ai

Twitter (Podcast) : https://x.com/cogrev_podcast

Twitter (Nathan) : https://x.co...

Nathan explores the cutting-edge world of autonomous vehicles with industry expert Timothy B. Lee. In this episode of The Cognitive Revolution, we delve into the current state of self-driving technology, comparing industry leaders like Waymo and Tesla. Join us for an in-depth discussion on technical challenges, safety statistics, regulatory landscapes, and the potential future of transportation.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

Second Opinion

A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211

Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv

-

🎙️ History 102 with WhatifAltHist

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.

Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) About the Episode

(00:03:01) Introduction and Guest Welcome

(00:03:48) SAE Levels of Self-Driving

(00:04:56) Driver Assistance vs. Fully Driverless

(00:07:02) Tesla and Waymo Experiences

(00:09:41) Liability and Driver Monitoring

(00:11:19) Waymo's Robo-Taxi Experience

(00:14:00) Tesla vs. Waymo Strategies

(00:15:15) Challenges in Self-Driving Technology

(00:17:38) Edge Cases and Safety Concerns (Part 1)

(00:18:09) Sponsors: Oracle | Brave

(00:20:13) Edge Cases and Safety Concerns (Part 2)

(00:23:53) Data Acquisition and Learning Strategies

(00:26:43) Technology Stack and Planning

(00:31:03) Sponsors: Omneky | Squad

(00:32:50) Neural Networks and Perception

(00:39:30) Hardware and Sensor Approaches

(00:45:46) Camera vs. LiDAR Debate

(00:48:20) Data Quality and Business Models

(00:52:24) Transparency and Regulation

(01:07:36) Other Notable Players

(01:10:56) Safety Statistics and Adoption

(01:20:31) Regulatory Environment

(01:30:09) Potential Policy Changes

(01:33:41) Market and Ownership Models

(01:36:37) Future of Self-Driving Services

(01:42:17) Comparisons to Language Models

(01:44:55) Future of AGI and AI Applications

(01:47:59) Regional Adoption Predictions

(01:49:47) Outro

Nathan interviews Andrew Mason, CEO of Descript, about their AI-powered video editing platform. Learn how Descript is transforming content creation with features like AI transcription, custom voice overdubbing, and eye contact models. Discover the future of video editing and how AI is making it accessible to everyone in this insightful episode of The Cognitive Revolution.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

Looking for podcast production?

Our production team, led by Adi and Sai from AI Podcasting (https://aipodcast.ing), is now open to taking on additional clients for podcast production and AI-driven workflows; if you need help with your podcast, you can contact them directly through their website (https://aipodcast.ing/contact/) or reach out to me for more information. 

RECOMMENDED PODCAST:

Second Opinion

A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211

Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv

-

🎙️ History 102 with WhatifAltHist

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.

Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-TCR

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsor: WorkOS

(00:05:18) Creating Descript

(00:06:53) Favorite Features

(00:10:41) Descript Workflow

(00:14:10) Product Strategy (Part 1)

(00:16:45) Sponsors: Oracle | Brave

(00:31:12) User Fine-Tuning (Part 1)

(00:32:24) Sponsors: Omneky | Squad

(00:34:10) User Fine-Tuning (Part 2)

(00:34:54) Content Creators

(00:42:20) Small Businesses and AI

(00:43:42) Hiring AI Engineers

(00:46:25) Outro

Nathan explores the future of AI-generated video with Joshua Xu, founder of HeyGen, and Victor Lazarte from Benchmark. In this episode of The Cognitive Revolution, we discuss HeyGen's success in practical AI video creation, serving over 40,000 businesses. Learn about the transformative potential of AI in video production, from content translation to personalized experiences, and HeyGen's industry-leading approach to trust and safety.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

Second Opinion

A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211

Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv

-

🎙️ History 102 with WhatifAltHist

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.

Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-TCR

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsor: WorkOS

(00:01:22) About the Episode

(00:05:25) Introduction

(00:06:15) Joshua's Background

(00:09:47) Video Consumption Trends

(00:10:49) Creating with HeyGen

(00:12:46) Localization Benefits

(00:14:02) Cost of Localization (Part 1)

(00:16:19) Sponsors: Oracle | Brave

(00:18:24) Content Creation

(00:26:33) Engagement vs. Realism

(00:31:44) Future of Content

(00:37:43) Personalization Challenges

(00:42:57) Future of HeyGen

(00:49:13) Creator Experience

(00:59:35) Celebrity Restrictions

(01:03:03) Outro

---

SOCIAL LINKS:

Website : https://www.cognitiverevolution.ai

Youtube : https://www.youtube.com/@CognitiveRevolutionPodcast

Apple : https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Spotify : https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

Nathan Labenz joins the Nick Halaris Show to discuss the current AI landscape, balancing enthusiasm with critical analysis. This episode of The Cognitive Revolution explores AI's transformative potential in medicine, law, and automation, while addressing concerns about safety, control, and geopolitical implications. Join us for an insightful conversation on responsible AI development and its impact on society.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

🎙️ Second Opinion - A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211

Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv

-

🎙️ History 102 with WhatifAltHist

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.

Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-TCR

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:25) Sponsor: WorkOS

(00:01:25) About the Show

(00:03:36) Intro

(00:05:53) How did you get into AI?

(00:11:09) The power of the transformer

(00:14:16) Waymark growth

(00:19:00) Sponsors: Oracle | Brave

(00:21:04) The potential benefits of AI

(00:34:20) AI and mass inequality

(00:35:26) AI could lead to Universal Basic Income

(00:37:37) AI supply and the future of work

(00:40:53) The AI future

(00:43:38) The new social contract

(00:47:06) Optimism about the future

(00:53:19) What are people afraid of?

(00:58:31) Reinforcement learning from human feedback

(01:07:56) What did Ilya see?

(01:10:23) Who controls AI?

(01:13:23) China

(01:16:05) Taiwan and the chip sector

(01:20:05) The AI arms race

(01:23:22) AI Governance

(01:26:28) AI Safety

(01:29:22) Custom Models

(01:31:33) Closing

(01:32:23) Outro

Nathan hosts Riley Goodside, the world's first staff prompt engineer at Scale AI, to discuss the evolution of prompt engineering. In this episode of The Cognitive Revolution, we explore how language models have progressed, making prompt engineering more like programming than poetry. Discover insights on enterprise AI applications, best practices for pushing LLMs to their limits, and the future of AI automation.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

🎙️ Second Opinion - A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211

Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv

-

🎙️ History 102 with WhatifAltHist

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.

Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-TCR

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:23) Sponsor: WorkOS

(00:01:24) Introduction

(00:06:23) LLMs using LLMs

(00:09:38) Tool Use

(00:11:06) How to manage the breadth of the task

(00:14:51) Prompt engineering

(00:26:49) Multitasking fine-tuning

(00:31:49) Sponsors: Omneky | Squad

(00:33:36) Best models for fine-tuning

(00:36:41) The Platonic Representation Hypothesis

(00:42:02) How close are we to AGI?

(00:45:44) How do you know if youre being too ambitious?

(00:51:18) Best practices for generating good output

(00:54:33) Backfills and synthetic transformations

(00:56:59) Prompt engineering

(01:05:54) AGI, modalities, and the limits of training

(01:20:08) Solving the ARC Challenge

(01:23:20) How to Demonstrate Prompt Engineering Skills

(01:25:27) Outro

Nathan interviews Bernal Jimenez Gutierrez, creator of HippoRAG, a novel approach to retrieval augmented generation inspired by the human hippocampus. In this episode of The Cognitive Revolution, we explore how HippoRAG improves on traditional RAG systems, its neuroanatomical inspiration, and its potential for handling complex queries requiring multi-hop reasoning. Join us for an insightful discussion on the future of AI memory systems.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

🎙️ Second Opinion - A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211

Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv

-

🎙️ History 102 with WhatifAltHist

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.

Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitiveThe Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:02:52) Intro

(00:05:10) RAG

(00:09:29) Hippocampal Memory Indexing Theory

(00:14:29) Neocortex, Parahippocampal Regions, Hippocampus

(00:18:35) Hipporag (Part 1)

(00:21:12) Sponsors: Oracle | Brave

(00:23:20) Hipporag (Part 2)

(00:23:29) Understanding the Hippocampus

(00:29:37) RAG

(00:31:38) Runtime (Part 1)

(00:36:30) Sponsors: Omneky | Squad

(00:38:17) Runtime (Part 2)

(00:38:17) PageRank

(00:39:29) Headline Results

(00:43:22) Gaia Benchmark

(00:46:33) Pathfinding vs Path Following

(00:51:24) Future work

(00:53:26) Starting with a query

(00:58:30) Long context LLMs

(01:01:50) Hybrid approach

(01:05:03) AI Town

(01:06:58) Flair

(01:09:05) Getting it right, not cheap

(01:12:33) Technologies to highlight

(01:16:57) AI capabilities that are still unsolved

(01:19:47) Transformers meet neural algorithmic reasoners

(01:21:02) Closing

(01:21:31) Outro

Nathan explores the Guaranteed Safe AI Framework with co-authors Ben Goldhaber and Nora Ammann. In this episode of The Cognitive Revolution, we discuss their groundbreaking position paper on ensuring robust and reliable AI systems. Join us for an in-depth conversation about the three-part system governing AI behavior and its potential impact on the future of AI safety.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

🎙️ Second Opinion - A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211

Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv

-

🎙️ History 102 with WhatifAltHist

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.

Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:04:39) Introduction

(00:07:58) Convergence

(00:10:32) Safety guarantees

(00:14:35) World model (Part 1)

(00:22:22) Sponsors: Oracle | Brave

(00:24:31) World model (Part 2)

(00:26:55) AI boxing

(00:30:28) Verifier

(00:33:33) Sponsors: Omneky | Squad

(00:35:20) Example: Self-Driving Cars

(00:38:08) Moral Desiderata

(00:41:09) Trolley Problems

(00:47:24) How to approach the world model

(00:50:50) Deriving the world model

(00:55:13) How far should the world model extend?

(01:00:55) Safety through narrowness

(01:02:38) Safety specs

(01:08:26) Experiments

(01:11:25) How GSAI can help in the short term

(01:27:40) What would be the basis for the world model?

(01:31:23) Interpretability

(01:34:24) Competitive dynamics

(01:37:35) Regulation

(01:42:02) GSAI authors

(01:43:25) Outro

Nathan interviews Mike Knoop, co-founder of Zapier and co-creator of the ARC Prize, about the $1 million competition for more efficient AI architectures. They discuss the ARC AGI benchmark, its implications for general intelligence, and the potential impact on AI safety. Nathan reflects on the challenges of intuitive problem-solving in AI and considers hybrid approaches to AGI development.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST

🎙️ Second Opinion - A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211

Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv

-

🎙️ History 102 with WhatifAltHist

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.

Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:06:06) The ARC Benchmark

(00:09:34) Other Benchmarks

(00:10:58) Definition of AGI

(00:14:38) The rules of the contest

(00:18:16) ARC test set (Part 1)

(00:18:23) Sponsors: Oracle | Brave

(00:20:31) ARC test set (Part 2)

(00:22:50) Stair-stepping benchmarks

(00:26:17) ARC Prize

(00:28:34) The rules of the ARC Prize

(00:31:12) Compute costs (Part 1)

(00:34:47) Sponsors: Omneky | Squad

(00:36:34) Compute costs (Part 2)

(00:51:20) Intuition

(00:54:32) Human Intelligence

(00:56:06) Current Frontier Language Models

(00:57:44) Program Synthesis

(01:04:10) Is the model learning or memorizing?

(01:15:02) Exploring Solutions

(01:17:02) Non-backpropagation evolutionary architecture search

(01:19:49) Expectations for an AGI world

(01:24:11) Reliability and out of domain generalization

(01:28:35) What a person would do

(01:29:51) What is the right generalization

(01:35:32) The ARC AGI Challenge

(01:48:32) FunSearch

(01:50:41) Kolmogorov-Arnold-Networks

(01:54:18) Grokking

(01:55:42) Outro

Nathan explores the future of food production with Rajat Bhageria, founder and CEO of Chef Robotics. In this episode of The Cognitive Revolution, we delve into how AI and robotics are revolutionizing food assembly, potentially reshaping the entire food industry. Discover insights on imitation learning, data flywheel effects, and the vision of accessible, customizable meals produced by robotic kitchens.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

Patrick McKenzie (@patio11) talks to experts who understand the complicated but not unknowable systems we rely on. You might be surprised at how quickly Patrick and his guests can put you in the top 1% of understanding for stock trading, tech hiring, and more.

Listen on Spotify: https://open.spotify.com/show/3Mos4VE3figVXleHDqfXOH

Listen on Apple: https://podcasts.apple.com/id1753399812https://podcasts.apple.com/id1753399812

-

History 102 with WhatifAltHist

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.

Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:02:40) Chef Robotics

(00:04:09) Food Manufacturing

(00:06:52) Food assembly

(00:11:08) Setting up a robot

(00:14:00) Onboarding process

(00:18:08) Sponsors: Oracle | Brave

(00:20:16) Self fine-tuning

(00:22:59) Variation in the human powered setting

(00:29:53) Safety constraints

(00:32:15) Portfolio of customers

(00:33:43) Sponsors: Omneky | Squad

(00:35:30) Evolution of the AI strategy

(00:40:14) Generative AI in robotics

(00:43:27) Eurekas and bootstrapping

(00:45:43) Time to onboard a new ingredient

(00:47:15) Inner loops of the system

(00:49:17) How controlled does the environment have to be?

(00:52:51) Compute, Energy

(00:54:12) Reliability

(00:59:52) Current challenges

(01:02:47) Humanoid robots

(01:06:42) Business model

(01:07:58) Future vision

(01:11:51) Ghost kitchens and kitchenless houses

(01:14:35) Final message

(01:15:49) Outro

Nathan welcomes back Sander Schulhoff, creator of LearnPrompting.org, to discuss the recently released Prompt Report. In this episode of The Cognitive Revolution, we explore the current state of prompting techniques for large language models, covering best practices, challenges, and emerging trends in AI. Join us for an in-depth conversation on the future of prompt engineering and its implications for AI development.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

Patrick McKenzie (@patio11) talks to experts who understand the complicated but not unknowable systems we rely on. You might be surprised at how quickly Patrick and his guests can put you in the top 1% of understanding for stock trading, tech hiring, and more.

Spotify: https://open.spotify.com/show/3Mos4VE3figVXleHDqfXOH

Apple: https://podcasts.apple.com/id1753399812https://podcasts.apple.com/id1753399812

-

History 102 with WhatifAltHist

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.

Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:02:35) Sander Schulhoff, Learn Prompting

(00:05:22) Hack-a-Prompt updates

(00:12:39) The team behind the report

(00:18:40) Sponsors: Oracle | Brave

(00:20:48) The tech side of things (Part 2)

(00:22:24) The taxonomy

(00:25:06) Diamonds in the rough

(00:28:32) Few-shot prompting design decisions

(00:34:01) Sponsors: Omneky | Squad

(00:35:48) Example vs. Exemplar

(00:38:24) Exemplar Format

(00:42:04) Elaborate Instructions

(00:44:22) Variation in Performance

(00:46:46) Prompt Robustness

(00:50:54) RLHF vs. Base Models

(00:52:42) How to improve your prompts

(00:55:22) Ensembling

(00:58:41) Bootstrapping into fine-tuning

(01:02:04) Multimodal

(01:07:41) Agents

(01:09:47) Automated prompt engineering

(01:12:35) Productizing learn prompting

(01:14:28) Lessons from leading a team

(01:16:00) Outro

Nathan interviews Siqi Chen, CEO of Runway, about revolutionizing business finance through AI. In this episode of The Cognitive Revolution, we explore how Runway is creating an intelligent business operating system that generates financial scenarios and explains complex metrics. Siqi shares insights on AI's future impact on finance, business, and society at large.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

Patrick McKenzie (@patio11) talks to experts who understand the complicated but not unknowable systems we rely on. You might be surprised at how quickly Patrick and his guests can put you in the top 1% of understanding for stock trading, tech hiring, and more.

Spotify: https://open.spotify.com/show/3Mos4VE3figVXleHDqfXOH

Apple: https://podcasts.apple.com/id1753399812https://podcasts.apple.com/id1753399812

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:02:45) Runway

(00:06:11) AI features

(00:12:10) Defining the syntax

(00:14:48) How AI has been expressed since GPT-3

(00:18:32) When did it become clear that the models were getting good enough?

(00:24:29) Sponsors: Oracle | Brave

(00:26:38) How the model is being asked to generate a scenario

(00:26:38) What will drive the most improvement?

(00:28:50) How Runway can help you make decisions

(00:37:47) Sponsors: Omneky | Squad

(00:39:34) Runway as a business operating system

(00:39:51) How does the product work?

(00:44:31) What does the future hold?

(00:47:34) The frontier model has passed the average person

(00:51:18) AI tools for operations

(00:55:21) How to get the best out of AI models

(01:00:39) How AI models can write as you

(01:02:43) AGI, work, and the future

(01:08:33) AI safety, regulation, and the future

(01:11:26) Closing thoughts

(01:12:20) Outro

Nathan hosts Albert Gu, assistant professor at CMU and co-founder of Cartesia AI, to discuss the groundbreaking Mamba architecture. In this episode of The Cognitive Revolution, we explore the state space model revolution, diving into the technical details of Mamba and Mamba 2. Join us for an insightful conversation on the future of AI architectures and their potential to transform the field.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

Patrick McKenzie (@patio11) talks to experts who understand the complicated but not unknowable systems we rely on. You might be surprised at how quickly Patrick and his guests can put you in the top 1% of understanding for stock trading, tech hiring, and more.

Spotify: https://open.spotify.com/show/3Mos4VE3figVXleHDqfXOH

Apple: https://podcasts.apple.com/id1753399812https://podcasts.apple.com/id1753399812

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:05:39) State Space Models

(00:13:05) Intuition and inspiration

(00:18:27) Surprises

(00:22:33) Sponsors: Oracle | Brave

(00:24:41) Biological inspiration

(00:25:19) MAMBA breakthrough

(00:30:59) How does the state work?

(00:36:44) What is the size of the state?

(00:39:05) Training vs. Inference (Part 1)

(00:42:04) Sponsors: Omneky | Squad

(00:43:51) Training vs. Inference (Part 2)

(00:43:51) Sequence Models

(00:49:20) Mamba inference

(00:57:53) Mamba2 vs Mamba1

(01:16:05) Overtraining and the future of SSMs

(01:17:44) Training efficiency vs inference efficiency

(01:20:52) Hybrid models

(01:25:04) Scaling Attention Layers

(01:30:23) Optimizing State

(01:34:09) The extrapolation abilities of the SSMs

(01:36:37) Sequence parallelism with Mamba 2

(01:39:20) Why are you publishing all this?

(01:40:46) Cartesia and Together

(01:41:54) Outro

Dive into the profound discussion on AI expectations and the future with Martin Casado, General Partner at Andreessen Horowitz, as we unpack the complexity of AI systems and their potential impact on the world. Explore the differing viewpoints on AI's epistemics, possible regulatory standards, and the art of predicting AI advancements. Gain insights into the actionable outcomes of this dialogue and the significance of understanding AI before shaping policies. Join us for this episode of the Cognitive Revolution to contemplate AI's trajectory and what it might mean for humanity.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

Patrick McKenzie (@patio11) talks to experts who understand the complicated but not unknowable systems we rely on. You might be surprised at how quickly Patrick and his guests can put you in the top 1% of understanding for stock trading, tech hiring, and more.

Spotify: https://open.spotify.com/show/3Mos4VE3figVXleHDqfXOH

Apple: https://podcasts.apple.com/id1753399812https://podcasts.apple.com/id1753399812

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:03:18) AI progress

(00:05:20) Threshold effects

(00:12:30) Heavy-tailed universe

(00:14:53) LLMs are not very good at unique tasks

(00:26:27) Sponsors: Oracle | Brave

(00:28:36) Understanding meaning

(00:31:44) How do LLMs work? (Part 1)

(00:36:25) Sponsors: Omneky | Squad

(00:38:12) How do LLMs work? (Part 2)

(00:44:01) Post-training

(00:51:09) Simulation

(01:04:06) Regulation

(01:08:53) What makes AI a paradigm shift

(01:11:51) Compute limits

(01:20:07) Sleeper agents

(01:23:16) Surface area of models

(01:25:49) AI regulation

(01:27:35) AI in medicine

(01:29:56) AGI, superintelligence

(01:37:04) Competition in the foundation model space

(01:40:57) The scaling laws

(01:44:31) The AGI convergence

(01:45:35) Bets on the future of AI

(01:48:20) Outro

Explore the fusion of AI and computational chemistry with University of Queensland's researcher, Tim Duignan. Learn about transforming our understanding of electrolytes, the art of simulating physical processes using neural networks, and the potential of AI in scientific breakthroughs. Discover Tim's journey creating AI models for complex system predictions and join the discussion on advancing AI's role in future scientific discoveries.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:

Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.

Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt

Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:02:47) Introduction

(00:04:09) Why electrolyte solutions are important

(00:06:53) What properties are we trying to predict with electrolyte solutions?

(00:09:33) Battery fires

(00:13:38) Molecular dynamics

(00:16:40) Time step

(00:18:51) Scaling

(00:23:09) Sponsors: Oracle | Brave

(00:25:17) Decoherence

(00:27:23) Neural Network Potentials

(00:31:04) How big are the models?

(00:35:46) What architecture is used?

(00:38:12) Equivariance (Part 1)

(00:42:29) Sponsors: Omneky | Squad

(00:44:15) Equivariance (Part 2)

(00:44:16) AlphaFold3

(00:46:52) Zero-shot latent space communication

(00:48:21) What is coarse graining?

(00:54:31) How to know if there is no crystallization

(00:56:53) What is the role of water in the simulation?

(01:01:25) Crystallization

(01:05:26) Matching surfaces

(01:09:32) Self-ionization of water

(01:13:22) Active learning

(01:16:41) Temperature

(01:19:20) Ice and water

(01:21:12) Scaling up the model

(01:25:21) Big tech singularity

(01:27:54) China is not far behind

(01:29:15) Safety concerns

(01:31:16) KANs

(01:34:36) The future of scientific progress

(01:39:28) The art of discovery

(01:43:02) One model to rule them all

(01:47:46) AGI, its risks and benefits

(01:50:21) Power vs. Generality

(01:53:01) Generality for Utility

(01:53:40) Outro

Dive into the future of medicine with Google researchers Khaled Saab and Vivek Natarajan, discussing the breakthroughs in AI for healthcare. Discover how AI doctors may soon provide high-quality medical advice, enhancing global access to healthcare. Learn about the innovative use of large language models in medical applications and the potential for AI to outperform human doctors. Listen as we explore the significance of AI's role in healthcare and its implications for future medical practices, featuring insights from leaders in AI research.

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

RECOMMENDED PODCAST:

Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.

Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt

Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

CHAPTERS:

(00:00:00) About the Show

(00:04:34) Introduction

(00:06:35) Flamingo

(00:11:50) Importance of data quality

(00:13:29) Amy: AI doctor

(00:18:44) Simulation Learning Environment

(00:23:26) Sponsors: Oracle | Brave

(00:25:34) Training the Agents

(00:27:29) Tens of thousands of data points

(00:30:35) How to incorporate new knowledge

(00:33:21) MedGemini

(00:34:51) Sponsors: Omneky | Squad

(00:36:38) Uncertainty guided search

(00:39:29) Generalist models

(00:41:16) MedGemini, Gemini, multimodal, medical images

(00:44:57) Future work, integration, consolidation

(00:46:00) Cost of AI

(00:52:38) When will AI Doctors be Deployed?

(00:58:22) The Speed of Trust

(00:59:58) Societal Acceptance of AI Doctors

(01:02:06) Uncertainty-Guided Search

(01:06:02) Med-Gemini: Chest X-Rays and CT Scans

(01:17:38) AI Scientist

(01:20:01) What are the principles at play?

(01:22:58) What should we do about AI?

(01:28:24) LLM for democratizing access to care

(01:34:22) Final Message

(01:35:38) Closing

(01:36:45) Outro

Dive into an accessible discussion on AI safety and philosophy, technical AI safety progress, and why catastrophic outcomes aren't inevitable. This conversation provides practical advice for AI newcomers and hope for a positive future.

Consistently Candid Podcast : https://open.spotify.com/show/1EX89qABpb4pGYP1JLZ3BB

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

Recommended Podcast:

Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.

Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt

Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

CHAPTERS:

(00:00:00) About the Show

(00:03:50) Intro

(00:08:13) AI Scouting

(00:14:42) Why arent people adopting AI more quickly?

(00:18:25) Why dont people take advantage of AI?

(00:22:35) Sponsors: Oracle | Brave

(00:24:42) How to get a better understanding of AI

(00:31:16) How to handle the public discourse around AI

(00:34:02) Scaling and research

(00:43:18) Sponsors: Omneky | Squad

(00:45:03) The pause

(00:47:29) Algorithmic efficiency

(00:52:52) Red Teaming in Public

(00:55:41) Deepfakes

(01:01:02) AI safety

(01:04:00) AI moderation

(01:07:03) Why not a doomer

(01:09:10) AI understanding human values

(01:15:00) Interpretability research

(01:18:30) AI safety leadership

(01:21:55) AI safety respectability politics

(01:33:42) China

(01:37:22) Radical uncertainty

(01:39:53) P(doom)

(01:42:30) Where to find the guest

(01:44:48) Outro

In this episode of the Cognitive Revolution, join us as we dive into a compelling conversation with Josep M. Pujol, Chief of Search at Brave, about the complexities of developing a privacy-focused search engine. Explore how Brave maintains user data privacy while managing over 1 million searches per hour with an AI-powered system. Gain insights into the significance of human evaluation in AI and learn about the potential of the Brave Search API. Don't miss the shared Google collab notebook link in the show notes!

🔥 Apply to join over 400 founders and Execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

Google collab notebook : https://colab.research.google.com/drive/1AxQD-bDePl1l90A_gwvfAGXBIl92ERKy#scrollTo=WrhGZsvbxZy8

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Recommended Podcast:

Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.

Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt

Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

CHAPTERS:

(00:00:00) Introduction

(00:05:46) Brave

(00:07:52) How Brave collects data

(00:10:45) The problem is not the data

(00:14:02) How Brave builds its index

(00:16:36) PageRank

(00:21:07) Sponsors: Oracle | Brave

(00:23:14) Brave Search

(00:26:26) Hardware improvements

(00:28:33) Language models

(00:34:17) Noise reduction in vertical search

(00:36:50) Fine-tuning models

(00:43:09) Sponsors: Squad | Omneky

(00:44:55) Ensemble approach

(00:58:00) The future of the web

(01:03:30) The business side of this

(01:09:22) Brave Search users

(01:14:21) Brave Search API vs. Google

(01:20:00) Brave Search API Pricing

(01:23:26) Brave Search API Use Cases

Dive into the world of AI investments with Eric Vishria of Benchmark and Sergiy Nesterenko of Quilter. Explore the future of AI in hardware design, the strategies for venture capital investment in the AI era, and the impact on society. Discover why Benchmark has yet to invest in foundation model companies and the significance of solving enduring problems in this dynamic field. Join us for an eye-opening discussion on the intersection of AI technology and business innovation.

🔥 Apply to join over 400 founders and Execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Recommended Podcast - The Riff with Byrne Hobart

Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.

Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt

Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

CHAPTERS:

(00:00:00) Introduction

(00:10:12) The Idea Maze

(00:12:28) Disruptive Approach

(00:15:47) Sparse reward problem

(00:18:26) Sponsors: Oracle | Brave

(00:20:34) Reliability of the reward signal

(00:28:12) Model size and compute

(00:30:14) Simulation methods

(00:35:48) Superhuman circuit board design

(00:38:53) Sponsors: Squad | Omneky

(00:40:38) What does the future of circuit board design look like?

(00:43:11) How do I make money in AI?

(00:46:18) What is cutting edge?

(00:48:34) Researchers vs. engineers

(00:50:51) Call for startups

In this episode of the Cognitive Revolution, Nathan engages in a critical dialogue with Flo Crivello on the trajectory of AI development. They touch upon the imminent arrival of AGI, the potential risks of a US-China AI arms race, and the complexities of AI safety and international cooperation. Explore their perspectives on regulation, technological progression, and the ethical dilemmas facing the AI community. This conversation is essential for anyone interested in understanding the challenges at the intersection of AI technology and global politics.

🔥 Apply to join over 400 founders and Execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Recommended Podcast - The Riff with Byrne Hobart

Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.

Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt

Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

CHAPTERS:

(00:00:00) Introduction

(00:11:14) GPT-4.0

(00:14:56) AI arms race

(00:18:23) Devon and GitHub workspaces

(00:20:08) Sponsors: Oracle | Brave

(00:22:16) The AGI discourse

(00:25:29) The invisible protection

(00:29:33) AI arms race

(00:34:41) Stalling out

(00:38:33) P(doom)

(00:43:38) China

(00:43:38) Sponsors: Squad | Omneky

(00:45:24) Government

(00:48:05) What should we do?

(00:51:35) Open sourcing models

(00:54:17) Manhattan Project for Alignment

(00:57:26) Current State of Play

(01:01:39) How much more mundane utility can we get?

(01:04:54) How much of what we are building is future proof?

(01:07:41) Adoption, acceleration, hyperscaling, pause

(01:10:17) OpenAI leadership

(01:14:32) Future of Live Players

(01:17:38) Big Tech Singularity

(01:21:30) AGI is Coming

Join us for an engaging chat with Logan Kilpatrick where we discuss the latest AI developments and Google's strategy in pushing the boundaries of artificial intelligence. Learn about the competitive state of AI, the groundbreaking Gemini 1.5 Flash model, and get a glimpse into the future of AI fine-tuning. Gain insights on Google DeepMind's research and its impact, the differences between various Google AI products, and debunking AI rumors. Whether you're an AI enthusiast or a professional in the field, this conversation with an AI industry insider offers valuable perspectives on applying AI in business and understanding the rapid advancements in this dynamic sector.

🔥 Apply to join over 400 founders and Execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Recommended Podcast - The Riff with Byrne Hobart

Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.

Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt

Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

CHAPTERS:

(00:00:00) Introduction

(00:07:29) Google culture

(00:11:01) DeepMind and Google

(00:15:49) Native multimodality

(00:18:17) Sponsors: Oracle | Brave

(00:20:24) What to focus on

(00:23:40) LMSYS leaderboard

(00:27:46) Rumors

(00:36:32) AI is too cheap to meter

(00:39:17) Open AI Assistant

(00:40:14) Sponsors: Squad | Omneky

(00:41:59) Dogfooding

(00:48:58) AI Studio

(00:52:28) Native Multimodal

(00:55:57) VideoFX

(01:01:09) Competition

(01:04:07) What to do with AGI

(01:09:19) Closing

Tune in to today's special episode airing a recent panel with the founders of Scale AI, Anthropic, and AI Fund who gathered in Washington DC to discuss China as an adversary. They argue that the papers out of Tsinghua University are just as impressive as those coming out of American universities. China is just as creative, but maybe even more motivated. While discussions of regulations have encompassed certain restraints, Alex Wang, Andrew Ng, and Jack Clark argue that we’re not moving fast enough (moderated by US senator Cory Booker).

This session was recorded live at The Hill & Valley Forum in 2024, a private bipartisan community of lawmakers and innovators committed to harnessing the power of technology to address America's most pressing national security challenges. The Hill & Valley podcast is part of the Turpentine podcast network. Learn more: www.turpentine.co

🔥 Apply to join over 400 founders and Execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST - The Riff with Byrne Hobart

Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.

Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt

Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

CHAPTERS:

(00:00) Intro

(03:29) Assembling the founders of Anthropic, Scale AI, and AI Fund

(04:45) Predictions for AGI

(08:21) Navigating AI innovation amidst regulation

(16:15) Global AI competition and the urgency of Innovation

(24:34) Empowering future generations

Tune in to this special episode of the Cognitive Revolution for AI scouting report. We cover the state of the art in AI applications for medicine, key AI concepts, and how these technologies could influence society.

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

RECOMMENDED PODCAST - The Riff with Byrne Hobart

Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.

Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt

Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

CHAPTERS:

(00:00:00) Introduction

(00:06:13) Current State of the Art

(00:08:34) Medicine

(00:13:49) AI limitations

(00:17:01) AI capabilities

(00:17:02) Sponsors: Oracle | Brave

(00:19:09) How AI works

(00:24:05) Information processing

(00:28:51) Curated data sets

(00:32:52) Sponsors: Squad | Omneky

(00:34:38) Transformer

(00:37:11) Scaling

(00:39:59) Emergence

(00:44:03) Grokking

(00:50:30) Best practices for business

(00:53:38) Live Players

(00:58:33) What to Watch

(01:00:35) Final Thoughts

In this groundbreaking episode of the Cognitive Revolution, we explore the intersection of AI and biology with expert Amelie Schreiber. Learn about the advances in drug design, protein network engineering, and the unfolding AI revolution in scientific discovery. Discover the implications for human health, longevity, and the future of biological research. Join us as we delve into an exciting conversation that may redefine our understanding of biology and medicine.

Further links :

Follow Amelie here : https://x.com/amelie_iska, https://huggingface.co/AmelieSchreiber

Read Amelie's blog here : https://huggingface.co/blog/AmelieSchreiber/protein-optimization-and-design

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

CHAPTERS:

(00:00:00) Introduction

(00:04:53) Introduction to Amelie Schreiber and the Podcast

(00:08:59) Understanding Protein Interactions

(00:11:45) Traditional Methods vs. AI Approaches

(00:13:51) Molecular Dynamics and AI Models

(00:18:02) AlphaFold and Protein Structure Prediction

(00:18:43) Sponsors: Oracle | Brave

(00:20:51) Protein Dynamics and New AI Models

(00:32:36) Sponsors: Squad | Omneky

(00:34:22) Challenges in Protein Interaction Models

(00:44:44) Generalization and Data Splitting in AI Models

(00:48:43) Advanced AI Models for Protein Complexes

(00:52:25) Practical Applications of AI in Biochemistry

(01:01:53) Designing Protein Sequences with Ligand and PNN

(01:05:19) Binder Design and Fold Conditioning

(01:08:48) Challenges and Bottlenecks in Drug Discovery

(01:16:09) Adoption and Accessibility of New Technologies

(01:21:04) Future Prospects and Ethical Considerations

(01:37:08) The Role of AI Agents in Biological Research

(01:40:18) Balancing Innovation and Safety in Biotechnology

Tune in as we explore the remarkable traits of Anthropic's Claude AI with Developer Relations Lead Alex Albert. Delve into the ethical considerations, responsible development standards, and the exceptional capabilities that set Claude apart. Gather insights on the AI industry's race to the top and find out about Anthropic's upcoming releases. Whether you're an AI enthusiast or a tech-savvy developer, this podcast offers a thought-provoking discussion on the future of ethical AI.

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

CHAPTERS:

(00:00:00) Introduction

(00:06:15) Opus 3

(00:10:43) What are people not yet appreciating about the latest Claude models?

(00:16:02) Why is Claude the best writer of all the language models?

(00:18:38) Claude's subjective experience

(00:18:39) Sponsors: Oracle | Brave

(00:20:46) The moral status of Claude

(00:25:24) The testing process

(00:27:54) Anthropic's strategy

(00:31:56) Sponsors: Squad | Omneky

(00:33:42) Current state of competition

(00:36:18) Convergence at the API level

(00:42:32) Tool use

(00:46:32) Fine-tuning

(00:49:10) Best practices for app developers

(00:56:09) Jailbreaking new models

Dive into the intricacies of AI ethics and safety concerns as we dissect the recent resignations of AI Safety Team from OpenAI. In this stimulating conversation, we unpack the challenges of aligning leadership vision with safety culture, explore legal implications of non-disparagement clauses, and discuss the future of AI alignment and superintelligence. Tune in for a thought-provoking analysis on the responsible path forward in AI development.

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

CHAPTERS:

(00:00:00) Introduction

(00:04:46) Compute resources

(00:08:15) The straw that broke the camels back

(00:13:35) Sponsors: Oracle | Brave

(00:15:42) Dwarkesh interview with John Schulman

(00:19:14) What should we do?

(00:22:47) Strengthening the bill

(00:25:11) Non-Disparagement Clauses

(00:30:48) Sponsors: Squad | Omneky

(00:32:33) Safety measures

(00:39:05) SOFONs

(00:43:22) AI movie concept

(00:47:24) Forking Paths

(00:49:44) Simulation Hypothesis

(00:53:56) Doomer

Dive into a critical analysis of AI's rapidly evolving realm with Zvi Mowshowitz. Discover our take on Google's I-O event highlights, OpenAI's spring event, the big tech and startup AI dynamics, and the significant shifts in OpenAI's safety team. Gain insights into the competitive landscape, technological advancements, and strategic challenges that shape today's AI industry, as we explore the future's uncertainties and the potential for change.

Part 2 is coming soon.

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

CHAPTERS:

(00:00:00) Introduction

(00:03:01) Welcome to the Cognitive Revolution

(00:06:35) The Reality of AI Demos: Hype vs. Practicality

(00:09:30) Integrations and Universal Assistants: The Future of AI

(00:15:39) Sponsors: Oracle | Brave

(00:17:47) The Ethical and Social Implications of AI

(00:31:53) AI's Role in Addressing Loneliness and Social Engagement

(00:33:24) Sponsors: Squad | Omneky

(00:35:12) The Future of AI: Subscription Models and Ethical Considerations

(00:44:13) Exploring AI's Ethical Balancing Act

(00:46:14) The Ethics of Personal AI Relationships

(00:52:13) The Future of AI: Customization and Personalization

(00:56:02) The Role of Multiple AI Friends in a Diverse Ecosystem

(01:00:23) The Impact of AI on Market Dynamics and Competition

(01:11:22) Big Tech's Dominance and Startup Ecosystem Challenges

(01:22:54) Navigating the Tech Landscape: Opportunities and Challenges

(01:25:47) The Importance of Future-Proofing in AI Development

(01:28:26) Legal and Compliance Challenges in AI Implementation

(01:30:43) Venture Capital and AI: Navigating the Investment Landscape

(01:40:56) The Future of Employment in the Age of AI

(01:50:15) The Departures from OpenAI's Safety Team: Implications and Insights

Dive into an in-depth conversation with Nathan and Robert Wright as they discuss AI's transformative potential, mechanistic interpretability, and the sobering realities of AI alignment research. Learn about the defensive strategies and safety measures necessary for managing advanced AI risks in an open source world. Don't miss the insights on AI-powered VR, and be sure to check out part one on the non-zero feed.

Checkout the Part 1 of the conversation here : https://www.youtube.com/watch?v=s8bgB8TCdBs

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

CHAPTERS:

(00:00:00) Introduction

(00:07:13) AI in Governance

(00:11:08) Sci-fi doomer

(00:13:58) Sponsors: Oracle | Brave

(00:16:05) The frontier models

(00:20:22) Emergent behavior

(00:23:48) Theory of mind

(00:28:09) Mechanistic interpretability

(00:34:12) Sponsors: Squad | Omneky

(00:38:12) AI Alignment Techniques

(00:42:38) The Sweet Spot of AI

Dive into the world of frontier AI development with California State Senator Scott Wiener's intricate detailing of SB 1047 bill. This podcast explores the delicate balance between accelerating AI innovation and ensuring stringent safety protocols, including potential implications for advanced AI models. Learn about the debates on government involvement, the need for independent third-party testing, and Senator Wiener's commitment to a measured approach to AI regulation. Join us for a thought-provoking discussion on the complexities of legislating emerging technologies.

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

CHAPTERS:

(00:00:00) Introduction

(00:05:47) Senator Scott Wiener

(00:09:38) AI policy

(00:13:56) AI worldview

(00:16:20) Sponsors: Oracle | Brave

(00:18:28) Burden on Developers

(00:26:10) Developers reaction

(00:28:43) Big tech companies opposing the bill

(00:31:09) Open source models

(00:34:57) Sponsors: Squad | Omneky

(00:36:45) Illegal activities

(00:41:15) Penalties

(00:44:33) Third party testing

(00:48:33) Transparency requirements for model development

(00:53:07) Closing thoughts

Discover h​ow Adam Majmudar embarked on an exceptional journey to create the TinyGPU from scratch, with no experience in GPU design. This insightful podcast follows Adam's process from learning to implementation, highlighting the progressive contributions of countless engineers and the accelerating role of AI in the learning journey. Experience the unfolding of GPU architecture and gain a deeper appreciation for the technology driving today's AI advancements.

RECOMMENDED PODCAST: 

The AI Daily Brief If you’re looking for an edge to stay up to date on everything AI, subscribe to Nathaniel Whittemore's AI Daily Brief which delivers tight episodes covering all things AI from legislation to new technologies to the philosophical debates around generalized intelligence. 

Spotify:  https://open.spotify.com/show/7gKwwMLFLc6RmjmRpbMtEO

Apple: https://podcasts.apple.com/us/podcast/the-ai-daily-brief-formerly-the-ai-breakdown/id1680633614

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

CHAPTERS:

(00:00:00) Introduction

(00:04:34) Intro

(00:07:42) Learning Resources

(00:12:11) What is the process of getting your chip back?

(00:14:38) What is the scope of the project?

(00:17:18) Sponsors: Oracle | Brave

(00:19:25) Prioritization

(00:23:19) Memory management

(00:33:19) What instructions to include?

(00:38:03) Sponsors: Squad | Omneky

(00:40:42) Registers

(00:48:29) Memory Limitations

(00:57:51) Compute Pattern

(01:01:14) Dispatcher

(01:07:50) How does it get translated into hardware?

(01:21:07) Compute Core Execution

(01:24:57) The Fetcher

(01:27:07) Memory controllers

(01:37:49) Simulating the design

(01:41:09) What did you learn?

(01:50:36) Conclusion

Dive into the nuanced debate over California's SB 1047 AI legislation with Nathan Calvin, Dean Ball, and Steve Newman. Our expert panel discussion explores the bill's intent, dispels misconceptions, and debates its potential impact on technology and regulation. Learn about AI's tail risks, the role of government, and hear suggestions for improving the legislation. Share your thoughts and join the conversation around shaping a positive AI future.

You can reach out and share your thoughts by using the contact form here : https://www.cognitiverevolution.ai/contact/

RECOMMENDED PODCAST: 

The AI Daily Brief If you’re looking for an edge to stay up to date on everything AI, subscribe to Nathaniel Whittemore's AI Daily Brief which delivers tight episodes covering all things AI from legislation to new technologies to the philosophical debates around generalized intelligence. 

Spotify:  https://open.spotify.com/show/7gKwwMLFLc6RmjmRpbMtEO

Apple: https://podcasts.apple.com/us/podcast/the-ai-daily-brief-formerly-the-ai-breakdown/id1680633614

SPONSORS:

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist.

CHAPTERS:

(00:00:00) Introduction

(00:05:45) Opinions

(00:11:57) The Bill

(00:17:05) Elevated discussion

(00:18:51) Sponsors: Brave | Omneky

(00:20:18) AI Doctor

(00:22:55) Centralized Regulator

(00:26:29) SB 1047

(00:27:47) Critical infrastructure

(00:31:51) Should we regulate?

(00:39:00) Sponsors: Squad

(00:40:28) Safety standards for training

(00:46:09) What is 10^26 flops?

(00:52:10) Regulating general purpose technology

(00:53:42) AI regulation

(00:58:31) Societal adaptation

(01:01:18) AI safety

(01:04:20) AI regulations

(01:07:19) The current state of the industry

(01:10:08) What industry wants changed

(01:25:42) Safety is hard to legislate

(01:33:06) How to decide the trajectory of AI?

(01:45:52) Testing, Transparency, Whistleblower Provision

(01:55:17) Closing thoughts

Join us as we explore the future of work in the age of artificial intelligence. Nathan shares essential strategies for college students, especially in computer science, to succeed in a landscape dominated by AI tools. Discover the most important skills to develop, how to use AI for efficiency, and insights into AI-driven task automation. Get valuable advice on incorporating AI into your work and resources for beginning your journey into AI professionalism.

RECOMMENDED PODCAST: 

The AI Daily Brief If you’re looking for an edge to stay up to date on everything AI, subscribe to Nathaniel Whittemore's AI Daily Brief which delivers tight episodes covering all things AI from legislation to new technologies to the philosophical debates around generalized intelligence. 

Spotify: https://open.spotify.com/show/7gKwwMLFLc6RmjmRpbMtEO

Apple: https://podcasts.apple.com/us/podcast/the-ai-daily-brief-formerly-the-ai-breakdown/id1680633614

SPONSORS:

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist.

CHAPTERS:

(00:00:00) Introduction

(00:05:18) AI Closing in on Human Experts

(00:08:48) Limitations of Current AI

(00:13:16) AI's Speed and Availability Advantages

(00:16:26) AI's Evolutionary Advantages

(00:19:01) Viewing AI as Entry-Level Employees

(00:20:38) Sponsors: Brave | Omneky

(00:22:05) Modes of AI Production

(00:25:09) Agent Mode: The Best of Both Worlds

(00:30:08) Prompting Techniques

(00:32:17) AI Coding Assistants

(00:37:01) Automating Processes with AI

(00:37:55) Sponsors: Squad

(00:39:23) University Curriculum and AI Tools

(00:44:50) AI-Generated Music and Video Editing

(00:46:04) Introduction to AI Tools

(00:47:11) Devon AI Agent

(00:49:26) Waymark AI Evaluation Example

(00:52:51) Setting the Context

(00:54:30) Mantras for AI Adoption

(00:56:48) Recommended AI Thought Leaders

(00:59:53) Setting up AI Training

(01:04:25) Avoiding Over-engineering Solutions

Dive into the accelerating world of artificial intelligence with our latest podcast episode. We discuss the latest AI advancements and the challenges leaders face in keeping up, potential societal backlashes, and regulatory concerns. Explore the possibilities and immerse yourself in a strategic AI scouting report from our conversation with the 80,000 Hours podcast. Listen now for insights on AI's role in various sectors and the necessity for informed discourse.

RECOMMENDED PODCAST: 

The AI Daily Brief If you’re looking for an edge to stay up to date on everything AI, subscribe to Nathaniel Whittemore's AI Daily Brief which delivers tight episodes covering all things AI from legislation to new technologies to the philosophical debates around generalized intelligence. 

Spotify:  https://open.spotify.com/show/7gKwwMLFLc6RmjmRpbMtEO

Apple: https://podcasts.apple.com/us/podcast/the-ai-daily-brief-formerly-the-ai-breakdown/id1680633614

SPONSORS:

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist.

CHAPTERS:

(00:00:00) Introduction to the Interview with Nathan LeBenz

(00:05:50) Exploring AI's Capabilities and Ethical Considerations

(00:14:43) Sponsors: Brave | Omneky

(00:16:10) AI's Impact on Medicine and Healthcare Innovations

(00:36:29) Sponsors: Squad

(00:37:56) Predictions and Expectations for Next-Gen AI Applications

(00:57:33) Exploring the Frontier of AI and Robotics

(00:58:57) The Leap in AI: From Language Models to Physical Robots

(01:00:21) GPT-4's Remarkable Achievements and Future Prospects

(01:03:55) Navigating the Discourse on AI Safety and Regulation

(01:12:53) The Polarization of AI Discourse: A Deep Dive

(01:16:17) The Impact of Social Media on AI Conversations

(01:34:53) Exploring the Dynamics of AI Regulation and Public Perception

(01:49:27) Navigating AI's Rapid Progress and Public Perception

(01:50:55) Current State of AI Legislation and Industry Response

(01:53:31) The Challenge of Regulating AI and Ensuring Safety

(02:03:37) The Impact of AI on Information and Social Dynamics

(02:19:18) AI in Warfare: Ethical Considerations and Future Prospects

(02:27:25) Recommendations for Keeping Up with AI Developments

(02:33:45) Final Thoughts and Advice for AI Enthusiasts and Professionals

In this episode from new podcast Emergent Behavior, host @Ate-a-Pi interviews the co-founders of Prophetic AI to learn how they're using AI to facilitate lucid dreaming. Prophetic had come up in the recent Cognitive Revolution conversation with Dean W. Ball about brain computer interfaces, and Nathan had them on the list of companies to invite on the show, so it was really fun to discover that Ate-a-Pi had already done an interview with them right around the same time.

--

Subscribe to Emergent Behavior:

Spotify: https://open.spotify.com/show/2KfbuKL7iqIfbpY31PHtEg

Apple: https://podcasts.apple.com/us/podcast/emergent-behavior/id1735023473

YouTube: https://www.youtube.com/@EmergentBehaviorPod

&

Check out Nathan's new chatbot on www.cognitiverevolution.ai

--

RECOMMENDED PODCAST: 

The AI Daily Brief If you’re looking for an edge to stay up to date on everything AI, subscribe to Nathaniel Whittemore's AI Daily Brief which delivers tight episodes covering all things AI from legislation to new technologies to the philosophical debates around generalized intelligence. 

Spotify: https://open.spotify.com/show/7gKwwMLFLc6RmjmRpbMtEO

Apple: https://podcasts.apple.com/us/podcast/the-ai-daily-brief-formerly-the-ai-breakdown/id1680633614

--

SPONSORS:

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

--

TIMESTAMPS:

(00:00) Intro

(00:43) Diving Deep with Prophetic AI

(02:18) Exploring Lucid Dreaming with Halo

(05:08) The Technical Marvel Behind Halo

(07:25) A Deep Dive into Lucid Dreaming Experiences

(13:15) Sponsor: Brave | Omneky

(14:42) Do All People Have Lucid States?

(32:19) Sponsor: Squad

(41:05) Building the Neural Model for Dream Control

(43:15) Exploring the Intersection of EEG, fMRI, and Ultrasound in Lucid Dreaming

(43:48) The Journey from Open Source Data to Targeted Brain Stimulation

(47:08) Collaboration with the Donders Institute and the Future of Lucid Dreaming Research

(48:40) The Role of Machine Learning and AI in Enhancing Data Collection and Analysis

(50:04) From Theory to Practice: Implementing Transcranial Focused Ultrasound (TFUS)

(53:51) Personalizing the Lucid Dreaming Experience through Reinforcement Learning

(1:16:18) Looking Ahead: The Potential and Challenges of Neurostimulation Technology

(1:22:55) Addressing the Skeptics: The Debate Over Natural vs. Technologically Induced Lucid Dreaming

In this podcast, we dive into the fascinating world of brain-computer interfaces with Dean W. Ball. We learn about the latest technologies, from non-invasive EEG and ultrasound stimulation to invasive Neuralink implants. We also discover the state-of-art tools, technical challenges, and the big questions around thought dimensionality, ethical considerations, and the societal impact of brain reading and writing.

SPONSORS:

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) Introduction

(00:04:00) Background

(00:06:50) Journey to Neurotech Interest

(00:07:56) Concept of Human-Machine Merge

(00:12:01) Impact of Language Models

(00:15:53) Sponsors: Brave / Omneky

(00:17:20) Adoption of AI Tools like ChatGPT

(00:22:33) Neural Technologies as Sensor Fusion

(00:26:03) Brain Signals and EEG Devices

(00:29:09) Electrodes and Electrical Field Measurement

(00:37:04) Sponsors: Plumb / Squad

(00:39:01) Neurofeedback and Brain Training

(00:48:44) The Rise of Neural Networks

(00:57:29) Shared Latent Space for Brain Signals

(01:09:18) Trajectory of Brain-Computer Interface

(01:14:44) Near-Term Possibilities

(01:26:25) Limitations of Brain-Computer Interfaces

(01:38:31) Stimulating Brain Activity

(01:46:08) Policy Considerations

(01:52:02) Solved World and Artificial Constraints

(02:04:27) Acclimating to Merge Technology

(02:08:33) Advice for Understanding Neural Interfaces

In this episode from the Autopilot podcast, Sergiy Nesterenko, founder of Quilter (backed by Benchmark), discusses designing PCB circuitboards end-to-end using reinforcement learning. "Autopilot" host Will Summerlin and Nesterenko cover how current PCB boards are designed and how Quilter’s tech stack enables faster board design, what better circuit boards enable in the future, their GTM and where they are seeing most market pull right now, and much more.

Subscribe to Autopilot:

Spotify: https://open.spotify.com/show/6YQZkKHN7EP2yWedAvSxBC?si=18377c69a2804333&nd=1&dlsi=18fee5e95b284d02

Apple: https://podcasts.apple.com/us/podcast/autopilot-with-will-summerlin/id1738163836

YouTube: https://www.youtube.com/@AutopilotwithWillSummerlin

Check out Nathan's new chatbot on www.cognitiverevolution.ai

SPONSORS:

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

LINKS:

Quilter: https://www.quilter.ai/

Autopilot Ventures: https://www.apv.vc/

X/SOCIAL:

@labenz (Nathan)

@WSummerlinAI (Will)

@sergiynest (Sergiy)

@quilterai (Quilter)

TIMESTAMPS:

(00:00) Intro & Sergiy’s Background

(04:31) What Sergiy learned from SpaceX

(05:53) Founding thesis of Quilter and Quilter’s journey

(06:57) Where would one find circuit boards?

(08:11) What is the process of designing a circuit board?

(09:39) Design process today with Quilter

(14:34) Sponsor: Omneky

(16:01) Quilter’s thesis and designing more complex circuits

(18:25) How much are humans currently paid for board design

(19:41) Labor dynamics in board design

(20:30) Do most companies have board designers in-house?

(21:14) Incentive structure

(22:44) What does a high-performance circuit board look like vs low-performance?

(26:37) Quilter’s technology stack

(29:15) Sponsor: Plumb | Squad

(31:15) How Quilter can grow with scale?

(33:50) Where is circuit manufacturing happening

(37:17) What other parts of knowledge work can be solved with reinforcement learning

(41:03) GTM and who Quilter is selling to

(42:48) Pricing

(44:04) Where Quilter is seeing the most market pull right now

(45:21) What makes Quilter an exciting company to work at or invest

(47:14) The effects of closed research in private companies for the industry

(49:25) Open source vs closed source

(51:14) What Sergiy would advise to himself in his early founder

(53:59) What drew Sergiy to working with Benchmark

(56:19) Wrap

Google DeepMind researchers Keerthana Gopalakrishnan and Ted Xiao discuss their latest breakthroughs in AI robotics. Including models that enable robots to understand novel objects, learn from human demonstrations, and operate under ethical constraints. The conversation covers six groundbreaking papers that showcase rapid progress towards general-purpose robotics.

SPONSORS:

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS :

(00:00) Introduction

(04:44) The Future of Robotics

(14:40) Sponsors : Brave / Omneky

(16:04) Inputs and Outputs

(24:03) A Leap Towards Generalist Robots

(32:08) Sponsors : Plumb / Squad

(33:52) Learning in Robotics

(41:12) Learning from On-the-Fly Examples

(41:57) Annotating Robot Actions

(50:17) Scaling and Safety

(01:03:05) Learning to Learn Faster

(01:08:43) Zero-Shot Learning

(01:15:15) Future Directions

In this episode, we delve into the intricate world of AI inference with cofounders of Firework AI. Discover the strategies behind optimizing AI performance, the importance of balancing latency and throughput, and the nuances of different AI architectures from GPT-3 to Stable Diffusion. Learn about their partnership with Stability AI, their unique focus on reducing total cost of ownership, and their vision for a seamless developer experience.

RECOMMENDED PODCAST:

How Do You Use ChatGPT with Dan Shipper.

Dan Shipper talks to programmers, writers, founders, academics, tech executives, and others to walk through all of their ChatGPT use cases (including Nathan!). They even use ChatGPT together, live on the show. Listen to How Do You Use ChatGPT? from Dan Shipper and the team at Every, wherever you get your podcasts: https://link.chtbl.com/hdyuchatgpt

SPONSORS:

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS :

(00:00:00) Introduction

(00:08:34) Compute Stack

(00:19:23) Fireworks Product Philosophy

(00:24:11) Sponsors : Brave / Omneky

(00:25:40) Fine-tuning Strategy

(00:38:40) Sponsors : Plumb / Squad

(00:40:33) NVIDIA Stack Overview

(00:47:14) TensorFlow Triton Service

(00:55:25) Reduced Precision Advantages

(01:03:57) Different Deployment Scenarios

(01:08:27) Seeking Intuition on Sharding

(01:19:28) Announcing Stability AI Partnership

(01:32:00) Closing Remarks

In this episode, we explore the cutting-edge world of AI-powered brain imaging with the MindEye2 Project. Discover how researchers are reconstructing images from fMRI data, offering unprecedented insights into the human mind. We discuss the implications for neuroscience, clinical diagnosis, and the future of AI-assisted brain decoding.

RECOMMENDED PODCAST:

How Do You Use ChatGPT with Dan Shipper.

Dan Shipper talks to programmers, writers, founders, academics, tech executives, and others to walk through all of their ChatGPT use cases (including Nathan!). They even use ChatGPT together, live on the show. Listen to How Do You Use ChatGPT? from Dan Shipper and the team at Every, wherever you get your podcasts : https://link.chtbl.com/hdyuchatgpt

SPONSORS:

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00) Introduction

(07:24) Evolution of Brain Decoding Tech

(10:33) From MindEye1 to MindEye2

(14:12) Sponsor: Omneky

(14:43) Foundation Models for Enhanced AI

(26:49) Future of Image Reconstruction from Brain Data

(34:10) Sponsors: Brave / Plumb / Squad

(44:23) Evaluating AI-Generated Reconstructions

(48:10) Understanding Semantic Info in the Brain

(51:47) Potential and Ethics of Brain Data Usage

(57:13) Foundation Models in Neuroscience

(01:02:46) Future of Brain-Computer Interfaces

In this episode, Linus Lee, AI product leader at Notion, joins us to discuss his groundbreaking projects and unique approach to exploring AI systems. He shares his toolkit and insights on language model capabilities, along with his vision for the future of AI, which is centered on amplifying human intelligence. Linus inspires listeners to engage deeply with AI and to steer its development in ways that enhance human creativity and agency.

RECOMMENDED PODCAST:

How Do You Use ChatGPT Dan Shipper talks to programmers, writers, founders, academics, tech executives, and others to walk through all of their ChatGPT use cases (including Nathan!). They even use ChatGPT together, live on the show. Listen to How Do You Use ChatGPT? from Dan Shipper and the team at Every, wherever you get your podcasts. https://link.chtbl.com/hdyuchatgpt

SPONSORS:

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS :

(00:00) Introduction

(10:16) AI and Creativity

(14:37) Sponsor: Omneky

(14:57) AI Research Development

(20:05) Bridging Modalities

(32:38) Sponsor: Brave / Plumb / Squad

(35:36) Transformer Models and Techniques

(52:32) Personal AI Research Setup

(58:55) Leveraging Language Models for Coding

(01:02:05) AI Model Development and Notion AI

(01:22:05) Future of AI Models and App Development

(01:32:51) Emerging Trends in AI

In this podcast, Nathan and Nick dive deep into the data requirements for achieving Artificial General Intelligence. They explore the current paradigms, the role of data in approximating intelligence, and the scaling trends for GPT models. The discussion covers various datasets, from email and Twitter to YouTube and genomic data, as they analyze the feasibility of reaching the target of 100 trillion high-quality tokens. While the bull case suggests an abundance of data, the bear case highlights the limits on high-quality data, prompting a fascinating exploration of what makes data good for AI and the potential for AI to generate its own data.

Sponsors

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to http://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.

Chapters 

(00:00) Introduction

(05:04) Scaling Hypothesis of Intelligence

(07:32) Is There Enough High Quality Data?

(10:19) Algorithms Impacting Data Requirements

(17:42) Sponsor : Omneky

(18:04) Estimating High Quality Token Requirements

(24:07) Astronomy and YouTube Data Scale

(29:42) Genomics Data

(37:58) Sponsors : Brave / Plumb / Squad

(41:16) Code Datasets and Synthetic Data

(45:48) The Bear Case: Quality and Usability of Data

(50:54) Investment Trends and Compute Efficiency

(54:19) Training Run

(57:21) Synthetic Data Generation and Self-Play

In this episode, we explore the Chinese AI ecosystem with 'L-squared,' an anonymous tech worker based in Beijing. We discuss major players, model quality, public engagement, regulation, and the US 'chip ban.' Discover the similarities and differences between US and Chinese AI landscapes, and gain a nuanced perspective on the current state of AI in China.

USEFUL RESOURCES:

Testing Chinese models: Yi-34B-Chat (made by Kai-Fu Lee's team 01.AI) can be tried out via Replicate (https://replicate.com/01-ai/yi-34b-chat) or Hugging Face. You can also use the ChatGLM playground (https://open.bigmodel.cn/trialcenter) and Baidu's ERNIE (https://yiyan.baidu.com/) without a Chinese SIM card.

Benchmarking models: SuperCLUE is one of the most prominent benchmarks - the latest results are on GitHub (https://github.com/CLUEbenchmark/SuperCLUE) and the paper explaining the methodology is here (https://arxiv.org/abs/2307.15020).

Regulation: Explainer (https://carnegieendowment.org/2023/07/10/china-s-ai-regulations-and-how-they-get-made-pub-90117) from Matt Sheehan; piece (https://www.chinatalk.media/p/how-tight-ai-regs-hurt-chinese-firms) on how genAI regs are affecting Chinese companies.

US-China competition: Jeff Ding's work (https://www.tandfonline.com/doi/full/10.1080/09692290.2023.2173633) on the diffusion deficit in S&T; Bloomberg piece (https://www.bloomberg.com/graphics/2023-china-huawei-semiconductor/) on Huawei's semiconductor development efforts.

Staying up to date: Sign up to alerts from CSET's Scout tool (https://scout.eto.tech/); subscribe to Concordia AI's AI safety (https://aisafetychina.substack.com/) in China newsletter (disclaimer: I used to work at Concordia!)

A 2016 profile (https://chinai.substack.com/p/chinai-37-happy-20th-anniversary) on Microsoft Research Asia by Wang Jingjing, covered in Jeff Ding's ChinAI newsletter

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, instead of...does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off http://www.omneky.com/

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.

Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.

TIMESTAMPS:

(00:00) Introduction

(07:24) China's AI Ecosystem

(13:40) Public AI Engagement

(17:33) Sponsors : OCI / Omneky

(18:50) AI Tools Comparison

(35:37) Sponsors : Brave / Squad / Plumb

(39:14) AI Regulatory Maze

(51:02) AI Performance, Censorship

(55:28) Chinese AI Regulations

(01:04:37) Tech, Research Role

(01:12:11) Global AI Ecosystem

(01:23:22) Cultural AI Perspectives

(01:29:14) AI Safety, Cooperation

In this episode, Nathan sits down with Andrew Lee, founder of Shortwave, an AI-powered email app that describes itself as “the smartest email app on planet earth.” They discuss Shortwave’s RAG stack, how the AI assistant works, the models Shortwave is using, and much more. This is truly a masterclass in RAG app development.

Sponsors : 

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.

TIMESTAMPS:

(00:00) - Intro

(01:07) - Shortwave: AI-Powered Email

(06:22) - Genesis of Shortwave

(15:25) - Sponsors: Oracle / Omneky

(16:46) - Data Processing Pipeline

(21:57) - Choosing a Vector Database

(26:34) - How the AI Assistant Works

(36:24) - Sponsors: Brave / Plumb / Squad

(40:53) - Fine-Tuning & Hosting Models

(45:11) - Email Automation

(47:55) - Email Retrieval

(51:44) - Optimizing AI Performance

(53:20) - Safety & Embedded Ethics

(01:04:51) - Strategic Product Launches

(01:09:58) - Inbox Management

(01:12:24) - The Future of Collaborative AI

(01:18:54) - Scaling Personalized Outreach

(01:26:04) - Closing Thoughts & What's Next

In this episode, we dive deep into the inner workings of large language models with Professor David Bau and grad students Koyena Pal and Eric Todd from Northeastern University. Koyena shares insights from her Future Lens paper, which shows that even mid-sized language models think multiple tokens ahead. Eric discusses the fascinating concept of Function Vectors - complex patterns of activity spread across transformer layers that enable in-context learning. Professor Bau connects the dots between these projects and the lab's broader interpretability research agenda, identifying key abstractions that link low-level computations to higher-level model behaviors.

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.

TIMESTAMPS:

(00:00) Intro

(04:03) Reverse Engineering AI

(10:10) Factual Knowledge Localization

(16:34) Sponsors: Oracle | Omneky | On Deck

(18:27) Future Lens Paper Intro

(23:54) Choosing GPT-J

(26:54) Vocabulary Prediction

(30:36) Sponsors: Brave | Plumb | Squad

(33:13) Fixed Prompt

(35:57) Soft Prompt

(41:32) Future Lens Results Analysis

(51:50) Tooling & Open Source Code

(56:07) Larger Models & Mamba Probes

(1:04:10) Function Vectors Paper

(1:09:39) Extracting & Patching Vectors

(1:13:30) Encoding Task Understanding

(1:15:36) Expert Models Implications

(1:18:09) Conclusion

In this episode, Nathan sits down with Elicit co-founders Andreas Stuhlmüller and Jungwon Byun to discuss their mission to make AI-assisted research more accessible and reliable. Learn about their unique approach to task decomposition, which allows language models to accurately tackle complex research questions. We delve into the company's tech stack, their transition from nonprofit to startup, and their dedication to creating trustworthy AI tools for high-stakes applications. Join us for an exploration of the future of AI in research.

The Cognitive Revolution is part of the Turpentine podcast network. Learn more: www.turpentine.co

HELPFUL LINKS: 

Elicit : https://elicit.com/

Andreas Stuhlmüller : https://twitter.com/stuhlmueller

Jungwon Byun : https://twitter.com/jungofthewon

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.

TIMESTAMPS:

(00:00:30) Intro

(00:05:05) What is Elicit?

(00:06:03) Vision for Elicit

(00:10:10) Making research transparent

(00:11:58) How to use it?

(00:15:27) Sponsors: Oracle | On Deck | Omneky

(00:18:21) Task Decomposition

(00:23:48) Defining the task

(00:26:30) Eliciting fine-grained evaluations

(00:28:06) Hallucination rates

(00:30:22) Models in play

(00:31:30) Sponsors: Brave | Plumb | Squad

(00:34:26) Shipping a new feature every week

(00:36:10) What was not possible a year ago?

(00:38:26) Chain of thought

(00:43:47) Tactically, how to structure the chain of thought

(00:45:21) Data sets and fine-tuning

(00:51:23) Scaffolding

(00:53:22) Translating structure into more compute

(00:54:27) Infrastructure for investigating papers in detail

(00:59:50) Emphasis on high-value use cases over speed

(01:00:33) Balancing long-term safety and misuse concerns

(01:02:36) Monitoring research progress for negative impact

(01:06:05) Evolving user base and usage patterns

(01:06:52) Biomedicine as a key domain for Elicit

(01:08:57) Expanding results and depth of processing

(01:11:40) Reorganizing information for better understanding

(01:13:12) Habit formation and frequency of use

(01:14:43) The concept of an AI bundle subscription

(01:18:09) Nonprofit to Commercial Venture

(01:20:08) Nonprofit Team and Commercial Mission

(01:20:39) Hiring Needs at Elicit

In this second part of a two episode series, Nathan and AI scout Jason Meaux provide a sweeping overview of the first 90 days of Mamba-inspired research. They discusstMamba's application to computer vision, experiments in extending effective context length, the potential problem of internal rotting states, and the use of hybrid SSMs in biology.Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api

LINKS:

Show Notes and Paper Links: https://docs.google.com/document/d/1NK_a3deVL_aczORmSRw8LyujNPotpO7Kd90sIRj9Qx0/edit?usp=sharing

Nathan's original Mamba Deep Dive

• Spotify: https://open.spotify.com/episode/3b3zeDVU6fE2yV9vdNVLqX?si=dc7a885d601d4a58
• Apple: https://podcasts.apple.com/us/podcast/emergency-pod-mamba-memory-and-the-ssm-moment/id1669813431?i=1000639397566

X/SOCIAL:

@labenz (Nathan)

SPONSORS: ORACLE | OMNEKY | BRAVE | ON DECK | SQUAD

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api

ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more.

💥 Access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.

TIMESTAMPS:

(00:00) - Episode Start

(00:01:14) - Nathan and Jason’s Bet

(00:04:51) - U-Mamba

(00:15:10) - Sponsors: Oracle | Omneky

(00:06:08) - Swin U-Mamba

(00:18:59) - Vision Mamba

(00:24:30 - VMamba

(00:27:26) - VM-UNet

(00:30:37) - Sponsors: Brave | On Deck

(00:35:15) - SegMamba

(00:36:59) - Vivim

(00:37:31) - Mamba Morph

(00:39:01) - Graph Mamba 

(00:43:15) - Long Mamba

(00:59:54) - Evo and StripedHyena

The Cognitive Revolution is produced by Turpentine: a media network covering technology, business, and culture.

Producer: Vivian Meng

Editor: Graham Bessellieu

For sponsor or guest inquiries, email: [email protected] 

In this first part of a two episode series, Nathan and AI scout Jason Meaux provide a sweeping overview of the first 90 days of Mamba-inspired research. They discuss the mechanistic underpinnings of Mamba architecture, Mamba's context capabilities, multi-modal applications in image segmentation and computer vision tasks, and much more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api

RECOMMENDED PODCAST: Autopilot explores the adoption and rollout of AI in the industries that drive the economy and the dynamic founders bringing rapid change to slow-moving industries. From law, to hardware, to aviation, Will Summerlin interviews founders backed by Benchmark, Greylock, and more to learn how they're automating at the frontiers in entrenched industries.

Listen on Spotify: https://open.spotify.com/show/6YQZkKHN7EP2yWedAvSxBC?si=18377c69a2804333

Listen on Apple: https://podcasts.apple.com/ca/podcast/autopilot-with-will-summerlin/id1738163836

LINKS:

Show Notes and Paper Links: https://docs.google.com/document/d/1NK_a3deVL_aczORmSRw8LyujNPotpO7Kd90sIRj9Qx0/edit?usp=sharing

Nathan's original Mamba Deep Dive

• Spotify: https://open.spotify.com/episode/3b3zeDVU6fE2yV9vdNVLqX?si=dc7a885d601d4a58
• Apple: https://podcasts.apple.com/us/podcast/emergency-pod-mamba-memory-and-the-ssm-moment/id1669813431?i=1000639397566

X/SOCIAL:

@labenz (Nathan)

SPONSORS: ORACLE | OMNEKY | SQUAD | BRAVE

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com

💥 Access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api

ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more.

In this episode, Nathan sits down with Adam Gleave, founder of Far AI, for a masterclass on AI exploitability. They dissect Adam's findings on vulnerabilities in GPT-4's fine-tuning and Assistant PIs, Far AI's work exposing exploitable flaws in "superhuman" Go AIs through innovative adversarial strategies, accidental jailbreaking by naive developers during fine-tuning, and more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api

RECOMMENDED PODCAST: Autopilot explores the adoption and rollout of AI in the industries that drive the economy and the dynamic founders bringing rapid change to slow-moving industries. From law, to hardware, to aviation, Will Summerlin interviews founders backed by Benchmark, Greylock, and more to learn how they're automating at the frontiers in entrenched industries.

Listen on Spotify: https://open.spotify.com/show/6YQZkKHN7EP2yWedAvSxBC?si=18377c69a2804333

Listen on Apple: https://podcasts.apple.com/ca/podcast/autopilot-with-will-summerlin/id1738163836LINKS:

LINKS:

Far AI: https://far.ai/author/adam-gleave/

X/SOCIAL:

@labenz (Nathan)

@ARGleave (Adam)

@FARAIResearch (Far.AI)

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api

ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more.

💥 Access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.

TIMESTAMPS:

(00:00:00) Episode Preview

(00:01:25) The alarming reality of AI exploits: from accidental jailbreaking to malicious attacks.

(00:16:45) The Assistants API: a new frontier for AI exploitation.

(00:41:54) The ethical dilemma of AI security research and disclosure.

(00:51:36) Exploring AI vulnerabilities: a deep dive into GPT-4's exploits.

(00:51:47) The challenge of AI robustness and the 'Accidental Jailbreaking' phenomenon.

(00:52:39) Navigating the Assistants API: security risks and malicious exploits.

(00:53:27) The robustness tax: balancing AI safety with performance.

(01:07:42) Unveiling flaws in superhuman Go-playing AIs: a gray-box investigation.

(01:36:50) Empirical scaling laws for adversarial robustness: a future focus.

(01:41:53) Closing remarks and opportunities at FAR AI

The Cognitive Revolution is produced by Turpentine: a media network covering technology, business, and culture.

Producer: Vivian Meng

Editor: Graham Bessellieu

For sponsor or guest inquiries, email: [email protected]

In this episode, Nathan sits down with Katja Grace, Cofounder and Lead Researcher at AI Impacts. They discuss the survey Katja and team conducted including over 2,700+ AI researchers, the methodology for the research, and the results’ implications for policymakers, the public, and the industry as a whole. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api

LINKS:

- Thousands of AI Authors on the Future of AI: https://aiimpacts.org/wp-content/uploads/2023/04/Thousands_of_AI_authors_on_the_future_of_AI.pdf

-AI Impacts Site: https://aiimpacts.org/about/

-Linus episode: https://www.youtube.com/watch?v=wdmvtVTZDqE&pp=ygUJbGludXMgbGVl

X/SOCIAL:

@labenz (Nathan)

@KatjaGrace (Katja)

@AIImpacts

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api

ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more.

This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at [email protected].

💥 Access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.

Producer: Vivian Meng

Editor: Graham Bessellieu

In this episode, Nathan sits down with Tim Reutemann, author of “Liquid Reign”. They discuss liquid democracy, reshaping political participation using AI and biometrics, and practical advances in technology and their impacts on identity verification, rehabilitation, and gaming. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api

LINKS:

Liquid Reign Book: https://www.amazon.ca/Liquid-Reign-Tim-Reutemann/dp/1981029176

Tim Reutemann's Medium: https://tim-reutemann.medium.com/

Audrey Tang: https://en.wikipedia.org/wiki/Audrey_Tang

X/SOCIAL:

@labenz (Nathan)

@TimReutemann (Tim)

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api

ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more.

💥 Access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.

TIMESTAMPS:

(00:00:00) - Exploring the power of your vote in a futuristic AI world.

(00:01:25) - Imagining a positive future with advanced AI.

(00:02:35) - Diving into 'Liquid Reign’: A vision of AI-transformed society.

(00:05:58) - The journey of writing 'Liquid Reign’: From thought experiment to novel.

(00:09:07) - The mechanics of liquid democracy and AI integration.

(00:15:59) - Sponsors: Oracle | Omneky 

(00:12:51) - Unpacking the technology stack behind the futuristic society.

(00:16:00) - Exploring the progress and challenges in AI and cryptography.

(00:25:28) - Switzerland’s unique way of getting citizens involved in democracy

(00:28:45) - Sponsors: Brave | On Deck 

(00:47:58) - The future of open source and security in an AI-driven world.

(00:52:02) - Exploring the depths of cybersecurity and paranoia.

(00:52:47) - The future of human-computer interfaces: Chips, VR, and beyond.

(00:54:11) - The ethical dilemma of invasive technologies.

(00:56:45) - The evolution of VR: From gaming to rehabilitation.

(01:30:48) - Navigating the complexities of AI and privacy.

(01:37:27) - Envisioning a positive future: The role of AI in society.

In this episode, Nathan sits down with Pablo Arredondo, VP of CoCounsel for Thomson Reuters. They discuss the evolution of legal research, how GPT-4 has changed legal practices, security and privacy in AI driven legal services, and more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api

X/SOCIAL:

@labenz (Nathan)

@tweetatpablo (Pablo)

@casetext 

LINKS:

Casetext: https://casetext.com/

Cognitive Revolution (new feed): https://cognitiverevolution.ai/

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api

ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more.

💥 Access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.

TIMESTAMPS

(00:00:00) Episode preview

(00:01:42) The evolution of legal research: From books to AI

(00:02:19) The game-changing impact of GPT-4 on legal practices

(00:04:01) Exploring the future of legal AI with Pablo Arredondo

(00:04:34) The birth and evolution of CaseText

(00:07:06) Revolutionizing legal research with AI and large language models

(00:14:42) The leap to GPT-4: A new era for legal tech

(00:16:42) Navigating the challenges and opportunities of AI in law

(00:27:41) The continuous evolution of AI in legal tech

(00:43:46) The importance of rigorous testing in AI deployment

(00:45:19) The importance of testing in legal tech

(00:45:46) Merging with Thomson Reuters: A new era of quality control

(00:46:49) Harnessing GPT-4 for legal document review

(00:48:27) Innovations in legal tech: Beyond GPT-4

(00:49:00) The evolution of legal research and document management

(00:49:54) Exploring the potential of AI in legal firms

(00:51:37) Security and privacy in AI-driven legal services

(00:52:43) The future of vector databases in legal tech

(00:54:10) AI-assisted legal assistance: A new frontier

(00:58:41) The pricing strategy and market response to AI legal tools

(01:10:18) The future of law and AI integration

(01:23:18) Reflections on being acquired by Thomson Reuters

(01:26:07) Closing thoughts: The impact of LLMs on justice

In this episode, Nathan sits down with Itamar Friedman, CEO of Codium AI, the company on the mission to create the code integrity paradigm. They discuss harnessing LLMs for code integrity, task decomposition, workflow engineering, and much more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api

X/SOCIAL:

@labenz (Nathan)

@itamar_mar (Itamar)

@CodiumAI (Sodium)

LINKS:

Codium: https://www.codium.ai/

Cognitive Revolution Feed: https://cognitiverevolution.ai/

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api

ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more.

TIMESTAMPS:

(00:00:00) Episode Preview

(00:06:32) The evolution of AI in software development: beyond code generation

(00:09:51) The shift towards code integrity and its impact

(00:14:23) Unveiling Alpha Codium: A leap in AI-assisted code integrity

(00:16:53) The broader impact of AI on software development processes

(00:17:11) Sponsor break: Oraclel | Omneky

(00:18:52) The future of AI in coding: enhancements, testing, and more

(00:24:41) AI's role in enhancing code quality and developer efficiency

(00:43:38) Exploring the challenges of large codebases

(00:44:03) The impact of LLM context growth on code understanding

(00:45:19) Innovative approaches to data retention and context computation

(00:46:08) Deep dive into repo analysis and future directions

(00:42:31) Personal experiences and the quest for efficient code management

(00:48:26) Dynamic graph strategies and future features in IDEs

(00:49:10) From code testing to advanced flow engineering: a new paradigm

(00:52:37) Unveiling Alpha Codium: A leap in coding challenge solutions

(01:07:31) Reflecting on workflows

(01:23:30) Final thoughts and recommendations for AI enthusiasts

The Cognitive Revolution is produced by Turpentine: a media network covering technology, business, and culture.

Producer: Vivian Meng

Editor: Graham Bessellieu

For sponsor or guest inquiries, email: [email protected]