Modern Web Podcast S12E37- Java’s AI Evolution: Semantic Caching JVM, and GenAI Architectures with Theresa Mamarella & Brian Sam-Bodden

In this episode of the Modern Web Podcast, Danny Thompson, Director of Technology at This Dot Labs, hosts a conversation with Theresa Mammarella, JVM engineer at IBM, and Brian Sam-Bodden, Applied AI Engineer at Redis. They explore their talks at JCONF in Dallas, Texas, covering topics like GenAI architectures in the Java community and OpenJDK's Project Valhalla. Their conversation covers Java’s evolution, AI applications, semantic caching, and how these technologies are impacting development workflows and performance optimization.

Chapters

00:00 - Introduction  

01:00 - Brian on GenAI in the Java Community  

01:47 - Java’s Safe Evolution Path  

02:17 - Teresa on Project Valhalla  

03:54 - Value Classes and Performance  

04:33 - Brian on Semantic Caching  

06:54 - Challenges of Rewording Prompts  

09:15 - What is RAG Architecture?  

11:34 - Java’s Role in AI  

13:57 - Cost of LLMs and Caching Strategies  

15:57 - Teresa on Java’s Future  

18:22 - Learning Resources for Java Developers  

20:44 - Addressing Misconceptions About Java  

22:39 - Final Thoughts  

Follow Theresa Mammarella & Brian Sam on Social Media

Theresa Mammarella Twitter: https://x.com/t_mammarella?lang=en

Brian Sam-Bodden Twitter: https://x.com/bsbodden

Theresa Mammarella Linkedin: https://www.linkedin.com/in/tmammarella/

Brian Sam-Bodden Linkedin:  https://www.linkedin.com/in/sambodden/