Database School

Want to learn more SQLite? Check out my SQLite course: https://highperformancesqlite.com In this episode, I sit down with Mike Buckbee to dive into the nitty-gritty of web application firewalls and his journey from using Redis to SQLite in Wafris. We talk about database architecture, operational challenges, and the fascinating ways SQLite improves performance and usability in cybersecurity tools. Get production ready SQLite with Turso: https://tur.so/af. Follow Mike: Twitter: https://twitter.com/mbuckbee LinkedIn: https://www.linkedin.com/in/michaelbuckbee Wafris website: https://wafris.org Rearchitecting Redis to SQLite article: https://wafris.org/blog/rearchitecting-for-sqlite Follow Aaron: Twitter: https://twitter.com/aarondfrancis LinkedIn: https://www.linkedin.com/in/aarondfrancis Website: https://aaronfrancis.com - find articles, podcasts, courses, and more. Chapters: 00:00 - Introduction and Guest Overview 01:06 - What is Wafris? 02:43 - Naming and Origins of Wafris 04:00 - Mike's Cybersecurity Background 07:17 - Challenges with Web Application Firewalls 10:01 - Wafris Architecture Overview 16:15 - Why Switch to SQLite? 18:01 - Handling IP Address Ranges 24:00 - Wild Redis Data Structures Explained 28:51 - Transitioning to SQLite 32:02 - Operational Advantages of SQLite 37:04 - How Wafris Leverages Threat Lists 40:13 - Performance Gains with SQLite 46:51 - Splitting Reads and Writes in the New Architecture 52:29 - Closing Thoughts and Where to Learn More

Want to learn more Postgres? Check out my Postgres course: https://masteringpostgres.com. 

In this interview, I talk with Jesse Hanley, founder of Bento, about running a lean email service from Japan. We chat about the challenges of scaling infrastructure, managing databases, and maintaining a calm business while serving a global customer base. 

Links Mentioned: 
Bento: https://bentonow.com 
Database school on YouTube: https://www.youtube.com/playlist?list=PLI72dgeNJtzqElnNB6sQoAn2R-F3Vqm15
Database school audio only: https://databaseschool.transistor.fm

Follow Jesse:
Twitter: https://twitter.com/jessethanley
Bento on Twitter: https://twitter.com/Bento

Follow Aaron:
Twitter: https://twitter.com/aarondfrancis
LinkedIn: https://www.linkedin.com/in/aarondfrancis
Website: https://aaronfrancis.com - find articles, podcasts, courses, and more.

Chapters:
00:00 - Introduction to Jesse Hanley
01:02 - Running Bento from Japan
01:48 - The Lean Team Structure at Bento
03:00 - Managing Support via Discord
05:01 - Benefits of Using Discord for Customer Support
06:45 - The Role of Community in Customer Feedback
09:01 - How Bento Gained Traction
13:00 - Bootstrapping Bento and Profitable Growth
16:00 - Running Your Own Mail Servers
19:03 - The Economics and Redundancy of Email Delivery
21:00 - Bento's Heroku Setup and Scaling Challenges
26:00 - Handling and Querying Massive Data in Bento
29:52 - Leveraging Elasticsearch for Data Queries
35:40 - Moving Toward Multi-Database Solutions
37:45 - Exploring Crunchy Data and Citus for Database Scaling
42:00 - Optimizing Bento for Performance and Scalability
54:02 - Jesse’s Advice on Building a Calm and Profitable Business
57:00 - How Bento Uses WebSockets and Background Jobs
1:00:00 - Optimizing Bento with Action Cable
1:02:25 - Avoiding N+1 Queries with WebSockets
1:04:50 - Scaling Redis and Postgres at Bento
1:09:00 - Jesse’s Approach to Managing Growth and Multiple Services
1:11:00 - Final Thoughts on Scaling and Optimizing Databases
1:13:10 - Advice for Aspiring Builders: Stay Patient and True to Your Vision
1:16:00 - Bento’s Unique Approach to Email Marketing and Transactional Emails
1:19:50 - Closing Thoughts and Where to Find Jesse Hanley Online

Want to learn more Postgres? Check out my Postgres course: https://masteringpostgres.com.

Production ready Postgres for teams that ship fast: https://xata.io In this interview, I talk with Monica Sarbu and Tudor Golubenco from Xata about their journey from Elastic to founding Xata. We deep dive on building a Postgres hosting platform, handling schema changes, and how they've made their free tier economical.

Links Mentioned:
Xata.io: https://xata.io/ The economics of a Postgres free tier:
https://xata.io/blog/postgres-free-tier

Follow Monica & Tudor:
Monica on Twitter: https://twitter.com/monicasarbu
Monica on LinkedIn: https://www.linkedin.com/in/monicasarbu
Tudor on Twitter: https://twitter.com/tudor_g
Tudor on LinkedIn: https://www.linkedin.com/in/tudorgolubenco/

Follow Aaron:
Twitter: https://twitter.com/aarondfrancis
LinkedIn: https://www.linkedin.com/in/aarondfrancis
Website: https://aaronfrancis.com - find articles, podcasts, courses, and more.

Chapters:
00:00 - Introduction
00:26 - What is Xata? Overview and Mission
01:32 - Open Source Projects: PG Roll and PG Stream
02:33 - Synchronizing Data: Postgres to Elastic Search
03:12 - Monica and Tudor's Background & Journey to Elastic
04:00 - Founding of Packetbeat: The Start of Open Source Monitoring
06:08 - Transition from Elastic to Starting Xata
07:00 - Launching a Nonprofit and Insights on Database Challenges
08:29 - The Idea Behind Xata: Simplifying Application Development
10:00 - Tudor Joins Xata: The Decision to Start Again
10:47 - The Technical Vision for Xata's Platform
12:06 - Founding Xata During the Pandemic 13:11 - Funding Journey: From Seed to Series A
15:07 - Building a Platform, Not Just a Hosted Database
17:20 - Introducing Postgres to Xata's Stack
20:19 - Navigating Postgres as a DBA
22:44 - Open Source Strategy & Community Building
27:48 - PG Stream Use Cases & Postgres Replication
32:08 - PG Roll for Zero Downtime Schema Changes
36:05 - Implementing Safe and Fast Schema Changes
39:49 - Blob Storage and Cloudflare Integration
45:11 - Xata's Unique Features: Serving Builders and Larger Teams
49:20 - Free Tier Economics and Why It Matters
56:04 - Working as a Husband-Wife Team

Want to learn more Postgres? Check out my Postgres course: https://masteringpostgres.com.

In this interview, I dive deep with Craig Kerstiens from Crunchy Data into the world of Postgres, covering its rise to prominence, scaling at Heroku, and the power of Postgres extensions. Craig also shares insights on database sharding, the future of Postgres, and why developers love working with it.

Follow Craig:
Twitter: https://twitter.com/craigkerstiens
Crunchy Data Blog: https://www.crunchydata.com/blog

Follow Aaron:
Twitter: https://twitter.com/aarondfrancis
LinkedIn: https://www.linkedin.com/in/aarondfrancis
Website: https://aaronfrancis.com - find articles, podcasts, courses, and more.

Chapters:
00:00 - Introduction: Welcome to Database School
00:20 - Guest Introduction: Craig Kerstiens and Crunchy Data
01:40 - Craig's Journey from Heroku to Crunchy Data
02:55 - Scaling Postgres at Heroku
04:50 - Mastering Postgres Course Announcement
05:30 - The Importance of Postgres at Heroku
07:50 - The Value of Live SQL with Data Clips
09:25 - Data Clips for Business Intelligence and Real-Time Analytics
11:05 - Heroku’s Unique Company Culture and How Data Clips Came to Be
12:30 - Postgres Extensions and Marketplace
14:00 - Citus: Scaling Postgres for Multi-Tenant Applications
15:40 - The Challenges of Sharding in Databases
18:00 - Managing Large Databases and Sharding Keys with Citus
24:00 - The Evolution of Postgres and Its Growing Popularity
31:00 - Postgres for Developers and the Importance of Extensions
35:00 - Extensions as Proving Grounds for Core Postgres Features
37:50 - Building an Extension Marketplace for Postgres
41:00 - Postgres as a Data Platform and Developer Flexibility
46:00 - Why Developers Love Postgres: Stability, Extensions, and Ownership
51:00 - DuckDB: A Fascinating New Database Approach
53:30 - Crunchy Data: What They Offer and Why It Matters
58:30 - Expanding Postgres with DuckDB for Data Warehousing
01:00:00 - Wrapping Up: Where to Find Craig and Crunchy Data

Want to learn more about SQLite? Check out the full course: https://highperformancesqlite.com Get production ready SQLite with Turso: https://tur.so/af.

In this interview, I talk to Stephen Margheim about his work with SQLite and Ruby on Rails.

Links:
Database school on YouTube: https://www.youtube.com/playlist?list=PLI72dgeNJtzqElnNB6sQoAn2R-F3Vqm15
Database school audio only: https://databaseschool.transistor.fm
Aaron on Twitter: https://twitter.com/aarondfrancis
Stephen on Twitter: https://twitter.com/fractaledmind
Stephen's blog: https://fractaledmind.github.io/
Stephen's book: https://fractaledmind.gumroad.com/l/sqlite-on-rails
Aaron's conference talk: https://www.youtube.com/watch?v=2YaEtaXYVtI

Want to learn more about SQLite? Check out the full course: https://highperformancesqlite.com. Get production ready SQLite with Turso: https://tur.so/af. In this interview, I talk to Kent C. Dodds about SQLite, LiteFS and the React ecosystem.

Kent: https://twitter.com/kentcdodds
EpicWeb: https://www.epicweb.dev
The Epic Stack: https://www.epicweb.dev/epic-stack
Fly.io: https://fly.io
LiteFS: https://fly.io/docs/litefs
Litestream: https://litestream.io

Want to learn more about SQLite? Check out the full course: https://highperformancesqlite.com

Get production ready SQLite with Turso: https://tur.so/af.

In this interview I talk to Glauber Costa, CEO of Turso.

Want to learn more about SQLite? Check out the full course: https://highperformancesqlite.com. Get production ready SQLite with Turso: https://tur.so/af.

In this interview I talk to Carl Sverre about his new project: SQLSync. It's an offline-first, collaborative wrapper around SQLite. We cover event sourcing, conflict resolution, VFSes, and more! Carl: https://twitter.com/carlsverre PartyKit: https://www.partykit.io SQLSync: https://sqlsync.dev Carl's new company: https://orbitinghail.dev ------- 00:00 Intro and Background 01:56 What is SQLSync 02:30 Amplify 05:08 SQLSync Use Case 07:35 Multiplayer Explained 09:41 Durable Objects 12:00 Compare to PartyKit 13:08 Local First 22:46 SQLSync Terminology 24:28 SQLSync Replication Flow 27:33 Virtual File System 33:51 Transactions in WASM 39:41 Sync to Coordinator 43:22 Conflict Resolution as Business Logic 52:03 Sync to Clients 1:01:12 Goals for SQLSync 1:04:14 Scaling Limitations 1:07:30 Graft Storage Engine 1:14:47 Graft as a SQLite Extension 1:17:08 What's Next -----

Want to learn more about SQLite? Check out the full course: https://highperformancesqlite.com. Get production ready SQLite with Turso: https://tur.so/af.

Ben and Aaron discuss replication and backups in SQLite, Litestream and LiteFS, and future mad scientist projects Ben is working on. • Ben Johnson on Twitter: https://x.com/benbjohnson • Litestream: https://litestream.io/ • LiteFS: https://fly.io/docs/litefs/

Want to learn more about SQLite? Check out the full course: https://highperformancesqlite.com. Get production ready SQLite with Turso: https://tur.so/af. DHH and Aaron discuss modern SQLite, the one-person framework, conceptual compression, stoicism, and ONCE.com's newest product: Workbook.