Making Sense of Data Engineering Acronyms and Buzzwords - Natalie Kwong

We talked about:

• Natalie’s background
• Airbyte
• What is ETL?
• Why ELT instead of ETL?
• Transformations
• How does ELT help analysts be more independent?
• Data marts and Data warehouses
• Ingestion DB
• ETL vs ELT
• Data lakes
• Data swamps
• Data governance
• Ingestion layer vs Data lake
• Do you need both a Data warehouse and a Data lake?
• Airbyte and ELT
• Modern data stack
• Reverse ETL
• Is drag-and-drop killing data engineering jobs?
• Who is responsible for managing unused data?
• CDC – Change Data Capture
• Slowly changing dimension
• Are there cases where ETL is preferable over ELT?
• Why is Airbyte open source?
• The case of Elasticsearch and AWS

Links:

• Natalie's LinkedIn: https://www.linkedin.com/in/nataliekwong/
• https://airbyte.io/blog/why-the-future-of-etl-is-not-elt-but-el

Join DataTalks.Club: https://datatalks.club/slack.html

Our events: https://datatalks.club/events.html