136: System Evolution from Hadoop to RocksDB with Dhruba Borthakur of Rockset

Highlights from this week’s conversation include:

• Dhruba’s journey into the data space (2:02)
• The impact of Hadoop on the industry (3:37)
• Dhruba’s work in the early days of the Facebook team (7:54)
• Building and implementing RocksDB (14:33)
• Stories with Mark Zuckerberg at Facebook (24:25)
• The next evolution in storage hardware (26:14)
• How Rockset is different from other real-time platforms (33:13)
• Going from a key value store to an index (37:15)
• Where does Rockset go from here? (44:59)
• The success of RocksDB as an open source project (49:11)
• How do we properly steward real-time technology for impact (51:17)
• Final thoughts and takeaways (56:18)

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.