Sveriges mest populära poddar

Thinking Machines: AI & Philosophy

GPUs and how the cloud is changing (with Cedana Founder, Neel Master)

43 min • 2 februari 2024

What’s going on with GPUs? We talk through the GPU bottleneck/supply gut, Meta’s apparent 600,000 H100-equivalents and the future of the GPU cloud.

Neel Master is the CEO and founder of Cedana, enabling pause/migrate/resume for compute jobs. Neel is a serial entrepreneur, former founder of Engooden and angel investor. He started his career in ML research at MIT's CSAIL.

Topics from this podcast include:

  • Cedana's real-time save, migrate and resume for compute technology, enabling the migration of compute jobs across instances without interruption
  • When will there be enough GPUs?
  • What does it mean, that the cloud can become a robot?
  • How might compute change, as per-capita GPU supply grows massively?
  • How much does it actually cost to run GPUs?
  • How can startups compete with the Big Tech’s giant compute moats?

Share your thoughts with us at [email protected] or tweet us @slingshot_ai.

00:00 -00:00