The Future is Fine Tuned (with Dev Rishi, Predibase)

Dev Rishi is the founder and CEO of Predibase, the company behind Ludwig and LoRAX. Predibase just released LoRA Land, a technical report showing 310 models that can outcompete GPT-4 on specific tasks through fine-tuning. In this episode, Dev tries (pretty successfully) to convince me that fine-tuning is the future, while answering a bunch of interesting questions, like:

• Is fine-tuning hard?
• If LoRAX is a competitive advantage for you, why open-source it?
• Is model hosting becoming commoditized? If so, how can anyone compete?
• What are people actually fine-tuning language models for?
• How worried are you about OpenAI eating your lunch?

I had a ton of fun with Dev on this one. Also, check out Predibase’s newsletter called fine-tuned (great name!) and LoRA Land.