It all starts from physics. The entropy of an isolated system never decreases… Everyone at school, at some point of his life, learned this in his physics class. What does this have to do with machine learning?
To find out, listen to the show.
References
Entropy in machine learning
https://amethix.com/entropy-in-machine-learning/