Data Skeptic
Data Skeptic
Kyle Polich
[MINI] Entropy
16 minutes Posted Dec 16, 2016 at 8:23 am.
0:00
16:36
Download MP3
Show notes

Classically, entropy is a measure of disorder in a system. From a statistical perspective, it is more useful to say it's a measure of the unpredictability of the system. In this episode we discuss how information reduces the entropy in deciding whether or not Yoshi the parrot will like a new chew toy. A few other everyday examples help us examine why entropy is a nice metric for constructing a decision tree.