Linear Digressions
Linear Digressions
Katie Malone
KL Divergence
25 minutes Posted Aug 7, 2017 at 3:07 am.
0:00
25:38
Download MP3
Show notes
Kullback Leibler divergence, or KL divergence, is a measure of information loss when you try to approximate one distribution with another distribution.  It comes to us originally from information theory, but today underpins other, more machine-learning-focused algorithms like t-SNE.  And boy oh boy can it be tough to explain.  But we're trying our hardest in this episode!