Data Science at Home
Data Science at Home
Francesco Gadaleta
More powerful deep learning with transformers (Ep. 84)
37 minutes Posted Oct 27, 2019 at 6:59 am.
0:00
37:44
Download MP3
Show notes

Some of the most powerful NLP models like BERT and GPT-2 have one thing in common: they all use the transformer architecture.

Such architecture is built on top of another important concept already known to the community: self-attention.
In this episode I explain what these mechanisms are, how they work and why they are so powerful.

Don't forget to subscribe to our Newsletter or join the discussion on our Discord server

 

References