Daily Archives: May 25, 2020


Transformer Notes

Blog : http://jalammar.github.io/illustrated-transformer/ Paper: Attention is all you need What is transformer From 1000 fts, it converts input to output. (usually used in machine translation) From 100 fts, it consists of multiple layers of encoders and decoders. From 10 fts, there are 6 layers of encoders and decoders. from 1 […]