NLP Primer

Attention

• Visualizing a neural machine translation model 

Transformers

• [June 2017] Paper : Attention is all you need
• [April 2018] Explainer blog post : The annotated transformer
• [June 2018] Explainer blog post : The illustrated transformer

Bert

• Bert explainer
• The illustrated Bert, elmo and co : How NLP cracked transfer learning
• Paper
• Multi-lingual BERT

XLNet 

• Paper : Generalized auto-regressive pretraining for language understanding
• Code : github link
• A fair comparison study of XLNet and Bert with large models

XLM - Enhancing BERT for cross lingual language model

• XLM explainer
• How is XLM different from multilingual bert
• Paper : Cross lingual language model pretraining
• Code : github link

XLM-R

• Paper : Unsupervised cross-lingual representation learning at scale
• Code : https://github.com/pytorch/fairseq/tree/master/examples/xlmr

XTREME

• Blog : A massively multilingual multi-task benchmark for evaluating cross-lingual generalization