Attention and Transformers

Lecture Video (Portuguese)

• Attention and Transformers

Slides (English)

• Attention and Transformers

Code (Google Colab, Notebooks and More)

• PyTorch: Transformer Illustration and code

• PyTorch: nn.Transformer Tutorial

• PyTorch: Object Detection with DETR - a minimal implementation

• Hugging Face: Fine-tuning a pretrained model

• Hugging Face: Transformers Notebooks

• Hugging Face: Examples

Additional Resources

• Transformer: A Novel Neural Network Architecture for Language Understanding

• The Illustrated Transformer

• The Annotated Transformer

• Transformers from Scratch