Attention Mechanisms

Understanding attention in neural networks

This is a sample note. Replace with your content.

Topics

• Self-attention
• Multi-head attention
• Scaled dot-product attention