← Flash PapersAttention Is All You Need — Explaining the Transformer

Share this Flash Paper

Attention Is All You Need — Explaining the Transformer

https://flashpapers.ai/p/yudgctsnk7
Post to XPost to BlueskyShare on LinkedInSubmit to Hacker NewsSubmit to RedditEmail a link
Make your own
Ashish Vaswani, Noam Shazeer +6 more
cs.CL2017arXiv:1706.03762Code· 17k★· updated 3y ago
Details ▸
BLEU:28.4· WMT 2014 English-to-GermanBLEU:41.8· WMT 2014 English-to-French
Concepts:Self-AttentionTransformerDirect Preference OptimizationLoRADiffusion ModelsMixture of ExpertsRotary Position EmbeddingScaling Laws