← Flash PapersRoFormer: Enhanced Transformer with Rotary Position Embedding

Share this Flash Paper

RoFormer: Enhanced Transformer with Rotary Position Embedding

https://flashpapers.ai/p/82rwdvghqq
Post to XPost to BlueskyShare on LinkedInSubmit to Hacker NewsSubmit to RedditEmail a link
Make your own
Jianlin Su, Yu Lu +4 more
cs.CL2021arXiv:2104.09864Code· 1.1k★· updated 4y ago
Details ▸
BLEU:27.5· WMT 2014 English-to-GermanAccuracy:69.79%· CAIL2019-SCM
Concepts:Rotary Position EmbeddingSelf-Attention