Language Models Can Control Their Own Attention Paper • 2609.02737 • Published 17 days ago • 75
RoFormer: Enhanced Transformer with Rotary Position Embedding Paper • 2104.09864 • Published Apr 20, 2021 • 19