Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation
Github: https://github.com/ofirpress/attention_with_linear_biases
Paper: https://ofir.io/train_short_test_long.pdf
Fairseq: https://github.com/pytorch/fairseq
👉 @bigdata_1
Post #604
640
