The first high-performance self-supervised algorithm that works for speech, vision, and text

Github: https://github.com/pytorch/fairseq/tree/main/examples/data2vec

Paper: https://ai.facebook.com/research/data2vec-a-general-framework-for-self-supervised-learning-in-speech-vision-and-language

Meta AI: https://ai.facebook.com/blog/the-first-high-performance-self-supervised-algorithm-that-works-for-speech-vision-and-text/

👉 @bigdata_1