XNLI and MLQA needs bidirectional context, and multifit is unidirectional since it uses casual language modeling and RNNs. But it is on the todo list just below of training multifit in zeroshoot scenario with XLM as a teacher model.
❇ @AI_Python_EN
Post #1994
965
AI, Python, Cognitive Neuroscience Did you run any experiments in XNLI? Also curious how it compares to XLM. Also, shameless plug for the cross-lingual QA dataset we just released, MLQA https://github.com/facebookresearch/MLQA - could be a great testbed for models like this ❇ @AI_Python_EN