Interesting work from Ross Wightman comparing something like EfficientNet / ResNet which uses only Imagenet data to the Facebook-IG ResNext that was trained on a lot of instagram public data. While their validation scores are close, the test scores seem to diverge more.

FacebookAI ResNeXt models pre-trained on Instagram hashtags stand out in their ability to generalized to the 'ImageNetV2' test set.
#PyTorch
https://colab.research.google.com/github/rwightman/pytorch-image-models/blob/master/notebooks/GeneralizationToImageNetV2.ipynb

✴️ @AI_Python_EN