You don't need EfficientNets. Simple tricks make ResNets better and faster than EfficientNets
Google Brain

Authors introduce a new family of ResNet architectures - ResNet-RS

🔥 Main Results
- ResNet-RSs are 1.7x - 2.7x faster than EfficientNets on TPUs, while achieving similar or better accuracies on ImageNet.
- In semi-supervised learning scenario (w/ 130M pseudo-labaled images) ResNet-RS achieves 86.2% top-1 ImageNet accuracy, while being 4.7x faster than EfficientNet-NoisyStudent
- SoTA results for transfer learning.

Continued below👇