Old Dog, New Tricks: ResNet-50 Beats New Architectures

Cool paper where over dozen tricks are applied to train ResNet-50 and that beats previous architectural innovations. This is “old” paper, newer tricks are more powerful! This is likely the only DL paper where word “trick” is explicitly mentioned 13 times.

https://arxiv.org/abs/1812.01187

Discussion