Fixup Initialization: Residual Learning Without Normalization

Open paper
Benchmark Model Rank Results
image-classification-on-cifar-10WRN + fixup init + mixup + cutout#74Percentage correct: 97.7
image-classification-on-svhnWRN + fixup init + mixup + cutout#8Percentage error: 1.4

Rank counts only results with a code link.