Lookahead Optimizer: k steps forward, 1 step back

Benchmark Model Rank Results
stochastic-optimization-on-cifar-10-resnet-18-200-epochsLookahead#2Accuracy: 95.27
stochastic-optimization-on-cifar-10-resnet-18-200-epochsSGD#3Accuracy: 95.23
stochastic-optimization-on-cifar-10-resnet-18-200-epochsADAM#4Accuracy: 94.84