Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training
Open paper
Benchmark
Model
Rank
Results
sparse-learning-on-imagenet
Resnet-50: 80% Sparse 100 epochs
#4
Top-1 Accuracy: 75.84
sparse-learning-on-imagenet
Resnet-50: 90% Sparse 100 epochs
#6
Top-1 Accuracy: 73.82
Rank counts only results with a code link.