OnDev-LCT: On-Device Lightweight Convolutional Transformers towards federated learning

Benchmark Model Rank Results
image-classification-on-cifar-10OnDev-LCT-1/1–Percentage correct: 84.55Top-1 Accuracy: 84.55Parameters: 0.21M
image-classification-on-cifar-10OnDev-LCT-1/3–Percentage correct: 85.73Top-1 Accuracy: 85.73Parameters: 0.25M
image-classification-on-cifar-10OnDev-LCT-2/1–Percentage correct: 86.27Top-1 Accuracy: 86.27Parameters: 0.31M
image-classification-on-cifar-10OnDev-LCT-2/3–Percentage correct: 86.04Top-1 Accuracy: 86.04Parameters: 0.35M
image-classification-on-cifar-10OnDev-LCT-4/1–Percentage correct: 86.61Top-1 Accuracy: 86.61Parameters: 0.51M
image-classification-on-cifar-10OnDev-LCT-4/3–Percentage correct: 87.03Top-1 Accuracy: 87.03Parameters: 0.55M
image-classification-on-cifar-10OnDev-LCT-8/1–Percentage correct: 86.64Top-1 Accuracy: 86.64Parameters: 0.91M
image-classification-on-cifar-10OnDev-LCT-8/3–Percentage correct: 87.65Top-1 Accuracy: 87.65Parameters: 0.95M
image-classification-on-emnist-balancedOnDev-LCT-1/1–Accuracy: 89.52Trainable Parameters: 216208
image-classification-on-emnist-balancedOnDev-LCT-2/1–Accuracy: 89.18Trainable Parameters: 315792
image-classification-on-emnist-balancedOnDev-LCT-4/1–Accuracy: 89.39Trainable Parameters: 514960
image-classification-on-emnist-balancedOnDev-LCT-8/1–Accuracy: 89.55Trainable Parameters: 913296