OpenCodePapers

neural-architecture-search-on-imagenet

AutoMLNeural Architecture Search
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
Click a sortable column header to sort.
PaperCodeTop-1 Error RateAccuracyParamsMACsFLOPsModelNameReleaseDate
DeepMAD: Mathematical Architecture Design for Deep Convolutional Neural Network✓ Link16.183.950M8.7GDeepMAD-50M2023-03-05
Zen-NAS: A Zero-Shot NAS for High-Performance Deep Image Recognition✓ Link16.483.6180M22GZenNAS (1.2ms)2021-02-01
GPUNet: Searching the Deployable Convolution Neural Networks for GPUs✓ Link16.419M15.6GGPUNet-D32022-04-26
GPUNet: Searching the Deployable Convolution Neural Networks for GPUs✓ Link17.510.6M3.66GGPUNet-D12022-04-26
FBNetV3: Joint Architecture-Recipe Search using Predictor Pretraining✓ Link17.782.32.0GFBNetV3-G2020-06-03
BossNAS: Exploring Hybrid CNN-transformers with Block-wisely Self-supervised Neural Architecture Search✓ Link17.882.210.5GBossNet-T1+2021-03-23
NASViT: Neural Architecture Search for Efficient Vision Transformers with Gradient Conflict aware Supernet Training✓ Link18.281.8757MNASViT-A52021-09-29
FBNetV5: Neural Architecture Search for Multiple Tasks in One Run18.2726MFBNetV52021-11-19
FBNetV5: Neural Architecture Search for Multiple Tasks in One Run18.381.7685MFBNetV5-A-CLS2021-11-19
NASViT: Neural Architecture Search for Efficient Vision Transformers with Gradient Conflict aware Supernet Training✓ Link18.681.4591MNASViT-A42021-09-29
NASViT: Neural Architecture Search for Efficient Vision Transformers with Gradient Conflict aware Supernet Training✓ Link19.081.0528MNASViT-A32021-09-29
AlphaNet: Improved Training of Supernets with Alpha-Divergence✓ Link19.280.8709MAlphaNet-A62021-02-16
UniNet: Unified Architecture Search with Convolution, Transformer, and MLP✓ Link19.211.5M555MUniNet-B02022-07-12
AlphaNet: Improved Training of Supernets with Alpha-Divergence✓ Link19.480.6596MAlphaNet-A5 (base)2021-02-16
Neural Architecture Transfer✓ Link19.580.59.1M600MNAT-M42020-05-12
NASViT: Neural Architecture Search for Efficient Vision Transformers with Gradient Conflict aware Supernet Training✓ Link19.580.5421MNASViT-A22021-09-29
NSGANetV2: Evolutionary Multi-Objective Surrogate-Assisted Neural Architecture Search✓ Link19.680.48.7M593MNSGANetV2-xl2020-07-20
FBNetV3: Joint Architecture-Recipe Search using Predictor Pretraining✓ Link19.680.4752MFBNetV3-E2020-06-03
AlphaNet: Improved Training of Supernets with Alpha-Divergence✓ Link19.780.3491MAlphaNet-A5 (small)2021-02-16
ISyNet: Convolutional Neural Networks design for AI accelerator✓ Link19.84ISyNet-N32021-09-04
HardCoRe-NAS: Hard Constrained diffeRentiable Neural Architecture Search✓ Link19.980.1330MHardcoreNAS_E_KD2021-02-23
AttentiveNAS: Improving Neural Architecture Search via Attentive Sampling✓ Link19.980.1491MAttentiveNAS-A52020-11-18
AlphaNet: Improved Training of Supernets with Alpha-Divergence✓ Link20.080.0444MAlphaNet-A42021-02-16
Neural Architecture Transfer✓ Link20.179.99.1M490MNAT-M32020-05-12
AttentiveNAS: Improving Neural Architecture Search via Attentive Sampling✓ Link20.279.8444MAttentiveNAS-A42020-11-18
SEDONA: Search for Decoupled Neural Networks toward Greedy Block-wise Learning✓ Link20.2SEDONA (ResNet-152 Aux. Ens., K=4)2021-01-01
NASViT: Neural Architecture Search for Efficient Vision Transformers with Gradient Conflict aware Supernet Training✓ Link20.379.7309MNASViT-A12021-09-29
GPUNet: Searching the Deployable Convolution Neural Networks for GPUs✓ Link20.36.2M720MGPUNet-D02022-04-26
FBNetV3: Joint Architecture-Recipe Search using Predictor Pretraining✓ Link20.479.6544MFBNetV3-C2020-06-03
BigNAS: Scaling Up Neural Architecture Search with Big Single-Stage Models✓ Link20.579.56.4M586MBigNASModel-L2020-03-24
HardCoRe-NAS: Hard Constrained diffeRentiable Neural Architecture Search✓ Link20.579.5290MHardcoreNAS_D_KD2021-02-23
ISyNet: Convolutional Neural Networks design for AI accelerator✓ Link20.59ISyNet-N22021-09-04
AlphaNet: Improved Training of Supernets with Alpha-Divergence✓ Link20.679.4357MAlphaNet-A32021-02-16
AlphaNet: Improved Training of Supernets with Alpha-Divergence✓ Link20.879.2317MAlphaNet-A22021-02-16
NSGANetV2: Evolutionary Multi-Objective Surrogate-Assisted Neural Architecture Search✓ Link20.979.18.0M400MNSGANetV2-l2020-07-20
AttentiveNAS: Improving Neural Architecture Search via Attentive Sampling✓ Link20.979.1357MAttentiveNAS-A32020-11-18
AlphaNet: Improved Training of Supernets with Alpha-Divergence✓ Link21.079.0279MAlphaNet-A12021-02-16
SEDONA: Search for Decoupled Neural Networks toward Greedy Block-wise Learning✓ Link21.09SEDONA (ResNet-152, K=4)2021-01-01
BigNAS: Scaling Up Neural Architecture Search with Big Single-Stage Models✓ Link21.178.95.5M418MBigNASModel-M2020-03-24
HardCoRe-NAS: Hard Constrained diffeRentiable Neural Architecture Search✓ Link21.178.9270MHardcoreNAS_C_KD2021-02-23
HardCoRe-NAS: Hard Constrained diffeRentiable Neural Architecture Search✓ Link21.278.8250MHardcoreNAS_B_KD2021-02-23
AttentiveNAS: Improving Neural Architecture Search via Attentive Sampling✓ Link21.278.8317MAttentiveNAS-A22020-11-18
$μ$DARTS: Model Uncertainty-Aware Differentiable Architecture Search21.2478.76602MμDARTS2021-07-24
Neural Architecture Transfer✓ Link21.478.67.7M312MNAT-M22020-05-12
LayerNAS: Neural Architecture Search in Polynomial Complexity21.49.7M627MLayerNAS-600M2023-04-23
ISyNet: Convolutional Neural Networks design for AI accelerator✓ Link21.45ISyNet-N1-S32021-09-04
Blockwisely Supervised Neural Architecture Search with Knowledge Distillation✓ Link21.678.46.4M611MDNA-d2019-11-29
AttentiveNAS: Improving Neural Architecture Search via Attentive Sampling✓ Link21.678.4279MAttentiveNAS-A12020-11-18
NSGANetV2: Evolutionary Multi-Objective Surrogate-Assisted Neural Architecture Search✓ Link21.778.37.7M312MNSGANetV2-m2020-07-20
HardCoRe-NAS: Hard Constrained diffeRentiable Neural Architecture Search✓ Link21.778.3220MHardcoreNAS_A_KD2021-02-23
NASViT: Neural Architecture Search for Efficient Vision Transformers with Gradient Conflict aware Supernet Training✓ Link21.878.2208MNASViT-A02021-09-29
HardCoRe-NAS: Hard Constrained diffeRentiable Neural Architecture Search✓ Link21.978.1340MHardcoreNAS_F2021-02-23
FBNetV3: Joint Architecture-Recipe Search using Predictor Pretraining✓ Link22.078.0343MFBNetV3-A2020-06-03
Noisy Differentiable Architecture Search✓ Link22.177.95.5M449MNoisyDARTS-A2020-05-07
AlphaNet: Improved Training of Supernets with Alpha-Divergence✓ Link22.177.9203MAlphaNet-A02021-02-16
HardCoRe-NAS: Hard Constrained diffeRentiable Neural Architecture Search✓ Link22.177.9330MHardcoreNAS_E2021-02-23
ISyNet: Convolutional Neural Networks design for AI accelerator✓ Link22.15ISyNet-N1-S22021-09-04
Blockwisely Supervised Neural Architecture Search with Knowledge Distillation✓ Link22.277.85.3M466MDNA-c2019-11-29
Zen-NAS: A Zero-Shot NAS for High-Performance Deep Image Recognition✓ Link22.277.830.11.7GZenNAS (0.1ms)2021-02-01
Neural Architecture Search for Lightweight Non-Local Networks✓ Link22.377.7AutoNL-L2020-04-04
AtomNAS: Fine-Grained End-to-End Neural Architecture Search✓ Link22.477.65.9M363MAtomNAS-C+†2019-12-20
Neural Architecture Transfer✓ Link22.577.56.0M225MNAT-M12020-05-12
Blockwisely Supervised Neural Architecture Search with Knowledge Distillation✓ Link22.577.54.9M406MDNA-b2019-11-29
NSGANetV2: Evolutionary Multi-Objective Surrogate-Assisted Neural Architecture Search✓ Link22.677.46.1M225MNSGANetV2-s2020-07-20
HardCoRe-NAS: Hard Constrained diffeRentiable Neural Architecture Search✓ Link22.677.4290MHardcoreNAS_D2021-02-23
AttentiveNAS: Improving Neural Architecture Search via Attentive Sampling✓ Link22.777.3203MAttentiveNAS-A02020-11-18
ISyNet: Convolutional Neural Networks design for AI accelerator✓ Link22.7ISyNet-N1-S12021-09-04
AtomNAS: Fine-Grained End-to-End Neural Architecture Search✓ Link22.877.25.5M329MAtomNAS-B+†2019-12-20
FBNetV5: Neural Architecture Search for Multiple Tasks in One Run22.877.2215MFBNetV5-AR-CLS2021-11-19
FBNetV2: Differentiable Neural Architecture Search for Spatial and Channel Dimensions✓ Link22.877.2325MFBNetV2-L12020-04-12
Fair DARTS: Eliminating Unfair Advantages in Differentiable Architecture Search✓ Link22.8386MFairDARTS-C2019-11-27
GreedyNAS: Towards Fast One-Shot NAS with Greedy Supernet22.977.16.5MGreedyNAS-A2020-03-25
Blockwisely Supervised Neural Architecture Search with Knowledge Distillation✓ Link22.977.14.2M348MDNA-a2019-11-29
HardCoRe-NAS: Hard Constrained diffeRentiable Neural Architecture Search✓ Link22.977.1270MHardcoreNAS_C2021-02-23
LayerNAS: Neural Architecture Search in Polynomial Complexity22.95.2M322MLayerNAS-300M2023-04-23
SCARLET-NAS: Bridging the Gap between Stability and Scalability in Weight-sharing Neural Architecture Search✓ Link23.176.96.7M365MSCARLET-A2019-08-16
Once-for-All: Train One Network and Specialize it for Efficient Deployment✓ Link23.176.9230MOFA w/ PS #752019-08-26
ISyNet: Convolutional Neural Networks design for AI accelerator✓ Link23.16ISyNet-N12021-09-04
GreedyNAS: Towards Fast One-Shot NAS with Greedy Supernet23.276.85.2MGreedyNAS-B2020-03-25
MUXConv: Information Multiplexing in Convolutional Neural Networks✓ Link23.476.64.0M318MMUXNet-l2020-03-31
Accuracy Prediction with Non-neural Model for Neural Architecture Search✓ Link23.576.56.4M577MGBDT-NAS-3S2020-07-09
BigNAS: Scaling Up Neural Architecture Search with Big Single-Stage Models✓ Link23.576.54.5M242MBigNASModel-S2020-03-24
Semi-Supervised Neural Architecture Search✓ Link23.576.5SemiNAS2020-02-24
Neural Architecture Search for Lightweight Non-Local Networks✓ Link23.576.5AutoNL-S2020-04-04
HardCoRe-NAS: Hard Constrained diffeRentiable Neural Architecture Search✓ Link23.576.5250MHardcoreNAS_B2021-02-23
SCARLET-NAS: Bridging the Gap between Stability and Scalability in Weight-sharing Neural Architecture Search✓ Link23.776.36.5M329MSCARLET-B2019-08-16
AtomNAS: Fine-Grained End-to-End Neural Architecture Search✓ Link23.776.34.7M260MAtomNAS-A+†2019-12-20
DrNAS: Dirichlet Neural Architecture Search✓ Link23.75.7MDrNAS2020-06-18
GreedyNAS: Towards Fast One-Shot NAS with Greedy Supernet23.876.24.7MGreedyNAS-C2020-03-25
EEEA-Net: An Early Exit Evolutionary Neural Architecture Search✓ Link23.876.2EEEA-Net-C2 (b=7) (our)2021-08-13
MSR-DARTS: Minimum Stable Rank of Differentiable Architecture Search23.976.15.6M632MMSR-DARTS (CIFAR-10)2020-09-19
Shapley-NAS: Discovering Operation Contribution for Neural Architecture Search✓ Link23.95.4M582MShapley-NAS2022-06-20
$β$-DARTS: Beta-Decay Regularization for Differentiable Architecture Search✓ Link23.9b-DARTS (CIFAR-10)2022-03-03
Densely Connected Search Space for More Flexible Neural Architecture Search✓ Link23.9479MDenseNAS-Large2019-06-23
sharpDARTS: Faster and More Accurate Differentiable Architecture Search✓ Link24.076.08.3M950MsharpDARTS2019-03-23
FBNetV2: Differentiable Neural Architecture Search for Spatial and Channel Dimensions✓ Link24.076.0238MFBNetV2-F42020-04-12
Geometry-Aware Gradient Algorithms for Neural Architecture Search✓ Link245.6GAEA PC-DARTS2020-04-16
A Generic Graph-based Neural Architecture Encoding Scheme for Predictor-based NAS✓ Link24.175.95.6MGATES2020-04-04
SGAS: Sequential Greedy Architecture Search✓ Link24.175.95.4M598MSGAS2019-11-30
DU-DARTS: Decreasing the Uncertainty of Differentiable Architecture Search✓ Link24.175.95.3MDU-DARTS2021-11-23
HardCoRe-NAS: Hard Constrained diffeRentiable Neural Architecture Search✓ Link24.175.9220MHardcoreNAS_A2021-02-23
PC-DARTS: Partial Channel Connections for Memory-Efficient Architecture Search✓ Link24.275.85.3M597MPC-DARTS (ImageNet)2019-07-12
SCARLET-NAS: Bridging the Gap between Stability and Scalability in Weight-sharing Neural Architecture Search✓ Link24.475.66.0M280MSCARLET-C2019-08-16
Evolving Neural Architecture Using One Shot Model✓ Link24.475.65.3599EvNAS-B2020-12-23
Evolving Neural Architecture Using One Shot Model✓ Link24.475.65.1570EvNAS-A2020-12-23
LayerNAS: Neural Architecture Search in Polynomial Complexity24.45.1M229MLayerNAS-220M2023-04-23
AlphaX: eXploring Neural Architectures with Deep Neural Networks and Monte Carlo Tree Search✓ Link24.575.55.4MAlphaX-12019-03-26
ISyNet: Convolutional Neural Networks design for AI accelerator✓ Link24.55ISyNet-N02021-09-04
[]()24.5775.43Evo-NAS
FairNAS: Rethinking Evaluation Fairness of Weight Sharing Neural Architecture Search✓ Link24.775.344.6M388MFairNAS-A2019-07-03
MUXConv: Information Multiplexing in Convolutional Neural Networks✓ Link24.775.33.4M218MMUXNet-m2020-03-31
iDARTS: Improving DARTS by Node Normalization and Decorrelation Discretization24.75.1M568MiDARTS (ImageNet)2021-08-25
ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware✓ Link24.975.15.1M581MProxylesNAS2018-12-02
FairNAS: Rethinking Evaluation Fairness of Weight Sharing Neural Architecture Search✓ Link24.975.14.5M345MFairNAS-B2019-07-03
Evolving Neural Architecture Using One Shot Model✓ Link25.174.94.9547EvNAS-C2020-12-23
sharpDARTS: Faster and More Accurate Differentiable Architecture Search✓ Link25.174.14.9M573MSharpSepConvDARTS2019-03-23
iDARTS: Improving DARTS by Node Normalization and Decorrelation Discretization25.25.1M578MiDARTS (CIFAR-10)2021-08-25
Exploring Randomly Wired Neural Networks for Image Recognition✓ Link25.35.6M583MRandWire-WS (small)2019-04-02
FairNAS: Rethinking Evaluation Fairness of Weight Sharing Neural Architecture Search✓ Link25.474.694.4M321MFairNAS-C2019-07-03
EEEA-Net: An Early Exit Evolutionary Neural Architecture Search✓ Link25.774.3EEEA-Net-C1 (b=7) (our)2021-08-13
MemNAS: Memory-Efficient Neural Architecture Search With Grow-Trim Learning✓ Link25.974.1MemNAS2020-06-01
[]()26.074.05.3581GDAS
How does topology of neural architectures impact gradient propagation and model performance?✓ Link26.773.33.7M393M393MNN-MASS-B2021-06-16
DARTS: Differentiable Architecture Search✓ Link26.773.34.9595MDARTS2018-06-24
FBNetV2: Differentiable Neural Architecture Search for Spatial and Channel Dimensions✓ Link26.873.2126MFBNetV2-F32020-04-12
How does topology of neural architectures impact gradient propagation and model performance?✓ Link27.172.92.3M200M200MNN-MASS-A2021-06-16
MUXConv: Information Multiplexing in Convolutional Neural Networks✓ Link28.471.62.4M117MMUXNet-s2020-03-31
Optimizing Neural Architecture Search using Limited GPU Time in a Dynamic Search Space: A Gene Expression Programming Approach✓ Link29.5170.49NASGEP2020-05-15
LayerNAS: Neural Architecture Search in Polynomial Complexity313.7M61MLayerNAS-60M2023-04-23
FBNetV2: Differentiable Neural Architecture Search for Spatial and Channel Dimensions✓ Link31.768.356MFBNetV2-F12020-04-12
MUXConv: Information Multiplexing in Convolutional Neural Networks✓ Link33.366.71.8M66MMUXNet-xs2020-03-31
Single Path One-Shot Neural Architecture Search with Uniform Sampling✓ Link75.3465MSPOS (ProxylessNAS (GPU) latency)2019-03-31
Single Path One-Shot Neural Architecture Search with Uniform Sampling✓ Link75.1375MSPOS (FBNet-C latency)2019-03-31
Single Path One-Shot Neural Architecture Search with Uniform Sampling✓ Link74.7328MSPOS (block search + channel search)2019-03-31
Progressive Neural Architecture Search✓ Link5.1PNAS2017-12-02
Check out how to contribute new results.