DistilProtBert: A distilled protein language model used to distinguish between real proteins and their randomly shuffled counterparts

Benchmark Model Rank Results
protein-secondary-structure-prediction-on-casp12DistilProtBert#4Q3: 0.72
protein-secondary-structure-prediction-on-cb513DistilProtBert#9Q3: 0.79
protein-secondary-structure-prediction-on-ts115DistilProtBert#4Q3: 0.81