A Two-Stage Prediction-Aware Contrastive Learning Framework for Multi-Intent NLU

Benchmark Model Rank Results
intent-detection-on-mixatisRoBERTa (PACL)Accuracy: 79.1
intent-detection-on-mixatisSLIM (PACL)Accuracy: 81.9
intent-detection-on-mixatisTFMN (PACL)Accuracy: 82.9
intent-detection-on-mixsnipsRoBERTa (PACL)Accuracy: 96.5
intent-detection-on-mixsnipsSLIM (PACL)Accuracy: 96.9
intent-detection-on-mixsnipsTFMN (PACL)Accuracy: 97.4
slot-filling-on-mixatisRoBERTa (PACL)Micro F1: 86.0
slot-filling-on-mixatisSLIM (PACL)Micro F1: 87.3
slot-filling-on-mixatisTFMN (PACL)Micro F1: 86.7
slot-filling-on-mixsnipsRoBERTa (PACL)Micro F1: 96.2
slot-filling-on-mixsnipsSLIM (PACL)Micro F1: 96.8
slot-filling-on-mixsnipsTFMN (PACL)Micro F1: 96.3