Overview of the SV-Ident 2022 Shared Task on Survey Variable Identification in Social Science Publications

Benchmark Model Rank Results
variable-disambiguation-on-sv-identsentence-transformers/distiluse-base-multilingual-cased-v1#1mAP@10: 18.93
variable-disambiguation-on-sv-identSentence-T5#2mAP@10: 13.59
variable-disambiguation-on-sv-identSPARTA#3mAP@10: 11.27
variable-disambiguation-on-sv-identBM25#4mAP@10: 9.43