Learning to Encode Position for Transformer with Continuous Dynamical Model

Benchmark Model Rank Results
semantic-textual-similarity-on-mrpcFLOATER-large#4Accuracy: 91.4%
sentiment-analysis-on-sst-2-binary-classificationFLOATER-large#12Accuracy: 96.7
linguistic-acceptability-on-colaFLOATER-large#13Accuracy: 69%
machine-translation-on-wmt2014-english-frenchFLOATER-large#16BLEU score: 42.7
machine-translation-on-wmt2014-english-germanFLOATER-large#27BLEU score: 29.2