TIDE: Every Layer Knows the Token Beneath the Context

Benchmark Model Rank Results
common-sense-reasoning-on-arc-easyTIDE-8E (3B)–Accuracy: 75.5
language-modelling-on-lambadaTIDE-8E (3B)–Accuracy: 70.2
question-answering-on-boolqTIDE-8E (3B)–Accuracy: 72.3
question-answering-on-piqaTIDE-8E (3B)–Accuracy: 78.3
sentence-completion-on-hellaswagTIDE-8E (3B)–Accuracy: 72.2