OpenCodePapers

named-entity-recognition-ner-on-conll-2003

Named Entity Recognition (NER)
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeF1ModelNameReleaseDate
Automated Concatenation of Embeddings for Structured Prediction✓ Link94.6ACE + document-context2020-10-10
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention✓ Link94.3LUKE 483M2020-10-02
Learning from Noisy Labels for Entity-Centric Information Extraction✓ Link94.22Co-regularized LUKE2021-04-17
SubRegWeigh: Effective and Efficient Annotation Weighing with Subword Regularization✓ Link94.2LUKE + SubRegWeigh (K-means)2024-09-10
Autoregressive Structured Prediction with Language Models✓ Link94.1ASP+T5-3B2022-10-26
FLERT: Document-Level Features for Named Entity Recognition✓ Link94.09FLERT XLM-R2020-11-13
Packed Levitated Marker for Entity and Relation Extraction✓ Link94.0PL-Marker2021-09-13
Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning✓ Link93.85CL-KL2021-05-08
Named entity recognition architecture combining contextual and global features✓ Link93.82XLNet-GCN2021-12-15
SubRegWeigh: Effective and Efficient Annotation Weighing with Subword Regularization✓ Link93.81RoBERTa + SubRegWeigh (K-means)2024-09-10
Autoregressive Structured Prediction with Language Models✓ Link93.8ASP+flan-T5-large2022-10-26
InferNER: an attentive model leveraging the sentence-level information for Named Entity Recognition in Microblogs93.76InferNER2021-04-18
Exploring Cross-sentence Contexts for Named Entity Recognition with BERT✓ Link93.74Cross-sentence context (First)2020-06-02
Transformer-based Named Entity Recognition with Combined Data Representation93.69XLM-RoBERTa-large union2024-06-25
Boundary Smoothing for Named Entity Recognition✓ Link93.65Baseline + BS2022-04-26
Automated Concatenation of Embeddings for Structured Prediction✓ Link93.64ACE2020-10-10
Focusing on Potential Named Entities During Active Label Acquisition✓ Link93.6BERT-CRF2021-11-06
Cloze-driven Pretraining of Self-attention Networks93.5CNN Large + fine-tune2019-03-19
Named Entity Recognition as Dependency Parsing✓ Link93.5Biaffine-NER2020-05-14
GCDT: A Global Context Enhanced Deep Transition Architecture for Sequence Labeling✓ Link93.47GCDT + BERT-L2019-06-06
Improved Differentiable Architecture Search for Language Modeling and Named Entity Recognition✓ Link93.47I-DARTS + Flair2019-11-01
CrossWeigh: Training Named Entity Tagger from Imperfect Annotations✓ Link93.43CrossWeigh + Pooled Flair2019-09-03
Neural Architectures for Nested NER through Linearization✓ Link93.38LSTM-CRF+ELMo+BERT+Flair2019-08-19
Hierarchical Contextualized Representation for Named Entity Recognition✓ Link93.37Hierarchical + BERT2019-11-06
Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning✓ Link93.35BERT-CRF (Replicated in AdaSeq)2021-05-08
Dice Loss for Data-imbalanced NLP Tasks✓ Link93.33BERT-MRC+DSC2019-11-07
Named entity recognition architecture combining contextual and global features✓ Link93.28XLNet2021-12-15
A Unified Generative Framework for Various NER Subtasks✓ Link93.24BARTNER2021-06-02
GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extraction✓ Link93.1GoLLIE2023-10-05
Contextual String Embeddings for Sequence Labeling✓ Link93.09Flair embeddings2018-08-01
PromptNER: Prompt Locating and Typing for Named Entity Recognition✓ Link93.08PromptNER [RoBERTa-large]2023-05-26
Unified Named Entity Recognition as Word-Word Relation Classification✓ Link93.07W2NER2021-12-19
A Unified MRC Framework for Named Entity Recognition✓ Link93.04BERT-MRC2019-10-25
Locate and Label: A Two-stage Identifier for Nested Named Entity Recognition✓ Link92.94Locate and Label2021-05-14
Parallel Instance Query Network for Named Entity Recognition✓ Link92.87PIQN2022-03-20
DiffusionNER: Boundary Diffusion for Named Entity Recognition✓ Link92.78DiffusionNER2023-05-22
Towards Improving Neural Named Entity Recognition with Gazetteers✓ Link92.75HSCRF + softdict2019-07-01
TENER: Adapting Transformer Encoder for Named Entity Recognition✓ Link92.62TENER2019-11-10
Semi-Supervised Sequence Modeling with Cross-View Training✓ Link92.61CVT + Multi-Task2018-09-22
Semi-Supervised Sequence Modeling with Cross-View Training✓ Link92.61CVT + Multi-Task + Large2018-09-22
Joint Learning of Named Entity Recognition and Entity Linking92.43Stack LSTM2019-07-18
PromptNER: Prompt Locating and Typing for Named Entity Recognition✓ Link92.41PromptNER [BERT-large]2023-05-26
Dependency-Guided LSTM-CRF for Named Entity Recognition✓ Link92.4DGLSTM-CRF + ELMo (L=2) 3.0pt1-4.51.52019-09-23
GRN: Gated Relation Network to Enhance Convolutional Neural Network for Named Entity Recognition✓ Link92.34GRN2019-07-12
Evaluating the Utility of Hand-crafted Features in Sequence Labelling✓ Link92.29Neural-CRF+AE2018-08-28
Multi-Grained Named Entity Recognition✓ Link92.28MGNER2019-06-20
Deep contextualized word representations✓ Link92.22BiLSTM-CRF+ELMo2018-02-15
Generalizing Natural Language Analysis through Span-relation Representations✓ Link92.2SpanRel2019-11-10
Efficient Contextualized Representation: Language Model Pruning for Sequence Labeling✓ Link92.03LD-Net2018-04-20
GCDT: A Global Context Enhanced Deep Transition Architecture for Sequence Labeling✓ Link91.96GCDT2019-06-06
Hierarchical Contextualized Representation for Named Entity Recognition✓ Link91.96Hierarchical2019-11-06
Evaluating the Utility of Hand-crafted Features in Sequence Labelling✓ Link91.87CRF + AutoEncoder2018-08-28
A Prism Module for Semantic Disentanglement in Name Entity Recognition✓ Link91.8PRISM2019-07-01
[]()91.74GraphIE (GCN+BiLSTM)
Robust Lexical Features for Improved Neural Network Named-Entity Recognition✓ Link91.73Bi-LSTM-CRF + Lexical Features2018-06-09
Learning Better Internal Structure of Words for Sequence Labeling91.64IntNet + BiLSTM-CRF2018-10-29
Neural Reranking for Named Entity Recognition✓ Link91.62Yang et al. ([2017a])2017-07-17
Named Entity Recognition with Bidirectional LSTM-CNNs✓ Link91.62Bi-LSTM-CNN2015-11-26
Sentence-State LSTM for Text Representation✓ Link91.57S-LSTM2018-05-07
Long Short-Term Memory with Dynamic Skip Connections✓ Link91.56LSTM with dynamic skip2018-11-09
Robust Multilingual Part-of-Speech Tagging via Adversarial Training✓ Link91.56Adversarial Bi-LSTM2017-11-14
Hybrid semi-Markov CRF for Neural Sequence Labeling✓ Link91.38HSCRF2018-05-10
Robust Multilingual Named Entity Recognition with Shallow Semi-Supervised Features✓ Link91.36IXA pipes2017-01-31
NCRF++: An Open-source Neural Sequence Labeling Toolkit✓ Link91.35NCRF++2018-06-14
Transfer Learning for Sequence Tagging with Hierarchical Recurrent Networks✓ Link91.26Yang et al.2017-03-18
Empower Sequence Labeling with Task-Aware Neural Language Model✓ Link91.24LM-LSTM-CRF2017-09-13
A Deep Neural Network Model for the Task of Named Entity Recognition✓ Link91.22Bi-LSTM-CNN-CRF2018-02-01
End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF✓ Link91.21BLSTM-CNN-CRF2016-03-04
Harnessing Deep Neural Networks with Logic Rules✓ Link91.18Bi-LSTM + Logic rules2016-03-21
Neural Architectures for Named Entity Recognition✓ Link90.94LSTM-CRF2016-03-04
Named entity recognition architecture combining contextual and global features✓ Link88.63GCN2021-12-15
Baseline Needs More Love: On Simple Word-Embedding-Based Models and Associated Pooling Mechanisms✓ Link86.28SWEM-CRF2018-05-24
Variational Sequential Labelers for Semi-Supervised Learning✓ Link84.7VSL-GG-Hier2019-06-23