OpenCodePapers
multimodal-machine-translation-on-multi30k
Multimodal Machine Translation
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
Show papers without code
Paper
Code
BLEU (EN-DE)
↕
BLUE (DE-EN)
↕
Meteor (EN-DE)
↕
Meteor (EN-FR)
↕
ModelName
ReleaseDate
↕
ERNIE-UniX2: A Unified Cross-lingual Cross-modal Framework for Understanding and Generation
49.3
ERNIE-UniX2
2022-11-09
Distill the Image to Nowhere: Inversion Knowledge Distillation for Multimodal Machine Translation
✓ Link
41.28
58.93
77.20
IKD-MMT
2022-10-10
Dynamic Context-guided Capsule Network for Multimodal Machine Translation
✓ Link
39.7
56.8
76.4
DCCN
2020-09-04
Multimodal Machine Translation through Visuals and Speech
39.4
58.7
Caglayan
2019-11-28
Gumbel-Attention for Multi-modal Machine Translation
39.2
57.8
Gumbel-Attention MMT
2021-03-16
Multimodal Transformer for Multimodal Machine Translation
✓ Link
38.7
55.7
Multimodal Transformer
2020-07-01
Generative Imagination Elevates Machine Translation
38.4
55.7
ImagiT
2020-09-21
Distilling Translations with Visual Awareness
✓ Link
38
55.6
del+obj
2019-06-18
Latent Variable Model for Multi-modal Translation
✓ Link
37.6
56.0
VMMTF
2018-11-01
Incorporating Global Visual Features into Attention-Based Neural Machine Translation
37.3
55.1
IMGD
2017-01-23
Doubly-Attentive Decoder for Multi-modal Neural Machine Translation
37.1
54.5
NMTSRC+IMG
2017-02-04
A Visual Attention Grounding Neural Model for Multimodal Machine Translation
✓ Link
31.6
52.2
70.3
VAG-NMT
2018-08-24
Self-Knowledge Distillation with Progressive Refinement of Targets
✓ Link
32.3
PS-KD
2020-06-22
Attention Is All You Need
✓ Link
29.0
Transformer
2017-06-12
Distilling Translations with Visual Awareness
✓ Link
74.6
del
2019-06-18