OpenCodePapers

multimodal-machine-translation-on-multi30k

Machine TranslationMultimodal Machine Translation

Results over time

Click legend items to toggle metrics. Hover points for model names.

Leaderboard

Paper	Code	BLEU (EN-DE)	BLUE (DE-EN)	Meteor (EN-DE)	Meteor (EN-FR)	ModelName	ReleaseDate
ERNIE-UniX2: A Unified Cross-lingual Cross-modal Framework for Understanding and Generation		49.3				ERNIE-UniX2	2022-11-09
Dual-branch Prompting for Multimodal Machine Translation	✓ Link	43.12				D 2 P-MMT (R)	2025-07-23
Dual-branch Prompting for Multimodal Machine Translation	✓ Link	42.72				D 2 P-MMT (A)	2025-07-23
Distill the Image to Nowhere: Inversion Knowledge Distillation for Multimodal Machine Translation	✓ Link	41.28		58.93	77.20	IKD-MMT	2022-10-10
Dynamic Context-guided Capsule Network for Multimodal Machine Translation	✓ Link	39.7		56.8	76.4	DCCN	2020-09-04
Multimodal Machine Translation through Visuals and Speech		39.4		58.7		Caglayan	2019-11-28
Gumbel-Attention for Multi-modal Machine Translation		39.2		57.8		Gumbel-Attention MMT	2021-03-16
Multimodal Transformer for Multimodal Machine Translation	✓ Link	38.7		55.7		Multimodal Transformer	2020-07-01
Generative Imagination Elevates Machine Translation		38.4		55.7		ImagiT	2020-09-21
Distilling Translations with Visual Awareness	✓ Link	38		55.6		del+obj	2019-06-18
Latent Variable Model for Multi-modal Translation	✓ Link	37.6		56.0		VMMTF	2018-11-01
Incorporating Global Visual Features into Attention-Based Neural Machine Translation		37.3		55.1		IMGD	2017-01-23
Doubly-Attentive Decoder for Multi-modal Neural Machine Translation		37.1		54.5		NMTSRC+IMG	2017-02-04
A Visual Attention Grounding Neural Model for Multimodal Machine Translation	✓ Link	31.6		52.2	70.3	VAG-NMT	2018-08-24
Self-Knowledge Distillation with Progressive Refinement of Targets	✓ Link		32.3			PS-KD	2020-06-22
Attention Is All You Need	✓ Link		29.0			Transformer	2017-06-12
Distilling Translations with Visual Awareness	✓ Link				74.6	del	2019-06-18