OpenCodePapers

text-to-video-generation-on-msr-vtt

Text-to-Video Generation
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
Click a sortable column header to sort.
PaperCodeFVDCLIPSIMCLIP-FIDFIDModelNameReleaseDate
Snap Video: Scaled Spatiotemporal Transformers for Text-to-Video Synthesis104.00.27939.35Snap Video (512x288)2024-02-22
Snap Video: Scaled Spatiotemporal Transformers for Text-to-Video Synthesis110.40.27938.48Snap Video (288×288)2024-02-22
Video-LaVIT: Unified Video-Language Pre-training with Decoupled Visual-Motional Tokenization✓ Link188.360.301211.27Video-LaVIT2024-02-05
VideoPoet: A Large Language Model for Zero-Shot Video Generation2130.3123VideoPoet2023-12-21
Make Pixels Dance: High-Dynamic Video Generation3810.3125PixelDance2023-11-18
Hierarchical Spatio-temporal Decoupling for Text-to-Video Generation✓ Link4060.29478.60HiGen2023-12-07
A Recipe for Scaling up Text-to-Video Generation with Text-free Videos✓ Link4410.29918.19TF-T2V2023-12-25
Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation✓ Link5380.307213.08Show-12023-09-27
ModelScope Text-to-Video Technical Report✓ Link5500.293011.09ModelScopeT2V2023-08-12
VideoComposer: Compositional Video Synthesis with Motion Controllability✓ Link5800.2932VideoComposer2023-06-03
MagicVideo: Efficient Video Generation With Latent Diffusion Models99836.5MagicVideo2022-11-20
Make-A-Video: Text-to-Video Generation without Text-Video Data✓ Link0.304913.1713.17Make-A-Video2022-09-29
Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models✓ Link0.2929Video LDM2023-04-18
Tell Me What Happened: Unifying Text-guided Video Completion via Multimodal Masked Video Generation✓ Link0.264423.4MMVG2022-11-23
Make-A-Video: Text-to-Video Generation without Text-Video Data✓ Link0.263123.5923.59CogVideo (English)2022-09-29
Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models✓ Link0.261424.78CogVideo (Chinese)2023-04-18
NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion✓ Link0.243947.6847.68NUWA2021-11-24
GODIVA: Generating Open-DomaIn Videos from nAtural Descriptions✓ Link0.2402GODIVA2021-04-30
Check out how to contribute new results.