OpenCodePapers

video-prediction-on-kth

Video GenerationVideo Prediction
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeFVDSSIMPSNRLPIPSCondTrainPredParams (M)MSEDiversityModelNameReleaseDate
Accurate Grid Keypoint Learning for Efficient Video Prediction✓ Link144.20.83727.110.0921010402.0Grid-keypoints2021-07-28
Stochastic Adversarial Video Prediction✓ Link145.70.80626.000.1161010407.3SAVP-VAE (from Grid-keypoints)2018-04-04
Stochastic Video Generation with a Learned Prior✓ Link157.90.80023.910.12910104022.8SVG-LP (from Grid-keypoints)2018-02-21
Stochastic Adversarial Video Prediction✓ Link183.70.69923.790.12610104017.6SAVP (from Grid-keypoints)2018-04-04
Stochastic Variational Video Prediction✓ Link209.50.78225.870.2321010408.3SV2P time-invariant (from Grid-keypoints)2017-10-30
Stochastic Latent Residual Video Prediction✓ Link222 ± 30.8697±0.004629.69±0320.0736±0.0029101030SRVP2020-02-21
SLAMP: Stochastic Latent Appearance and Motion Prediction✓ Link228 ± 50.8646±0.005029.39±0.300.0795±0.0034101030SLAMP2021-08-05
Stochastic Variational Video Prediction✓ Link253.50.77225.700.2601010408.3SV2P time-invariant (from Grid-keypoints)2017-10-30
Stochastic Adversarial Video Prediction✓ Link374 ± 30.7564±0.006226.51±0.290.1120±0.0039101030SAVP (from SRVP)2018-04-04
Stochastic Video Generation with a Learned Prior✓ Link377 ± 60.8438±0.005428.06±0.290.0923±0.0038101030SVG-LP (from SRVP)2018-02-21
Unsupervised Learning of Object Structure and Dynamics from Videos✓ Link395.00.76624.290.1241010402.3Struct-VRNN (from Grid-keypoints)2019-06-19
Stochastic Variational Video Prediction✓ Link636 ± 10.83828.19±0.310.2049±0.0053101030SV2P (from SRVP)2017-10-30
MSPred: Video Prediction at Multiple Spatio-Temporal Scales with Hierarchical Recurrent Networks✓ Link0.95127.810.02923.18MSPred2022-03-17
Exploring Spatial-Temporal Multi-Frequency Analysis for High-Fidelity and Temporal-Consistency Video Prediction✓ Link0.89329.851020WAM2020-02-23
Eidetic 3D LSTM: A Model for Video Prediction and Beyond✓ Link0.87929.311020E3d-LSTM2019-05-01
Video Prediction Recalling Long-term Motion Context via Memory Alignment Learning✓ Link0.87927.5159.81040LMC2021-04-02
Mutual Suppression Network for Video Prediction using Disentangled Features0.87627.081020MSNET2018-04-13
PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learning✓ Link0.86528.471020PredRNN++2018-04-17
Stochastic Adversarial Video Prediction✓ Link0.85227.771020SAVP-VAE2018-04-04
VarNet: Exploring Variations for Unsupervised Video Prediction✓ Link0.84328.481020VarNet2018-10-01
PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learning✓ Link0.83928.370.1391020PredRNN-V22021-03-17
Z-Order Recurrent Neural Networks for Video Prediction0.81727.581020Znet2019-07-08
Convolutional Tensor-Train LSTM for Spatio-temporal Learning✓ Link0.81527.620.1961020Conv-TT-LSTM2020-02-21
Decomposing Motion and Content for Natural Video Sequence Prediction✓ Link0.80626.291020MCnet + Residual2017-06-25
Decomposing Motion and Content for Natural Video Sequence Prediction✓ Link0.80425.951020MCnet2017-06-25
Dynamic Filter Networks✓ Link0.79427.261020DFN2016-05-31
Deep Learning for Precipitation Nowcasting: A Benchmark and A New Model✓ Link0.79026.971020TrajGRU2017-06-12
Folded Recurrent Neural Networks for Future Video Prediction✓ Link0.77126.121020fRNN2017-12-01
Video Pixel Networks✓ Link0.74623.761020VPN2016-10-03
Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting✓ Link0.71223.580.2311020ConvLSTM2015-06-13
Diverse Video Generation using a Gaussian Process Trigger✓ Link0.483DVG2021-07-09