Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset

Benchmark Model Rank Results
action-classification-on-charadesI3D#25MAP: 32.9
action-classification-on-kinetics-400I3D#151Acc@1: 71.1Acc@5: 89.3
action-classification-on-moments-in-timeI3D#19Top 1 Accuracy: 29.51%Top 5 Accuracy: 56.06%
action-classification-on-toyota-smarthomeI3D#8CS: 53.4CV1: 34.9CV2: 45.1
action-recognition-in-videos-on-hmdb-51Two-stream I3D#10Average accuracy of 3 splits: 80.9
action-recognition-in-videos-on-hmdb-51Two-Stream I3D (Imagenet+Kinetics pre-training)#12Average accuracy of 3 splits: 80.7
action-recognition-in-videos-on-hmdb-51Flow-I3D (Kinetics pre-training)#20Average accuracy of 3 splits: 77.3
action-recognition-in-videos-on-hmdb-51Flow-I3D (Imagenet+Kinetics pre-training)#21Average accuracy of 3 splits: 77.1
action-recognition-in-videos-on-hmdb-51RGB-I3D (Imagenet+Kinetics pre-training)#25Average accuracy of 3 splits: 74.8
action-recognition-in-videos-on-hmdb-51RGB-I3D (Kinetics pre-training)#27Average accuracy of 3 splits: 74.3
action-recognition-in-videos-on-ucf101Two-Stream I3D (Imagenet+Kinetics pre-training)#63-fold Accuracy: 98.0
action-recognition-in-videos-on-ucf101Two-Stream I3D (Kinetics pre-training)#73-fold Accuracy: 97.8
action-recognition-in-videos-on-ucf101Flow-I3D (Imagenet+Kinetics pre-training)#193-fold Accuracy: 96.7
action-recognition-in-videos-on-ucf101Flow-I3D (Kinetics pre-training)#203-fold Accuracy: 96.5
action-recognition-in-videos-on-ucf101RGB-I3D (Imagenet+Kinetics pre-training)#233-fold Accuracy: 95.6
action-recognition-in-videos-on-ucf101RGB-I3D (Kinetics pre-training)#263-fold Accuracy: 95.1
action-recognition-in-videos-on-ucf101Two-stream I3D#373-fold Accuracy: 93.4
skeleton-based-action-recognition-on-j-hmdbI3D#1Accuracy (RGB+pose): 84.1
video-object-tracking-on-caterI3D-50 + LSTM#5Top 1 Accuracy: 60.2L1: 1.2Top 5 Accuracy: 81.8