OpenCodePapers

temporal-action-localization-on-activitynet

Action LocalizationTemporal Action Localization
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodemAPmAP IOU@0.5mAP IOU@0.75mAP IOU@0.95ModelNameReleaseDate
Enhancing Temporal Action Localization: Advanced S6 Modeling with Recurrent Mechanism✓ Link42.964.144.010.6RDFA-S6 (InternVideo2-6B)2024-07-18
Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understanding✓ Link42.0262.4343.4910.23ActionMamba (InternVideo2-6B)2024-03-14
Proposal Relation Network for Temporal Action Detection✓ Link42.059.7PRN+BMN (ensemble)2021-06-20
End-to-End Temporal Action Detection with 1B Parameters Across 1000 Frames✓ Link41.9361.7243.3510.85AdaTAD (VideoMAEv2-giant)2023-11-28
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding✓ Link41.2InternVideo2-6B2024-03-22
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding✓ Link40.4InternVideo2-1B2024-03-22
UniMD: Towards Unifying Moment Retrieval and Temporal Action Detection✓ Link39.8360.29UniMD+Sync.2024-04-07
Proposal Relation Network for Temporal Action Detection✓ Link39.457.9PRN (CSN)2021-06-20
InternVideo: General Video Foundation Models via Generative and Discriminative Learning✓ Link39.00InternVideo2022-12-06
Temporal Context Aggregation Network for Temporal Action Proposal Refinement✓ Link37.5654.3339.138.41TCANet (SlowFast R101)2021-03-24
Proposal Relation Network for Temporal Action Detection✓ Link37.555.5PRN (ViViT)2021-06-20
Hear Me Out: Fusional Approaches for Audio Augmented Temporal Action Localization✓ Link36.8254.3437.668.93AVFusion2021-06-27
TriDet: Temporal Action Detection with Relative Boundary Modeling✓ Link36.854.738.08.4TriDet (TSP features)2023-03-13
End-to-end Temporal Action Detection with Transformer✓ Link36.7553.6237.5210.56TadTR (TSP features)2021-06-18
ActionFormer: Localizing Moments of Actions with Transformers✓ Link36.654.737.88.4ActionFormer (TSP feautures)2022-02-16
Proposal-Free Temporal Action Detection via Global Segmentation Mask Learning✓ Link36.5TAGS (I3D)2022-07-14
Video Self-Stitching Graph Network for Temporal Action Localization✓ Link35.9453.2636.768.12VSGN (TSP features)2020-11-30
TSP: Temporally-Sensitive Pretraining of Video Encoders for Localization Tasks✓ Link35.8151.2637.129.29TSP2020-11-23
Improve Temporal Action Proposals using Hierarchical Context35.6152.5136.107.12HCN(I3D features)2023-04-03
DCAN: Improving Temporal Action Detection via Dual Context Aggregation✓ Link35.3951.7835.989.45DCAN (TSN features)2021-12-07
An Empirical Study of End-to-End Temporal Action Detection✓ Link35.1050.4735.9910.83E2E-TAD (SlowFast R50+TadTR)2022-04-06
Low-Fidelity Video Encoder Optimization for Temporal Action Localization34.9650.9135.868.79LoFi+G-TAD2021-12-01
BSN++: Complementary Boundary Regressor with Scale-Balanced Relation Modeling for Temporal Action Proposal Generation✓ Link34.8851.2735.708.33BSN++2020-09-15
Boundary-sensitive Pre-training for Temporal Localization in Videos✓ Link34.7550.9435.617.98G-TAD+BSP2020-11-21
Self-Supervised Learning for Semi-Supervised Temporal Action Proposal✓ Link34.4850.7235.287.87SSTAP@100%+2021-04-07
Boundary Content Graph Neural Network for Temporal Action Proposal Generation34.2650.5634.759.37BC-GNN2020-08-04
Graph Convolutional Module for Temporal Action Localization in Videos34.2451.0335.177.44GCM2021-12-01
G-TAD: Sub-Graph Localization for Temporal Action Detection✓ Link34.0950.3634.609.02G-TAD2019-11-26
BMN: Boundary-Matching Network for Temporal Action Proposal Generation✓ Link33.8550.0734.788.29BMN2019-07-23
A Pursuit of Temporal Accuracy in General Activity Detection✓ Link32.2639.12SSN2017-03-08
Graph Convolutional Networks for Temporal Action Localization✓ Link31.1148.2633.163.27P-GCN2019-09-07
BSN: Boundary Sensitive Network for Temporal Action Proposal Generation✓ Link30.0346.4529.968.02BSN2018-06-08
UnLoc: A Unified Framework for Video Localization Tasks✓ Link59.3UnLoc-L2023-08-21