OpenCodePapers

highlight-detection-on-qvhighlights

Highlight Detection
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodemAPHit@1ModelNameReleaseDate
Saliency-Guided DETR for Moment Retrieval and Highlight Detection✓ Link44.7071.00SG-DETR (w/ PT)2024-10-02
FlashVTG: Feature Layering and Adaptive Score Handling Network for Video Temporal Grounding✓ Link44.0971.01FlashVTG2024-12-18
Saliency-Guided DETR for Moment Retrieval and Highlight Detection✓ Link43.7669.13SG-DETR2024-10-02
VideoLights: Feature Refinement and Cross-Task Alignment Transformer for Joint Video Highlight Detection and Moment Retrieval✓ Link42.8470.56VideoLights-B-pt2024-12-02
Unleash the Potential of CLIP for Video Highlight Detection✓ Link41.9470.60HL-CLIP2024-04-02
$R^2$-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding✓ Link40.7564.20R^2-Tuning2024-03-31
Correlation-Guided Query-Dependency Calibration for Video Temporal Grounding✓ Link40.7166.60CG-DETR (w/ PT)2023-11-15
Number it: Temporal Grounding Videos like Flipping Manga✓ Link40.5470.71NumPro2024-11-15
UniVTG: Towards Unified Video-Language Temporal Grounding✓ Link40.5466.28UniVTG (w/ PT)2023-07-31
Correlation-Guided Query-Dependency Calibration for Video Temporal Grounding✓ Link40.3366.21CG-DETR2023-11-15
Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment Retrieval✓ Link40.3365.69LLMEPET2024-07-21
UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detection✓ Link39.12UMT (w. PT)2022-03-23
Query-Dependent Video Representation for Moment Retrieval and Highlight Detection✓ Link39.0462.87QD-DETR2023-03-24
Query-Dependent Video Representation for Moment Retrieval and Highlight Detection✓ Link38.9462.40QD-DETR (only Video)2023-03-24
Query-Dependent Video Representation for Moment Retrieval and Highlight Detection✓ Link38.5262.27QD-DETR (w/ PT)2023-03-24
UniVTG: Towards Unified Video-Language Temporal Grounding✓ Link38.2060.96UniVTG2023-07-31
UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detection✓ Link38.18UMT2022-03-23
QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queries✓ Link37.4360.17Moment-DETR w/ PT2021-07-20
TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuning✓ Link27.055.3VideoChat-T (FT)2024-10-25
[]()26.554.1VideoChat-T (ZS)
Query-Dependent Video Representation for Moment Retrieval and Highlight Detection✓ Link61.91QD-DETR (only Video w/ PT)2023-03-24