Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localization

Benchmark Model Rank Results
deepfake-detection-on-lav-df-temporal-localizationBA-TFD+ (audio-visual)#1AP@0.5: 96.3AR@100: 81.62AP@0.95: 4.44AR@10: 78.75AR@20: 79.4…
deepfake-detection-on-lav-df-temporal-localizationTriDet#2AP@0.5: 86.33AR@100: 74.47AP@0.95: 3.05AR@10: 74.45AR@20: 74.46…
deepfake-detection-on-lav-df-temporal-localizationActionFormer#3AP@0.5: 85.23AR@100: 77.23AP@0.95: 0.93AR@10: 76.93AR@20: 77.19…
deepfake-detection-on-lav-df-temporal-localizationTadTR#4AP@0.5: 80.22AR@100: 72.5AP@0.95: 5.22AR@10: 69.18AR@20: 70.56…
deepfake-detection-on-lav-df-temporal-localizationBA-TFD#5AP@0.5: 79.15AR@100: 67.03AP@0.95: 0.24AR@10: 58.51AR@20: 60.89…
deepfake-detection-on-lav-df-temporal-localizationAVFusion#7AP@0.5: 65.38AR@100: 62.98AP@0.95: 0.11AR@10: 52.11AR@20: 54.8…
deepfake-detection-on-lav-df-temporal-localizationBA-TFD+ (visual-only)#8AP@0.5: 64.78AR@100: 64.0AP@0.95: 2.53AR@10: 54.38AR@20: 55.94…
deepfake-detection-on-lav-df-temporal-localizationBSN++#10AP@0.5: 56.41AR@100: 74.93AP@0.95: 0.21AR@10: 59.29AR@20: 64.98…
deepfake-detection-on-lav-df-temporal-localizationBMN (E2E)#11AP@0.5: 24.01AR@100: 53.26AP@0.95: 0.07AR@10: 26.93AR@20: 31.6…
deepfake-detection-on-lav-df-temporal-localizationAGT#12AP@0.5: 17.85AR@100: 43.15AP@0.95: 0.11AR@10: 16.71AR@20: 24.59…
deepfake-detection-on-lav-df-temporal-localizationMDS#13AP@0.5: 12.78AR@100: 37.88AP@0.95: 0.0AR@10: 32.15AR@20: 34.39…
deepfake-detection-on-lav-df-temporal-localizationBMN#14AP@0.5: 10.56AR@100: 48.49AP@0.95: 0.0AR@10: 31.55AR@20: 37.13…