keyword-spotting-on-quesst

Keyword Spotting

Results over time

Click legend items to toggle metrics. Hover points for model names.

Leaderboard

Paper	Code	Cnxe	MinCnxe	ATWV	MTWV	SSF	PMUs	ISF	PMUi	PL	lowerbound	ModelName	ReleaseDate
ELiRF at MediaEval 2014: Query by Example Search on Speech Task (QUESST)		0.6023	0.5977	0.3792	0.3801							ELiRF Fusion+Length(All Queries)	2014-10-16
ELiRF at MediaEval 2014: Query by Example Search on Speech Task (QUESST)		0.6125	0.6062	0.3896	0.3952							ELiRF Fusion(All Queries)	2014-10-16
CUHK System for QUESST Task of MediaEval 2014		0.638	0.585	0.412	0.413							CUHK(all the queries) System №2	2014-10-16
GTTS-EHU Systems for QUESST at MediaEval 2014		0.6540	0.6353	0.3567	0.3663	0.064	0.208					GTTS-EHU p (for the development set)	2014-10-16
CUHK System for QUESST Task of MediaEval 2014		0.682	0.659	0.412	0.413							CUHK(all the queries) System №1	2014-10-16
The NNI Query-by-Example System for MediaEval 2014		0.6925	0.6816	0.2918	0.2974							NNI DTW(All Queries)	2014-10-16
The SPL-IT Query by Example Search on Speech system for MediaEval 2014		0.7106	0.5881	0.4051	0.4052							SPL-IT(for the development set)	2014-10-16
The NNI Query-by-Example System for MediaEval 2014		0.7322	0.7293	0.2696	0.2717							NNI Symbolic(All Queries)	2014-10-16
The NNI Query-by-Example System for MediaEval 2015		0.761	0.747	0.270	0.274							NNI (eval)	2015-09-14
The NNI Query-by-Example System for MediaEval 2015		0.773	0.757	0.286	0.286							NNI (dev)	2015-09-14
The SPL-IT-UC Query by Example Search on Speech system for MediaEval 2015		0.7782	0.7716									SPL-IT-UC [All + side-info] (dev)	2015-09-14
The SPL-IT-UC Query by Example Search on Speech system for MediaEval 2015		0.7842	0.7786									SPL-IT-UC [Hmean + side-info] (eval)	2015-09-14
The SPL-IT-UC Query by Example Search on Speech system for MediaEval 2015		0.7862	0.7800									SPL-IT-UC [Hmean + side-info] (dev)	2015-09-14
The SPL-IT-UC Query by Example Search on Speech system for MediaEval 2015		0.7866	0.7809									SPL-IT-UC [All + side-info] (eval)	2015-09-14
The SPL-IT-UC Query by Example Search on Speech system for MediaEval 2015		0.7873	0.7816									SPL-IT-UC [All, no side] (dev)	2015-09-14
The SPL-IT-UC Query by Example Search on Speech system for MediaEval 2015		0.7914	0.7856									SPL-IT-UC [Hmean, no side] (eval)	2015-09-14
The SPL-IT-UC Query by Example Search on Speech system for MediaEval 2015		0.7930	0.7875									SPL-IT-UC [All, no side] (eval)	2015-09-14
The SPL-IT-UC Query by Example Search on Speech system for MediaEval 2015		0.7957	0.7893									SPL-IT-UC [Hmean, no side] (dev)	2015-09-14
BUT QUESST 2015 System Description		0.8447	0.8124									BUT [l-fea stack DTW+slope+2w3w fusion] (eval)	2015-09-14
BUT QUESST 2015 System Description		0.8452	0.8263									BUT [p-fea stack DTW ] (eval)	2015-09-14
BUT QUESST 2015 System Description		0.8490	0.8184									BUT [l-fea stack DTW+slope] (eval)	2015-09-14
BUT QUESST 2015 System Description		0.8580	0.8426									BUT [p-fea stack DTW ] (dev)	2015-09-14
GTM-UVigo Systems for the Query-by-Example Search on Speech Task at MediaEval 2015	✓ Link	0.871	0.838								0.592	GTM-UVigo Primary late submission (eval)	2015-09-14
BUT QUESST 2015 System Description		0.8731	0.8321									BUT [l-fea stack DTW+slope+2w3w fusion] (dev)	2015-09-14
GTM-UVigo Systems for the Query-by-Example Search on Speech Task at MediaEval 2015	✓ Link	0.875	0.847								0.593	GTM-UVigo Primary late submission (dev)	2015-09-14
BUT QUESST 2015 System Description		0.8772	0.8389									BUT [l-fea stack DTW+slope] (dev)	2015-09-14
BUT QUESST 2015 System Description		0.8884	0.8569									BUT [l-fea stack DTW 2w+slope] (dev)	2015-09-14
GTM-UVigo Systems for the Query-by-Example Search on Speech Task at MediaEval 2015	✓ Link	0.907	0.864								0.618	GTM-UVigo Contrastive late submission (dev)	2015-09-14
IIIT-H System for MediaEval 2014 QUESST		0.9121	0.8070	0.2261	0.2263							NS-DTW(for the development set, all the queries)	2014-10-16
GTM-UVigo Systems for the Query-by-Example Search on Speech Task at MediaEval 2015	✓ Link	0.917	0.905								0.627	GTM-UVigo Primary (dev)	2015-09-14
BUT QUESST 2015 System Description		0.9188	0.8801									BUT [l-fea stack DTW 3w+slope] (dev)	2015-09-14
GTM-UVigo Systems for the Query-by-Example Search on Speech Task at MediaEval 2015	✓ Link	0.919	0.905								0.629	GTM-UVigo Primary (eval)	2015-09-14
The IIT-B Query-by-Example System for MediaEval 2015		0.9213	0.9082	0.0812	0.816							IIT-B (dev)	2015-09-14
TUKE System for MediaEval 2014 QUESST		0.948	0.854	0.191	0.191							TUKE p-low late submission (for the development set)	2014-10-16
The IIT-B Query-by-Example System for MediaEval 2015		0.9536	0.9364	0.0254	0.0421							IIT-B (eval)	2015-09-14
TUKE System for MediaEval 2014 QUESST		0.960	0.892	0.161	0.162							TUKE p-low(for the development set)	2014-10-16
TUKE at MediaEval 2015 QUESST		0.962	0.940	0.055	0.059							TUKE p-S late submission (dev)	2015-09-14
TUKE at MediaEval 2015 QUESST		0.963	0.940	0.046	0.049							TUKE p-S late submission (eval)	2015-09-14
TUKE at MediaEval 2015 QUESST		0.970	0.947	0.022	0.036	0.0061	1.874	2.312	0.250	0.068		TUKE p-S (dev)	2015-09-14
TUKE at MediaEval 2015 QUESST		0.970	0.951	0.032	0.035							TUKE g-U late submission (dev)	2015-09-14
TUKE System for MediaEval 2014 QUESST		0.971	0.922	0.106	0.107							TUKE g-zero late submission(for the development set)	2014-10-16
TUKE at MediaEval 2015 QUESST		0.971	0.953	0.002	0.022							TUKE p-S (eval)	2015-09-14
TUKE at MediaEval 2015 QUESST		0.973	0.953	-0.01	0.023							TUKE g-U (eval)	2015-09-14
TUKE System for MediaEval 2014 QUESST		0.974	0.934	0.091	0.091							TUKE g-zero(for the development set)	2014-10-16
TUKE at MediaEval 2015 QUESST		0.974	0.953	0.0001	0.031	0.0066	2.292	0.383	0.515	0.033		TUKE g-U (dev)	2015-09-14
TUKE at MediaEval 2015 QUESST		0.974	0.954	0.028	0.032							TUKE g-U late submission (eval)	2015-09-14
GTM-UVigo Systems for the Query-by-Example Search on Speech Task at MediaEval 2015	✓ Link	0.989	0.852								0.613	GTM-UVigo Contrastive late submission (eval)	2015-09-14
GTM-UVigo Systems for the Query-by-Example Search on Speech Task at MediaEval 2015	✓ Link	0.998	0.918								0.635	GTM-UVigo Contrastive (dev)	2015-09-14
CUNY Systems for the Query-by-Example Search on Speech Task at MediaEval 2015		0.9988	0.9872	0.0011	0.0067							CUNY [SMO+iSAX] (dev)	2015-09-14
CUNY Systems for the Query-by-Example Search on Speech Task at MediaEval 2015		0.9989	0.9870	0.0006	0.0010							CUNY [SMO+iSAX] (eval)	2015-09-14
GTM-UVigo Systems for the Query-by-Example Search on Speech Task at MediaEval 2015	✓ Link	0.999	0.923								0.633	GTM-UVigo Contrastive (eval)	2015-09-14
ELiRF at MediaEval 2015: Query by Example Search on Speech Task (QUESST)		1.0651	0.8677	0.1446	0.1543							ELiRF SDTW-avg (dev)	2015-09-14
CUNY Systems for the Query-by-Example Search on Speech Task at MediaEval 2015		1.0658	0.9823	-3.9820	0.0123							CUNY [Subseq+MFCC] (dev)	2015-09-14
CUNY Systems for the Query-by-Example Search on Speech Task at MediaEval 2015		1.0674	0.9853	-4.0205	0.0006							CUNY [Subseq+MFCC] (eval)	2015-09-14
ELiRF at MediaEval 2015: Query by Example Search on Speech Task (QUESST)		1.0701	0.8702	0.1404	0.1493							ELiRF SDTW (dev)	2015-09-14
ELiRF at MediaEval 2015: Query by Example Search on Speech Task (QUESST)		1.0731	0.8751	0.1125	0.1181							ELiRF SDTW-avg (eval)	2015-09-14
ELiRF at MediaEval 2015: Query by Example Search on Speech Task (QUESST)		1.1879	0.9338	0.0449	0.0581							ELiRF SDTW (eval)	2015-09-14
NTU System at MediaEval 2015: Zero Resource Query by Example Spoken Term Detection Using Deep and Recurrent Neural Networks		2.0066										NTU dtw (dev)	2015-09-14
NTU System at MediaEval 2015: Zero Resource Query by Example Spoken Term Detection Using Deep and Recurrent Neural Networks		2.0066										NTU rnn (dev)	2015-09-14
NTU System at MediaEval 2015: Zero Resource Query by Example Spoken Term Detection Using Deep and Recurrent Neural Networks		2.0067										NTU dtw (eval)	2015-09-14
NTU System at MediaEval 2015: Zero Resource Query by Example Spoken Term Detection Using Deep and Recurrent Neural Networks		2.0067										NTU rnn (eval)	2015-09-14
The NNI Query-by-Example System for MediaEval 2014		5.8940	0.9595	0.0692	0.0692							NNI Choi(for the development set)	2014-10-16
The NNI Query-by-Example System for MediaEval 2014		6.0905	0.9571	0.0768	0.0767							NNI non-filtered(for the development set)	2014-10-16
BUT QUESST 2014 System Description			0.461									BUT (p-bigfusion)	2014-10-16
BUT QUESST 2014 System Description			0.486									BUT (g-bigfusionnoside )	2014-10-16
BUT QUESST 2014 System Description			0.533									BUT (g-best_single)	2014-10-16
BUT QUESST 2014 System Description			0.641									BUT (AKWS-cz)	2014-10-16
BUT QUESST 2014 System Description			0.673									BUT (AKWS-T3-cz)	2014-10-16
BUT QUESST 2014 System Description			0.929									BUT (g-LID)	2014-10-16

OpenCodePapers

keyword-spotting-on-quesst