INEX 2012 Snippet Retrieval Track - Evaluation Results

Geometric Mean of Recall and Negative Recall

Rank	Run	Score
1	UMD_focussed_child_1	0.6121
2	QUT_2012_Focused	0.6096
3	UMD_snippets_article_score_180	0.5798
4	QUT_2012_Focused_Split	0.5712
5	TheCNGL_DCU_SnippetTrack2012_SRReferenceRun02	0.5648
6	TheCNGL_DCU_SnippetTrack2012_SRReferenceRun03	0.5510
7	UMD_focussed_child_2_bleu	0.5466
8	SR2012-Baseline	0.5431
9	TheCNGL_DCU_SnippetTrack_2012_SRun04	0.5390
10	UMD_focussed_correlation_1	0.5319
11	UMD_snippets_article_bleu_180	0.5305
12	TheCNGL_DCU_SnippetTrack2012_SRReferenceRun01	0.5174
13	IRIT_MW	0.5171
14	IRIT_knapsack	0.5039
15	UMD_focussed_correlation_2_bleu	0.5007
16	UMD_snippets_child_score_3_100_Single	0.4991
17	UMD_snippets_correlation_score_3_100_Single	0.4927
18	UMD_snippets_child_score_300_Single	0.4706
19	UMD_snippets_correlation_score_300_Single	0.4268
20	UMD_snippets_article_first_180	0.4063

Run	MPA	MNPA	Recall	NR	GM	PA	NA
SR2012-Baseline	0.7729	0.6993	0.4625	0.9504	0.5431	0.4913	0.7997
IRIT_knapsack	0.7314	0.6474	0.3906	0.8869	0.5039	0.4076	0.7661
IRIT_MW	0.7100	0.6487	0.4881	0.8356	0.5171	0.4895	0.6872
QUT_2012_Focused	0.7243	0.6821	0.4259	0.8841	0.6096	0.4595	0.7765
QUT_2012_Focused_Split	0.7371	0.6725	0.5148	0.8188	0.5712	0.4992	0.7422
TheCNGL_DCU_SnippetTrack_2012_SRun04	0.7443	0.6687	0.4083	0.9122	0.5390	0.4624	0.7756
TheCNGL_DCU_SnippetTrack2012_SRReferenceRun01	0.7971	0.6670	0.4528	0.8676	0.5174	0.4387	0.7970
TheCNGL_DCU_SnippetTrack2012_SRReferenceRun02	0.7800	0.7039	0.5478	0.8574	0.5648	0.5183	0.7843
TheCNGL_DCU_SnippetTrack2012_SRReferenceRun03	0.7614	0.6899	0.4627	0.9120	0.5510	0.5006	0.7596
UMD_focussed_child_1	0.7443	0.6844	0.5071	0.8476	0.6121	0.5292	0.7685
UMD_focussed_child_2_bleu	0.7643	0.6920	0.4424	0.9111	0.5466	0.4447	0.7987
UMD_focussed_correlation_1	0.7429	0.6481	0.4566	0.8617	0.5319	0.4708	0.7517
UMD_focussed_correlation_2_bleu	0.6800	0.6144	0.3853	0.8714	0.5007	0.4108	0.7057
UMD_snippets_article_bleu_180	0.6986	0.6669	0.4552	0.8869	0.5305	0.4306	0.7396
UMD_snippets_article_first_180	0.7500	0.6164	0.3092	0.9405	0.4063	0.3726	0.7899
UMD_snippets_article_score_180	0.7014	0.6706	0.4873	0.8338	0.5798	0.4954	0.6878
UMD_snippets_child_score_3_100_Single	0.6900	0.6332	0.3441	0.8752	0.4991	0.3774	0.7172
UMD_snippets_child_score_300_Single	0.7157	0.6179	0.4080	0.8257	0.4706	0.4463	0.6952
UMD_snippets_correlation_score_3_100_Single	0.7143	0.6492	0.3668	0.8954	0.4927	0.4162	0.7311
UMD_snippets_correlation_score_300_Single	0.6743	0.5836	0.3986	0.7854	0.4268	0.4078	0.6713