INEX 2011 Focused Relevance Feedback Track - Results

The evaluation was performed using the first 20 topics from the INEX 2009 Ad Hoc track.

Exact Precision

	Reference	Reference (no feedback)	Otago (BM25)	Otago (Rocchio)	Otago (Tuned)
P@5	0.5	0.5	0.54	0.54	0.52
P@10	0.515	0.435	0.445	0.445	0.485
P@15	0.49	0.4	0.4167	0.4167	0.45
P@20	0.4675	0.385	0.3975	0.3975	0.3975
P@30	0.4367	0.35	0.3583	0.3583	0.3533
P@100	0.3095	0.242	0.226	0.226	0.2175
P@200	0.2327	0.174	0.183	0.1828	0.1788
P@500	0.1224	0.1182	0.1154	0.1154	0.1152
P@1000	0.0636	0.0636	0.0636	0.0636	0.0636
R-Precision	0.4126	0.3361	0.3597	0.3597	0.3573

	Reference	Reference (no feedback)	Otago (BM25)	Otago (Rocchio)	Otago (Tuned)
IP@0.0	0.87	0.8418	0.8481	0.8481	0.8679
IP@0.1	0.6903	0.5741	0.5782	0.5782	0.5916
IP@0.2	0.5877	0.5105	0.494	0.494	0.516
IP@0.3	0.5132	0.433	0.4354	0.4354	0.4518
IP@0.4	0.4718	0.3986	0.3943	0.3943	0.3916
IP@0.5	0.4329	0.3078	0.3537	0.3537	0.3632
IP@0.6	0.3912	0.2703	0.3128	0.3134	0.3305
IP@0.7	0.3557	0.2488	0.279	0.279	0.2977
IP@0.8	0.3015	0.2053	0.241	0.241	0.2407
IP@0.9	0.217	0.1716	0.1761	0.1761	0.1753
IP@1.0	0.1528	0.1291	0.1369	0.1369	0.1368
Average	0.4219	0.3376	0.3580	0.3576	0.3656