TY - GEN
T1 - Testing the cluster hypothesis with focused and graded relevance judgments
AU - Sheetrit, Eilon
AU - Shtok, Anna
AU - Kurland, Oren
AU - Shprincis, Igal
N1 - Publisher Copyright:
© 2018 ACM.
PY - 2018/6/27
Y1 - 2018/6/27
N2 - The cluster hypothesis is a fundamental concept in ad hoc retrieval. Heretofore, cluster hypothesis tests were applied to documents using binary relevance judgments. We present novel tests that utilize graded and focused relevance judgments; the latter are markups of relevant text in relevant documents. Empirical exploration reveals that the cluster hypothesis holds not only for documents, but also for passages, as measured by the proposed tests. Furthermore, the hypothesis holds to a higher extent for highly relevant documents and for those that contain a high fraction of relevant text.
AB - The cluster hypothesis is a fundamental concept in ad hoc retrieval. Heretofore, cluster hypothesis tests were applied to documents using binary relevance judgments. We present novel tests that utilize graded and focused relevance judgments; the latter are markups of relevant text in relevant documents. Empirical exploration reveals that the cluster hypothesis holds not only for documents, but also for passages, as measured by the proposed tests. Furthermore, the hypothesis holds to a higher extent for highly relevant documents and for those that contain a high fraction of relevant text.
KW - Cluster hypothesis
KW - Inter-passage similarities
KW - Passages
UR - http://www.scopus.com/inward/record.url?scp=85051552323&partnerID=8YFLogxK
U2 - 10.1145/3209978.3210120
DO - 10.1145/3209978.3210120
M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???
AN - SCOPUS:85051552323
T3 - 41st International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2018
SP - 1173
EP - 1176
BT - 41st International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2018
T2 - 41st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2018
Y2 - 8 July 2018 through 12 July 2018
ER -