A Test Collection for Interactive Lifelog Retrieval
Gurrin, Cathal; Schoeffmann, Klaus; Joho, Hideo; Münzer, Bernd; Albatal, Rami; Hopfgartner, Frank; Zhou, Liting; Dang Nguyen, Duc Tien
Peer reviewed, Journal article
Accepted version
View/ Open
Date
2019Metadata
Show full item recordCollections
Original version
https://doi.org/10.1007/978-3-030-05710-7_26Abstract
There is a long history of repeatable and comparable evaluation in Information Retrieval (IR). However, thus far, no shared test collection exists that has been designed to support interactive lifelog retrieval. In this paper we introduce the LSC2018 collection, that is designed to evaluate the performance of interactive retrieval systems. We describe the features of the dataset and we report on the outcome of the first Lifelog Search Challenge (LSC), which used the dataset in an interactive competition at ACM ICMR 2018.