Auflistung nach:
Auflistung Datenbank Spektrum 20(1) - März 2020 nach Schlagwort "Automatic Evaluation"
1 - 1 von 1
Treffer pro Seite
Sortieroptionen
- ZeitschriftenartikelHumans Optional? Automatic Large-Scale Test Collections for Entity, Passage, and Entity-Passage Retrieval(Datenbank-Spektrum: Vol. 20, No. 1, 2020) Dietz, Laura; Dalton, JeffManually creating test collections is a time-, effort-, and cost-intensive process. This paper describes a fully automatic alternative for deriving large-scale test collections, where no human assessments are needed. The empirical experiments confirm that automatic test collection and manual assessments agree on the best performing systems. The collection includes relevance judgments for both text passages and knowledge base entities. Since test collections with relevance data for both entity and text passages are rare, this approach provides a cost-efficient way for training and evaluating ad hoc passage retrieval, entity retrieval, and entity-aware text retrieval methods.