Logo des Repositoriums

it - Information Technology 60(1) - Februar 2018

https://dl.gi.de/handle/20.500.12116/36583
Auflistung nach:

Auflistung it - Information Technology 60(1) - Februar 2018 nach Autor:in "Kruschwitz, Udo"

1 - 1 von 1
  • Zeitschriftenartikel
    Optimising crowdsourcing efficiency: Amplifying human computation with validation
    (it - Information Technology: Vol. 60, No. 1, 2018) Chamberlain, Jon; Kruschwitz, Udo; Poesio, Massimo
    Crowdsourcing has revolutionised the way tasks can be completed but the process is frequently inefficient, costing practitioners time and money. This research investigates whether crowdsourcing can be optimised with a validation process, as measured by four criteria: quality; cost; noise; and speed. A validation model is described, simulated and tested on real data from an online crowdsourcing game to collect data about human language. Results show that by adding an agreement validation (or a like/upvote) step fewer annotations are required, noise and collection time are reduced and quality may be improved.