Auflistung nach Autor:in "Poesio, Massimo"
1 - 1 von 1
Treffer pro Seite
Sortieroptionen
- ZeitschriftenartikelOptimising crowdsourcing efficiency: Amplifying human computation with validation(it - Information Technology: Vol. 60, No. 1, 2018) Chamberlain, Jon; Kruschwitz, Udo; Poesio, MassimoCrowdsourcing has revolutionised the way tasks can be completed but the process is frequently inefficient, costing practitioners time and money. This research investigates whether crowdsourcing can be optimised with a validation process, as measured by four criteria: quality; cost; noise; and speed. A validation model is described, simulated and tested on real data from an online crowdsourcing game to collect data about human language. Results show that by adding an agreement validation (or a like/upvote) step fewer annotations are required, noise and collection time are reduced and quality may be improved.