GI Digital Library :: Auflistung nach Schlagwort "Empirical studies in interaction design"

1 - 1 von 1

Zeitschriftenartikel
Optimising crowdsourcing efficiency: Amplifying human computation with validation
(it - Information Technology: Vol. 60, No. 1, 2018) Chamberlain, Jon; Kruschwitz, Udo; Poesio, Massimo
Crowdsourcing has revolutionised the way tasks can be completed but the process is frequently inefficient, costing practitioners time and money. This research investigates whether crowdsourcing can be optimised with a validation process, as measured by four criteria: quality; cost; noise; and speed. A validation model is described, simulated and tested on real data from an online crowdsourcing game to collect data about human language. Results show that by adding an agreement validation (or a like/upvote) step fewer annotations are required, noise and collection time are reduced and quality may be improved.