Dynamic and Goal-based Quality Management for Human-based Electronic Services
Journal
International Journal of Cooperative Information Systems (IJCIS).
ISSN
0218-8430
ISSN-Digital
1793-6365
Type
journal article
Date Issued
2012-01-17
Author(s)
Abstract
Crowdsourcing in the form of human-based electronic services (people services) provides a powerful way of outsourcing tasks to a large crowd of remote workers over the Internet. Research has shown that multiple redundant results delivered by different workers can be aggregated in order to achieve a reliable result. However, basic implementations of this approach are rather inefficient as they multiply the effort for task execution and are not able to guarantee a certain quality level. In this paper, we are addressing these challenges by elaborating on a statistical approach for quality management of people services which we had previously proposed. The approach combines elements of statistical quality management with dynamic group decisions. We present a comprehensive statistical model that enhances our original work and makes it more transparent. We also provide an extendible toolkit that implements our model and facilitates its application to real-time experiments as well as to simulations. A quantitative analysis based on an optical character recognition (OCR) scenario confirms the efficiency and reach of our model.
Language
English
Keywords
Crowdsourcing
statistical quality control
human computation
eServices
people services
HSG Classification
contribution to scientific community
Refereed
Yes
Publisher
World Scientific Publishing
Publisher place
Singapore
Volume
21
Number
1
Start page
3
End page
29
Pages
27
Subject(s)
Division(s)
Eprints ID
208921