PeopleClouds

Research focus: Crowdsourcing, human computation, service science, quality management
Period: June 2010 to December 2012
Project leader/Contact: Robert Kern
Involved research groups: Service Innovation & Management
Funding: IBM

Contents

Organizations will have to adapt their business processes to further increase their flexibility to react to changing markets and varying demands. This requires a scalable provisioning and "de-provisioning" of resources, especially in productive business processes. For IT resources, the huge interest in cloud computing solutions already underscores this trend. For human resources, which are still the core of most organizational endeavors, traditional modes of operation still prohibit a flexible adaption and scalability of workforce capacity to changing needs.

In this context, crowdsourcing in the form of human-based electronic services is posing a promising approach for the scalable on-demand and per-request outsourcing of human tasks to a large group of people - in fact is the first step to develop public or private "people clouds": Amazon.com first addressed this issue with its Web marketplace Mturk, in which organizations can publish open calls for Human Intelligence Tasks (HITs). Any Internet user who meets certain skill criteria may act as a service worker and complete tasks in return for (still) small amounts of money. This platform is already used for supplementing low-level business processes. However, when leveraging human-based electronic services in more critical business contexts, it is crucial to be able to monitor or even to guarantee the quality of the work results.

The objective of this project is to understand how an open group of people can be coordinated in a way that the result delivered by the whole group meets a certain level of well defined quality although contributions of the individuals may not. The key idea is to "recursively" apply human based e-services for mass quality assurance mechanisms. Starting from statistical quality control and group decision theory, an integrated approach for quality management of human-based electronic services is being developed, implemented and evaluated via a series of experimental and real life scenarios.

People Cloud Concept

Project partner: IBM, buw Group

Press

Workshops

Literature


1
Kern, R.; Thies, H.; Zirpins, C.; Satzger, G. 2012
Dynamic and Goal-based Quality Management for Human-based Electronic Services. International Journal of Cooperative Information Systems 21(1). 3–29.
doi:10.1142/s0218843012400011
http://digbib.ubka.uni-karlsruhe.de/volltexte/1000026818
@Article{CitationKey,
author = {Kern, Robert and Thies, Hans and Zirpins, Christian and Satzger,
Gerhard},
title = {{Dynamic and Goal-based Quality Management for Human-based Electronic
Services}},
journal = {International Journal of Cooperative Information Systems},
year = {2012},
volume = {21},
pages = {3-29},
number = {1},
doi = {http://dx.doi.org/10.1142/S0218843012400011},
url = {http://digbib.ubka.uni-karlsruhe.de/volltexte/1000026818}}

					
 
2
Bermbach, D.; Kern, R.; Wichmann, P.; Rath, S.; Zirpins, C. 2011
An Extendable Toolkit for Managing Quality of Human-based Electronic Services. Proceedings of the AAAI workshop on human computation, San Francisco, USA. AAAI Press.
http://www.aaai.org/ocs/index.php/WS/AAAIW11/paper/view/3923/4258
@Inproceedings{CitationKey,
author = {David Bermbach and Robert Kern and Pascal Wichmann and Sandra Rath
and Christian Zirpins},
title = {{An Extendable Toolkit for Managing Quality of Human-based Electronic
Services}},
booktitle = {Proceedings of the AAAI workshop on human computation, San Francisco,
USA},
year = {2011},
publisher = {AAAI Press},
url = {http://www.aaai.org/ocs/index.php/WS/AAAIW11/paper/view/3923/4258}}

					
 
3
Satzger, G.; Kern, R.; Pasing, A.; Pfau, G.; Fritz, R.; Alexander, S.; Roland, P. 2011
People Services: Efficient work processes leveraging the power of the crowd. Abstract. 20th Annual Frontiers in Service Conference. (Columbus/Ohio, USA).
@Inproceedings{CitationKey,
author = {Satzger, Gerhard and Kern, Robert and Pasing, Andreas and Pfau, Gerhard
and Fritz, Ronald and Schmid Alexander and Peisl Roland},
title = {{People Services: Efficient work processes leveraging the power of
the crowd}},
booktitle = {Abstract. 20th Annual Frontiers in Service Conference},
year = {2011},
address = {Columbus/Ohio, USA}}

					
 
4
Kern, R.; Thies, H.; Satzger, G. 2011
Efficient Quality Management of Human-Based Electronic Services Leveraging Group Decision Making. Proceedings of the 19th European Conference on Information Systems - ECIS 2011.
http://aisel.aisnet.org/ecis2011/112/
@Inproceedings{CitationKey,
author = {Kern, Robert and Thies, Hannes and Satzger, Gerhard},
title = {{Efficient Quality Management of Human-Based Electronic Services
Leveraging Group Decision Making}},
booktitle = {Proceedings of the 19th European Conference on Information Systems
- ECIS 2011},
year = {2011},
url = {http://aisel.aisnet.org/ecis2011/112/}}

					
 
5
Wichmann, P.; Borek, A.; Kern, R.; Woodall, P.; Parlikad, A. K.; Satzger, G. 2011
Exploring the “Crowd” as Enabler of Better Information Quality. Proceedings of the 16th International Conference on Information Quality, Australia.
Available at: click here
@Inproceedings{CitationKey,
author = {Wichmann, Pascal and Borek, Alexander and Kern, Robert and Woodall,
Philip and Parlikad, Ajith Kumar and Satzger, Gerhard},
title = {{Exploring the “Crowd” as Enabler of Better Information Quality}},
booktitle = {Proceedings of the 16th International Conference on Information
Quality, Australia},
year = {2011},
url =
{http://ssm-vm030.mit.edu/ICIQ/Documents/IQ%20Conference%202011/Papers/03_01_ICIQ2011.pdf}}

					
 
6
Kern, R.; Thies, H.; Satzger, G. 2010
Statistical Quality Control for Human-Based Electronic Services. in: Maglio, P.; Weske, M.; Yang, J.; Fantinato, M. (eds.), Service-Oriented Computing - Proceedings ICSOC 2010. LNCS, no. 6470. Springer. 243–257.
doi:10.1007/978-3-642-17358-5_17
http://digbib.ubka.uni-karlsruhe.de/volltexte/1000022178
@Inproceedings{CitationKey,
author = {Kern, Robert and Thies, Hannes and Satzger, Gerhard},
title = {{Statistical Quality Control for Human-Based Electronic Services}},
booktitle = {Service-Oriented Computing - Proceedings ICSOC 2010},
year = {2010},
pages = {243-257},
editor = {Maglio, P and Weske, M and Yang, J and Fantinato, M},
number = {6470},
series = {LNCS},
publisher = {Springer},
doi = {10.1007/978-3-642-17358-5_17},
url = {http://digbib.ubka.uni-karlsruhe.de/volltexte/1000022178}}

					
 
7
Kern, R.; Thies, H.; Bauer, C.; Satzger, G. 2010
Quality Assurance for Human-Based Electronic Services: A Decision Matrix for Choosing the Right Approach. in: Daniel, F.; Facca, F. M. (eds.), Current Trends in Web Engineering - Proceedings ICWE 2010. LNCS, vol. 6385. Springer. 421–424.
doi:10.1007/978-3-642-16985-4_39
http://digbib.ubka.uni-karlsruhe.de/volltexte/1000022179
@Inproceedings{CitationKey,
author = {Kern, Robert and Thies, Hannes and Bauer, Cordula and Satzger, Gerhard},
title = {{Quality Assurance for Human-Based Electronic Services: A Decision
Matrix for Choosing the Right Approach}},
booktitle = {Current Trends in Web Engineering - Proceedings ICWE 2010},
year = {2010},
pages = {421-424},
editor = {Daniel, Florian and Facca, Federico Michele},
volume = {6385},
series = {LNCS},
publisher = {Springer},
doi = {10.1007/978-3-642-16985-4_39},
url = {http://digbib.ubka.uni-karlsruhe.de/volltexte/1000022179}}

					
 
8
Kern, R.; Bauer, C.; Thies, H.; Satzger, G. 2010
Validating results of human-based electronic services leveraging multiple reviewers. Proceedings of the 16th Americas Conference on Information Systems (AMCIS). (Lima, Peru).
http://digbib.ubka.uni-karlsruhe.de/volltexte/1000022266
@Inproceedings{CitationKey,
author = {Kern, Robert and Bauer, Cordula and Thies, Hannes and Satzger, Gerhard},
title = {{Validating results of human-based electronic services leveraging
multiple reviewers}},
booktitle = {Proceedings of the 16th Americas Conference on Information Systems
(AMCIS)},
year = {2010},
address = {Lima, Peru},
url = {http://digbib.ubka.uni-karlsruhe.de/volltexte/1000022266},
abstract = {Crowdsourcing in the form of human-based electronic services (people
services) provides a powerful way of outsourcing so called micro tasks to large
groups of people over the Internet in order to increase the scalability and
productivity of business processes. However, quality management of the work
results continues to be a challenge. Most existing approaches assume that multiple
redundant results delivered by different people for the same task can be
aggregated in order to achieve a reliable result, but for a lot of task types
an automatic aggregation or comparison of task results is not possible. Also,
cost considerations and estimators for outgoing quality have experienced little
attention. Our majority review approach addresses these challenges by leveraging
the crowd not only for delivering work results but also for validating the results
delivered by others. An evaluation in a business context confirms that the
approach is capable of gaining reliable results.



Keywords: crowdsourcing, human computation, statistical quality management}}

					
 
9
Kern, R.; Bauer, C.; Thies, H.; Satzger, G. 2010
Efficient quality management for human-based electronic services. Presentation at the 19th Annual Frontiers in Service Conference, Karlstad, Sweden.
http://aisel.aisnet.org/ecis2011/112/
@Inproceedings{CitationKey,
author = {Kern, Robert and Bauer, Cordula and Thies, Hannes and Satzger, Gerhard},
title = {{Efficient quality management for human-based electronic services}},
booktitle = {Presentation at the 19th Annual Frontiers in Service Conference,
Karlstad, Sweden},
year = {2010},
url = {http://aisel.aisnet.org/ecis2011/112/}}

					
 
10
Kern, R.; Zirpins, C.; Satzger, G. 2009
People Services: Manpower as a Service. Presentation at the 18th Annual Frontiers in Service Conference, Honolulu, USA.
@Misc{CitationKey,
author = {Kern, Robert and Zirpins, Christian and Satzger, Gerhard},
title = {{People Services: Manpower as a Service}},
howpublished = {Presentation at the 18th Annual Frontiers in Service Conference,
Honolulu, USA},
year = {2009}}

					
 
11
Kern, R.; Zirpins, C.; Agarwal, S. 2009
Managing Quality of Human-Based eServices. in: Feuerlicht, G.; Lamersdorf, W. (eds.), Service-Oriented Computing - ICSOC 2008 Workshops, ICSOC 2008 International Workshops, Sydney, Australia, December 1st, 2008, Revised Selected Papers. Lecture Notes in Computer Science, vol. LNCS 5472. Springer. 304–309.
http://disi.unitn.it/~dandrea/ESBE/papers/esbe08_submission_9.pdf
@Inproceedings{CitationKey,
author = {Robert Kern and Christian Zirpins and Sudhir Agarwal},
title = {{Managing Quality of Human-Based eServices}},
booktitle = {Service-Oriented Computing - ICSOC 2008 Workshops, ICSOC 2008
International Workshops, Sydney, Australia, December 1st, 2008, Revised Selected
Papers},
year = {2009},
pages = {304-309},
editor = {George Feuerlicht and Winfried Lamersdorf},
volume = {LNCS 5472},
series = {Lecture Notes in Computer Science},
publisher = {Springer},
url = {http://disi.unitn.it/~dandrea/ESBE/papers/esbe08_submission_9.pdf}}

					
KIT – University of the State of Baden-Wuerttemberg and National Research Center of the Helmholtz Association