Rating Scales for Collective Intelligence in Innovation Communities: Why Quick and Easy Decision Making Does Not Get it Right
ISBN
978-0-615-41898-8
Type
conference paper
Date Issued
2010-06-01
Author(s)
Editor(s)
Sabherwal, Rajiv
Sumner, Mary
Research Team
CCC, Crowdsourcing, IWI6
Abstract
The increasing popularity of open innovation approaches has lead to the rise of various innovation platforms on the Internet which might contain 10.000s user-generated ideas. However, a company’s absorptive capacity is limited regarding such an amount of ideas so that there is a strong need for mechanism to identify the best ideas. Extending previous decision management research we focus on analyzing effective idea rating and selection mechanisms in online innovation communities and underlying explanations. Using a multi-method approach our research comprises a web-based rating experiment with 313 participants evaluating 24 ideas from a real-world innovation community, data from a survey measuring rating satisfaction of participants, and idea ratings from an independent expert jury. Our findings show that, despite its popular use in online innovation communities, simple rating mechanisms such as thumbs up/down rating or 5-star rating do not produce valid idea rankings and are significantly outperformed by the multi-attribute scale.
Language
English
Keywords
Open innovation
absorptive capacity
rating
decision making
idea evaluation
collecting intelligence
HSG Classification
contribution to scientific community
HSG Profile Area
SoM - Business Innovation
Refereed
Yes
Book title
Proceedings of the International Conference on Information Systems, ICIS 2010
Publisher
Association for Information Systems
Publisher place
AIS Electronic Library (AISeL)
Event Title
31st International Conference on Information Systems (ICIS 2010)
Event Location
Saint Louis, MO
Event Date
12.-15.12.2010
Official URL
Subject(s)
Division(s)
Eprints ID
220567
File(s)![Thumbnail Image]()
Name
JML_195.pdf
Size
1.08 MB
Format
Adobe PDF
Checksum (MD5)
92ea6769a514c9ad45bb69798b4e24f0