Options
Investigating the Impact of Different Research Designs on Empirical Results
ISBN
978-0-9915567-0-0
Type
conference paper
Date Issued
2014-06-07
Author(s)
Editor(s)
Avital, Michel
Leimeister, Jan Marco
Schultze, Ulrike
Research Team
IWI6
Abstract
Understanding why people use or refuse to use information systems (IS) is a major research area of the IS field. To study related research questions, a plethora of different research designs has been applied in the past. Some studies rely on vignettes or a series of screenshots as treatments before data collection, others have their participants use more or less complete versions of IS in experimental settings. To-date, the results generated from the different studies are usually generalized without actually investigating whether the different research design have an impact on the results. To address this gap, we aim at comparing four different research designs. In detail, we investigate how the degree of active control and the closeness to the actual usage context impact the results of two IS models. Therefore, we develop a 2x2 experimental design including four treatments resembling different specifications of these two dimensions. Our benchmark is a free-simulation experiment, in which participants are supposed to have a high degree of active control as well as are very close to the actual usage context. The other three treatments include a GoPro-video of the free-simulation experiment (low active control), a Click-dummy version of the IS (low closeness to the actual usage context), and a video of a participant using the Click-dummy (low active control and low closeness to the actual usage context). After the collection of our data, we aim at investigating the impact of the different research designs on the collected data. In this research-in-progress paper, we present our motivation, the theoretical background, our hypotheses as well as our research design.
Language
English
Keywords
Research design
Data quality
Experiment
Model comparison
Empirical research
HSG Classification
contribution to scientific community
Refereed
Yes
Book title
First AIS-Journals Joint Author Workshop (Pre-ECIS 14 Workshop)
Publisher
Association for Information Systems
Publisher place
AIS Electronic Library (AISeL)
Event Title
22nd European Conference on Information Systems (ECIS) 2014
Event Location
Tel Aviv, Israel
Event Date
09.-11.06.2014
Subject(s)
Division(s)
Eprints ID
233745