How Good are your Counterfactuals? : Assessing Quantitative Macro-Comparative Welfare State Research with Qualitative Criteria
Journal
Journal of European Social Policy
ISSN
1461-7269
ISSN-Digital
0958-9287
Type
journal article
Date Issued
2011-10-01
Author(s)
Abstract
All causal statements based on historical data - both in qualitative and quantitative social research - rely on counterfactuals. In quantitative research, scholars attempt to arrive at valid counterfactuals by emulating an experimental design. However, because of treatments that are impossible to manipulate and the non-random assignment of data to treatment and control groups, causal statements are often based on invalid counterfactuals. In qualitative research, scholars attempt to arrive at valid counterfactuals by probing the historical and logical consistency of counterfactuals and by acknowledging the interconnectedness of events. Criteria to evaluate counterfactuals have been developed that allow for a discussion of the quality of counterfactuals used in causal statements. In this article, we suggest using these qualitative criteria to evaluate counterfactuals in quantitative macro-comparative welfare state research. We argue that these criteria can help us identify erroneous causal inferences in quantitative research based on historical data.
Language
English
HSG Classification
contribution to scientific community
HSG Profile Area
SEPS - Global Democratic Governance
Refereed
Yes
Publisher
Sage
Publisher place
London
Volume
21
Number
4
Start page
365
End page
380
Pages
16
Subject(s)
Division(s)
Eprints ID
227279