IDEAS home Printed from https://ideas.repec.org/a/sae/somere/v51y2022i2p527-540.html
   My bibliography  Save this article

Beyond the Facts: Limited Empirical Diversity and Causal Inference in Qualitative Comparative Analysis

Author

Listed:
  • Alrik Thiem

Abstract

Qualitative Comparative Analysis (QCA) is a relatively young method of causal inference that continues to diffuse across the social sciences. However, recent methodological research has found the conservative (QCA-CS) and the intermediate solution type (QCA-IS) of QCA to fail fundamental tests of correctness. Even under conditions otherwise ideal for causal discovery, both solution types frequently committed causal fallacies by presenting inferences that were in direct disagreement with the underlying data-generating structure to be discovered by QCA. None of these problems affected the parsimonious solution type (QCA-PS). These findings conflict with conventional wisdom in the QCA literature, which has it that QCA-CS uses empirical information only and that QCA-IS is preferable to both QCA-CS and QCA-PS. The present article resolves these contradictions. It shows that QCA-CS and QCA-IS systematically supplement empirical data with matching artificial data. These artificial data, however, regularly induce causal fallacies of severe magnitude. Researchers who employ QCA-CS or QCA-IS in empirical analyses thus always risk moving further away from the truth rather than closer to it.

Suggested Citation

  • Alrik Thiem, 2022. "Beyond the Facts: Limited Empirical Diversity and Causal Inference in Qualitative Comparative Analysis," Sociological Methods & Research, , vol. 51(2), pages 527-540, May.
  • Handle: RePEc:sae:somere:v:51:y:2022:i:2:p:527-540
    DOI: 10.1177/0049124119882463
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0049124119882463
    Download Restriction: no

    File URL: https://libkey.io/10.1177/0049124119882463?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Cartwright,Nancy, 2007. "Hunting Causes and Using Them," Cambridge Books, Cambridge University Press, number 9780521860819.
    2. Hug, Simon, 2013. "Qualitative Comparative Analysis: How Inductive Use and Measurement Error Lead to Problematic Inference," Political Analysis, Cambridge University Press, vol. 21(2), pages 252-265, April.
    3. Ragin, Charles C., 2000. "Fuzzy-Set Social Science," University of Chicago Press Economics Books, University of Chicago Press, edition 1, number 9780226702773, April.
    4. Krogslund, Chris & Choi, Donghyun Danny & Poertner, Mathias, 2015. "Fuzzy Sets on Shaky Ground: Parameter Sensitivity and Confirmation Bias in fsQCA," Political Analysis, Cambridge University Press, vol. 23(1), pages 21-41, January.
    5. Cartwright,Nancy, 2007. "Hunting Causes and Using Them," Cambridge Books, Cambridge University Press, number 9780521677981.
    6. Thiem, Alrik, 2016. "Standards of Good Practice and the Methodology of Necessary Conditions in Qualitative Comparative Analysis," Political Analysis, Cambridge University Press, vol. 24(4), pages 478-484.
    7. repec:ucp:bkecon:9780226702766 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bear F. Braumoeller, 2017. "Aggregation Bias and the Analysis of Necessary and Sufficient Conditions in fsQCA," Sociological Methods & Research, , vol. 46(2), pages 242-251, March.
    2. Barbara Vis & Jan Dul, 2018. "Analyzing Relationships of Necessity Not Just in Kind But Also in Degree," Sociological Methods & Research, , vol. 47(4), pages 872-899, November.
    3. Martyna Daria Swiatczak, 2022. "Different algorithms, different models," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(4), pages 1913-1937, August.
    4. Wagemann, Claudius & Buche, Jonas & Siewert, Markus B., 2016. "QCA and business research: Work in progress or a consolidated agenda?," Journal of Business Research, Elsevier, vol. 69(7), pages 2531-2540.
    5. Lankoski, Jussi & Thiem, Alrik, 2020. "Linkages between agricultural policies, productivity and environmental sustainability," Ecological Economics, Elsevier, vol. 178(C).
    6. Andrew Gelman & Guido Imbens, 2013. "Why ask Why? Forward Causal Inference and Reverse Causal Questions," NBER Working Papers 19614, National Bureau of Economic Research, Inc.
    7. Mouchart, Michel & Russo, Federica & Wunsch, Guillaume, 2011. "Inferring causal relations by modelling structures : Article de recherche," LIDAM Discussion Papers ISBA 2011007, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    8. Galbács Peter, 2021. "What did it take for Lucas to set up ‘useful’ analogue systems in monetary business cycle theory?," Economics and Business Review, Sciendo, vol. 7(3), pages 61-82, September.
    9. Michael Baumgartner & Alrik Thiem, 2020. "Often Trusted but Never (Properly) Tested: Evaluating Qualitative Comparative Analysis," Sociological Methods & Research, , vol. 49(2), pages 279-311, May.
    10. Padró, R. & Marco, I. & Font, C. & Tello, E., 2019. "Beyond Chayanov: A sustainable agroecological farm reproductive analysis of peasant domestic units and rural communities (Sentmenat; Catalonia, 1860)," Ecological Economics, Elsevier, vol. 160(C), pages 227-239.
    11. Deirdre Nansen McCloskey, 2013. "Why Economics cannot Explain the Modern World," The Economic Record, The Economic Society of Australia, vol. 89, pages 8-22, June.
    12. Hünermund Paul & Louw Beyers & Caspi Itamar, 2023. "Double machine learning and automated confounder selection: A cautionary tale," Journal of Causal Inference, De Gruyter, vol. 11(1), pages 1-12, January.
    13. Magdalena Osinska, 2011. "On the Interpretation of Causality in Granger’s Sense," Dynamic Econometric Models, Uniwersytet Mikolaja Kopernika, vol. 11, pages 129-140.
    14. Kieran P. Donaghy, 2022. "A Circular Economy Model of Economic Growth with Circular and Cumulative Causation and Trade," Networks and Spatial Economics, Springer, vol. 22(3), pages 461-488, September.
    15. Kieran P. Donaghy, 2014. "Walter Isard’s Evolving Sense of the Scientific in Regional Science," International Regional Science Review, , vol. 37(1), pages 78-95, January.
    16. Gil, Olga, 2022. "Accountability in Artificial Intelligence," SocArXiv wckuf, Center for Open Science.
    17. Li, Sufang & Tu, Dalun & Zeng, Yan & Gong, Chenggang & Yuan, Di, 2022. "Does geopolitical risk matter in crude oil and stock markets? Evidence from disaggregated data," Energy Economics, Elsevier, vol. 113(C).
    18. George F. DeMartino, 2021. "The specter of irreparable ignorance: counterfactuals and causality in economics," Review of Evolutionary Political Economy, Springer, vol. 2(2), pages 253-276, July.
    19. Krauss, Alexander, 2021. "Assessing the overall validity of randomised controlled trials," LSE Research Online Documents on Economics 112576, London School of Economics and Political Science, LSE Library.
    20. Douglas, Evan J. & Shepherd, Dean A. & Prentice, Catherine, 2020. "Using fuzzy-set qualitative comparative analysis for a finer-grained understanding of entrepreneurship," Journal of Business Venturing, Elsevier, vol. 35(1).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:somere:v:51:y:2022:i:2:p:527-540. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.