IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v184y2021i1p65-86.html
   My bibliography  Save this article

Estimating causal moderation effects with randomized treatments and non‐randomized moderators

Author

Listed:
  • Kirk Bansak

Abstract

Researchers are often interested in analysing conditional treatment effects. One variant of this is ‘causal moderation’, which implies that intervention upon a third (moderator) variable would alter the treatment effect. This study considers the conditions under which causal moderation can be identified and presents a generalized framework for estimating causal moderation effects given randomized treatments and non‐randomized moderators. As part of the estimation process, it allows researchers to implement their preferred method of covariate adjustment, including parametric and non‐parametric methods, or alternative identification strategies of their choosing. In addition, it provides a set‐up whereby sensitivity analysis designed for the average treatment effect context can be extended to the moderation context. To illustrate the methods, the study presents two applications: one dealing with the effect of using the term ‘welfare’ to describe public assistance in the United States, and one dealing with the effect of asylum seekers’ religion on European attitudes towards asylum seekers.

Suggested Citation

  • Kirk Bansak, 2021. "Estimating causal moderation effects with randomized treatments and non‐randomized moderators," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(1), pages 65-86, January.
  • Handle: RePEc:bla:jorssa:v:184:y:2021:i:1:p:65-86
    DOI: 10.1111/rssa.12614
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssa.12614
    Download Restriction: no

    File URL: https://libkey.io/10.1111/rssa.12614?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Mueller, John E., 1970. "Presidential Popularity from Truman to Johnson1," American Political Science Review, Cambridge University Press, vol. 64(1), pages 18-34, March.
    2. Naoki Egami & Kosuke Imai, 2019. "Causal Interaction in Factorial Experiments: Application to Conjoint Analysis," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(526), pages 529-540, April.
    3. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    4. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    5. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    6. Weiss, Jessica Chen, 2013. "Authoritarian Signaling, Mass Audiences, and Nationalist Protest in China," International Organization, Cambridge University Press, vol. 67(1), pages 1-35, January.
    7. Lu Tian & Ash A. Alizadeh & Andrew J. Gentles & Robert Tibshirani, 2014. "A Simple Method for Estimating Interactions Between a Treatment and a Large Number of Covariates," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(508), pages 1517-1532, December.
    8. Dinas, Elias & Matakos, Konstantinos & Xefteris, Dimitrios & Hangartner, Dominik, 2019. "Waking Up the Golden Dawn: Does Exposure to the Refugee Crisis Increase Support for Extreme-Right Parties?," Political Analysis, Cambridge University Press, vol. 27(2), pages 244-254, April.
    9. Sekhon, Jasjeet S., 2011. "Multivariate and Propensity Score Matching Software with Automated Balance Optimization: The Matching package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 42(i07).
    10. Huddy, Leonie & Mason, Lilliana & Aarøe, Lene, 2015. "Expressive Partisanship: Campaign Involvement, Political Emotion, and Partisan Identity," American Political Science Review, Cambridge University Press, vol. 109(1), pages 1-17, February.
    11. Peng Ding & Avi Feller & Luke Miratrix, 2016. "Randomization inference for treatment effect variation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(3), pages 655-671, June.
    12. Ratkovic, Marc & Tingley, Dustin, 2017. "Sparse Estimation and Uncertainty with Application to Subgroup Analysis," Political Analysis, Cambridge University Press, vol. 25(1), pages 1-40, January.
    13. Brambor, Thomas & Clark, William Roberts & Golder, Matt, 2006. "Understanding Interaction Models: Improving Empirical Analyses," Political Analysis, Cambridge University Press, vol. 14(1), pages 63-82, January.
    14. Hainmueller, Jens & Mummolo, Jonathan & Xu, Yiqing, 2019. "How Much Should We Trust Estimates from Multiplicative Interaction Models? Simple Tools to Improve Empirical Practice," Political Analysis, Cambridge University Press, vol. 27(2), pages 163-192, April.
    15. Christopher M. Federico, 2004. "When Do Welfare Attitudes Become Racialized? The Paradoxical Effects of Education," American Journal of Political Science, John Wiley & Sons, vol. 48(2), pages 374-391, April.
    16. Hangartner, Dominik & Dinas, Elias & Marbach, Moritz & Matakos, Konstantinos & Xefteris, Dimitrios, 2019. "Does Exposure to the Refugee Crisis Make Natives More Hostile?," American Political Science Review, Cambridge University Press, vol. 113(2), pages 442-455, May.
    17. Peter M. Aronow & Cyrus Samii, 2016. "Does Regression Produce Representative Estimates of Causal Effects?," American Journal of Political Science, John Wiley & Sons, vol. 60(1), pages 250-267, January.
    18. Kosuke Imai & Gary King & Elizabeth A. Stuart, 2008. "Misunderstandings between experimentalists and observationalists about causal inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 171(2), pages 481-502, April.
    19. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881, October.
    20. Ho, Daniel E. & Imai, Kosuke & King, Gary & Stuart, Elizabeth A., 2007. "Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference," Political Analysis, Cambridge University Press, vol. 15(3), pages 199-236, July.
    21. Bansak, Kirk & Hainmueller, Jens & Hangartner, Dominik, 2016. "How economic, humanitarian, and religious concerns shape European attitudes toward asylum seekers," LSE Research Online Documents on Economics 67898, London School of Economics and Political Science, LSE Library.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nora Bearth & Michael Lechner, 2024. "Causal Machine Learning for Moderation Effects," Papers 2401.08290, arXiv.org, revised Apr 2024.
    2. Heinrich, Tobias & Kobayashi, Yoshiharu & Motta, Matthew, 2024. "Which foreign vaccine should the government purchase in a pandemic? Evidence from a survey experiment in the United States," Social Science & Medicine, Elsevier, vol. 347(C).
    3. Davide Gritti & Filippo Gioachin & Anna Zamberlan, 2023. "The Buffer Function of Wealth in Socioemotional Responses to Covid‐19 in Italy," Social Inclusion, Cogitatio Press, vol. 11(1), pages 148-162.
    4. Nora Müller & Klaus Pforr & Jascha Dräger, 2023. "Wealth Stratification and the Insurance Function of Wealth," Social Inclusion, Cogitatio Press, vol. 11(1), pages 128-134.
    5. Bansak, Kirk & Nowacki, Tobias, 2022. "Effect Heterogeneity and Causal Attribution in Regression Discontinuity Designs," SocArXiv vj34m, Center for Open Science.
    6. Michael Lechner, 2023. "Causal Machine Learning and its use for public policy," Swiss Journal of Economics and Statistics, Springer;Swiss Society of Economics and Statistics, vol. 159(1), pages 1-15, December.
    7. Kobayashi, Yoshiharu & Howell, Christopher & Heinrich, Tobias, 2021. "Vaccine hesitancy, state bias, and Covid-19: Evidence from a survey experiment using Phase-3 results announcement by BioNTech and Pfizer," Social Science & Medicine, Elsevier, vol. 282(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vrânceanu, Alina & Dinas, Elias & Heidland, Tobias & Ruhs, Martin, 2023. "The European refugee crisis and public support for the externalisation of migration management," Open Access Publications from Kiel Institute for the World Economy 279441, Kiel Institute for the World Economy (IfW Kiel).
    2. Sloczynski, Tymon, 2018. "A General Weighted Average Representation of the Ordinary and Two-Stage Least Squares Estimands," IZA Discussion Papers 11866, Institute of Labor Economics (IZA).
    3. Mark Kattenberg & Bas Scheer & Jurre Thiel, 2023. "Causal forests with fixed effects for treatment effect heterogeneity in difference-in-differences," CPB Discussion Paper 452, CPB Netherlands Bureau for Economic Policy Analysis.
    4. Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," SciencePo Working papers Main hal-03455978, HAL.
    5. Jeffrey Smith & Arthur Sweetman, 2016. "Viewpoint: Estimating the causal effects of policies and programs," Canadian Journal of Economics, Canadian Economics Association, vol. 49(3), pages 871-905, August.
    6. Tymon S{l}oczy'nski, 2018. "Interpreting OLS Estimands When Treatment Effects Are Heterogeneous: Smaller Groups Get Larger Weights," Papers 1810.01576, arXiv.org, revised May 2020.
    7. Zimmermann, Severin & Stutzer, Alois, 2022. "The consequences of hosting asylum seekers for citizens’ policy preferences," European Journal of Political Economy, Elsevier, vol. 73(C).
    8. Joshua B. Gilbert & Zachary Himmelsbach & James Soland & Mridul Joshi & Benjamin W. Domingue, 2024. "Estimating Heterogeneous Treatment Effects with Item-Level Outcome Data: Insights from Item Response Theory," Papers 2405.00161, arXiv.org, revised Aug 2024.
    9. Weihua An & Ying Ding, 2018. "The Landscape of Causal Inference: Perspective From Citation Network Analysis," The American Statistician, Taylor & Francis Journals, vol. 72(3), pages 265-277, July.
    10. Ashesh Rambachan & Neil Shephard, 2019. "Econometric analysis of potential outcomes time series: instruments, shocks, linearity and the causal response function," Papers 1903.01637, arXiv.org, revised Feb 2020.
    11. Susan Athey & Guido Imbens, 2016. "The Econometrics of Randomized Experiments," Papers 1607.00698, arXiv.org.
    12. Myoung‐jae Lee, 2021. "Instrument residual estimator for any response variable with endogenous binary treatment," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(3), pages 612-635, July.
    13. Tymon Słoczyński, 2022. "Interpreting OLS Estimands When Treatment Effects Are Heterogeneous: Smaller Groups Get Larger Weights," The Review of Economics and Statistics, MIT Press, vol. 104(3), pages 501-509, May.
    14. Matti Sarvimäki, 2021. "Managing Refugee Protection Crises: Policy Lessons from Economics and Political Science," RF Berlin - CReAM Discussion Paper Series 2131, Rockwool Foundation Berlin (RF Berlin) - Centre for Research and Analysis of Migration (CReAM).
    15. Jasjeet Singh Sekhon & Richard D. Grieve, 2012. "A matching method for improving covariate balance in cost‐effectiveness analyses," Health Economics, John Wiley & Sons, Ltd., vol. 21(6), pages 695-714, June.
    16. Julius Owusu, 2023. "Randomization Inference of Heterogeneous Treatment Effects under Network Interference," Papers 2308.00202, arXiv.org, revised Jan 2024.
    17. Michael Lechner, 2023. "Causal Machine Learning and its use for public policy," Swiss Journal of Economics and Statistics, Springer;Swiss Society of Economics and Statistics, vol. 159(1), pages 1-15, December.
    18. Simplice A. Asongu & Joseph Nnanna & Vanessa S. Tchamyou, 2020. "Finance, Institutions and Private Investment in Africa," Working Papers of the African Governance and Development Institute. 20/080, African Governance and Development Institute..
    19. Ragni, Alessandra & Ippolito, Daniel & Masci, Chiara, 2024. "Assessing the impact of hybrid teaching on students’ academic performance via multilevel propensity score-based techniques," Socio-Economic Planning Sciences, Elsevier, vol. 92(C).
    20. Guido W. Imbens, 2022. "Causality in Econometrics: Choice vs Chance," Econometrica, Econometric Society, vol. 90(6), pages 2541-2566, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:184:y:2021:i:1:p:65-86. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.