IDEAS home Printed from https://ideas.repec.org/a/sae/joupea/v61y2024i3p462-476.html
   My bibliography  Save this article

Bias mitigation in empirical peace and conflict studies: A short primer on posttreatment variables

Author

Listed:
  • Christoph Dworschak

    (Department of Politics, University of York)

Abstract

Posttreatment variables are covariates that are preceded by the main explanatory variable. Their inclusion in a statistical model does not ‘control’ for their influence on the relationship of interest, and it does not substitute for a mediation analysis. Likewise, a coefficient estimate of an appropriate ‘control variable’ cannot be interpreted as a causal effect estimate. While these facts are well-established in various fields across the social sciences, their recognition in the field of peace and conflict studies is more limited. Originally collected data on recent publications from leading peace and conflict journals reveal that a large majority of evaluated articles condition on posttreatment variables, demonstrating how a review of these fallacies can help to substantially improve future research on peace and conflict. Drawing on a broad set of literature and using graphical approaches, I offer an intuitive explanation of the logic of posttreatment variables and clarify common misconceptions. Building on recent developments in methodology and software, and by deriving conditions for bounding using analytical bias expressions, I discuss avenues for dealing with posttreatment variables in observational studies. The article concludes with a discussion of implications for applied research.

Suggested Citation

  • Christoph Dworschak, 2024. "Bias mitigation in empirical peace and conflict studies: A short primer on posttreatment variables," Journal of Peace Research, Peace Research Institute Oslo, vol. 61(3), pages 462-476, May.
    • Handle: RePEc:sae:joupea:v:61:y:2024:i:3:p:462-476
    DOI: 10.1177/00223433221145531
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/00223433221145531
    Download Restriction: no
    File URL: https://libkey.io/10.1177/00223433221145531?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Adam N. Glynn, 2012. "The Product and Difference Fallacies for Indirect Effects," American Journal of Political Science, John Wiley & Sons, vol. 56(1), pages 257-269, January.
    2. Imai, Kosuke & Keele, Luke & Tingley, Dustin & Yamamoto, Teppei, 2011. "Unpacking the Black Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies," American Political Science Review, Cambridge University Press, vol. 105(4), pages 765-789, November.
    3. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    4. Hannah Smidt, 2020. "Mitigating election violence locally: UN peacekeepers’ election-education campaigns in Côte d’Ivoire," Journal of Peace Research, Peace Research Institute Oslo, vol. 57(1), pages 199-216, January.
    5. Blackwell, Matthew & Glynn, Adam N., 2018. "How to Make Causal Inferences with Time-Series Cross-Sectional Data under Selection on Observables," American Political Science Review, Cambridge University Press, vol. 112(4), pages 1067-1082, November.
    6. Acharya, Avidit & Blackwell, Matthew & Sen, Maya, 2016. "Explaining Causal Findings Without Bias: Detecting and Assessing Direct Effects," American Political Science Review, Cambridge University Press, vol. 110(3), pages 512-529, August.
    7. Keele, Luke & Stevenson, Randolph T. & Elwert, Felix, 2020. "The causal interpretation of estimated associations in regression models," Political Science Research and Methods, Cambridge University Press, vol. 8(1), pages 1-13, January.
    8. Carlos Cinelli & Chad Hazlett, 2020. "Making sense of sensitivity: extending omitted variable bias," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(1), pages 39-67, February.
    9. Blackwell, Matthew, 2014. "A Selection Bias Approach to Sensitivity Analysis for Causal Effects," Political Analysis, Cambridge University Press, vol. 22(2), pages 169-182, April.
    10. Rosseel, Yves, 2012. "lavaan: An R Package for Structural Equation Modeling," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i02).
    11. Shpitser Ilya & VanderWeele Tyler J, 2011. "A Complete Graphical Criterion for the Adjustment Formula in Mediation Analysis," The International Journal of Biostatistics, De Gruyter, vol. 7(1), pages 1-24, March.
    12. Jacob M. Montgomery & Brendan Nyhan & Michelle Torres, 2018. "How Conditioning on Posttreatment Variables Can Ruin Your Experiment and What to Do about It," American Journal of Political Science, John Wiley & Sons, vol. 62(3), pages 760-775, July.
    13. Kosuke Imai & Gary King & Elizabeth A. Stuart, 2008. "Misunderstandings between experimentalists and observationalists about causal inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 171(2), pages 481-502, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Grätz, Michael, 2019. "When Less Conditioning Provides Better Estimates: Overcontrol and Collider Bias in Research on Intergenerational Mobility," Working Paper Series 2/2019, Stockholm University, Swedish Institute for Social Research.
    2. Humphreys, John M. & Srygley, Robert B. & Lawton, Douglas & Hudson, Amy R. & Branson, David H., 2022. "Grasshoppers exhibit asynchrony and spatial non-stationarity in response to the El Niño/Southern and Pacific Decadal Oscillations," Ecological Modelling, Elsevier, vol. 471(C).
    3. Jiawei Fu, 2024. "Extracting Mechanisms from Heterogeneous Effects: An Identification Strategy for Mediation Analysis," Papers 2403.04131, arXiv.org, revised Oct 2024.
    4. Geraldo, Pablo, 2024. "Credible causal inference beyond toy models," SocArXiv x4526, Center for Open Science.
    5. S Anukriti & Catalina Herrera‐Almanza & Praveen K. Pathak & Mahesh Karra, 2020. "Curse of the Mummy‐ji: The Influence of Mothers‐in‐Law on Women in India†," American Journal of Agricultural Economics, John Wiley & Sons, vol. 102(5), pages 1328-1351, October.
    6. Acharya, Avidit & Blackwell, Matthew & Sen, Maya, 2016. "Explaining Causal Findings Without Bias: Detecting and Assessing Direct Effects," American Political Science Review, Cambridge University Press, vol. 110(3), pages 512-529, August.
    7. Emilio Depetris-Chauvin & Ömer Özak, 2020. "The origins of the division of labor in pre-industrial times," Journal of Economic Growth, Springer, vol. 25(3), pages 297-340, September.
    8. Parker Hevron, 2018. "Judicialization and Its Effects: Experiments as a Way Forward," Laws, MDPI, vol. 7(2), pages 1-21, May.
    9. Colnet Bénédicte & Josse Julie & Varoquaux Gaël & Scornet Erwan, 2022. "Causal effect on a target population: A sensitivity analysis to handle missing covariates," Journal of Causal Inference, De Gruyter, vol. 10(1), pages 372-414, January.
    10. Maude Lavanchy & Patrick Reichert & Jayanth Narayanan & Krishna Savani, 2023. "Applicants’ Fairness Perceptions of Algorithm-Driven Hiring Procedures," Journal of Business Ethics, Springer, vol. 188(1), pages 125-150, November.
    11. Hao, Shiming, 2021. "True structure change, spurious treatment effect? A novel approach to disentangle treatment effects from structure changes," MPRA Paper 108679, University Library of Munich, Germany.
    12. Annika B. Bergbauer, 2019. "How Did EU Membership of Eastern Europe Affect Student Achievement?," ifo Working Paper Series 299, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    13. Reeves, Aaron, 2021. "The health effects of wage setting institutions: how collective bargaining improves health but not because it reduces inequality," LSE Research Online Documents on Economics 113422, London School of Economics and Political Science, LSE Library.
    14. Boerner, Lars & Rubin, Jared & Severgnini, Battista, 2021. "A time to print, a time to reform," European Economic Review, Elsevier, vol. 138(C).
    15. Reimer, Matthew N. & Haynie, Alan C., 2018. "Mechanisms matter for evaluating the economic impacts of marine reserves," Journal of Environmental Economics and Management, Elsevier, vol. 88(C), pages 427-446.
    16. Maria Paula Saffon & Fabio Sánchez, 2019. "Historical grievances and war dynamics: Old land conflicts as a cause of current forced displacements in Colombia," Documentos CEDE 17320, Universidad de los Andes, Facultad de Economía, CEDE.
    17. Benjamin Krick & Jonathan Petkun & Mara Revkin, 2023. "What Determines Military Legitimacy? Evidence from the Battle of Mosul in Iraq," HiCN Working Papers 402, Households in Conflict Network.
    18. Christopher Wiley Shay, 2023. "Swords into ploughshares? Why human rights abuses persist after resistance campaigns," Journal of Peace Research, Peace Research Institute Oslo, vol. 60(1), pages 141-156, January.
    19. Carpena, Fenella & Zia, Bilal, 2020. "The causal mechanism of financial education: Evidence from mediation analysis," Journal of Economic Behavior & Organization, Elsevier, vol. 177(C), pages 143-184.
    20. Cristobal Young, 2019. "The Difference Between Causal Analysis and Predictive Models: Response to “Comment on Young and Holsteen (2017)â€," Sociological Methods & Research, , vol. 48(2), pages 431-447, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:joupea:v:61:y:2024:i:3:p:462-476. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: http://www.prio.no/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.