IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2404.14603.html
   My bibliography  Save this paper

Quantifying the Internal Validity of Weighted Estimands

Author

Listed:
  • Alexandre Poirier
  • Tymon S{l}oczy'nski

Abstract

In this paper we study a class of weighted estimands, which we define as parameters that can be expressed as weighted averages of the underlying heterogeneous treatment effects. The popular ordinary least squares (OLS), two-stage least squares (2SLS), and two-way fixed effects (TWFE) estimands are all special cases within our framework. Our focus is on answering two questions concerning weighted estimands. First, under what conditions can they be interpreted as the average treatment effect for some (possibly latent) subpopulation? Second, when these conditions are satisfied, what is the upper bound on the size of that subpopulation, either in absolute terms or relative to a target population of interest? We argue that this upper bound provides a valuable diagnostic for empirical research. When a given weighted estimand corresponds to the average treatment effect for a small subset of the population of interest, we say its internal validity is low. Our paper develops practical tools to quantify the internal validity of weighted estimands.

Suggested Citation

  • Alexandre Poirier & Tymon S{l}oczy'nski, 2024. "Quantifying the Internal Validity of Weighted Estimands," Papers 2404.14603, arXiv.org.
  • Handle: RePEc:arx:papers:2404.14603
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2404.14603
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Joshua D. Angrist, 1998. "Estimating the Labor Market Impact of Voluntary Military Service Using Social Security Data on Military Applicants," Econometrica, Econometric Society, vol. 66(2), pages 249-288, March.
    2. Betsey Stevenson & Justin Wolfers, 2006. "Bargaining in the Shadow of the Law: Divorce Laws and Family Distress," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 121(1), pages 267-288.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Becker, Sascha & Hvide, Hans V, 2013. "Do entrepreneurs matter?," CAGE Online Working Paper Series 109, Competitive Advantage in the Global Economy (CAGE).
    2. Blackburn, McKinley L. & Vermilyea, Todd, 2012. "The prevalence and impact of misstated incomes on mortgage loan applications," Journal of Housing Economics, Elsevier, vol. 21(2), pages 151-168.
    3. Gordon Dahl, 2010. "Early teen marriage and future poverty," Demography, Springer;Population Association of America (PAA), vol. 47(3), pages 689-718, August.
    4. Guven, Cahit & Senik, Claudia & Stichnoth, Holger, 2012. "You can’t be happier than your wife. Happiness gaps and divorce," Journal of Economic Behavior & Organization, Elsevier, vol. 82(1), pages 110-130.
    5. Emanuela Galasso & Martin Ravallion, 2004. "Social Protection in a Crisis: Argentina's Plan Jefes y Jefas," The World Bank Economic Review, World Bank, vol. 18(3), pages 367-399.
    6. Jan Kabátek, 2018. "Divorced in a Flash: The Effect of the Administrative Divorce Option on Marital Stability in the Netherlands," Melbourne Institute Working Paper Series wp2018n12, Melbourne Institute of Applied Economic and Social Research, The University of Melbourne.
    7. Carattini, Stefano & Gillingham, Kenneth & Meng, Xiangyu & Yoeli, Erez, 2024. "Peer-to-peer solar and social rewards: Evidence from a field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 219(C), pages 340-370.
    8. Yan, Sen & Sun, Xinyu & Zhang, Yurong, 2024. "High-speed railway ripples on the greenness: Insight from urban green vegetation cover," Transportation Research Part A: Policy and Practice, Elsevier, vol. 179(C).
    9. Michael Gerfin & Michael Lechner, 2002. "A Microeconometric Evaluation of the Active Labour Market Policy in Switzerland," Economic Journal, Royal Economic Society, vol. 112(482), pages 854-893, October.
    10. Alberto Abadie & Susan Athey & Guido W. Imbens & Jeffrey M. Wooldridge, 2020. "Sampling‐Based versus Design‐Based Uncertainty in Regression Analysis," Econometrica, Econometric Society, vol. 88(1), pages 265-296, January.
    11. Nekby, Lena, 2010. "Inter- and Intra-Marriage Premiums Revisited: It’s probably who you are, not who you marry!," Research Papers in Economics 2010:23, Stockholm University, Department of Economics.
    12. Li, Li & Mak, Eric, 2016. "Marriage, Divorce, Remarriage: The Catalyst Effect of Unilateral Divorce," MPRA Paper 83330, University Library of Munich, Germany.
    13. Peter Bäckström & Erika Sandow & Olle Westerlund, 2016. "Commuting and timing of retirement," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 56(1), pages 125-152, January.
    14. Elizabeth Richardson Vigdor & James A. Mercy, 2006. "Do Laws Restricting Access to Firearms by Domestic Violence Offenders Prevent Intimate Partner Homicide?," Evaluation Review, , vol. 30(3), pages 313-346, June.
    15. Joshua S. Gans & Andrew Leigh, 2012. "Bargaining Over Labour: Do Patients Have Any Power?," The Economic Record, The Economic Society of Australia, vol. 88(281), pages 182-194, June.
    16. Sansone, Dario, 2019. "Pink work: Same-sex marriage, employment and discrimination," Journal of Public Economics, Elsevier, vol. 180(C).
    17. Boto-García, David & Mariel, Petr & Baños-Pino, José Francisco, 2023. "Intra-household bargaining for a joint vacation," Journal of choice modelling, Elsevier, vol. 47(C).
    18. Asadul Islam, 2011. "Medium- and Long-Term Participation in Microcredit: An Evaluation Using a New Panel Dataset from Bangladesh," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 93(3), pages 843-862.
    19. Augurzky, Boris & Kluve, Jochen, 2004. "Assessing the performance of matching algorithms when selection into treatment is strong," RWI Discussion Papers 21, RWI - Leibniz-Institut für Wirtschaftsforschung.
    20. Griffin Edwards, 2014. "Doing Their Duty: An Empirical Analysis of the Unintended Effect of Tarasoff v. Regents on Homicidal Activity," Journal of Law and Economics, University of Chicago Press, vol. 57(2), pages 321-348.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2404.14603. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.