IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/37148.html
   My bibliography  Save this paper

Partial identification of the distribution of treatment effects and its confidence sets

Author

Listed:
  • Fan, Yanqin
  • Park, Sang Soo

Abstract

In this paper, we study partial identification of the distribution of treatment effects of a binary treatment for ideal randomized experiments, ideal randomized experiments with a known value of a dependence measure, and for data satisfying the selection-on-observables assumption respectively. For ideal randomized experiments, (i) we propose nonparametric estimators of the sharp bounds on the distribution of treatment effects and construct asymptotically valid confidence sets for the distribution of treatment effects; (ii) we propose bias-corrected estimators of the sharp bounds on the distribution of treatment effects; and (iii) we investigate finite sample performances of the proposed confidence sets and the bias-corrected estimators via simulation.

Suggested Citation

  • Fan, Yanqin & Park, Sang Soo, 2009. "Partial identification of the distribution of treatment effects and its confidence sets," MPRA Paper 37148, University Library of Munich, Germany.
    • Handle: RePEc:pra:mprapa:37148
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/37148/1/MPRA_paper_37148.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Pedro Carneiro & Karsten T. Hansen & James J. Heckman, 2003. "Estimating Distributions of Treatment Effects with an Application to the Returns to Schooling and Measurement of the Effects of Uncertainty on College," NBER Working Papers 9546, National Bureau of Economic Research, Inc.
    2. Nelsen, Roger B. & Molina, José Juan Quesada & Lallena, José Antonio Rodríguez & Flores, Manuel Úbeda, 2004. "Best-possible bounds on sets of bivariate distribution functions," Journal of Multivariate Analysis, Elsevier, vol. 90(2), pages 348-358, August.
    3. James J. Heckman & Jeffrey Smith & Nancy Clements, 1997. "Making The Most Out Of Programme Evaluations and Social Experiments: Accounting For Heterogeneity in Programme Impacts," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 487-535.
    4. Carneiro, Pedro & Hansen, Karsten T. & Heckman, James J., 2003. "Estimating Distributions of Treatment Effects with an Application to the Returns to Schooling and Measurement of the Effects of Uncertainty on College Choice," IZA Discussion Papers 767, Institute of Labor Economics (IZA).
    5. Pedro Carneiro & Karsten T. Hansen & James J. Heckman, 2003. "2001 Lawrence R. Klein Lecture Estimating Distributions of Treatment Effects with an Application to the Returns to Schooling and Measurement of the Effects of Uncertainty on College Choice," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 44(2), pages 361-422, May.
    6. Jinyong Hahn, 1998. "On the Role of the Propensity Score in Efficient Semiparametric Estimation of Average Treatment Effects," Econometrica, Econometric Society, vol. 66(2), pages 315-332, March.
    7. Joseph P. Romano & Azeem M. Shaikh, 2010. "Inference for the Identified Set in Partially Identified Econometric Models," Econometrica, Econometric Society, vol. 78(1), pages 169-211, January.
    8. Galichon, Alfred & Henry, Marc, 2009. "A test of non-identifying restrictions and confidence regions for partially identified parameters," Journal of Econometrics, Elsevier, vol. 152(2), pages 186-196, October.
    9. Jorg Stoye, 2009. "More on Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 77(4), pages 1299-1315, July.
    10. Michael Lechner, 1999. "Nonparametric bounds on employment and income effects of continuous vocational training in East Germany," Econometrics Journal, Royal Economic Society, vol. 2(1), pages 1-28.
    11. Marianne P. Bitler & Jonah B. Gelbach & Hilary W. Hoynes, 2006. "What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments," American Economic Review, American Economic Association, vol. 96(4), pages 988-1012, September.
    12. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    13. Dan A. Black & Jeffrey A. Smith & Mark C. Berger & Brett J. Noel, 2002. "Is the Threat of Reemployment Services More Effective than the Services Themselves? Experimental Evidence from the UI System," NBER Working Papers 8825, National Bureau of Economic Research, Inc.
    14. Guido W. Imbens & Charles F. Manski, 2004. "Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 72(6), pages 1845-1857, November.
    15. Robert J. LaLonde, 1995. "The Promise of Public Sector-Sponsored Training Programs," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 149-168, Spring.
    16. Dan A. Black & Jeffrey A. Smith & Mark C. Berger & Brett J. Noel, 2003. "Is the Threat of Reemployment Services More Effective Than the Services Themselves? Evidence from Random Assignment in the UI System," American Economic Review, American Economic Association, vol. 93(4), pages 1313-1327, September.
    17. Donald W. K. Andrews, 2000. "Inconsistency of the Bootstrap when a Parameter Is on the Boundary of the Parameter Space," Econometrica, Econometric Society, vol. 68(2), pages 399-406, March.
    18. E. Tamer & V. Chernozhukov & H. Hong, 2004. "Parameter Set Inference in a Class of Econometric Models," Econometric Society 2004 North American Winter Meetings 382, Econometric Society.
    19. Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2003. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometrica, Econometric Society, vol. 71(4), pages 1161-1189, July.
    20. Rosen, Adam M., 2008. "Confidence sets for partially identified parameters that satisfy a finite number of moment inequalities," Journal of Econometrics, Elsevier, vol. 146(1), pages 107-117, September.
    21. Victor Chernozhukov & Christian Hansen, 2005. "An IV Model of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 73(1), pages 245-261, January.
    22. Djebbari, Habiba & Smith, Jeffrey, 2008. "Heterogeneous impacts in PROGRESA," Journal of Econometrics, Elsevier, vol. 145(1-2), pages 64-80, July.
    23. Guido W. Imbens & Donald B. Rubin, 1997. "Estimating Outcome Distributions for Compliers in Instrumental Variables Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 555-574.
    24. Charles F. Manski, 1997. "The Mixing Problem in Programme Evaluation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 537-553.
    25. Andrews, Donald W.K. & Guggenberger, Patrik, 2009. "Validity Of Subsampling And “Plug-In Asymptotic” Inference For Parameters Defined By Moment Inequalities," Econometric Theory, Cambridge University Press, vol. 25(3), pages 669-709, June.
    26. Sergio Firpo, 2007. "Efficient Semiparametric Estimation of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 75(1), pages 259-276, January.
    27. Jörg Stoye, 2010. "Partial identification of spread parameters," Quantitative Economics, Econometric Society, vol. 1(2), pages 323-357, November.
    28. Canay, Ivan A., 2010. "EL inference for partially identified models: Large deviations optimality and bootstrap validity," Journal of Econometrics, Elsevier, vol. 156(2), pages 408-425, June.
    29. Abbring, Jaap H. & Heckman, James J., 2007. "Econometric Evaluation of Social Programs, Part III: Distributional Treatment Effects, Dynamic Treatment Effects, Dynamic Discrete Choice, and General Equilibrium Policy Evaluation," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 72, Elsevier.
    30. Lechner, Michael, 1999. "Earnings and Employment Effects of Continuous Off-the-Job Training in East Germany after Unification," Journal of Business & Economic Statistics, American Statistical Association, vol. 17(1), pages 74-90, January.
    31. Fan, Yanqin & Park, Sang Soo, 2010. "Confidence sets for some partially identified parameters," MPRA Paper 37149, University Library of Munich, Germany.
    32. Firpo, Sergio Pinheiro & Ridder, Geert, 2010. "Bounds on functionals of the distribution treatment effects," Textos para discussão 201, FGV EESP - Escola de Economia de São Paulo, Fundação Getulio Vargas (Brazil).
    33. Lee, Myoung-jae, 2005. "Micro-Econometrics for Policy, Program and Treatment Effects," OUP Catalogue, Oxford University Press, number 9780199267699.
    34. Denuit, M. & Genest, C. & Marceau, E., 1999. "Stochastic bounds on sums of dependent risks," Insurance: Mathematics and Economics, Elsevier, vol. 25(1), pages 85-104, September.
    35. Fan, Yanqin & Park, Sang Soo, 2010. "Sharp Bounds On The Distribution Of Treatment Effects And Their Statistical Inference," Econometric Theory, Cambridge University Press, vol. 26(3), pages 931-951, June.
    36. Donald W. K. Andrews & Gustavo Soares, 2010. "Inference for Parameters Defined by Moment Inequalities Using Generalized Moment Selection," Econometrica, Econometric Society, vol. 78(1), pages 119-157, January.
    37. Arild Aakvik & James J. Heckman & Edward J. Vytlacil, 2000. "Treatment Effects for Discrete Outcomes when Responses to Treatment Vary Among Observationally Identical Persons: An Application to Norwegian ..," NBER Technical Working Papers 0262, National Bureau of Economic Research, Inc.
    38. Aakvik, Arild & Heckman, James J. & Vytlacil, Edward J., 2005. "Estimating treatment effects for discrete outcomes when responses to treatment vary: an application to Norwegian vocational rehabilitation programs," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 15-51.
    39. Leigh Tesfatsion, 1976. "Stochastic Dominance and the Maximization of Expected Utility," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 43(2), pages 301-315.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Callaway, Brantly, 2021. "Bounds on distributional treatment effect parameters using panel data with an application on job displacement," Journal of Econometrics, Elsevier, vol. 222(2), pages 861-881.
    2. Victor Chernozhukov & Sokbae Lee & Adam M. Rosen, 2013. "Intersection Bounds: Estimation and Inference," Econometrica, Econometric Society, vol. 81(2), pages 667-737, March.
    3. Matthew A. Masten & Alexandre Poirier, 2020. "Inference on breakdown frontiers," Quantitative Economics, Econometric Society, vol. 11(1), pages 41-111, January.
    4. Pablo Lavado & Gonzalo Rivera, 2016. "Identifying Treatment Effects with Data Combination and Unobserved Heterogeneity," Working Papers 79, Peruvian Economic Association.
    5. Brantly Callaway, 2017. "Job Displacement during the Great Recession: Tight Bounds on Distributional Treatment Effect Parameters using Panel Data," DETU Working Papers 1703, Department of Economics, Temple University.
    6. Jiannan Lu & Peng Ding & Tirthankar Dasgupta, 2018. "Treatment Effects on Ordinal Outcomes: Causal Estimands and Sharp Bounds," Journal of Educational and Behavioral Statistics, , vol. 43(5), pages 540-567, October.
    7. Firpo, Sergio & Galvao, Antonio F. & Parker, Thomas, 2023. "Uniform inference for value functions," Journal of Econometrics, Elsevier, vol. 235(2), pages 1680-1699.
    8. Fan, Yanqin & Guerre, Emmanuel & Zhu, Dongming, 2017. "Partial identification of functionals of the joint distribution of “potential outcomes”," Journal of Econometrics, Elsevier, vol. 197(1), pages 42-59.
    9. Matthew Gentry & Tong Li, 2014. "Identification in Auctions With Selective Entry," Econometrica, Econometric Society, vol. 82(1), pages 315-344, January.
    10. Fan Yanqin & Sherman Robert & Shum Matthew, 2016. "Estimation and Inference in an Ecological Inference Model," Journal of Econometric Methods, De Gruyter, vol. 5(1), pages 17-48, January.
    11. Fan, Yanqin & Park, Sang Soo, 2012. "Confidence intervals for the quantile of treatment effects in randomized experiments," Journal of Econometrics, Elsevier, vol. 167(2), pages 330-344.
    12. Pablo Lavado, "undated". "Identifying Treatment Effects and Counterfactual Distributions using Data Combination with Unobserved Heterogeneity," Working Papers 13-25, Departamento de Economía, Universidad del Pacífico.
    13. Fan, Yanqin & Yu, Zhengfei, 2012. "Partial identification of distributional and quantile treatment effects in difference-in-differences models," Economics Letters, Elsevier, vol. 115(3), pages 511-515.
    14. Pablo Lavado & Gonzalo Rivera, 2015. "Identifying treatment effects and counterfactual distributions using data combination with unobserved heterogeneity," Working Papers 15-14, Centro de Investigación, Universidad del Pacífico.
    15. Chiburis, Richard C., 2010. "Semiparametric bounds on treatment effects," Journal of Econometrics, Elsevier, vol. 159(2), pages 267-275, December.
    16. Fan, Yanqin & Park, Sang Soo, 2014. "Nonparametric inference for counterfactual means: Bias-correction, confidence sets, and weak IV," Journal of Econometrics, Elsevier, vol. 178(P1), pages 45-56.
    17. Fan, Yanqin & Park, Sang Soo, 2010. "Confidence sets for some partially identified parameters," MPRA Paper 37149, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    2. Sergio Firpo & Cristine Pinto, 2016. "Identification and Estimation of Distributional Impacts of Interventions Using Changes in Inequality Measures," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(3), pages 457-486, April.
    3. Fan, Yanqin & Park, Sang Soo, 2012. "Confidence intervals for the quantile of treatment effects in randomized experiments," Journal of Econometrics, Elsevier, vol. 167(2), pages 330-344.
    4. Fan, Yanqin & Guerre, Emmanuel & Zhu, Dongming, 2017. "Partial identification of functionals of the joint distribution of “potential outcomes”," Journal of Econometrics, Elsevier, vol. 197(1), pages 42-59.
    5. Firpo, Sergio & Ridder, Geert, 2019. "Partial identification of the treatment effect distribution and its functionals," Journal of Econometrics, Elsevier, vol. 213(1), pages 210-234.
    6. James J. Heckman, 2008. "The Principles Underlying Evaluation Estimators with an Application to Matching," Annals of Economics and Statistics, GENES, issue 91-92, pages 9-73.
    7. Donald W. K. Andrews & Panle Jia Barwick, 2012. "Inference for Parameters Defined by Moment Inequalities: A Recommended Moment Selection Procedure," Econometrica, Econometric Society, vol. 80(6), pages 2805-2826, November.
    8. Callaway, Brantly, 2021. "Bounds on distributional treatment effect parameters using panel data with an application on job displacement," Journal of Econometrics, Elsevier, vol. 222(2), pages 861-881.
    9. Sung Jae Jun & Yoonseok Lee & Youngki Shin, 2016. "Treatment Effects With Unobserved Heterogeneity: A Set Identification Approach," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(2), pages 302-311, April.
    10. Paul. B. Kenfac Dongmezo & P. N. Mwita & I. R. Kamga Tchwaket, 2018. "Distributive and Quantile Treatment Effects: Imputation Based Estimators Approach," Journal of Statistical and Econometric Methods, SCIENPRESS Ltd, vol. 7(2), pages 1-3.
    11. Fan, Yanqin & Park, Sang Soo, 2010. "Confidence sets for some partially identified parameters," MPRA Paper 37149, University Library of Munich, Germany.
    12. Heckman, James J., 2010. "The Assumptions Underlying Evaluation Estimators," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 30(2), December.
    13. Christian Bontemps & Thierry Magnac & Eric Maurin, 2012. "Set Identified Linear Models," Econometrica, Econometric Society, vol. 80(3), pages 1129-1155, May.
    14. Chen, Le-Yu & Szroeter, Jerzy, 2014. "Testing multiple inequality hypotheses: A smoothed indicator approach," Journal of Econometrics, Elsevier, vol. 178(P3), pages 678-693.
    15. Gautier, Eric & Hoderlein, Stefan, 2011. "A triangular treatment effect model with random coefficients in the selection equation," TSE Working Papers 15-598, Toulouse School of Economics (TSE), revised 25 Aug 2015.
    16. Magnac, Thierry, 2013. "Identification partielle : méthodes et conséquences pour les applications empiriques," L'Actualité Economique, Société Canadienne de Science Economique, vol. 89(4), pages 233-258, Décembre.
    17. Zongwu Cai & Ying Fang & Ming Lin & Shengfang Tang, 2020. "Inferences for Partially Conditional Quantile Treatment Effect Model," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202005, University of Kansas, Department of Economics, revised Feb 2020.
    18. Bedoya Arguelles,Guadalupe & Bittarello,Luca & Davis,Jonathan Martin Villars & Mittag,Nikolas Karl & Bedoya Arguelles,Guadalupe & Bittarello,Luca & Davis,Jonathan Martin Villars & Mittag,Nikolas Karl, 2017. "Distributional impact analysis: toolkit and illustrations of impacts beyond the average treatment effect," Policy Research Working Paper Series 8139, The World Bank.
    19. Donald W. K. Andrews & Xiaoxia Shi, 2013. "Inference Based on Conditional Moment Inequalities," Econometrica, Econometric Society, vol. 81(2), pages 609-666, March.
    20. Fan, Yanqin & Park, Sang Soo, 2014. "Nonparametric inference for counterfactual means: Bias-correction, confidence sets, and weak IV," Journal of Econometrics, Elsevier, vol. 178(P1), pages 45-56.

    More about this item

    Keywords

    Confidence sets; partial identification; distribution; treatment effects;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C19 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Other
    • C49 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Other
    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C01 - Mathematical and Quantitative Methods - - General - - - Econometrics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:37148. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.