IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1711.02048.html
   My bibliography  Save this paper

Identifying the Effects of a Program Offer with an Application to Head Start

Author

Listed:
  • Vishal Kamat

Abstract

I propose a treatment selection model that introduces unobserved heterogeneity in both choice sets and preferences to evaluate the average effects of a program offer. I show how to exploit the model structure to define parameters capturing these effects and then computationally characterize their identified sets under instrumental variable variation in choice sets. I illustrate these tools by analyzing the effects of providing an offer to the Head Start preschool program using data from the Head Start Impact Study. I find that such a policy affects a large number of children who take up the offer, and that they subsequently have positive effects on test scores. These effects arise from children who do not have any preschool as an outside option. A cost-benefit analysis reveals that the earning benefits associated with the test score gains can be large and outweigh the net costs associated with offer take up.

Suggested Citation

  • Vishal Kamat, 2017. "Identifying the Effects of a Program Offer with an Application to Head Start," Papers 1711.02048, arXiv.org, revised Aug 2023.
    • Handle: RePEc:arx:papers:1711.02048
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1711.02048
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ivan A. Canay & Azeem M. Shaikh, 2016. "Practical and theoretical advances in inference for partially identified models," CeMMAP working papers CWP05/16, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    2. James J. Heckman & Sergio Urzua & Edward Vytlacil, 2008. "Instrumental Variables in Models with Multiple Outcomes: The General Unordered Case," Annals of Economics and Statistics, GENES, issue 91-92, pages 151-174.
    3. Magne Mogstad & Andres Santos & Alexander Torgovitsky, 2017. "Using Instrumental Variables for Inference about Policy Relevant Treatment Effects," NBER Working Papers 23568, National Bureau of Economic Research, Inc.
    4. Hiroaki Kaido & Francesca Molinari & Jörg Stoye, 2019. "Confidence Intervals for Projections of Partially Identified Parameters," Econometrica, Econometric Society, vol. 87(4), pages 1397-1432, July.
    5. James J. Heckman & Sergio Urzua & Edward Vytlacil, 2006. "Understanding Instrumental Variables in Models with Essential Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 389-432, August.
    6. Patrick Kline & Melissa Tartari, 2016. "Bounding the Labor Supply Responses to a Randomized Welfare Experiment: A Revealed Preference Approach," American Economic Review, American Economic Association, vol. 106(4), pages 972-1014, April.
    7. James J. Heckman & Vytlacil, Edward J., 2007. "Econometric Evaluation of Social Programs, Part II: Using the Marginal Treatment Effect to Organize Alternative Econometric Estimators to Evaluate Social Programs, and to Forecast their Effects in New," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 71, Elsevier.
    8. Marc Henry & Ismael Mourifié, 2012. "Sharp Bounds in the Binary Roy Model," CIRJE F-Series CIRJE-F-835, CIRJE, Faculty of Economics, University of Tokyo.
    9. Charles F. Manski, 1997. "Monotone Treatment Response," Econometrica, Econometric Society, vol. 65(6), pages 1311-1334, November.
    10. Federico A. Bugni & Ivan A. Canay & Azeem M. Shaikh, 2018. "Inference Under Covariate-Adaptive Randomization," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(524), pages 1784-1796, October.
    11. Patrick Kline & Christopher R. Walters, 2016. "Evaluating Public Programs with Close Substitutes: The Case of HeadStart," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1795-1848.
    12. Ismaël Mourifié & Marc Henry & Romuald Méango, 2020. "Sharp Bounds and Testability of a Roy Model of STEM Major Choices," Journal of Political Economy, University of Chicago Press, vol. 128(8), pages 3220-3283.
    13. Christopher R. Walters, 2015. "Inputs in the Production of Early Childhood Human Capital: Evidence from Head Start," American Economic Journal: Applied Economics, American Economic Association, vol. 7(4), pages 76-102, October.
    14. Charles F. Manski, 2014. "Identification of income–leisure preferences and evaluation of income tax policy," Quantitative Economics, Econometric Society, vol. 5, pages 145-174, March.
    15. Richard Blundell & Amanda Gosling & Hidehiko Ichimura & Costas Meghir, 2007. "Changes in the Distribution of Male and Female Wages Accounting for Employment Composition Using Bounds," Econometrica, Econometric Society, vol. 75(2), pages 323-363, March.
    16. Lars Kirkebøen & Edwin Leuven & Magne Mogstad, 2014. "Field of Study, Earnings, and Self-Selection," NBER Working Papers 20816, National Bureau of Economic Research, Inc.
    17. Guido W. Imbens & Charles F. Manski, 2004. "Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 72(6), pages 1845-1857, November.
    18. James J. Heckman & Jeffrey Smith & Nancy Clements, 1997. "Making The Most Out Of Programme Evaluations and Social Experiments: Accounting For Heterogeneity in Programme Impacts," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 487-535.
    19. Charles F. Manski, 1996. "Learning about Treatment Effects from Experiments with Random Assignment of Treatments," Journal of Human Resources, University of Wisconsin Press, vol. 31(4), pages 709-733.
    20. Alexander Torgovitsky, 2019. "Nonparametric Inference on State Dependence in Unemployment," Econometrica, Econometric Society, vol. 87(5), pages 1475-1505, September.
    21. Charles F. Manski, 2007. "Partial Identification Of Counterfactual Choice Probabilities," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 48(4), pages 1393-1410, November.
    22. Heckman, James J & Honore, Bo E, 1990. "The Empirical Content of the Roy Model," Econometrica, Econometric Society, vol. 58(5), pages 1121-1149, September.
    23. Jörg Stoye, 2010. "Partial identification of spread parameters," Quantitative Economics, Econometric Society, vol. 1(2), pages 323-357, November.
    24. Charles F. Manski & John V. Pepper, 2000. "Monotone Instrumental Variables, with an Application to the Returns to Schooling," Econometrica, Econometric Society, vol. 68(4), pages 997-1012, July.
    25. James J. Heckman & Rodrigo Pinto, 2018. "Unordered Monotonicity," Econometrica, Econometric Society, vol. 86(1), pages 1-35, January.
    26. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    27. Charles F. Manski, 1997. "The Mixing Problem in Programme Evaluation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 537-553.
    28. Jacob Marschak, 1959. "Binary Choice Constraints on Random Utility Indicators," Cowles Foundation Discussion Papers 74, Cowles Foundation for Research in Economics, Yale University.
    29. Bugni, Federico A., 2016. "Comparison Of Inferential Methods In Partially Identified Models In Terms Of Error In Coverage Probability," Econometric Theory, Cambridge University Press, vol. 32(1), pages 187-242, February.
    30. repec:adr:anecst:y:2008:i:91-92:p:08 is not listed on IDEAS
    31. Alexander Torgovitsky, 2019. "Partial identification by extending subdistributions," Quantitative Economics, Econometric Society, vol. 10(1), pages 105-144, January.
    32. Charles F. Manski & John V. Pepper, 2009. "More on monotone instrumental variables," Econometrics Journal, Royal Economic Society, vol. 12(s1), pages 200-216, January.
    33. Joseph P. Romano & Azeem M. Shaikh, 2010. "Inference for the Identified Set in Partially Identified Econometric Models," Econometrica, Econometric Society, vol. 78(1), pages 169-211, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sokbae Lee & Bernard Salani'e, 2020. "Treatment Effects with Targeting Instruments," Papers 2007.10432, arXiv.org, revised Dec 2024.
    2. Pietro Tebaldi & Alexander Torgovitsky & Hanbin Yang, 2023. "Nonparametric Estimates of Demand in the California Health Insurance Exchange," Econometrica, Econometric Society, vol. 91(1), pages 107-146, January.
    3. Vira Semenova, 2023. "Aggregated Intersection Bounds and Aggregated Minimax Values," Papers 2303.00982, arXiv.org, revised Jun 2024.
    4. Vishal Kamat & Samuel Norris & Matthew Pecenco, 2023. "Identification in Multiple Treatment Models under Discrete Variation," Papers 2307.06174, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kamat, Vishal, 2019. "Identification with Latent Choice Sets," TSE Working Papers 19-1031, Toulouse School of Economics (TSE).
    2. Kamat, Vishal, 2024. "Identifying the effects of a program offer with an application to Head Start," Journal of Econometrics, Elsevier, vol. 240(1).
    3. Francesca Molinari, 2020. "Microeconometrics with Partial Identi?cation," CeMMAP working papers CWP15/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    4. Francesca Molinari, 2019. "Econometrics with Partial Identification," CeMMAP working papers CWP25/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    5. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    6. Vishal Kamat & Samuel Norris & Matthew Pecenco, 2023. "Identification in Multiple Treatment Models under Discrete Variation," Papers 2307.06174, arXiv.org.
    7. Sokbae Lee & Bernard Salanié, 2018. "Identifying Effects of Multivalued Treatments," Econometrica, Econometric Society, vol. 86(6), pages 1939-1963, November.
    8. Kate Ho & Adam M. Rosen, 2015. "Partial Identification in Applied Research: Benefits and Challenges," NBER Working Papers 21641, National Bureau of Economic Research, Inc.
    9. Sianesi, Barbara, 2017. "Evidence of randomisation bias in a large-scale social experiment: The case of ERA," Journal of Econometrics, Elsevier, vol. 198(1), pages 41-64.
    10. Tsunao Okumura & Emiko Usui, 2014. "Concave‐monotone treatment response and monotone treatment selection: With an application to the returns to schooling," Quantitative Economics, Econometric Society, vol. 5, pages 175-194, March.
    11. Lee, Ji Hyung & Park, Byoung G., 2023. "Nonparametric identification and estimation of the extended Roy model," Journal of Econometrics, Elsevier, vol. 235(2), pages 1087-1113.
    12. Manski, Charles F., 2000. "Identification problems and decisions under ambiguity: Empirical analysis of treatment response and normative analysis of treatment choice," Journal of Econometrics, Elsevier, vol. 95(2), pages 415-442, April.
    13. Ismaël Mourifié & Marc Henry & Romuald Méango, 2020. "Sharp Bounds and Testability of a Roy Model of STEM Major Choices," Journal of Political Economy, University of Chicago Press, vol. 128(8), pages 3220-3283.
    14. Gu, Jiaying & Russell, Thomas M., 2023. "Partial identification in nonseparable binary response models with endogenous regressors," Journal of Econometrics, Elsevier, vol. 235(2), pages 528-562.
    15. Lukáš Lafférs, 2019. "Bounding average treatment effects using linear programming," Empirical Economics, Springer, vol. 57(3), pages 727-767, September.
    16. Sungwon Lee, 2024. "Partial identification and inference for conditional distributions of treatment effects," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(1), pages 107-127, January.
    17. Sun, Zhenting, 2023. "Instrument validity for heterogeneous causal effects," Journal of Econometrics, Elsevier, vol. 237(2).
    18. Bartalotti, Otávio & Kédagni, Désiré & Possebom, Vitor, 2023. "Identifying marginal treatment effects in the presence of sample selection," Journal of Econometrics, Elsevier, vol. 234(2), pages 565-584.
    19. Sung Jae Jun & Sokbae Lee, 2023. "Identifying the Effect of Persuasion," Journal of Political Economy, University of Chicago Press, vol. 131(8), pages 2032-2058.
    20. Matthew A Masten & Alexandre Poirier, 2023. "Choosing exogeneity assumptions in potential outcome models," The Econometrics Journal, Royal Economic Society, vol. 26(3), pages 327-349.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1711.02048. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.