IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2012.11046.html
   My bibliography  Save this paper

Policy Transforms and Learning Optimal Policies

Author

Listed:
  • Thomas M. Russell

Abstract

We study the problem of choosing optimal policy rules in uncertain environments using models that may be incomplete and/or partially identified. We consider a policymaker who wishes to choose a policy to maximize a particular counterfactual quantity called a policy transform. We characterize learnability of a set of policy options by the existence of a decision rule that closely approximates the maximin optimal value of the policy transform with high probability. Sufficient conditions are provided for the existence of such a rule. However, learnability of an optimal policy is an ex-ante notion (i.e. before observing a sample), and so ex-post (i.e. after observing a sample) theoretical guarantees for certain policy rules are also provided. Our entire approach is applicable when the distribution of unobservables is not parametrically specified, although we discuss how semiparametric restrictions can be used. Finally, we show possible applications of the procedure to a simultaneous discrete choice example and a program evaluation example.

Suggested Citation

  • Thomas M. Russell, 2020. "Policy Transforms and Learning Optimal Policies," Papers 2012.11046, arXiv.org.
    • Handle: RePEc:arx:papers:2012.11046
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2012.11046
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Beresteanu, Arie & Molchanov, Ilya & Molinari, Francesca, 2012. "Partial identification using random set theory," Journal of Econometrics, Elsevier, vol. 166(1), pages 17-32.
    2. Manski, Charles F., 1986. "Ordinal Utility Models Of Decision Making Under Uncertainty," SSRI Workshop Series 292682, University of Wisconsin-Madison, Social Systems Research Institute.
    3. Galichon, Alfred & Henry, Marc, 2009. "A test of non-identifying restrictions and confidence regions for partially identified parameters," Journal of Econometrics, Elsevier, vol. 152(2), pages 186-196, October.
    4. Miyauchi, Yuhei, 2016. "Structural estimation of pairwise stable networks with nonnegative externality," Journal of Econometrics, Elsevier, vol. 195(2), pages 224-235.
    5. James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects, and Econometric Policy Evaluation," Econometrica, Econometric Society, vol. 73(3), pages 669-738, May.
    6. Kaido, Hiroaki & Molinari, Francesca & Stoye, Jörg, 2022. "Constraint Qualifications In Partial Identification," Econometric Theory, Cambridge University Press, vol. 38(3), pages 596-619, June.
    7. Andrew Chesher & Adam Rosen, 2015. "Characterizations of identified sets delivered by structural econometric models," CeMMAP working papers CWP63/15, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    8. Andrews, Donald W.K. & Shi, Xiaoxia, 2017. "Inference based on many conditional moment inequalities," Journal of Econometrics, Elsevier, vol. 196(2), pages 275-287.
    9. Toru Kitagawa & Aleksey Tetenov, 2018. "Who Should Be Treated? Empirical Welfare Maximization Methods for Treatment Choice," Econometrica, Econometric Society, vol. 86(2), pages 591-616, March.
    10. Ismaël Mourifié & Marc Henry & Romuald Méango, 2020. "Sharp Bounds and Testability of a Roy Model of STEM Major Choices," Journal of Political Economy, University of Chicago Press, vol. 128(8), pages 3220-3283.
    11. Susanne M. Schennach, 2014. "Entropic Latent Variable Integration via Simulation," Econometrica, Econometric Society, vol. 82(1), pages 345-385, January.
    12. Pedro Carneiro & James J. Heckman & Edward J. Vytlacil, 2011. "Estimating Marginal Returns to Education," American Economic Review, American Economic Association, vol. 101(6), pages 2754-2781, October.
    13. repec:hal:spmain:info:hdl:2441/5rkqqmvrn4tl22s9mc4ao8ocg is not listed on IDEAS
    14. Charles F. Manski & Aleksey Tetenov, 2014. "The Quantile Performance of Statistical Treatment Rules Using Hypothesis Tests to Allocate a Population to Two Treatments," CeMMAP working papers CWP44/14, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    15. Andrew Chesher & Adam Rosen, 2012. "Simultaneous equations for discrete outcomes: coherence, completeness, and identification," CeMMAP working papers CWP21/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    16. Timothy F. Bresnahan & Peter C. Reiss, 1990. "Entry in Monopoly Market," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 57(4), pages 531-553.
    17. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    18. Federico Ciliberto & Charles Murry & Elie Tamer, 2021. "Market Structure and Competition in Airline Markets," Journal of Political Economy, University of Chicago Press, vol. 129(11), pages 2995-3038.
    19. Donald W. K. Andrews & Xiaoxia Shi, 2013. "Inference Based on Conditional Moment Inequalities," Econometrica, Econometric Society, vol. 81(2), pages 609-666, March.
    20. Alexander Torgovitsky, 2019. "Partial identification by extending subdistributions," Quantitative Economics, Econometric Society, vol. 10(1), pages 105-144, January.
    21. Eric Mbakop & Max Tabord‐Meehan, 2021. "Model Selection for Treatment Choice: Penalized Welfare Maximization," Econometrica, Econometric Society, vol. 89(2), pages 825-848, March.
    22. repec:cwl:cwldpp:1840rr is not listed on IDEAS
    23. repec:hal:wpspec:info:hdl:2441/5rkqqmvrn4tl22s9mc4ao8ocg is not listed on IDEAS
    24. Elie Tamer, 2003. "Incomplete Simultaneous Discrete Response Model with Multiple Equilibria," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 70(1), pages 147-165.
    25. Andrew Chesher & Adam M. Rosen & Konrad Smolinski, 2013. "An instrumental variable model of multiple discrete choice," Quantitative Economics, Econometric Society, vol. 4(2), pages 157-196, July.
    26. Andrew Chesher & Adam M. Rosen, 2014. "An instrumental variable random‐coefficients model for binary outcomes," Econometrics Journal, Royal Economic Society, vol. 17(2), pages 1-19, June.
    27. William A. Brock & Steven N. Durlauf, 2001. "Discrete Choice with Social Interactions," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 68(2), pages 235-260.
    28. Stoye, Jörg, 2009. "Minimax regret treatment choice with finite samples," Journal of Econometrics, Elsevier, vol. 151(1), pages 70-81, July.
    29. Arie Beresteanu & Ilya Molchanov & Francesca Molinari, 2011. "Sharp Identification Regions in Models With Convex Moment Predictions," Econometrica, Econometric Society, vol. 79(6), pages 1785-1821, November.
    30. Jovanovic, Boyan, 1989. "Observable Implications of Models with Multiple Equilibria," Econometrica, Econometric Society, vol. 57(6), pages 1431-1437, November.
    31. Hidehiko Ichimura & Christopher Taber, 2000. "Direct estimation of policy impacts," IFS Working Papers W00/05, Institute for Fiscal Studies.
    32. Alexandre Belloni & Federico A. Bugni & Victor Chernozhukov, 2019. "Subvector inference in PI models with many moment inequalities," CeMMAP working papers CWP28/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    33. Keisuke Hirano & Jack R. Porter, 2009. "Asymptotics for Statistical Treatment Rules," Econometrica, Econometric Society, vol. 77(5), pages 1683-1701, September.
    34. Ivar Ekeland & Alfred Galichon & Marc Henry, 2010. "Optimal transportation and the falsifiability of incompletely specified economic models," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 42(2), pages 355-374, February.
    35. Jörg Stoye, 2011. "Statistical decisions under ambiguity," Theory and Decision, Springer, vol. 70(2), pages 129-148, February.
    36. James J. Heckman, 2010. "Building Bridges between Structural and Program Evaluation Approaches to Evaluating Policy," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 356-398, June.
    37. Andrew Chesher & Adam M. Rosen, 2017. "Generalized Instrumental Variable Models," Econometrica, Econometric Society, vol. 85, pages 959-989, May.
    38. Andrews, Donald W.K. & Shi, Xiaoxia, 2014. "Nonparametric inference based on conditional moment inequalities," Journal of Econometrics, Elsevier, vol. 179(1), pages 31-45.
    39. Philip A. Haile & Elie Tamer, 2003. "Inference with an Incomplete Model of English Auctions," Journal of Political Economy, University of Chicago Press, vol. 111(1), pages 1-51, February.
    40. Pietro Tebaldi & Alexander Torgovitsky & Hanbin Yang, 2023. "Nonparametric Estimates of Demand in the California Health Insurance Exchange," Econometrica, Econometric Society, vol. 91(1), pages 107-146, January.
    41. Stoye, Jörg, 2012. "Minimax regret treatment choice with covariates or with limited validity of experiments," Journal of Econometrics, Elsevier, vol. 166(1), pages 138-156.
    42. Bresnahan, Timothy F. & Reiss, Peter C., 1991. "Empirical models of discrete games," Journal of Econometrics, Elsevier, vol. 48(1-2), pages 57-81.
    43. Maxwell B. Stinchcombe & Halbert White, 1992. "Some Measurability Results for Extrema of Random Functions Over Random Sets," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 59(3), pages 495-514.
    44. Steven E. Shreve & Dimitri P. Bertsekas, 1979. "Universally Measurable Policies in Dynamic Programming," Mathematics of Operations Research, INFORMS, vol. 4(1), pages 15-30, February.
    45. Maximilian Kasy, 2016. "Partial Identification, Distributional Preferences, and the Welfare Ranking of Policies," The Review of Economics and Statistics, MIT Press, vol. 98(1), pages 111-131, March.
    46. Qin, Duo & Gilbert, Christopher L., 2001. "The Error Term In The History Of Time Series Econometrics," Econometric Theory, Cambridge University Press, vol. 17(2), pages 424-450, April.
    47. Tetenov, Aleksey, 2012. "Statistical treatment choice based on asymmetric minimax regret criteria," Journal of Econometrics, Elsevier, vol. 166(1), pages 157-165.
    48. Magne Mogstad & Andres Santos & Alexander Torgovitsky, 2018. "Using Instrumental Variables for Inference About Policy Relevant Treatment Parameters," Econometrica, Econometric Society, vol. 86(5), pages 1589-1619, September.
    49. Charles F. Manski, 2004. "Statistical Treatment Rules for Heterogeneous Populations," Econometrica, Econometric Society, vol. 72(4), pages 1221-1246, July.
    50. Victor Chernozhukov & Han Hong & Elie Tamer, 2007. "Estimation and Confidence Regions for Parameter Sets in Econometric Models," Econometrica, Econometric Society, vol. 75(5), pages 1243-1284, September.
    51. Alfred Galichon & Marc Henry, 2011. "Set Identification in Models with Multiple Equilibria," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 78(4), pages 1264-1298.
    52. Victor Chernozhukov & Denis Chetverikov & Kengo Kato, 2012. "Gaussian approximations and multiplier bootstrap for maxima of sums of high-dimensional random vectors," Papers 1212.6906, arXiv.org, revised Jan 2018.
    53. Vasilis Syrgkanis & Elie Tamer & Juba Ziani, 2017. "Inference on Auctions with Weak Assumptions on Information," Papers 1710.03830, arXiv.org, revised Mar 2018.
    54. Andrew Chesher & Adam Rosen, 2017. "Incomplete English auction models with heterogeneity," CeMMAP working papers CWP27/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    55. Panle Jia, 2008. "What Happens When Wal-Mart Comes to Town: An Empirical Analysis of the Discount Retailing Industry," Econometrica, Econometric Society, vol. 76(6), pages 1263-1316, November.
    56. Peter L. Bartlett & Stéphane Boucheron & Gábor Lugosi, 2000. "Model selection and error estimation," Economics Working Papers 508, Department of Economics and Business, Universitat Pompeu Fabra.
    57. Marzena Rostek, 2010. "Quantile Maximization in Decision Theory ," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 77(1), pages 339-371.
    58. Charalambos D. Aliprantis & Kim C. Border, 2006. "Infinite Dimensional Analysis," Springer Books, Springer, edition 0, number 978-3-540-29587-7, December.
    59. Ivar Ekeland & Alfred Galichon & Marc Henry, 2010. "Optimal transportation and the falsifiability of incompletely specified economic models," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 42(2), pages 355-374, February.
    60. Edward Vytlacil, 2002. "Independence, Monotonicity, and Latent Index Models: An Equivalence Result," Econometrica, Econometric Society, vol. 70(1), pages 331-341, January.
    61. Andrew Chesher & Adam Rosen, 2020. "Structural modeling of simultaneous discrete choice," CeMMAP working papers CWP9/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Timothy Christensen & Hyungsik Roger Moon & Frank Schorfheide, 2022. "Optimal Decision Rules when Payoffs are Partially Identified," Papers 2204.11748, arXiv.org, revised May 2023.
    2. Kohei Yata, 2021. "Optimal Decision Rules Under Partial Identification," Papers 2111.04926, arXiv.org, revised Aug 2023.
    3. Takuya Ishihara & Toru Kitagawa, 2021. "Evidence Aggregation for Treatment Choice," Papers 2108.06473, arXiv.org, revised Jul 2024.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Francesca Molinari, 2020. "Microeconometrics with Partial Identi?cation," CeMMAP working papers CWP15/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    2. Semenova, Vira, 2023. "Debiased machine learning of set-identified linear models," Journal of Econometrics, Elsevier, vol. 235(2), pages 1725-1746.
    3. Larry G. Epstein & Hiroaki Kaido & Kyoungwon Seo, 2016. "Robust Confidence Regions for Incomplete Models," Econometrica, Econometric Society, vol. 84, pages 1799-1838, September.
    4. Lukáš Lafférs, 2019. "Identification in Models with Discrete Variables," Computational Economics, Springer;Society for Computational Economics, vol. 53(2), pages 657-696, February.
    5. Francesca Molinari, 2019. "Econometrics with Partial Identification," CeMMAP working papers CWP25/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    6. Aradillas-López, Andrés & Rosen, Adam M., 2022. "Inference in ordered response games with complete information," Journal of Econometrics, Elsevier, vol. 226(2), pages 451-476.
    7. Gu, Jiaying & Russell, Thomas M., 2023. "Partial identification in nonseparable binary response models with endogenous regressors," Journal of Econometrics, Elsevier, vol. 235(2), pages 528-562.
    8. Jiaying Gu & Thomas M. Russell, 2021. "Partial Identification in Nonseparable Binary Response Models with Endogenous Regressors," Papers 2101.01254, arXiv.org, revised Jul 2022.
    9. Yu-Chang Chen & Haitian Xie, 2022. "Personalized Subsidy Rules," Papers 2202.13545, arXiv.org, revised Mar 2022.
    10. Kate Ho & Adam M. Rosen, 2015. "Partial Identification in Applied Research: Benefits and Challenges," NBER Working Papers 21641, National Bureau of Economic Research, Inc.
    11. Susan Athey & Stefan Wager, 2021. "Policy Learning With Observational Data," Econometrica, Econometric Society, vol. 89(1), pages 133-161, January.
    12. Marc Henry & Romuald Méango & Maurice Queyranne, 2012. "Combinatorial Bootstrap Inference IN in Prtially Identified Incomplete Structural Models," CIRJE F-Series CIRJE-F-837, CIRJE, Faculty of Economics, University of Tokyo.
    13. Hoshino, Tadao & Yanagi, Takahide, 2023. "Treatment effect models with strategic interaction in treatment decisions," Journal of Econometrics, Elsevier, vol. 236(2).
    14. Hiroaki Kaido & Yi Zhang, 2019. "Robust Likelihood Ratio Tests for Incomplete Economic Models," Papers 1910.04610, arXiv.org, revised Dec 2019.
    15. Magnac, Thierry, 2013. "Identification partielle : méthodes et conséquences pour les applications empiriques," L'Actualité Economique, Société Canadienne de Science Economique, vol. 89(4), pages 233-258, Décembre.
    16. Arthur Lewbel, 2019. "The Identification Zoo: Meanings of Identification in Econometrics," Journal of Economic Literature, American Economic Association, vol. 57(4), pages 835-903, December.
    17. Lixiong Li & Marc Henry, 2022. "Finite Sample Inference in Incomplete Models," Papers 2204.00473, arXiv.org, revised Apr 2024.
    18. Toru Kitagawa & Sokbae Lee & Chen Qiu, 2022. "Treatment Choice with Nonlinear Regret," Papers 2205.08586, arXiv.org, revised Oct 2024.
    19. Alexander Torgovitsky, 2019. "Partial identification by extending subdistributions," Quantitative Economics, Econometric Society, vol. 10(1), pages 105-144, January.
    20. Victor Chernozhukov & Denis Chetverikov & Kengo Kato, 2013. "Testing Many Moment Inequalities," CeMMAP working papers 65/13, Institute for Fiscal Studies.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2012.11046. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.