IDEAS home Printed from https://ideas.repec.org/a/spr/jecrev/v69y2018i1d10.1111_jere.12169.html
   My bibliography  Save this article

Estimation of Discrete Choice Dynamic Programming Models

Author

Listed:
  • Hiroyuki Kasahara

    (University of British Columbia)

  • Katsumi Shimotsu

    (University of Tokyo)

Abstract

This study reviews estimation methods for the infinite horizon discrete choice dynamic programming models and conducts Monte Carlo experiments. We consider: the maximum likelihood estimator (MLE), the two-step conditional choice probabilities estimator, sequential estimators based on policy iterations mapping under finite dependence, and sequential estimators based on value iteration mappings. Our simulation result shows that the estimation performance of the sequential estimators based on policy iterations and value iteration mappings is largely comparable to the MLE, while they achieve substantial computation gains over the MLE by a factor of 100 for a model with a moderately large state space.

Suggested Citation

  • Hiroyuki Kasahara & Katsumi Shimotsu, 2018. "Estimation of Discrete Choice Dynamic Programming Models," The Japanese Economic Review, Springer, vol. 69(1), pages 28-58, March.
    • Handle: RePEc:spr:jecrev:v:69:y:2018:i:1:d:10.1111_jere.12169
    DOI: 10.1111/jere.12169
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1111/jere.12169
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1111/jere.12169?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Miller, Robert A, 1984. "Job Matching and Occupational Choice," Journal of Political Economy, University of Chicago Press, vol. 92(6), pages 1086-1120, December.
    2. Gautam Gowrisankaran & Marc Rysman, 2012. "Dynamics of Consumer Demand for New Durable Goods," Journal of Political Economy, University of Chicago Press, vol. 120(6), pages 1173-1219.
    3. Rust, John, 1987. "Optimal Replacement of GMC Bus Engines: An Empirical Model of Harold Zurcher," Econometrica, Econometric Society, vol. 55(5), pages 999-1033, September.
    4. V. Joseph Hotz & Robert A. Miller, 1993. "Conditional Choice Probabilities and the Estimation of Dynamic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 60(3), pages 497-529.
    5. Sumru Altuğ & Robert A. Miller, 1998. "The Effect of Work Experience on Female Wages and Labour Supply," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(1), pages 45-85.
    6. Srisuma, Sorawoot & Linton, Oliver, 2012. "Semiparametric estimation of Markov decision processes with continuous state space," Journal of Econometrics, Elsevier, vol. 166(2), pages 320-341.
    7. Peter Arcidiacono & Paul B. Ellickson, 2011. "Practical Methods for Estimation of Dynamic Discrete Choice Models," Annual Review of Economics, Annual Reviews, vol. 3(1), pages 363-394, September.
    8. Kasahara, Hiroyuki, 2009. "Temporary Increases in Tariffs and Investment: The Chilean Experience," Journal of Business & Economic Statistics, American Statistical Association, vol. 27, pages 113-127.
    9. Sanghamitra Das & Mark J. Roberts & James R. Tybout, 2007. "Market Entry Costs, Producer Heterogeneity, and Export Dynamics," Econometrica, Econometric Society, vol. 75(3), pages 837-873, May.
    10. Donna B. Gilleskie, 1998. "A Dynamic Stochastic Model of Medical Care Use and Work Absence," Econometrica, Econometric Society, vol. 66(1), pages 1-46, January.
    11. Rothwell, Geoffrey & Rust, John, 1997. "On the Optimal Lifetime of Nuclear Power Plants," Journal of Business & Economic Statistics, American Statistical Association, vol. 15(2), pages 195-208, April.
    12. Wolpin, Kenneth I, 1984. "An Estimable Dynamic Stochastic Model of Fertility and Child Mortality," Journal of Political Economy, University of Chicago Press, vol. 92(5), pages 852-874, October.
    13. Victor Aguirregabiria & Pedro Mira, 2002. "Swapping the Nested Fixed Point Algorithm: A Class of Estimators for Discrete Markov Decision Models," Econometrica, Econometric Society, vol. 70(4), pages 1519-1543, July.
    14. John Rust & Christopher Phelan, 1997. "How Social Security and Medicare Affect Retirement Behavior in a World of Incomplete Markets," Econometrica, Econometric Society, vol. 65(4), pages 781-832, July.
    15. Pakes, Ariel S, 1986. "Patents as Options: Some Estimates of the Value of Holding European Patent Stocks," Econometrica, Econometric Society, vol. 54(4), pages 755-784, July.
    16. Andrew Ching & Susumu Imai & Masakazu Ishihara & Neelam Jain, 2012. "A practitioner’s guide to Bayesian estimation of discrete choice dynamic programming models," Quantitative Marketing and Economics (QME), Springer, vol. 10(2), pages 151-196, June.
    17. Victor Aguirregabiria, 1999. "The Dynamics of Markups and Inventories in Retailing Firms," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 66(2), pages 275-308.
    18. Yamaguchi, Shintaro, 2016. "Effects of Parental Leave Policies on Female Career and Fertility Choices," CEI Working Paper Series 2016-8, Center for Economic Institutions, Institute of Economic Research, Hitotsubashi University.
    19. Sanghamitra Das, 1992. "A Micro-Econometric Model of Capital Utilization and Retirement: The Case of the U.S. Cement Industry," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 59(2), pages 277-297.
    20. Che‐Lin Su & Kenneth L. Judd, 2012. "Constrained Optimization Approaches to Estimation of Structural Models," Econometrica, Econometric Society, vol. 80(5), pages 2213-2230, September.
    21. Shintaro Yamaguchi, 2016. "Effects of Parental Leave Policies on Female Career and Fertility Choices," Department of Economics Working Papers 2016-10, McMaster University.
    22. Kasahara, Hiroyuki & Shimotsu, Katsumi, 2008. "Pseudo-likelihood estimation and bootstrap inference for structural discrete Markov decision models," Journal of Econometrics, Elsevier, vol. 146(1), pages 92-106, September.
    23. Kasahara, Hiroyuki & Rodrigue, Joel, 2008. "Does the use of imported intermediates increase productivity? Plant-level evidence," Journal of Development Economics, Elsevier, vol. 87(1), pages 106-118, August.
    24. Mehmet Soytas & Limor Golan & George-Levi Gayle, 2014. "What Accounts for the Racial Gap in Time Allocation and Intergenerational Transmission of Human Capital?," 2014 Meeting Papers 83, Society for Economic Dynamics.
    25. Andriy Norets, 2009. "Inference in Dynamic Discrete Choice Models With Serially orrelated Unobserved State Variables," Econometrica, Econometric Society, vol. 77(5), pages 1665-1682, September.
    26. Gotz, Glenn A. & McCall, John J., 1980. "Estimation in sequential decisionmaking models : A methodological note," Economics Letters, Elsevier, vol. 6(2), pages 131-136.
    27. Zvi Eckstein & Kenneth I. Wolpin, 1999. "Why Youths Drop Out of High School: The Impact of Preferences, Opportunities, and Abilities," Econometrica, Econometric Society, vol. 67(6), pages 1295-1340, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kasahara, Hiroyuki & Shimotsu, Katsumi, 2008. "Pseudo-likelihood estimation and bootstrap inference for structural discrete Markov decision models," Journal of Econometrics, Elsevier, vol. 146(1), pages 92-106, September.
    2. Kalouptsidi, Myrto & Scott, Paul & Souza-Rodrigues, Edouardo, 2015. "Identification of Counterfactuals and Payoffs in Dynamic Discrete Choice with an Application to Land Use," TSE Working Papers 15-596, Toulouse School of Economics (TSE).
    3. Aguirregabiria, Victor & Mira, Pedro, 2010. "Dynamic discrete choice structural models: A survey," Journal of Econometrics, Elsevier, vol. 156(1), pages 38-67, May.
    4. Myrto Kalouptsidi & Paul T. Scott & Eduardo Souza-Rodrigues, 2015. "Identification of Counterfactuals in Dynamic Discrete Choice Models," NBER Working Papers 21527, National Bureau of Economic Research, Inc.
    5. Sebastian Galiani & Juan Pantano, 2021. "Structural Models: Inception and Frontier," NBER Working Papers 28698, National Bureau of Economic Research, Inc.
    6. Peter Arcidiacono & Robert A. Miller, 2011. "Conditional Choice Probability Estimation of Dynamic Discrete Choice Models With Unobserved Heterogeneity," Econometrica, Econometric Society, vol. 79(6), pages 1823-1867, November.
    7. Victor Aguirregabiria, 2006. "Another Look at the Identification of Dynamic Discrete Decision Processes: With an Application to Retirement Behavior," 2006 Meeting Papers 169, Society for Economic Dynamics.
    8. George‐Levi Gayle & Limor Golan & Mehmet A. Soytas, 2018. "Estimation of dynastic life‐cycle discrete choice models," Quantitative Economics, Econometric Society, vol. 9(3), pages 1195-1241, November.
    9. Gayle, George-Levi & Golan, Limor & Soytas, Mehmet A., 2022. "What is the source of the intergenerational correlation in earnings?," Journal of Monetary Economics, Elsevier, vol. 129(C), pages 24-45.
    10. Le-Yu Chen, 2009. "Identification of structural dynamic discrete choice models," CeMMAP working papers CWP08/09, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    11. Victor Aguirregabiria, 2005. "Another Look at the Identification of Dynamic Discrete Decision Processes," Econometrics 0504006, University Library of Munich, Germany.
    12. Peter Arcidiacono & Paul B. Ellickson, 2011. "Practical Methods for Estimation of Dynamic Discrete Choice Models," Annual Review of Economics, Annual Reviews, vol. 3(1), pages 363-394, September.
    13. Peter Arcidiacono, Holger Sieg, Frank Sloan, 2001. "Living Rationally Under the Volcano? Heavy Drinking and Smoking Among the Elderly," Computing in Economics and Finance 2001 207, Society for Computational Economics.
    14. Peter Arcidiacono & Holger Sieg & Frank Sloan, 2007. "Living Rationally Under The Volcano? An Empirical Analysis Of Heavy Drinking And Smoking," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 48(1), pages 37-65, February.
    15. Victor Aguirregabiria & Allan Collard-Wexler & Stephen P. Ryan, 2021. "Dynamic Games in Empirical Industrial Organization," Papers 2109.01725, arXiv.org, revised Sep 2021.
    16. Hiroyuki Kasahara & Katsumi Shimotsu, 2006. "Nested Pseudo-likelihood Estimation And Bootstrap-based Inference For Structural Discrete Markov Decision Models," Working Paper 1063, Economics Department, Queen's University.
    17. Victor Aguirregabiria & Margaret Slade, 2017. "Empirical models of firms and industries," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 50(5), pages 1445-1488, December.
    18. Keane, Michael P. & Todd, Petra E. & Wolpin, Kenneth I., 2011. "The Structural Estimation of Behavioral Models: Discrete Choice Dynamic Programming Methods and Applications," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 4, pages 331-461, Elsevier.
    19. Andriy Norets, 2010. "Continuity and differentiability of expected value functions in dynamic discrete choice models," Quantitative Economics, Econometric Society, vol. 1(2), pages 305-322, November.
    20. Arthur Charpentier & Romuald Elie & Carl Remlinger, 2020. "Reinforcement Learning in Economics and Finance," Papers 2003.10014, arXiv.org.

    More about this item

    Keywords

    C13; C14; C63;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jecrev:v:69:y:2018:i:1:d:10.1111_jere.12169. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.