IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2501.18746.html
   My bibliography  Save this paper

Model-Adaptive Approach to Dynamic Discrete Choice Models with Large State Spaces

Author

Listed:
  • Ertian Chen

Abstract

Estimating dynamic discrete choice models with large state spaces poses computational difficulties. This paper develops a novel model-adaptive approach to solve the linear system of fixed point equations of the policy valuation operator. We propose a model-adaptive sieve space, constructed by iteratively augmenting the space with the residual from the previous iteration. We show both theoretically and numerically that model-adaptive sieves dramatically improve performance. In particular, the approximation error decays at a superlinear rate in the sieve dimension, unlike a linear rate achieved using conventional methods. Our method works for both conditional choice probability estimators and full-solution estimators with policy iteration. We apply the method to analyze consumer demand for laundry detergent using Kantar's Worldpanel Take Home data. On average, our method is 51.5% faster than the conventional methods in solving the dynamic programming problem, making the Bayesian MCMC estimator computationally feasible. The results confirm the computational efficiency of our method in practice.

Suggested Citation

  • Ertian Chen, 2025. "Model-Adaptive Approach to Dynamic Discrete Choice Models with Large State Spaces," Papers 2501.18746, arXiv.org.
  • Handle: RePEc:arx:papers:2501.18746
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2501.18746
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ling Huang & Martin D. Smith, 2014. "The Dynamic Efficiency Costs of Common-Pool Resource Exploitation," American Economic Review, American Economic Association, vol. 104(12), pages 4071-4103, December.
    2. Bee Yan Aw & Mark J. Roberts & Daniel Yi Xu, 2011. "R&D Investment, Exporting, and Productivity Dynamics," American Economic Review, American Economic Association, vol. 101(4), pages 1312-1344, June.
    3. Gautam Gowrisankaran & Marc Rysman, 2012. "Dynamics of Consumer Demand for New Durable Goods," Journal of Political Economy, University of Chicago Press, vol. 120(6), pages 1173-1219.
    4. Susumu Imai & Neelam Jain & Andrew Ching, 2009. "Bayesian Estimation of Dynamic Discrete Choice Models," Econometrica, Econometric Society, vol. 77(6), pages 1865-1899, November.
    5. Tülin Erdem & Susumu Imai & Michael Keane, 2003. "Brand and Quantity Choice Dynamics Under Price Uncertainty," Quantitative Marketing and Economics (QME), Springer, vol. 1(1), pages 5-64, March.
    6. Pierre Dubois & Rachel Griffith & Martin O'Connell, 2020. "How Well Targeted Are Soda Taxes?," American Economic Review, American Economic Association, vol. 110(11), pages 3661-3704, November.
    7. Andriy Norets, 2012. "Estimation of Dynamic Discrete Choice Models Using Artificial Neural Network Approximations," Econometric Reviews, Taylor & Francis Journals, vol. 31(1), pages 84-106.
    8. Victor Aguirregabiria & Pedro Mira, 2002. "Swapping the Nested Fixed Point Algorithm: A Class of Estimators for Discrete Markov Decision Models," Econometrica, Econometric Society, vol. 70(4), pages 1519-1543, July.
    9. Kenneth L. Judd, 1998. "Numerical Methods in Economics," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262100711, December.
    10. Daniel Ackerberg, 2009. "A new use of importance sampling to reduce computational burden in simulation estimation," Quantitative Marketing and Economics (QME), Springer, vol. 7(4), pages 343-376, December.
    11. Matthew Osborne, 2018. "Approximating the Cost-of-Living Index for a Storable Good," American Economic Journal: Microeconomics, American Economic Association, vol. 10(2), pages 286-314, May.
    12. V. Joseph Hotz & Robert A. Miller, 1993. "Conditional Choice Probabilities and the Estimation of Dynamic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 60(3), pages 497-529.
    13. Pierre Dubois & Rachel Griffith & Aviv Nevo, 2014. "Do Prices and Attributes Explain International Differences in Food Purchases?," American Economic Review, American Economic Association, vol. 104(3), pages 832-867, March.
    14. Chernozhukov, Victor & Hong, Han, 2003. "An MCMC approach to classical estimation," Journal of Econometrics, Elsevier, vol. 115(2), pages 293-346, August.
    15. John Rust, 1997. "Using Randomization to Break the Curse of Dimensionality," Econometrica, Econometric Society, vol. 65(3), pages 487-516, May.
    16. Emily Yucai Wang, 2015. "The impact of soda taxes on consumer welfare: implications of storability and taste heterogeneity," RAND Journal of Economics, RAND Corporation, vol. 46(2), pages 409-441, June.
    17. Myrto Kalouptsidi, 2014. "Time to Build and Fluctuations in Bulk Shipping," American Economic Review, American Economic Association, vol. 104(2), pages 564-608, February.
    18. Carrasco, Marine & Florens, Jean-Pierre & Renault, Eric, 2007. "Linear Inverse Problems in Structural Econometrics Estimation Based on Spectral Decomposition and Regularization," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 77, Elsevier.
    19. Andrew Sweeting, 2013. "Dynamic Product Positioning in Differentiated Product Markets: The Effect of Fees for Musical Performance Rights on the Commercial Radio Industry," Econometrica, Econometric Society, vol. 81(5), pages 1763-1803, September.
    20. Peter Arcidiacono & Robert A. Miller, 2011. "Conditional Choice Probability Estimation of Dynamic Discrete Choice Models With Unobserved Heterogeneity," Econometrica, Econometric Society, vol. 79(6), pages 1823-1867, November.
    21. Todd D. Gerarden, 2023. "Demanding Innovation: The Impact of Consumer Subsidies on Solar Panel Production Costs," Management Science, INFORMS, vol. 69(12), pages 7799-7820, December.
    22. Martin Pesendorfer & Philipp Schmidt-Dengler, 2008. "Asymptotic Least Squares Estimators for Dynamic Games -super-1," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 75(3), pages 901-928.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Victor Aguirregabiria & Margaret Slade, 2017. "Empirical models of firms and industries," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 50(5), pages 1445-1488, December.
    2. Aguirregabiria, Victor & Mira, Pedro, 2010. "Dynamic discrete choice structural models: A survey," Journal of Econometrics, Elsevier, vol. 156(1), pages 38-67, May.
    3. Daniel Ackerberg, 2009. "A new use of importance sampling to reduce computational burden in simulation estimation," Quantitative Marketing and Economics (QME), Springer, vol. 7(4), pages 343-376, December.
    4. Victor Aguirregabiria & Victor Aguirregabiria & Aviv Nevo & Aviv Nevo, 2010. "Recent Developments in Empirical IO: Dynamic Demand and Dynamic Games," Working Papers tecipa-419, University of Toronto, Department of Economics.
    5. Hu Yingyao & Shum Matthew & Tan Wei & Xiao Ruli, 2017. "A Simple Estimator for Dynamic Models with Serially Correlated Unobservables," Journal of Econometric Methods, De Gruyter, vol. 6(1), pages 1-16, January.
    6. Andrew Ching & Susumu Imai & Masakazu Ishihara & Neelam Jain, 2012. "A practitioner’s guide to Bayesian estimation of discrete choice dynamic programming models," Quantitative Marketing and Economics (QME), Springer, vol. 10(2), pages 151-196, June.
    7. Ji, Yongjie & Rabotyagov, Sergey & Kling, Catherine L., 2014. "Crop Choice and Rotational Effects: A Dynamic Model of Land Use in Iowa in Recent Years," 2014 Annual Meeting, July 27-29, 2014, Minneapolis, Minnesota 170366, Agricultural and Applied Economics Association.
    8. Amoroso, S., 2013. "Heterogeneity of innovative, collaborative, and productive firm-level processes," Other publications TiSEM f5784a49-7053-401d-855d-1, Tilburg University, School of Economics and Management.
    9. Hu, Yingyao, 2017. "The Econometrics of Unobservables -- Latent Variable and Measurement Error Models and Their Applications in Empirical Industrial Organization and Labor Economics [The Econometrics of Unobservables]," Economics Working Paper Archive 64578, The Johns Hopkins University,Department of Economics, revised 2021.
    10. Sara Amoroso, 2014. "The hidden costs of R&D collaboration," JRC Working Papers on Corporate R&D and Innovation 2014-02, Joint Research Centre.
    11. Federico A. Bugni & Jackson Bunting & Takuya Ura, 2020. "Testing homogeneity in dynamic discrete games in finite samples," Papers 2010.02297, arXiv.org, revised Aug 2024.
    12. Joseph Cullen & Nicolas Schutz & Oleksandr Shcherbakov, 2020. "The Welfare Effects of Early Termination Fees in the US Wireless Industry," CRC TR 224 Discussion Paper Series crctr224_2020_247, University of Bonn and University of Mannheim, Germany.
    13. Myrto Kalouptsidi & Paul T. Scott & Eduardo Souza-Rodrigues, 2018. "Linear IV Regression Estimators for Structural Dynamic Discrete Choice Models," NBER Working Papers 25134, National Bureau of Economic Research, Inc.
    14. Srisuma, Sorawoot & Linton, Oliver, 2012. "Semiparametric estimation of Markov decision processes with continuous state space," Journal of Econometrics, Elsevier, vol. 166(2), pages 320-341.
    15. Kalouptsidi, Myrto & Scott, Paul T. & Souza-Rodrigues, Eduardo, 2021. "Linear IV regression estimators for structural dynamic discrete choice models," Journal of Econometrics, Elsevier, vol. 222(1), pages 778-804.
    16. Hu, Yingyao & Shum, Matthew, 2012. "Nonparametric identification of dynamic models with unobserved state variables," Journal of Econometrics, Elsevier, vol. 171(1), pages 32-44.
    17. Victor Aguirregabiria & Mathieu Marcoux, 2021. "Imposing equilibrium restrictions in the estimation of dynamic discrete games," Quantitative Economics, Econometric Society, vol. 12(4), pages 1223-1271, November.
    18. Jason R. Blevins & Ahmed Khwaja & Nathan Yang, 2018. "Firm Expansion, Size Spillovers, and Market Dominance in Retail Chain Dynamics," Management Science, INFORMS, vol. 64(9), pages 4070-4093.
    19. Jean-Pierre Dubé & K. Sudhir & Andrew Ching & Gregory Crawford & Michaela Draganska & Jeremy Fox & Wesley Hartmann & Günter Hitsch & V. Viard & Miguel Villas-Boas & Naufel Vilcassim, 2005. "Recent Advances in Structural Econometric Modeling: Dynamics, Product Positioning and Entry," Marketing Letters, Springer, vol. 16(3), pages 209-224, December.
    20. Panle Jia Barwick & Parag A. Pathak, 2015. "The costs of free entry: an empirical study of real estate agents in Greater Boston," RAND Journal of Economics, RAND Corporation, vol. 46(1), pages 103-145, March.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2501.18746. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.