IDEAS home Printed from https://ideas.repec.org/p/cpm/dynare/008.html
   My bibliography  Save this paper

Indirect Likelihood Inference

Author

Listed:
  • Creel, Michael
  • Kristensen, Dennis

Abstract

Given a sample from a fully specified parametric model, let $Z_n$ be a given finite-dimensional statistic - for example, an initial estimator or a set of sample moments. We propose to (re-)estimate the parameters of the model by maximizing the likelihood of $Z_n$. We call this the maximum indirect likelihood (MIL) estimator. We also propose a com- putationally tractable Bayesian version of the estimator which we refer to as a Bayesian Indirect Likelihood (BIL) estimator. In most cases, the density of the statistic will be of unknown form, and we develop simulated versions of the MIL and BIL estimators. We show that the indirect likelihood estimators are consistent and asymptotically normally distributed, with the same asymptotic variance as that of the corresponding efficient two-step GMM estimator based on the same statistic. However, our likelihood-based estimators, by taking into account the full finite-sample distribution of the statistic, are higher order efficient relative to GMM-type estimators. Furthermore, in many cases they enjoy a bias reduction property similar to that of the indirect inference estimator. Monte Carlo results for a number of applications including dynamic and nonlinear panel data models, a structural auction model and two DSGE models show that the proposed estimators indeed have attractive finite sample properties.

Suggested Citation

  • Creel, Michael & Kristensen, Dennis, 2011. "Indirect Likelihood Inference," Dynare Working Papers 8, CEPREMAP.
  • Handle: RePEc:cpm:dynare:008
    as

    Download full text from publisher

    File URL: https://www.dynare.org/wp-repo/dynarewp008.pdf
    File Function: Main text
    Download Restriction: no

    File URL: https://www.dynare.org/wp-repo/dynarewp008.zip
    File Function: Source code of programs used in the paper
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Aruoba, S. Boragan & Fernandez-Villaverde, Jesus & Rubio-Ramirez, Juan F., 2006. "Comparing solution methods for dynamic equilibrium economies," Journal of Economic Dynamics and Control, Elsevier, vol. 30(12), pages 2477-2508, December.
    2. Rilstone, Paul & Srivastava, V. K. & Ullah, Aman, 1996. "The second-order bias and mean squared error of nonlinear estimators," Journal of Econometrics, Elsevier, vol. 75(2), pages 369-395, December.
    3. Smith, A A, Jr, 1993. "Estimating Nonlinear Time-Series Models Using Simulated Vector Autoregressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 63-84, Suppl. De.
    4. Canova, Fabio & Sala, Luca, 2009. "Back to square one: Identification issues in DSGE models," Journal of Monetary Economics, Elsevier, vol. 56(4), pages 431-449, May.
    5. Li, Tong, 2010. "Indirect inference in structural econometric models," Journal of Econometrics, Elsevier, vol. 157(1), pages 120-128, July.
    6. Kristensen, Dennis & Shin, Yongseok, 2012. "Estimation of dynamic models with nonparametric simulated maximum likelihood," Journal of Econometrics, Elsevier, vol. 167(1), pages 76-94.
    7. Dennis Kristensen & Bernard Salanié, 2010. "Higher Order Improvements for Approximate Estimators," CAM Working Papers 2010-04, University of Copenhagen. Department of Economics. Centre for Applied Microeconometrics.
    8. Kristensen, Dennis, 2009. "Uniform Convergence Rates Of Kernel Estimators With Heterogeneous Dependent Data," Econometric Theory, Cambridge University Press, vol. 25(5), pages 1433-1445, October.
    9. Whitney K. Newey & Richard J. Smith, 2004. "Higher Order Properties of Gmm and Generalized Empirical Likelihood Estimators," Econometrica, Econometric Society, vol. 72(1), pages 219-255, January.
    10. Duffie, Darrell & Singleton, Kenneth J, 1993. "Simulated Moments Estimation of Markov Models of Asset Prices," Econometrica, Econometric Society, vol. 61(4), pages 929-952, July.
    11. Pablo A. Guerron-Quintana, 2010. "What you match does matter: the effects of data on DSGE estimation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(5), pages 774-804.
    12. Özer Karagedikli & Troy Matheson & Christie Smith & Shaun P. Vahey, 2010. "RBCs AND DSGEs: THE COMPUTATIONAL APPROACH TO BUSINESS CYCLE THEORY AND EVIDENCE," Journal of Economic Surveys, Wiley Blackwell, vol. 24(1), pages 113-136, February.
    13. Fermanian, Jean-David & Salanié, Bernard, 2004. "A Nonparametric Simulated Maximum Likelihood Estimation Method," Econometric Theory, Cambridge University Press, vol. 20(4), pages 701-734, August.
    14. Altonji, Joseph G & Segal, Lewis M, 1996. "Small-Sample Bias in GMM Estimation of Covariance Structures," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(3), pages 353-366, July.
    15. Gouriéroux, Christian & Phillips, Peter C.B. & Yu, Jun, 2010. "Indirect inference for dynamic panel models," Journal of Econometrics, Elsevier, vol. 157(1), pages 68-77, July.
    16. Michael Creel, 2003. "Econometrics," UFAE and IAE Working Papers 575.03, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC), revised 23 Oct 2015.
    17. Pfanzagl, J. & Wefelmeyer, W., 1978. "A third-order optimum property of the maximum likelihood estimator," Journal of Multivariate Analysis, Elsevier, vol. 8(1), pages 1-29, March.
    18. Michael Creel, 2008. "Estimation of Dynamic Latent Variable Models Using Simulated Nonparametric Moments," UFAE and IAE Working Papers 725.08, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC), revised 02 Jun 2008.
    19. RUGE-MURCIA, Francisco J., 2010. "Estimating Nonlinear DSGE Models by the Simulated Method of Moments," Cahiers de recherche 2010-10, Universite de Montreal, Departement de sciences economiques.
    20. McFadden, Daniel, 1989. "A Method of Simulated Moments for Estimation of Discrete Response Models without Numerical Integration," Econometrica, Econometric Society, vol. 57(5), pages 995-1026, September.
    21. Rothenberg, Thomas J., 1984. "Approximating the distributions of econometric estimators and test statistics," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 15, pages 881-935, Elsevier.
    22. Inoue, Atsushi & Shintani, Mototsugu, 2006. "Bootstrapping GMM estimators for time series," Journal of Econometrics, Elsevier, vol. 133(2), pages 531-555, August.
    23. Horowitz, J., 1996. "Bootstrap Critical Values For Tests Based On The Smoothed Maximum Score Estimator," SFB 373 Discussion Papers 1996,44, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    24. Viktor Winschel & Markus Kr‰tzig, 2010. "Solving, Estimating, and Selecting Nonlinear Dynamic Models Without the Curse of Dimensionality," Econometrica, Econometric Society, vol. 78(2), pages 803-821, March.
    25. Jinyong Hahn & Whitney Newey, 2004. "Jackknife and Analytical Bias Reduction for Nonlinear Panel Models," Econometrica, Econometric Society, vol. 72(4), pages 1295-1319, July.
    26. Chernozhukov, Victor & Hong, Han, 2003. "An MCMC approach to classical estimation," Journal of Econometrics, Elsevier, vol. 115(2), pages 293-346, August.
    27. Gallant, A. Ronald & Tauchen, George, 1996. "Which Moments to Match?," Econometric Theory, Cambridge University Press, vol. 12(4), pages 657-681, October.
    28. Hall, Peter & Horowitz, Joel L, 1996. "Bootstrap Critical Values for Tests Based on Generalized-Method-of-Moments Estimators," Econometrica, Econometric Society, vol. 64(4), pages 891-916, July.
    29. Michael Creel, 2007. "I ran four million probits last night: HPC clustering with ParallelKnoppix," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(1), pages 215-223.
    30. Kezdi, Gabor & Hahn, Jinyong & Solon, Gary, 2002. "Jackknife minimum distance estimation," Economics Letters, Elsevier, vol. 76(1), pages 35-45, June.
    31. Ruge-Murcia, Francisco J., 2007. "Methods to estimate dynamic stochastic general equilibrium models," Journal of Economic Dynamics and Control, Elsevier, vol. 31(8), pages 2599-2636, August.
    32. Michael Creel & Dennis Kristensen, 2012. "Estimation of dynamic latent variable models using simulated non‐parametric moments," Econometrics Journal, Royal Economic Society, vol. 15(3), pages 490-515, October.
    33. Doran, Howard E. & Schmidt, Peter, 2006. "GMM estimators with improved finite sample properties using principal components of the weighting matrix, with an application to the dynamic panel data model," Journal of Econometrics, Elsevier, vol. 133(1), pages 387-409, July.
    34. Hansen, Lars Peter & Heaton, John & Yaron, Amir, 1996. "Finite-Sample Properties of Some Alternative GMM Estimators," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(3), pages 262-280, July.
    35. Everaert, Gerdie & Pozzi, Lorenzo, 2007. "Bootstrap-based bias correction for dynamic panels," Journal of Economic Dynamics and Control, Elsevier, vol. 31(4), pages 1160-1184, April.
    36. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, volume 1, number 8355.
    37. Michael Creel, 2005. "ParallelKnoppix," Grecs Computer Code 003.05, Research Group in Computation and Simulations (GRECS).
    38. Jinyong Hahn & Guido Kuersteiner, 2002. "Asymptotically Unbiased Inference for a Dynamic Panel Model with Fixed Effects when Both "n" and "T" Are Large," Econometrica, Econometric Society, vol. 70(4), pages 1639-1657, July.
    39. Manuel Arellano & Stéphane Bonhomme, 2009. "Robust Priors in Nonlinear Panel Data Models," Econometrica, Econometric Society, vol. 77(2), pages 489-536, March.
    40. Horowitz, Joel L, 1992. "A Smoothed Maximum Score Estimator for the Binary Response Model," Econometrica, Econometric Society, vol. 60(3), pages 505-531, May.
    41. Phillips, Peter C B, 1977. "A General Theorem in the Theory of Asymptotic Expansions as Approximations to the Finite Sample Distributions of Econometric Estimators," Econometrica, Econometric Society, vol. 45(6), pages 1517-1534, September.
    42. Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 113-172.
    43. Viktor Winschel, 2005. "Solving, Estimating and Selecting Nonlinear Dynamic Economic Models without the Curse of Dimensionality," GE, Growth, Math methods 0507014, University Library of Munich, Germany.
    44. Chumacero Rómulo A., 2001. "Estimating ARMA Models Efficiently," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 5(2), pages 1-14, July.
    45. Andrews, Donald W K, 1993. "Exactly Median-Unbiased Estimation of First Order Autoregressive/Unit Root Models," Econometrica, Econometric Society, vol. 61(1), pages 139-165, January.
    46. Joel L. Horowitz, 1996. "Bootstrap Critical Values for Tests Based on the Smoothed Maximum Score Estimator," Econometrics 9603003, University Library of Munich, Germany.
    47. Donald, Stephen G. & Newey, Whitney K., 2000. "A jackknife interpretation of the continuous updating estimator," Economics Letters, Elsevier, vol. 67(3), pages 239-243, June.
    48. Mark A. Beaumont & Jean-Marie Cornuet & Jean-Michel Marin & Christian P. Robert, 2009. "Adaptive approximate Bayesian computation," Biometrika, Biometrika Trust, vol. 96(4), pages 983-990.
    49. Mariano,Roberto & Schuermann,Til & Weeks,Melvyn J. (ed.), 2000. "Simulation-based Inference in Econometrics," Cambridge Books, Cambridge University Press, number 9780521591126, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kristensen, Dennis & Shin, Yongseok, 2012. "Estimation of dynamic models with nonparametric simulated maximum likelihood," Journal of Econometrics, Elsevier, vol. 167(1), pages 76-94.
    2. Creel, Michael, 2017. "Neural nets for indirect inference," Econometrics and Statistics, Elsevier, vol. 2(C), pages 36-49.
    3. Bertl Johanna & Ewing Gregory & Kosiol Carolin & Futschik Andreas, 2017. "Approximate maximum likelihood estimation for population genetic inference," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 16(5-6), pages 291-312, December.
    4. Valerio Scalone, 2018. "Estimating Non-Linear DSGEs with the Approximate Bayesian Computation: an application to the Zero Lower Bound," Working papers 688, Banque de France.
    5. Creel, Michael & Kristensen, Dennis, 2015. "ABC of SV: Limited information likelihood inference in stochastic volatility jump-diffusion models," Journal of Empirical Finance, Elsevier, vol. 31(C), pages 85-108.
    6. Forneron, Jean-Jacques & Ng, Serena, 2018. "The ABC of simulation estimation with auxiliary statistics," Journal of Econometrics, Elsevier, vol. 205(1), pages 112-139.
    7. Michael Creel & Dennis Kristensen, 2013. "Indirect Likelihood Inference (revised)," UFAE and IAE Working Papers 931.13, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).
    8. Michael Creel, 2016. "Neural Nets for Indirect Inference," UFAE and IAE Working Papers 960.16, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC), revised 18 Jul 2016.
    9. Creel, Michael & Kristensen, Dennis, 2016. "On selection of statistics for approximate Bayesian computing (or the method of simulated moments)," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 99-114.
    10. Michael Creel & Jiti Gao & Han Hong & Dennis Kristensen, 2016. "Bayesian Indirect Inference and the ABC of GMM," Monash Econometrics and Business Statistics Working Papers 1/16, Monash University, Department of Econometrics and Business Statistics.
    11. Michael Creel, 2016. "A Note on Julia and MPI, with Code Examples," Computational Economics, Springer;Society for Computational Economics, vol. 48(3), pages 535-546, October.
    12. Jiti Gao & Han Hong, 2014. "A Computational Implementation of GMM," Monash Econometrics and Business Statistics Working Papers 24/14, Monash University, Department of Econometrics and Business Statistics.
    13. Valerio Scalone, 2015. "Estimating Non-Linear DSGEs with the Approximate Bayesian Computation: an application to the Zero Lower Bound," Working Papers 6/15, Sapienza University of Rome, DISS.
    14. Aldrich, EM, 2014. "GPU Computing in Economics," Santa Cruz Department of Economics, Working Paper Series qt8p12748g, Department of Economics, UC Santa Cruz.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michael Creel & Dennis Kristensen, 2013. "Indirect Likelihood Inference (revised)," UFAE and IAE Working Papers 931.13, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).
    2. Dennis Kristensen & Bernard Salanié, 2010. "Higher Order Improvements for Approximate Estimators," CAM Working Papers 2010-04, University of Copenhagen. Department of Economics. Centre for Applied Microeconometrics.
    3. Kristensen, Dennis & Salanié, Bernard, 2017. "Higher-order properties of approximate estimators," Journal of Econometrics, Elsevier, vol. 198(2), pages 189-208.
    4. Kundhi, Gubhinder & Rilstone, Paul, 2012. "Edgeworth expansions for GEL estimators," Journal of Multivariate Analysis, Elsevier, vol. 106(C), pages 118-146.
    5. Kristensen, Dennis & Shin, Yongseok, 2012. "Estimation of dynamic models with nonparametric simulated maximum likelihood," Journal of Econometrics, Elsevier, vol. 167(1), pages 76-94.
    6. Forneron, Jean-Jacques & Ng, Serena, 2018. "The ABC of simulation estimation with auxiliary statistics," Journal of Econometrics, Elsevier, vol. 205(1), pages 112-139.
    7. Michael Creel, 2021. "Inference Using Simulated Neural Moments," Econometrics, MDPI, vol. 9(4), pages 1-15, September.
    8. Bruins, Marianne & Duffy, James A. & Keane, Michael P. & Smith, Anthony A., 2018. "Generalized indirect inference for discrete choice models," Journal of Econometrics, Elsevier, vol. 205(1), pages 177-203.
    9. Gouriéroux, Christian & Phillips, Peter C.B. & Yu, Jun, 2010. "Indirect inference for dynamic panel models," Journal of Econometrics, Elsevier, vol. 157(1), pages 68-77, July.
    10. Jinyong Hahn & David W. Hughes & Guido Kuersteiner & Whitney K. Newey, 2024. "Efficient bias correction for cross‐section and panel data," Quantitative Economics, Econometric Society, vol. 15(3), pages 783-816, July.
    11. La Vecchia, Davide & Moor, Alban & Scaillet, Olivier, 2023. "A higher-order correct fast moving-average bootstrap for dependent data," Journal of Econometrics, Elsevier, vol. 235(1), pages 65-81.
    12. Lee, Seojeong, 2016. "Asymptotic refinements of a misspecification-robust bootstrap for GEL estimators," Journal of Econometrics, Elsevier, vol. 192(1), pages 86-104.
    13. Hill, Jonathan B. & Prokhorov, Artem, 2016. "GEL estimation for heavy-tailed GARCH models with robust empirical likelihood inference," Journal of Econometrics, Elsevier, vol. 190(1), pages 18-45.
    14. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez, 2007. "Estimating Macroeconomic Models: A Likelihood Approach," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(4), pages 1059-1087.
    15. Prosper Dovonon & Alastair R. Hall, 2017. "The Asymptotic Properties of GMM and Indirect Inference Under Second-Order Identification," Economics Discussion Paper Series 1705, Economics, The University of Manchester.
    16. Stelios Arvanitis & Antonis Demos, 2015. "A class of indirect inference estimators: higher‐order asymptotics and approximate bias correction," Econometrics Journal, Royal Economic Society, vol. 18(2), pages 200-241, June.
    17. Blasques, Francisco & Duplinskiy, Artem, 2018. "Penalized indirect inference," Journal of Econometrics, Elsevier, vol. 205(1), pages 34-54.
    18. repec:bla:ecorec:v:91:y:2015:i::p:1-24 is not listed on IDEAS
    19. Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91(S1), pages 1-24, June.
    20. Dovonon, Prosper & Hall, Alastair R., 2018. "The asymptotic properties of GMM and indirect inference under second-order identification," Journal of Econometrics, Elsevier, vol. 205(1), pages 76-111.
    21. Kerem Tuzcuoglu, 2019. "Composite Likelihood Estimation of an Autoregressive Panel Probit Model with Random Effects," Staff Working Papers 19-16, Bank of Canada.

    More about this item

    Keywords

    indirect inference; maximum-likelihood; simulation-based methods; bias correction; Bayesian estimation;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C33 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Models with Panel Data; Spatio-temporal Models

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cpm:dynare:008. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sébastien Villemot (email available below). General contact details of provider: https://edirc.repec.org/data/ceprefr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.