IDEAS home Printed from https://ideas.repec.org/p/ssb/dispap/540.html
   My bibliography  Save this paper

Simulated Maximum Likelihood using Tilted Importance Sampling

Author

Listed:

Abstract

This paper develops the important distinction between tilted and simple importance sampling as methods for simulating likelihood functions for use in simulated maximum likelihood. It is shown that tilted importance sampling removes a lower bound to simulation error for given importance sample size that is inherent in simulated maximum likelihood using simple importance sampling, the main method for simulating likelihood functions in the statistics literature. In addition, a new importance sampling technique, generalized Laplace importance sampling, easily combined with tilted importance sampling, is introduced. A number of applications and Monte Carlo experiments demonstrate the power and applicability of the methods. As an example, simulated maximum likelihood estimates from the infamous salamander mating model from McCullagh and Nelder (1989) can be found to easily satisfactory precision with an importance sample size of 100.

Suggested Citation

  • Christian N. Brinch, 2008. "Simulated Maximum Likelihood using Tilted Importance Sampling," Discussion Papers 540, Statistics Norway, Research Department.
    • Handle: RePEc:ssb:dispap:540
    as

    Download full text from publisher

    File URL: https://www.ssb.no/a/publikasjoner/pdf/DP/dp540.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. J. G. Booth & J. P. Hobert, 1999. "Maximizing generalized linear mixed model likelihoods with an automated Monte Carlo EM algorithm," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(1), pages 265-285.
    2. Siem Jan Koopman & Neil Shephard & Jurgen A. Doornik, 1999. "Statistical algorithms for models in state space using SsfPack 2.2," Econometrics Journal, Royal Economic Society, vol. 2(1), pages 107-160.
    3. Manabu Asai & Michael McAleer & Jun Yu, 2006. "Multivariate Stochastic Volatility," Microeconomics Working Papers 22058, East Asian Bureau of Economic Research.
    4. Saralees Nadarajah & Samuel Kotz, 2005. "Sampling distributions associated with the multivariate t distribution," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 59(2), pages 214-234, May.
    5. Borus Jungbacker & Siem Jan Koopman, 2006. "Monte Carlo Likelihood Estimation for Three Multivariate Stochastic Volatility Models," Econometric Reviews, Taylor & Francis Journals, vol. 25(2-3), pages 385-408.
    6. Andrew Harvey & Esther Ruiz & Neil Shephard, 1994. "Multivariate Stochastic Variance Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 61(2), pages 247-264.
    7. Rabe-Hesketh, Sophia & Skrondal, Anders & Pickles, Andrew, 2005. "Maximum likelihood estimation of limited and discrete dependent variable models with nested random effects," Journal of Econometrics, Elsevier, vol. 128(2), pages 301-323, October.
    8. Kuk, Anthony Y. C., 1999. "The use of approximating models in Monte Carlo maximum likelihood estimation," Statistics & Probability Letters, Elsevier, vol. 45(4), pages 325-333, December.
    9. Jean-Francois Richard, 2007. "Efficient High-Dimensional Importance Sampling," Working Paper 321, Department of Economics, University of Pittsburgh, revised Jan 2007.
    10. Richard, Jean-Francois & Zhang, Wei, 2007. "Efficient high-dimensional importance sampling," Journal of Econometrics, Elsevier, vol. 141(2), pages 1385-1411, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mao, Xiuping & Czellar, Veronika & Ruiz, Esther & Veiga, Helena, 2020. "Asymmetric stochastic volatility models: Properties and particle filter-based simulated maximum likelihood estimation," Econometrics and Statistics, Elsevier, vol. 13(C), pages 84-105.
    2. Christian Brinch, 2012. "Efficient simulated maximum likelihood estimation through explicitly parameter dependent importance sampling," Computational Statistics, Springer, vol. 27(1), pages 13-28, March.
    3. Tsyplakov, Alexander, 2010. "Revealing the arcane: an introduction to the art of stochastic volatility models," MPRA Paper 25511, University Library of Munich, Germany.
    4. Manabu Asai & Michael McAleer & Jun Yu, 2006. "Multivariate Stochastic Volatility," Microeconomics Working Papers 22058, East Asian Bureau of Economic Research.
    5. Jun Yu & Renate Meyer, 2006. "Multivariate Stochastic Volatility Models: Bayesian Estimation and Model Comparison," Econometric Reviews, Taylor & Francis Journals, vol. 25(2-3), pages 361-384.
    6. Scharth, Marcel & Kohn, Robert, 2016. "Particle efficient importance sampling," Journal of Econometrics, Elsevier, vol. 190(1), pages 133-147.
    7. Isabel Casas & Helena Veiga, 2021. "Exploring Option Pricing and Hedging via Volatility Asymmetry," Computational Economics, Springer;Society for Computational Economics, vol. 57(4), pages 1015-1039, April.
    8. Rutger Jan Lange, 2020. "Bellman filtering for state-space models," Tinbergen Institute Discussion Papers 20-052/III, Tinbergen Institute, revised 19 May 2021.
    9. Jun Yu, 2007. "Automated Likelihood Based Inference for Stochastic Volatility Models," Working Papers 01-2007, Singapore Management University, Sim Kee Boon Institute for Financial Economics.
    10. BAUWENS, Luc & HAFNER, Christian & LAURENT, Sébastien, 2011. "Volatility models," LIDAM Discussion Papers CORE 2011058, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
      • Bauwens, L. & Hafner, C. & Laurent, S., 2012. "Volatility Models," LIDAM Reprints ISBA 2012028, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
      • Bauwens, L. & Hafner C. & Laurent, S., 2011. "Volatility Models," LIDAM Discussion Papers ISBA 2011044, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    11. Koopman, Siem Jan & Shephard, Neil & Creal, Drew, 2009. "Testing the assumptions behind importance sampling," Journal of Econometrics, Elsevier, vol. 149(1), pages 2-11, April.
    12. M. Hakan Eratalay, 2016. "Estimation of Multivariate Stochastic Volatility Models: A Comparative Monte Carlo Study," International Econometric Review (IER), Econometric Research Association, vol. 8(2), pages 19-52, September.
    13. repec:cte:wsrepe:ws142618 is not listed on IDEAS
    14. Kleppe, Tore Selland & Yu, Jun & Skaug, Hans J., 2014. "Maximum likelihood estimation of partially observed diffusion models," Journal of Econometrics, Elsevier, vol. 180(1), pages 73-80.
    15. M. Hakan Eratalay, 2016. "Estimation of Multivariate Stochastic Volatility Models: A Comparative Monte Carlo Study," International Econometric Review (IER), Econometric Research Association, vol. 8(2), pages 19-52, September.
    16. Yu, Jun, 2012. "A semiparametric stochastic volatility model," Journal of Econometrics, Elsevier, vol. 167(2), pages 473-482.
    17. Almeida, Carlos & Czado, Claudia, 2012. "Efficient Bayesian inference for stochastic time-varying copula models," Computational Statistics & Data Analysis, Elsevier, vol. 56(6), pages 1511-1527.
    18. Kurose, Yuta & Omori, Yasuhiro, 2020. "Multiple-block dynamic equicorrelations with realized measures, leverage and endogeneity," Econometrics and Statistics, Elsevier, vol. 13(C), pages 46-68.
    19. Christian M. Hafner & Hans Manner, 2012. "Dynamic stochastic copula models: estimation, inference and applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(2), pages 269-295, March.
    20. Kleppe, Tore Selland & Skaug, Hans Julius, 2012. "Fitting general stochastic volatility models using Laplace accelerated sequential importance sampling," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3105-3119.
    21. Charles S. Bos, 2011. "Relating Stochastic Volatility Estimation Methods," Tinbergen Institute Discussion Papers 11-049/4, Tinbergen Institute.

    More about this item

    Keywords

    Simulation based estimation; importance sampling.;

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ssb:dispap:540. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: L Maasø (email available below). General contact details of provider: https://edirc.repec.org/data/ssbgvno.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.