IDEAS home Printed from https://ideas.repec.org/a/taf/jnlasa/v114y2019i528p1826-1837.html
   My bibliography  Save this article

Bayesian Model Comparison with the Hyvärinen Score: Computation and Consistency

Author

Listed:
  • Stephane Shao
  • Pierre E. Jacob
  • Jie Ding
  • Vahid Tarokh

Abstract

The Bayes factor is a widely used criterion in model comparison and its logarithm is a difference of out-of-sample predictive scores under the logarithmic scoring rule. However, when some of the candidate models involve vague priors on their parameters, the log-Bayes factor features an arbitrary additive constant that hinders its interpretation. As an alternative, we consider model comparison using the Hyvärinen score. We propose a method to consistently estimate this score for parametric models, using sequential Monte Carlo methods. We show that this score can be estimated for models with tractable likelihoods as well as nonlinear non-Gaussian state-space models with intractable likelihoods. We prove the asymptotic consistency of this new model selection criterion under strong regularity assumptions in the case of nonnested models, and we provide qualitative insights for the nested case. We also use existing characterizations of proper scoring rules on discrete spaces to extend the Hyvärinen score to discrete observations. Our numerical illustrations include Lévy-driven stochastic volatility models and diffusion models for population dynamics. Supplementary materials for this article are available online.

Suggested Citation

  • Stephane Shao & Pierre E. Jacob & Jie Ding & Vahid Tarokh, 2019. "Bayesian Model Comparison with the Hyvärinen Score: Computation and Consistency," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(528), pages 1826-1837, October.
  • Handle: RePEc:taf:jnlasa:v:114:y:2019:i:528:p:1826-1837
    DOI: 10.1080/01621459.2018.1518237
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/01621459.2018.1518237
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1080/01621459.2018.1518237?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chen, Su & Walker, Stephen G., 2023. "A New Statistic for Bayesian Hypothesis Testing," Econometrics and Statistics, Elsevier, vol. 26(C), pages 139-152.
    2. De Silva, Dakshina G. & Hubbard, Timothy P. & Schiller, Anita R. & Tsionas, Mike G., 2023. "Estimating outcomes in the presence of endogeneity and measurement error with an application to R&D," The Quarterly Review of Economics and Finance, Elsevier, vol. 88(C), pages 278-294.
    3. Tsionas, Mike G., 2021. "Comparison of stochastic frontier models using the Hyvärinen factor," Economics Letters, Elsevier, vol. 202(C).
    4. Jack Jewson & David Rossell, 2022. "General Bayesian loss function selection and the use of improper models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(5), pages 1640-1665, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:jnlasa:v:114:y:2019:i:528:p:1826-1837. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/UASA20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.