IDEAS home Printed from https://ideas.repec.org/a/taf/japsta/v30y2003i9p967-981.html
   My bibliography  Save this article

Evaluation of methods for interval estimation of model outputs, with application to survival models

Author

Listed:
  • Richard Stevens

Abstract

When a published statistical model is also distributed as computer software, it will usually be desirable to present the outputs as interval, as well as point, estimates. The present paper compares three methods for approximate interval estimation about a model output, for use when the model form does not permit an exact interval estimate. The methods considered are first-order asymptotics, using second derivatives of the log-likelihood to estimate variance information; higher-order asymptotics based on the signed-root transformation; and the non-parametric bootstrap. The signed-root method is Bayesian, and uses an approximation for posterior moments that has not previously been tested in a real-world application. Use of the three methods is illustrated with reference to a software project arising in medical decision-making, the UKPDS Risk Engine. Intervals from the first-order and signed-root methods are near- identical, and typically 1% wider to 7% narrower than those from the non-parametric bootstrap. The asymptotic methods are markedly faster than the bootstrap method.

Suggested Citation

  • Richard Stevens, 2003. "Evaluation of methods for interval estimation of model outputs, with application to survival models," Journal of Applied Statistics, Taylor & Francis Journals, vol. 30(9), pages 967-981.
    • Handle: RePEc:taf:japsta:v:30:y:2003:i:9:p:967-981
    DOI: 10.1080/0266476032000076100
    as

    Download full text from publisher

    File URL: http://www.tandfonline.com/doi/abs/10.1080/0266476032000076100
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/0266476032000076100?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. I. D. Hill & R. Hill & R. L. Holder, 1976. "Fitting Johnson Curves by Moments," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 25(2), pages 180-189, June.
    2. Chris Chatfield, 1995. "Model Uncertainty, Data Mining and Statistical Inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 158(3), pages 419-444, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chou, Ping & Chuang, Howard Hao-Chun & Chou, Yen-Chun & Liang, Ting-Peng, 2022. "Predictive analytics for customer repurchase: Interdisciplinary integration of buy till you die modeling and machine learning," European Journal of Operational Research, Elsevier, vol. 296(2), pages 635-651.
    2. Riccardo (Jack) Lucchetti & Luca Pedini, 2020. "ParMA: Parallelised Bayesian Model Averaging for Generalised Linear Models," Working Papers 2020:28, Department of Economics, University of Venice "Ca' Foscari".
    3. Robert Lehmann & Antje Weyh, 2016. "Forecasting Employment in Europe: Are Survey Results Helpful?," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 12(1), pages 81-117, September.
    4. Castle Jennifer L. & Doornik Jurgen A & Hendry David F., 2011. "Evaluating Automatic Model Selection," Journal of Time Series Econometrics, De Gruyter, vol. 3(1), pages 1-33, February.
    5. Lee, Yun Shin & Scholtes, Stefan, 2014. "Empirical prediction intervals revisited," International Journal of Forecasting, Elsevier, vol. 30(2), pages 217-234.
    6. Coleman, Stephen, 2005. "Testing Theories with Qualitative and Quantitative Predictions," MPRA Paper 105171, University Library of Munich, Germany.
    7. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    8. Brooks, Jeremy S., 2010. "The Buddha mushroom: Conservation behavior and the development of institutions in Bhutan," Ecological Economics, Elsevier, vol. 69(4), pages 779-795, February.
    9. Brian Knaeble & Seth Dutter, 2017. "Reversals of Least-Square Estimates and Model-Invariant Estimation for Directions of Unique Effects," The American Statistician, Taylor & Francis Journals, vol. 71(2), pages 97-105, April.
    10. Steven M. Shugan, 2002. "In Search of Data: An Editorial," Marketing Science, INFORMS, vol. 21(4), pages 369-377.
    11. Michael Schomaker & Christian Heumann, 2020. "When and when not to use optimal model averaging," Statistical Papers, Springer, vol. 61(5), pages 2221-2240, October.
    12. Clark, Todd & McCracken, Michael, 2013. "Advances in Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1107-1201, Elsevier.
    13. W. Robert Reed, 2009. "The Determinants Of U.S. State Economic Growth: A Less Extreme Bounds Analysis," Economic Inquiry, Western Economic Association International, vol. 47(4), pages 685-700, October.
    14. Nicholas Weller & Jeb Barnes, 2016. "Pathway Analysis and the Search for Causal Mechanisms," Sociological Methods & Research, , vol. 45(3), pages 424-457, August.
    15. S. P. Brooks & E. A. Catchpole & B. J. T. Morgan & M. P. Harris, 2002. "Bayesian methods for analysing ringing data," Journal of Applied Statistics, Taylor & Francis Journals, vol. 29(1-4), pages 187-206.
    16. Nick Inglis & Bruce Vanstone & Tobias Hahn, 2019. "Modelling momentum winner/loser asymmetry: the sources of winner and loser returns in the ASX200 and S&P500," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 59(S1), pages 657-684, April.
    17. Chen, Huifen & Cheng, Yuyen, 2007. "Non-normality effects on the economic-statistical design of charts with Weibull in-control time," European Journal of Operational Research, Elsevier, vol. 176(2), pages 986-998, January.
    18. Ormerod, Paul, 2015. "The economics of radical uncertainty," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 9, pages 1-20.
    19. Sai Ding & John Knight, 2011. "Why has China Grown So Fast? The Role of Physical and Human Capital Formation," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 73(2), pages 141-174, April.
    20. M. Pir Bavaghar, 2015. "Deforestation modelling using logistic regression and GIS," Journal of Forest Science, Czech Academy of Agricultural Sciences, vol. 61(5), pages 193-199.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:japsta:v:30:y:2003:i:9:p:967-981. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/CJAS20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.