IDEAS home Printed from https://ideas.repec.org/a/tsj/stataj/v10y2010i3p339-358.html
   My bibliography  Save this article

Comparing the predictive powers of survival models using Harrell’s C or Somers’ D

Author

Listed:
  • Roger B. Newson

    (National Heart and Lung Institute)

Abstract

Medical researchers frequently make statements that one model pre- dicts survival better than another, and they are frequently challenged to provide rigorous statistical justification for those statements. Stata provides the estat concordance command to calculate the rank parameters Harrell’s C and Somers’ D as measures of the ordinal predictive power of a model. However, no confidence limits or p-values are provided to compare the predictive power of distinct models. The somersd package, downloadable from Statistical Software Components, can provide such confidence intervals, but they should not be taken seriously if they are calculated in the dataset in which the model was fit. Methods are demonstrated for fitting alternative models to a training set of data, and then measuring and comparing their predictive powers by using out-of-sample prediction and somersd in a test set to produce statistically sensible confidence intervals and p-values for the differences between the predictive powers of different models. Copyright 2010 by StataCorp LP.

Suggested Citation

  • Roger B. Newson, 2010. "Comparing the predictive powers of survival models using Harrell’s C or Somers’ D," Stata Journal, StataCorp LP, vol. 10(3), pages 339-358, September.
    • Handle: RePEc:tsj:stataj:v:10:y:2010:i:3:p:339-358
    Note: to access software from within Stata, net describe http://www.stata-journal.com/software/sj10-3/st0198/
    as

    Download full text from publisher

    File URL: http://www.stata-journal.com/article.html?article=st0198
    File Function: link to article download
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Roger Newson, 2002. "Parameters behind "nonparametric" statistics: Kendall's tau,Somers' D and median differences," Stata Journal, StataCorp LP, vol. 2(1), pages 45-64, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Stephen F Weng & Jenna Reps & Joe Kai & Jonathan M Garibaldi & Nadeem Qureshi, 2017. "Can machine-learning improve cardiovascular risk prediction using routine clinical data?," PLOS ONE, Public Library of Science, vol. 12(4), pages 1-14, April.
    2. Buenstorf, Guido & Costa, Carla, 2018. "Drivers of spin-off performance in industry clusters: Embodied knowledge or embedded firms?," Research Policy, Elsevier, vol. 47(3), pages 663-673.
    3. Kalahasthi, Lokesh Kumar & Sánchez-Díaz, Iván & Pablo Castrellon, Juan & Gil, Jorge & Browne, Michael & Hayes, Simon & Sentís Ros, Carles, 2022. "Joint modeling of arrivals and parking durations for freight loading zones: Potential applications to improving urban logistics," Transportation Research Part A: Policy and Practice, Elsevier, vol. 166(C), pages 307-329.
    4. Nikolskiy, Ilya & Furmanov, Kirill, 2023. "Assessing the accuracy of efficiency rankings obtained from a stochastic frontier model," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 71, pages 128-142.
    5. Rumyantseva, Ekaterina & Furmanov, Kirill, 2016. "Modeling mortgage survival," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 41, pages 123-143.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. John, Katrin & Thomsen, Stephan L., 2015. "School-track environment or endowment: What determines different other-regarding behavior across peer groups?," Games and Economic Behavior, Elsevier, vol. 94(C), pages 122-141.
    2. Chakrabarty, Manisha & Hildenbrand, Werner, 2011. "Engel's Law Reconsidered," Journal of Mathematical Economics, Elsevier, vol. 47(3), pages 289-299.
    3. Guerra, Alice & Zhuravleva, Tatyana, 2021. "Do bystanders react to bribery?," Journal of Economic Behavior & Organization, Elsevier, vol. 185(C), pages 442-462.
    4. Philipp Chapkovski & Luca Corazzini & Valeria Maggian, 2021. "Does Whistleblowing on Tax Evaders Reduce Ingroup Cooperation?," Working Papers 2021:20, Department of Economics, University of Venice "Ca' Foscari".
    5. Cingl, Lubomír & Lichard, Tomáš & Miklánek, Tomáš, 2023. "Tax designation effects on compliance: An online experiment with taxpayers," Journal of Economic Behavior & Organization, Elsevier, vol. 214(C), pages 615-633.
    6. Lukasz Prorokowski, 2016. "Rank-order statistics for validating discriminative power of credit risk models," Bank i Kredyt, Narodowy Bank Polski, vol. 47(3), pages 227-250.
    7. Newson, Roger, 2005. "Efficient Calculation of Jackknife Confidence Intervals for Rank Statistics," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 15(i01).
    8. Jeannette Brosig‐Koch & Heike Hennig‐Schmidt & Nadja Kairies‐Schwarz & Daniel Wiesen, 2017. "The Effects of Introducing Mixed Payment Systems for Physicians: Experimental Evidence," Health Economics, John Wiley & Sons, Ltd., vol. 26(2), pages 243-262, February.
    9. Löschel, Andreas & Sturm, Bodo & Uehleke, Reinhard, 2013. "Revealed preferences for climate protection when the purely individual perspective is relaxed: Evidence from a framed field experiment," ZEW Discussion Papers 13-006, ZEW - Leibniz Centre for European Economic Research.
    10. Valeria Maggian & Natalia Montinari & Antonio Nicol�, 2018. "Backscratching in Hierarchical Organizations," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 34(2), pages 133-161.
    11. Dirk Tasche, 2009. "Estimating discriminatory power and PD curves when the number of defaults is small," Papers 0905.3928, arXiv.org, revised Mar 2010.
    12. Hanna Karolina Szymborska, 2018. "Household wealth structures and position in the income distribution – econometric analysis for the USA, 1989-2013," Working Papers PKWP1806, Post Keynesian Economics Society (PKES).
    13. Tomas Miklanek, 2017. "The Effect of Shame in Dictator Games with Information Asymmetry," CERGE-EI Working Papers wp581, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    14. Szymborska, Hanna Karolina, 2019. "Wealth structures and income distribution of US households before and after the Great Recession," Structural Change and Economic Dynamics, Elsevier, vol. 51(C), pages 168-185.
    15. Roger Newson, 2006. "On the central role of Somers' D," United Kingdom Stata Users' Group Meetings 2006 01, Stata Users Group.
    16. Michelangelo Scorpio & Davide Carleo & Martina Gargiulo & Pilar Chías Navarro & Yorgos Spanodimitriou & Parinaz Sabet & Massimiliano Masullo & Giovanni Ciampi, 2023. "A Review of Subjective Assessments in Virtual Reality for Lighting Research," Sustainability, MDPI, vol. 15(9), pages 1-25, May.
    17. Ramos, Héctor M. & Ollero, Jorge & Suárez-Llorens, Alfonso, 2017. "A new explanatory index for evaluating the binary logistic regression based on the sensitivity of the estimated model," Statistics & Probability Letters, Elsevier, vol. 120(C), pages 135-140.
    18. William Rhodes, 2014. "Pairwise Cluster Randomization," Evaluation Review, , vol. 38(3), pages 217-250, June.
    19. Löschel, Andreas & Sturm, Bodo & Uehleke, Reinhard, 2017. "Revealed preferences for voluntary climate change mitigation when the purely individual perspective is relaxed – evidence from a framed field experiment," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 67(C), pages 149-160.
    20. Chakrabarty, Manisha & Hildenbrand, Werner, 2009. "Engel’s Law Reconsidered," Bonn Econ Discussion Papers 22/2009, University of Bonn, Bonn Graduate School of Economics (BGSE).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tsj:stataj:v:10:y:2010:i:3:p:339-358. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christopher F. Baum or Lisa Gilmore (email available below). General contact details of provider: http://www.stata-journal.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.