IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0231670.html
   My bibliography  Save this article

Confounding adjustment performance of ordinal analysis methods in stroke studies

Author

Listed:
  • Thomas P Zonneveld
  • Annette Aigner
  • Rolf H H Groenwold
  • Ale Algra
  • Paul J Nederkoorn
  • Ulrike Grittner
  • Nyika D Kruyt
  • Bob Siegerink

Abstract

Background: In stroke studies, ordinal logistic regression (OLR) is often used to analyze outcome on the modified Rankin Scale (mRS), whereas the non-parametric Mann-Whitney measure of superiority (MWS) has also been suggested. It is unclear how these perform comparatively when confounding adjustment is warranted. Aims: Our aim is to quantify the performance of OLR and MWS in different confounding variable settings. Methods: We set up a simulation study with three different scenarios; (1) dichotomous confounding variables, (2) continuous confounding variables, and (3) confounding variable settings mimicking a study on functional outcome after stroke. We compared adjusted ordinal logistic regression (aOLR) and stratified Mann-Whitney measure of superiority (sMWS), and also used propensity scores to stratify the MWS (psMWS). For comparability, OLR estimates were transformed to a MWS. We report bias, the percentage of runs that produced a point estimate deviating by more than 0.05 points (point estimate variation), and the coverage probability. Results: In scenario 1, there was no bias in both sMWS and aOLR, with similar point estimate variation and coverage probabilities. In scenario 2, sMWS resulted in more bias (0.04 versus 0.00), and higher point estimate variation (41.6% versus 3.3%), whereas coverage probabilities were similar. In scenario 3, there was no bias in both methods, point estimate variation was higher in the sMWS (6.7%) versus aOLR (1.1%), and coverage probabilities were 0.98 (sMWS) versus 0.95 (aOLR). With psMWS, bias remained 0.00, with less point estimate variation (1.5%) and a coverage probability of 0.95. Conclusions: The bias of both adjustment methods was similar in our stroke simulation scenario, and the higher point estimate variation in the MWS improved with propensity score based stratification. The stratified MWS is a valid alternative for adjusted OLR only when the ratio of number of strata versus number of observations is relatively low, but propensity score based stratification extends the application range of the MWS.

Suggested Citation

  • Thomas P Zonneveld & Annette Aigner & Rolf H H Groenwold & Ale Algra & Paul J Nederkoorn & Ulrike Grittner & Nyika D Kruyt & Bob Siegerink, 2020. "Confounding adjustment performance of ordinal analysis methods in stroke studies," PLOS ONE, Public Library of Science, vol. 15(4), pages 1-10, April.
    • Handle: RePEc:plo:pone00:0231670
    DOI: 10.1371/journal.pone.0231670
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0231670
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0231670&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0231670?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Richard Williams, 2006. "Generalized ordered logit/partial proportional odds models for ordinal dependent variables," Stata Journal, StataCorp LLC, vol. 6(1), pages 58-82, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mengyuan Zhou, 2022. "Does the Source of Inheritance Matter in Bequest Attitudes? Evidence from Japan," Journal of Family and Economic Issues, Springer, vol. 43(4), pages 867-887, December.
    2. D'Alberto, R. & Targetti, S. & Schaller, L. & Bartolini, F. & Eichhorn, T. & Haltia, E. & Harmanny, K. & Le Gloux, F. & Nikolov, D. & Runge, T. & Vergamini, D. & Viaggi, D., 2024. "A European perspective on acceptability of innovative agri-environment-climate contract solutions," Land Use Policy, Elsevier, vol. 141(C).
    3. Yuri Reina-Aranza, 2015. "Violencia de pareja y estado de salud de la mujer en Colombia," Documentos de Trabajo Sobre Economía Regional y Urbana 13964, Banco de la República, Economía Regional.
    4. Mengyuan Zhou, 2019. "The Effect of the Source of Inheritance on Bequest Attitudes: Evidence from Japan," Keio-IES Discussion Paper Series 2019-018, Institute for Economics Studies, Keio University.
    5. William Magee, 2023. "Earnings, Intersectional Earnings Inequality, Disappointment in One’s Life Achievements and Life (Dis)satisfaction," Journal of Happiness Studies, Springer, vol. 24(1), pages 373-396, January.
    6. Cristina Chaminade & Monica Plechero, 2015. "Do Regions Make a Difference? Regional Innovation Systems and Global Innovation Networks in the ICT Industry," European Planning Studies, Taylor & Francis Journals, vol. 23(2), pages 215-237, February.
    7. Dirk Crass & Franz Schwiebacher, 2017. "The importance of trademark protection for product differentiation and innovation," Economia e Politica Industriale: Journal of Industrial and Business Economics, Springer;Associazione Amici di Economia e Politica Industriale, vol. 44(2), pages 199-220, June.
    8. Bruno Amable, 2009. "The Differentiation of Social Demands in Europe. The Social Basis of the European Models of Capitalism," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 91(3), pages 391-426, May.
    9. Giuseppina Guagnano & Elisabetta Santarelli & Isabella Santini, 2016. "Can Social Capital Affect Subjective Poverty in Europe? An Empirical Analysis Based on a Generalized Ordered Logit Model," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 128(2), pages 881-907, September.
    10. Richard Williams, 2009. "Using Heterogeneous Choice Models to Compare Logit and Probit Coefficients Across Groups," Sociological Methods & Research, , vol. 37(4), pages 531-559, May.
    11. Hanna Dudek & Joanna Landmesser, 2012. "Income satisfaction and relative deprivation," Statistics in Transition new series, Główny Urząd Statystyczny (Polska), vol. 13(2), pages 321-334, June.
    12. Elvire Guillaud, 2013. "Preferences for redistribution: an empirical analysis over 33 countries," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 11(1), pages 57-78, March.
    13. Yahui Wang, 2019. "What Affects Participation in the Farmland Rental Market in Rural China? Evidence from CHARLS," Sustainability, MDPI, vol. 11(24), pages 1-15, December.
    14. Joachim Wagner, 2009. "Exporte und Firmenerfolg: Welche Firmen profitieren wie vom internationalen Handel?," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 3(2), pages 109-122, October.
    15. Combs, Tabitha S., 2017. "Examining changes in travel patterns among lower wealth households after BRT investment in Bogotá, Colombia," Journal of Transport Geography, Elsevier, vol. 60(C), pages 11-20.
    16. Charlie Tchinda & Marcus Dejardin, 2021. "Are Business Policy Measures in Response to the COVID-19 Pandemic to Be Equally Valued? An Exploration According to SMEs Owners’ Business Expectations," Sustainability, MDPI, vol. 13(21), pages 1-42, October.
    17. repec:dau:papers:123456789/13753 is not listed on IDEAS
    18. Michaël Zemmour, 2015. "Economie politique du financement progressif de la protection sociale," Working Papers hal-01205217, HAL.
    19. Jirjahn Uwe & Tsertsvadze Georgi, 2006. "Betriebsräte und Arbeitszufriedenheit / Works Councils and Job Satisfaction," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 226(5), pages 537-561, October.
    20. Woo, C.K. & Zarnikau, J. & Moore, J. & Horowitz, I., 2011. "Wind generation and zonal-market price divergence: Evidence from Texas," Energy Policy, Elsevier, vol. 39(7), pages 3928-3938, July.
    21. Bachmann, Kremena & Meyer, Julia & Krauss, Annette, 2024. "Investment motives and performance expectations of impact investors," Journal of Behavioral and Experimental Finance, Elsevier, vol. 42(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0231670. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.