IDEAS home Printed from https://ideas.repec.org/p/hhs/oruesi/2008_006.html
   My bibliography  Save this paper

Comparison of methods in the analysis of dependent ordered catagorical data

Author

Listed:
  • Högberg, Hans

    (Centre for Research and Development, Uppsala University and Country,Council of Gävleborg, Sweden)

  • Svensson, Elisabeth

    (Department of Business, Economics, Statistics and Informatics)

Abstract

Rating scales for outcome variables produce categorical data which are often ordered and measurements from rating scales are not standardized. The purpose of this study is to apply commonly used and novel methods for paired ordered categorical data to two data sets with different properties and to compare the results and the conditions for use of these models. The two applications consist of a data set of inter-rater reliability and a data set from a follow-up evaluation of patients. Standard measures of agreement and measures of association are used. Various loglinear models for paired categorical data using properties of quasi-independence and quasi-symmetry as well as logit models with a marginal modelling approach are used. A nonparametric method for ranking and analyzing paired ordered categorical data is also used. We show that a deeper insight when it comes to disagreement and change patterns may be reached using the nonparametric method and illustrate some problems with standard measures as well as parametric loglinear and logit models. In addition, the merits of the nonparametric method are illustrated.

Suggested Citation

  • Högberg, Hans & Svensson, Elisabeth, 2008. "Comparison of methods in the analysis of dependent ordered catagorical data," Working Papers 2008:6, Örebro University, School of Business.
    • Handle: RePEc:hhs:oruesi:2008_006
    as

    Download full text from publisher

    File URL: https://www.oru.se/globalassets/oru-sv/institutioner/hh/workingpapers/workingpapers2008/wp-6-2008.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Alan Agresti & Ranjini Natarajan, 2001. "Modeling Clustered Ordered Categorical Data: A Survey," International Statistical Review, International Statistical Institute, vol. 69(3), pages 345-371, December.
    2. J. Richard Landis & Gary G. Koch, 1975. "A review of statistical methods in the analysis of data arising from observer reliability studies (Part II)," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 29(4), pages 151-161, December.
    3. Ivy Liu & Alan Agresti, 2005. "The analysis of ordered categorical data: An overview and a survey of recent developments," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 14(1), pages 1-73, June.
    4. J. Richard Landis & Gary G. Koch, 1975. "A review of statistical methods in the analysis of data arising from observer reliability studies (Part I)," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 29(3), pages 101-123, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Högberg, Hans & Svensson, Elisabeth, 2008. "An Overview of Methods in the Analysis of Dependent ordered catagorical Data: Assumptions and Implications," Working Papers 2008:7, Örebro University, School of Business.
    2. Debby L Gerritsen & Nardi Steverink & Dinnus HM Frijters & Marcel E Ooms & Miel W Ribbe, 2010. "Social well‐being and its measurement in the nursing home, the SWON‐scale," Journal of Clinical Nursing, John Wiley & Sons, vol. 19(9‐10), pages 1243-1251, May.
    3. N. Lu & T. Chen & P. Wu & D. Gunzler & H. Zhang & H. He & X.M. Tu, 2014. "Functional response models for intraclass correlation coefficients," Journal of Applied Statistics, Taylor & Francis Journals, vol. 41(11), pages 2539-2556, November.
    4. Christof Schuster & David Smith, 2005. "Dispersion-weighted kappa: An integrative framework for metric and nominal scale agreement coefficients," Psychometrika, Springer;The Psychometric Society, vol. 70(1), pages 135-146, March.
    5. Fabio Rapallo, 2005. "Algebraic exact inference for rater agreement models," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 14(1), pages 45-66, February.
    6. Li, Yonghai & Schafer, Daniel W., 2008. "Likelihood analysis of the multivariate ordinal probit regression model for repeated ordinal responses," Computational Statistics & Data Analysis, Elsevier, vol. 52(7), pages 3474-3492, March.
    7. Cheng, Song-Show & Cheng, Yu-Chun, 1998. "An ordered relation between the ANOVA estimator of the intraclass correlation and a kappa-type statistic in binary data," Statistics & Probability Letters, Elsevier, vol. 38(3), pages 275-280, June.
    8. Nooraee, Nazanin & Molenberghs, Geert & van den Heuvel, Edwin R., 2014. "GEE for longitudinal ordinal data: Comparing R-geepack, R-multgee, R-repolr, SAS-GENMOD, SPSS-GENLIN," Computational Statistics & Data Analysis, Elsevier, vol. 77(C), pages 70-83.
    9. Domenico Piccolo & Rosaria Simone, 2019. "The class of cub models: statistical foundations, inferential issues and empirical evidence," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 28(3), pages 389-435, September.
    10. Baruch, Shmuel & Panayides, Marios & Venkataraman, Kumar, 2017. "Informed trading and price discovery before corporate events," Journal of Financial Economics, Elsevier, vol. 125(3), pages 561-588.
    11. Bambio, Yiriyibin & Bouayad Agha, Salima, 2018. "Land tenure security and investment: Does strength of land right really matter in rural Burkina Faso?," World Development, Elsevier, vol. 111(C), pages 130-147.
    12. Wei, Zheng & Kim, Daeyoung, 2021. "On exploratory analytic method for multi-way contingency tables with an ordinal response variable and categorical explanatory variables," Journal of Multivariate Analysis, Elsevier, vol. 186(C).
    13. Rasheed A. Adeyemi & Temesgen Zewotir & Shaun Ramroop, 2016. "Semiparametric Multinomial Ordinal Model to Analyze Spatial Patterns of Child Birth Weight in Nigeria," IJERPH, MDPI, vol. 13(11), pages 1-22, November.
    14. M. Pardo, 2011. "Testing equality restrictions in generalized linear models for multinomial data," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 73(2), pages 231-253, March.
    15. Keunbaik Lee & Michael J. Daniels, 2007. "A Class of Markov Models for Longitudinal Ordinal Data," Biometrics, The International Biometric Society, vol. 63(4), pages 1060-1067, December.
    16. Simone, Rosaria & Tutz, Gerhard & Iannario, Maria, 2020. "Subjective heterogeneity in response attitude for multivariate ordinal outcomes," Econometrics and Statistics, Elsevier, vol. 14(C), pages 145-158.
    17. Maynou, Laia & Cairns, John, 2019. "What is driving HTA decision-making? Evidence from cancer drug reimbursement decisions from 6 European countries," Health Policy, Elsevier, vol. 123(2), pages 130-139.
    18. Pardo, L. & Pardo, M.C., 2008. "An extension of likelihood-ratio-test for testing linear hypotheses in the baseline-category logit model," Computational Statistics & Data Analysis, Elsevier, vol. 52(3), pages 1477-1489, January.
    19. Sabrina Maggio & Sandra Iaco & Claudia Cappello, 2024. "Multilevel modeling for investigating the probability of digital innovation in museums," Annals of Operations Research, Springer, vol. 342(3), pages 1737-1764, November.
    20. Maynou, Laia & Cairns, John, 2018. "What is driving HTA decision-making? Evidence from cancer drug reimbursement decisions from 6 European countries," LSE Research Online Documents on Economics 90877, London School of Economics and Political Science, LSE Library.

    More about this item

    Keywords

    Agreement:ordinal data; ranking; reliability.rating scales;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hhs:oruesi:2008_006. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/ieoruse.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.