IDEAS home Printed from https://ideas.repec.org/a/spr/compst/v36y2021i1d10.1007_s00180-020-01004-z.html
   My bibliography  Save this article

An accelerated EM algorithm for mixture models with uncertainty for rating data

Author

Listed:
  • Rosaria Simone

    (University of Naples Federico II)

Abstract

The paper is framed within the literature around Louis’ identity for the observed information matrix in incomplete data problems, with a focus on the implied acceleration of maximum likelihood estimation for mixture models. The goal is twofold: to obtain direct expressions for standard errors of parameters from the EM algorithm and to reduce the computational burden of the estimation procedure for a class of mixture models with uncertainty for rating variables. This achievement fosters the feasibility of best-subset variable selection, which is an advisable strategy to identify response patterns from regression models for all Mixtures of Experts systems. The discussion is supported by simulation experiments and a real case study.

Suggested Citation

  • Rosaria Simone, 2021. "An accelerated EM algorithm for mixture models with uncertainty for rating data," Computational Statistics, Springer, vol. 36(1), pages 691-714, March.
    • Handle: RePEc:spr:compst:v:36:y:2021:i:1:d:10.1007_s00180-020-01004-z
    DOI: 10.1007/s00180-020-01004-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00180-020-01004-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s00180-020-01004-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. D. Oakes, 1999. "Direct calculation of the information matrix via the EM," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(2), pages 479-482, April.
    2. Stefania Capecchi & Domenico Piccolo, 2017. "Dealing with heterogeneity in ordinal responses," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(5), pages 2375-2393, September.
    3. Maria Iannario, 2010. "On the identifiability of a mixture model for ordinal data," Metron - International Journal of Statistics, Dipartimento di Statistica, Probabilità e Statistiche Applicate - University of Rome, vol. 0(1), pages 87-94.
    4. D'Elia, Angela & Piccolo, Domenico, 2005. "A mixture model for preferences data analysis," Computational Statistics & Data Analysis, Elsevier, vol. 49(3), pages 917-934, June.
    5. Domenico Piccolo & Rosaria Simone & Maria Iannario, 2019. "Cumulative and CUB Models for Rating Data: A Comparative Analysis," International Statistical Review, International Statistical Institute, vol. 87(2), pages 207-236, August.
    6. Rosaria Simone & Gerhard Tutz, 2018. "Modelling uncertainty and response styles in ordinal data," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 72(3), pages 224-245, August.
    7. Manisera, Marica & Zuccolotto, Paola, 2014. "Modeling rating data with Nonlinear CUB models," Computational Statistics & Data Analysis, Elsevier, vol. 78(C), pages 100-118.
    8. Simone, Rosaria & Tutz, Gerhard & Iannario, Maria, 2020. "Subjective heterogeneity in response attitude for multivariate ordinal outcomes," Econometrics and Statistics, Elsevier, vol. 14(C), pages 145-158.
    9. Zhou, Hua & Lange, Kenneth, 2009. "Rating Movies and Rating the Raters Who Rate Them," The American Statistician, American Statistical Association, vol. 63(4), pages 297-307.
    10. Anna Gottard & Maria Iannario & Domenico Piccolo, 2016. "Varying uncertainty in CUB models," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 10(2), pages 225-244, June.
    11. Khalili, Abbas & Chen, Jiahua, 2007. "Variable Selection in Finite Mixture of Regression Models," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1025-1038, September.
    12. Domenico Piccolo & Rosaria Simone, 2019. "Rejoinder to the discussion of “The class of cub models: statistical foundations, inferential issues and empirical evidence”," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 28(3), pages 477-493, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Shaoting Li & Jiahua Chen, 2023. "Mixture of shifted binomial distributions for rating data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 75(5), pages 833-853, October.
    2. Francesca Iorio & Riccardo Lucchetti & Rosaria Simone, 2024. "Testing distributional assumptions in CUB models for the analysis of rating data," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 108(3), pages 669-701, September.
    3. Rosaria Simone, 2022. "On finite mixtures of Discretized Beta model for ordered responses," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 31(3), pages 828-855, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Manisera, Marica & Zuccolotto, Paola, 2022. "A mixture model for ordinal variables measured on semantic differential scales," Econometrics and Statistics, Elsevier, vol. 22(C), pages 98-123.
    2. Domenico Piccolo & Rosaria Simone, 2019. "The class of cub models: statistical foundations, inferential issues and empirical evidence," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 28(3), pages 389-435, September.
    3. Stefania Capecchi & Maria Iannario & Rosaria Simone, 2018. "Well-Being and Relational Goods: A Model-Based Approach to Detect Significant Relationships," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 135(2), pages 729-750, January.
    4. Simone, Rosaria & Tutz, Gerhard & Iannario, Maria, 2020. "Subjective heterogeneity in response attitude for multivariate ordinal outcomes," Econometrics and Statistics, Elsevier, vol. 14(C), pages 145-158.
    5. Capecchi, Stefania & Amato, Mario & Sodano, Valeria & Verneau, Fabio, 2019. "Understanding beliefs and concerns towards palm oil: Empirical evidence and policy implications," Food Policy, Elsevier, vol. 89(C).
    6. Ryan H. L. Ip & K. Y. K. Wu, 2024. "A mixture distribution for modelling bivariate ordinal data," Statistical Papers, Springer, vol. 65(7), pages 4453-4488, September.
    7. E. Nardo & R. Simone, 2019. "A model-based fuzzy analysis of questionnaires," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 28(2), pages 187-215, June.
    8. Roberto Colombi & Sabrina Giordano & Gerhard Tutz, 2021. "A Rating Scale Mixture Model to Account for the Tendency to Middle and Extreme Categories," Journal of Educational and Behavioral Statistics, , vol. 46(6), pages 682-716, December.
    9. Rosaria Simone, 2023. "Uncertainty Diagnostics of Binomial Regression Trees for Ordered Rating Data," Journal of Classification, Springer;The Classification Society, vol. 40(1), pages 79-105, April.
    10. Stefania Capecchi & Romina Gambacorta & Rosaria Simone & Domenico Piccolo, 2024. "Modelling cognitive response patterns to survey questions using the class of CUB models," Questioni di Economia e Finanza (Occasional Papers) 885, Bank of Italy, Economic Research and International Relations Area.
    11. Gerhard Tutz & Micha Schneider & Maria Iannario & Domenico Piccolo, 2017. "Mixture models for ordinal responses to account for uncertainty of choice," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 11(2), pages 281-305, June.
    12. Stefania Capecchi & Rosaria Simone, 2019. "A Proposal for a Model-Based Composite Indicator: Experience on Perceived Discrimination in Europe," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 95-110, January.
    13. Manisera, Marica & Zuccolotto, Paola, 2015. "Identifiability of a model for discrete frequency distributions with a multidimensional parameter space," Journal of Multivariate Analysis, Elsevier, vol. 140(C), pages 302-316.
    14. Francesca Iorio & Riccardo Lucchetti & Rosaria Simone, 2024. "Testing distributional assumptions in CUB models for the analysis of rating data," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 108(3), pages 669-701, September.
    15. Shaoting Li & Jiahua Chen, 2023. "Mixture of shifted binomial distributions for rating data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 75(5), pages 833-853, October.
    16. Ribecco, Nunziata & D'Uggento, Angela Maria & Labarile, Angela, 2022. "What influences the perception of immigration in Italian adolescents? An analysis with CUB models for rating data," Socio-Economic Planning Sciences, Elsevier, vol. 82(PB).
    17. Gennaro Punzo & Rosalia Castellano & Mirko Buonocore, 2018. "Job Satisfaction in the “Big Four” of Europe: Reasoning Between Feeling and Uncertainty Through CUB Models," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 139(1), pages 205-236, August.
    18. Manisera, Marica & Zuccolotto, Paola, 2014. "Modeling rating data with Nonlinear CUB models," Computational Statistics & Data Analysis, Elsevier, vol. 78(C), pages 100-118.
    19. Maria Iannario & Domenico Piccolo, 2016. "A comprehensive framework of regression models for ordinal data," METRON, Springer;Sapienza Università di Roma, vol. 74(2), pages 233-252, August.
    20. Roberto Colombi & Sabrina Giordano, 2019. "Likelihood-based tests for a class of misspecified finite mixture models for ordinal categorical data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(4), pages 1175-1202, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:compst:v:36:y:2021:i:1:d:10.1007_s00180-020-01004-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.