IDEAS home Printed from https://ideas.repec.org/a/spr/metron/v73y2015i2p155-176.html
   My bibliography  Save this article

A new Bayesian approach for determining the number of components in a finite mixture

Author

Listed:
  • Murray Aitkin
  • Duy Vu
  • Brian Francis

Abstract

This article evaluates a new Bayesian approach to determining the number of components in a finite mixture. We evaluate through simulation studies mixtures of normals and latent class mixtures of Bernoulli responses. For normal mixtures we use a “gold standard” set of population models based on a well-known “testbed” data set—the galaxy recession velocity data set of Roeder (J Am Stat Assoc 85:617–624, 1990 ). For Bernoulli latent class mixtures we consider models for psychiatric diagnosis Berkhof et al. (Stat Sin 13:423–442, 2003 ). The new approach is based on comparing models with different numbers of components through their posterior deviance distributions, based on non-informative or diffuse priors. Simulations show that even large numbers of closely spaced normal components can be identified with sufficiently large samples, while for latent classes with Bernoulli responses identification is more complex, though it again improves with increasing sample size. Copyright Sapienza Università di Roma 2015

Suggested Citation

  • Murray Aitkin & Duy Vu & Brian Francis, 2015. "A new Bayesian approach for determining the number of components in a finite mixture," METRON, Springer;Sapienza Università di Roma, vol. 73(2), pages 155-176, August.
  • Handle: RePEc:spr:metron:v:73:y:2015:i:2:p:155-176
    DOI: 10.1007/s40300-015-0068-1
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s40300-015-0068-1
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s40300-015-0068-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Various, 1957. "Additional Comments," NBER Chapters, in: The Measurement and Behavior of Unemployment, pages 585-600, National Bureau of Economic Research, Inc.
    2. Sylvia. Richardson & Peter J. Green, 1997. "On Bayesian Analysis of Mixtures with an Unknown Number of Components (with discussion)," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 59(4), pages 731-792.
    3. David J. Spiegelhalter & Nicola G. Best & Bradley P. Carlin & Angelika Van Der Linde, 2002. "Bayesian measures of model complexity and fit," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(4), pages 583-639, October.
    4. King, C.J., 1957. "The Commencement of Settlement," Review of Marketing and Agricultural Economics, Australian Agricultural and Resource Economics Society, vol. 25(03), pages 1-33, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marco Alfó & Francesco Bartolucci, 2015. "Latent variable models for the analysis of socio-economic data," METRON, Springer;Sapienza Università di Roma, vol. 73(2), pages 151-154, August.
    2. Murray Aitkin & Duy Vu & Brian Francis, 2017. "Statistical modelling of a terrorist network," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(3), pages 751-768, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yuan Fang & Dimitris Karlis & Sanjeena Subedi, 2022. "Infinite Mixtures of Multivariate Normal-Inverse Gaussian Distributions for Clustering of Skewed Data," Journal of Classification, Springer;The Classification Society, vol. 39(3), pages 510-552, November.
    2. Kazuhiko Kakamu, 2022. "Bayesian analysis of mixtures of lognormal distribution with an unknown number of components from grouped data," Papers 2210.05115, arXiv.org, revised Sep 2023.
    3. Carnicero, José Antonio, 2008. "A semi-parametric model for circular data based on mixtures of beta distributions," DES - Working Papers. Statistics and Econometrics. WS ws081305, Universidad Carlos III de Madrid. Departamento de Estadística.
    4. S. Upadhyay & M. Peshwani, 2008. "Posterior analysis of lognormal regression models using the Gibbs sampler," Statistical Papers, Springer, vol. 49(1), pages 59-85, March.
    5. Assaf, A. George & Tsionas, Mike & Oh, Haemoon, 2018. "The time has come: Toward Bayesian SEM estimation in tourism research," Tourism Management, Elsevier, vol. 64(C), pages 98-109.
    6. Ang Shan & Fengkai Yang, 2021. "Bayesian Inference for Finite Mixture Regression Model Based on Non-Iterative Algorithm," Mathematics, MDPI, vol. 9(6), pages 1-13, March.
    7. Komárek, Arnost, 2009. "A new R package for Bayesian estimation of multivariate normal mixtures allowing for selection of the number of components and interval-censored data," Computational Statistics & Data Analysis, Elsevier, vol. 53(12), pages 3932-3947, October.
    8. Chen, Yunxiao & Lu, Yan & Moustaki, Irini, 2022. "Detection of two-way outliers in multivariate data and application to cheating detection in educational tests," LSE Research Online Documents on Economics 112499, London School of Economics and Political Science, LSE Library.
    9. Marco Berrettini & Giuliano Galimberti & Saverio Ranciati, 2023. "Semiparametric finite mixture of regression models with Bayesian P-splines," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 17(3), pages 745-775, September.
    10. G. Iliopoulos & M. Kateri & I. Ntzoufras, 2009. "Bayesian Model Comparison for the Order Restricted RC Association Model," Psychometrika, Springer;The Psychometric Society, vol. 74(4), pages 561-587, December.
    11. McGrory, C.A. & Titterington, D.M., 2007. "Variational approximations in Bayesian model selection for finite mixture distributions," Computational Statistics & Data Analysis, Elsevier, vol. 51(11), pages 5352-5367, July.
    12. Arima, Serena & Basset, Alberto & Jona Lasinio, Giovanna & Pollice, Alessio & Rosati, Ilaria, 2013. "A hierarchical Bayesian model for the ecological status classification of lagoons," Ecological Modelling, Elsevier, vol. 263(C), pages 187-195.
    13. Sanjeena Subedi & Paul D. McNicholas, 2021. "A Variational Approximations-DIC Rubric for Parameter Estimation and Mixture Model Selection Within a Family Setting," Journal of Classification, Springer;The Classification Society, vol. 38(1), pages 89-108, April.
    14. Nicolas Chopin & Christian P. Robert, 2010. "Properties of nested sampling," Biometrika, Biometrika Trust, vol. 97(3), pages 741-755.
    15. Cai, Jing-Heng & Song, Xin-Yuan & Lam, Kwok-Hap & Ip, Edward Hak-Sing, 2011. "A mixture of generalized latent variable models for mixed mode and heterogeneous data," Computational Statistics & Data Analysis, Elsevier, vol. 55(11), pages 2889-2907, November.
    16. Park, Byung-Jung & Zhang, Yunlong & Lord, Dominique, 2010. "Bayesian mixture modeling approach to account for heterogeneity in speed data," Transportation Research Part B: Methodological, Elsevier, vol. 44(5), pages 662-673, June.
    17. Buddhavarapu, Prasad & Scott, James G. & Prozzi, Jorge A., 2016. "Modeling unobserved heterogeneity using finite mixture random parameters for spatially correlated discrete count data," Transportation Research Part B: Methodological, Elsevier, vol. 91(C), pages 492-510.
    18. Dingjing Shi & Xin Tong, 2017. "The Impact of Prior Information on Bayesian Latent Basis Growth Model Estimation," SAGE Open, , vol. 7(3), pages 21582440177, August.
    19. Lee, Jung Wun & Chung, Hwan & Jeon, Saebom, 2021. "Bayesian multivariate latent class profile analysis: Exploring the developmental progression of youth depression and substance use," Computational Statistics & Data Analysis, Elsevier, vol. 161(C).
    20. Deborah Gefang, 2012. "Money‐output Causality Revisited – A Bayesian Logistic Smooth Transition VECM Perspective," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 74(1), pages 131-151, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:metron:v:73:y:2015:i:2:p:155-176. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.