IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v78y2013i1p134-153.html
   My bibliography  Save this article

Global Convergence of the EM Algorithm for Unconstrained Latent Variable Models with Categorical Indicators

Author

Listed:
  • Alexander Weissman

Abstract

Convergence of the expectation-maximization (EM) algorithm to a global optimum of the marginal log likelihood function for unconstrained latent variable models with categorical indicators is presented. The sufficient conditions under which global convergence of the EM algorithm is attainable are provided in an information-theoretic context by interpreting the EM algorithm as alternating minimization of the Kullback–Leibler divergence between two convex sets. It is shown that these conditions are satisfied by an unconstrained latent class model, yielding an optimal bound against which more highly constrained models may be compared. Copyright The Psychometric Society 2013

Suggested Citation

  • Alexander Weissman, 2013. "Global Convergence of the EM Algorithm for Unconstrained Latent Variable Models with Categorical Indicators," Psychometrika, Springer;The Psychometric Society, vol. 78(1), pages 134-153, January.
    • Handle: RePEc:spr:psycho:v:78:y:2013:i:1:p:134-153
    DOI: 10.1007/s11336-012-9295-z
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s11336-012-9295-z
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s11336-012-9295-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. R. Bock & Murray Aitkin, 1981. "Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm," Psychometrika, Springer;The Psychometric Society, vol. 46(4), pages 443-459, December.
    2. Roger Wets, 1999. "Statistical estimation from an optimization viewpoint," Annals of Operations Research, Springer, vol. 85(0), pages 79-101, January.
    3. Hamparsum Bozdogan, 1987. "Model selection and Akaike's Information Criterion (AIC): The general theory and its analytical extensions," Psychometrika, Springer;The Psychometric Society, vol. 52(3), pages 345-370, September.
    4. Irini Moustaki & Martin Knott, 2000. "Generalized latent trait models," Psychometrika, Springer;The Psychometric Society, vol. 65(3), pages 391-411, September.
    5. K. Humphreys & D. Titterington, 2003. "Variational approximations for categorical causal modeling with latent variables," Psychometrika, Springer;The Psychometric Society, vol. 68(3), pages 391-412, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alexander Weissman, 2013. "Optimizing information using the EM algorithm in item response theory," Annals of Operations Research, Springer, vol. 206(1), pages 627-646, July.
    2. Vitoratou, Silia & Ntzoufras, Ioannis & Moustaki, Irini, 2016. "Explaining the behavior of joint and marginal Monte Carlo estimators in latent variable models with independence assumptions," LSE Research Online Documents on Economics 57685, London School of Economics and Political Science, LSE Library.
    3. An, Xinming & Bentler, Peter M., 2012. "Efficient direct sampling MCEM algorithm for latent variable models with binary responses," Computational Statistics & Data Analysis, Elsevier, vol. 56(2), pages 231-244.
    4. Frank Rijmen & Minjeong Jeon, 2013. "Fitting an item response theory model with random item effects across groups by a variational approximation method," Annals of Operations Research, Springer, vol. 206(1), pages 647-662, July.
    5. Dylan Molenaar, 2015. "Heteroscedastic Latent Trait Models for Dichotomous Data," Psychometrika, Springer;The Psychometric Society, vol. 80(3), pages 625-644, September.
    6. Minjeong Jeon & Frank Rijmen & Sophia Rabe-Hesketh, 2017. "A Variational Maximization–Maximization Algorithm for Generalized Linear Mixed Models with Crossed Random Effects," Psychometrika, Springer;The Psychometric Society, vol. 82(3), pages 693-716, September.
    7. Shing-On Leung, 2008. "A Three-Dimensional Latent Variable Model for Attitude Scales," Sociological Methods & Research, , vol. 37(1), pages 135-154, August.
    8. Silvia Cagnone & Paola Monari, 2013. "Latent variable models for ordinal data by using the adaptive quadrature approximation," Computational Statistics, Springer, vol. 28(2), pages 597-619, April.
    9. Bianconcini, Silvia & Cagnone, Silvia, 2012. "Estimation of generalized linear latent variable models via fully exponential Laplace approximation," Journal of Multivariate Analysis, Elsevier, vol. 112(C), pages 183-193.
    10. Peida Zhan & Xin Qiao, 2022. "DIAGNOSTIC Classification Analysis of Problem-Solving Competence using Process Data: An Item Expansion Method," Psychometrika, Springer;The Psychometric Society, vol. 87(4), pages 1529-1547, December.
    11. Taha Hannachi & Sonya Yakimova & Alain Somat, 2024. "A Follow up on the Continuum Theory of Eco-Anxiety: Analysis of the Climate Change Anxiety Scale Using Item Response Theory among French Speaking Population," IJERPH, MDPI, vol. 21(9), pages 1-16, August.
    12. Daniela Andreini & Diego Rinallo & Giuseppe Pedeliento & Mara Bergamaschi, 2017. "Brands and Religion in the Secularized Marketplace and Workplace: Insights from the Case of an Italian Hospital Renamed After a Roman Catholic Pope," Journal of Business Ethics, Springer, vol. 141(3), pages 529-550, March.
    13. Domenico Piccolo & Rosaria Simone, 2019. "The class of cub models: statistical foundations, inferential issues and empirical evidence," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 28(3), pages 389-435, September.
    14. Ying Cheng & Ke-Hai Yuan, 2010. "The Impact of Fallible Item Parameter Estimates on Latent Trait Recovery," Psychometrika, Springer;The Psychometric Society, vol. 75(2), pages 280-291, June.
    15. S. A. Abu Bakar & Saralees Nadarajah & Z. A. Absl Kamarul Adzhar, 2018. "Loss modeling using Burr mixtures," Empirical Economics, Springer, vol. 54(4), pages 1503-1516, June.
    16. Jaewoong Yun, 2023. "Strategies for Improving the Sustainability of Fare-Free Policy for the Elderly through Preferences by Travel Modes," Sustainability, MDPI, vol. 15(20), pages 1-14, October.
    17. Malerba, Martino E. & Connolly, Sean R. & Heimann, Kirsten, 2015. "An experimentally validated nitrate–ammonium–phytoplankton model including effects of starvation length and ammonium inhibition on nitrate uptake," Ecological Modelling, Elsevier, vol. 317(C), pages 30-40.
    18. Yanyuan Ma & Marc G. Genton, 2010. "Explicit estimating equations for semiparametric generalized linear latent variable models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(4), pages 475-495, September.
    19. Emilio Augusto Coelho-Barros & Jorge Alberto Achcar & Josmar Mazucheli, 2010. "Longitudinal Poisson modeling: an application for CD4 counting in HIV-infected patients," Journal of Applied Statistics, Taylor & Francis Journals, vol. 37(5), pages 865-880.
    20. Alexander Robitzsch, 2024. "Bias-Reduced Haebara and Stocking–Lord Linking," J, MDPI, vol. 7(3), pages 1-12, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:78:y:2013:i:1:p:134-153. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.