IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v49y2024i1p121-142.html
   My bibliography  Save this article

Bayesian Exploratory Factor Analysis via Gibbs Sampling

Author

Listed:
  • Adrian Quintero

    (Icfes-Colombian Institute for Educational Evaluation)

  • Emmanuel Lesaffre
  • Geert Verbeke

    (I-BioStat, KU Leuven)

Abstract

Bayesian methods to infer model dimensionality in factor analysis generally assume a lower triangular structure for the factor loadings matrix. Consequently, the ordering of the outcomes influences the results. Therefore, we propose a method to infer model dimensionality without imposing any prior restriction on the loadings matrix. Our approach considers a relatively large number of factors and includes auxiliary multiplicative parameters, which may render null the unnecessary columns in the loadings matrix. The underlying dimensionality is then inferred based on the number of nonnull columns in the factor loadings matrix, and the model parameters are estimated with a postprocessing scheme. The advantages of the method in selecting the correct dimensionality are illustrated via simulations and using real data sets.

Suggested Citation

  • Adrian Quintero & Emmanuel Lesaffre & Geert Verbeke, 2024. "Bayesian Exploratory Factor Analysis via Gibbs Sampling," Journal of Educational and Behavioral Statistics, , vol. 49(1), pages 121-142, February.
    • Handle: RePEc:sae:jedbes:v:49:y:2024:i:1:p:121-142
    DOI: 10.3102/10769986231176023
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/10769986231176023
    Download Restriction: no
    File URL: https://libkey.io/10.3102/10769986231176023?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. repec:bfi:wpaper:2014-014 is not listed on IDEAS
    2. Sylvia Kaufmann & Christian Schumacher, 2017. "Identifying relevant and irrelevant variables in sparse factor models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(6), pages 1123-1144, September.
    3. Albert Xingyi Man & Steven Andrew Culpepper, 2022. "A Mode-Jumping Algorithm for Bayesian Factor Analysis," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 117(537), pages 277-290, January.
    4. Conti, Gabriella & Frühwirth-Schnatter, Sylvia & Heckman, James J. & Piatek, Rémi, 2014. "Bayesian exploratory factor analysis," Journal of Econometrics, Elsevier, vol. 183(1), pages 31-57.
    5. Per Engzell, 2021. "What Do Books in the Home Proxy For? A Cautionary Tale," Sociological Methods & Research, , vol. 50(4), pages 1487-1514, November.
    6. Carvalho, Carlos M. & Chang, Jeffrey & Lucas, Joseph E. & Nevins, Joseph R. & Wang, Quanli & West, Mike, 2008. "High-Dimensional Sparse Factor Modeling: Applications in Gene Expression Genomics," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1438-1456.
    7. Aßmann, Christian & Boysen-Hogrefe, Jens & Pape, Markus, 2016. "Bayesian analysis of static and dynamic factor models: An ex-post approach towards the rotation problem," Journal of Econometrics, Elsevier, vol. 192(1), pages 190-206.
    8. Veronika Ročková & Edward I. George, 2016. "Fast Bayesian Factor Analysis via Automatic Rotations to Sparsity," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1608-1622, October.
    9. Rosseel, Yves, 2012. "lavaan: An R Package for Structural Equation Modeling," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i02).
    10. Elena A. Erosheva & S. McKay Curtis, 2017. "Dealing with Reflection Invariance in Bayesian Factor Analysis," Psychometrika, Springer;The Psychometric Society, vol. 82(2), pages 295-307, June.
    11. Zi-Yi Guo, 2017. "Heavy-tailed Distributions and Risk Management of Equity Market Tail Events," Journal of Risk & Control, Risk Market Journals, vol. 4(1), pages 31-41.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Simon Beyeler & Sylvia Kaufmann, 2021. "Reduced‐form factor augmented VAR—Exploiting sparsity to include meaningful factors," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(7), pages 989-1012, November.
    2. Kaufmann, Sylvia & Schumacher, Christian, 2019. "Bayesian estimation of sparse dynamic factor models with order-independent and ex-post mode identification," Journal of Econometrics, Elsevier, vol. 210(1), pages 116-134.
    3. Simon Beyeler & Sylvia Kaufmann, 2016. "Factor augmented VAR revisited - A sparse dynamic factor model approach," Working Papers 16.08, Swiss National Bank, Study Center Gerzensee.
    4. Sylvia Frühwirth-Schnatter & Darjus Hosszejni & Hedibert Freitas Lopes, 2023. "When It Counts—Econometric Identification of the Basic Factor Model Based on GLT Structures," Econometrics, MDPI, vol. 11(4), pages 1-30, November.
    5. Hauber, Philipp & Schumacher, Christian, 2021. "Precision-based sampling with missing observations: A factor model application," Discussion Papers 11/2021, Deutsche Bundesbank.
    6. Javier Maldonado & Esther Ruiz, 2021. "Accurate Confidence Regions for Principal Components Factors," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 83(6), pages 1432-1453, December.
    7. Christian Aßmann & Jens Boysen-Hogrefe & Markus Pape, 2024. "Post-processing for Bayesian analysis of reduced rank regression models with orthonormality restrictions," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 108(3), pages 577-609, September.
    8. Dimitris Korobilis & Kenichi Shimizu, 2022. "Bayesian Approaches to Shrinkage and Sparse Estimation," Foundations and Trends(R) in Econometrics, now publishers, vol. 11(4), pages 230-354, June.
    9. Attanasio, Orazio & Blundell, Richard & Conti, Gabriella & Mason, Giacomo, 2020. "Inequality in socio-emotional skills: A cross-cohort comparison," Journal of Public Economics, Elsevier, vol. 191(C).
    10. Casarin, Roberto & Grassi, Stefano & Ravazzolo, Francesco & van Dijk, Herman K., 2023. "A flexible predictive density combination for large financial data sets in regular and crisis periods," Journal of Econometrics, Elsevier, vol. 237(2).
    11. Roberto Casarin & Fausto Corradin & Francesco Ravazzolo & Nguyen Domenico Sartore & Wing-Keung Wong, 2020. "A Scoring Rule for Factor and Autoregressive Models Under Misspecification," Advances in Decision Sciences, Asia University, Taiwan, vol. 24(2), pages 66-103, June.
    12. Sung, Bongjung & Lee, Jaeyong, 2023. "Covariance structure estimation with Laplace approximation," Journal of Multivariate Analysis, Elsevier, vol. 198(C).
    13. L Schiavon & A Canale & D B Dunson, 2022. "Generalized infinite factorization models [A latent factor linear mixed model for high-dimensional longitudinal data analysis]," Biometrika, Biometrika Trust, vol. 109(3), pages 817-835.
    14. Mohsen Maleki & Darren Wraith, 2019. "Mixtures of multivariate restricted skew-normal factor analyzer models in a Bayesian framework," Computational Statistics, Springer, vol. 34(3), pages 1039-1053, September.
    15. Gregor Kastner & Sylvia Fruhwirth-Schnatter & Hedibert Freitas Lopes, 2016. "Efficient Bayesian Inference for Multivariate Factor Stochastic Volatility Models," Papers 1602.08154, arXiv.org, revised Jul 2017.
    16. Sylvia Fruhwirth-Schnatter, 2023. "Generalized Cumulative Shrinkage Process Priors with Applications to Sparse Bayesian Factor Analysis," Papers 2303.00473, arXiv.org.
    17. Sylvia Kaufmann & Markus Pape, 2023. "Bayesian (non-)unique sparse factor modelling," Working Papers 23.04, Swiss National Bank, Study Center Gerzensee.
    18. Aßmann, Christian & Boysen-Hogrefe, Jens & Pape, Markus, 2016. "Bayesian analysis of static and dynamic factor models: An ex-post approach towards the rotation problem," Journal of Econometrics, Elsevier, vol. 192(1), pages 190-206.
    19. Md. Mominur Rahman & Bilkis Akhter, 2021. "The impact of investment in human capital on bank performance: evidence from Bangladesh," Future Business Journal, Springer, vol. 7(1), pages 1-13, December.
    20. César Merino-Soto & Gina Chávez-Ventura & Verónica López-Fernández & Guillermo M. Chans & Filiberto Toledano-Toledano, 2022. "Learning Self-Regulation Questionnaire (SRQ-L): Psychometric and Measurement Invariance Evidence in Peruvian Undergraduate Students," Sustainability, MDPI, vol. 14(18), pages 1-17, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:49:y:2024:i:1:p:121-142. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.