IDEAS home Printed from https://ideas.repec.org/a/spr/stmapp/v31y2022i2d10.1007_s10260-021-00575-5.html
   My bibliography  Save this article

Chunk-wise regularised PCA-based imputation of missing data

Author

Listed:
  • A. Iodice D’Enza

    (Univeristà degli studi di Napoli Federico II)

  • A. Markos

    (Democritus University of Thrace)

  • F. Palumbo

    (Univeristà degli studi di Napoli Federico II)

Abstract

Standard multivariate techniques like Principal Component Analysis (PCA) are based on the eigendecomposition of a matrix and therefore require complete data sets. Recent comparative reviews of PCA algorithms for missing data showed the regularised iterative PCA algorithm (RPCA) to be effective. This paper presents two chunk-wise implementations of RPCA suitable for the imputation of “tall” data sets, that is, data sets with many observations. A “chunk” is a subset of the whole set of available observations. In particular, one implementation is suitable for distributed computation as it imputes each chunk independently. The other implementation, instead, is suitable for incremental computation, where the imputation of each new chunk is based on all the chunks analysed that far. The proposed procedures were compared to batch RPCA considering different data sets and missing data mechanisms. Experimental results showed that the distributed approach had similar performance to batch RPCA for data with entries missing completely at random. The incremental approach showed appreciable performance when the data is missing not completely at random, and the first analysed chunks contain sufficient information on the data structure.

Suggested Citation

  • A. Iodice D’Enza & A. Markos & F. Palumbo, 2022. "Chunk-wise regularised PCA-based imputation of missing data," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 31(2), pages 365-386, June.
    • Handle: RePEc:spr:stmapp:v:31:y:2022:i:2:d:10.1007_s10260-021-00575-5
    DOI: 10.1007/s10260-021-00575-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10260-021-00575-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10260-021-00575-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Henk Kiers, 1997. "Weighted least squares fitting using ordinary least squares algorithms," Psychometrika, Springer;The Psychometric Society, vol. 62(2), pages 251-266, June.
    2. P. Robert & Y. Escoufier, 1976. "A Unifying Tool for Linear Multivariate Statistical Methods: The RV‐Coefficient," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 25(3), pages 257-265, November.
    3. Marco Geraci & Alessio Farcomeni, 2016. "Probabilistic principal component analysis to identify profiles of physical activity behaviours in the presence of non-ignorable missing data," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 65(1), pages 51-75, January.
    4. Sébastien Loisel & Yoshio Takane, 2019. "Comparisons among several methods for handling missing data in principal component analysis (PCA)," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 13(2), pages 495-518, June.
    5. Hervé Cardot & David Degras, 2018. "Online Principal Component Analysis in High Dimension: Which Algorithm to Choose?," International Statistical Review, International Statistical Institute, vol. 86(1), pages 29-50, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Qing Li & Long Hai Vo, 2021. "Intangible Capital and Innovation: An Empirical Analysis of Vietnamese Enterprises," Economics Discussion / Working Papers 21-02, The University of Western Australia, Department of Economics.
    2. Joost Ginkel & Pieter Kroonenberg, 2014. "Using Generalized Procrustes Analysis for Multiple Imputation in Principal Component Analysis," Journal of Classification, Springer;The Classification Society, vol. 31(2), pages 242-269, July.
    3. Cling, Jean-Pierre & Delecourt, Clément, 2022. "Interlinkages between the Sustainable Development Goals," World Development Perspectives, Elsevier, vol. 25(C).
    4. Delimiro Visbal-Cadavid & Mónica Martínez-Gómez & Rolando Escorcia-Caballero, 2020. "Exploring University Performance through Multiple Factor Analysis: A Case Study," Sustainability, MDPI, vol. 12(3), pages 1-24, January.
    5. Florence Jacquet & A Aboul-Naga & Bernard Hubert, 2020. "The contribution of ARIMNet to address livestock systems resilience in the Mediterranean region," Post-Print hal-03625860, HAL.
    6. Rauf Ahmad, M., 2019. "A significance test of the RV coefficient in high dimensions," Computational Statistics & Data Analysis, Elsevier, vol. 131(C), pages 116-130.
    7. Grothe, Oliver & Schnieders, Julius & Segers, Johan, 2013. "Measuring Association and Dependence Between Random Vectors," LIDAM Discussion Papers ISBA 2013026, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    8. Camila Kolling & José Luis Duarte Ribeiro & Donato Morea & Gianpaolo Iazzolino, 2023. "Corporate social responsibility and circular economy from the perspective of consumers: A cross‐cultural analysis in the cosmetic industry," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 30(3), pages 1226-1243, May.
    9. Ziwei Zhu & Tengyao Wang & Richard J. Samworth, 2022. "High‐dimensional principal component analysis with heterogeneous missingness," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(5), pages 2000-2031, November.
    10. Dorota Toczydlowska & Gareth W. Peters, 2018. "Financial Big Data Solutions for State Space Panel Regression in Interest Rate Dynamics," Econometrics, MDPI, vol. 6(3), pages 1-45, July.
    11. Namgil Lee & Jong-Min Kim, 2018. "Block tensor train decomposition for missing data estimation," Statistical Papers, Springer, vol. 59(4), pages 1283-1305, December.
    12. Haouès-Jouve Sinda & Lemonsu Aude & Gauvrau Benoit & Amossé Alexandre & Can Arnaud & Carrissimo Bertrand & Gaudio Noémie & Hidalgo Julia & Lopez-Rieu Claudia & Chouillou Delphine & Richard Isabelle, 2022. "Cross-analysis for the assessment of urban environmental quality: An interdisciplinary and participative approach," Environment and Planning B, , vol. 49(3), pages 1024-1047, March.
    13. Michailidis, George & De Leeuw, Jan, 2005. "Homogeneity analysis using absolute deviations," Computational Statistics & Data Analysis, Elsevier, vol. 48(3), pages 587-603, March.
    14. Jean-Pierre Rossi & Maxime Nardin & Martin Godefroid & Manuela Ruiz-Diaz & Anne-Sophie Sergent & Alejandro Martinez-Meier & Luc Pâques & Philippe Rozenberg, 2014. "Dissecting the Space-Time Structure of Tree-Ring Datasets Using the Partial Triadic Analysis," PLOS ONE, Public Library of Science, vol. 9(9), pages 1-13, September.
    15. Mordant, Gilles & Segers, Johan, 2022. "Measuring dependence between random vectors via optimal transport," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    16. Marcon, Arthur & Ribeiro, José Luis Duarte & Olteanu, Yasmin & Fichter, Klaus, 2024. "How the interplay between innovation ecosystems and market contingency factors impacts startup innovation," Technology in Society, Elsevier, vol. 76(C).
    17. Sneha Vishwanath & Alexandre G de Brevern & Narayanaswamy Srinivasan, 2018. "Same but not alike: Structure, flexibility and energetics of domains in multi-domain proteins are influenced by the presence of other domains," PLOS Computational Biology, Public Library of Science, vol. 14(2), pages 1-26, February.
    18. Monnez, Jean-Marie & Skiredj, Abderrahman, 2021. "Widening the scope of an eigenvector stochastic approximation process and application to streaming PCA and related methods," Journal of Multivariate Analysis, Elsevier, vol. 182(C).
    19. Josse, Julie & Husson, François, 2016. "missMDA: A Package for Handling Missing Values in Multivariate Data Analysis," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 70(i01).
    20. Mansooreh Kazemilari & Maman Abdurachman Djauhari & Zuhaimy Ismail, 2016. "Foreign Exchange Market Performance: Evidence from Bivariate Time Series Approach," Papers 1608.07694, arXiv.org.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:stmapp:v:31:y:2022:i:2:d:10.1007_s10260-021-00575-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.