IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v54y2010i12p3095-3107.html
   My bibliography  Save this article

Imputation of missing values for compositional data using classical and robust methods

Author

Listed:
  • Hron, K.
  • Templ, M.
  • Filzmoser, P.

Abstract

New imputation algorithms for estimating missing values in compositional data are introduced. A first proposal uses the k-nearest neighbor procedure based on the Aitchison distance, a distance measure especially designed for compositional data. It is important to adjust the estimated missing values to the overall size of the compositional parts of the neighbors. As a second proposal an iterative model-based imputation technique is introduced which initially starts from the result of the proposed k-nearest neighbor procedure. The method is based on iterative regressions, thereby accounting for the whole multivariate data information. The regressions have to be performed in a transformed space, and depending on the data quality classical or robust regression techniques can be employed. The proposed methods are tested on a real and on simulated data sets. The results show that the proposed methods outperform standard imputation methods. In the presence of outliers, the model-based method with robust regressions is preferable.

Suggested Citation

  • Hron, K. & Templ, M. & Filzmoser, P., 2010. "Imputation of missing values for compositional data using classical and robust methods," Computational Statistics & Data Analysis, Elsevier, vol. 54(12), pages 3095-3107, December.
    • Handle: RePEc:eee:csdana:v:54:y:2010:i:12:p:3095-3107
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167-9473(09)00436-8
    Download Restriction: Full text for ScienceDirect subscribers only.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yucel, Recai M. & Demirtas, Hakan, 2010. "Impact of non-normal random effects on inference by multiple imputation: A simulation assessment," Computational Statistics & Data Analysis, Elsevier, vol. 54(3), pages 790-801, March.
    2. Michael E. Tipping & Christopher M. Bishop, 1999. "Probabilistic Principal Component Analysis," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(3), pages 611-622.
    3. Serneels, Sven & Verdonck, Tim, 2008. "Principal component analysis for data containing outliers and missing elements," Computational Statistics & Data Analysis, Elsevier, vol. 52(3), pages 1712-1727, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. K. Hron & P. Filzmoser & K. Thompson, 2012. "Linear regression with compositional explanatory variables," Journal of Applied Statistics, Taylor & Francis Journals, vol. 39(5), pages 1115-1128, November.
    2. Nikola Štefelová & Andreas Alfons & Javier Palarea-Albaladejo & Peter Filzmoser & Karel Hron, 2021. "Robust regression with compositional covariates including cellwise outliers," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 15(4), pages 869-909, December.
    3. Maria Anna Di Palma & Michele Gallo, 2019. "External Information Model in a Compositional Perspective: Evaluation of Campania Adolescents’ Preferences in the Allocation of Leisure-Time," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 146(1), pages 117-133, November.
    4. Peter Filzmoser & Karel Hron & Matthias Templ, 2012. "Discriminant analysis for compositional data and robust parameter estimation," Computational Statistics, Springer, vol. 27(4), pages 585-604, December.
    5. Templ, Matthias & Kowarik, Alexander & Filzmoser, Peter, 2011. "Iterative stepwise regression imputation using standard and robust methods," Computational Statistics & Data Analysis, Elsevier, vol. 55(10), pages 2793-2806, October.
    6. Takahiro Yoshida & Morito Tsutsumi, 2018. "On the effects of spatial relationships in spatial compositional multivariate models," Letters in Spatial and Resource Sciences, Springer, vol. 11(1), pages 57-70, March.
    7. M. A. Di Palma & M. Gallo, 2016. "A co-median approach to detect compositional outliers," Journal of Applied Statistics, Taylor & Francis Journals, vol. 43(13), pages 2348-2362, October.
    8. repec:jss:jstsof:37:i03 is not listed on IDEAS
    9. Mark A. Engle & Charles W. Nye & Ghanashyam Neupane & Scott A. Quillinan & Jonathan Fred McLaughlin & Travis McLing & Josep A. Martín-Fernández, 2022. "Predicting Rare Earth Element Potential in Produced and Geothermal Waters of the United States via Emergent Self-Organizing Maps," Energies, MDPI, vol. 15(13), pages 1-21, June.
    10. Garrido-Vega, Pedro & Ortega Jimenez, Cesar H. & de los Ríos, José Luis Díez Pérez & Morita, Michiya, 2015. "Implementation of technology and production strategy practices: Relationship levels in different industries," International Journal of Production Economics, Elsevier, vol. 161(C), pages 201-216.
    11. Martín-Fernández, J.A. & Hron, K. & Templ, M. & Filzmoser, P. & Palarea-Albaladejo, J., 2012. "Model-based replacement of rounded zeros in compositional data: Classical and robust approaches," Computational Statistics & Data Analysis, Elsevier, vol. 56(9), pages 2688-2704.
    12. Tutz, Gerhard & Ramzan, Shahla, 2015. "Improved methods for the imputation of missing data by nearest neighbor methods," Computational Statistics & Data Analysis, Elsevier, vol. 90(C), pages 84-99.
    13. Frahm, Gabriel & Nordhausen, Klaus & Oja, Hannu, 2020. "M-estimation with incomplete and dependent multivariate data," Journal of Multivariate Analysis, Elsevier, vol. 176(C).
    14. Hazen, Benjamin T. & Overstreet, Robert E. & Jones-Farmer, L. Allison & Field, Hubert S., 2012. "The role of ambiguity tolerance in consumer perception of remanufactured products," International Journal of Production Economics, Elsevier, vol. 135(2), pages 781-790.
    15. Elena Catanese, 2016. "Data Editing for Complex Surveys in Presence Of Administrative Data: An Application to Fss 2013 Livestock Survey Data Based on The Joint Sequential Use Of Different R Packages," Romanian Statistical Review, Romanian Statistical Review, vol. 64(2), pages 101-117, June.
    16. M. Templ & K. Hron & P. Filzmoser, 2017. "Exploratory tools for outlier detection in compositional data with structural zeros," Journal of Applied Statistics, Taylor & Francis Journals, vol. 44(4), pages 734-752, March.
    17. Matthias Templ & Andreas Alfons & Peter Filzmoser, 2012. "Exploring incomplete data using visualization techniques," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 6(1), pages 29-47, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sébastien Loisel & Yoshio Takane, 2019. "Comparisons among several methods for handling missing data in principal component analysis (PCA)," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 13(2), pages 495-518, June.
    2. Wang, Zihan & Daeipour, Mohamad & Xu, Hongyi, 2023. "Quantification and propagation of Aleatoric uncertainties in topological structures," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    3. Matteo Barigozzi & Matteo Luciani, 2024. "Quasi Maximum Likelihood Estimation and Inference of Large Approximate Dynamic Factor Models via the EM algorithm," Finance and Economics Discussion Series 2024-086, Board of Governors of the Federal Reserve System (U.S.).
    4. Xin Xu & Yang Lu & Yupeng Zhou & Zhiguo Fu & Yanjie Fu & Minghao Yin, 2021. "An Information-Explainable Random Walk Based Unsupervised Network Representation Learning Framework on Node Classification Tasks," Mathematics, MDPI, vol. 9(15), pages 1-14, July.
    5. Dorota Toczydlowska & Gareth W. Peters & Man Chung Fung & Pavel V. Shevchenko, 2017. "Stochastic Period and Cohort Effect State-Space Mortality Models Incorporating Demographic Factors via Probabilistic Robust Principal Components," Risks, MDPI, vol. 5(3), pages 1-77, July.
    6. Matteo Barigozzi & Marc Hallin, 2023. "Dynamic Factor Models: a Genealogy," Papers 2310.17278, arXiv.org, revised Jan 2024.
    7. Chen, Tao & Martin, Elaine & Montague, Gary, 2009. "Robust probabilistic PCA with missing data and contribution analysis for outlier detection," Computational Statistics & Data Analysis, Elsevier, vol. 53(10), pages 3706-3716, August.
    8. Chen, Andrew Y. & McCoy, Jack, 2024. "Missing values handling for machine learning portfolios," Journal of Financial Economics, Elsevier, vol. 155(C).
    9. Wang, Shao-Hsuan & Huang, Su-Yun, 2022. "Perturbation theory for cross data matrix-based PCA," Journal of Multivariate Analysis, Elsevier, vol. 190(C).
    10. Cook, R. Dennis, 2022. "A slice of multivariate dimension reduction," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    11. Wentao Qu & Xianchao Xiu & Huangyue Chen & Lingchen Kong, 2023. "A Survey on High-Dimensional Subspace Clustering," Mathematics, MDPI, vol. 11(2), pages 1-39, January.
    12. Ligon, Ethan, 2017. "Estimating household welfare from disaggregate expenditures," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt5gc4h1fm, Department of Agricultural & Resource Economics, UC Berkeley.
    13. Jiaju Miao & Pawel Polak, 2023. "Online Ensemble of Models for Optimal Predictive Performance with Applications to Sector Rotation Strategy," Papers 2304.09947, arXiv.org.
    14. Marconi, Gabriele, 2014. "European higher education policies and the problem of estimating a complex model with a small cross-section," MPRA Paper 87600, University Library of Munich, Germany.
    15. Jingying Yang, 2024. "Element Aggregation for Estimation of High-Dimensional Covariance Matrices," Mathematics, MDPI, vol. 12(7), pages 1-16, March.
    16. Jingtao Wang & Gregory J. Fonseca & Jun Ding, 2024. "scSemiProfiler: Advancing large-scale single-cell studies through semi-profiling with deep generative models and active learning," Nature Communications, Nature, vol. 15(1), pages 1-27, December.
    17. Dorota Toczydlowska & Gareth W. Peters, 2018. "Financial Big Data Solutions for State Space Panel Regression in Interest Rate Dynamics," Econometrics, MDPI, vol. 6(3), pages 1-45, July.
    18. Jung, WoongHee & Taflanidis, Alexandros A., 2023. "Efficient global sensitivity analysis for high-dimensional outputs combining data-driven probability models and dimensionality reduction," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    19. Frahm, Gabriel & Jaekel, Uwe, 2010. "A generalization of Tyler's M-estimators to the case of incomplete data," Computational Statistics & Data Analysis, Elsevier, vol. 54(2), pages 374-393, February.
    20. Matteo Barigozzi, 2023. "Asymptotic equivalence of Principal Components and Quasi Maximum Likelihood estimators in Large Approximate Factor Models," Papers 2307.09864, arXiv.org, revised Jun 2024.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:54:y:2010:i:12:p:3095-3107. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.