IDEAS home Printed from https://ideas.repec.org/a/taf/jnlasa/v110y2015i509p218-232.html
   My bibliography  Save this article

R -Estimation for Asymmetric Independent Component Analysis

Author

Listed:
  • Marc Hallin
  • Chintan Mehta

Abstract

Independent component analysis (ICA) recently has attracted much attention in the statistical literature as an appealing alternative to elliptical models. Whereas k -dimensional elliptical densities depend on one single unspecified radial density, however, k -dimensional independent component distributions involve k unspecified component densities. In practice, for given sample size n and dimension k , this makes the statistical analysis much harder. We focus here on the estimation, from an independent sample, of the mixing/demixing matrix of the model. Traditional methods (FOBI, Kernel-ICA, FastICA) mainly originate from the engineering literature. Their consistency requires moment conditions, they are poorly robust, and do not achieve any type of asymptotic efficiency. When based on robust scatter matrices, the two-scatter methods developed by Oja, Sirkia, and Eriksson in 2006 and Nordhausen, Oja, and Ollila in 2008 enjoy better robustness features, but their optimality properties remain unclear. The "classical semiparametric" approach by Chen and Bickel in 2006, quite on the contrary, achieves semiparametric efficiency, but requires the estimation of the densities of the k unobserved independent components. As a reaction, an efficient (signed-)rank-based approach was proposed by Ilmonen and Paindaveine in 2011 for the case of symmetric component densities. The performance of their estimators is quite good, but they unfortunately fail to be root- n consistent as soon as one of the component densities violates the symmetry assumption. In this article, using ranks rather than signed ranks, we extend their approach to the asymmetric case and propose a one-step R -estimator for ICA mixing matrices. The finite-sample performances of those estimators are investigated and compared to those of existing methods under moderately large sample sizes. Particularly good performances are obtained from a version involving data-driven scores taking into account the skewness and kurtosis of residuals. Finally, we show, by an empirical exercise, that our methods also may provide excellent results in a context such as image analysis, where the basic assumptions of ICA are quite unlikely to hold. Supplementary materials for this article are available online.

Suggested Citation

  • Marc Hallin & Chintan Mehta, 2015. "R -Estimation for Asymmetric Independent Component Analysis," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 218-232, March.
  • Handle: RePEc:taf:jnlasa:v:110:y:2015:i:509:p:218-232
    DOI: 10.1080/01621459.2014.909316
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/01621459.2014.909316
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1080/01621459.2014.909316?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Marc Hallin & Bas Werker, 2003. "Semiparametric efficiency, distribution-freeness, and invariance," ULB Institutional Repository 2013/2119, ULB -- Universite Libre de Bruxelles.
    2. Sirkku Pauliina Ilmonen & Davy Paindaveine, 2011. "Semiparametrically Efficient Inference Based on Signed Ranks in Symmetric Independent Component Models," Working Papers ECARES ECARES 2011-003, ULB -- Universite Libre de Bruxelles.
    3. Delphine Cassart & Marc Hallin & Davy Paindaveine, 2010. "On the estimation of cross-information quantities in rank-based inference," Working Papers ECARES ECARES 2010-010, ULB -- Universite Libre de Bruxelles.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hallin, Marc & La Vecchia, Davide, 2020. "A Simple R-estimation method for semiparametric duration models," Journal of Econometrics, Elsevier, vol. 218(2), pages 736-749.
    2. Bernd Funovits, 2019. "Identification and Estimation of SVARMA models with Independent and Non-Gaussian Inputs," Papers 1910.04087, arXiv.org.
    3. Hallin, Marc & La Vecchia, Davide, 2017. "R-estimation in semiparametric dynamic location-scale models," Journal of Econometrics, Elsevier, vol. 196(2), pages 233-247.
    4. Lee, Seonjoo & Shen, Haipeng & Truong, Young, 2021. "Sampling properties of color Independent Component Analysis," Journal of Multivariate Analysis, Elsevier, vol. 181(C).
    5. Funovits, Bernd, 2024. "Identifiability and estimation of possibly non-invertible SVARMA Models: The normalised canonical WHF parametrisation," Journal of Econometrics, Elsevier, vol. 241(2).
    6. Jari Miettinen & Katrin Illner & Klaus Nordhausen & Hannu Oja & Sara Taskinen & Fabian J. Theis, 2016. "Separation of Uncorrelated Stationary time series using Autocovariance Matrices," Journal of Time Series Analysis, Wiley Blackwell, vol. 37(3), pages 337-354, May.
    7. Geert Mesters & Piotr Zwiernik, 2022. "Non-Independent Components Analysis," Working Papers 1358, Barcelona School of Economics.
    8. Lanne, Markku & Meitz, Mika & Saikkonen, Pentti, 2017. "Identification and estimation of non-Gaussian structural vector autoregressions," Journal of Econometrics, Elsevier, vol. 196(2), pages 288-304.
    9. Hallin, M. & Werker, B.J.M. & van den Akker, R., 2015. "Optimal Pseudo-Gaussian and Rank-based Tests of the Cointegration Rank in Semiparametric Error-correction Models," Discussion Paper 2015-001, Tilburg University, Center for Economic Research.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. M. Hallin & D. La Vecchia & H. Liu, 2022. "Center-Outward R-Estimation for Semiparametric VARMA Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 117(538), pages 925-938, April.
    2. Hallin, Marc & La Vecchia, Davide, 2017. "R-estimation in semiparametric dynamic location-scale models," Journal of Econometrics, Elsevier, vol. 196(2), pages 233-247.
    3. Delphine Cassart & Marc Hallin & Davy Paindaveine, 2014. "Optimal Rank Tests for Symmetry against Edgeworth-Type Alternatives," Working Papers ECARES ECARES 2014-48, ULB -- Universite Libre de Bruxelles.
    4. Marc Hallin & Davide La Vecchia, 2014. "Semiparametrically Efficient R-Estimation for Dynamic Location-Scale Models," Working Papers ECARES ECARES 2014-45, ULB -- Universite Libre de Bruxelles.
    5. Hallin, Marc & La Vecchia, Davide, 2020. "A Simple R-estimation method for semiparametric duration models," Journal of Econometrics, Elsevier, vol. 218(2), pages 736-749.
    6. Werker, Bas J.M. & Zhou, B., 2022. "Semiparametric testing with highly persistent predictors," Other publications TiSEM 2974ce9c-97c1-44cd-9331-0, Tilburg University, School of Economics and Management.
    7. Victor Chernozhukov & Alfred Galichon & Marc Hallin & Marc Henry, 2014. "Monge-Kantorovich Depth, Quantiles, Ranks, and Signs," Papers 1412.8434, arXiv.org, revised Sep 2015.
    8. Victor Chernozhukov & Alfred Galichon & Marc Hallin & Marc Henry, 2014. "Monge-Kantorovich Depth, Quantiles, Ranks, and Signs," Papers 1412.8434, arXiv.org, revised Sep 2015.
    9. Andreou, E. & Werker, B.J.M., 2003. "A Simple Asymptotic Analysis of Residual-Based Statistics," Other publications TiSEM 9fe68e51-a026-4660-b6e7-8, Tilburg University, School of Economics and Management.
    10. Lanne, Markku & Meitz, Mika & Saikkonen, Pentti, 2017. "Identification and estimation of non-Gaussian structural vector autoregressions," Journal of Econometrics, Elsevier, vol. 196(2), pages 288-304.
    11. Werker, Bas J.M. & Zhou, Bo, 2022. "Semiparametric testing with highly persistent predictors," Journal of Econometrics, Elsevier, vol. 227(2), pages 347-370.
    12. Andreou, Elena & Werker, Bas J.M., 2015. "Residual-based rank specification tests for AR–GARCH type models," Journal of Econometrics, Elsevier, vol. 185(2), pages 305-331.
    13. Chen, Xiaohong & Huang, Zhuo & Yi, Yanping, 2021. "Efficient estimation of multivariate semi-nonparametric GARCH filtered copula models," Journal of Econometrics, Elsevier, vol. 222(1), pages 484-501.
    14. Andreou, E. & Werker, B.J.M., 2004. "An Alternative Asymptotic Analysis of Residual-Based Statistics," Other publications TiSEM 93fe16c1-9f21-4dab-9b73-4, Tilburg University, School of Economics and Management.
    15. Marc Hallin & Catherine Vermandele & Bas J. M. Werker, 2008. "Semiparametrically efficient inference based on signs and ranks for median‐restricted models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(2), pages 389-412, April.
    16. Francq, Christian & Jiménez Gamero, Maria Dolores & Meintanis, Simos, 2015. "Tests for sphericity in multivariate garch models," MPRA Paper 67411, University Library of Munich, Germany.
    17. Hallin, M. & Vermandele, C. & Werker, B.J.M., 2003. "Serial and Nonserial Sign-and-Rank Statistics : Asymptotic Representation and Asymptotic Normality," Discussion Paper 2003-23, Tilburg University, Center for Economic Research.
    18. Davy Paindaveine & Germain Van Bever, 2017. "Halfspace Depths for Scatter, Concentration and Shape Matrices," Working Papers ECARES ECARES 2017-19, ULB -- Universite Libre de Bruxelles.
    19. Hallin, M. & van den Akker, R. & Werker, B.J.M., 2012. "Rank-based Tests of the Cointegrating Rank in Semiparametric Error Correction Models," Other publications TiSEM bc68a2f2-3ca3-443c-b3ac-f, Tilburg University, School of Economics and Management.
    20. Nezar Bennala & Marc Hallin & Davy Paindaveine, 2010. "Rank‐based Optimal Tests for Random Effects in Panel Data," Working Papers ECARES ECARES 2010-018, ULB -- Universite Libre de Bruxelles.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:jnlasa:v:110:y:2015:i:509:p:218-232. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/UASA20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.