IDEAS home Printed from https://ideas.repec.org/a/bla/istatr/v91y2023i1p140-161.html
   My bibliography  Save this article

A Computational Perspective on Projection Pursuit in High Dimensions: Feasible or Infeasible Feature Extraction

Author

Listed:
  • Chunming Zhang
  • Jimin Ye
  • Xiaomei Wang

Abstract

Finding a suitable representation of multivariate data is fundamental in many scientific disciplines. Projection pursuit ( PP) aims to extract interesting ‘non‐Gaussian’ features from multivariate data, and tends to be computationally intensive even when applied to data of low dimension. In high‐dimensional settings, a recent work (Bickel et al., 2018) on PP addresses asymptotic characterization and conjectures of the feasible projections as the dimension grows with sample size. To gain practical utility of and learn theoretical insights into PP in an integral way, data analytic tools needed to evaluate the behaviour of PP in high dimensions become increasingly desirable but are less explored in the literature. This paper focuses on developing computationally fast and effective approaches central to finite sample studies for (i) visualizing the feasibility of PP in extracting features from high‐dimensional data, as compared with alternative methods like PCA and ICA, and (ii) assessing the plausibility of PP in cases where asymptotic studies are lacking or unavailable, with the goal of better understanding the practicality, limitation and challenge of PP in the analysis of large data sets.

Suggested Citation

  • Chunming Zhang & Jimin Ye & Xiaomei Wang, 2023. "A Computational Perspective on Projection Pursuit in High Dimensions: Feasible or Infeasible Feature Extraction," International Statistical Review, International Statistical Institute, vol. 91(1), pages 140-161, April.
  • Handle: RePEc:bla:istatr:v:91:y:2023:i:1:p:140-161
    DOI: 10.1111/insr.12517
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/insr.12517
    Download Restriction: no

    File URL: https://libkey.io/10.1111/insr.12517?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Justel, Ana & Peña, Daniel & Zamar, Rubén, 1997. "A multivariate Kolmogorov-Smirnov test of goodness of fit," Statistics & Probability Letters, Elsevier, vol. 35(3), pages 251-259, October.
    2. Loperfido, Nicola, 2018. "Skewness-based projection pursuit: A computational approach," Computational Statistics & Data Analysis, Elsevier, vol. 120(C), pages 42-57.
    3. Posse, Christian, 1995. "Projection pursuit exploratory data analysis," Computational Statistics & Data Analysis, Elsevier, vol. 20(6), pages 669-687, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ursula Laa & Dianne Cook, 2020. "Using tours to visually investigate properties of new projection pursuit indexes with application to problems in physics," Computational Statistics, Springer, vol. 35(3), pages 1171-1205, September.
    2. Carole Bernard & Oleg Bondarenko & Steven Vanduffel, 2021. "A model-free approach to multivariate option pricing," Review of Derivatives Research, Springer, vol. 24(2), pages 135-155, July.
    3. Jie Shi & Arno P. J. M. Siebes & Siamak Mehrkanoon, 2023. "TransCORALNet: A Two-Stream Transformer CORAL Networks for Supply Chain Credit Assessment Cold Start," Papers 2311.18749, arXiv.org.
    4. Loperfido, Nicola, 2021. "Some theoretical properties of two kurtosis matrices, with application to invariant coordinate selection," Journal of Multivariate Analysis, Elsevier, vol. 186(C).
    5. Daniel Rojas-Diaz & Alexandra Catano-Lopez & Carlos M. Vélez & Santiago Ortiz & Henry Laniado, 2024. "Confidence sub-contour box: an alternative to traditional confidence intervals," Computational Statistics, Springer, vol. 39(5), pages 2821-2858, July.
    6. Lee, Sharon X. & McLachlan, Geoffrey J., 2022. "An overview of skew distributions in model-based clustering," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    7. Loperfido, Nicola, 2018. "Skewness-based projection pursuit: A computational approach," Computational Statistics & Data Analysis, Elsevier, vol. 120(C), pages 42-57.
    8. Squalli, Jay, 2017. "Renewable energy, coal as a baseload power source, and greenhouse gas emissions: Evidence from U.S. state-level data," Energy, Elsevier, vol. 127(C), pages 479-488.
    9. Chiragiev, Arthur & Landsman, Zinoviy, 2009. "Multivariate flexible Pareto model: Dependency structure, properties and characterizations," Statistics & Probability Letters, Elsevier, vol. 79(16), pages 1733-1743, August.
    10. Torri, Gabriele & Giacometti, Rosella & Paterlini, Sandra, 2018. "Robust and sparse banking network estimation," European Journal of Operational Research, Elsevier, vol. 270(1), pages 51-65.
    11. Yue, Zenghui & Xu, Haiyun & Yuan, Guoting & Pang, Hongshen, 2019. "Modeling study of knowledge diffusion in scientific collaboration networks based on differential dynamics: A case study in graphene field," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 524(C), pages 375-391.
    12. Shushi, Tomer, 2018. "A proof for the existence of multivariate singular generalized skew-elliptical density functions," Statistics & Probability Letters, Elsevier, vol. 141(C), pages 50-55.
    13. Langrené, Nicolas & Warin, Xavier, 2021. "Fast multivariate empirical cumulative distribution function with connection to kernel density estimation," Computational Statistics & Data Analysis, Elsevier, vol. 162(C).
    14. Nicola Loperfido, 2019. "Finite mixtures, projection pursuit and tensor rank: a triangulation," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 13(1), pages 145-173, March.
    15. Cheng, Qixiu & Lin, Yuqian & Zhou, Xuesong (Simon) & Liu, Zhiyuan, 2024. "Analytical formulation for explaining the variations in traffic states: A fundamental diagram modeling perspective with stochastic parameters," European Journal of Operational Research, Elsevier, vol. 312(1), pages 182-197.
    16. Abdi, Me’raj & Madadi, Mohsen & Balakrishnan, Narayanaswamy & Jamalizadeh, Ahad, 2021. "Family of mean-mixtures of multivariate normal distributions: Properties, inference and assessment of multivariate skewness," Journal of Multivariate Analysis, Elsevier, vol. 181(C).
    17. R. N. Rattihalli, 2023. "A Class of Multivariate Power Skew Symmetric Distributions: Properties and Inference for the Power-Parameter," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 85(2), pages 1356-1393, August.
    18. Zuliqar Ali & Ijaz Hussain & Muhammad Faisal & Hafiza Mamona Nazir & Mitwali Abd-el Moemen & Tajammal Hussain & Sadaf Shamsuddin, 2017. "A Novel Multi-Scalar Drought Index for Monitoring Drought: the Standardized Precipitation Temperature Index," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 31(15), pages 4957-4969, December.
    19. Jean-David Fermanian, 2003. "Goodness of Fit Tests for Copulas," Working Papers 2003-34, Center for Research in Economics and Statistics.
    20. Abul Kalam Azad & Mohammad Golam Rasul & Talal Yusaf, 2014. "Statistical Diagnosis of the Best Weibull Methods for Wind Power Assessment for Agricultural Applications," Energies, MDPI, vol. 7(5), pages 1-30, May.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:istatr:v:91:y:2023:i:1:p:140-161. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/isiiinl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.