IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v9y2021i9p1017-d546884.html
   My bibliography  Save this article

Learning Neural Representations and Local Embedding for Nonlinear Dimensionality Reduction Mapping

Author

Listed:
  • Sheng-Shiung Wu

    (Department of Applied Mathematics, National Dong Hwa University, Hualien 947301, Taiwan)

  • Sing-Jie Jong

    (Department of Applied Mathematics, National Dong Hwa University, Hualien 947301, Taiwan)

  • Kai Hu

    (Department of Applied Mathematics, National Dong Hwa University, Hualien 947301, Taiwan)

  • Jiann-Ming Wu

    (Department of Applied Mathematics, National Dong Hwa University, Hualien 947301, Taiwan)

Abstract

This work explores neural approximation for nonlinear dimensionality reduction mapping based on internal representations of graph-organized regular data supports. Given training observations are assumed as a sample from a high-dimensional space with an embedding low-dimensional manifold. An approximating function consisting of adaptable built-in parameters is optimized subject to given training observations by the proposed learning process, and verified for transformation of novel testing observations to images in the low-dimensional output space. Optimized internal representations sketch graph-organized supports of distributed data clusters and their representative images in the output space. On the basis, the approximating function is able to operate for testing without reserving original massive training observations. The neural approximating model contains multiple modules. Each activates a non-zero output for mapping in response to an input inside its correspondent local support. Graph-organized data supports have lateral interconnections for representing neighboring relations, inferring the minimal path between centroids of any two data supports, and proposing distance constraints for mapping all centroids to images in the output space. Following the distance-preserving principle, this work proposes Levenberg-Marquardt learning for optimizing images of centroids in the output space subject to given distance constraints, and further develops local embedding constraints for mapping during execution phase. Numerical simulations show the proposed neural approximation effective and reliable for nonlinear dimensionality reduction mapping.

Suggested Citation

  • Sheng-Shiung Wu & Sing-Jie Jong & Kai Hu & Jiann-Ming Wu, 2021. "Learning Neural Representations and Local Embedding for Nonlinear Dimensionality Reduction Mapping," Mathematics, MDPI, vol. 9(9), pages 1-18, April.
  • Handle: RePEc:gam:jmathe:v:9:y:2021:i:9:p:1017-:d:546884
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/9/9/1017/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/9/9/1017/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Gale Young & A. Householder, 1938. "Discussion of a set of points in terms of their mutual distances," Psychometrika, Springer;The Psychometric Society, vol. 3(1), pages 19-22, March.
    2. Jiarui Ding & Anne Condon & Sohrab P. Shah, 2018. "Interpretable dimensionality reduction of single cell transcriptome data with deep generative models," Nature Communications, Nature, vol. 9(1), pages 1-13, December.
    3. Warren Torgerson, 1952. "Multidimensional scaling: I. Theory and method," Psychometrika, Springer;The Psychometric Society, vol. 17(4), pages 401-419, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Panpan Yu & Qingna Li, 2018. "Ordinal Distance Metric Learning with MDS for Image Ranking," Asia-Pacific Journal of Operational Research (APJOR), World Scientific Publishing Co. Pte. Ltd., vol. 35(01), pages 1-19, February.
    2. Zha, Hongyuan & Zhang, Zhenyue, 2007. "Continuum Isomap for manifold learnings," Computational Statistics & Data Analysis, Elsevier, vol. 52(1), pages 184-200, September.
    3. Si-Tong Lu & Miao Zhang & Qing-Na Li, 2020. "Feasibility and a fast algorithm for Euclidean distance matrix optimization with ordinal constraints," Computational Optimization and Applications, Springer, vol. 76(2), pages 535-569, June.
    4. Malone, Samuel W. & Tarazaga, Pablo & Trosset, Michael W., 2002. "Better initial configurations for metric multidimensional scaling," Computational Statistics & Data Analysis, Elsevier, vol. 41(1), pages 143-156, November.
    5. Michael W. Trosset, 2002. "Extensions of Classical Multidimensional Scaling via Variable Reduction," Computational Statistics, Springer, vol. 17(2), pages 147-163, July.
    6. W. Alan Nicewander & Joseph Lee Rodgers, 2022. "Obituary: Bruce McArthur Bloxom 1938–2020," Psychometrika, Springer;The Psychometric Society, vol. 87(3), pages 1042-1044, September.
    7. Maarten M. Kampert & Jacqueline J. Meulman & Jerome H. Friedman, 2017. "rCOSA: A Software Package for Clustering Objects on Subsets of Attributes," Journal of Classification, Springer;The Classification Society, vol. 34(3), pages 514-547, October.
    8. Trosset, Michael W. & Priebe, Carey E., 2008. "The out-of-sample problem for classical multidimensional scaling," Computational Statistics & Data Analysis, Elsevier, vol. 52(10), pages 4635-4642, June.
    9. Alexander Strehl & Joydeep Ghosh, 2003. "Relationship-Based Clustering and Visualization for High-Dimensional Data Mining," INFORMS Journal on Computing, INFORMS, vol. 15(2), pages 208-230, May.
    10. Fengzhen Zhai & Qingna Li, 2020. "A Euclidean distance matrix model for protein molecular conformation," Journal of Global Optimization, Springer, vol. 76(4), pages 709-728, April.
    11. Walesiak Marek & Dudek Andrzej, 2017. "Selecting the Optimal Multidimensional Scaling Procedure for Metric Data With R Environment," Statistics in Transition New Series, Statistics Poland, vol. 18(3), pages 521-540, September.
    12. Morales José F. & Song Tingting & Auerbach Arleen D. & Wittkowski Knut M., 2008. "Phenotyping Genetic Diseases Using an Extension of µ-Scores for Multivariate Data," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 7(1), pages 1-20, June.
    13. Vicente Gallego & Ramon Oller, 2024. "A Kernel approach for extending nonparametric multivariate analysis of variance in high-dimensional settings," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 33(5), pages 1315-1335, November.
    14. Benjamin B. Risk & David S. Matteson & David Ruppert & Ani Eloyan & Brian S. Caffo, 2014. "An evaluation of independent component analyses with an application to resting-state fMRI," Biometrics, The International Biometric Society, vol. 70(1), pages 224-236, March.
    15. Carter T. Butts & Kathleen M. Carley, 2005. "Some Simple Algorithms for Structural Comparison," Computational and Mathematical Organization Theory, Springer, vol. 11(4), pages 291-305, December.
    16. Raatikainen, Mika & Skön, Jukka-Pekka & Leiviskä, Kauko & Kolehmainen, Mikko, 2016. "Intelligent analysis of energy consumption in school buildings," Applied Energy, Elsevier, vol. 165(C), pages 416-429.
    17. José Luis Ortega Priego, 2003. "A Vector Space Model as a methodological approach to the Triple Helix dimensionality: A comparative study of Biology and Biomedicine Centres of two European National Research Councils from a Webometri," Scientometrics, Springer;Akadémiai Kiadó, vol. 58(2), pages 429-443, October.
    18. Chao Ding & Hou-Duo Qi, 2017. "Convex Euclidean distance embedding for collaborative position localization with NLOS mitigation," Computational Optimization and Applications, Springer, vol. 66(1), pages 187-218, January.
    19. Jenny Assi & Mario Lucchini & Amedeo Spagnolo, 2012. "Mapping patterns of well-being and quality of life in extended Europe," International Review of Economics, Springer;Happiness Economics and Interpersonal Relations (HEIRS), vol. 59(4), pages 409-430, December.
    20. Meller, Barbara & Metiu, Norbert, 2015. "The synchronization of European credit cycles," Discussion Papers 20/2015, Deutsche Bundesbank.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:9:y:2021:i:9:p:1017-:d:546884. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.