IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v9y2021i9p1017-d546884.html
   My bibliography  Save this article

Learning Neural Representations and Local Embedding for Nonlinear Dimensionality Reduction Mapping

Author

Listed:
  • Sheng-Shiung Wu

    (Department of Applied Mathematics, National Dong Hwa University, Hualien 947301, Taiwan)

  • Sing-Jie Jong

    (Department of Applied Mathematics, National Dong Hwa University, Hualien 947301, Taiwan)

  • Kai Hu

    (Department of Applied Mathematics, National Dong Hwa University, Hualien 947301, Taiwan)

  • Jiann-Ming Wu

    (Department of Applied Mathematics, National Dong Hwa University, Hualien 947301, Taiwan)

Abstract

This work explores neural approximation for nonlinear dimensionality reduction mapping based on internal representations of graph-organized regular data supports. Given training observations are assumed as a sample from a high-dimensional space with an embedding low-dimensional manifold. An approximating function consisting of adaptable built-in parameters is optimized subject to given training observations by the proposed learning process, and verified for transformation of novel testing observations to images in the low-dimensional output space. Optimized internal representations sketch graph-organized supports of distributed data clusters and their representative images in the output space. On the basis, the approximating function is able to operate for testing without reserving original massive training observations. The neural approximating model contains multiple modules. Each activates a non-zero output for mapping in response to an input inside its correspondent local support. Graph-organized data supports have lateral interconnections for representing neighboring relations, inferring the minimal path between centroids of any two data supports, and proposing distance constraints for mapping all centroids to images in the output space. Following the distance-preserving principle, this work proposes Levenberg-Marquardt learning for optimizing images of centroids in the output space subject to given distance constraints, and further develops local embedding constraints for mapping during execution phase. Numerical simulations show the proposed neural approximation effective and reliable for nonlinear dimensionality reduction mapping.

Suggested Citation

  • Sheng-Shiung Wu & Sing-Jie Jong & Kai Hu & Jiann-Ming Wu, 2021. "Learning Neural Representations and Local Embedding for Nonlinear Dimensionality Reduction Mapping," Mathematics, MDPI, vol. 9(9), pages 1-18, April.
  • Handle: RePEc:gam:jmathe:v:9:y:2021:i:9:p:1017-:d:546884
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/9/9/1017/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/9/9/1017/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Gale Young & A. Householder, 1938. "Discussion of a set of points in terms of their mutual distances," Psychometrika, Springer;The Psychometric Society, vol. 3(1), pages 19-22, March.
    2. Warren Torgerson, 1952. "Multidimensional scaling: I. Theory and method," Psychometrika, Springer;The Psychometric Society, vol. 17(4), pages 401-419, December.
    3. Jiarui Ding & Anne Condon & Sohrab P. Shah, 2018. "Interpretable dimensionality reduction of single cell transcriptome data with deep generative models," Nature Communications, Nature, vol. 9(1), pages 1-13, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. W. Alan Nicewander & Joseph Lee Rodgers, 2022. "Obituary: Bruce McArthur Bloxom 1938–2020," Psychometrika, Springer;The Psychometric Society, vol. 87(3), pages 1042-1044, September.
    2. Panpan Yu & Qingna Li, 2018. "Ordinal Distance Metric Learning with MDS for Image Ranking," Asia-Pacific Journal of Operational Research (APJOR), World Scientific Publishing Co. Pte. Ltd., vol. 35(01), pages 1-19, February.
    3. Zha, Hongyuan & Zhang, Zhenyue, 2007. "Continuum Isomap for manifold learnings," Computational Statistics & Data Analysis, Elsevier, vol. 52(1), pages 184-200, September.
    4. Maarten M. Kampert & Jacqueline J. Meulman & Jerome H. Friedman, 2017. "rCOSA: A Software Package for Clustering Objects on Subsets of Attributes," Journal of Classification, Springer;The Classification Society, vol. 34(3), pages 514-547, October.
    5. Si-Tong Lu & Miao Zhang & Qing-Na Li, 2020. "Feasibility and a fast algorithm for Euclidean distance matrix optimization with ordinal constraints," Computational Optimization and Applications, Springer, vol. 76(2), pages 535-569, June.
    6. Malone, Samuel W. & Tarazaga, Pablo & Trosset, Michael W., 2002. "Better initial configurations for metric multidimensional scaling," Computational Statistics & Data Analysis, Elsevier, vol. 41(1), pages 143-156, November.
    7. Michael W. Trosset, 2002. "Extensions of Classical Multidimensional Scaling via Variable Reduction," Computational Statistics, Springer, vol. 17(2), pages 147-163, July.
    8. Trosset, Michael W. & Priebe, Carey E., 2008. "The out-of-sample problem for classical multidimensional scaling," Computational Statistics & Data Analysis, Elsevier, vol. 52(10), pages 4635-4642, June.
    9. Alexander Strehl & Joydeep Ghosh, 2003. "Relationship-Based Clustering and Visualization for High-Dimensional Data Mining," INFORMS Journal on Computing, INFORMS, vol. 15(2), pages 208-230, May.
    10. Venera Tomaselli, 1996. "Multivariate statistical techniques and sociological research," Quality & Quantity: International Journal of Methodology, Springer, vol. 30(3), pages 253-276, August.
    11. Oscar Claveria & Enric Monte & Salvador Torra, 2017. "A new approach for the quantification of qualitative measures of economic expectations," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(6), pages 2685-2706, November.
    12. Bijmolt, T.H.A. & Wedel, M., 1996. "A Monte Carlo Evaluation of Maximum Likelihood Multidimensional Scaling Methods," Other publications TiSEM f72cc9d8-f370-43aa-a224-4, Tilburg University, School of Economics and Management.
    13. Kuroda, Kaori & Hashiguchi, Hiroki & Fujiwara, Kantaro & Ikeguchi, Tohru, 2014. "Reconstruction of network structures from marked point processes using multi-dimensional scaling," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 415(C), pages 194-204.
    14. Fengzhen Zhai & Qingna Li, 2020. "A Euclidean distance matrix model for protein molecular conformation," Journal of Global Optimization, Springer, vol. 76(4), pages 709-728, April.
    15. Jinkai Yu & Wenjing Bi, 2019. "Evolution of Marine Environmental Governance Policy in China," Sustainability, MDPI, vol. 11(18), pages 1-14, September.
    16. Walesiak Marek & Dudek Andrzej, 2017. "Selecting the Optimal Multidimensional Scaling Procedure for Metric Data With R Environment," Statistics in Transition New Series, Statistics Poland, vol. 18(3), pages 521-540, September.
    17. Mirta Galesic & A. Walkyria Goode & Thomas S. Wallsten & Kent L. Norman, 2018. "Using Tversky’s contrast model to investigate how features of similarity affect judgments of likelihood," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 13(2), pages 163-169, March.
    18. Lewis, R.M. & Trosset, M.W., 2006. "Sensitivity analysis of the strain criterion for multidimensional scaling," Computational Statistics & Data Analysis, Elsevier, vol. 50(1), pages 135-153, January.
    19. Morales José F. & Song Tingting & Auerbach Arleen D. & Wittkowski Knut M., 2008. "Phenotyping Genetic Diseases Using an Extension of µ-Scores for Multivariate Data," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 7(1), pages 1-20, June.
    20. Benjamin B. Risk & David S. Matteson & David Ruppert & Ani Eloyan & Brian S. Caffo, 2014. "An evaluation of independent component analyses with an application to resting-state fMRI," Biometrics, The International Biometric Society, vol. 70(1), pages 224-236, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:9:y:2021:i:9:p:1017-:d:546884. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.