IDEAS home Printed from https://ideas.repec.org/a/gam/jftint/v13y2021i8p193-d602327.html
   My bibliography  Save this article

Education 4.0: Teaching the Basics of KNN, LDA and Simple Perceptron Algorithms for Binary Classification Problems

Author

Listed:
  • Diego Lopez-Bernal

    (Tecnologico de Monterrey, National Department of Research, Puente 222, Del. Tlalpan, Mexico City 14380, Mexico)

  • David Balderas

    (Tecnologico de Monterrey, National Department of Research, Puente 222, Del. Tlalpan, Mexico City 14380, Mexico)

  • Pedro Ponce

    (Tecnologico de Monterrey, National Department of Research, Puente 222, Del. Tlalpan, Mexico City 14380, Mexico)

  • Arturo Molina

    (Tecnologico de Monterrey, National Department of Research, Puente 222, Del. Tlalpan, Mexico City 14380, Mexico)

Abstract

One of the main focuses of Education 4.0 is to provide students with knowledge on disruptive technologies, such as Machine Learning (ML), as well as the skills to implement this knowledge to solve real-life problems. Therefore, both students and professors require teaching and learning tools that facilitate the introduction to such topics. Consequently, this study looks forward to contributing to the development of those tools by introducing the basic theory behind three machine learning classifying algorithms: K-Nearest-Neighbor (KNN), Linear Discriminant Analysis (LDA), and Simple Perceptron; as well as discussing the diverse advantages and disadvantages of each method. Moreover, it is proposed to analyze how these methods work on different conditions through their implementation over a test bench. Thus, in addition to the description of each algorithm, we discuss their application to solving three different binary classification problems using three different datasets, as well as comparing their performances in these specific case studies. The findings of this study can be used by teachers to provide students the basic knowledge of KNN, LDA, and perceptron algorithms, and, at the same time, it can be used as a guide to learn how to apply them to solve real-life problems that are not limited to the presented datasets.

Suggested Citation

  • Diego Lopez-Bernal & David Balderas & Pedro Ponce & Arturo Molina, 2021. "Education 4.0: Teaching the Basics of KNN, LDA and Simple Perceptron Algorithms for Binary Classification Problems," Future Internet, MDPI, vol. 13(8), pages 1-14, July.
    • Handle: RePEc:gam:jftint:v:13:y:2021:i:8:p:193-:d:602327
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1999-5903/13/8/193/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1999-5903/13/8/193/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Voyant, Cyril & Notton, Gilles & Kalogirou, Soteris & Nivet, Marie-Laure & Paoli, Christophe & Motte, Fabrice & Fouilloy, Alexis, 2017. "Machine learning methods for solar radiation forecasting: A review," Renewable Energy, Elsevier, vol. 105(C), pages 569-582.
    2. Niraj Thapa & Zhipeng Liu & Dukka B. KC & Balakrishna Gokaraju & Kaushik Roy, 2020. "Comparison of Machine Learning and Deep Learning Models for Network Intrusion Detection Systems," Future Internet, MDPI, vol. 12(10), pages 1-16, September.
    3. Heinermann, Justin & Kramer, Oliver, 2016. "Machine learning ensembles for wind power prediction," Renewable Energy, Elsevier, vol. 89(C), pages 671-679.
    4. Giulia Bressan & Giulia Cisotto & Gernot R. Müller-Putz & Selina Christin Wriessnegger, 2021. "Deep Learning-Based Classification of Fine Hand Movements from Low Frequency EEG," Future Internet, MDPI, vol. 13(5), pages 1-14, April.
    5. Rajagopal, 2015. "Market Trend Analysis," Palgrave Macmillan Books, in: The Butterfly Effect in Competitive Markets, chapter 4, pages 95-118, Palgrave Macmillan.
    6. Eric Hitimana & Gaurav Bajpai & Richard Musabe & Louis Sibomana & Jayavel Kayalvizhi, 2021. "Implementation of IoT Framework with Data Analysis Using Deep Learning Methods for Occupancy Prediction in a Building," Future Internet, MDPI, vol. 13(3), pages 1-19, March.
    7. Ping Zhang & Rongqin Wang & Nianfeng Shi, 2020. "IgA Nephropathy Prediction in Children with Machine Learning Algorithms," Future Internet, MDPI, vol. 12(12), pages 1-11, December.
    8. Guillermo Rodríguez-Abitia & Graciela Bribiesca-Correa, 2021. "Assessing Digital Transformation in Universities," Future Internet, MDPI, vol. 13(2), pages 1-16, February.
    9. J. B. Heaton & N. G. Polson & J. H. Witte, 2017. "Deep learning for finance: deep portfolios," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 33(1), pages 3-12, January.
    10. Zeng, Yu-Rong & Zeng, Yi & Choi, Beomjin & Wang, Lin, 2017. "Multifactor-influenced energy consumption forecasting using enhanced back-propagation neural network," Energy, Elsevier, vol. 127(C), pages 381-396.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sabarathinam Srinivasan & Suresh Kumarasamy & Zacharias E. Andreadakis & Pedro G. Lind, 2023. "Artificial Intelligence and Mathematical Models of Power Grids Driven by Renewable Energy Sources: A Survey," Energies, MDPI, vol. 16(14), pages 1-56, July.
    2. Nam, KiJeon & Hwangbo, Soonho & Yoo, ChangKyoo, 2020. "A deep learning-based forecasting model for renewable energy scenarios to guide sustainable energy policy: A case study of Korea," Renewable and Sustainable Energy Reviews, Elsevier, vol. 122(C).
    3. Dania Ortiz & Vera Migueis & Vitor Leal & Janelle Knox-Hayes & Jungwoo Chun, 2022. "Analysis of Renewable Energy Policies through Decision Trees," Sustainability, MDPI, vol. 14(13), pages 1-31, June.
    4. Mohammad Mahdi Forootan & Iman Larki & Rahim Zahedi & Abolfazl Ahmadi, 2022. "Machine Learning and Deep Learning in Energy Systems: A Review," Sustainability, MDPI, vol. 14(8), pages 1-49, April.
    5. Rushdi, Mostafa A. & Yoshida, Shigeo & Watanabe, Koichi & Ohya, Yuji, 2021. "Machine learning approaches for thermal updraft prediction in wind solar tower systems," Renewable Energy, Elsevier, vol. 177(C), pages 1001-1013.
    6. Voyant, Cyril & Motte, Fabrice & Notton, Gilles & Fouilloy, Alexis & Nivet, Marie-Laure & Duchaud, Jean-Laurent, 2018. "Prediction intervals for global solar irradiation forecasting using regression trees methods," Renewable Energy, Elsevier, vol. 126(C), pages 332-340.
    7. Trigo-González, Mauricio & Batlles, F.J. & Alonso-Montesinos, Joaquín & Ferrada, Pablo & del Sagrado, J. & Martínez-Durbán, M. & Cortés, Marcelo & Portillo, Carlos & Marzo, Aitor, 2019. "Hourly PV production estimation by means of an exportable multiple linear regression model," Renewable Energy, Elsevier, vol. 135(C), pages 303-312.
    8. Pedro, Hugo T.C. & Lim, Edwin & Coimbra, Carlos F.M., 2018. "A database infrastructure to implement real-time solar and wind power generation intra-hour forecasts," Renewable Energy, Elsevier, vol. 123(C), pages 513-525.
    9. Miguel Ángel Rodríguez López & Diego Rodríguez Rodríguez, 2024. "La aplicación de datos masivos en economía de la energía: una revisión," Working Papers 2024-08, FEDEA.
    10. Martín Pensado-Mariño & Lara Febrero-Garrido & Pablo Eguía-Oller & Enrique Granada-Álvarez, 2021. "Feasibility of Different Weather Data Sources Applied to Building Indoor Temperature Estimation Using LSTM Neural Networks," Sustainability, MDPI, vol. 13(24), pages 1-15, December.
    11. Agga, Ali & Abbou, Ahmed & Labbadi, Moussa & El Houm, Yassine, 2021. "Short-term self consumption PV plant power production forecasts based on hybrid CNN-LSTM, ConvLSTM models," Renewable Energy, Elsevier, vol. 177(C), pages 101-112.
    12. Mousavi, Navid & Kothapalli, Ganesh & Habibi, Daryoush & Das, Choton K. & Baniasadi, Ali, 2020. "A novel photovoltaic-pumped hydro storage microgrid applicable to rural areas," Applied Energy, Elsevier, vol. 262(C).
    13. Wang, Zhenyu & Zhang, Yunpeng & Li, Guorong & Zhang, Jinlong & Zhou, Hai & Wu, Ji, 2024. "A novel solar irradiance forecasting method based on multi-physical process of atmosphere optics and LSTM-BP model," Renewable Energy, Elsevier, vol. 226(C).
    14. Eric Benhamou & David Saltiel & Sandrine Ungari & Abhishek Mukhopadhyay & Jamal Atif, 2020. "AAMDRL: Augmented Asset Management with Deep Reinforcement Learning," Papers 2010.08497, arXiv.org.
    15. Paskalis Glabadanidis, 2020. "Portfolio Strategies to Track and Outperform a Benchmark," JRFM, MDPI, vol. 13(8), pages 1-26, August.
    16. Gao, Datong & Zhao, Bin & Kwan, Trevor Hocksun & Hao, Yong & Pei, Gang, 2022. "The spatial and temporal mismatch phenomenon in solar space heating applications: status and solutions," Applied Energy, Elsevier, vol. 321(C).
    17. Stephan Schlüter & Fabian Menz & Milena Kojić & Petar Mitić & Aida Hanić, 2022. "A Novel Approach to Generate Hourly Photovoltaic Power Scenarios," Sustainability, MDPI, vol. 14(8), pages 1-16, April.
    18. Eleni Kosta, 2022. "Algorithmic state surveillance: Challenging the notion of agency in human rights," Regulation & Governance, John Wiley & Sons, vol. 16(1), pages 212-224, January.
    19. Erik Heilmann & Janosch Henze & Heike Wetzel, 2021. "Machine learning in energy forecasts with an application to high frequency electricity consumption data," MAGKS Papers on Economics 202135, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    20. Edna S. Solano & Payman Dehghanian & Carolina M. Affonso, 2022. "Solar Radiation Forecasting Using Machine Learning and Ensemble Feature Selection," Energies, MDPI, vol. 15(19), pages 1-18, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jftint:v:13:y:2021:i:8:p:193-:d:602327. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.