IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v14y2022i22p15273-d975785.html
   My bibliography  Save this article

Neural Network-Augmented Locally Adaptive Linear Regression Model for Tabular Data

Author

Listed:
  • Lkhagvadorj Munkhdalai

    (Database and Bioinformatics Laboratory, College of Electrical and Computer Engineering, Chungbuk National University, Cheongju 28644, Republic of Korea)

  • Tsendsuren Munkhdalai

    (Google, Mountain View, CA 94043, USA)

  • Van Huy Pham

    (Data Science Laboratory, Faculty of Information Technology, Ton Duc Thang University, Ho Chi Minh City 700000, Vietnam)

  • Jang-Eui Hong

    (Software Intelligence Engineering Laboratory, Department of Computer Science, Chungbuk National University, Cheongju 28644, Republic of Korea)

  • Keun Ho Ryu

    (Data Science Laboratory, Faculty of Information Technology, Ton Duc Thang University, Ho Chi Minh City 700000, Vietnam
    Biomedical Engineering Institute, Chiang Mai University, Chiang Mai 50200, Thailand)

  • Nipon Theera-Umpon

    (Biomedical Engineering Institute, Chiang Mai University, Chiang Mai 50200, Thailand
    Department of Electrical Engineering, Faculty of Engineering, Chiang Mai University, Chiang Mai 50200, Thailand)

Abstract

Creating an interpretable model with high predictive performance is crucial in eXplainable AI (XAI) field. We introduce an interpretable neural network-based regression model for tabular data in this study. Our proposed model uses ordinary least squares (OLS) regression as a base-learner, and we re-update the parameters of our base-learner by using neural networks, which is a meta-learner in our proposed model. The meta-learner updates the regression coefficients using the confidence interval formula. We extensively compared our proposed model to other benchmark approaches on public datasets for regression task. The results showed that our proposed neural network-based interpretable model showed outperformed results compared to the benchmark models. We also applied our proposed model to the synthetic data to measure model interpretability, and we showed that our proposed model can explain the correlation between input and output variables by approximating the local linear function for each point. In addition, we trained our model on the economic data to discover the correlation between the central bank policy rate and inflation over time. As a result, it is drawn that the effect of central bank policy rates on inflation tends to strengthen during a recession and weaken during an expansion. We also performed the analysis on CO 2 emission data, and our model discovered some interesting explanations between input and target variables, such as a parabolic relationship between CO 2 emissions and gross national product (GNP). Finally, these experiments showed that our proposed neural network-based interpretable model could be applicable for many real-world applications where data type is tabular and explainable models are required.

Suggested Citation

  • Lkhagvadorj Munkhdalai & Tsendsuren Munkhdalai & Van Huy Pham & Jang-Eui Hong & Keun Ho Ryu & Nipon Theera-Umpon, 2022. "Neural Network-Augmented Locally Adaptive Linear Regression Model for Tabular Data," Sustainability, MDPI, vol. 14(22), pages 1-21, November.
  • Handle: RePEc:gam:jsusta:v:14:y:2022:i:22:p:15273-:d:975785
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/14/22/15273/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/14/22/15273/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Holtz-Eakin, Douglas & Selden, Thomas M., 1995. "Stoking the fires? CO2 emissions and economic growth," Journal of Public Economics, Elsevier, vol. 57(1), pages 85-101, May.
    2. Kwiatkowski, Denis & Phillips, Peter C. B. & Schmidt, Peter & Shin, Yongcheol, 1992. "Testing the null hypothesis of stationarity against the alternative of a unit root : How sure are we that economic time series have a unit root?," Journal of Econometrics, Elsevier, vol. 54(1-3), pages 159-178.
    3. Dickey, David A & Fuller, Wayne A, 1981. "Likelihood Ratio Statistics for Autoregressive Time Series with a Unit Root," Econometrica, Econometric Society, vol. 49(4), pages 1057-1072, June.
    4. Andrew Gelman & Ben Goodrich & Jonah Gabry & Aki Vehtari, 2019. "R-squared for Bayesian Regression Models," The American Statistician, Taylor & Francis Journals, vol. 73(3), pages 307-309, July.
    5. Dangl, Thomas & Halling, Michael, 2012. "Predictive regressions with time-varying coefficients," Journal of Financial Economics, Elsevier, vol. 106(1), pages 157-181.
    6. Kelley Pace, R. & Barry, Ronald, 1997. "Sparse spatial autoregressions," Statistics & Probability Letters, Elsevier, vol. 33(3), pages 291-297, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Muhammad, Anees & Ishfaq, Ahmed, 2011. "Industrial development, agricultural growth, urbanization and environmental Kuznets curve in Pakistan," MPRA Paper 33469, University Library of Munich, Germany.
    2. Guili Liao & Qimeng Liu & Rongmao Zhang & Shifang Zhang, 2022. "Rank test of unit‐root hypothesis with AR‐GARCH errors," Journal of Time Series Analysis, Wiley Blackwell, vol. 43(5), pages 695-719, September.
    3. Xiaojie Xu, 2017. "The rolling causal structure between the Chinese stock index and futures," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 31(4), pages 491-509, November.
    4. repec:kap:iaecre:v:17:y:2011:i:2:p:157-168 is not listed on IDEAS
    5. Jan Babecký & Fabrizio Coricelli & Roman Horváth, 2009. "Assessing Inflation Persistence: Micro Evidence on an Inflation Targeting Economy," Czech Journal of Economics and Finance (Finance a uver), Charles University Prague, Faculty of Social Sciences, vol. 59(2), pages 102-127, June.
    6. Hu, Junjie & López Cabrera, Brenda & Melzer, Awdesch, 2021. "Advanced statistical learning on short term load process forecasting," IRTG 1792 Discussion Papers 2021-020, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    7. Kun Guo & Wei-Xing Zhou & Si-Wei Cheng & Didier Sornette, 2011. "The US Stock Market Leads the Federal Funds Rate and Treasury Bond Yields," PLOS ONE, Public Library of Science, vol. 6(8), pages 1-9, August.
    8. Isabel Cortés-Jiménez & Manuel Artís, 2005. "The role of the tourism sector in economic development - Lessons from the Spanish experience," ERSA conference papers ersa05p488, European Regional Science Association.
    9. Philippe Andrade & Catherine Bruneau, 2002. "Excess returns, portfolio choices and exchange rate dynamics. The yen/dollar case, 1980–1998," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 64(3), pages 233-256, July.
    10. Hondroyiannis, George & Papapetrou, Evangelia, 2001. "Demographic changes, labor effort and economic growth: empirical evidence from Greece," Journal of Policy Modeling, Elsevier, vol. 23(2), pages 169-188, February.
    11. Francis Ahking, 2003. "Efficient unit root tests of real exchange rates in the post-Bretton Woods era," Economics Bulletin, AccessEcon, vol. 6(7), pages 1-12.
    12. Fabian Knorre & Martin Wagner & Maximilian Grupe, 2021. "Monitoring Cointegrating Polynomial Regressions: Theory and Application to the Environmental Kuznets Curves for Carbon and Sulfur Dioxide Emissions," Econometrics, MDPI, vol. 9(1), pages 1-35, March.
    13. Ashis Kumar Pradhan & Gourishankar S Hiremath, 2020. "Do external commercial borrowings and financial development affect exports?," Cogent Business & Management, Taylor & Francis Journals, vol. 7(1), pages 1796269-179, January.
    14. Fredj Jawadi & Catherine Bruneau & Nadia Sghaier, 2009. "Nonlinear Cointegration Relationships Between Non‐Life Insurance Premiums and Financial Markets," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 76(3), pages 753-783, September.
    15. Derek Bond & Michael J. Harrison & Edward J. O'Brien, 2005. "Testing for Long Memory and Nonlinear Time Series: A Demand for Money Study," Trinity Economics Papers tep20021, Trinity College Dublin, Department of Economics.
    16. Wang, Peijie & Brand, Steven, 2015. "A new approach to estimating value–income ratios with income growth and time-varying yields," European Journal of Operational Research, Elsevier, vol. 242(1), pages 182-187.
    17. Frédérique Bec & Mélika Ben Salem & Marine Carrasco, 2010. "Detecting Mean Reversion in Real Exchange Rates from a Multiple Regime star Model," Annals of Economics and Statistics, GENES, issue 99-100, pages 395-427.
    18. Ahmed, Walid M.A., 2018. "On the interdependence of natural gas and stock markets under structural breaks," The Quarterly Review of Economics and Finance, Elsevier, vol. 67(C), pages 149-161.
    19. Boris Hofmann, 2003. "Bank Lending and Property Prices: Some International Evidence," Working Papers 222003, Hong Kong Institute for Monetary Research.
    20. Garg, Bhavesh & Prabheesh, K.P., 2021. "Testing the intertemporal sustainability of current account in the presence of endogenous structural breaks: Evidence from the top deficit countries," Economic Modelling, Elsevier, vol. 97(C), pages 365-379.
    21. Levent KORAP, 2008. "Exchange Rate Determination Of Tl/Us$:A Co-Integration Approach," Istanbul University Econometrics and Statistics e-Journal, Department of Econometrics, Faculty of Economics, Istanbul University, vol. 7(1), pages 24-50, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:14:y:2022:i:22:p:15273-:d:975785. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.