IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v11y2023i18p3899-d1239229.html
   My bibliography  Save this article

Nonparametric Estimation for High-Dimensional Space Models Based on a Deep Neural Network

Author

Listed:
  • Hongxia Wang

    (School of Statistics and Data Science, Nanjing Audit University, Nanjing 211815, China)

  • Xiao Jin

    (School of Statistics and Data Science, Nanjing Audit University, Nanjing 211815, China)

  • Jianian Wang

    (School of Statistics and Data Science, Nanjing Audit University, Nanjing 211815, China)

  • Hongxia Hao

    (School of Statistics and Data Science, Nanjing Audit University, Nanjing 211815, China)

Abstract

With high dimensionality and dependence in spatial data, traditional parametric methods suffer from the curse of dimensionality problem. The theoretical properties of deep neural network estimation methods for high-dimensional spatial models with dependence and heterogeneity have been investigated only in a few studies. In this paper, we propose a deep neural network with a ReLU activation function to estimate unknown trend components, considering both spatial dependence and heterogeneity. We prove the compatibility of the estimated components under spatial dependence conditions and provide an upper bound for the mean squared error ( M S E ). Simulations and empirical studies demonstrate that the convergence speed of neural network methods is significantly better than that of local linear methods.

Suggested Citation

  • Hongxia Wang & Xiao Jin & Jianian Wang & Hongxia Hao, 2023. "Nonparametric Estimation for High-Dimensional Space Models Based on a Deep Neural Network," Mathematics, MDPI, vol. 11(18), pages 1-37, September.
    • Handle: RePEc:gam:jmathe:v:11:y:2023:i:18:p:3899-:d:1239229
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/11/18/3899/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/11/18/3899/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bentsen, Lars Ødegaard & Warakagoda, Narada Dilp & Stenbro, Roy & Engelstad, Paal, 2023. "Spatio-temporal wind speed forecasting using graph networks and novel Transformer architectures," Applied Energy, Elsevier, vol. 333(C).
    2. Gérard Biau & Benoît Cadre, 2004. "Nonparametric Spatial Prediction," Statistical Inference for Stochastic Processes, Springer, vol. 7(3), pages 327-349, October.
    3. Michael Hamers & Michael Kohler, 2006. "Nonasymptotic Bounds on the L 2 Error of Neural Network Regression Estimates," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 58(1), pages 131-151, March.
    4. Marc Hallin & Zudi Lu & Lanh T. Tran, 2004. "Local linear spatial regression," ULB Institutional Repository 2013/2131, ULB -- Universite Libre de Bruxelles.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hongxia Wang & Jinde Wang & Bo Huang, 2012. "Prediction for spatio-temporal models with autoregression in errors," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 24(1), pages 217-244.
    2. Mohamed El Machkouri, 2011. "Asymptotic normality of the Parzen–Rosenblatt density estimator for strongly mixing random fields," Statistical Inference for Stochastic Processes, Springer, vol. 14(1), pages 73-84, February.
    3. Benhenni, Karim & Su, Yingcai, 2016. "Optimal sampling designs for nonparametric estimation of spatial averages of random fields," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 341-351.
    4. Amiri, Aboubacar & Dabo-Niang, Sophie, 2018. "Density estimation over spatio-temporal data streams," Econometrics and Statistics, Elsevier, vol. 5(C), pages 148-170.
    5. Sophie Dabo-Niang & Anne-Françoise Yao, 2013. "Kernel spatial density estimation in infinite dimension space," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 76(1), pages 19-52, January.
    6. Li, Linyuan, 2015. "Nonparametric adaptive density estimation on random fields using wavelet method," Statistics & Probability Letters, Elsevier, vol. 96(C), pages 346-355.
    7. Rongrong Xu & Jinde Wang, 2008. "-estimation for spatial nonparametric regression," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 20(6), pages 523-537.
    8. Sophie Dabo-Niang & Sidi Ould-Abdi & Ahmedoune Ould-Abdi & Aliou Diop, 2014. "Consistency of a nonparametric conditional mode estimator for random fields," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 23(1), pages 1-39, March.
    9. Zudi Lu & Dag Johan Steinskog & Dag Tjøstheim & Qiwei Yao, 2009. "Adaptively varying‐coefficient spatiotemporal models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(4), pages 859-880, September.
    10. El Machkouri, Mohamed & Es-Sebaiy, Khalifa & Ouassou, Idir, 2017. "On local linear regression for strongly mixing random fields," Journal of Multivariate Analysis, Elsevier, vol. 156(C), pages 103-115.
    11. Chouaf Abdelhak & Laksaci Ali, 2012. "On the functional local linear estimate for spatial regression," Statistics & Risk Modeling, De Gruyter, vol. 29(3), pages 189-214, August.
    12. Ahmad Younso, 2023. "On the consistency of mode estimate for spatially dependent data," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 86(3), pages 343-372, April.
    13. Tang Qingguo, 2015. "Robust estimation for spatial semiparametric varying coefficient partially linear regression," Statistical Papers, Springer, vol. 56(4), pages 1137-1161, November.
    14. Gao, Jiti & Lu, Zudi & Tjostheim, Dag, 2003. "Estimation in semiparametric spatial regression," MPRA Paper 11979, University Library of Munich, Germany, revised Jul 2005.
    15. Chen, Fuhao & Yan, Jie & Liu, Yongqian & Yan, Yamin & Tjernberg, Lina Bertling, 2024. "A novel meta-learning approach for few-shot short-term wind power forecasting," Applied Energy, Elsevier, vol. 362(C).
    16. Michel Carbon, 2014. "Histograms for stationary linear random fields," Statistical Inference for Stochastic Processes, Springer, vol. 17(3), pages 245-266, October.
    17. repec:esx:essedp:767 is not listed on IDEAS
    18. Lv, Yunlong & Hu, Qin & Xu, Hang & Lin, Huiyao & Wu, Yufan, 2024. "An ultra-short-term wind power prediction method based on spatial-temporal attention graph convolutional model," Energy, Elsevier, vol. 293(C).
    19. Tang Qingguo & Cheng Longsheng, 2010. "B-spline estimation for spatial data," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 22(2), pages 197-217.
    20. Yang, Ting & Yang, Zhenning & Li, Fei & Wang, Hengyu, 2024. "A short-term wind power forecasting method based on multivariate signal decomposition and variable selection," Applied Energy, Elsevier, vol. 360(C).
    21. Xu, Xuefang & Hu, Shiting & Shao, Huaishuang & Shi, Peiming & Li, Ruixiong & Li, Deguang, 2023. "A spatio-temporal forecasting model using optimally weighted graph convolutional network and gated recurrent unit for wind speed of different sites distributed in an offshore wind farm," Energy, Elsevier, vol. 284(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:11:y:2023:i:18:p:3899-:d:1239229. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.