IDEAS home Printed from https://ideas.repec.org/p/ucr/wpaper/202215.html
   My bibliography  Save this paper

Semiparametric Partially Linear Varying Coefficient Modal Regression

Author

Listed:
  • Aman Ullah

    (Department of Economics, University of California Riverside)

  • Tao Wang

    (University of Victoria)

  • Weixin Yao

    (University of California Riverside)

Abstract

We in this paper propose a semiparametric partially linear varying coefficient (SPLVC) modal regression, in which the conditional mode function of the response variable given covariates admit a partially linear varying coefficient structure. In comparison to existing regressions, the newly developed SPLVC modal regression captures the most likely effect and provides superior prediction performance when the data distribution is skewed. The consistency and asymptotic properties of the resultant estimators for both parametric and nonparametric parts are rigorously established. We employ a kernel-based objective function to simplify the computation and a modified modal-expectation-maximization (MEM) algorithm to estimate the model numerically. Furthermore, taking the residual sums of modes as the loss function, we construct a goodness of fit testing statistic for hypotheses on the coefficient functions, whose limiting null distribution is shown to follow an asymptotically normal-distribution with a scale dependent on density functions. To achieve sparsity in the high-dimensional SPLVC modal regression, we develop a regularized estimation procedure by imposing a penalty on the coefficients in the parametric part to eliminate the irrelevant variables. Monte Carlo simulations and two real-data applications are conducted to examine the performance of the suggested estimation methods and hypothesis test. We also briefly explore the extension of the SPLVC modal regression to the case where some varying coefficient functions admit higher-order smoothness.

Suggested Citation

  • Aman Ullah & Tao Wang & Weixin Yao, 2022. "Semiparametric Partially Linear Varying Coefficient Modal Regression," Working Papers 202215, University of California at Riverside, Department of Economics, revised Jun 2022.
  • Handle: RePEc:ucr:wpaper:202215
    as

    Download full text from publisher

    File URL: https://economics.ucr.edu/repec/ucr/wpaper/202215.pdf
    File Function: First version, 2022
    Download Restriction: no

    File URL: https://economics.ucr.edu/repec/ucr/wpaper/202215R.pdf
    File Function: Revised version, 2022
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Robinson, Peter M, 1988. "Root- N-Consistent Semiparametric Regression," Econometrica, Econometric Society, vol. 56(4), pages 931-954, July.
    2. Weihua Zhao & Riquan Zhang & Jicai Liu, 2013. "Robust variable selection for the varying coefficient model based on composite L 1 -- L 2 regression," Journal of Applied Statistics, Taylor & Francis Journals, vol. 40(9), pages 2024-2040, September.
    3. Aman Ullah & Tao Wang & Weixin Yao, 2021. "Modal regression for fixed effects panel data," Empirical Economics, Springer, vol. 60(1), pages 261-308, January.
    4. Jianqing Fan & Jiancheng Jiang, 2007. "Rejoinder on: Nonparametric inference with generalized likelihood ratio tests," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 16(3), pages 471-478, December.
    5. Lee, Myoung-jae, 1993. "Quadratic mode regression," Journal of Econometrics, Elsevier, vol. 57(1-3), pages 1-19.
    6. Weixin Yao & Bruce Lindsay & Runze Li, 2012. "Local modal regression," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 24(3), pages 647-663.
    7. Weihua Zhao & Riquan Zhang & Jicai Liu & Yazhao Lv, 2014. "Robust and efficient variable selection for semiparametric partially linear varying coefficient model based on modal regression," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 66(1), pages 165-191, February.
    8. Kemp, Gordon C.R. & Santos Silva, J.M.C., 2012. "Regression towards the mode," Journal of Econometrics, Elsevier, vol. 170(1), pages 92-101.
    9. Cai, Zongwu & Das, Mitali & Xiong, Huaiyu & Wu, Xizhi, 2006. "Functional coefficient instrumental variables models," Journal of Econometrics, Elsevier, vol. 133(1), pages 207-241, July.
    10. Gordon C. R. Kemp & Paulo M. D. C. Parente & J. M. C. Santos Silva, 2020. "Dynamic Vector Mode Regression," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(3), pages 647-661, July.
    11. Jerome M. Krief, 2017. "Semi‐linear mode regression," Econometrics Journal, Royal Economic Society, vol. 20(2), pages 149-167.
    12. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    13. Weixin Yao & Longhai Li, 2014. "A New Regression Model: Modal Linear Regression," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 41(3), pages 656-671, September.
    14. Jianqing Fan & Jiancheng Jiang, 2007. "Nonparametric inference with generalized likelihood ratio tests," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 16(3), pages 409-444, December.
    15. Aman Ullah & Tao Wang & Weixin Yao, 2022. "Nonlinear modal regression for dependent data with application for predicting COVID‐19," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(3), pages 1424-1453, July.
    16. Liangjun Su & Irina Murtazashvili & Aman Ullah, 2013. "Local Linear GMM Estimation of Functional Coefficient IV Models With an Application to Estimating the Rate of Return to Schooling," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(2), pages 184-207, April.
    17. Jerome M. Krief, 2017. "Semi‐linear mode regression," Econometrics Journal, Royal Economic Society, vol. 20(2), pages 149-167, June.
    18. Cai, Zongwu & Fan, Jianqing & Yao, Qiwei, 2000. "Functional-coefficient regression models for nonlinear time series," LSE Research Online Documents on Economics 6314, London School of Economics and Political Science, LSE Library.
    19. Riquan Zhang & Weihua Zhao & Jicai Liu, 2013. "Robust estimation and variable selection for semiparametric partially linear varying coefficient model based on modal regression," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 25(2), pages 523-544, June.
    20. Hansheng Wang & Runze Li & Chih-Ling Tsai, 2007. "Tuning parameter selectors for the smoothly clipped absolute deviation method," Biometrika, Biometrika Trust, vol. 94(3), pages 553-568.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bogui Li & Jianbao Chen & Shuangshuang Li, 2023. "Estimation of Fixed Effects Partially Linear Varying Coefficient Panel Data Regression Model with Nonseparable Space-Time Filters," Mathematics, MDPI, vol. 11(6), pages 1-24, March.
    2. Zhe Sun & Yundong Tu, 2024. "Factors in Fashion: Factor Analysis towards the Mode," Papers 2409.19287, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhe Sun & Yundong Tu, 2024. "Factors in Fashion: Factor Analysis towards the Mode," Papers 2409.19287, arXiv.org.
    2. Aman Ullah & Tao Wang & Weixin Yao, 2022. "Nonlinear modal regression for dependent data with application for predicting COVID‐19," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(3), pages 1424-1453, July.
    3. Hu Yang & Ning Li & Jing Yang, 2020. "A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates," Statistical Papers, Springer, vol. 61(5), pages 1911-1937, October.
    4. Wang, Kangning & Li, Shaomin, 2021. "Robust distributed modal regression for massive data," Computational Statistics & Data Analysis, Elsevier, vol. 160(C).
    5. Wang, Kangning & Li, Shaomin & Sun, Xiaofei & Lin, Lu, 2019. "Modal regression statistical inference for longitudinal data semivarying coefficient models: Generalized estimating equations, empirical likelihood and variable selection," Computational Statistics & Data Analysis, Elsevier, vol. 133(C), pages 257-276.
    6. Lv, Zhike & Zhu, Huiming & Yu, Keming, 2014. "Robust variable selection for nonlinear models with diverging number of parameters," Statistics & Probability Letters, Elsevier, vol. 91(C), pages 90-97.
    7. Aman Ullah & Tao Wang & Weixin Yao, 2021. "Modal regression for fixed effects panel data," Empirical Economics, Springer, vol. 60(1), pages 261-308, January.
    8. Yang, Jing & Tian, Guoliang & Lu, Fang & Lu, Xuewen, 2020. "Single-index modal regression via outer product gradients," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    9. Yen-Chi Chen, 2017. "Modal Regression using Kernel Density Estimation: a Review," Papers 1710.07004, arXiv.org, revised Dec 2017.
    10. Qingyang Liu & Xianzheng Huang & Haiming Zhou, 2024. "The Flexible Gumbel Distribution: A New Model for Inference about the Mode," Stats, MDPI, vol. 7(1), pages 1-16, March.
    11. Xuejun Ma & Yue Du & Jingli Wang, 2022. "Model detection and variable selection for mode varying coefficient model," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 31(2), pages 321-341, June.
    12. Yunlu Jiang & Guo-Liang Tian & Yu Fei, 2019. "A robust and efficient estimation method for partially nonlinear models via a new MM algorithm," Statistical Papers, Springer, vol. 60(6), pages 2063-2085, December.
    13. Germán Aneiros & Philippe Vieu, 2015. "Partial linear modelling with multi-functional covariates," Computational Statistics, Springer, vol. 30(3), pages 647-671, September.
    14. Delgado, Michael S. & McCloud, Nadine & Kumbhakar, Subal C., 2014. "A generalized empirical model of corruption, foreign direct investment, and growth," Journal of Macroeconomics, Elsevier, vol. 42(C), pages 298-316.
    15. Zongwu Cai & Linna Chen & Ying Fang, 2015. "Semiparametric Estimation of Partially Varying-Coefficient Dynamic Panel Data Models," Econometric Reviews, Taylor & Francis Journals, vol. 34(6-10), pages 695-719, December.
    16. Yang, Jing & Yang, Hu, 2016. "A robust penalized estimation for identification in semiparametric additive models," Statistics & Probability Letters, Elsevier, vol. 110(C), pages 268-277.
    17. Jianqing Fan & Jinchi Lv, 2008. "Sure independence screening for ultrahigh dimensional feature space," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(5), pages 849-911, November.
    18. Tianshun Yan & Changlin Mei, 2017. "A test for a parametric form of the volatility in second-order diffusion models," Computational Statistics, Springer, vol. 32(4), pages 1583-1596, December.
    19. Alan T. K. Wan & Jinhong You & Riquan Zhang, 2016. "A Seemingly Unrelated Nonparametric Additive Model with Autoregressive Errors," Econometric Reviews, Taylor & Francis Journals, vol. 35(5), pages 894-928, May.
    20. Joel L. Horowitz, 2015. "Variable selection and estimation in high-dimensional models," CeMMAP working papers 35/15, Institute for Fiscal Studies.

    More about this item

    Keywords

    Goodness of fit test; MEM algorithm; Modal regression; Oracle property; Partially linear varying coefficient;
    All these keywords.

    JEL classification:

    • C01 - Mathematical and Quantitative Methods - - General - - - Econometrics
    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C50 - Mathematical and Quantitative Methods - - Econometric Modeling - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ucr:wpaper:202215. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kelvin Mac (email available below). General contact details of provider: https://edirc.repec.org/data/deucrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.