IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v12y2024i17p2787-d1474375.html
   My bibliography  Save this article

Robust Liu Estimator Used to Combat Some Challenges in Partially Linear Regression Model by Improving LTS Algorithm Using Semidefinite Programming

Author

Listed:
  • Waleed B. Altukhaes

    (Institute of Mathematical Sciences, Faculty of Science, Universiti Malaya, Kuala Lumpur 50603, Malaysia
    Department of Mathematics, College of Science and Humanities, Shaqra University, Sahqra 11961, Saudi Arabia)

  • Mahdi Roozbeh

    (Department of Statistics, Faculty of Mathematics, Statistics and Computer Sciences, Semnan University, Semnan 3513119111, Iran)

  • Nur A. Mohamed

    (Institute of Mathematical Sciences, Faculty of Science, Universiti Malaya, Kuala Lumpur 50603, Malaysia)

Abstract

Outliers are a common problem in applied statistics, together with multicollinearity. In this paper, robust Liu estimators are introduced into a partially linear model to combat the presence of multicollinearity and outlier challenges when the error terms are not independent and some linear constraints are assumed to hold in the parameter space. The Liu estimator is used to address the multicollinearity, while robust methods are used to handle the outlier problem. In the literature on the Liu methodology, obtaining the best value for the biased parameter plays an important role in model prediction and is still an unsolved problem. In this regard, some robust estimators of the biased parameter are proposed based on the least trimmed squares (LTS) technique and its extensions using a semidefinite programming approach. Based on a set of observations with a sample size of n , and the integer trimming parameter h ≤ n , the LTS estimator computes the hyperplane that minimizes the sum of the lowest h squared residuals. Even though the LTS estimator is statistically more effective than the widely used least median squares (LMS) estimate, it is less complicated computationally than LMS. It is shown that the proposed robust extended Liu estimators perform better than classical estimators. As part of our proposal, using Monte Carlo simulation schemes and a real data example, the performance of robust Liu estimators is compared with that of classical ones in restricted partially linear models.

Suggested Citation

  • Waleed B. Altukhaes & Mahdi Roozbeh & Nur A. Mohamed, 2024. "Robust Liu Estimator Used to Combat Some Challenges in Partially Linear Regression Model by Improving LTS Algorithm Using Semidefinite Programming," Mathematics, MDPI, vol. 12(17), pages 1-23, September.
  • Handle: RePEc:gam:jmathe:v:12:y:2024:i:17:p:2787-:d:1474375
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/12/17/2787/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/12/17/2787/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Kristofer Månsson & B.M. Golam Kibria & Ghazi Shukur, 2016. "A restricted Liu estimator for binary regression models and its application to an applied demand system," Journal of Applied Statistics, Taylor & Francis Journals, vol. 43(6), pages 1119-1127, May.
    2. M. H. Karbalaee & M. Arashi & S. M. M. Tabatabaey, 2018. "Performance analysis of the preliminary test estimator with series of stochastic restrictions," Communications in Statistics - Theory and Methods, Taylor & Francis Journals, vol. 47(1), pages 1-17, January.
    3. M. Arashi & T. Valizadeh, 2015. "Performance of Kibria’s methods in partial linear ridge regression model," Statistical Papers, Springer, vol. 56(1), pages 231-246, February.
    4. Yatchew,Adonis, 2003. "Semiparametric Regression for the Applied Econometrician," Cambridge Books, Cambridge University Press, number 9780521812832, September.
    5. Ruppert,David & Wand,M. P. & Carroll,R. J., 2003. "Semiparametric Regression," Cambridge Books, Cambridge University Press, number 9780521785167, October.
    6. R. Fallah & M. Arashi & S. M. M. Tabatabaey, 2017. "On the ridge regression estimator with sub-space restriction," Communications in Statistics - Theory and Methods, Taylor & Francis Journals, vol. 46(23), pages 11854-11865, December.
    7. Fikri Akdeniz & Mahdi Roozbeh & Esra Akdeniz & Naushad Mamode Khan, 2022. "Generalized difference-based weighted mixed almost unbiased liu estimator in semiparametric regression models," Communications in Statistics - Theory and Methods, Taylor & Francis Journals, vol. 51(13), pages 4395-4416, June.
    8. Wolfgang Härdle & Oliver Linton & Wang & Qihua, 2003. "Semiparametric regression analysis with missing response at random," CeMMAP working papers 11/03, Institute for Fiscal Studies.
    9. M. Taavoni & M. Arashi, 2021. "Kernel estimation in semiparametric mixed effect longitudinal modeling," Statistical Papers, Springer, vol. 62(3), pages 1095-1116, June.
    10. Nguyen, T.D. & Welsch, R., 2010. "Outlier detection and least trimmed squares approximation using semi-definite programming," Computational Statistics & Data Analysis, Elsevier, vol. 54(12), pages 3212-3226, December.
    11. Ruppert,David & Wand,M. P. & Carroll,R. J., 2003. "Semiparametric Regression," Cambridge Books, Cambridge University Press, number 9780521780506, October.
    12. repec:hum:journl:v:105:y:2012:i:1:p:164-175 is not listed on IDEAS
    13. Inyoung Kim & Noah D. Cohen & Raymond J. Carroll, 2003. "Semiparametric Regression Splines in Matched Case-Control Studies," Biometrics, The International Biometric Society, vol. 59(4), pages 1158-1169, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Timothy K.M. Beatty & Erling Røed Larsen, 2005. "Using Engel curves to estimate bias in the Canadian CPI as a cost of living index," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 38(2), pages 482-499, May.
    2. Kalogridis, Ioannis & Van Aelst, Stefan, 2023. "Robust penalized estimators for functional linear regression," Journal of Multivariate Analysis, Elsevier, vol. 194(C).
    3. Morteza Amini & Mahdi Roozbeh & Nur Anisah Mohamed, 2024. "Separation of the Linear and Nonlinear Covariates in the Sparse Semi-Parametric Regression Model in the Presence of Outliers," Mathematics, MDPI, vol. 12(2), pages 1-17, January.
    4. Mark J. Meyer & Haobo Cheng & Katherine Hobbs Knutson, 2023. "Bayesian Analysis of Multivariate Matched Proportions with Sparse Response," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 15(2), pages 490-509, July.
    5. Giancarlo Aquila & Lucas Barros Scianni Morais & Victor Augusto Durães de Faria & José Wanderley Marangon Lima & Luana Medeiros Marangon Lima & Anderson Rodrigo de Queiroz, 2023. "An Overview of Short-Term Load Forecasting for Electricity Systems Operational Planning: Machine Learning Methods and the Brazilian Experience," Energies, MDPI, vol. 16(21), pages 1-35, November.
    6. Øystein Sørensen & Anders M. Fjell & Kristine B. Walhovd, 2023. "Longitudinal Modeling of Age-Dependent Latent Traits with Generalized Additive Latent and Mixed Models," Psychometrika, Springer;The Psychometric Society, vol. 88(2), pages 456-486, June.
    7. Katarzyna Reluga & María‐José Lombardía & Stefan Sperlich, 2023. "Simultaneous inference for linear mixed model parameters with an application to small area estimation," International Statistical Review, International Statistical Institute, vol. 91(2), pages 193-217, August.
    8. Zanin, Luca, 2023. "A flexible estimation of sectoral portfolio exposure to climate transition risks in the European stock market," Journal of Behavioral and Experimental Finance, Elsevier, vol. 39(C).
    9. Gao, Lisa & Shi, Peng, 2022. "Leveraging high-resolution weather information to predict hail damage claims: A spatial point process for replicated point patterns," Insurance: Mathematics and Economics, Elsevier, vol. 107(C), pages 161-179.
    10. Yu Liu & Chin-Shang Li, 2023. "A linear spline Cox cure model with its applications," Computational Statistics, Springer, vol. 38(2), pages 935-954, June.
    11. Sun, Shilin & Li, Qi & Hu, Wenyang & Liang, Zhongchao & Wang, Tianyang & Chu, Fulei, 2023. "Wind turbine blade breakage detection based on environment-adapted contrastive learning," Renewable Energy, Elsevier, vol. 219(P2).
    12. Caldeira, João F. & Santos, André A.P. & Torrent, Hudson S., 2023. "Semiparametric portfolios: Improving portfolio performance by exploiting non-linearities in firm characteristics," Economic Modelling, Elsevier, vol. 122(C).
    13. Benjamin Owusu & Bettina Bökemeier & Alfred Greiner, 2023. "Assessing nonlinearities and heterogeneity in debt sustainability analysis: a panel spline approach," Empirical Economics, Springer, vol. 64(3), pages 1315-1346, March.
    14. Lu, Steven Qiang & Singh, Sonika & de Roos, Nicolas, 2023. "Effects of online and offline advertising and their synergy on direct telephone sales," Journal of Retailing, Elsevier, vol. 99(3), pages 337-352.
    15. Degao Li & Guodong Li & Jinhong You, 2014. "Significant Variable Selection And Autoregressive Order Determination For Time-Series Partially Linear Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 35(5), pages 478-490, August.
    16. Hamdy F. F. Mahmoud & Inyoung Kim, 2023. "Semiparametric Integrated and Additive Spatio-Temporal Single-Index Models," Mathematics, MDPI, vol. 11(22), pages 1-15, November.
    17. Maximilian Osterhaus, 2024. "A Sparse Grid Approach for the Nonparametric Estimation of High-Dimensional Random Coefficient Models," Papers 2408.07185, arXiv.org.
    18. Otto-Sobotka, Fabian & Salvati, Nicola & Ranalli, Maria Giovanna & Kneib, Thomas, 2019. "Adaptive semiparametric M-quantile regression," Econometrics and Statistics, Elsevier, vol. 11(C), pages 116-129.
    19. Arthur Charpentier & Emmanuel Flachaire & Antoine Ly, 2017. "Econom\'etrie et Machine Learning," Papers 1708.06992, arXiv.org, revised Mar 2018.
    20. Hyunju Son & Youyi Fong, 2021. "Fast grid search and bootstrap‐based inference for continuous two‐phase polynomial regression models," Environmetrics, John Wiley & Sons, Ltd., vol. 32(3), May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:12:y:2024:i:17:p:2787-:d:1474375. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.