IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v12y2024i19p3139-d1493583.html
   My bibliography  Save this article

Modified Liu Parameters for Scaling Options of the Multiple Regression Model with Multicollinearity Problem

Author

Listed:
  • Autcha Araveeporn

    (Department of Statistics, School of Science, King Mongkut’s Institute of Technology Ladkrabang, Bangkok 10520, Thailand)

Abstract

The multiple regression model statistical technique is employed to analyze the relationship between the dependent variable and several independent variables. The multicollinearity problem is one of the issues affecting the multiple regression model, occurring in regard to the relationship among independent variables. The ordinal least square is the standard method to evaluate parameters in the regression model, but the multicollinearity problem affects the unstable estimator. Liu regression is proposed to approximate the Liu estimators based on the Liu parameter, to overcome multicollinearity. In this paper, we propose a modified Liu parameter to estimate the biasing parameter in scaling options, comparing the ordinal least square estimator with two modified Liu parameters and six standard Liu parameters. The performance of the modified Liu parameter is considered, generating independent variables from the multivariate normal distribution in the Toeplitz correlation pattern as the multicollinearity data, where the dependent variable is obtained from the independent variable multiplied by a coefficient of regression and the error from the normal distribution. The mean absolute percentage error is computed as an evaluation criterion of the estimation. For application, a real Hepatitis C patients dataset was used, in order to investigate the benefit of the modified Liu parameter. Through simulation and real dataset analysis, the results indicate that the modified Liu parameter outperformed the other Liu parameters and the ordinal least square estimator. It can be recommended to the user for estimating parameters via the modified Liu parameter when the independent variable exhibits the multicollinearity problem.

Suggested Citation

  • Autcha Araveeporn, 2024. "Modified Liu Parameters for Scaling Options of the Multiple Regression Model with Multicollinearity Problem," Mathematics, MDPI, vol. 12(19), pages 1-18, October.
    • Handle: RePEc:gam:jmathe:v:12:y:2024:i:19:p:3139-:d:1493583
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/12/19/3139/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/12/19/3139/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Muhammad Suhail & Iqra Babar & Yousaf Ali Khan & Muhammad Imran & Zeeshan Nawaz, 2021. "Quantile-Based Estimation of Liu Parameter in the Linear Regression Model: Applications to Portland Cement and US Crime Data," Mathematical Problems in Engineering, Hindawi, vol. 2021, pages 1-11, July.
    2. Yuli Liang & Dietrich Rosen & Tatjana Rosen, 2021. "On properties of Toeplitz-type covariance matrices in models with nested random effects," Statistical Papers, Springer, vol. 62(6), pages 2509-2528, December.
    3. Hu Yang & Jianwen Xu, 2009. "An alternative stochastic restricted Liu estimator in linear regression," Statistical Papers, Springer, vol. 50(3), pages 639-647, June.
    4. Druilhet, Pierre & Mom, Alain, 2008. "Shrinkage structure in biased regression," Journal of Multivariate Analysis, Elsevier, vol. 99(2), pages 232-244, February.
    5. M. Hubert & P. Wijekoon, 2006. "Improvement of the Liu estimator in linear regression model," Statistical Papers, Springer, vol. 47(3), pages 471-479, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Akdeniz Duran, Esra & Härdle, Wolfgang Karl & Osipenko, Maria, 2012. "Difference based ridge and Liu type estimators in semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 105(1), pages 164-175.
    2. Murat Genç, 2022. "A new double-regularized regression using Liu and lasso regularization," Computational Statistics, Springer, vol. 37(1), pages 159-227, March.
    3. Roozbeh, Mahdi, 2018. "Optimal QR-based estimation in partially linear regression models with correlated errors using GCV criterion," Computational Statistics & Data Analysis, Elsevier, vol. 117(C), pages 45-61.
    4. Sivarajah Arumairajan & Pushpakanthie Wijekoon, 2017. "The generalized preliminary test estimator when different sets of stochastic restrictions are available," Statistical Papers, Springer, vol. 58(3), pages 729-747, September.
    5. Esra Akdeniz Duran & Fikri Akdeniz, 2012. "Efficiency of the modified jackknifed Liu-type estimator," Statistical Papers, Springer, vol. 53(2), pages 265-280, May.
    6. Liang, Yuli & Hao, Chengcheng & Dai, Deliang, 2024. "Two-sample intraclass correlation coefficient tests for matrix-valued data," Working Papers in Economics and Statistics 6/2024, Linnaeus University, School of Business and Economics, Department of Economics and Statistics.
    7. Yalian Li & Hu Yang, 2010. "A new stochastic mixed ridge estimator in linear regression model," Statistical Papers, Springer, vol. 51(2), pages 315-323, June.
    8. Ning Li & Hu Yang, 2021. "Nonnegative estimation and variable selection under minimax concave penalty for sparse high-dimensional linear regression models," Statistical Papers, Springer, vol. 62(2), pages 661-680, April.
    9. Yalian Li & Hu Yang, 2019. "Performance of the restricted almost unbiased type principal components estimators in linear regression model," Statistical Papers, Springer, vol. 60(1), pages 19-34, February.
    10. Aboobacker Jahufer & Jianbao Chen, 2012. "Identifying local influential observations in Liu estimator," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 75(3), pages 425-438, April.
    11. Kristofer Månsson & B. M. Golam Kibria, 2021. "Estimating the Unrestricted and Restricted Liu Estimators for the Poisson Regression Model: Method and Application," Computational Economics, Springer;Society for Computational Economics, vol. 58(2), pages 311-326, August.
    12. Hu Yang & Jianwen Xu, 2009. "An alternative stochastic restricted Liu estimator in linear regression," Statistical Papers, Springer, vol. 50(3), pages 639-647, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:12:y:2024:i:19:p:3139-:d:1493583. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.