IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v8y2020i4p605-d346167.html
   My bibliography  Save this article

The VIF and MSE in Raise Regression

Author

Listed:
  • Román Salmerón Gómez

    (Department of Quantitative Methods for Economics and Business, University of Granada, 18010 Granada, Spain)

  • Ainara Rodríguez Sánchez

    (Department of Economic Theory and History, University of Granada, 18010 Granada, Spain)

  • Catalina García García

    (Department of Quantitative Methods for Economics and Business, University of Granada, 18010 Granada, Spain)

  • José García Pérez

    (Department of Economy and Company, University of Almería, 04120 Almería, Spain)

Abstract

The raise regression has been proposed as an alternative to ordinary least squares estimation when a model presents collinearity. In order to analyze whether the problem has been mitigated, it is necessary to develop measures to detect collinearity after the application of the raise regression. This paper extends the concept of the variance inflation factor to be applied in a raise regression. The relevance of this extension is that it can be applied to determine the raising factor which allows an optimal application of this technique. The mean square error is also calculated since the raise regression provides a biased estimator. The results are illustrated by two empirical examples where the application of the raise estimator is compared to the application of the ridge and Lasso estimators that are commonly applied to estimate models with multicollinearity as an alternative to ordinary least squares.

Suggested Citation

  • Román Salmerón Gómez & Ainara Rodríguez Sánchez & Catalina García García & José García Pérez, 2020. "The VIF and MSE in Raise Regression," Mathematics, MDPI, vol. 8(4), pages 1-28, April.
    • Handle: RePEc:gam:jmathe:v:8:y:2020:i:4:p:605-:d:346167
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/8/4/605/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/8/4/605/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Wenxing Guo & Xiaohui Liu & Shangli Zhang, 2016. "The principal correlation components estimator and its optimality," Statistical Papers, Springer, vol. 57(3), pages 755-779, September.
    2. Mia Hubert & Irène Gijbels & Dina Vanpaemel, 2013. "Reducing the mean squared error of quantile-based estimators by smoothing," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(3), pages 448-465, September.
    3. Yalian Li & Hu Yang, 2012. "A new Liu-type estimator in linear regression model," Statistical Papers, Springer, vol. 53(2), pages 427-437, May.
    4. Yoshimasa Uematsu & Shinya Tanaka, 2019. "High†dimensional macroeconomic forecasting and variable selection via penalized regression," The Econometrics Journal, Royal Economic Society, vol. 22(1), pages 34-56.
    5. Artur Klinger, 2001. "Inference in high dimensional generalized linear models based on soft thresholding," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(2), pages 377-392.
    6. Kazuhiro Ohtani, 1998. "An MSE comparison of the restricted Stein-rule and minimum mean squared error estimators in regression," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 7(2), pages 361-376, December.
    7. Golan, Amos, 2008. "Information and Entropy Econometrics — A Review and Synthesis," Foundations and Trends(R) in Econometrics, now publishers, vol. 2(1–2), pages 1-145, February.
    8. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    9. M. Aguilera-Morillo & Ana Aguilera & Manuel Escabias & Mariano Valderrama, 2013. "Penalized spline approaches for functional logit regression," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(2), pages 251-277, June.
    10. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    11. Catalina Garcia & José Pérez & José Liria, 2011. "The raise method. An alternative procedure to estimate the parameters in presence of collinearity," Quality & Quantity: International Journal of Methodology, Springer, vol. 45(2), pages 403-423, February.
    12. Henk Kiers & Age Smilde, 2007. "A comparison of various methods for multivariate regression with highly collinear variables," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 16(2), pages 193-228, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rasha Ashraf, 2024. "Bank Customer Churn Prediction Using Machine Learning Framework," Journal of Applied Finance & Banking, SCIENPRESS Ltd, vol. 14(4), pages 1-5.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    2. Román Salmerón Gómez & Catalina García García & José García Pérez, 2020. "Detection of Near-Nulticollinearity through Centered and Noncentered Regression," Mathematics, MDPI, vol. 8(6), pages 1-17, June.
    3. Murat Genç, 2022. "A new double-regularized regression using Liu and lasso regularization," Computational Statistics, Springer, vol. 37(1), pages 159-227, March.
    4. Harold A. Hernández-Roig & M. Carmen Aguilera-Morillo & Rosa E. Lillo, 2021. "Functional Modeling of High-Dimensional Data: A Manifold Learning Approach," Mathematics, MDPI, vol. 9(4), pages 1-22, February.
    5. Mogliani, Matteo & Simoni, Anna, 2021. "Bayesian MIDAS penalized regressions: Estimation, selection, and prediction," Journal of Econometrics, Elsevier, vol. 222(1), pages 833-860.
    6. Ning Li & Hu Yang, 2021. "Nonnegative estimation and variable selection under minimax concave penalty for sparse high-dimensional linear regression models," Statistical Papers, Springer, vol. 62(2), pages 661-680, April.
    7. Richard Schnorrenberger & Aishameriane Schmidt & Guilherme Valle Moura, 2024. "Harnessing Machine Learning for Real-Time Inflation Nowcasting," Working Papers 806, DNB.
    8. Yoshiki Nakajima & Naoya Sueishi, 2022. "Forecasting the Japanese macroeconomy using high-dimensional data," The Japanese Economic Review, Springer, vol. 73(2), pages 299-324, April.
    9. Zemin Zheng & Jinchi Lv & Wei Lin, 2021. "Nonsparse Learning with Latent Variables," Operations Research, INFORMS, vol. 69(1), pages 346-359, January.
    10. Matsui, Hidetoshi, 2014. "Variable and boundary selection for functional data via multiclass logistic regression modeling," Computational Statistics & Data Analysis, Elsevier, vol. 78(C), pages 176-185.
    11. Lansangan, Joseph Ryan G. & Barrios, Erniel B., 2017. "Simultaneous dimension reduction and variable selection in modeling high dimensional data," Computational Statistics & Data Analysis, Elsevier, vol. 112(C), pages 242-256.
    12. Lee, Juyong & Reiner, David M., 2023. "Determinants of public preferences on low-carbon energy sources: Evidence from the United Kingdom," Energy, Elsevier, vol. 284(C).
    13. Tutz, Gerhard & Pößnecker, Wolfgang & Uhlmann, Lorenz, 2015. "Variable selection in general multinomial logit models," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 207-222.
    14. Carstensen, Kai & Heinrich, Markus & Reif, Magnus & Wolters, Maik H., 2020. "Predicting ordinary and severe recessions with a three-state Markov-switching dynamic factor model," International Journal of Forecasting, Elsevier, vol. 36(3), pages 829-850.
    15. Hou-Tai Chang & Ping-Huai Wang & Wei-Fang Chen & Chen-Ju Lin, 2022. "Risk Assessment of Early Lung Cancer with LDCT and Health Examinations," IJERPH, MDPI, vol. 19(8), pages 1-12, April.
    16. Wang, Qiao & Zhou, Wei & Cheng, Yonggang & Ma, Gang & Chang, Xiaolin & Miao, Yu & Chen, E, 2018. "Regularized moving least-square method and regularized improved interpolating moving least-square method with nonsingular moment matrices," Applied Mathematics and Computation, Elsevier, vol. 325(C), pages 120-145.
    17. Mkhadri, Abdallah & Ouhourane, Mohamed, 2013. "An extended variable inclusion and shrinkage algorithm for correlated variables," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 631-644.
    18. Lucian Belascu & Alexandra Horobet & Georgiana Vrinceanu & Consuela Popescu, 2021. "Performance Dissimilarities in European Union Manufacturing: The Effect of Ownership and Technological Intensity," Sustainability, MDPI, vol. 13(18), pages 1-19, September.
    19. Candelon, B. & Hurlin, C. & Tokpavi, S., 2012. "Sampling error and double shrinkage estimation of minimum variance portfolios," Journal of Empirical Finance, Elsevier, vol. 19(4), pages 511-527.
    20. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2025. "Specification Choices in Quantile Regression for Empirical Macroeconomics," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 40(1), pages 57-73, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:8:y:2020:i:4:p:605-:d:346167. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.