IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v57y2023i5d10.1007_s11135-022-01557-9.html
   My bibliography  Save this article

Simultaneous raise regression: a novel approach to combating collinearity in linear regression models

Author

Listed:
  • Jinse Jacob

    (SRM Institute of Science and Technology)

  • R. Varadharajan

    (SRM Institute of Science and Technology)

Abstract

The effect of multicollinearity deems the estimation and interpretation of regression coefficients by the method of Ordinary Least Squares (OLS) as burdensome. Even if there are alternate techniques like Ridge Regression (RR) and Liu Regression (LR) for providing a model, the statistical inference is impaired. In this study, we present the Simultaneous Raise Regression (SRR) approach, which is based on QR decomposition and reduces multicollinearity while preserving statistical inference. In contrast to the classical raise approach, the proposed strategy attains the number of variables to be raised and their corresponding raise parameter with a single step. We have designed Sequential Variation Inflation Factor for this purpose (SVIF). The performance of SRR has been compared with OLS, Ridge Regression and Liu Regression through Predictive Root Mean Square Error (PRMSE), Predictive Mean Absolute Error (PMAE) and Standard Error of the coefficients. To validate the suggested approach, a simulation study and a real-life example are presented; both outcomes imply that our proposed method outperforms the competition.

Suggested Citation

  • Jinse Jacob & R. Varadharajan, 2023. "Simultaneous raise regression: a novel approach to combating collinearity in linear regression models," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(5), pages 4365-4386, October.
    • Handle: RePEc:spr:qualqt:v:57:y:2023:i:5:d:10.1007_s11135-022-01557-9
    DOI: 10.1007/s11135-022-01557-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-022-01557-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11135-022-01557-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Feng-Jenq Lin, 2008. "Solving Multicollinearity in the Process of Fitting Regression Model Using the Nested Estimate Procedure," Quality & Quantity: International Journal of Methodology, Springer, vol. 42(3), pages 417-426, June.
    2. Catalina Garcia & José Pérez & José Liria, 2011. "The raise method. An alternative procedure to estimate the parameters in presence of collinearity," Quality & Quantity: International Journal of Methodology, Springer, vol. 45(2), pages 403-423, February.
    3. Sergio Perez-Melo & B. M. Golam Kibria, 2020. "On Some Test Statistics for Testing the Regression Coefficients in Presence of Multicollinearity: A Simulation Study," Stats, MDPI, vol. 3(1), pages 1-16, March.
    4. Massimiliano Giacalone & Demetrio Panarello & Raffaele Mattera, 2018. "Multicollinearity in regression: an efficiency comparison between Lp-norm and least squares estimators," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(4), pages 1831-1859, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Massimiliano Giacalone & Demetrio Panarello & Raffaele Mattera, 2018. "Multicollinearity in regression: an efficiency comparison between Lp-norm and least squares estimators," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(4), pages 1831-1859, July.
    2. Suwatchai Denfanapapol & Prasongchai Setthasuravich & Surapong Rattanakul & Aphisit Pukdeewut & Hironori Kato, 2024. "The Digital Divide, Wealth, and Inequality: An Examination of Socio-Economic Determinants of Collaborative Environmental Governance in Thailand through Provincial-Level Panel Data Analysis," Sustainability, MDPI, vol. 16(11), pages 1-22, May.
    3. Panarello, Demetrio, 2021. "Economic insecurity, conservatism, and the crisis of environmentalism: 30 years of evidence," Socio-Economic Planning Sciences, Elsevier, vol. 73(C).
    4. Ingvild Reymert & Taran Thune, 2023. "Task complementarity in academic work: a study of the relationship between research, education and third mission tasks among university professors," The Journal of Technology Transfer, Springer, vol. 48(1), pages 331-360, February.
    5. Román Salmerón Gómez & Catalina García García & José García Pérez, 2020. "Detection of Near-Nulticollinearity through Centered and Noncentered Regression," Mathematics, MDPI, vol. 8(6), pages 1-17, June.
    6. Alexander Robitzsch, 2020. "L p Loss Functions in Invariance Alignment and Haberman Linking with Few or Many Groups," Stats, MDPI, vol. 3(3), pages 1-38, August.
    7. Massimiliano Giacalone & Raffaele Mattera & Eugenia Nissi, 2020. "Economic indicators forecasting in presence of seasonal patterns: time series revision and prediction accuracy," Quality & Quantity: International Journal of Methodology, Springer, vol. 54(1), pages 67-84, February.
    8. Muhammad Nadir Shabbir & Muhammad Usman Arshad & Muhammad Amir Alvi & Kainat Iftikhar, 2022. "Impact of Trade Policy Uncertainty and Sustainable Development on Medical Innovation for Developed Countries: An Application of DID Approach," Sustainability, MDPI, vol. 15(1), pages 1-26, December.
    9. Nur Ainna Ramli & Hengky Latan & Gilbert V. Nartea, 2018. "Why Should PLS-SEM Be Used Rather Than Regression? Evidence from the Capital Structure Perspective," International Series in Operations Research & Management Science, in: Necmi K. Avkiran & Christian M. Ringle (ed.), Partial Least Squares Structural Equation Modeling, chapter 0, pages 171-209, Springer.
    10. Setthasuravich, Prasongchai & Sirikhan, Kulacha & Kato, Hironori, 2024. "Spatial econometric analysis of the digital divide in Thailand at the sub-district level: Patterns and determinants," Telecommunications Policy, Elsevier, vol. 48(8).
    11. Massimiliano Giacalone & Demetrio Panarello, 2022. "A Nonparametric Approach for Testing Long Memory in Stock Returns’ Higher Moments," Mathematics, MDPI, vol. 10(5), pages 1-21, February.
    12. Muhammad Usman Arshad & Muhammad Nadir Shabbir & Momna Niazi, 2023. "Trade Openness and Public Innovation: A Causality Analysis," SAGE Open, , vol. 13(3), pages 21582440231, September.
    13. Ratan J. S. Dheer, 2017. "Cross-national differences in entrepreneurial activity: role of culture and institutional factors," Small Business Economics, Springer, vol. 48(4), pages 813-842, April.
    14. Anne Michaels & Michael Grüning, 2017. "Relationship of corporate social responsibility disclosure on information asymmetry and the cost of capital," Journal of Management Control: Zeitschrift für Planung und Unternehmenssteuerung, Springer, vol. 28(3), pages 251-274, October.
    15. Kyung-Duk Min & Ju-Yeun Lee & Yeonghwa So & Sung-il Cho, 2019. "Deforestation Increases the Risk of Scrub Typhus in Korea," IJERPH, MDPI, vol. 16(9), pages 1-10, April.
    16. Roy Cerqueti & Massimiliano Giacalone & Raffaele Mattera, 2020. "Skewed non-Gaussian GARCH models for cryptocurrencies volatility modelling," Papers 2004.11674, arXiv.org.
    17. Stefania Veltri & Francesco De Luca & Ho‐Tan‐Phat Phan, 2020. "Do investors value companies' mandatory nonfinancial risk disclosure? An empirical analysis of the Italian context after the EU Directive," Business Strategy and the Environment, Wiley Blackwell, vol. 29(6), pages 2226-2237, September.
    18. Kyung-Duk Min & Jusun Hwang & Maria Cristina Schneider & Yeonghwa So & Ju-Yeun Lee & Sung-il Cho, 2021. "An exploration of the protective effect of rodent species richness on the geographical expansion of Lassa fever in West Africa," PLOS Neglected Tropical Diseases, Public Library of Science, vol. 15(2), pages 1-14, February.
    19. Kim, Do-Hoon, 2020. "Human factors influencing the ship operator's perceived risk in the last moment of collision encounter," Reliability Engineering and System Safety, Elsevier, vol. 203(C).
    20. Naveed Ahmad Faraz & Fawad Ahmed & Zhengde Xiong, 2024. "How firms leverage corporate environmental strategy to nurture green behavior: Role of multi‐level environmentally responsible leadership," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 31(1), pages 243-259, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:57:y:2023:i:5:d:10.1007_s11135-022-01557-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.