A Double-Penalized Estimator to Combat Separation and Multicollinearity in Logistic Regression
Author
Abstract
Suggested Citation
Download full text from publisher
References listed on IDEAS
- Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
- Rousseeuw, Peter J. & Christmann, Andreas, 2003. "Robustness against separation and outliers in logistic regression," Computational Statistics & Data Analysis, Elsevier, vol. 43(3), pages 315-332, July.
- Zorn, Christopher, 2005. "A Solution to Separation in Binary Response Models," Political Analysis, Cambridge University Press, vol. 13(2), pages 157-170, April.
- Emmanuel O. Ogundimu, 2019. "Prediction of default probability by using statistical models for rare events," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 182(4), pages 1143-1162, October.
- S. le Cessie & J. C. van Houwelingen, 1992. "Ridge Estimators in Logistic Regression," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 41(1), pages 191-201, March.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Etienne Farvaque, 2024.
"For those about to rock… is stability a determinant of rock bands success?,"
Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 48(1), pages 145-166, March.
- Etienne Farvaque, 2023. "For those about to rock… is stability a determinant of rock bands success?," Post-Print hal-04126395, HAL.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Luca Insolia & Ana Kenney & Martina Calovi & Francesca Chiaromonte, 2021. "Robust Variable Selection with Optimality Guarantees for High-Dimensional Logistic Regression," Stats, MDPI, vol. 4(3), pages 1-17, August.
- Christopher J Greenwood & George J Youssef & Primrose Letcher & Jacqui A Macdonald & Lauryn J Hagg & Ann Sanson & Jenn Mcintosh & Delyse M Hutchinson & John W Toumbourou & Matthew Fuller-Tyszkiewicz &, 2020. "A comparison of penalised regression methods for informing the selection of predictive markers," PLOS ONE, Public Library of Science, vol. 15(11), pages 1-14, November.
- Zanin, Luca, 2020. "Combining multiple probability predictions in the presence of class imbalance to discriminate between potential bad and good borrowers in the peer-to-peer lending market," Journal of Behavioral and Experimental Finance, Elsevier, vol. 25(C).
- Kamiar Rahnama Rad & Arian Maleki, 2020. "A scalable estimate of the out‐of‐sample prediction error via approximate leave‐one‐out cross‐validation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(4), pages 965-996, September.
- Adam C. Sales & Ben B. Hansen & Brian Rowan, 2018. "Rebar: Reinforcing a Matching Estimator With Predictions From High-Dimensional Covariates," Journal of Educational and Behavioral Statistics, , vol. 43(1), pages 3-31, February.
- Ayanendranath Basu & Abhik Ghosh & Maria Jaenada & Leandro Pardo, 2024. "Robust adaptive LASSO in high-dimensional logistic regression," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 33(5), pages 1217-1249, November.
- Tutz, Gerhard & Leitenstorfer, Florian, 2006. "Response shrinkage estimators in binary regression," Computational Statistics & Data Analysis, Elsevier, vol. 50(10), pages 2878-2901, June.
- Godichon-Baggioni, Antoine & Lu, Wei & Portier, Bruno, 2024. "Recursive ridge regression using second-order stochastic algorithms," Computational Statistics & Data Analysis, Elsevier, vol. 190(C).
- Faisal Zahid & Gerhard Tutz, 2013. "Ridge estimation for multinomial logit models with symmetric side constraints," Computational Statistics, Springer, vol. 28(3), pages 1017-1034, June.
- Tutz, Gerhard & Pößnecker, Wolfgang & Uhlmann, Lorenz, 2015. "Variable selection in general multinomial logit models," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 207-222.
- Ernesto Carrella & Richard M. Bailey & Jens Koed Madsen, 2018. "Indirect inference through prediction," Papers 1807.01579, arXiv.org.
- Marianna Belloc & Francesco Drago & Roberto Galbiati, 2016.
"Earthquakes, Religion, and Transition to Self-Government in ItalianCities,"
The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1875-1926.
- Marianna Belloc & Francesco Drago & Roberto Galbiati, 2015. "Earthquakes, Religion, and Transition to Self-Government in Italian Cities," CESifo Working Paper Series 5566, CESifo.
- Marianna Belloc & Francesco Drago & Roberto Galbiati, 2016. "Earthquakes, Religion, and Transition to Self-Government in Italian Cities," Post-Print hal-03392007, HAL.
- Marianna Belloc & Francesco Drago & Roberto Galbiati, 2016. "Earthquakes, Religion, and Transition to Self-Government in Italian Cities," SciencePo Working papers Main hal-03392007, HAL.
- Rui Wang & Naihua Xiu & Kim-Chuan Toh, 2021. "Subspace quadratic regularization method for group sparse multinomial logistic regression," Computational Optimization and Applications, Springer, vol. 79(3), pages 531-559, July.
- Mkhadri, Abdallah & Ouhourane, Mohamed, 2013. "An extended variable inclusion and shrinkage algorithm for correlated variables," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 631-644.
- Masakazu Higuchi & Mitsuteru Nakamura & Shuji Shinohara & Yasuhiro Omiya & Takeshi Takano & Daisuke Mizuguchi & Noriaki Sonota & Hiroyuki Toda & Taku Saito & Mirai So & Eiji Takayama & Hiroo Terashi &, 2022. "Detection of Major Depressive Disorder Based on a Combination of Voice Features: An Exploratory Approach," IJERPH, MDPI, vol. 19(18), pages 1-13, September.
- Susan Athey & Guido W. Imbens & Stefan Wager, 2018.
"Approximate residual balancing: debiased inference of average treatment effects in high dimensions,"
Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 80(4), pages 597-623, September.
- Susan Athey & Guido W. Imbens & Stefan Wager, 2016. "Approximate Residual Balancing: De-Biased Inference of Average Treatment Effects in High Dimensions," Papers 1604.07125, arXiv.org, revised Jan 2018.
- Vincent, Martin & Hansen, Niels Richard, 2014. "Sparse group lasso and high dimensional multinomial classification," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 771-786.
- Chen, Le-Yu & Lee, Sokbae, 2018.
"Best subset binary prediction,"
Journal of Econometrics, Elsevier, vol. 206(1), pages 39-56.
- Le-Yu Chen & Sokbae Lee, 2016. "Best Subset Binary Prediction," Papers 1610.02738, arXiv.org, revised May 2018.
- Le-Yu Chen & Sokbae (Simon) Lee, 2017. "Best subset binary prediction," CeMMAP working papers CWP50/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Le-Yu Chen & Sokbae (Simon) Lee, 2017. "Best subset binary prediction," CeMMAP working papers 50/17, Institute for Fiscal Studies.
- Perrot-Dockès Marie & Lévy-Leduc Céline & Chiquet Julien & Sansonnet Laure & Brégère Margaux & Étienne Marie-Pierre & Robin Stéphane & Genta-Jouve Grégory, 2018. "A variable selection approach in the multivariate linear model: an application to LC-MS metabolomics data," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 17(5), pages 1-14, October.
- Fan, Jianqing & Jiang, Bai & Sun, Qiang, 2022. "Bayesian factor-adjusted sparse regression," Journal of Econometrics, Elsevier, vol. 230(1), pages 3-19.
More about this item
Keywords
double-penalized likelihood estimator; log F -type penalty; logistic regression; multicollinearity; separation;All these keywords.
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:10:y:2022:i:20:p:3824-:d:943815. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.