IDEAS home Printed from https://ideas.repec.org/a/spr/sankha/v80y2018i2d10.1007_s13171-017-0122-6.html
   My bibliography  Save this article

Efficient Shrinkage for Generalized Linear Mixed Models Under Linear Restrictions

Author

Listed:
  • T. Thomson

    (University of Winnipeg)

  • S. Hossain

    (University of Winnipeg)

Abstract

In this paper, we consider the pretest, shrinkage, and penalty estimation procedures for generalized linear mixed models when it is conjectured that some of the regression parameters are restricted to a linear subspace. We develop the statistical properties of the pretest and shrinkage estimation methods, which include asymptotic distributional biases and risks. We show that the pretest and shrinkage estimators have a significantly higher relative efficiency than the classical estimator. Furthermore, we consider the penalty estimator LASSO (Least Absolute Shrinkage and Selection Operator), and numerically compare its relative performance with that of the other estimators. A series of Monte Carlo simulation experiments are conducted with different combinations of inactive predictors, and the performance of each estimator is evaluated in terms of the simulated mean squared error. The study shows that the shrinkage and pretest estimators are comparable to the LASSO estimator when the number of inactive predictors in the model is relatively large. The estimators under consideration are applied to a real data set to illustrate the usefulness of the procedures in practice.

Suggested Citation

  • T. Thomson & S. Hossain, 2018. "Efficient Shrinkage for Generalized Linear Mixed Models Under Linear Restrictions," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 80(2), pages 385-410, August.
    • Handle: RePEc:spr:sankha:v:80:y:2018:i:2:d:10.1007_s13171-017-0122-6
    DOI: 10.1007/s13171-017-0122-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s13171-017-0122-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s13171-017-0122-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lu, Xun & Su, Liangjun, 2016. "Shrinkage estimation of dynamic panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 190(1), pages 148-175.
    2. Lian, Heng, 2012. "Shrinkage estimation for identification of linear components in additive models," Statistics & Probability Letters, Elsevier, vol. 82(2), pages 225-231.
    3. Liangjun Su & Yonghui Zhang, 2016. "Semiparametric Estimation of Partially Linear Dynamic Panel Data Models with Fixed Effects," Advances in Econometrics, in: Essays in Honor of Aman Ullah, volume 36, pages 137-204, Emerald Group Publishing Limited.
    4. Jamshidian, Mortaza, 2004. "On algorithms for restricted maximum likelihood estimation," Computational Statistics & Data Analysis, Elsevier, vol. 45(2), pages 137-157, March.
    5. David G. Luenberger & Yinyu Ye, 2008. "Linear and Nonlinear Programming," International Series in Operations Research and Management Science, Springer, edition 0, number 978-0-387-74503-9, January.
    6. Raheem, S.M. Enayetur & Ahmed, S. Ejaz & Doksum, Kjell A., 2012. "Absolute penalty and shrinkage estimation in partially linear models," Computational Statistics & Data Analysis, Elsevier, vol. 56(4), pages 874-891.
    7. Teng Zhang & Hui Zou, 2014. "Sparse precision matrix estimation via lasso penalized D-trace loss," Biometrika, Biometrika Trust, vol. 101(1), pages 103-120.
    8. Fahrmeir, Ludwig & Kneib, Thomas, 2011. "Bayesian Smoothing and Regression for Longitudinal, Spatial and Event History Data," OUP Catalogue, Oxford University Press, number 9780199533022.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Feng, Guohua & Gao, Jiti & Peng, Bin, 2022. "An integrated panel data approach to modelling economic growth," Journal of Econometrics, Elsevier, vol. 228(2), pages 379-397.
    2. Yuki Takara & Shingo Takagi, 2023. "An empirical approach to measure unobserved cultural relations using music trade data," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 47(2), pages 205-245, June.
    3. Huang, Wenxin & Jin, Sainan & Phillips, Peter C.B. & Su, Liangjun, 2021. "Nonstationary panel models with latent group structures and cross-section dependence," Journal of Econometrics, Elsevier, vol. 221(1), pages 198-222.
    4. Ye, Xiaoqing & Xu, Juan & Wu, Xiangjun, 2018. "Estimation of an unbalanced panel data Tobit model with interactive effects," Journal of choice modelling, Elsevier, vol. 28(C), pages 108-123.
    5. Ruiqi Liu & Ben Boukai & Zuofeng Shang, 2019. "Statistical Inference on Partially Linear Panel Model under Unobserved Linearity," Papers 1911.08830, arXiv.org.
    6. Ayden Higgins & Federico Martellosio, 2019. "Shrinkage Estimation of Network Spillovers with Factor Structured Errors," Papers 1909.02823, arXiv.org, revised Nov 2021.
    7. Cheng Hsiao & Yimeng Xie & Qiankun Zhou, 2021. "Factor dimension determination for panel interactive effects models: an orthogonal projection approach," Computational Statistics, Springer, vol. 36(2), pages 1481-1497, June.
    8. Hyungsik Roger Moon & Martin Weidner, 2018. "Nuclear Norm Regularized Estimation of Panel Regression Models," Papers 1810.10987, arXiv.org, revised Jun 2023.
    9. Vogt, M. & Walsh, C. & Linton, O., 2022. "CCE Estimation of High-Dimensional Panel Data Models with Interactive Fixed Effects," Janeway Institute Working Papers 2218, Faculty of Economics, University of Cambridge.
    10. Vogt, M. & Walsh, C. & Linton, O., 2022. "CCE Estimation of High-Dimensional Panel Data Models with Interactive Fixed Effects," Cambridge Working Papers in Economics 2242, Faculty of Economics, University of Cambridge.
    11. Hsiao, Cheng, 2018. "Panel models with interactive effects," Journal of Econometrics, Elsevier, vol. 206(2), pages 645-673.
    12. Yufeng Mao & Bin Peng & Mervyn J Silvapulle & Param Silvapulle & Yanrong Yang, 2021. "Decomposition of Bilateral Trade Flows Using a Three-Dimensional Panel Data Model," Monash Econometrics and Business Statistics Working Papers 7/21, Monash University, Department of Econometrics and Business Statistics.
    13. Chiang, Harold D. & Rodrigue, Joel & Sasaki, Yuya, 2023. "Post-Selection Inference In Three-Dimensional Panel Data," Econometric Theory, Cambridge University Press, vol. 39(3), pages 623-658, June.
    14. Avagyan, Vahe & Nogales, Francisco J., 2015. "D-trace Precision Matrix Estimation Using Adaptive Lasso Penalties," DES - Working Papers. Statistics and Econometrics. WS 21775, Universidad Carlos III de Madrid. Departamento de Estadística.
    15. Shahmohammadi, Ali & Sioshansi, Ramteen & Conejo, Antonio J. & Afsharnia, Saeed, 2018. "Market equilibria and interactions between strategic generation, wind, and storage," Applied Energy, Elsevier, vol. 220(C), pages 876-892.
    16. Alp Atakan & Mehmet Ekmekci & Ludovic Renou, 2021. "Cross-verification and Persuasive Cheap Talk," Papers 2102.13562, arXiv.org, revised Apr 2021.
    17. Arthur Medeiros & Thales Ramos & José Tavares de Oliveira & Manoel F. Medeiros Júnior, 2020. "Direct Voltage Control of a Doubly Fed Induction Generator by Means of Optimal Strategy," Energies, MDPI, vol. 13(3), pages 1-28, February.
    18. Ivorra, Benjamin & Mohammadi, Bijan & Manuel Ramos, Angel, 2015. "A multi-layer line search method to improve the initialization of optimization algorithms," European Journal of Operational Research, Elsevier, vol. 247(3), pages 711-720.
    19. Jagannadha Pawan Tamvada, 2015. "The Spatial Distribution of Self-Employment in India: Evidence from Semiparametric Geoadditive Models," Regional Studies, Taylor & Francis Journals, vol. 49(2), pages 300-322, February.
    20. Tanaka, Ken'ichiro & Toda, Alexis Akira, 2015. "Discretizing Distributions with Exact Moments: Error Estimate and Convergence Analysis," University of California at San Diego, Economics Working Paper Series qt7g23r5kh, Department of Economics, UC San Diego.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:sankha:v:80:y:2018:i:2:d:10.1007_s13171-017-0122-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.