IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v167y2022ics0167947321001857.html
   My bibliography  Save this article

Model averaging for linear mixed models via augmented Lagrangian

Author

Listed:
  • Kruse, René-Marcel
  • Silbersdorff, Alexander
  • Säfken, Benjamin

Abstract

Model selection for linear mixed models has been a focus of recent research in statistics. Yet, the method of model averaging has been sparsely explored in this context. A weight finding criterion for model averaging of linear mixed models is introduced, as well as its implementation for the programming language R. Since the optimization of the underlying criterion is non-trivial, a fast and robust implementation of the augmented Lagrangian optimization technique is employed. Furthermore, the influence of the weight finding criterion on the resulting model averaging estimator is illustrated through simulation studies and two applications based on real data.

Suggested Citation

  • Kruse, René-Marcel & Silbersdorff, Alexander & Säfken, Benjamin, 2022. "Model averaging for linear mixed models via augmented Lagrangian," Computational Statistics & Data Analysis, Elsevier, vol. 167(C).
    • Handle: RePEc:eee:csdana:v:167:y:2022:i:c:s0167947321001857
    DOI: 10.1016/j.csda.2021.107351
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947321001857
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2021.107351?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bartolucci, Francesco & Bacci, Silvia & Pigini, Claudia, 2017. "Misspecification test for random effects in generalized linear finite-mixture models for clustered binary and ordered data," Econometrics and Statistics, Elsevier, vol. 3(C), pages 112-131.
    2. Benjamin Säfken & Thomas Kneib, 2020. "Conditional covariance penalties for mixed models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(3), pages 990-1010, September.
    3. Wensheng Guo, 2002. "Functional Mixed Effects Models," Biometrics, The International Biometric Society, vol. 58(1), pages 121-128, March.
    4. Chengbo Li & Wotao Yin & Hong Jiang & Yin Zhang, 2013. "An efficient augmented Lagrangian method with applications to total variation minimization," Computational Optimization and Applications, Springer, vol. 56(3), pages 507-530, December.
    5. Bradley Efron, 2004. "The Estimation of Prediction Error: Covariance Penalties and Cross-Validation," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 619-632, January.
    6. Simon N. Wood, 2013. "A simple test for random effects in regression models," Biometrika, Biometrika Trust, vol. 100(4), pages 1005-1010.
    7. Florin Vaida & Suzette Blanchard, 2005. "Conditional Akaike information for mixed-effects models," Biometrika, Biometrika Trust, vol. 92(2), pages 351-370, June.
    8. repec:cup:cbooks:9780521780506 is not listed on IDEAS
    9. Simon N. Wood & Natalya Pya & Benjamin Säfken, 2016. "Smoothing Parameter and Model Selection for General Smooth Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1548-1563, October.
    10. David G. Luenberger & Yinyu Ye, 2008. "Linear and Nonlinear Programming," International Series in Operations Research and Management Science, Springer, edition 0, number 978-0-387-74503-9, December.
    11. Xinyu Zhang & Guohua Zou & Hua Liang, 2014. "Model averaging and weight choice in linear mixed-effects models," Biometrika, Biometrika Trust, vol. 101(1), pages 205-218.
    12. Ciprian M. Crainiceanu & David Ruppert, 2004. "Likelihood ratio tests in linear mixed models with one variance component," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(1), pages 165-185, February.
    13. repec:cup:cbooks:9780521785167 is not listed on IDEAS
    14. Alexander Silbersdorff & Julia Lynch & Stephan Klasen & Thomas Kneib, 2018. "Reconsidering the income‐health relationship using distributional regression," Health Economics, John Wiley & Sons, Ltd., vol. 27(7), pages 1074-1088, July.
    15. Hua Liang & Hulin Wu & Guohua Zou, 2008. "A note on conditional aic for linear mixed-effects models," Biometrika, Biometrika Trust, vol. 95(3), pages 773-778.
    16. Sonja Greven & Thomas Kneib, 2010. "On the behaviour of marginal and conditional AIC in linear mixed models," Biometrika, Biometrika Trust, vol. 97(4), pages 773-789.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Braun, Julia & Sabanés Bové, Daniel & Held, Leonhard, 2014. "Choice of generalized linear mixed models using predictive crossvalidation," Computational Statistics & Data Analysis, Elsevier, vol. 75(C), pages 190-202.
    2. Cantoni, Eva & Jacot, Nadège & Ghisletta, Paolo, 2024. "Review and comparison of measures of explained variation and model selection in linear mixed-effects models," Econometrics and Statistics, Elsevier, vol. 29(C), pages 150-168.
    3. Benjamin Säfken & Thomas Kneib, 2020. "Conditional covariance penalties for mixed models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(3), pages 990-1010, September.
    4. Jonathan Bradley & Noel Cressie & Tao Shi, 2015. "Comparing and selecting spatial predictors using local criteria," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 24(1), pages 1-28, March.
    5. Simona Buscemi & Antonella Plaia, 2020. "Model selection in linear mixed-effect models," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 104(4), pages 529-575, December.
    6. Kawakubo, Yuki & Kubokawa, Tatsuya, 2014. "Modified conditional AIC in linear mixed models," Journal of Multivariate Analysis, Elsevier, vol. 129(C), pages 44-56.
    7. Zhang, Xinyu & Yu, Jihai, 2018. "Spatial weights matrix selection and model averaging for spatial autoregressive models," Journal of Econometrics, Elsevier, vol. 203(1), pages 1-18.
    8. Yu, Dalei & Yau, Kelvin K.W., 2012. "Conditional Akaike information criterion for generalized linear mixed models," Computational Statistics & Data Analysis, Elsevier, vol. 56(3), pages 629-644.
    9. Overholser, Rosanna & Xu, Ronghui, 2014. "Effective degrees of freedom and its application to conditional AIC for linear mixed-effects models with correlated error structures," Journal of Multivariate Analysis, Elsevier, vol. 132(C), pages 160-170.
    10. Yu, Dalei & Zhang, Xinyu & Yau, Kelvin K.W., 2013. "Information based model selection criteria for generalized linear mixed models with unknown variance component parameters," Journal of Multivariate Analysis, Elsevier, vol. 116(C), pages 245-262.
    11. Philipp F. M. Baumann & Enzo Rossi & Alexander Volkmann, 2020. "What Drives Inflation and How: Evidence from Additive Mixed Models Selected by cAIC," Papers 2006.06274, arXiv.org, revised Aug 2022.
    12. Øystein Sørensen & Anders M. Fjell & Kristine B. Walhovd, 2023. "Longitudinal Modeling of Age-Dependent Latent Traits with Generalized Additive Latent and Mixed Models," Psychometrika, Springer;The Psychometric Society, vol. 88(2), pages 456-486, June.
    13. Colin Griesbach & Andreas Groll & Elisabeth Bergherr, 2021. "Addressing cluster-constant covariates in mixed effects models via likelihood-based boosting techniques," PLOS ONE, Public Library of Science, vol. 16(7), pages 1-17, July.
    14. Mojtaba Ganjali & Taban Baghfalaki, 2018. "Application of Penalized Mixed Model in Identification of Genes in Yeast Cell-Cycle Gene Expression Data," Biostatistics and Biometrics Open Access Journal, Juniper Publishers Inc., vol. 6(2), pages 38-41, April.
    15. Sun-Joo Cho & Sarah Brown-Schmidt & Paul De Boeck & Matthew Naveiras & Si On Yoon & Aaron Benjamin, 2023. "Incorporating Functional Response Time Effects into a Signal Detection Theory Model," Psychometrika, Springer;The Psychometric Society, vol. 88(3), pages 1056-1086, September.
    16. Roel Verbelen & Katrien Antonio & Gerda Claeskens, 2018. "Unravelling the predictive power of telematics data in car insurance pricing," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 67(5), pages 1275-1304, November.
    17. Baey, Charlotte & Cournède, Paul-Henry & Kuhn, Estelle, 2019. "Asymptotic distribution of likelihood ratio test statistics for variance components in nonlinear mixed effects models," Computational Statistics & Data Analysis, Elsevier, vol. 135(C), pages 107-122.
    18. Simon N. Wood, 2020. "Inference and computation with generalized additive models and their extensions," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 29(2), pages 307-339, June.
    19. Sonja Greven & Fabian Scheipl, 2020. "Comments on: Inference and computation with Generalized Additive Models and their extensions," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 29(2), pages 343-350, June.
    20. Craiu, Radu V. & Duchesne, Thierry, 2018. "A scalable and efficient covariate selection criterion for mixed effects regression models with unknown random effects structure," Computational Statistics & Data Analysis, Elsevier, vol. 117(C), pages 154-161.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:167:y:2022:i:c:s0167947321001857. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.