IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v69y2014icp141-153.html
   My bibliography  Save this article

Information criteria: How do they behave in different models?

Author

Listed:
  • Emiliano, Paulo C.
  • Vivanco, Mário J.F.
  • de Menezes, Fortunato S.

Abstract

The choice of the best model is crucial in modeling data, and parsimony is one of the principles that must guide this choice. Despite their broad use in model selection, the foundations of the Akaike information criterion (AIC), the corrected Akaike criterion (AICc) and the Bayesian information criterion (BIC) are, in general, poorly understood. The AIC, AICc and BIC penalize the likelihoods in order to select the simplest model. These criteria are based upon concepts of information and entropy, which are explained in this work, by focusing on a statistical approach. The three criteria are compared through Monte Carlo simulations, and the applications of these criteria are investigated in the selection of normal models, the selection of biological growth models and selection of time series models. For the simulation with normal models, all three criteria exhibited poor performance for a small sample size N=100 (particularly, when the variances are slightly different). For biological growth model simulations with a very small sample size N=13 the AIC and AICc showed better performance in comparison to the BIC. The simulation based on time series models produced results similar to the normal model simulations. For these simulations, the BIC exhibited superior performance, in some cases, in comparison to the other two information criteria (AIC and AICc) for a small sample size N=100, but in other cases, the BIC performed poorly, as did the AIC and AICc.

Suggested Citation

  • Emiliano, Paulo C. & Vivanco, Mário J.F. & de Menezes, Fortunato S., 2014. "Information criteria: How do they behave in different models?," Computational Statistics & Data Analysis, Elsevier, vol. 69(C), pages 141-153.
    • Handle: RePEc:eee:csdana:v:69:y:2014:i:c:p:141-153
    DOI: 10.1016/j.csda.2013.07.032
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947313002776
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2013.07.032?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gerda Claeskens & Nils Lid Hjort, 2004. "Goodness of Fit via Non‐parametric Likelihood Ratios," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 31(4), pages 487-513, December.
    2. Claeskens,Gerda & Hjort,Nils Lid, 2008. "Model Selection and Model Averaging," Cambridge Books, Cambridge University Press, number 9780521852258, October.
    3. Hafidi, B. & Mkhadri, A., 2006. "A corrected Akaike criterion based on Kullback's symmetric divergence: applications in time series, multiple and multivariate regression," Computational Statistics & Data Analysis, Elsevier, vol. 50(6), pages 1524-1550, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Francesco Giordano & Marcella Niglio & Cosimo Damiano Vitale, 2023. "Linear approximation of the Threshold AutoRegressive model: an application to order estimation," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 32(1), pages 27-56, March.
    2. Fawen Li & Huifeng Liu & Xu Chen & Dong Yu, 2019. "Trivariate Copula Based Evaluation Model of Water Accessibility," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 33(9), pages 3211-3225, July.
    3. Rinke Saskia & Sibbertsen Philipp, 2016. "Information criteria for nonlinear time series models," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 20(3), pages 325-341, June.
    4. Vladimír Hönig & Petr Prochazka & Michal Obergruber & Luboš Smutka & Viera Kučerová, 2019. "Economic and Technological Analysis of Commercial LNG Production in the EU," Energies, MDPI, vol. 12(8), pages 1-17, April.
    5. Tobias A. Möller & Christian H. Weiß & Hee-Young Kim & Andrei Sirchenko, 2018. "Modeling Zero Inflation in Count Data Time Series with Bounded Support," Methodology and Computing in Applied Probability, Springer, vol. 20(2), pages 589-609, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kitagawa, Toru & Muris, Chris, 2016. "Model averaging in semiparametric estimation of treatment effects," Journal of Econometrics, Elsevier, vol. 193(1), pages 271-289.
    2. Jeffrey S. Racine & Qi Li & Dalei Yu & Li Zheng, 2023. "Optimal Model Averaging of Mixed-Data Kernel-Weighted Spline Regressions," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 41(4), pages 1251-1261, October.
    3. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    4. Davide Fiaschi & Andrea Mario Lavezzi & Angela Parenti, 2020. "Deep and Proximate Determinants of the World Income Distribution," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 66(3), pages 677-710, September.
    5. Fabio Canova & Christian Matthes, 2021. "Dealing with misspecification in structural macroeconometric models," Quantitative Economics, Econometric Society, vol. 12(2), pages 313-350, May.
    6. Yu, Jun & Meng, Xiran & Wang, Yaping, 2023. "Optimal designs for semi-parametric dose-response models under random contamination," Computational Statistics & Data Analysis, Elsevier, vol. 178(C).
    7. Olivier Thas, 2009. "Comments on: Goodness-of-fit tests in mixed modes," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 18(2), pages 260-264, August.
    8. Zhongqi Liang & Qihua Wang & Yuting Wei, 2022. "Robust model selection with covariables missing at random," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 74(3), pages 539-557, June.
    9. HAEDO, Christian & MOUCHART , Michel & ,, 2013. "Specialized agglomerations with areal data: model and detection," LIDAM Discussion Papers CORE 2013060, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    10. Bhattacharya, Debopam & Dupas, Pascaline, 2012. "Inferring welfare maximizing treatment assignment under budget constraints," Journal of Econometrics, Elsevier, vol. 167(1), pages 168-196.
    11. Schomaker Michael & Heumann Christian, 2011. "Model Averaging in Factor Analysis: An Analysis of Olympic Decathlon Data," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 7(1), pages 1-15, January.
    12. Dirick, Lore & Claeskens, Gerda & Vasnev, Andrey & Baesens, Bart, 2022. "A hierarchical mixture cure model with unobserved heterogeneity for credit risk," Econometrics and Statistics, Elsevier, vol. 22(C), pages 39-55.
    13. Tumala, Mohammed M & Olubusoye, Olusanya E & Yaaba, Baba N & Yaya, OlaOluwa S & Akanbi, Olawale B, 2017. "Forecasting Nigerian Inflation using Model Averaging methods: Modelling Frameworks to Central Banks," MPRA Paper 88754, University Library of Munich, Germany, revised Feb 2018.
    14. José Manuel Cordero Ferrera & Manuel Muñiz Pérez & Rosa Simancas Rodríguez, 2015. "The influence of socioeconomic factors on cognitive and non-cognitive educational outcomes," Investigaciones de Economía de la Educación volume 10, in: Marta Rahona López & Jennifer Graves (ed.), Investigaciones de Economía de la Educación 10, edition 1, volume 10, chapter 21, pages 413-438, Asociación de Economía de la Educación.
    15. Satoshi Hattori & Masayuki Henmi, 2014. "Stratified doubly robust estimators for the average causal effect," Biometrics, The International Biometric Society, vol. 70(2), pages 270-277, June.
    16. Naoya Sueishi & Arihiro Yoshimura, 2017. "Focused Information Criterion for Series Estimation in Partially Linear Models," The Japanese Economic Review, Japanese Economic Association, vol. 68(3), pages 352-363, September.
    17. Liao, Jun & Zou, Guohua, 2020. "Corrected Mallows criterion for model averaging," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    18. Tune H Pers & Anders Albrechtsen & Claus Holst & Thorkild I A Sørensen & Thomas A Gerds, 2009. "The Validation and Assessment of Machine Learning: A Game of Prediction from High-Dimensional Data," PLOS ONE, Public Library of Science, vol. 4(8), pages 1-8, August.
    19. Miao Han & Liuquan Sun & Yutao Liu & Jun Zhu, 2018. "Joint analysis of recurrent event data with additive–multiplicative hazards model for the terminal event time," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 81(5), pages 523-547, July.
    20. Robert J. B. Goudie & Sach Mukherjee & Jan-Emmanuel De Neve & Andrew J. Oswald & Stephen Wu, 2011. "Happiness as a Driver of Risk-Avoiding Behavior," CESifo Working Paper Series 3451, CESifo.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:69:y:2014:i:c:p:141-153. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.