IDEAS home Printed from https://ideas.repec.org/a/bla/istatr/v82y2014i3p422-439.html
   My bibliography  Save this article

Akaike's Information Criterion, C p and Estimators of Loss for Elliptically Symmetric Distributions

Author

Listed:
  • Aurélie Boisbunon
  • Stéphane Canu
  • Dominique Fourdrinier
  • William Strawderman
  • Martin T. Wells

Abstract

type="main" xml:id="insr12052-abs-0001"> In this article, we develop a modern perspective on Akaike's information criterion and Mallows's C p for model selection, and propose generalisations to spherically and elliptically symmetric distributions. Despite the differences in their respective motivation, C p and Akaike's information criterion are equivalent in the special case of Gaussian linear regression. In this case, they are also equivalent to a third criterion, an unbiased estimator of the quadratic prediction loss, derived from loss estimation theory. We then show that the form of the unbiased estimator of the quadratic prediction loss under a Gaussian assumption still holds under a more general distributional assumption, the family of spherically symmetric distributions. One of the features of our results is that our criterion does not rely on the specificity of the distribution, but only on its spherical symmetry. The same kind of criterion can be derived for a family of elliptically contoured distribution, which allows correlations, when considering the invariant loss. More specifically, the unbiasedness property is relative to a distribution associated to the original density.

Suggested Citation

  • Aurélie Boisbunon & Stéphane Canu & Dominique Fourdrinier & William Strawderman & Martin T. Wells, 2014. "Akaike's Information Criterion, C p and Estimators of Loss for Elliptically Symmetric Distributions," International Statistical Review, International Statistical Institute, vol. 82(3), pages 422-439, December.
  • Handle: RePEc:bla:istatr:v:82:y:2014:i:3:p:422-439
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1111/insr.12052
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Maruyama, Yuzo & Strawderman, William E., 2009. "An extended class of minimax generalized Bayes estimators of regression coefficients," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2155-2166, November.
    2. Dominique Fourdrinier & William Strawderman, 2003. "On Bayes and unbiased estimators of loss," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 55(4), pages 803-816, December.
    3. Cellier, D. & Fourdrinier, D., 1995. "Shrinkage Estimators under Spherical Symmetry for the General Linear Model," Journal of Multivariate Analysis, Elsevier, vol. 52(2), pages 338-351, February.
    4. Cellier, Dominique & Fourdrinier, Dominique & Robert, Christian, 1989. "Robust shrinkage estimators of the location parameter for elliptically symmetric distributions," Journal of Multivariate Analysis, Elsevier, vol. 29(1), pages 39-52, April.
    5. Kubokawa, T. & Srivastava, M. S., 2001. "Robust Improvement in Estimation of a Mean Matrix in an Elliptically Contoured Distribution," Journal of Multivariate Analysis, Elsevier, vol. 76(1), pages 138-152, January.
    6. Fourdrinier, Dominique & Strawderman, William E. & Wells, Martin T., 2003. "Robust shrinkage estimation for elliptically symmetric distributions with unknown covariance matrix," Journal of Multivariate Analysis, Elsevier, vol. 85(1), pages 24-39, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Matsuda, Takeru & Strawderman, William E., 2019. "Improved loss estimation for a normal mean matrix," Journal of Multivariate Analysis, Elsevier, vol. 169(C), pages 300-311.
    2. Stéphane Canu & Dominique Fourdrinier, 2023. "Data based loss estimation of the mean of a spherical distribution with a residual vector," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 86(8), pages 851-878, November.
    3. Canu, Stéphane & Fourdrinier, Dominique, 2017. "Unbiased risk estimates for matrix estimation in the elliptical case," Journal of Multivariate Analysis, Elsevier, vol. 158(C), pages 60-72.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fourdrinier Dominique & Strawderman William E. & Wells Martin T., 2009. "Improved estimation for elliptically symmetric distributions with unknown block diagonal covariance matrix," Statistics & Risk Modeling, De Gruyter, vol. 26(3), pages 203-217, April.
    2. Dominique Fourdrinier & William Strawderman, 2015. "Robust minimax Stein estimation under invariant data-based loss for spherically and elliptically symmetric distributions," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 78(4), pages 461-484, May.
    3. Fourdrinier, Dominique & Strawderman, William, 2014. "On the non existence of unbiased estimators of risk for spherically symmetric distributions," Statistics & Probability Letters, Elsevier, vol. 91(C), pages 6-13.
    4. Fourdrinier, Dominique & Strawderman, William E., 2016. "Stokes’ theorem, Stein’s identity and completeness," Statistics & Probability Letters, Elsevier, vol. 109(C), pages 224-231.
    5. Maruyama Yuzo, 2003. "A robust generalized Bayes estimator improving on the James-Stein estimator for spherically symmetric distributions," Statistics & Risk Modeling, De Gruyter, vol. 21(1), pages 69-78, January.
    6. Canu, Stéphane & Fourdrinier, Dominique, 2017. "Unbiased risk estimates for matrix estimation in the elliptical case," Journal of Multivariate Analysis, Elsevier, vol. 158(C), pages 60-72.
    7. Kubokawa, T. & Srivastava, M. S., 2001. "Robust Improvement in Estimation of a Mean Matrix in an Elliptically Contoured Distribution," Journal of Multivariate Analysis, Elsevier, vol. 76(1), pages 138-152, January.
    8. Dominique Fourdrinier & Othmane Kortbi & William Strawderman, 2014. "Generalized Bayes minimax estimators of location vectors for spherically symmetric distributions with residual vector," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 77(2), pages 285-296, February.
    9. He Kun & Strawderman William E., 2001. "Estimation In Spherically Symmetric Regression With Random Design," Statistics & Risk Modeling, De Gruyter, vol. 19(1), pages 41-50, January.
    10. Kazuhiro Ohtani, 1998. "An MSE comparison of the restricted Stein-rule and minimum mean squared error estimators in regression," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 7(2), pages 361-376, December.
    11. Matsuda, Takeru & Strawderman, William E., 2019. "Improved loss estimation for a normal mean matrix," Journal of Multivariate Analysis, Elsevier, vol. 169(C), pages 300-311.
    12. M. Tan & L. Gleser, 1992. "Minimax estimators for location vectors in elliptical distributions with unknown scale parameter and its application to variance reduction in simulation," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 44(3), pages 537-550, September.
    13. Tsukuma, Hisayuki, 2010. "Shrinkage priors for Bayesian estimation of the mean matrix in an elliptically contoured distribution," Journal of Multivariate Analysis, Elsevier, vol. 101(6), pages 1483-1492, July.
    14. Bodnar, Olha & Bodnar, Taras & Parolya, Nestor, 2022. "Recent advances in shrinkage-based high-dimensional inference," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    15. Liu, Jin Shan & Ip, Wai Cheung & Wong, Heung, 2009. "Predictive inference for singular multivariate elliptically contoured distributions," Journal of Multivariate Analysis, Elsevier, vol. 100(7), pages 1440-1446, August.
    16. Jurečková Jana & Sen P. K., 2006. "Robust multivariate location estimation, admissibility, and shrinkage phenomenon," Statistics & Risk Modeling, De Gruyter, vol. 24(2), pages 273-290, December.
    17. Dominique Fourdrinier & William Strawderman & Martin Wells, 2006. "Estimation of a Location Parameter with Restrictions or “vague information” for Spherically Symmetric Distributions," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 58(1), pages 73-92, March.
    18. William E. Strawderman & Andrew L. Rukhin, 2010. "Simultaneous estimation and reduction of nonconformity in interlaboratory studies," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(2), pages 219-234, March.
    19. Fourdrinier, Dominique & Strawderman, William E., 2008. "A unified and generalized set of shrinkage bounds on minimax Stein estimates," Journal of Multivariate Analysis, Elsevier, vol. 99(10), pages 2221-2233, November.
    20. Chételat, Didier & Wells, Martin T., 2016. "Improved second order estimation in the singular multivariate normal model," Journal of Multivariate Analysis, Elsevier, vol. 147(C), pages 1-19.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:istatr:v:82:y:2014:i:3:p:422-439. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/isiiinl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.