IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v99y2008i9p1888-1905.html
   My bibliography  Save this article

Bayesian shrinkage prediction for the regression problem

Author

Listed:
  • Kobayashi, Kei
  • Komaki, Fumiyasu

Abstract

We consider Bayesian shrinkage predictions for the Normal regression problem under the frequentist Kullback-Leibler risk function. Firstly, we consider the multivariate Normal model with an unknown mean and a known covariance. While the unknown mean is fixed, the covariance of future samples can be different from that of training samples. We show that the Bayesian predictive distribution based on the uniform prior is dominated by that based on a class of priors if the prior distributions for the covariance and future covariance matrices are rotation invariant. Then, we consider a class of priors for the mean parameters depending on the future covariance matrix. With such a prior, we can construct a Bayesian predictive distribution dominating that based on the uniform prior. Lastly, applying this result to the prediction of response variables in the Normal linear regression model, we show that there exists a Bayesian predictive distribution dominating that based on the uniform prior. Minimaxity of these Bayesian predictions follows from these results.

Suggested Citation

  • Kobayashi, Kei & Komaki, Fumiyasu, 2008. "Bayesian shrinkage prediction for the regression problem," Journal of Multivariate Analysis, Elsevier, vol. 99(9), pages 1888-1905, October.
  • Handle: RePEc:eee:jmvana:v:99:y:2008:i:9:p:1888-1905
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047-259X(08)00036-5
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. George, Edward I. & Xu, Xinyi, 2008. "Predictive Density Estimation For Multiple Regression," Econometric Theory, Cambridge University Press, vol. 24(2), pages 528-544, April.
    2. Marriott,Paul & Salmon,Mark (ed.), 2000. "Applications of Differential Geometry to Econometrics," Cambridge Books, Cambridge University Press, number 9780521651165, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Komaki, Fumiyasu, 2015. "Simultaneous prediction for independent Poisson processes with different durations," Journal of Multivariate Analysis, Elsevier, vol. 141(C), pages 35-48.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Parente, Paulo M.D.C. & Smith, Richard J., 2011. "Gel Methods For Nonsmooth Moment Indicators," Econometric Theory, Cambridge University Press, vol. 27(1), pages 74-113, February.
    2. Antoine, Bertille & Bonnal, Helene & Renault, Eric, 2007. "On the efficient use of the informational content of estimating equations: Implied probabilities and Euclidean empirical likelihood," Journal of Econometrics, Elsevier, vol. 138(2), pages 461-487, June.
    3. Michael Jansson, 2008. "Semiparametric Power Envelopes for Tests of the Unit Root Hypothesis," Econometrica, Econometric Society, vol. 76(5), pages 1103-1142, September.
    4. Bontemps, Christophe & Mizon, Grayham E., 2001. "Congruence and encompassing," Discussion Paper Series In Economics And Econometrics 107, Economics Division, School of Social Sciences, University of Southampton.
    5. Jean-Marie Dufour & Alain Trognon & Purevdorj Tuvaandorj, 2017. "Invariant tests based on M -estimators, estimating functions, and the generalized method of moments," Econometric Reviews, Taylor & Francis Journals, vol. 36(1-3), pages 182-204, March.
    6. Smith, Richard J., 2011. "Gel Criteria For Moment Condition Models," Econometric Theory, Cambridge University Press, vol. 27(6), pages 1192-1235, December.
    7. Xu, Xinyi & Zhou, Dunke, 2011. "Empirical Bayes predictive densities for high-dimensional normal models," Journal of Multivariate Analysis, Elsevier, vol. 102(10), pages 1417-1428, November.
    8. Yuichi Kitamura, 2006. "Empirical Likelihood Methods in Econometrics: Theory and Practice," CIRJE F-Series CIRJE-F-430, CIRJE, Faculty of Economics, University of Tokyo.
    9. Guggenberger, Patrik & Smith, Richard J., 2008. "Generalized empirical likelihood tests in time series models with potential identification failure," Journal of Econometrics, Elsevier, vol. 142(1), pages 134-161, January.
    10. Jansson, Michael, 2004. "Stationarity Testing With Covariates," Econometric Theory, Cambridge University Press, vol. 20(1), pages 56-94, February.
    11. Imbens, Guido W. & Spady, Richard, 2002. "Confidence intervals in generalized method of moments models," Journal of Econometrics, Elsevier, vol. 107(1-2), pages 87-98, March.
    12. Takeru Matsuda & Fumiyasu Komaki, 2015. "Singular value shrinkage priors for Bayesian prediction," Biometrika, Biometrika Trust, vol. 102(4), pages 843-854.
    13. James Morley & Irina B. Panovska & Tara M. Sinclair, 2014. "Testing Stationarity for Unobserved Components Models," Discussion Papers 2012-41B, School of Economics, The University of New South Wales.
    14. Komaki, Fumiyasu, 2015. "Simultaneous prediction for independent Poisson processes with different durations," Journal of Multivariate Analysis, Elsevier, vol. 141(C), pages 35-48.
    15. Alain Guay & Jean-Francois Lamarche, 2005. "The Information Content of Implied Probabilities to Detect Structural Change," Working Papers 0804, Brock University, Department of Economics, revised Oct 2008.
    16. Bontemps, Christophe & Mizon, Grayham E., 2001. "Congruence and encompassing," Discussion Paper Series In Economics And Econometrics 0107, Economics Division, School of Social Sciences, University of Southampton.
    17. Abdelkamel Alj & Rajae Azrak & Guy Melard, 2014. "On Conditions in Central Limit Theorems for Martingale Difference Arrays Long Version," Working Papers ECARES ECARES 2014-05, ULB -- Universite Libre de Bruxelles.
    18. Andrea Loi & Stefano Matta & Daria Uccheddu, 2023. "Uniqueness of equilibrium and redistributive policies: a geometric approach to efficiency," Papers 2308.03706, arXiv.org.
    19. Alain Guay & Florian Pelgrin, 2007. "Using Implied Probabilities to Improve Estimation with Unconditional Moment Restrictions," Cahiers de recherche 0747, CIRPEE.
    20. Patrik Guggenberger, 2005. "Generalized Empirical Likelihood Tests in Time Series Models With Potential Identification Failure (joint with R.J.Smith), accepted for publication, Journal of Econometrics," UCLA Economics Online Papers 357, UCLA Department of Economics.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:99:y:2008:i:9:p:1888-1905. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.