IDEAS home Printed from https://ideas.repec.org/p/ihs/ihsesp/285.html
   My bibliography  Save this paper

Bayesian Semiparametric Regression

Author

Listed:
  • Pelenis, Justinas

    (Department of Economics and Finance, Institute for Advanced Studies, Vienna, Austria)

Abstract

We consider Bayesian estimation of restricted conditional moment models with linear regression as a particular example. The standard practice in the Bayesian literature for semiparametric models is to use flexible families of distributions for the errors and assume that the errors are independent from covariates. However, a model with flexible covariate dependent error distributions should be preferred for the following reasons: consistent estimation of the parameters of interest even if errors and covariates are dependent; possibly superior prediction intervals and more efficient estimation of the parameters under heteroscedasticity. To address these issues, we develop a Bayesian semiparametric model with flexible predictor dependent error densities and with mean restricted by a conditional moment condition. Sufficient conditions to achieve posterior consistency of the regression parameters and conditional error densities are provided. In experiments, the proposed method compares favorably with classical and alternative Bayesian estimation methods for the estimation of the regression coefficients.

Suggested Citation

  • Pelenis, Justinas, 2012. "Bayesian Semiparametric Regression," Economics Series 285, Institute for Advanced Studies.
    • Handle: RePEc:ihs:ihsesp:285
    as

    Download full text from publisher

    File URL: https://irihs.ihs.ac.at/id/eprint/2129
    File Function: First version, 2012
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Omiros Papaspiliopoulos & Gareth O. Roberts, 2008. "Retrospective Markov chain Monte Carlo methods for Dirichlet process hierarchical models," Biometrika, Biometrika Trust, vol. 95(1), pages 169-186.
    2. De Iorio, Maria & Muller, Peter & Rosner, Gary L. & MacEachern, Steven N., 2004. "An ANOVA Model for Dependent Random Measures," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 205-215, January.
    3. Robinson, P M, 1987. "Asymptotically Efficient Estimation in the Presence of Heteroskedasticity of Unknown Form," Econometrica, Econometric Society, vol. 55(4), pages 875-891, July.
    4. Keisuke Hirano, 2002. "Semiparametric Bayesian Inference in Autoregressive Panel Data Models," Econometrica, Econometric Society, vol. 70(2), pages 781-799, March.
    5. Yeonseung Chung & David Dunson, 2011. "The local Dirichlet process," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 63(1), pages 59-80, February.
    6. John Geweke & Gianni Amisano, 2011. "Hierarchical Markov normal mixture models with applications to financial asset returns," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(1), pages 1-29, January/F.
    7. Geweke, John & Keane, Michael, 2007. "Smoothly mixing regressions," Journal of Econometrics, Elsevier, vol. 138(1), pages 252-290, May.
    8. Norets, Andriy & Pelenis, Justinas, 2014. "Posterior Consistency In Conditional Density Estimation By Covariate Dependent Mixtures," Econometric Theory, Cambridge University Press, vol. 30(3), pages 606-646, June.
    9. Conley, Timothy G. & Hansen, Christian B. & McCulloch, Robert E. & Rossi, Peter E., 2008. "A semi-parametric Bayesian approach to the instrumental variable problem," Journal of Econometrics, Elsevier, vol. 144(1), pages 276-305, May.
    10. Chung, Yeonseung & Dunson, David B., 2009. "Nonparametric Bayes Conditional Distribution Modeling With Variable Selection," Journal of the American Statistical Association, American Statistical Association, vol. 104(488), pages 1646-1660.
    11. Griffin, J.E. & Steel, M.F.J., 2006. "Order-Based Dependent Dirichlet Processes," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 179-194, March.
    12. David B. Dunson & Ju-Hyun Park, 2008. "Kernel stick-breaking processes," Biometrika, Biometrika Trust, vol. 95(2), pages 307-323.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Debdeep Pati & David Dunson, 2014. "Bayesian nonparametric regression with varying residual density," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 66(1), pages 1-31, February.
    2. Lewis, Gabriel, 2022. "Heteroskedasticity and Clustered Covariances from a Bayesian Perspective," MPRA Paper 116662, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pelenis, Justinas, 2014. "Bayesian regression with heteroscedastic error density and parametric mean function," Journal of Econometrics, Elsevier, vol. 178(P3), pages 624-638.
    2. Norets, Andriy, 2015. "Bayesian regression with nonparametric heteroskedasticity," Journal of Econometrics, Elsevier, vol. 185(2), pages 409-419.
    3. Norets, Andriy & Pelenis, Justinas, 2012. "Bayesian modeling of joint and conditional distributions," Journal of Econometrics, Elsevier, vol. 168(2), pages 332-346.
    4. Pati, Debdeep & Dunson, David B. & Tokdar, Surya T., 2013. "Posterior consistency in conditional distribution estimation," Journal of Multivariate Analysis, Elsevier, vol. 116(C), pages 456-472.
    5. Debdeep Pati & David Dunson, 2014. "Bayesian nonparametric regression with varying residual density," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 66(1), pages 1-31, February.
    6. Huang, Yifan & Meng, Shengwang, 2020. "A Bayesian nonparametric model and its application in insurance loss prediction," Insurance: Mathematics and Economics, Elsevier, vol. 93(C), pages 84-94.
    7. Jensen, Mark J. & Maheu, John M., 2010. "Bayesian semiparametric stochastic volatility modeling," Journal of Econometrics, Elsevier, vol. 157(2), pages 306-316, August.
    8. Stefano Favaro & Antonio Lijoi & Igor Prünster, 2012. "On the stick–breaking representation of normalized inverse Gaussian priors," DEM Working Papers Series 008, University of Pavia, Department of Economics and Management.
    9. Federico Bassetti & Roberto Casarin & Francesco Ravazzolo, 2018. "Bayesian Nonparametric Calibration and Combination of Predictive Distributions," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(522), pages 675-685, April.
    10. Bassetti, Federico & Casarin, Roberto & Leisen, Fabrizio, 2014. "Beta-product dependent Pitman–Yor processes for Bayesian inference," Journal of Econometrics, Elsevier, vol. 180(1), pages 49-72.
    11. Griffin, J.E. & Steel, M.F.J., 2011. "Stick-breaking autoregressive processes," Journal of Econometrics, Elsevier, vol. 162(2), pages 383-396, June.
    12. Barrientos, Andrés F. & Canale, Antonio, 2021. "A Bayesian goodness-of-fit test for regression," Computational Statistics & Data Analysis, Elsevier, vol. 155(C).
    13. Miller, Jeffrey W., 2019. "An elementary derivation of the Chinese restaurant process from Sethuraman’s stick-breaking process," Statistics & Probability Letters, Elsevier, vol. 146(C), pages 112-117.
    14. Jin, Xin & Maheu, John M., 2016. "Bayesian semiparametric modeling of realized covariance matrices," Journal of Econometrics, Elsevier, vol. 192(1), pages 19-39.
    15. Fuentes-García, Ruth & Mena, Ramsés H. & Walker, Stephen G., 2009. "A nonparametric dependent process for Bayesian regression," Statistics & Probability Letters, Elsevier, vol. 79(8), pages 1112-1119, April.
    16. Laura Liu, 2018. "Density Forecasts in Panel Data Models : A Semiparametric Bayesian Perspective," Finance and Economics Discussion Series 2018-036, Board of Governors of the Federal Reserve System (U.S.).
    17. Billio, Monica & Casarin, Roberto & Rossini, Luca, 2019. "Bayesian nonparametric sparse VAR models," Journal of Econometrics, Elsevier, vol. 212(1), pages 97-115.
    18. Hatjispyros, Spyridon J. & Nicoleris, Theodoros & Walker, Stephen G., 2016. "Random density functions with common atoms and pairwise dependence," Computational Statistics & Data Analysis, Elsevier, vol. 101(C), pages 236-249.
    19. Villani, Mattias & Kohn, Robert & Nott, David J., 2012. "Generalized smooth finite mixtures," Journal of Econometrics, Elsevier, vol. 171(2), pages 121-133.
    20. repec:jss:jstsof:40:i05 is not listed on IDEAS
    21. Yeonseung Chung & David Dunson, 2011. "The local Dirichlet process," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 63(1), pages 59-80, February.

    More about this item

    Keywords

    Bayesian semiparametrics; Bayesian conditional density estimation; heteroscedastic linear reggression; posterior consistency;
    All these keywords.

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ihs:ihsesp:285. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Doris Szoncsitz (email available below). General contact details of provider: https://edirc.repec.org/data/deihsat.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.