IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v199y2024ics0167947324000963.html
   My bibliography  Save this article

Bayesian modal regression based on mixture distributions

Author

Listed:
  • Liu, Qingyang
  • Huang, Xianzheng
  • Bai, Ray

Abstract

Compared to mean regression and quantile regression, the literature on modal regression is very sparse. A unifying framework for Bayesian modal regression is proposed, based on a family of unimodal distributions indexed by the mode, along with other parameters that allow for flexible shapes and tail behaviors. Sufficient conditions for posterior propriety under an improper prior on the mode parameter are derived. Following prior elicitation, regression analysis of simulated data and datasets from several real-life applications are conducted. Besides drawing inference for covariate effects that are easy to interpret, prediction and model selection under the proposed Bayesian modal regression framework are also considered. Evidence from these analyses suggest that the proposed inference procedures are very robust to outliers, enabling one to discover interesting covariate effects missed by mean or median regression, and to construct much tighter prediction intervals than those from mean or median regression. Computer programs for implementing the proposed Bayesian modal regression are available at https://github.com/rh8liuqy/Bayesian_modal_regression.

Suggested Citation

  • Liu, Qingyang & Huang, Xianzheng & Bai, Ray, 2024. "Bayesian modal regression based on mixture distributions," Computational Statistics & Data Analysis, Elsevier, vol. 199(C).
  • Handle: RePEc:eee:csdana:v:199:y:2024:i:c:s0167947324000963
    DOI: 10.1016/j.csda.2024.108012
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947324000963
    Download Restriction: Full text for ScienceDirect subscribers only.

    File URL: https://libkey.io/10.1016/j.csda.2024.108012?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Carpenter, Bob & Gelman, Andrew & Hoffman, Matthew D. & Lee, Daniel & Goodrich, Ben & Betancourt, Michael & Brubaker, Marcus & Guo, Jiqiang & Li, Peter & Riddell, Allen, 2017. "Stan: A Probabilistic Programming Language," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 76(i01).
    2. Qingyang Liu & Xianzheng Huang & Haiming Zhou, 2024. "The Flexible Gumbel Distribution: A New Model for Inference about the Mode," Stats, MDPI, vol. 7(1), pages 1-16, March.
    3. Zhou, Haiming & Huang, Xianzheng, 2022. "Bayesian beta regression for bounded responses with unknown supports," Computational Statistics & Data Analysis, Elsevier, vol. 167(C).
    4. Ho, Chi-san & Damien, Paul & Walker, Stephen, 2017. "Bayesian mode regression using mixtures of triangular densities," Journal of Econometrics, Elsevier, vol. 197(2), pages 273-283.
    5. Weixin Yao & Longhai Li, 2014. "A New Regression Model: Modal Linear Regression," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 41(3), pages 656-671, September.
    6. repec:ces:ifodic:v:10:y:2012:i:2:p:18946535 is not listed on IDEAS
    7. Veronika Ročková & Edward I. George, 2018. "The Spike-and-Slab LASSO," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(521), pages 431-444, January.
    8. Geweke, J, 1993. "Bayesian Treatment of the Independent Student- t Linear Model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 19-40, Suppl. De.
    9. Patrick Royston & Douglas G. Altman, 1994. "Regression Using Fractional Polynomials of Continuous Covariates: Parsimonious Parametric Modelling," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 43(3), pages 429-453, September.
    10. Jess Benhabib & Alberto Bisin, 2018. "Skewed Wealth Distributions: Theory and Empirics," Journal of Economic Literature, American Economic Association, vol. 56(4), pages 1261-1291, December.
    11. Randi Hjalmarsson & Lance Lochner, 2012. "The Impact of Education on Crime: International Evidence," ifo DICE Report, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 10(02), pages 49-55, August.
    12. Yu, Keming & Moyeed, Rana A., 2001. "Bayesian quantile regression," Statistics & Probability Letters, Elsevier, vol. 54(4), pages 437-447, October.
    13. Lee, Myoung-jae, 1993. "Quadratic mode regression," Journal of Econometrics, Elsevier, vol. 57(1-3), pages 1-19.
    14. David J. Spiegelhalter & Nicola G. Best & Bradley P. Carlin & Angelika Van Der Linde, 2002. "Bayesian measures of model complexity and fit," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(4), pages 583-639, October.
    15. Randi Hjalmarsson & Lance Lochner, 2012. "The Impact of Education on Crime: International Evidence," ifo DICE Report, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 10(2), pages 49-55, 08.
    16. Daniele Durante, 2019. "Conjugate Bayes for probit regression via unified skew-normal distributions," Biometrika, Biometrika Trust, vol. 106(4), pages 765-779.
    17. Arellano-Valle, Reinaldo B. & Azzalini, Adelchi, 2008. "The centred parametrization for the multivariate skew-normal distribution," Journal of Multivariate Analysis, Elsevier, vol. 99(7), pages 1362-1382, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dimitris Korobilis & Kenichi Shimizu, 2022. "Bayesian Approaches to Shrinkage and Sparse Estimation," Foundations and Trends(R) in Econometrics, now publishers, vol. 11(4), pages 230-354, June.
    2. Bassetti, Federico & De Giuli, Maria Elena & Nicolino, Enrica & Tarantola, Claudia, 2018. "Multivariate dependence analysis via tree copula models: An application to one-year forward energy contracts," European Journal of Operational Research, Elsevier, vol. 269(3), pages 1107-1121.
    3. David M. Phillippo & Sofia Dias & A. E. Ades & Mark Belger & Alan Brnabic & Alexander Schacht & Daniel Saure & Zbigniew Kadziola & Nicky J. Welton, 2020. "Multilevel network meta‐regression for population‐adjusted treatment comparisons," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(3), pages 1189-1210, June.
    4. Ylenia Brilli & Marco Tonello, 2015. "The contemporaneous effect of education on adolescent crime. Mechanisms and evidence from regional divides," CHILD Working Papers Series 41 JEL Classification: I2, Centre for Household, Income, Labour and Demographic Economics (CHILD) - CCA.
    5. Giampaolo Lecce & Laura Ogliari & Tommaso Orlando, 2017. "Resistance to Institutions and Cultural Distance: Brigandage in Post-Unification Italy," Cowles Foundation Discussion Papers 2097, Cowles Foundation for Research in Economics, Yale University.
    6. Divan A. Burger & Sean van der Merwe & Emmanuel Lesaffre & Peter C. le Roux & Morgan J. Raath‐Krüger, 2023. "A robust mixed‐effects parametric quantile regression model for continuous proportions: Quantifying the constraints to vitality in cushion plants," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 77(4), pages 444-470, November.
    7. Marco Gramatica & Peter Congdon & Silvia Liverani, 2021. "Bayesian modelling for spatially misaligned health areal data: A multiple membership approach," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 70(3), pages 645-666, June.
    8. Ylenia Brilli & Marco Tonello, 2018. "Does Increasing Compulsory Education Decrease or Displace Adolescent Crime? New Evidence from Administrative and Victimization Data," CESifo Economic Studies, CESifo Group, vol. 64(1), pages 15-49.
    9. Åslund, Olof & Grönqvist, Hans & Hall, Caroline & Vlachos, Jonas, 2018. "Education and criminal behavior: Insights from an expansion of upper secondary school," Labour Economics, Elsevier, vol. 52(C), pages 178-192.
    10. Assaf, A. George & Tsionas, Mike & Oh, Haemoon, 2018. "The time has come: Toward Bayesian SEM estimation in tourism research," Tourism Management, Elsevier, vol. 64(C), pages 98-109.
    11. Ignacio Munyo, 2015. "The Juvenile Crime Dilemma," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 18(2), pages 201-211, April.
    12. Ana Maria Ibanez & Catherine Rodriguez & David Zarruk, 2013. "Crime, Punishment, and Schooling Decisions: Evidence from Colombian Adolescents," Research Department Publications IDB-WP-413, Inter-American Development Bank, Research Department.
    13. Antolín-Díaz, Juan & Drechsel, Thomas & Petrella, Ivan, 2024. "Advances in nowcasting economic activity: The role of heterogeneous dynamics and fat tails," Journal of Econometrics, Elsevier, vol. 238(2).
    14. Cathy Chen & Simon Lin & Philip Yu, 2012. "Smooth Transition Quantile Capital Asset Pricing Models with Heteroscedasticity," Computational Economics, Springer;Society for Computational Economics, vol. 40(1), pages 19-48, June.
    15. Javier Cano-Urbina & Lance Lochner, 2019. "The Effect of Education and School Quality on Female Crime," Journal of Human Capital, University of Chicago Press, vol. 13(2), pages 188-235.
    16. Marc Aerts & Niel Hens & Jeffrey Simonoff, 2010. "Model selection in regression based on pre-smoothing," Journal of Applied Statistics, Taylor & Francis Journals, vol. 37(9), pages 1455-1472.
    17. Saleem Bahaj, 2014. "Systemic Sovereign Risk: Macroeconomic Implications in the Euro Area," Discussion Papers 1406, Centre for Macroeconomics (CFM).
    18. Gordon C. R. Kemp & Paulo M. D. C. Parente & J. M. C. Santos Silva, 2020. "Dynamic Vector Mode Regression," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(3), pages 647-661, July.
    19. Angela Zorro Medina & Camilo Acosta & Daniel Mejía, 2020. "The Unintended Consequences of the U.S. Adversarial Model in Latin American Crime," Documentos de Trabajo de Valor Público 18406, Universidad EAFIT.
    20. repec:esx:essedp:761 is not listed on IDEAS
    21. Olivier Parent & James P. LeSage, 2008. "Using the variance structure of the conditional autoregressive spatial specification to model knowledge spillovers," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(2), pages 235-256.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:199:y:2024:i:c:s0167947324000963. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.