IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v199y2024ics0167947324000963.html
   My bibliography  Save this article

Bayesian modal regression based on mixture distributions

Author

Listed:
  • Liu, Qingyang
  • Huang, Xianzheng
  • Bai, Ray

Abstract

Compared to mean regression and quantile regression, the literature on modal regression is very sparse. A unifying framework for Bayesian modal regression is proposed, based on a family of unimodal distributions indexed by the mode, along with other parameters that allow for flexible shapes and tail behaviors. Sufficient conditions for posterior propriety under an improper prior on the mode parameter are derived. Following prior elicitation, regression analysis of simulated data and datasets from several real-life applications are conducted. Besides drawing inference for covariate effects that are easy to interpret, prediction and model selection under the proposed Bayesian modal regression framework are also considered. Evidence from these analyses suggest that the proposed inference procedures are very robust to outliers, enabling one to discover interesting covariate effects missed by mean or median regression, and to construct much tighter prediction intervals than those from mean or median regression. Computer programs for implementing the proposed Bayesian modal regression are available at https://github.com/rh8liuqy/Bayesian_modal_regression.

Suggested Citation

  • Liu, Qingyang & Huang, Xianzheng & Bai, Ray, 2024. "Bayesian modal regression based on mixture distributions," Computational Statistics & Data Analysis, Elsevier, vol. 199(C).
  • Handle: RePEc:eee:csdana:v:199:y:2024:i:c:s0167947324000963
    DOI: 10.1016/j.csda.2024.108012
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947324000963
    Download Restriction: Full text for ScienceDirect subscribers only.

    File URL: https://libkey.io/10.1016/j.csda.2024.108012?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Carpenter, Bob & Gelman, Andrew & Hoffman, Matthew D. & Lee, Daniel & Goodrich, Ben & Betancourt, Michael & Brubaker, Marcus & Guo, Jiqiang & Li, Peter & Riddell, Allen, 2017. "Stan: A Probabilistic Programming Language," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 76(i01).
    2. Qingyang Liu & Xianzheng Huang & Haiming Zhou, 2024. "The Flexible Gumbel Distribution: A New Model for Inference about the Mode," Stats, MDPI, vol. 7(1), pages 1-16, March.
    3. Lee, Myoung-jae, 1993. "Quadratic mode regression," Journal of Econometrics, Elsevier, vol. 57(1-3), pages 1-19.
    4. Zhou, Haiming & Huang, Xianzheng, 2022. "Bayesian beta regression for bounded responses with unknown supports," Computational Statistics & Data Analysis, Elsevier, vol. 167(C).
    5. David J. Spiegelhalter & Nicola G. Best & Bradley P. Carlin & Angelika Van Der Linde, 2002. "Bayesian measures of model complexity and fit," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(4), pages 583-639, October.
    6. Randi Hjalmarsson & Lance Lochner, 2012. "The Impact of Education on Crime: International Evidence," ifo DICE Report, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 10(2), pages 49-55, 08.
    7. Ho, Chi-san & Damien, Paul & Walker, Stephen, 2017. "Bayesian mode regression using mixtures of triangular densities," Journal of Econometrics, Elsevier, vol. 197(2), pages 273-283.
    8. Weixin Yao & Longhai Li, 2014. "A New Regression Model: Modal Linear Regression," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 41(3), pages 656-671, September.
    9. Jess Benhabib & Alberto Bisin, 2018. "Skewed Wealth Distributions: Theory and Empirics," Journal of Economic Literature, American Economic Association, vol. 56(4), pages 1261-1291, December.
    10. repec:ces:ifodic:v:10:y:2012:i:2:p:18946535 is not listed on IDEAS
    11. Veronika Ročková & Edward I. George, 2018. "The Spike-and-Slab LASSO," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(521), pages 431-444, January.
    12. Daniele Durante, 2019. "Conjugate Bayes for probit regression via unified skew-normal distributions," Biometrika, Biometrika Trust, vol. 106(4), pages 765-779.
    13. Geweke, J, 1993. "Bayesian Treatment of the Independent Student- t Linear Model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 19-40, Suppl. De.
    14. Patrick Royston & Douglas G. Altman, 1994. "Regression Using Fractional Polynomials of Continuous Covariates: Parsimonious Parametric Modelling," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 43(3), pages 429-453, September.
    15. Arellano-Valle, Reinaldo B. & Azzalini, Adelchi, 2008. "The centred parametrization for the multivariate skew-normal distribution," Journal of Multivariate Analysis, Elsevier, vol. 99(7), pages 1362-1382, August.
    16. Randi Hjalmarsson & Lance Lochner, 2012. "The Impact of Education on Crime: International Evidence," ifo DICE Report, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 10(02), pages 49-55, August.
    17. Yu, Keming & Moyeed, Rana A., 2001. "Bayesian quantile regression," Statistics & Probability Letters, Elsevier, vol. 54(4), pages 437-447, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dimitris Korobilis & Kenichi Shimizu, 2022. "Bayesian Approaches to Shrinkage and Sparse Estimation," Foundations and Trends(R) in Econometrics, now publishers, vol. 11(4), pages 230-354, June.
    2. Padilla, Juan L. & Azevedo, Caio L.N. & Lachos, Victor H., 2018. "Multidimensional multiple group IRT models with skew normal latent trait distributions," Journal of Multivariate Analysis, Elsevier, vol. 167(C), pages 250-268.
    3. Bassetti, Federico & De Giuli, Maria Elena & Nicolino, Enrica & Tarantola, Claudia, 2018. "Multivariate dependence analysis via tree copula models: An application to one-year forward energy contracts," European Journal of Operational Research, Elsevier, vol. 269(3), pages 1107-1121.
    4. David M. Phillippo & Sofia Dias & A. E. Ades & Mark Belger & Alan Brnabic & Alexander Schacht & Daniel Saure & Zbigniew Kadziola & Nicky J. Welton, 2020. "Multilevel network meta‐regression for population‐adjusted treatment comparisons," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(3), pages 1189-1210, June.
    5. Ylenia Brilli & Marco Tonello, 2015. "The contemporaneous effect of education on adolescent crime. Mechanisms and evidence from regional divides," CHILD Working Papers Series 41 JEL Classification: I2, Centre for Household, Income, Labour and Demographic Economics (CHILD) - CCA.
    6. Giampaolo Lecce & Laura Ogliari & Tommaso Orlando, 2017. "Resistance to Institutions and Cultural Distance: Brigandage in Post-Unification Italy," Cowles Foundation Discussion Papers 2097, Cowles Foundation for Research in Economics, Yale University.
    7. Olivier Parent & James P. LeSage, 2008. "Using the variance structure of the conditional autoregressive spatial specification to model knowledge spillovers," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(2), pages 235-256.
    8. Fabrizi, Enrico & Salvati, Nicola & Trivisano, Carlo, 2020. "Robust Bayesian small area estimation based on quantile regression," Computational Statistics & Data Analysis, Elsevier, vol. 145(C).
    9. Xiaokun Wang & Kara M. Kockelman, 2009. "Baysian Inference For Ordered Response Data With A Dynamic Spatial‐Ordered Probit Model," Journal of Regional Science, Wiley Blackwell, vol. 49(5), pages 877-913, December.
    10. Yen-Chi Chen, 2017. "Modal Regression using Kernel Density Estimation: a Review," Papers 1710.07004, arXiv.org, revised Dec 2017.
    11. Divan A. Burger & Sean van der Merwe & Emmanuel Lesaffre & Peter C. le Roux & Morgan J. Raath‐Krüger, 2023. "A robust mixed‐effects parametric quantile regression model for continuous proportions: Quantifying the constraints to vitality in cushion plants," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 77(4), pages 444-470, November.
    12. Marco Gramatica & Peter Congdon & Silvia Liverani, 2021. "Bayesian modelling for spatially misaligned health areal data: A multiple membership approach," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 70(3), pages 645-666, June.
    13. Ylenia Brilli & Marco Tonello, 2018. "Does Increasing Compulsory Education Decrease or Displace Adolescent Crime? New Evidence from Administrative and Victimization Data," CESifo Economic Studies, CESifo Group, vol. 64(1), pages 15-49.
    14. Wang, Kai Y.K. & Chen, Cathy W.S. & So, Mike K.P., 2023. "Quantile three-factor model with heteroskedasticity, skewness, and leptokurtosis," Computational Statistics & Data Analysis, Elsevier, vol. 182(C).
    15. Åslund, Olof & Grönqvist, Hans & Hall, Caroline & Vlachos, Jonas, 2018. "Education and criminal behavior: Insights from an expansion of upper secondary school," Labour Economics, Elsevier, vol. 52(C), pages 178-192.
    16. Assaf, A. George & Tsionas, Mike & Oh, Haemoon, 2018. "The time has come: Toward Bayesian SEM estimation in tourism research," Tourism Management, Elsevier, vol. 64(C), pages 98-109.
    17. Acosta, Camilo & Mejía, Daniel & Zorro Medina, Angela, 2023. "On the Tension Between Due Process Protection and Public Safety: The Case of an Extensive Procedural Reform in Colombia," Documentos CEDE 20924, Universidad de los Andes, Facultad de Economía, CEDE.
    18. Ignacio Munyo, 2015. "The Juvenile Crime Dilemma," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 18(2), pages 201-211, April.
    19. Ullah, Aman & Wang, Tao & Yao, Weixin, 2023. "Semiparametric partially linear varying coefficient modal regression," Journal of Econometrics, Elsevier, vol. 235(2), pages 1001-1026.
    20. Ana Maria Ibanez & Catherine Rodriguez & David Zarruk, 2013. "Crime, Punishment, and Schooling Decisions: Evidence from Colombian Adolescents," Research Department Publications IDB-WP-413, Inter-American Development Bank, Research Department.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:199:y:2024:i:c:s0167947324000963. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.