IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v200y2024ics0167947324001208.html
   My bibliography  Save this article

Hierarchical Bayesian spectral regression with shape constraints for multi-group data

Author

Listed:
  • Lenk, Peter
  • Lee, Jangwon
  • Han, Dongu
  • Park, Jichan
  • Choi, Taeryon

Abstract

We propose a hierarchical Bayesian (HB) model for multi-group analysis with group–specific, flexible regression functions. The lower–level (within group) and upper–level (between groups) regression functions have hierarchical Gaussian process priors. HB smoothing priors are developed for the spectral coefficients. The HB priors smooth the estimated functions within and between groups. The HB model is particularly useful when data within groups are sparse because it shares information across groups, and provides more accurate estimates than fitting separate nonparametric models to each group. The proposed model also allows shape constraints, such as monotone, U and S–shaped, and multi-modal constraints. When appropriate, shape constraints improve estimation by recognizing violations of the shape constraints as noise. The model is illustrated by two examples: monotone growth curves for children, and happiness as a convex, U-shaped function of age in multiple countries. Various basis functions could also be used, and the paper also implements versions with B-splines and orthogonal polynomials.

Suggested Citation

  • Lenk, Peter & Lee, Jangwon & Han, Dongu & Park, Jichan & Choi, Taeryon, 2024. "Hierarchical Bayesian spectral regression with shape constraints for multi-group data," Computational Statistics & Data Analysis, Elsevier, vol. 200(C).
    • Handle: RePEc:eee:csdana:v:200:y:2024:i:c:s0167947324001208
    DOI: 10.1016/j.csda.2024.108036
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947324001208
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2024.108036?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. J. O. Ramsay, 1998. "Estimating smooth monotone functions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 60(2), pages 365-375.
    2. Blanchflower, David G. & Oswald, Andrew J., 2004. "Well-being over time in Britain and the USA," Journal of Public Economics, Elsevier, vol. 88(7-8), pages 1359-1386, July.
    3. Blanchflower, David G. & Oswald, Andrew J., 2008. "Is well-being U-shaped over the life cycle?," Social Science & Medicine, Elsevier, vol. 66(8), pages 1733-1749, April.
    4. Lizhen Lin & David B. Dunson, 2014. "Bayesian monotone regression using Gaussian process projection," Biometrika, Biometrika Trust, vol. 101(2), pages 303-317.
    5. David G. Blanchflower, 2021. "Is happiness U-shaped everywhere? Age and subjective well-being in 145 countries," Journal of Population Economics, Springer;European Society for Population Economics, vol. 34(2), pages 575-624, April.
    6. Ander Wilson & Jessica Tryner & Christian L'Orange & John Volckens, 2020. "Bayesian nonparametric monotone regression," Environmetrics, John Wiley & Sons, Ltd., vol. 31(8), December.
    7. S. McKay Curtis & Sujit K. Ghosh, 2011. "A variable selection approach to monotonic regression with Bernstein polynomials," Journal of Applied Statistics, Taylor & Francis Journals, vol. 38(5), pages 961-976, February.
    8. Frijters, Paul & Beatton, Tony, 2012. "The mystery of the U-shaped relationship between happiness and age," Journal of Economic Behavior & Organization, Elsevier, vol. 82(2), pages 525-542.
    9. P. J. Lenk, 1999. "Bayesian inference for semiparametric regression using a Fourier representation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(4), pages 863-879.
    10. Ruppert,David & Wand,M. P. & Carroll,R. J., 2003. "Semiparametric Regression," Cambridge Books, Cambridge University Press, number 9780521780506, January.
    11. Elisabet Beseran & Juan M. Pericàs & Lucinda Cash-Gibson & Meritxell Ventura-Cots & Keshia M. Pollack Porter & Joan Benach, 2022. "Deaths of Despair: A Scoping Review on the Social Determinants of Drug Overdose, Alcohol-Related Liver Disease and Suicide," IJERPH, MDPI, vol. 19(19), pages 1-18, September.
    12. Thomas S. Shively & Thomas W. Sager & Stephen G. Walker, 2009. "A Bayesian approach to non‐parametric monotone function estimation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(1), pages 159-175, January.
    13. Edsel L. Beja, 2018. "The U-shaped relationship between happiness and age: evidence using world values survey data," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(4), pages 1817-1829, July.
    14. Ruppert,David & Wand,M. P. & Carroll,R. J., 2003. "Semiparametric Regression," Cambridge Books, Cambridge University Press, number 9780521785167, January.
    15. Paul L. Speckman, 2003. "Fully Bayesian spline smoothing and intrinsic autoregressive priors," Biometrika, Biometrika Trust, vol. 90(2), pages 289-302, June.
    16. Allenby, Greg M & Lenk, Peter J, 1995. "Reassessing Brand Loyalty, Price Sensitivity, and Merchandising Effects on Consumer Brand Choice," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 281-289, July.
    17. Ander Wilson & David M. Reif & Brian J. Reich, 2014. "Hierarchical dose–response modeling for high-throughput toxicity screening of environmental chemicals," Biometrics, The International Biometric Society, vol. 70(1), pages 237-246, March.
    18. Mary Meyer & Amber Hackstadt & Jennifer Hoeting, 2011. "Bayesian estimation and inference for generalised partial linear models using shape-restricted splines," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 23(4), pages 867-884.
    19. Peter J. Lenk & Wayne S. DeSarbo & Paul E. Green & Martin R. Young, 1996. "Hierarchical Bayes Conjoint Analysis: Recovery of Partworth Heterogeneity from Reduced Experimental Designs," Marketing Science, INFORMS, vol. 15(2), pages 173-191.
    20. Se Yoon Lee & Bowen Lei & Bani Mallick, 2020. "Estimation of COVID-19 spread curves integrating global data and borrowing information," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-17, July.
    21. Inyoung Kim & Noah D. Cohen & Raymond J. Carroll, 2003. "Semiparametric Regression Splines in Matched Case-Control Studies," Biometrics, The International Biometric Society, vol. 59(4), pages 1158-1169, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Taeryon Choi & Hea-Jung Kim & Seongil Jo, 2016. "Bayesian variable selection approach to a Bernstein polynomial regression model with stochastic constraints," Journal of Applied Statistics, Taylor & Francis Journals, vol. 43(15), pages 2751-2771, November.
    2. Wu, Ximing & Sickles, Robin, 2018. "Semiparametric estimation under shape constraints," Econometrics and Statistics, Elsevier, vol. 6(C), pages 74-89.
    3. Biermann, Philipp & Bitzer, Jürgen & Gören, Erkan, 2022. "The relationship between age and subjective well-being: Estimating within and between effects simultaneously," The Journal of the Economics of Ageing, Elsevier, vol. 21(C).
    4. Thomas Hansen & Morten Blekesaune, 2022. "The age and well-being “paradox”: a longitudinal and multidimensional reconsideration," European Journal of Ageing, Springer, vol. 19(4), pages 1277-1286, December.
    5. Clark, Andrew E. & Etilé, Fabrice, 2011. "Happy house: Spousal weight and individual well-being," Journal of Health Economics, Elsevier, vol. 30(5), pages 1124-1136.
    6. Junji Kageyama & Kazuma Sato, 2021. "Explaining the U-shaped life satisfaction: dissatisfaction as a driver of behavior," Journal of Bioeconomics, Springer, vol. 23(2), pages 179-202, July.
    7. Hazelton, Martin L. & Turlach, Berwin A., 2011. "Semiparametric regression with shape-constrained penalized splines," Computational Statistics & Data Analysis, Elsevier, vol. 55(10), pages 2871-2879, October.
    8. C Rohrbeck & D A Costain & A Frigessi, 2018. "Bayesian spatial monotonic multiple regression," Biometrika, Biometrika Trust, vol. 105(3), pages 691-707.
    9. David G. Blanchflower & Carol L. Graham, 2022. "The Mid-Life Dip in Well-Being: a Critique," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 161(1), pages 287-344, May.
    10. Piper, Alan, 2021. "Temps dip deeper: Temporary employment and the midlife nadir in human well-being," The Journal of the Economics of Ageing, Elsevier, vol. 19(C).
    11. Dimiter Toshkov, 2022. "The Relationship Between Age and Happiness Varies by Income," Journal of Happiness Studies, Springer, vol. 23(3), pages 1169-1188, March.
    12. Guhl, Daniel & Baumgartner, Bernhard & Kneib, Thomas & Steiner, Winfried J., 2018. "Estimating time-varying parameters in brand choice models: A semiparametric approach," International Journal of Research in Marketing, Elsevier, vol. 35(3), pages 394-414.
    13. Wunder, Christoph & Wiencierz, Andrea & Schwarze, Johannes & Küchenhoff, Helmut & Kleyer, Sara & Bleninger, Philipp, 2009. "Well-Being over the Life Span: Semiparametric Evidence from British and German Longitudinal Data," IZA Discussion Papers 4155, Institute of Labor Economics (IZA).
    14. Begoña Álvarez, 2022. "The Best Years of Older Europeans’ Lives," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 160(1), pages 227-260, February.
    15. Chen, Haiqiang & Li, Yingxing & Lin, Ming & Zhu, Yanli, 2018. "A Regime Shift Model with Nonparametric Switching Mechanism," IRTG 1792 Discussion Papers 2018-020, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    16. Otto-Sobotka, Fabian & Salvati, Nicola & Ranalli, Maria Giovanna & Kneib, Thomas, 2019. "Adaptive semiparametric M-quantile regression," Econometrics and Statistics, Elsevier, vol. 11(C), pages 116-129.
    17. Eduardo L. Montoya & Wendy Meiring, 2016. "An F-type test for detecting departure from monotonicity in a functional linear model," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 28(2), pages 322-337, June.
    18. Timothy K.M. Beatty & Erling Røed Larsen, 2005. "Using Engel curves to estimate bias in the Canadian CPI as a cost of living index," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 38(2), pages 482-499, May.
    19. Arthur Charpentier & Emmanuel Flachaire & Antoine Ly, 2017. "Econom\'etrie et Machine Learning," Papers 1708.06992, arXiv.org, revised Mar 2018.
    20. Hyunju Son & Youyi Fong, 2021. "Fast grid search and bootstrap‐based inference for continuous two‐phase polynomial regression models," Environmetrics, John Wiley & Sons, Ltd., vol. 32(3), May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:200:y:2024:i:c:s0167947324001208. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.