IDEAS home Printed from https://ideas.repec.org/p/ifs/cemmap/37-17.html
   My bibliography  Save this paper

Rebayes: an R package for empirical bayes mixture methods

Author

Listed:
  • Jiaying Gu

    (Institute for Fiscal Studies and University of Toronto)

  • Roger Koenker

    (Institute for Fiscal Studies and UCL)

Abstract

Models of unobserved heterogeneity, or frailty as it is commonly known in survival analysis, can often be formulated as semiparametric mixture models and estimated by maximum likelihood as proposed by Robbins (1950) and elaborated by Kiefer and Wolfowitz (1956). Recent developments in convex optimization, as noted by Koenker and Mizera (2014b), have led to dramatic improvements in computational methods for such models. In this vignette we describe an implementation contained in the R package REBayes with applications to a wide variety of mixture settings: Gaussian location and scale, Poisson and binomial mixtures for discrete data, Weibull and Gompertz models for survival data, and several Gaussian models intended for longitudinal data. While the dimension of the nonparametric heterogeneity of these models is inherently limited by our present gridding strategy, we describe how additional fixed parameters can be relatively easily accommodated via pro le likelihood. We also describe some nonparametric maximum likelihood methods for shape and norm constrained density estimation that employ related computational methods. This paper was published in Journal of Statistical Software, 82, 1-26, (2017).

Suggested Citation

  • Jiaying Gu & Roger Koenker, 2017. "Rebayes: an R package for empirical bayes mixture methods," CeMMAP working papers CWP37/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  • Handle: RePEc:ifs:cemmap:37/17
    as

    Download full text from publisher

    File URL: https://www.ifs.org.uk/uploads/cemmap/wps/CWP371717.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Heckman, James & Singer, Burton, 1984. "A Method for Minimizing the Impact of Distributional Assumptions in Econometric Models for Duration Data," Econometrica, Econometric Society, vol. 52(2), pages 271-320, March.
    2. Wenguang Sun & Alexander C. McLain, 2012. "Multiple Testing of Composite Null Hypotheses in Heteroscedastic Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(498), pages 673-687, June.
    3. Sun, Wenguang & Cai, T. Tony, 2007. "Oracle and Adaptive Compound Decision Rules for False Discovery Rate Control," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 901-912, September.
    4. Roger Koenker & Ivan Mizera, 2014. "Convex Optimization, Shape Constraints, Compound Decisions, and Empirical Bayes Rules," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(506), pages 674-685, June.
    5. Koenker R. & Geling O., 2001. "Reappraising Medfly Longevity: A Quantile Regression Survival Analysis," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 458-468, June.
    6. Koenker, Roger & Mizera, Ivan, 2014. "Convex Optimization in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 60(i05).
    7. James Vaupel & Kenneth Manton & Eric Stallard, 1979. "The impact of heterogeneity in individual frailty on the dynamics of mortality," Demography, Springer;Population Association of America (PAA), vol. 16(3), pages 439-454, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yeil Kwon & Zhigen Zhao, 2023. "On F-modelling-based empirical Bayes estimation of variances," Biometrika, Biometrika Trust, vol. 110(1), pages 69-81.
    2. Jiaying Gu & Roger Koenker, 2023. "Invidious Comparisons: Ranking and Selection as Compound Decisions," Econometrica, Econometric Society, vol. 91(1), pages 1-41, January.
    3. Li Tan & Cory Koedel, 2019. "The Effects of Differential Income Replacement and Mortality on U.S. Social Security Redistribution," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 613-637, October.
    4. Jiaying Gu & Roger Koenker, 2018. "Nonparametric maximum likelihood methods for binary response models with random coefficients," Papers 1811.03329, arXiv.org, revised Jan 2020.
    5. Dean Eckles & Nikolaos Ignatiadis & Stefan Wager & Han Wu, 2020. "Noise-Induced Randomization in Regression Discontinuity Designs," Papers 2004.09458, arXiv.org, revised Nov 2023.
    6. Jiaying Gu & Roger Koenker, 2020. "Invidious Comparisons: Ranking and Selection as Compound Decisions," Papers 2012.12550, arXiv.org, revised Sep 2021.
    7. Jiaying Gu & Roger Koenker, 2018. "Nonparametric maximum likelihood methods for binary response models with random coefficients," CeMMAP working papers CWP65/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jiaying Gu & Roger Koenker, 2017. "Rebayes: an R package for empirical bayes mixture methods," CeMMAP working papers 37/17, Institute for Fiscal Studies.
    2. Jiaying Gu & Roger Koenker, 2020. "Invidious Comparisons: Ranking and Selection as Compound Decisions," Papers 2012.12550, arXiv.org, revised Sep 2021.
    3. Jiaying Gu & Roger Koenker, 2016. "On a Problem of Robbins," International Statistical Review, International Statistical Institute, vol. 84(2), pages 224-244, August.
    4. Jiaying Gu & Roger Koenker, 2023. "Invidious Comparisons: Ranking and Selection as Compound Decisions," Econometrica, Econometric Society, vol. 91(1), pages 1-41, January.
    5. Michael Gilraine & Jiaying Gu & Robert McMillan, 2021. "A Nonparametric Method for Estimating Teacher Value-Added," Working Papers tecipa-689, University of Toronto, Department of Economics.
    6. Jiaying Gu & Roger Koenker, 2014. "Unobserved heterogeneity in income dynamics: an empirical Bayes perspective," CeMMAP working papers 43/14, Institute for Fiscal Studies.
    7. Jiaying Gu & Roger Koenker & Stanislav Volgushev, 2017. "Testing for homogeneity in mixture models," CeMMAP working papers 39/17, Institute for Fiscal Studies.
    8. Michael Gilraine & Jiaying Gu & Robert McMillan, 2020. "A New Method for Estimating Teacher Value-Added," NBER Working Papers 27094, National Bureau of Economic Research, Inc.
    9. Jiaying Gu & Roger Koenker & Stanislav Volgushev, 2017. "Testing for homogeneity in mixture models," CeMMAP working papers CWP39/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    10. Roger Koenker & Jiaying Gu, 2019. "Minimalist G-modelling: A comment on Efron," CeMMAP working papers CWP13/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    11. Jiaying Gu & Roger Koenker, 2014. "Unobserved heterogeneity in income dynamics: an empirical Bayes perspective," CeMMAP working papers CWP43/14, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    12. Mike Gilraine & Jiaying Gu & Robert McMillan, 2022. "A Nonparametric Approach for Studying Teacher Impacts," Working Papers tecipa-716, University of Toronto, Department of Economics.
    13. Jaap H. Abbring & Tim Salimans, 2019. "The Likelihood of Mixed Hitting Times," Papers 1905.03463, arXiv.org, revised Apr 2021.
    14. repec:wyi:journl:002122 is not listed on IDEAS
    15. Abbring, Jaap H. & Salimans, Tim, 2021. "The likelihood of mixed hitting times," Journal of Econometrics, Elsevier, vol. 223(2), pages 361-375.
    16. Gómez-Villegas Miguel A. & Salazar Isabel & Sanz Luis, 2014. "A Bayesian decision procedure for testing multiple hypotheses in DNA microarray experiments," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 13(1), pages 49-65, February.
    17. Wang, Yihe & Zhao, Sihai Dave, 2021. "A nonparametric empirical Bayes approach to large-scale multivariate regression," Computational Statistics & Data Analysis, Elsevier, vol. 156(C).
    18. Bijwaard, Govert, 2011. "Unobserved Heterogeneity in Multiple-Spell Multiple-States Duration Models," IZA Discussion Papers 5748, Institute of Labor Economics (IZA).
    19. Hess Wolfgang & Tutz Gerhard & Gertheiss Jan, 2016. "A Flexible Link Function for Discrete-Time Duration Models," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 236(4), pages 455-481, August.
    20. Xian Liu, 2000. "Development of a Structural Hazard Rate Model in Sociological Research," Sociological Methods & Research, , vol. 29(1), pages 77-117, August.
    21. Hsieh Fushing, 2012. "Semiparametric efficient inferences for lifetime regression model with time-dependent covariates," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 64(1), pages 1-25, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:37/17. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emma Hyman (email available below). General contact details of provider: https://edirc.repec.org/data/cmifsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.