IDEAS home Printed from https://ideas.repec.org/a/spr/stpapr/v65y2024i8d10.1007_s00362-024-01597-3.html
   My bibliography  Save this article

Bayesian and frequentist inference derived from the maximum entropy principle with applications to propagating uncertainty about statistical methods

Author

Listed:
  • David R. Bickel

    (University of North Carolina at Greensboro, The Graduate School)

Abstract

Using statistical methods to analyze data requires considering the data set to be randomly generated from a probability distribution that is unknown but idealized according to a mathematical model consisting of constraints, assumptions about the distribution. Since the choice of such a model is up to the scientist, there is an understandable bias toward choosing models that make scientific conclusions appear more certain than they really are. There is a similar bias in the scientist’s choice of whether to use Bayesian or frequentist methods. This article provides tools to mitigate both of those biases on the basis of a principle of information theory. It is found that the same principle unifies Bayesianism with the fiducial version of frequentism. The principle arguably overcomes not only the main objections against fiducial inference but also the main Bayesian objection against the use of confidence intervals.

Suggested Citation

  • David R. Bickel, 2024. "Bayesian and frequentist inference derived from the maximum entropy principle with applications to propagating uncertainty about statistical methods," Statistical Papers, Springer, vol. 65(8), pages 5389-5407, October.
    • Handle: RePEc:spr:stpapr:v:65:y:2024:i:8:d:10.1007_s00362-024-01597-3
    DOI: 10.1007/s00362-024-01597-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00362-024-01597-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s00362-024-01597-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lu Tian & Rui Wang & Tianxi Cai & Lee-Jen Wei, 2011. "The Highest Confidence Density Region and Its Usage for Joint Inferences about Constrained Parameters," Biometrics, The International Biometric Society, vol. 67(2), pages 604-610, June.
    2. Ryan Martin & Chuanhai Liu, 2013. "Inferential Models: A Framework for Prior-Free Posterior Probabilistic Inference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(501), pages 301-313, March.
    3. Hannig, Jan & Iyer, Hari & Patterson, Paul, 2006. "Fiducial Generalized Confidence Intervals," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 254-269, March.
    4. Giffin, Adom & Cafaro, Carlo & Ali, Sean Alan, 2016. "Application of the maximum relative entropy method to the physics of ferromagnetic materials," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 455(C), pages 11-26.
    5. David R. Bickel, 2022. "Confidence distributions and empirical Bayes posterior distributions unified as distributions of evidential support," Communications in Statistics - Theory and Methods, Taylor & Francis Journals, vol. 51(10), pages 3142-3163, May.
    6. Tore Schweder & Nils Lid Hjort, 2002. "Confidence and Likelihood," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 29(2), pages 309-332, June.
    7. Joshua Habiger & Ye Liang, 2022. "Publication Policies for Replicable Research and the Community-Wide False Discovery Rate," The American Statistician, Taylor & Francis Journals, vol. 76(2), pages 131-141, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xuhua Liu & Xingzhong Xu, 2016. "Confidence distribution inferences in one-way random effects model," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(1), pages 59-74, March.
    2. Eugenio Melilli & Piero Veronese, 2024. "Confidence distributions and hypothesis testing," Statistical Papers, Springer, vol. 65(6), pages 3789-3820, August.
    3. David R. Bickel, 2014. "Small-scale Inference: Empirical Bayes and Confidence Methods for as Few as a Single Comparison," International Statistical Review, International Statistical Institute, vol. 82(3), pages 457-476, December.
    4. Randy C. S. Lai & Jan Hannig & Thomas C. M. Lee, 2015. "Generalized Fiducial Inference for Ultrahigh-Dimensional Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(510), pages 760-772, June.
    5. Piero Veronese & Eugenio Melilli, 2015. "Fiducial and Confidence Distributions for Real Exponential Families," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 42(2), pages 471-484, June.
    6. Roy, Anindya & Bose, Arup, 2009. "Coverage of generalized confidence intervals," Journal of Multivariate Analysis, Elsevier, vol. 100(7), pages 1384-1397, August.
    7. La Vecchia, Davide & Moor, Alban & Scaillet, Olivier, 2023. "A higher-order correct fast moving-average bootstrap for dependent data," Journal of Econometrics, Elsevier, vol. 235(1), pages 65-81.
    8. Li, Xinmin & Wang, Juan & Liang, Hua, 2011. "Comparison of several means: A fiducial based approach," Computational Statistics & Data Analysis, Elsevier, vol. 55(5), pages 1993-2002, May.
    9. Russell J. Bowater, 2017. "A defence of subjective fiducial inference," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 101(2), pages 177-197, April.
    10. Xiaokang Luo & Tirthankar Dasgupta & Minge Xie & Regina Y. Liu, 2021. "Leveraging the Fisher randomization test using confidence distributions: Inference, combination and fusion learning," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(4), pages 777-797, September.
    11. Yuliang Yin & Bingbing Wang, 2016. "The Agreement between the Generalized Value and Bayesian Evidence in the One-Sided Testing Problem," International Journal of Mathematics and Mathematical Sciences, Hindawi, vol. 2016, pages 1-7, May.
    12. Nicolas Miconnet & Marie Cornu & Annie Beaufort & Laurent Rosso & Jean‐Baptiste Denis, 2005. "Uncertainty Distribution Associated with Estimating a Proportion in Microbial Risk Assessment," Risk Analysis, John Wiley & Sons, vol. 25(1), pages 39-48, February.
    13. Piero Veronese & Eugenio Melilli, 2021. "Confidence Distribution for the Ability Parameter of the Rasch Model," Psychometrika, Springer;The Psychometric Society, vol. 86(1), pages 131-166, March.
    14. Hannig, Jan & Lai, Randy C.S. & Lee, Thomas C.M., 2014. "Computational issues of generalized fiducial inference," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 849-858.
    15. A. Malekzadeh & M. Kharrati-Kopaei & S. Sadooghi-Alvandi, 2014. "Comparing exponential location parameters with several controls under heteroscedasticity," Computational Statistics, Springer, vol. 29(5), pages 1083-1094, October.
    16. Hsin-I Lee & Hungyen Chen & Hirohisa Kishino & Chen-Tuo Liao, 2016. "A Reference Population-Based Conformance Proportion," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 21(4), pages 684-697, December.
    17. Ben O’Neill, 2022. "Smallest covering regions and highest density regions for discrete distributions," Computational Statistics, Springer, vol. 37(3), pages 1229-1254, July.
    18. T. Chen & S. Tracy & H. Uno, 2021. "OptBand: optimization-based confidence bands for functions to characterize time-to-event distributions," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 27(3), pages 481-498, July.
    19. Weizhong Tian & Yaoting Yang & Tingting Tong, 2022. "Confidence Intervals Based on the Difference of Medians for Independent Log-Normal Distributions," Mathematics, MDPI, vol. 10(16), pages 1-14, August.
    20. Kruschke, John K. & Liddell, Torrin, 2016. "The Bayesian New Statistics: Hypothesis testing, estimation, meta-analysis, and power analysis from a Bayesian perspective," OSF Preprints ksfyr, Center for Open Science.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:stpapr:v:65:y:2024:i:8:d:10.1007_s00362-024-01597-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.