IDEAS home Printed from https://ideas.repec.org/a/gam/jstats/v2y2019i2p20-271d229088.html
   My bibliography  Save this article

Setting Alarm Thresholds in Measurements with Systematic and Random Errors

Author

Listed:
  • Tom Burr

    (SGIM/Nuclear Fuel Cycle Information Analysis, International Atomic Energy Agency, A1220 Vienna, Austria)

  • Elisa Bonner

    (Statistics Department, Colorado State University, Fort Collins, CO 80523, USA)

  • Kamil Krzysztoszek

    (SGIM/Nuclear Fuel Cycle Information Analysis, International Atomic Energy Agency, A1220 Vienna, Austria)

  • Claude Norman

    (SGIM/Nuclear Fuel Cycle Information Analysis, International Atomic Energy Agency, A1220 Vienna, Austria)

Abstract

For statistical evaluations that involve within-group and between-group variance components (denoted σ W 2 and σ B 2 , respectively), there is sometimes a need to monitor for a shift in the mean of time-ordered data. Uncertainty in the estimates σ ^ W 2 and σ ^ B 2 should be accounted for when setting alarm thresholds to check for a mean shift as both σ W 2 and σ B 2 must be estimated. One-way random effects analysis of variance (ANOVA) is the main tool for analysing such grouped data. Nearly all of the ANOVA applications assume that both the within-group and between-group components are normally distributed. However, depending on the application, the within-group and/or between-group probability distributions might not be well approximated by a normal distribution. This review paper uses the same example throughout to illustrate the possible approaches to setting alarm limits in grouped data, depending on what is assumed about the within-group and between-group probability distributions. The example involves measurement data, for which systematic errors are assumed to remain constant within a group, and to change between groups. The false alarm probability depends on the assumed measurement error model and its within-group and between-group error variances, which are estimated while using historical data, usually with ample within-group data, but with a small number of groups (three to 10 typically). This paper illustrates the parametric, semi-parametric, and non-parametric options to setting alarm thresholds in such grouped data.

Suggested Citation

  • Tom Burr & Elisa Bonner & Kamil Krzysztoszek & Claude Norman, 2019. "Setting Alarm Thresholds in Measurements with Systematic and Random Errors," Stats, MDPI, vol. 2(2), pages 1-13, May.
    • Handle: RePEc:gam:jstats:v:2:y:2019:i:2:p:20-271:d:229088
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2571-905X/2/2/20/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2571-905X/2/2/20/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Marsaglia, George, 2006. "Ratios of Normal Variables," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 16(i04).
    2. Joyce Paul & Marjoram Paul, 2008. "Approximately Sufficient Statistics and Bayesian Computation," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 7(1), pages 1-18, August.
    3. Klaus Martin & Annette Böckenhoff, 2007. "Analysis of short-term systematic measurement error variance for the difference of paired data without repetition of measurement," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 91(3), pages 291-310, October.
    4. Paul Fearnhead & Dennis Prangle, 2012. "Constructing summary statistics for approximate Bayesian computation: semi-automatic approximate Bayesian computation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 74(3), pages 419-474, June.
    5. Young, Derek S., 2010. "tolerance: An R Package for Estimating Tolerance Intervals," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 36(i05).
    6. Burr, Deborah, 2012. "bspmma: An R Package for Bayesian Semiparametric Models for Meta-Analysis," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 50(i04).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. D.T. Frazier & G.M. Martin & C.P. Robert & J. Rousseau, 2016. "Asymptotic Properties of Approximate Bayesian Computation," Monash Econometrics and Business Statistics Working Papers 18/16, Monash University, Department of Econometrics and Business Statistics.
    2. Gael M. Martin & David T. Frazier & Christian P. Robert, 2020. "Computing Bayes: Bayesian Computation from 1763 to the 21st Century," Monash Econometrics and Business Statistics Working Papers 14/20, Monash University, Department of Econometrics and Business Statistics.
    3. Gael M. Martin & David T. Frazier & Christian P. Robert, 2021. "Approximating Bayes in the 21st Century," Monash Econometrics and Business Statistics Working Papers 24/21, Monash University, Department of Econometrics and Business Statistics.
    4. Baey, Charlotte & Smith, Henrik G. & Rundlöf, Maj & Olsson, Ola & Clough, Yann & Sahlin, Ullrika, 2023. "Calibration of a bumble bee foraging model using Approximate Bayesian Computation," Ecological Modelling, Elsevier, vol. 477(C).
    5. Jonathan U Harrison & Ruth E Baker, 2020. "An automatic adaptive method to combine summary statistics in approximate Bayesian computation," PLOS ONE, Public Library of Science, vol. 15(8), pages 1-21, August.
    6. Prangle Dennis & Fearnhead Paul & Cox Murray P. & Biggs Patrick J. & French Nigel P., 2014. "Semi-automatic selection of summary statistics for ABC model choice," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 13(1), pages 67-82, February.
    7. Frazier, David T. & Maneesoonthorn, Worapree & Martin, Gael M. & McCabe, Brendan P.M., 2019. "Approximate Bayesian forecasting," International Journal of Forecasting, Elsevier, vol. 35(2), pages 521-539.
    8. Buzbas, Erkan O. & Rosenberg, Noah A., 2015. "AABC: Approximate approximate Bayesian computation for inference in population-genetic models," Theoretical Population Biology, Elsevier, vol. 99(C), pages 31-42.
    9. Creel, Michael & Kristensen, Dennis, 2015. "ABC of SV: Limited information likelihood inference in stochastic volatility jump-diffusion models," Journal of Empirical Finance, Elsevier, vol. 31(C), pages 85-108.
    10. Soubeyrand Samuel & Carpentier Florence & Guiton François & Klein Etienne K., 2013. "Approximate Bayesian computation with functional statistics," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 12(1), pages 17-37, March.
    11. Mikael Sunnåker & Alberto Giovanni Busetto & Elina Numminen & Jukka Corander & Matthieu Foll & Christophe Dessimoz, 2013. "Approximate Bayesian Computation," PLOS Computational Biology, Public Library of Science, vol. 9(1), pages 1-10, January.
    12. Creel, Michael & Kristensen, Dennis, 2016. "On selection of statistics for approximate Bayesian computing (or the method of simulated moments)," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 99-114.
    13. Wilkinson Richard David, 2013. "Approximate Bayesian computation (ABC) gives exact results under the assumption of model error," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 12(2), pages 129-141, May.
    14. Sebastian Calcetero-Vanegas & Andrei L. Badescu & X. Sheldon Lin, 2022. "Effective experience rating for large insurance portfolios via surrogate modeling," Papers 2211.06568, arXiv.org, revised Jun 2024.
    15. Nakagome Shigeki & Fukumizu Kenji & Mano Shuhei, 2013. "Kernel approximate Bayesian computation in population genetic inferences," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 12(6), pages 667-678, December.
    16. Michael Stocks & Mathieu Siol & Martin Lascoux & Stéphane De Mita, 2014. "Amount of Information Needed for Model Choice in Approximate Bayesian Computation," PLOS ONE, Public Library of Science, vol. 9(6), pages 1-13, June.
    17. Soubeyrand, Samuel & Haon-Lasportes, Emilie, 2015. "Weak convergence of posteriors conditional on maximum pseudo-likelihood estimates and implications in ABC," Statistics & Probability Letters, Elsevier, vol. 107(C), pages 84-92.
    18. Silk Daniel & Filippi Sarah & Stumpf Michael P. H., 2013. "Optimizing threshold-schedules for sequential approximate Bayesian computation: applications to molecular systems," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 12(5), pages 603-618, October.
    19. Grazzini, Jakob & Richiardi, Matteo G. & Tsionas, Mike, 2017. "Bayesian estimation of agent-based models," Journal of Economic Dynamics and Control, Elsevier, vol. 77(C), pages 26-47.
    20. Xing Ju Lee & Christopher C. Drovandi & Anthony N. Pettitt, 2015. "Model choice problems using approximate Bayesian computation with applications to pathogen transmission data sets," Biometrics, The International Biometric Society, vol. 71(1), pages 198-207, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jstats:v:2:y:2019:i:2:p:20-271:d:229088. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.