IDEAS home Printed from https://ideas.repec.org/p/hhs/gunsru/2007_003.html
   My bibliography  Save this paper

Consequences of using the probability of a false alarm as the false alarm measure

Author

Listed:
  • Bock, David

    (Statistical Research Unit, Department of Economics, School of Business, Economics and Law, Göteborg University)

Abstract

In systems for on-line detection of regime shifts, a process is continually observed. Based on the data available an alarm is given when there is enough evidence of a change. There is a risk of a false alarm and here two different ways of controlling the false alarms are compared: a fixed average run length until the first false alarm and a fixed probability of any false alarm (fixed size). The two approaches are evaluated in terms of the timeliness of alarms. A system with a fixed size is found to have a drawback: the ability to detect a change deteriorates with the time of the change. Consequently, the probability of successful detection will tend to zero and the expected delay of a motivated alarm tends to infinity. This drawback is present even when the size is set to be very large (close to 1). Utility measures expressing the costs for a false or a too late alarm are used in the comparison. How the choice of the best approach can be guided by the parameters of the process and the different costs of alarms is demonstrated. The technique is illustrated by financial transactions of the Hang Seng Index.

Suggested Citation

  • Bock, David, 2007. "Consequences of using the probability of a false alarm as the false alarm measure," Research Reports 2007:3, University of Gothenburg, Statistical Research Unit, School of Business, Economics and Law.
    • Handle: RePEc:hhs:gunsru:2007_003
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/2077/7577
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Xia Pan, 2005. "An alternative approach to multivariate EWMA control chart," Journal of Applied Statistics, Taylor & Francis Journals, vol. 32(7), pages 695-705.
    2. Andersson, Eva, 2007. "Effect of dependency in systems for multivariate surveillance," Research Reports 2007:1, University of Gothenburg, Statistical Research Unit, School of Business, Economics and Law.
    3. E. Andersson & D. Bock & M. Frisen, 2006. "Some statistical aspects of methods for detection of turning points in business cycles," Journal of Applied Statistics, Taylor & Francis Journals, vol. 33(3), pages 257-278.
    4. E. Andersson, 2002. "Monitoring cyclical processes. A non-parametric approach," Journal of Applied Statistics, Taylor & Francis Journals, vol. 29(7), pages 973-990.
    5. Christian Sonesson & David Bock, 2003. "A review and discussion of prospective statistical surveillance in public health," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 166(1), pages 5-21, February.
    6. Arthur Yeh & Dennis Lin & Honghong Zhou & Chandramouliswaran Venkataramani, 2003. "A multivariate exponentially weighted moving average control chart for monitoring process variability," Journal of Applied Statistics, Taylor & Francis Journals, vol. 30(5), pages 507-536.
    7. Mu'azu Abujiya & Hassen Muttlak, 2004. "Quality Control Chart for the Mean using Double Ranked Set Sampling," Journal of Applied Statistics, Taylor & Francis Journals, vol. 31(10), pages 1185-1201.
    8. A. F. B. Costa & M. A. Rahim, 2004. "Monitoring Process Mean and Variability with One Non-central Chi-square Chart," Journal of Applied Statistics, Taylor & Francis Journals, vol. 31(10), pages 1171-1183.
    9. Achim Zeileis & Friedrich Leisch & Christian Kleiber & Kurt Hornik, 2005. "Monitoring structural change in dynamic econometric models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(1), pages 99-121, January.
    10. Leisch, Friedrich & Hornik, Kurt & Kuan, Chung-Ming, 2000. "Monitoring Structural Changes With The Generalized Fluctuation Test," Econometric Theory, Cambridge University Press, vol. 16(6), pages 835-854, December.
    11. Zhang Wu & Yu Tian & Sheng Zhang, 2005. "Adjusted-loss-function charts with variable sample sizes and sampling intervals," Journal of Applied Statistics, Taylor & Francis Journals, vol. 32(3), pages 221-242.
    12. Frédéric Carsoule & Philip Franses, 2003. "A note on monitoring time-varying parameters in an autoregression," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 57(1), pages 51-62, February.
    13. Chu, Chia-Shang James & Stinchcombe, Maxwell & White, Halbert, 1996. "Monitoring Structural Change," Econometrica, Econometric Society, vol. 64(5), pages 1045-1065, September.
    14. A. A. Kalgonda & S. R. Kulkarni, 2004. "Multivariate Quality Control Chart for Autocorrelated Processes," Journal of Applied Statistics, Taylor & Francis Journals, vol. 31(3), pages 317-327.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Andersson, Eva & Bock, David & Frisén, Marianne, 2007. "Modeling influenza incidence for the purpose of on-line monitoring," Research Reports 2007:5, University of Gothenburg, Statistical Research Unit, School of Business, Economics and Law.
    2. Andersson, Eva & Kühlmann-Berenzon, Sharon & Linde, Annika & Schiöler, Linus & Rubinova, Sandra & Frisén, Marianne, 2007. "Predictions by early indicators of the time and height of yearly influenza outbreaks in Sweden," Research Reports 2007:7, University of Gothenburg, Statistical Research Unit, School of Business, Economics and Law.
    3. Andersson, Eva, 2008. "Hotelling´s T2 Method in Multivariate On-line Surveillance. On the Delay of an Alarm," Research Reports 2008:3, University of Gothenburg, Statistical Research Unit, School of Business, Economics and Law.
    4. Bock, David & Andersson, Eva & Frisén, Marianne, 2007. "Statistical Surveillance of Epidemics: Peak Detection of Influenza in Sweden," Research Reports 2007:6, University of Gothenburg, Statistical Research Unit, School of Business, Economics and Law.
    5. Bock, David & Pettersson, Kjell, 2007. "Explorative analysis of spatial aspects on the Swedish influenza data," Research Reports 2007:10, University of Gothenburg, Statistical Research Unit, School of Business, Economics and Law.
    6. Bock, David, 2007. "Evaluations of likelihood based surveillance of volatility," Research Reports 2007:9, University of Gothenburg, Statistical Research Unit, School of Business, Economics and Law.
    7. Bock, David & Andersson, Eva & Frisén, Marianne, 2007. "Similarities and differences between statistical surveillance and certain decision rules in finance," Research Reports 2007:8, University of Gothenburg, Statistical Research Unit, School of Business, Economics and Law.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David Bock, 2008. "Aspects on the control of false alarms in statistical surveillance and the impact on the return of financial decision systems," Journal of Applied Statistics, Taylor & Francis Journals, vol. 35(2), pages 213-227.
    2. Bock, David & Pettersson, Kjell, 2007. "Explorative analysis of spatial aspects on the Swedish influenza data," Research Reports 2007:10, University of Gothenburg, Statistical Research Unit, School of Business, Economics and Law.
    3. Bock, David, 2007. "Evaluations of likelihood based surveillance of volatility," Research Reports 2007:9, University of Gothenburg, Statistical Research Unit, School of Business, Economics and Law.
    4. Bock, David & Andersson, Eva & Frisén, Marianne, 2007. "Statistical Surveillance of Epidemics: Peak Detection of Influenza in Sweden," Research Reports 2007:6, University of Gothenburg, Statistical Research Unit, School of Business, Economics and Law.
    5. Pierre Perron & Eduardo Zorita & Eiji Kurozumi, 2017. "Monitoring Parameter Constancy with Endogenous Regressors," Journal of Time Series Analysis, Wiley Blackwell, vol. 38(5), pages 791-805, September.
    6. Bock, David & Andersson, Eva & Frisén, Marianne, 2007. "Similarities and differences between statistical surveillance and certain decision rules in finance," Research Reports 2007:8, University of Gothenburg, Statistical Research Unit, School of Business, Economics and Law.
    7. Elena Andreou & Eric Ghysels, 2004. "Monitoring for Disruptions in Financial Markets," CIRANO Working Papers 2004s-26, CIRANO.
    8. Jana Eklund & George Kapetanios & Simon Price, 2013. "Robust Forecast Methods and Monitoring during Structural Change," Manchester School, University of Manchester, vol. 81, pages 3-27, October.
    9. Eklund, Jana & Kapetanios, George & Price, Simon, 2010. "Forecasting in the presence of recent structural change," Bank of England working papers 406, Bank of England.
    10. Yudong Chen & Tengyao Wang & Richard J. Samworth, 2022. "High‐dimensional, multiscale online changepoint detection," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(1), pages 234-266, February.
    11. Hsu, Chih-Chiang, 2007. "The MOSUM of squares test for monitoring variance changes," Finance Research Letters, Elsevier, vol. 4(4), pages 254-260, December.
    12. KUROZUMI, Eiji & 黒住, 英司, 2016. "Monitoring Parameter Constancy with Endogenous Regressors," Discussion Papers 2016-01, Graduate School of Economics, Hitotsubashi University.
    13. Chen, Yudong & Wang, Tengyao & Samworth, Richard J., 2022. "High-dimensional, multiscale online changepoint detection," LSE Research Online Documents on Economics 113665, London School of Economics and Political Science, LSE Library.
    14. Jan J. J. Groen & George Kapetanios & Simon Price, 2013. "Multivariate Methods For Monitoring Structural Change," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(2), pages 250-274, March.
    15. Jan Verbesselt & Achim Zeileis & Martin Herold, 2011. "Near Real-Time Disturbance Detection in Terrestrial Ecosystems Using Satellite Image Time Series: Drought Detection in Somalia," Working Papers 2011-18, Faculty of Economics and Statistics, Universität Innsbruck.
    16. Anatolyev Stanislav & Kosenok Grigory, 2018. "Sequential Testing with Uniformly Distributed Size," Journal of Time Series Econometrics, De Gruyter, vol. 10(2), pages 1-22, July.
    17. Alberto Cazzola & Lucia Pasquini & Aurora Angeli, 2016. "The relationship between unemployment and fertility in Italy," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 34(1), pages 1-38.
    18. Otto, Sven & Breitung, Jörg, 2020. "Backward CUSUM for Testing and Monitoring Structural Change," VfS Annual Conference 2020 (Virtual Conference): Gender Economics 224533, Verein für Socialpolitik / German Economic Association.
    19. Anatolyev, Stanislav, 2009. "Nonparametric Retrospection and Monitoring of Predictability of Financial Returns," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(2), pages 149-160.
    20. Okyoung Na & Youngmi Lee & Sangyeol Lee, 2011. "Monitoring parameter change in time series models," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 20(2), pages 171-199, June.

    More about this item

    Keywords

    Monitoring; Surveillance; Repeated decisions; Moving average; Shewhart method;
    All these keywords.

    JEL classification:

    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hhs:gunsru:2007_003. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Linus Schiöler (email available below). General contact details of provider: http://www.statistics.gu.se/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.