IDEAS home Printed from https://ideas.repec.org/p/eve/wpaper/08-01.html
   My bibliography  Save this paper

Graphical Methods for Investigating the Finite-sample Properties of Confidence Regions: A Gap in the Literature? A New Proposal

Author

Listed:
  • Christian De Peretti

    (Centre d’Etudes des Politiques Economiques (EPEE), University of Evry Val d’Essonne)

  • Carole Siani

    (Laboratoire d’Analyse des Systèmes de Santé (LASS), University of Claude Bernard Lyon 1)

Abstract

In the literature, there are not satisfactory methods for measuring and presenting the performance of confidence regions. In this paper, techniques for measuring effectiveness of confidence regions and for the graphical display of simulation evidence as regards the coverage and effectiveness of confidence regions are developed and illustrated. Three types of figures are discussed: called coverage plots, coverage discrepancy plots, and coverage effectiveness curves, that permits to show the “true” effectiveness, rather than a spurious nominal effectiveness. We prove that when simulations are run to compute the coverage for only one confidence level, which is usually done in the literrature for classical presentations in tables, all the information useful for computing the coverage for all the levels is present. Thus, there is absolutely no loss of computing time by using this method, whereas it provides more information than the corresponding tabular presentations. These figures are used to illustrate the finite sample properties of autoregressive parameter confidence regions in the context of AR(1) processes. Particularly, asymptotic, percentile, and percentile-t confidence intervals, as well as confidence intervals based on inverting bootstrap tests are presented and commented. Monte Carlo results assessing the performance of these confidence intervals for various situations are also presented. We show that classical confidence intervals have very poor performances, even the percentile-t interval, whereas confidence intervals based on inverting bootstrap tests have quite satisfactory performance. An application is made on stock market indices.

Suggested Citation

  • Christian De Peretti & Carole Siani, 2008. "Graphical Methods for Investigating the Finite-sample Properties of Confidence Regions: A Gap in the Literature? A New Proposal," Documents de recherche 08-01, Centre d'Études des Politiques Économiques (EPEE), Université d'Evry Val d'Essonne.
    • Handle: RePEc:eve:wpaper:08-01
    as

    Download full text from publisher

    File URL: https://www.univ-evry.fr/fileadmin/mediatheque/ueve-institutionnel/03_Recherche/laboratoires/Epee/wp/08-01.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jeremy Berkowitz & Lutz Kilian, 2000. "Recent developments in bootstrapping time series," Econometric Reviews, Taylor & Francis Journals, vol. 19(1), pages 1-48.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Berkowitz, J. & Birgean, I. & Kilian, L., 1999. "On the Finite-Sample Accuracy of Nonparametric Resampling Algorithms for Economic Time Series," Papers 99-01, Michigan - Center for Research on Economic & Social Theory.
    2. Thomas George & Chuan-Yang Hwang & Tavy Ronen, 2010. "Bootstrap refinements in tests of microstructure frictions," Review of Quantitative Finance and Accounting, Springer, vol. 35(1), pages 47-70, July.
    3. Goncalves, Silvia & Kilian, Lutz, 2004. "Bootstrapping autoregressions with conditional heteroskedasticity of unknown form," Journal of Econometrics, Elsevier, vol. 123(1), pages 89-120, November.
    4. Guochang Wang & Wai Keung Li & Ke Zhu, 2018. "New HSIC-based tests for independence between two stationary multivariate time series," Papers 1804.09866, arXiv.org.
    5. Omtzigt Pieter & Fachin Stefano, 2002. "Bootstrapping and Bartlett corrections in the cointegrated VAR model," Economics and Quantitative Methods qf0212, Department of Economics, University of Insubria.
    6. Emily Anderson & Atsushi Inoue & Barbara Rossi, 2016. "Heterogeneous Consumers and Fiscal Policy Shocks," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 48(8), pages 1877-1888, December.
    7. Daniel Grabowski & Anna Staszewska-Bystrova & Peter Winker, 2020. "Skewness-adjusted bootstrap confidence intervals and confidence bands for impulse response functions," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 104(1), pages 5-32, March.
    8. Shamsuddin, Abul F. M. & Kim, Jae H., 2003. "Integration and interdependence of stock and foreign exchange markets: an Australian perspective," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 13(3), pages 237-254, July.
    9. Christopher J. Neely & Lucio Sarno, 2002. "How well do monetary fundamentals forecast exchange rates?," Review, Federal Reserve Bank of St. Louis, vol. 84(Sep), pages 51-74.
    10. Wu, Jyh-Lin, 2000. "Mean reversion of the current account: evidence from the panel data unit-root test," Economics Letters, Elsevier, vol. 66(2), pages 215-222, February.
    11. Cerrato, Mario & Sarantis, Nicholas, 2007. "A bootstrap panel unit root test under cross-sectional dependence, with an application to PPP," Computational Statistics & Data Analysis, Elsevier, vol. 51(8), pages 4028-4037, May.
    12. Kenneth S. Rogoff & Vania Stavrakeva, 2008. "The Continuing Puzzle of Short Horizon Exchange Rate Forecasting," NBER Working Papers 14071, National Bureau of Economic Research, Inc.
    13. Helmut Lütkepohl, 2013. "Vector autoregressive models," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 6, pages 139-164, Edward Elgar Publishing.
    14. Zhang Fang & Shan Ang & Luan Yihui, 2018. "A novel method to accurately calculate statistical significance of local similarity analysis for high-throughput time series," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 17(6), pages 1-14, December.
    15. Luís Aguiar-Conraria & Maria Joana Soares, 2014. "The Continuous Wavelet Transform: Moving Beyond Uni- And Bivariate Analysis," Journal of Economic Surveys, Wiley Blackwell, vol. 28(2), pages 344-375, April.
    16. Josifidis, Kosta & Allegret, Jean-Pierre & Gimet, Céline & Pucar, Emilija Beker, 2014. "Macroeconomic policy responses to financial crises in emerging European economies," Economic Modelling, Elsevier, vol. 36(C), pages 577-591.
    17. Jaime Casassus & Freddy Higuera, 2011. "Stock Return Predictability and Oil Prices," Documentos de Trabajo 406, Instituto de Economia. Pontificia Universidad Católica de Chile..
    18. Uhlig, Harald, 2005. "What are the effects of monetary policy on output? Results from an agnostic identification procedure," Journal of Monetary Economics, Elsevier, vol. 52(2), pages 381-419, March.
    19. Kim, Jae H. & Shamsuddin, Abul, 2008. "Are Asian stock markets efficient? Evidence from new multiple variance ratio tests," Journal of Empirical Finance, Elsevier, vol. 15(3), pages 518-532, June.
    20. Knut Are Aastveit & Claudia Foroni & Francesco Ravazzolo, 2017. "Density Forecasts With Midas Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(4), pages 783-801, June.

    More about this item

    Keywords

    Monte Carlo experiments; Graphical methods; confidence regions; inverting tests; bootstrap;
    All these keywords.

    JEL classification:

    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eve:wpaper:08-01. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Samuel Nosel (email available below). General contact details of provider: https://edirc.repec.org/data/epevrfr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.