IDEAS home Printed from https://ideas.repec.org/p/ifs/cemmap/29-13.html
   My bibliography  Save this paper

A simple bootstrap method for constructing nonparametric confidence bands for functions

Author

Listed:
  • Peter Hall

    (Institute for Fiscal Studies)

  • Joel L. Horowitz

    (Institute for Fiscal Studies and Northwestern University)

Abstract

Standard approaches to constructing nonparametric confidence bands for functions are frustrated by the impact of bias, which generally is not estimated consistently when using the bootstrap and conventionally smoothed function estimators. To overcome this problem, it is common practice to either undersmooth, so as to reduce the impact of bias, or oversmooth, and thereby introduce an explicit or implicit bias estimator. However, these approaches and others based on nonstandard smoothing methods, complicate the process of inference, for example by requiring the choice of new, unconventional smoothing parameters and, in the case of undersmoothing, producing relatively wide bands. In this paper we suggest a new approach, which exploits to our advantage one of the difficulties that, in the past, has prevented an attractive solution to the problem— the fact that the standard bootstrap bias estimator suffer from relatively high-frequency stochastic error. The high frequency, together with a technique based on quantiles, can be exploited to dampen down the stochastic error term, leading to relatively narrow, simple-to-construct confidence bands. A supplement to this article, which outlines theoretical properties underpinning the methodology and provides a proof of theorem, can be viewed here

Suggested Citation

  • Peter Hall & Joel L. Horowitz, 2013. "A simple bootstrap method for constructing nonparametric confidence bands for functions," CeMMAP working papers CWP29/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  • Handle: RePEc:ifs:cemmap:29/13
    as

    Download full text from publisher

    File URL: http://www.cemmap.ac.uk/wps/cwp291313.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Cai, T. Tony & Levine, Michael & Wang, Lie, 2009. "Variance function estimation in multivariate nonparametric regression with fixed design," Journal of Multivariate Analysis, Elsevier, vol. 100(1), pages 126-136, January.
    2. Tiejun Tong & Yuedong Wang, 2005. "Estimating residual variance in nonparametric regression using least squares," Biometrika, Biometrika Trust, vol. 92(4), pages 821-830, December.
    3. Song Xi Chen & Wolfgang Härdle & Ming Li, 2003. "An empirical likelihood goodness‐of‐fit test for time series," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(3), pages 663-678, August.
    4. McMurry, Timothy L. & Politis, Dimitris N., 2008. "Bootstrap confidence intervals in nonparametric regression with built-in bias correction," Statistics & Probability Letters, Elsevier, vol. 78(15), pages 2463-2469, October.
    5. Härdle, Wolfgang & Huet, Sylvie & Mammen, Enno & Sperlich, Stefan, 2004. "Bootstrap Inference In Semiparametric Generalized Additive Models," Econometric Theory, Cambridge University Press, vol. 20(2), pages 265-300, April.
    6. Horowitz, Joel L & Spokoiny, Vladimir G, 2001. "An Adaptive, Rate-Optimal Test of a Parametric Mean-Regression Model against a Nonparametric Alternative," Econometrica, Econometric Society, vol. 69(3), pages 599-631, May.
    7. Berry S. M. & Carroll R. J & Ruppert D., 2002. "Bayesian Smoothing and Regression Splines for Measurement Error Problems," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 160-169, March.
    8. Ruppert,David & Wand,M. P. & Carroll,R. J., 2003. "Semiparametric Regression," Cambridge Books, Cambridge University Press, number 9780521785167.
    9. Axel Munk & Nicolai Bissantz & Thorsten Wagner & Gudrun Freitag, 2005. "On difference‐based variance estimation in nonparametric regression when the covariate is high dimensional," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(1), pages 19-41, February.
    10. Mendez, Guillermo & Lohr, Sharon, 2011. "Estimating residual variance in random forest regression," Computational Statistics & Data Analysis, Elsevier, vol. 55(11), pages 2937-2950, November.
    11. Ruppert,David & Wand,M. P. & Carroll,R. J., 2003. "Semiparametric Regression," Cambridge Books, Cambridge University Press, number 9780521780506.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Peter Hall & Joel L. Horowitz, 2013. "A simple bootstrap method for constructing nonparametric confidence bands for functions," CeMMAP working papers 29/13, Institute for Fiscal Studies.
    2. Peter Hall & Joel L. Horowitz, 2012. "A simple bootstrap method for constructing nonparametric confidence bands for functions," CeMMAP working papers CWP14/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    3. Peter Hall & Joel L. Horowitz, 2012. "A simple bootstrap method for constructing nonparametric confidence bands for functions," CeMMAP working papers 14/12, Institute for Fiscal Studies.
    4. Gao, Jiti, 2007. "Nonlinear time series: semiparametric and nonparametric methods," MPRA Paper 39563, University Library of Munich, Germany, revised 01 Sep 2007.
    5. Jullion, Astrid & Lambert, Philippe, 2007. "Robust specification of the roughness penalty prior distribution in spatially adaptive Bayesian P-splines models," Computational Statistics & Data Analysis, Elsevier, vol. 51(5), pages 2542-2558, February.
    6. Øystein Sørensen & Anders M. Fjell & Kristine B. Walhovd, 2023. "Longitudinal Modeling of Age-Dependent Latent Traits with Generalized Additive Latent and Mixed Models," Psychometrika, Springer;The Psychometric Society, vol. 88(2), pages 456-486, June.
    7. Peter Pütz & Thomas Kneib, 2018. "A penalized spline estimator for fixed effects panel data models," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 102(2), pages 145-166, April.
    8. Roca-Pardinas, Javier & Cadarso-Suarez, Carmen & Tahoces, Pablo G. & Lado, Maria J., 2008. "Assessing continuous bivariate effects among different groups through nonparametric regression models: An application to breast cancer detection," Computational Statistics & Data Analysis, Elsevier, vol. 52(4), pages 1958-1970, January.
    9. Joel L. Horowitz & Anand Krishnamurthy, 2017. "A bootstrap method for constructing pointwise and uniform confidence bands for conditional quantile functions," CeMMAP working papers CWP01/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    10. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.
    11. Wu, Ximing & Sickles, Robin, 2018. "Semiparametric estimation under shape constraints," Econometrics and Statistics, Elsevier, vol. 6(C), pages 74-89.
    12. Eckhard Liebscher, 2012. "Model checks for parametric regression models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 21(1), pages 132-155, March.
    13. Liitiäinen, Elia & Corona, Francesco & Lendasse, Amaury, 2010. "Residual variance estimation using a nearest neighbor statistic," Journal of Multivariate Analysis, Elsevier, vol. 101(4), pages 811-823, April.
    14. María José Lombardía & Stefan Sperlich, 2008. "Semiparametric inference in generalized mixed effects models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(5), pages 913-930, November.
    15. Martin Meermeyer, 2015. "Weighted linear regression models with fixed weights and spherical disturbances," Computational Statistics, Springer, vol. 30(4), pages 929-955, December.
    16. Crainiceanu, Ciprian M. & Ruppert, David & Wand, Matthew P., 2005. "Bayesian Analysis for Penalized Spline Regression Using WinBUGS," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 14(i14).
    17. de Uña Álvarez, Jacobo & Roca Pardiñas, Javier, 2009. "Additive models in censored regression," Computational Statistics & Data Analysis, Elsevier, vol. 53(9), pages 3490-3501, July.
    18. Xin-Yuan Song & Zhao-Hua Lu & Jing-Heng Cai & Edward Ip, 2013. "A Bayesian Modeling Approach for Generalized Semiparametric Structural Equation Models," Psychometrika, Springer;The Psychometric Society, vol. 78(4), pages 624-647, October.
    19. Joel L. Horowitz & Anand Krishnamurthy, 2017. "A bootstrap method for constructing pointwise and uniform confidence bands for conditional quantile functions," CeMMAP working papers 01/17, Institute for Fiscal Studies.
    20. Zanin, Luca & Marra, Giampiero, 2012. "Assessing the functional relationship between CO2 emissions and economic development using an additive mixed model approach," Economic Modelling, Elsevier, vol. 29(4), pages 1328-1337.

    More about this item

    Keywords

    bandwidth; bias; boostrap; confidence interval; conservative coverage; coverage error; kernal methods; statistical smoothing;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:29/13. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emma Hyman (email available below). General contact details of provider: https://edirc.repec.org/data/cmifsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.