IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v75y2000i2p219-244.html
   My bibliography  Save this article

Design Adaptive Nearest Neighbor Regression Estimation

Author

Listed:
  • Guerre, Emmanuel

Abstract

This paper deals with nonparametric regression estimation under arbitrary sampling with an unknown distribution. The effect of the distribution of the design, which is a nuisance parameter, can be eliminated by conditioning. An upper bound for the conditional mean squared error of k-NN estimates leads us to consider an optimal number of neighbors, which is a random function of the sampling. The corresponding estimate can be used for nonasymptotic inference and is also consistent under a minimal recurrence condition. Some deterministic equivalents are found for the random rate of convergence of this optimal estimate, for deterministic and random designs with vanishing or diverging densities. The proposed estimate is rate optimal for standard designs.

Suggested Citation

  • Guerre, Emmanuel, 2000. "Design Adaptive Nearest Neighbor Regression Estimation," Journal of Multivariate Analysis, Elsevier, vol. 75(2), pages 219-244, November.
    • Handle: RePEc:eee:jmvana:v:75:y:2000:i:2:p:219-244
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047-259X(00)91901-8
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yakowitz, Sid, 1993. "Nearest neighbor regression estimation for null-recurrent Markov time series," Stochastic Processes and their Applications, Elsevier, vol. 48(2), pages 311-318, November.
    2. Hardle, Wolfgang & Tsybakov, A. B., 1993. "How sensitive are average derivatives?," Journal of Econometrics, Elsevier, vol. 58(1-2), pages 31-48, July.
    3. Gyorfi, Laszlo & Lugosi, Gabor, 1992. "Kernel density estimation from ergodic sample is not universally consistent," Computational Statistics & Data Analysis, Elsevier, vol. 14(4), pages 437-442, November.
    4. Spokoiny, Vladimir G., 1998. "Estimation of a function with discontinuities via local polynomial fit with an adaptive window choice," SFB 373 Discussion Papers 1998,1, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    5. Hardle, Wolfgang & Tsybakov, A. B., 1993. "How sensitive are average derivatives?," Journal of Econometrics, Elsevier, vol. 58(1-2), pages 31-48, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Guerre, 2004. "Design-Adaptive Pointwise Nonparametric Regression Estimation For Recurrent Markov Time Series," Econometrics 0411007, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kaido, Hiroaki, 2017. "Asymptotically Efficient Estimation Of Weighted Average Derivatives With An Interval Censored Variable," Econometric Theory, Cambridge University Press, vol. 33(5), pages 1218-1241, October.
    2. Ichimura, Hidehiko & Todd, Petra E., 2007. "Implementing Nonparametric and Semiparametric Estimators," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 74, Elsevier.
    3. Xia, Yingcun & Härdle, Wolfgang Karl & Linton, Oliver, 2009. "Optimal smoothing for a computationally and statistically efficient single index estimator," SFB 649 Discussion Papers 2009-028, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    4. Goldenshluger, Alexander, 2002. "Density Deconvolution in the Circular Structural Model," Journal of Multivariate Analysis, Elsevier, vol. 81(2), pages 360-375, May.
    5. Gorgens, T., 1999. "Semiparametric Estimation of Single-Index Transition Intensities," Papers 99-25, Carleton - School of Public Administration.
    6. Linton, Oliver, 2002. "Edgeworth approximations for semiparametric instrumental variable estimators and test statistics," Journal of Econometrics, Elsevier, vol. 106(2), pages 325-368, February.
    7. Girard, Stéphane & Guillou, Armelle & Stupfler, Gilles, 2013. "Frontier estimation with kernel regression on high order moments," Journal of Multivariate Analysis, Elsevier, vol. 116(C), pages 172-189.
    8. Qihua Wang & Tao Zhang & Wolfgang Karl Härdle, 2016. "An Extended Single-index Model with Missing Response at Random," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(4), pages 1140-1152, December.
    9. Kim, Peter T. & Koo, Ja-Yong & Park, Heon Jin, 2004. "Sharp minimaxity and spherical deconvolution for super-smooth error distributions," Journal of Multivariate Analysis, Elsevier, vol. 90(2), pages 384-392, August.
    10. Véronique Flambard & Pierre Lasserre & Pierre Mohnen, 2007. "Snow removal auctions in Montreal: costs, informational rents, and procurement management," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 40(1), pages 245-277, February.
    11. Kyungchul Song, 2009. "Two-Step Extremum Estimation with Estimated Single-Indices," PIER Working Paper Archive 09-012, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    12. Nishiyama, Y., 2004. "Minimum normal approximation error bandwidth selection for averaged derivatives," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 64(1), pages 53-61.
    13. Huybrechts F. Bindele & Ash Abebe & Karlene N. Meyer, 2018. "General rank-based estimation for regression single index models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 70(5), pages 1115-1146, October.
    14. Hall, Peter & Park, Byeong U. & Stern, Steven E., 1998. "On Polynomial Estimators of Frontiers and Boundaries," Journal of Multivariate Analysis, Elsevier, vol. 66(1), pages 71-98, July.
    15. Yiping Yang & Tiejun Tong & Gaorong Li, 2019. "SIMEX estimation for single-index model with covariate measurement error," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 103(1), pages 137-161, March.
    16. Cattaneo, Matias D. & Crump, Richard K. & Jansson, Michael, 2010. "Robust Data-Driven Inference for Density-Weighted Average Derivatives," Journal of the American Statistical Association, American Statistical Association, vol. 105(491), pages 1070-1083.
    17. repec:hum:wpaper:sfb649dp2014-003 is not listed on IDEAS
    18. Powell, James L. & Stoker, Thomas M., 1996. "Optimal bandwidth choice for density-weighted averages," Journal of Econometrics, Elsevier, vol. 75(2), pages 291-316, December.
    19. repec:hum:wpaper:sfb649dp2009-028 is not listed on IDEAS
    20. Girard, Séphane & Jacob, Pierre, 2009. "Frontier estimation with local polynomials and high power-transformed data," Journal of Multivariate Analysis, Elsevier, vol. 100(8), pages 1691-1705, September.
    21. Bontemps, Christophe & Simioni, Michel & Surry, Yves R., 2005. "Hedonic Housing Prices and Agricultural Pollution: An Empirical Investigation on Semiparametric Models," 2005 Annual meeting, July 24-27, Providence, RI 19547, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    22. Hidehiko Ichimura & Oliver Linton, 2001. "Asymptotic expansions for some semiparametric program evaluation estimators," CeMMAP working papers 04/01, Institute for Fiscal Studies.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:75:y:2000:i:2:p:219-244. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.