IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v75y2000i2p219-244.html
   My bibliography  Save this article

Design Adaptive Nearest Neighbor Regression Estimation

Author

Listed:
  • Guerre, Emmanuel

Abstract

This paper deals with nonparametric regression estimation under arbitrary sampling with an unknown distribution. The effect of the distribution of the design, which is a nuisance parameter, can be eliminated by conditioning. An upper bound for the conditional mean squared error of k-NN estimates leads us to consider an optimal number of neighbors, which is a random function of the sampling. The corresponding estimate can be used for nonasymptotic inference and is also consistent under a minimal recurrence condition. Some deterministic equivalents are found for the random rate of convergence of this optimal estimate, for deterministic and random designs with vanishing or diverging densities. The proposed estimate is rate optimal for standard designs.

Suggested Citation

  • Guerre, Emmanuel, 2000. "Design Adaptive Nearest Neighbor Regression Estimation," Journal of Multivariate Analysis, Elsevier, vol. 75(2), pages 219-244, November.
    • Handle: RePEc:eee:jmvana:v:75:y:2000:i:2:p:219-244
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047-259X(00)91901-8
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yakowitz, Sid, 1993. "Nearest neighbor regression estimation for null-recurrent Markov time series," Stochastic Processes and their Applications, Elsevier, vol. 48(2), pages 311-318, November.
    2. Hardle, Wolfgang & Tsybakov, A. B., 1993. "How sensitive are average derivatives?," Journal of Econometrics, Elsevier, vol. 58(1-2), pages 31-48, July.
    3. Gyorfi, Laszlo & Lugosi, Gabor, 1992. "Kernel density estimation from ergodic sample is not universally consistent," Computational Statistics & Data Analysis, Elsevier, vol. 14(4), pages 437-442, November.
    4. Spokoiny, Vladimir G., 1998. "Estimation of a function with discontinuities via local polynomial fit with an adaptive window choice," SFB 373 Discussion Papers 1998,1, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    5. Hardle, Wolfgang & Tsybakov, A. B., 1993. "How sensitive are average derivatives?," Journal of Econometrics, Elsevier, vol. 58(1-2), pages 31-48, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Guerre, 2004. "Design-Adaptive Pointwise Nonparametric Regression Estimation For Recurrent Markov Time Series," Econometrics 0411007, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ichimura, Hidehiko & Todd, Petra E., 2007. "Implementing Nonparametric and Semiparametric Estimators," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 74, Elsevier.
    2. Yingcun Xia & Wolfgang Härdle & Oliver Linton, 2009. "Optimal Smoothing for a Computationally and Statistically Efficient Single Index Estimator," SFB 649 Discussion Papers SFB649DP2009-028, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    3. Girard, Stéphane & Guillou, Armelle & Stupfler, Gilles, 2013. "Frontier estimation with kernel regression on high order moments," Journal of Multivariate Analysis, Elsevier, vol. 116(C), pages 172-189.
    4. Qihua Wang & Tao Zhang & Wolfgang Karl Härdle, 2016. "An Extended Single-index Model with Missing Response at Random," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(4), pages 1140-1152, December.
    5. Kim, Peter T. & Koo, Ja-Yong & Park, Heon Jin, 2004. "Sharp minimaxity and spherical deconvolution for super-smooth error distributions," Journal of Multivariate Analysis, Elsevier, vol. 90(2), pages 384-392, August.
    6. Véronique Flambard & Pierre Lasserre & Pierre Mohnen, 2007. "Snow removal auctions in Montreal: costs, informational rents, and procurement management," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 40(1), pages 245-277, February.
    7. Huybrechts F. Bindele & Ash Abebe & Karlene N. Meyer, 2018. "General rank-based estimation for regression single index models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 70(5), pages 1115-1146, October.
    8. Yiping Yang & Tiejun Tong & Gaorong Li, 2019. "SIMEX estimation for single-index model with covariate measurement error," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 103(1), pages 137-161, March.
    9. Almekinders, Geert J & Eijffinger, Sylvester C W, 1994. "Daily Bundesbank and Federal Reserve Interventions: Are They a Reaction to Changes in the Level and Volatility of the DM/$-Rate?," Empirical Economics, Springer, vol. 19(1), pages 111-130.
    10. Girard, Séphane & Jacob, Pierre, 2009. "Frontier estimation with local polynomials and high power-transformed data," Journal of Multivariate Analysis, Elsevier, vol. 100(8), pages 1691-1705, September.
    11. Kyungchul Song, 2009. "Bootstrapping Semiparametric Models with Single-Index Nuisance Parameters, Second Version," PIER Working Paper Archive 10-026, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 02 Aug 2010.
    12. Marian Hristache, 2002. "Are Efficient Estimators in Single-Index Models Really Efficient? A Computational Discussion," Computational Statistics, Springer, vol. 17(4), pages 453-464, December.
    13. Feng, Sanying & Kong, Kaidi & Kong, Yinfei & Li, Gaorong & Wang, Zhaoliang, 2022. "Statistical inference of heterogeneous treatment effect based on single-index model," Computational Statistics & Data Analysis, Elsevier, vol. 175(C).
    14. Cattaneo, Matias D. & Crump, Richard K. & Jansson, Michael, 2010. "Robust Data-Driven Inference for Density-Weighted Average Derivatives," Journal of the American Statistical Association, American Statistical Association, vol. 105(491), pages 1070-1083.
    15. Gorgens, T., 1999. "Semiparametric Estimation of Single-Index Transition Intensities," Papers 99-25, Carleton - School of Public Administration.
    16. Hidehiko Ichimura & Oliver Linton, 2001. "Asymptotic expansions for some semiparametric program evaluation estimators," CeMMAP working papers 04/01, Institute for Fiscal Studies.
    17. Erik Bergkvist & Per Johansson, 2000. "Weighted Derivative Estimation of Quantal Response Models: Simulations and Applications to Choice of Truck Freight Carrier," Computational Statistics, Springer, vol. 15(4), pages 485-510, December.
    18. Biau, Gérard & Cadre, Benoît & Pelletier, Bruno, 2008. "Exact rates in density support estimation," Journal of Multivariate Analysis, Elsevier, vol. 99(10), pages 2185-2207, November.
    19. Cardot, Hervé & Johannes, Jan, 2010. "Thresholding projection estimators in functional linear models," Journal of Multivariate Analysis, Elsevier, vol. 101(2), pages 395-408, February.
    20. Cuevas, Antonio & Febrero, Manuel & Fraiman, Ricardo, 2001. "Cluster analysis: a further approach based on density estimation," Computational Statistics & Data Analysis, Elsevier, vol. 36(4), pages 441-459, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:75:y:2000:i:2:p:219-244. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.