IDEAS home Printed from https://ideas.repec.org/a/spr/testjl/v30y2021i4d10.1007_s11749-020-00749-5.html
   My bibliography  Save this article

Nonparametric estimation for big-but-biased data

Author

Listed:
  • Laura Borrajo

    (CITIC, University of A Coruña)

  • Ricardo Cao

    (CITIC and ITMATI, University of A Coruña)

Abstract

Nonparametric estimation for a large-sized sample subject to sampling bias is studied in this paper. The general parameter considered is the mean of a transformation of the random variable of interest. When ignoring the biasing weight function, a small-sized simple random sample of the real population is assumed to be additionally observed. A new nonparametric estimator that incorporates kernel density estimation is proposed. Asymptotic properties for this estimator are obtained under suitable limit conditions on the small and the large sample sizes and standard and non-standard asymptotic conditions on the two bandwidths. Explicit formulas are shown for the particular case of mean estimation. Simulation results show that the new mean estimator outperforms two classical ones for suitable choices of the two smoothing parameters involved. The influence of two smoothing parameters on the performance of the final estimator is also studied, exhibiting a striking limit behavior of their optimal values. The new method is applied to a real data set from the Telco Company Vodafone ES, where a bootstrap algorithm is used to select the smoothing parameter.

Suggested Citation

  • Laura Borrajo & Ricardo Cao, 2021. "Nonparametric estimation for big-but-biased data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 30(4), pages 861-883, December.
    • Handle: RePEc:spr:testjl:v:30:y:2021:i:4:d:10.1007_s11749-020-00749-5
    DOI: 10.1007/s11749-020-00749-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11749-020-00749-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11749-020-00749-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Montanari, Giorgio E. & Ranalli, M. Giovanna, 2005. "Nonparametric Model Calibration Estimation in Survey Sampling," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 1429-1442, December.
    2. Li, Qi & Racine, Jeff, 2003. "Nonparametric estimation of distributions with categorical and continuous data," Journal of Multivariate Analysis, Elsevier, vol. 86(2), pages 266-292, August.
    3. Ma, Yanyuan & Genton, Marc G. & Tsiatis, Anastasios A., 2005. "Locally Efficient Semiparametric Estimators for Generalized Skew-Elliptical Distributions," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 980-989, September.
    4. Yanyuan Ma & Mijeong Kim & Marc G. Genton, 2013. "Semiparametric Efficient and Robust Estimation of an Unknown Symmetric Population Under Arbitrary Sample Selection Bias," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(503), pages 1090-1104, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mikhail Zhelonkin & Marc G. Genton & Elvezio Ronchetti, 2016. "Robust inference in sample selection models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(4), pages 805-827, September.
    2. Kim, Junyung & Shah, Asad Ullah Amin & Kang, Hyun Gook, 2020. "Dynamic risk assessment with bayesian network and clustering analysis," Reliability Engineering and System Safety, Elsevier, vol. 201(C).
    3. Feng, Guohua & McLaren, Keith R. & Yang, Ou & Zhang, Xiaohui & Zhao, Xueyan, 2021. "The impact of environmental policy stringency on industrial productivity growth: A semi-parametric study of OECD countries," Energy Economics, Elsevier, vol. 100(C).
    4. Besstremyannaya, Galina, 2015. "Measuring the effect of health insurance companies on the quality of healthcare systems with kernel and parametric regressions," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 38(2), pages 3-20.
    5. Carl-Erik Särndal & Imbi Traat & Kaur Lumiste, 2018. "Interaction Between Data Collection And Estimation Phases In Surveys With Nonresponse," Statistics in Transition New Series, Polish Statistical Association, vol. 19(2), pages 183-200, June.
    6. Hao Dong & Daniel L. Millimet, 2020. "Propensity Score Weighting with Mismeasured Covariates: An Application to Two Financial Literacy Interventions," JRFM, MDPI, vol. 13(11), pages 1-24, November.
    7. Jeff Racine & Qi Li & Xi Zhu, 2004. "Kernel Estimation of Multivariate Conditional Distributions," Annals of Economics and Finance, Society for AEF, vol. 5(2), pages 211-235, November.
    8. Jeffrey Racine, 2015. "Mixed data kernel copulas," Empirical Economics, Springer, vol. 48(1), pages 37-59, February.
    9. Cornelis J. Potgieter & Marc G. Genton, 2013. "Characteristic Function-based Semiparametric Inference for Skew-symmetric Models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 40(3), pages 471-490, September.
    10. Bontemps, Christophe & Racine, Jeffrey S. & Simioni, Michel, 2009. "Nonparametric vs Parametric Binary Choice Models: An Empirical Investigation," TSE Working Papers 09-126, Toulouse School of Economics (TSE).
    11. Gustavo Canavire-Bacarreza & Luis C. Carvajal-Osorio, 2020. "Two Stories of Wage Dynamics in Latin America: Different Policies, Different Outcomes," Journal of Labor Research, Springer, vol. 41(1), pages 128-168, June.
    12. Domingo Morales & María del Mar Rueda & Dolores Esteban, 2018. "Model-Assisted Estimation of Small Area Poverty Measures: An Application within the Valencia Region in Spain," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 138(3), pages 873-900, August.
    13. Daniel J. Henderson & Alexandre Olbrecht & Solomon W. Polachek, 2006. "Do Former College Athletes Earn More at Work?: A Nonparametric Assessment," Journal of Human Resources, University of Wisconsin Press, vol. 41(3).
    14. Chu, Chi-Yang & Henderson, Daniel J. & Parmeter, Christopher F., 2017. "On discrete Epanechnikov kernel functions," Computational Statistics & Data Analysis, Elsevier, vol. 116(C), pages 79-105.
    15. M. Rueda & I. Sánchez-Borrego & A. Arcos & S. Martínez, 2010. "Model-calibration estimation of the distribution function using nonparametric regression," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 71(1), pages 33-44, January.
    16. Escanciano, Juan Carlos & Song, Kyungchul, 2010. "Testing single-index restrictions with a focus on average derivatives," Journal of Econometrics, Elsevier, vol. 156(2), pages 377-391, June.
    17. Phillip Heiler & Jana Mareckova, 2019. "Shrinkage for Categorical Regressors," Papers 1901.01898, arXiv.org.
    18. Yong Liu & Alan P. Ker, 2021. "Simultaneous borrowing of information across space and time for pricing insurance contracts: An application to rating crop insurance policies," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 88(1), pages 231-257, March.
    19. Jae Kwang Kim & Mingue Park, 2010. "Calibration Estimation in Survey Sampling," International Statistical Review, International Statistical Institute, vol. 78(1), pages 21-39, April.
    20. Liu, Y. & Ker, A., 2018. "Is There Too Much History in Historical Yield Data," 2018 Conference, July 28-August 2, 2018, Vancouver, British Columbia 277293, International Association of Agricultural Economists.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:testjl:v:30:y:2021:i:4:d:10.1007_s11749-020-00749-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.