IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v133y2015icp38-50.html
   My bibliography  Save this article

Conditional density estimation in measurement error problems

Author

Listed:
  • Wang, Xiao-Feng
  • Ye, Deping

Abstract

This paper is motivated by a wide range of background correction problems in gene array data analysis, where the raw gene expression intensities are measured with error. Estimating a conditional density function from the contaminated expression data is a key aspect of statistical inference and visualization in these studies. We propose re-weighted deconvolution kernel methods to estimate the conditional density function in an additive error model, when the error distribution is known as well as when it is unknown. Theoretical properties of the proposed estimators are investigated with respect to the mean absolute error from a “double asymptotic” view. Practical rules are developed for the selection of smoothing-parameters. Simulated examples and an application to an Illumina bead microarray study are presented to illustrate the viability of the methods.

Suggested Citation

  • Wang, Xiao-Feng & Ye, Deping, 2015. "Conditional density estimation in measurement error problems," Journal of Multivariate Analysis, Elsevier, vol. 133(C), pages 38-50.
    • Handle: RePEc:eee:jmvana:v:133:y:2015:i:c:p:38-50
    DOI: 10.1016/j.jmva.2014.08.011
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X14001936
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2014.08.011?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Peter Hall & Jeff Racine & Qi Li, 2004. "Cross-Validation and the Estimation of Conditional Probability Densities," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 1015-1026, December.
    2. Jianqing Fan & Tsz Ho Yim, 2004. "A crossvalidation method for estimating conditional densities," Biometrika, Biometrika Trust, vol. 91(4), pages 819-834, December.
    3. Hall, Peter & Wand, Matthew P., 1988. "On the minimization of absolute distance in kernel density estimation," Statistics & Probability Letters, Elsevier, vol. 6(5), pages 311-314, April.
    4. Wang, Xiao-Feng & Wang, Bin, 2011. "Deconvolution Estimation in Measurement Error Models: The R Package decon," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 39(i10).
    5. Hall, Peter & Wand, Matthew P., 1988. "Minimizing L1 distance in nonparametric density estimation," Journal of Multivariate Analysis, Elsevier, vol. 26(1), pages 59-88, July.
    6. Peter Hall & Tapabrata Maiti, 2009. "Deconvolution methods for non‐parametric inference in two‐level mixed models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(3), pages 703-718, June.
    7. Bashtannyk, David M. & Hyndman, Rob J., 2001. "Bandwidth selection for kernel conditional density estimation," Computational Statistics & Data Analysis, Elsevier, vol. 36(3), pages 279-298, May.
    8. Delaigle, A. & Gijbels, I., 2004. "Practical bandwidth selection in deconvolution kernel density estimation," Computational Statistics & Data Analysis, Elsevier, vol. 45(2), pages 249-267, March.
    9. Wang, Xiao-Feng & Fan, Zhaozhi & Wang, Bin, 2010. "Estimating smooth distribution function in the presence of heteroscedastic measurement errors," Computational Statistics & Data Analysis, Elsevier, vol. 54(1), pages 25-36, January.
    10. Julie McIntyre & Leonard Stefanski, 2011. "Density Estimation with Replicate Heteroscedastic Measurements," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 63(1), pages 81-99, February.
    11. Jan G. De Gooijer & Dawit Zerom, 2003. "On Conditional Density Estimation," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 57(2), pages 159-176, May.
    12. Xiao-Feng Wang & Deping Ye, 2012. "The effects of error magnitude and bandwidth selection for deconvolution with unknown error distribution," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 24(1), pages 153-167.
    13. F. Comte & C. Lacour, 2011. "Data‐driven density estimation in the presence of additive noise with unknown distribution," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 73(4), pages 601-627, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kateřina Konečná & Ivanka Horová, 2019. "Maximum likelihood method for bandwidth selection in kernel conditional density estimate," Computational Statistics, Springer, vol. 34(4), pages 1871-1887, December.
    2. Wen, Kuangyu & Wu, Ximing, 2017. "Smoothed kernel conditional density estimation," Economics Letters, Elsevier, vol. 152(C), pages 112-116.
    3. Liang, Han-Ying & Liu, Ai-Ai, 2013. "Kernel estimation of conditional density with truncated, censored and dependent data," Journal of Multivariate Analysis, Elsevier, vol. 120(C), pages 40-58.
    4. Ali Al-Sharadqah & Majid Mojirsheibani & William Pouliot, 2020. "On the performance of weighted bootstrapped kernel deconvolution density estimators," Statistical Papers, Springer, vol. 61(4), pages 1773-1798, August.
    5. Ann-Kathrin Bott & Michael Kohler, 2016. "Adaptive Estimation of a Conditional Density," International Statistical Review, International Statistical Institute, vol. 84(2), pages 291-316, August.
    6. Ichimura, Tsuyoshi & Fukuda, Daisuke, 2010. "A fast algorithm for computing least-squares cross-validations for nonparametric conditional kernel density functions," Computational Statistics & Data Analysis, Elsevier, vol. 54(12), pages 3404-3410, December.
    7. Geenens, Gery & Dunn, Richard, 2022. "A nonparametric copula approach to conditional Value-at-Risk," Econometrics and Statistics, Elsevier, vol. 21(C), pages 19-37.
    8. Liang, Han-Ying & Peng, Liang, 2010. "Asymptotic normality and Berry-Esseen results for conditional density estimator with censored and dependent data," Journal of Multivariate Analysis, Elsevier, vol. 101(5), pages 1043-1054, May.
    9. Gery Geenens & Richard Dunn, 2017. "A nonparametric copula approach to conditional Value-at-Risk," Papers 1712.05527, arXiv.org, revised Oct 2019.
    10. Chopin, Nicolas & Gadat, Sébastien & Guedj, Benjamin & Guyader, Arnaud & Vernet, Elodie, 2015. "On some recent advances in high dimensional Bayesian Statistics," TSE Working Papers 15-557, Toulouse School of Economics (TSE).
    11. Holmes, Michael P. & Gray, Alexander G. & Isbell Jr., Charles Lee, 2010. "Fast kernel conditional density estimation: A dual-tree Monte Carlo approach," Computational Statistics & Data Analysis, Elsevier, vol. 54(7), pages 1707-1718, July.
    12. Han-Ying Liang & Jong-Il Baek, 2016. "Asymptotic normality of conditional density estimation with left-truncated and dependent data," Statistical Papers, Springer, vol. 57(1), pages 1-20, March.
    13. Obbey Elamin & Len Gill & Martyn Andrews, 2020. "Insights from kernel conditional-probability estimates into female labour force participation decision in the UK," Empirical Economics, Springer, vol. 58(6), pages 2981-3006, June.
    14. Jooyoung Jeon & James W. Taylor, 2012. "Using Conditional Kernel Density Estimation for Wind Power Density Forecasting," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(497), pages 66-79, March.
    15. Otneim, Håkon & Tjøstheim, Dag, 2016. "Non-parametric estimation of conditional densities: A new method," Discussion Papers 2016/22, Norwegian School of Economics, Department of Business and Management Science.
    16. Xiong, Xianzhu & Ou, Meijuan & Chen, Ailian, 2021. "Reweighted Nadaraya–Watson estimation of conditional density function in the right-censored model," Statistics & Probability Letters, Elsevier, vol. 168(C).
    17. Kato, Kengo & Sasaki, Yuya, 2018. "Uniform confidence bands in deconvolution with unknown error distribution," Journal of Econometrics, Elsevier, vol. 207(1), pages 129-161.
    18. Faugeras, Olivier P., 2009. "A quantile-copula approach to conditional density estimation," Journal of Multivariate Analysis, Elsevier, vol. 100(9), pages 2083-2099, October.
    19. Bin Wang & Shu-Guang Zhang & Xiao-Feng Wang & Ming Tan & Yaguang Xi, 2012. "Testing for Differentially-Expressed MicroRNAs with Errors-in-Variables Nonparametric Regression," PLOS ONE, Public Library of Science, vol. 7(5), pages 1-12, May.
    20. Arora, Siddharth & Taylor, James W., 2016. "Forecasting electricity smart meter data using conditional kernel density estimation," Omega, Elsevier, vol. 59(PA), pages 47-59.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:133:y:2015:i:c:p:38-50. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.