IDEAS home Printed from https://ideas.repec.org/a/taf/jnlasa/v110y2015i512p1726-1734.html
   My bibliography  Save this article

Conditional Distance Correlation

Author

Listed:
  • Xueqin Wang
  • Wenliang Pan
  • Wenhao Hu
  • Yuan Tian
  • Heping Zhang

Abstract

Statistical inference on conditional dependence is essential in many fields including genetic association studies and graphical models. The classic measures focus on linear conditional correlations and are incapable of characterizing nonlinear conditional relationship including nonmonotonic relationship. To overcome this limitation, we introduce a nonparametric measure of conditional dependence for multivariate random variables with arbitrary dimensions. Our measure possesses the necessary and intuitive properties as a correlation index. Briefly, it is zero almost surely if and only if two multivariate random variables are conditionally independent given a third random variable. More importantly, the sample version of this measure can be expressed elegantly as the root of a V or U-process with random kernels and has desirable theoretical properties. Based on the sample version, we propose a test for conditional independence, which is proven to be more powerful than some recently developed tests through our numerical simulations. The advantage of our test is even greater when the relationship between the multivariate random variables given the third random variable cannot be expressed in a linear or monotonic function of one random variable versus the other. We also show that the sample measure is consistent and weakly convergent, and the test statistic is asymptotically normal. By applying our test in a real data analysis, we are able to identify two conditionally associated gene expressions, which otherwise cannot be revealed. Thus, our measure of conditional dependence is not only an ideal concept, but also has important practical utility. Supplementary materials for this article are available online.

Suggested Citation

  • Xueqin Wang & Wenliang Pan & Wenhao Hu & Yuan Tian & Heping Zhang, 2015. "Conditional Distance Correlation," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1726-1734, December.
  • Handle: RePEc:taf:jnlasa:v:110:y:2015:i:512:p:1726-1734
    DOI: 10.1080/01621459.2014.993081
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/01621459.2014.993081
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1080/01621459.2014.993081?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Schick, Anton, 1997. "On U-statistics with random kernels," Statistics & Probability Letters, Elsevier, vol. 34(3), pages 275-283, June.
    2. Su, Liangjun & White, Halbert, 2003. "A Consistent Characteristic-Function-Based Test for Conditional Independence," University of California at San Diego, Economics Working Paper Series qt4dv0837f, Department of Economics, UC San Diego.
    3. Fan, Yanqin & Li, Qi, 1996. "Consistent Model Specification Tests: Omitted Variables and Semiparametric Functional Forms," Econometrica, Econometric Society, vol. 64(4), pages 865-890, July.
    4. Scutari, Marco, 2010. "Learning Bayesian Networks with the bnlearn R Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 35(i03).
    5. Su, Liangjun & White, Halbert, 2007. "A consistent characteristic function-based test for conditional independence," Journal of Econometrics, Elsevier, vol. 141(2), pages 807-834, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhou, Yeqing & Liu, Jingyuan & Zhu, Liping, 2020. "Test for conditional independence with application to conditional screening," Journal of Multivariate Analysis, Elsevier, vol. 175(C).
    2. Yi Liu & Qihua Wang, 2018. "Model-free feature screening for ultrahigh-dimensional data conditional on some variables," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 70(2), pages 283-301, April.
    3. Dominic Edelmann & Thomas Welchowski & Axel Benner, 2022. "A consistent version of distance covariance for right‐censored survival data and its application in hypothesis testing," Biometrics, The International Biometric Society, vol. 78(3), pages 867-879, September.
    4. Ke, Chenlu & Yang, Wei & Yuan, Qingcong & Li, Lu, 2023. "Partial sufficient variable screening with categorical controls," Computational Statistics & Data Analysis, Elsevier, vol. 187(C).
    5. Cencheng Shen & Joshua T. Vogelstein, 2021. "The exact equivalence of distance and kernel methods in hypothesis testing," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 105(3), pages 385-403, September.
    6. Maomao Ding & Ruosha Li & Jin Qin & Jing Ning, 2023. "A double‐robust test for high‐dimensional gene coexpression networks conditioning on clinical information," Biometrics, The International Biometric Society, vol. 79(4), pages 3227-3238, December.
    7. Xinyi Xu & Jingxiao Zhang, 2020. "Groupwise sufficient dimension reduction via conditional distance clustering," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 83(2), pages 217-242, February.
    8. Xu, Kai & Cheng, Qing, 2024. "Test of conditional independence in factor models via Hilbert–Schmidt independence criterion," Journal of Multivariate Analysis, Elsevier, vol. 199(C).
    9. Shi, Chengchun & Xu, Tianlin & Bergsma, Wicher & Li, Lexin, 2021. "Double generative adversarial networks for conditional independence testing," LSE Research Online Documents on Economics 112550, London School of Economics and Political Science, LSE Library.
    10. Soale, Abdul-Nasah, 2023. "Projection expectile regression for sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 180(C).
    11. Bianchi, Pascal & Elgui, Kevin & Portier, François, 2023. "Conditional independence testing via weighted partial copulas," Journal of Multivariate Analysis, Elsevier, vol. 193(C).
    12. Xuehu Zhu & Jun Lu & Jun Zhang & Lixing Zhu, 2021. "Testing for conditional independence: A groupwise dimension reduction‐based adaptive‐to‐model approach," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 48(2), pages 549-576, June.
    13. Fan, Jianqing & Feng, Yang & Xia, Lucy, 2020. "A projection-based conditional dependence measure with applications to high-dimensional undirected graphical models," Journal of Econometrics, Elsevier, vol. 218(1), pages 119-139.
    14. Jun Lu & Lu Lin, 2020. "Model-free conditional screening via conditional distance correlation," Statistical Papers, Springer, vol. 61(1), pages 225-244, February.
    15. Dingke Tang & Dehan Kong & Wenliang Pan & Linbo Wang, 2023. "Ultra‐high dimensional variable selection for doubly robust causal inference," Biometrics, The International Biometric Society, vol. 79(2), pages 903-914, June.
    16. Yuan, Qingcong & Chen, Xianyan & Ke, Chenlu & Yin, Xiangrong, 2022. "Independence index sufficient variable screening for categorical responses," Computational Statistics & Data Analysis, Elsevier, vol. 174(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Taoufik Bouezmarni & Jeroen V.K. Rombouts & Abderrahim Taamouti, 2011. "Nonparametric Copula-Based Test for Conditional Independence with Applications to Granger Causality," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(2), pages 275-287, October.
    2. Xuehu Zhu & Jun Lu & Jun Zhang & Lixing Zhu, 2021. "Testing for conditional independence: A groupwise dimension reduction‐based adaptive‐to‐model approach," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 48(2), pages 549-576, June.
    3. Nianqing Liu & Quang Vuong & Haiqing Xu, 2012. "Rationalization and Identification of Discrete Games with Correlated Types," Department of Economics Working Papers 130915, The University of Texas at Austin, Department of Economics.
    4. Liu, Nianqing & Vuong, Quang & Xu, Haiqing, 2017. "Rationalization and identification of binary games with correlated types," Journal of Econometrics, Elsevier, vol. 201(2), pages 249-268.
    5. Chen, Bin & Song, Zhaogang, 2013. "Testing whether the underlying continuous-time process follows a diffusion: An infinitesimal operator-based approach," Journal of Econometrics, Elsevier, vol. 173(1), pages 83-107.
    6. Fan, Jianqing & Feng, Yang & Xia, Lucy, 2020. "A projection-based conditional dependence measure with applications to high-dimensional undirected graphical models," Journal of Econometrics, Elsevier, vol. 218(1), pages 119-139.
    7. Herman J. Bierens & Li Wang, 2017. "Weighted simulated integrated conditional moment tests for parametric conditional distributions of stationary time series processes," Econometric Reviews, Taylor & Francis Journals, vol. 36(1-3), pages 103-135, March.
    8. Su, Liangjun & White, Halbert, 2014. "Testing conditional independence via empirical likelihood," Journal of Econometrics, Elsevier, vol. 182(1), pages 27-44.
    9. Bianchi, Pascal & Elgui, Kevin & Portier, François, 2023. "Conditional independence testing via weighted partial copulas," Journal of Multivariate Analysis, Elsevier, vol. 193(C).
    10. Bertrand Candelon & Sessi Tokpavi, 2016. "A Nonparametric Test for Granger Causality in Distribution With Application to Financial Contagion," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(2), pages 240-253, April.
    11. Fu, Zhonghao & Hong, Yongmiao, 2019. "A model-free consistent test for structural change in regression possibly with endogeneity," Journal of Econometrics, Elsevier, vol. 211(1), pages 206-242.
    12. Chuang, Chia-Chang & Kuan, Chung-Ming & Lin, Hsin-Yi, 2009. "Causality in quantiles and dynamic stock return-volume relations," Journal of Banking & Finance, Elsevier, vol. 33(7), pages 1351-1360, July.
    13. Simos G. Meintanis & Joseph Ngatchou-Wandji & James Allison, 2018. "Testing for serial independence in vector autoregressive models," Statistical Papers, Springer, vol. 59(4), pages 1379-1410, December.
    14. Long, Xiangdong & Su, Liangjun & Ullah, Aman, 2011. "Estimation and Forecasting of Dynamic Conditional Covariance: A Semiparametric Multivariate Model," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 109-125.
    15. Xu, Kai & Cheng, Qing, 2024. "Test of conditional independence in factor models via Hilbert–Schmidt independence criterion," Journal of Multivariate Analysis, Elsevier, vol. 199(C).
    16. repec:wyi:journl:002142 is not listed on IDEAS
    17. Amaro de Matos, Joao & Fernandes, Marcelo, 2007. "Testing the Markov property with high frequency data," Journal of Econometrics, Elsevier, vol. 141(1), pages 44-64, November.
    18. Huang, Meng & Sun, Yixiao & White, Hal, 2013. "A Flexible Nonparametric Test for Conditional Independence," University of California at San Diego, Economics Working Paper Series qt3pt89204, Department of Economics, UC San Diego.
    19. Bin Chen & Yongmiao Hong, 2013. "Characteristic Function-Based Testing for Multifactor Continuous-Time Markov Models via Nonparametri," Working Papers 2013-10-14, Wang Yanan Institute for Studies in Economics (WISE), Xiamen University.
    20. Chen, Bin & Hong, Yongmiao, 2012. "Testing For The Markov Property In Time Series," Econometric Theory, Cambridge University Press, vol. 28(1), pages 130-178, February.
    21. Wang, Hongfei & Liu, Binghui & Feng, Long & Ma, Yanyuan, 2024. "Rank-based max-sum tests for mutual independence of high-dimensional random vectors," Journal of Econometrics, Elsevier, vol. 238(1).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:jnlasa:v:110:y:2015:i:512:p:1726-1734. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/UASA20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.