IDEAS home Printed from https://ideas.repec.org/a/spr/compst/v29y2014i3p529-546.html
   My bibliography  Save this article

Sensitivity analysis for inference with partially identifiable covariance matrices

Author

Listed:
  • Max G’Sell
  • Shai Shen-Orr
  • Robert Tibshirani

Abstract

In some multivariate problems with missing data, pairs of variables exist that are never observed together. For example, some modern biological tools can produce data of this form. As a result of this structure, the covariance matrix is only partially identifiable, and point estimation requires that identifying assumptions be made. These assumptions can introduce an unknown and potentially large bias into the inference. This paper presents a method based on semidefinite programming for automatically quantifying this potential bias by computing the range of possible equal-likelihood inferred values for convex functions of the covariance matrix. We focus on the bias of missing value imputation via conditional expectation and show that our method can give an accurate assessment of the true error in cases where estimates based on sampling uncertainty alone are overly optimistic. Copyright Springer-Verlag Berlin Heidelberg 2014

Suggested Citation

  • Max G’Sell & Shai Shen-Orr & Robert Tibshirani, 2014. "Sensitivity analysis for inference with partially identifiable covariance matrices," Computational Statistics, Springer, vol. 29(3), pages 529-546, June.
    • Handle: RePEc:spr:compst:v:29:y:2014:i:3:p:529-546
    DOI: 10.1007/s00180-013-0451-4
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s00180-013-0451-4
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s00180-013-0451-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Rubin, Donald B, 1986. "Statistical Matching Using File Concatenation with Adjusted Weights and Multiple Imputations," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(1), pages 87-94, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nickolay Trendafilov & Martin Kleinsteuber & Hui Zou, 2014. "Sparse matrices in data analysis," Computational Statistics, Springer, vol. 29(3), pages 403-405, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. François Gardes, 2021. "On the value of time and human life," Documents de travail du Centre d'Economie de la Sorbonne 21023, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    2. François Gardes, 2021. "A Solution to the Estimation of an Enlarged GDP Including Domestic Production: An Estimation on Micro Data," Post-Print halshs-03325362, HAL.
    3. Joost Ginkel & Pieter Kroonenberg, 2014. "Using Generalized Procrustes Analysis for Multiple Imputation in Principal Component Analysis," Journal of Classification, Springer;The Classification Society, vol. 31(2), pages 242-269, July.
    4. Peter ven de Ven & Anne Harrison & Barbara Fraumeni & Dennis Fixler & David Johnson & Andrew Craig & Kevin Furlong, 2017. "A Consistent Data Series to Evaluate Growth and Inequality in the National Accounts Note: The views expressed in this research, including those related to statistical, methodological, technical, or op," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 63, pages 437-459, December.
    5. Norah Alyabs & Sy Han Chiou, 2022. "The Missing Indicator Approach for Accelerated Failure Time Model with Covariates Subject to Limits of Detection," Stats, MDPI, vol. 5(2), pages 1-13, May.
    6. Eugenio Zucchelli & Andrew M Jones & Nigel Rice, 2012. "The evaluation of health policies through dynamic microsimulation methods," International Journal of Microsimulation, International Microsimulation Association, vol. 5(1), pages 2-20.
    7. Michael S. Rendall & Bonnie Ghosh-Dastidar & Margaret M. Weden & Zafar Nazarov, 2011. "Multiple Imputation for Combined-Survey Estimation With Incomplete Regressors In One But Not Both Surveys," Working Papers WR-887-1, RAND Corporation.
    8. Joost R. Ginkel, 2020. "Standardized Regression Coefficients and Newly Proposed Estimators for $${R}^{{2}}$$R2 in Multiply Imputed Data," Psychometrika, Springer;The Psychometric Society, vol. 85(1), pages 185-205, March.
    9. Arif Mamun & Ankita Patnaik & Michael Levere & Gina Livermore & Todd Honeycutt & Jacqueline Kauff & Karen Katz & AnnaMaria McCutcheon & Joseph Mastrianni & Brittney Gionfriddo, "undated". "Promoting Readiness of Minors in Supplemental Security Income (PROMISE): Technical Appendix to the Interim Services and Impact Report," Mathematica Policy Research Reports 24c37444a21d4046abb21395a, Mathematica Policy Research.
    10. Hao Dong & Daniel L. Millimet, 2020. "Propensity Score Weighting with Mismeasured Covariates: An Application to Two Financial Literacy Interventions," JRFM, MDPI, vol. 13(11), pages 1-24, November.
    11. Anil Alpman, 2015. "Implementing Rubin's Alternative Multiple Imputation Method for Statistical Matching in Stata," Post-Print hal-01159191, HAL.
    12. Brownstone, David, 1997. "Multiple Imputation Methodology for Missing Data, Non-Random Response, and Panel Attrition," University of California Transportation Center, Working Papers qt2zd6w6hh, University of California Transportation Center.
    13. Lamarche, Pierre, 2017. "Estimating consumption in the HFCS: Experimental results on the first wave of the HFCS," Statistics Paper Series 22, European Central Bank.
    14. Keane, Michael & Stavrunova, Olena, 2016. "Adverse selection, moral hazard and the demand for Medigap insurance," Journal of Econometrics, Elsevier, vol. 190(1), pages 62-78.
    15. Gina Yannitell Reinhardt, 2009. "Matching Donors and Nonprofits," Journal of Theoretical Politics, , vol. 21(3), pages 283-309, July.
    16. Westermeier, Christian & Grabka, Markus M., 2016. "Longitudinal Wealth Data and Multiple Imputation: An Evaluation Study," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 10(3), pages 237-252.
    17. Lambert, Claudia & Larkou, Chloe & Pancaro, Cosimo & Pellicani, Antonella & Sintonen, Meri, 2024. "Digital euro demand: design, individuals’ payment preferences and socioeconomic factors," Working Paper Series 2980, European Central Bank.
    18. François Gardes, 2018. "On the value of time and human life," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01903596, HAL.
    19. Marcello D’Orazio, 2015. "Integration and imputation of survey data in R: the StatMatch package," Romanian Statistical Review, Romanian Statistical Review, vol. 63(2), pages 57-68, June.
    20. Mr. Michael Weber & Ms. Michaela Denk, 2011. "Avoid Filling Swiss Cheese with Whipped Cream: Imputation Techniques and Evaluation Procedures for Cross-Country Time Series," IMF Working Papers 2011/151, International Monetary Fund.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:compst:v:29:y:2014:i:3:p:529-546. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.