IDEAS home Printed from https://ideas.repec.org/a/bla/biomet/v73y2017i4p1082-1091.html
   My bibliography  Save this article

Efficient Bayesian hierarchical functional data analysis with basis function approximations using Gaussian–Wishart processes

Author

Listed:
  • Jingjing Yang
  • Dennis D. Cox
  • Jong Soo Lee
  • Peng Ren
  • Taeryon Choi

Abstract

Functional data are defined as realizations of random functions (mostly smooth functions) varying over a continuum, which are usually collected on discretized grids with measurement errors. In order to accurately smooth noisy functional observations and deal with the issue of high‐dimensional observation grids, we propose a novel Bayesian method based on the Bayesian hierarchical model with a Gaussian–Wishart process prior and basis function representations. We first derive an induced model for the basis‐function coefficients of the functional data, and then use this model to conduct posterior inference through Markov chain Monte Carlo methods. Compared to the standard Bayesian inference that suffers serious computational burden and instability in analyzing high‐dimensional functional data, our method greatly improves the computational scalability and stability, while inheriting the advantage of simultaneously smoothing raw observations and estimating the mean‐covariance functions in a nonparametric way. In addition, our method can naturally handle functional data observed on random or uncommon grids. Simulation and real studies demonstrate that our method produces similar results to those obtainable by the standard Bayesian inference with low‐dimensional common grids, while efficiently smoothing and estimating functional data with random and high‐dimensional observation grids when the standard Bayesian inference fails. In conclusion, our method can efficiently smooth and estimate high‐dimensional functional data, providing one way to resolve the curse of dimensionality for Bayesian functional data analysis with Gaussian–Wishart processes.

Suggested Citation

  • Jingjing Yang & Dennis D. Cox & Jong Soo Lee & Peng Ren & Taeryon Choi, 2017. "Efficient Bayesian hierarchical functional data analysis with basis function approximations using Gaussian–Wishart processes," Biometrics, The International Biometric Society, vol. 73(4), pages 1082-1091, December.
  • Handle: RePEc:bla:biomet:v:73:y:2017:i:4:p:1082-1091
    DOI: 10.1111/biom.12705
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/biom.12705
    Download Restriction: no

    File URL: https://libkey.io/10.1111/biom.12705?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Gromenko, Oleksandr & Kokoszka, Piotr, 2013. "Nonparametric inference in small data sets of spatially indexed curves with application to ionospheric trend determination," Computational Statistics & Data Analysis, Elsevier, vol. 59(C), pages 82-94.
    2. J. Q. Shi & B. Wang & R. Murray-Smith & D. M. Titterington, 2007. "Gaussian Process Functional Regression Modeling for Batch Data," Biometrics, The International Biometric Society, vol. 63(3), pages 714-723, September.
    3. Zhu, Hongxiao & Brown, Philip J. & Morris, Jeffrey S., 2011. "Robust, Adaptive Functional Regression in Functional Mixed Model Framework," Journal of the American Statistical Association, American Statistical Association, vol. 106(495), pages 1167-1179.
    4. Yao, Fang & Muller, Hans-Georg & Wang, Jane-Ling, 2005. "Functional Data Analysis for Sparse Longitudinal Data," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 577-590, June.
    5. Noel Cressie & Gardar Johannesson, 2008. "Fixed rank kriging for very large spatial data sets," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(1), pages 209-226, February.
    6. Ying Yuan & Valen E. Johnson, 2012. "Goodness-of-Fit Diagnostics for Bayesian Hierarchical Models," Biometrics, The International Biometric Society, vol. 68(1), pages 156-164, March.
    7. Finley, Andrew O. & Banerjee, Sudipto & Gelfand, Alan E., 2015. "spBayes for Large Univariate and Multivariate Point-Referenced Spatio-Temporal Data Models," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 63(i13).
    8. Sudipto Banerjee & Alan E. Gelfand & Andrew O. Finley & Huiyan Sang, 2008. "Gaussian predictive process models for large spatial data sets," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(4), pages 825-848, September.
    9. Hongxiao Zhu & Fang Yao & Hao Helen Zhang, 2014. "Structured functional additive regression in reproducing kernel Hilbert spaces," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(3), pages 581-603, June.
    10. Veerabhadran Baladandayuthapani & Bani K. Mallick & Mee Young Hong & Joanne R. Lupton & Nancy D. Turner & Raymond J. Carroll, 2008. "Bayesian Hierarchical Spatially Correlated Functional Data Analysis with Application to Colon Carcinogenesis," Biometrics, The International Biometric Society, vol. 64(1), pages 64-73, March.
    11. Anjishnu Banerjee & David B. Dunson & Surya T. Tokdar, 2013. "Efficient Gaussian process regression for large datasets," Biometrika, Biometrika Trust, vol. 100(1), pages 75-89.
    12. Huiyan Sang & Jianhua Z. Huang, 2012. "A full scale approximation of covariance functions for large spatial data sets," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 74(1), pages 111-132, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Codazzi, Laura & Colombi, Alessandro & Gianella, Matteo & Argiento, Raffaele & Paci, Lucia & Pini, Alessia, 2022. "Gaussian graphical modeling for spectrometric data analysis," Computational Statistics & Data Analysis, Elsevier, vol. 174(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Isabelle Grenier & Bruno Sansó & Jessica L. Matthews, 2024. "Multivariate nearest‐neighbors Gaussian processes with random covariance matrices," Environmetrics, John Wiley & Sons, Ltd., vol. 35(3), May.
    2. Bledar A. Konomi & Emily L. Kang & Ayat Almomani & Jonathan Hobbs, 2023. "Bayesian Latent Variable Co-kriging Model in Remote Sensing for Quality Flagged Observations," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 28(3), pages 423-441, September.
    3. Paciorek, Christopher J. & Lipshitz, Benjamin & Zhuo, Wei & Prabhat, . & Kaufman, Cari G. G. & Thomas, Rollin C., 2015. "Parallelizing Gaussian Process Calculations in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 63(i10).
    4. Marchetti, Yuliya & Nguyen, Hai & Braverman, Amy & Cressie, Noel, 2018. "Spatial data compression via adaptive dispersion clustering," Computational Statistics & Data Analysis, Elsevier, vol. 117(C), pages 138-153.
    5. Litvinenko, Alexander & Sun, Ying & Genton, Marc G. & Keyes, David E., 2019. "Likelihood approximation with hierarchical matrices for large spatial datasets," Computational Statistics & Data Analysis, Elsevier, vol. 137(C), pages 115-132.
    6. Kelly R. Moran & Matthew W. Wheeler, 2022. "Fast increased fidelity samplers for approximate Bayesian Gaussian process regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(4), pages 1198-1228, September.
    7. Mahdi Hosseinpouri & Majid Jafari Khaledi, 2019. "An area-specific stick breaking process for spatial data," Statistical Papers, Springer, vol. 60(1), pages 199-221, February.
    8. Peter A. Gao & Hannah M. Director & Cecilia M. Bitz & Adrian E. Raftery, 2022. "Probabilistic Forecasts of Arctic Sea Ice Thickness," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 27(2), pages 280-302, June.
    9. Huang Huang & Sameh Abdulah & Ying Sun & Hatem Ltaief & David E. Keyes & Marc G. Genton, 2021. "Competition on Spatial Statistics for Large Datasets," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 26(4), pages 580-595, December.
    10. Waley W. J. Liang & Herbert K. H. Lee, 2019. "Bayesian nonstationary Gaussian process models via treed process convolutions," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 13(3), pages 797-818, September.
    11. Si Cheng & Bledar A. Konomi & Georgios Karagiannis & Emily L. Kang, 2024. "Recursive nearest neighbor co‐kriging models for big multi‐fidelity spatial data sets," Environmetrics, John Wiley & Sons, Ltd., vol. 35(4), June.
    12. Hu Juan & Zhang Hao, 2015. "Numerical Methods of Karhunen–Loève Expansion for Spatial Data," Stochastics and Quality Control, De Gruyter, vol. 30(1), pages 49-58, June.
    13. Matthias Katzfuss & Joseph Guinness & Wenlong Gong & Daniel Zilber, 2020. "Vecchia Approximations of Gaussian-Process Predictions," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 25(3), pages 383-414, September.
    14. Chen, Yewen & Chang, Xiaohui & Luo, Fangzhi & Huang, Hui, 2023. "Additive dynamic models for correcting numerical model outputs," Computational Statistics & Data Analysis, Elsevier, vol. 187(C).
    15. Li, Meng & Wang, Kehui & Maity, Arnab & Staicu, Ana-Maria, 2022. "Inference in functional linear quantile regression," Journal of Multivariate Analysis, Elsevier, vol. 190(C).
    16. Zilber, Daniel & Katzfuss, Matthias, 2021. "Vecchia–Laplace approximations of generalized Gaussian processes for big non-Gaussian spatial data," Computational Statistics & Data Analysis, Elsevier, vol. 153(C).
    17. Ranadeep Daw & Christopher K. Wikle, 2023. "REDS: Random ensemble deep spatial prediction," Environmetrics, John Wiley & Sons, Ltd., vol. 34(1), February.
    18. K. Shuvo Bakar, 2020. "Interpolation of daily rainfall data using censored Bayesian spatially varying model," Computational Statistics, Springer, vol. 35(1), pages 135-152, March.
    19. Caamaño-Carrillo, Christian & Bevilacqua, Moreno & López, Cristian & Morales-Oñate, Víctor, 2024. "Nearest neighbors weighted composite likelihood based on pairs for (non-)Gaussian massive spatial data with an application to Tukey-hh random fields estimation," Computational Statistics & Data Analysis, Elsevier, vol. 191(C).
    20. Patrick Vetter & Wolfgang Schmid & Reimund Schwarze, 2013. "Efficient Approximation of the Spatial Covariance Function for Large Datasets - Analysis of Atmospheric CO2 Concentrations," Discussion Paper Series RECAP15 009, RECAP15, European University Viadrina, Frankfurt (Oder).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:biomet:v:73:y:2017:i:4:p:1082-1091. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0006-341X .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.