IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v204y2020ics0951832020306220.html
   My bibliography  Save this article

Conditional formulation for the calibration of multi-level random fields with incomplete data

Author

Listed:
  • Xu, Hao
  • Gardoni, Paolo

Abstract

Random fields are widely used in the modeling of spatially varying quantities. As an extension, multi-level random fields capture not only the spatial variability, but also the relationship between inter-dependent quantities. To calibrate such a model, we need data of different variables measured at the same locations in each level. However, measurements of different quantities are usually made independently at inconsistent locations. Recent work addressed this issue by predicting the missing data first, and calibrating the model using the completed dataset. However, existing formulations cannot capture the spatial correlation and inter-level dependency. This paper proposes a conditional random field formulation that overcomes the limitations. Beginning from the lowest level, we calibrate the model using observed data and make predictions conditioned on the observations. The observed data and predictions are then used in the calibration and prediction of the higher levels. To propagate the uncertainties, we develop predictive distributions based on total probability rule for the predictions. We discuss how the formulation works for two missing data scenarios: 1) data partially missing, and 2) data completely missing at some levels. An example of the modeling of multi-level earthquake intensities is provided to illustrate how to implement the proposed formulation in practice.

Suggested Citation

  • Xu, Hao & Gardoni, Paolo, 2020. "Conditional formulation for the calibration of multi-level random fields with incomplete data," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
  • Handle: RePEc:eee:reensy:v:204:y:2020:i:c:s0951832020306220
    DOI: 10.1016/j.ress.2020.107121
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832020306220
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2020.107121?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. James P. LeSage & R. Kelley Pace, 2004. "Models for Spatially Dependent Missing Data," The Journal of Real Estate Finance and Economics, Springer, vol. 29(2), pages 233-254, September.
    2. Liu, Haibin & Davidson, Rachel A. & Apanasovich, Tatiyana V., 2008. "Spatial generalized linear mixed models of electric power outages due to hurricanes and ice storms," Reliability Engineering and System Safety, Elsevier, vol. 93(6), pages 897-912.
    3. Nguyen, H.D. & Gouno, E., 2020. "Bayesian inference for Common cause failure rate based on causal inference with missing data," Reliability Engineering and System Safety, Elsevier, vol. 197(C).
    4. Mark D. Risser & Christopher J. Paciorek & Dáithí A. Stone, 2019. "Spatially Dependent Multiple Testing Under Model Misspecification, With Application to Detection of Anthropogenic Influence on Extreme Climate Events," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(525), pages 61-78, January.
    5. Dijoux, Yann & Fouladirad, Mitra & Nguyen, Dinh Tuan, 2016. "Statistical inference for imperfect maintenance models with missing data," Reliability Engineering and System Safety, Elsevier, vol. 154(C), pages 84-96.
    6. Patrick Royston, 2004. "Multiple imputation of missing values," Stata Journal, StataCorp LP, vol. 4(3), pages 227-241, September.
    7. Mark D. Risser & Catherine A. Calder, 2015. "Regression‐based covariance functions for nonstationary spatial modeling," Environmetrics, John Wiley & Sons, Ltd., vol. 26(4), pages 284-297, June.
    8. Emir Shuford & Arthur Albert & H. Edward Massengill, 1966. "Admissible probability measurement procedures," Psychometrika, Springer;The Psychometric Society, vol. 31(2), pages 125-145, June.
    9. Fang, Xiaolei & Zhou, Rensheng & Gebraeel, Nagi, 2015. "An adaptive functional regression-based prognostic model for applications with missing data," Reliability Engineering and System Safety, Elsevier, vol. 133(C), pages 266-274.
    10. Malings, Carl & Pozzi, Matteo, 2016. "Value of information for spatially distributed systems: Application to sensor placement," Reliability Engineering and System Safety, Elsevier, vol. 154(C), pages 219-233.
    11. Jianqing Fan & Yuan Liao & Han Liu, 2016. "An overview of the estimation of large covariance and precision matrices," Econometrics Journal, Royal Economic Society, vol. 19(1), pages 1-32, February.
    12. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    13. Joshua D Woodard & Apurba Shee & Andrew Mude, 2016. "A Spatial Econometric Approach to Designing and Rating Scalable Index Insurance in the Presence of Missing Data," The Geneva Papers on Risk and Insurance - Issues and Practice, Palgrave Macmillan;The Geneva Association, vol. 41(2), pages 259-279, April.
    14. Martin, Andrew D. & Quinn, Kevin M. & Park, Jong Hee, 2011. "MCMCpack: Markov Chain Monte Carlo in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 42(i09).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhang, Ruijing & Dai, Hongzhe, 2022. "A non-Gaussian stochastic model from limited observations using polynomial chaos and fractional moments," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    2. Wang, Tiao & Li, Chunhe & Zheng, Jian-jun & Hackl, Jürgen & Luan, Yao & Ishida, Tetsuya & Medepalli, Satya, 2023. "Consideration of coupling of crack development and corrosion in assessing the reliability of reinforced concrete beams subjected to bending," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    3. Jerez, D.J. & Jensen, H.A. & Beer, M., 2022. "An effective implementation of reliability methods for Bayesian model updating of structural dynamic models with multiple uncertain parameters," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    4. Gao, Xing & Meng, Jing & Ling, Yantao & Liao, Maolin & Cao, Mengqiu, 2022. "Localisation economies, intellectual property rights protection and entrepreneurship in China: A Bayesian analysis of multi-level spatial correlation," Structural Change and Economic Dynamics, Elsevier, vol. 61(C), pages 156-165.
    5. He, Jingran & Gao, Ruofan & Chen, Jianbing, 2022. "A sparse data-driven stochastic damage model for seismic reliability assessment of reinforced concrete structures," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    6. Zheng, Yi-Xuan & Xiahou, Tangfan & Liu, Yu & Xie, Chaoyang, 2021. "Structure function learning of hierarchical multi-state systems with incomplete observation sequences," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    7. Zhou, Daoqing & He, Jingjing & Du, Yi-Mu & Sun, C.P. & Guan, Xuefei, 2021. "Probabilistic information fusion with point, moment and interval data in reliability assessment," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    8. Tabandeh, Armin & Sharma, Neetesh & Gardoni, Paolo, 2022. "Uncertainty propagation in risk and resilience analysis of hierarchical systems," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    9. Gao, Xing & Meng, Jing & Ling, Yantao & Liao, Maolin & Cao, Mengqiu, 2022. "Localisation economies, intellectual property rights protection and entrepreneurship in China: a Bayesian analysis of multi-level spatial correlation," LSE Research Online Documents on Economics 114290, London School of Economics and Political Science, LSE Library.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roberto Leon-Gonzalez & Blessings Majoni, 2023. "Exact Likelihood for Inverse Gamma Stochastic Volatility Models," GRIPS Discussion Papers 23-07, National Graduate Institute for Policy Studies.
    2. Geweke, John & Amisano, Gianni, 2011. "Optimal prediction pools," Journal of Econometrics, Elsevier, vol. 164(1), pages 130-141, September.
    3. Fabian Krüger & Sebastian Lerch & Thordis Thorarinsdottir & Tilmann Gneiting, 2021. "Predictive Inference Based on Markov Chain Monte Carlo Output," International Statistical Review, International Statistical Institute, vol. 89(2), pages 274-301, August.
    4. Jorge Castillo-Mateo & Miguel Lafuente & Jesús Asín & Ana C. Cebrián & Alan E. Gelfand & Jesús Abaurrea, 2022. "Spatial Modeling of Day-Within-Year Temperature Time Series: An Examination of Daily Maximum Temperatures in Aragón, Spain," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 27(3), pages 487-505, September.
    5. Karl Schlag & James Tremewan & Joël Weele, 2015. "A penny for your thoughts: a survey of methods for eliciting beliefs," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 457-490, September.
    6. D. J. Hand & C. Anagnostopoulos, 2023. "Notes on the H-measure of classifier performance," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 17(1), pages 109-124, March.
    7. Karl Schlag & James Tremewan & Joël Weele, 2015. "A penny for your thoughts: a survey of methods for eliciting beliefs," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 457-490, September.
    8. Werner Ehm & Tilmann Gneiting & Alexander Jordan & Fabian Krüger, 2016. "Of quantiles and expectiles: consistent scoring functions, Choquet representations and forecast rankings," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(3), pages 505-562, June.
    9. Yanwei Jia & Jussi Keppo & Ville Satopää, 2023. "Herding in Probabilistic Forecasts," Management Science, INFORMS, vol. 69(5), pages 2713-2732, May.
    10. Lambert, Nicolas S. & Langford, John & Wortman Vaughan, Jennifer & Chen, Yiling & Reeves, Daniel M. & Shoham, Yoav & Pennock, David M., 2015. "An axiomatic characterization of wagering mechanisms," Journal of Economic Theory, Elsevier, vol. 156(C), pages 389-416.
    11. Kenneth C. Lichtendahl & Yael Grushka-Cockayne & Robert L. Winkler, 2013. "Is It Better to Average Probabilities or Quantiles?," Management Science, INFORMS, vol. 59(7), pages 1594-1611, July.
    12. Azar, Pablo D. & Micali, Silvio, 2018. "Computational principal agent problems," Theoretical Economics, Econometric Society, vol. 13(2), May.
    13. Rubio, F.J. & Steel, M.F.J., 2011. "Inference for grouped data with a truncated skew-Laplace distribution," Computational Statistics & Data Analysis, Elsevier, vol. 55(12), pages 3218-3231, December.
    14. Harald Schoen, 2008. "Identity, Instrumental Self-Interest and Institutional Evaluations," European Union Politics, , vol. 9(1), pages 5-29, March.
    15. Julia S. Goldberg, 2011. "Identity Salience and Involvement among Resident and Nonresident Fathers," Working Papers 1323, Princeton University, School of Public and International Affairs, Center for Research on Child Wellbeing..
    16. R de Fondeville & A C Davison, 2018. "High-dimensional peaks-over-threshold inference," Biometrika, Biometrika Trust, vol. 105(3), pages 575-592.
    17. John Bound & Michael F. Lovenheim & Sarah Turner, 2010. "Why Have College Completion Rates Declined? An Analysis of Changing Student Preparation and Collegiate Resources," American Economic Journal: Applied Economics, American Economic Association, vol. 2(3), pages 129-157, July.
    18. Domenico Piccolo & Rosaria Simone, 2019. "The class of cub models: statistical foundations, inferential issues and empirical evidence," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 28(3), pages 389-435, September.
    19. Finn Lindgren, 2015. "Comments on: Comparing and selecting spatial predictors using local criteria," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 24(1), pages 35-44, March.
    20. von Hinke Kessler Scholder S, 2009. "Genetic Markers as Instrumental Variables: An Application to Child Fat Mass and Academic Achievement," Health, Econometrics and Data Group (HEDG) Working Papers 09/25, HEDG, c/o Department of Economics, University of York.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:204:y:2020:i:c:s0951832020306220. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.