IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v12y2021i1d10.1038_s41467-021-26107-z.html
   My bibliography  Save this article

From calibration to parameter learning: Harnessing the scaling effects of big data in geoscientific modeling

Author

Listed:
  • Wen-Ping Tsai

    (Pennsylvania State University)

  • Dapeng Feng

    (Pennsylvania State University)

  • Ming Pan

    (University of California San Diego
    Civil and Environmental Engineering, Princeton University)

  • Hylke Beck

    (GloH2O)

  • Kathryn Lawson

    (Pennsylvania State University
    HydroSapient, Inc)

  • Yuan Yang

    (Tsinghua University
    China Three Gorges Corporation)

  • Jiangtao Liu

    (Pennsylvania State University)

  • Chaopeng Shen

    (Pennsylvania State University
    HydroSapient, Inc)

Abstract

The behaviors and skills of models in many geosciences (e.g., hydrology and ecosystem sciences) strongly depend on spatially-varying parameters that need calibration. A well-calibrated model can reasonably propagate information from observations to unobserved variables via model physics, but traditional calibration is highly inefficient and results in non-unique solutions. Here we propose a novel differentiable parameter learning (dPL) framework that efficiently learns a global mapping between inputs (and optionally responses) and parameters. Crucially, dPL exhibits beneficial scaling curves not previously demonstrated to geoscientists: as training data increases, dPL achieves better performance, more physical coherence, and better generalizability (across space and uncalibrated variables), all with orders-of-magnitude lower computational cost. We demonstrate examples that learned from soil moisture and streamflow, where dPL drastically outperformed existing evolutionary and regionalization methods, or required only ~12.5% of the training data to achieve similar performance. The generic scheme promotes the integration of deep learning and process-based models, without mandating reimplementation.

Suggested Citation

  • Wen-Ping Tsai & Dapeng Feng & Ming Pan & Hylke Beck & Kathryn Lawson & Yuan Yang & Jiangtao Liu & Chaopeng Shen, 2021. "From calibration to parameter learning: Harnessing the scaling effects of big data in geoscientific modeling," Nature Communications, Nature, vol. 12(1), pages 1-13, December.
  • Handle: RePEc:nat:natcom:v:12:y:2021:i:1:d:10.1038_s41467-021-26107-z
    DOI: 10.1038/s41467-021-26107-z
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-021-26107-z
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-021-26107-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Markus Reichstein & Gustau Camps-Valls & Bjorn Stevens & Martin Jung & Joachim Denzler & Nuno Carvalhais & Prabhat, 2019. "Deep learning and process understanding for data-driven Earth system science," Nature, Nature, vol. 566(7743), pages 195-204, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Licheng Liu & Wang Zhou & Kaiyu Guan & Bin Peng & Shaoming Xu & Jinyun Tang & Qing Zhu & Jessica Till & Xiaowei Jia & Chongya Jiang & Sheng Wang & Ziqi Qin & Hui Kong & Robert Grant & Symon Mezbahuddi, 2024. "Knowledge-guided machine learning can improve carbon cycle quantification in agroecosystems," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    2. Rozenstein, Offer & Fine, Lior & Malachy, Nitzan & Richard, Antoine & Pradalier, Cedric & Tanny, Josef, 2023. "Data-driven estimation of actual evapotranspiration to support irrigation management: Testing two novel methods based on an unoccupied aerial vehicle and an artificial neural network," Agricultural Water Management, Elsevier, vol. 283(C).
    3. Jiang, Hou & Lu, Ning & Huang, Guanghui & Yao, Ling & Qin, Jun & Liu, Hengzi, 2020. "Spatial scale effects on retrieval accuracy of surface solar radiation using satellite data," Applied Energy, Elsevier, vol. 270(C).
    4. Wen Zhang & Jing Li & Yunhao Chen & Yang Li, 2019. "A Surrogate-Based Optimization Design and Uncertainty Analysis for Urban Flood Mitigation," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 33(12), pages 4201-4214, September.
    5. Feng, Jiaojiao & Wang, Weizhen & Xu, Feinan & Wang, Shengtang, 2024. "Evaluating the ability of deep learning on actual daily evapotranspiration estimation over the heterogeneous surfaces," Agricultural Water Management, Elsevier, vol. 291(C).
    6. Mohanad A. Deif & Ahmed A. A. Solyman & Mohammed H. Alsharif & Seungwon Jung & Eenjun Hwang, 2021. "A Hybrid Multi-Objective Optimizer-Based SVM Model for Enhancing Numerical Weather Prediction: A Study for the Seoul Metropolitan Area," Sustainability, MDPI, vol. 14(1), pages 1-17, December.
    7. Zhang, Shuangyi & Li, Xichen, 2021. "Future projections of offshore wind energy resources in China using CMIP6 simulations and a deep learning-based downscaling method," Energy, Elsevier, vol. 217(C).
    8. Florian Reiner & Martin Brandt & Xiaoye Tong & David Skole & Ankit Kariryaa & Philippe Ciais & Andrew Davies & Pierre Hiernaux & Jérôme Chave & Maurice Mugabowindekwe & Christian Igel & Stefan Oehmcke, 2023. "More than one quarter of Africa’s tree cover is found outside areas previously classified as forest," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    9. Wang, Yukuan & Liu, Jingxian & Liu, Ryan Wen & Wu, Weihuang & Liu, Yang, 2023. "Interval prediction of vessel trajectory based on lower and upper bound estimation and attention-modified LSTM with bayesian optimization," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 630(C).
    10. Gianluca Biggi & Martina Iori & Julia Mazzei & Andrea Mina, 2024. "Green Intelligence: The AI content of green technologies," LEM Papers Series 2024/23, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    11. He, Xinlei & Liu, Shaomin & Xu, Tongren & Yu, Kailiang & Gentine, Pierre & Zhang, Zhe & Xu, Ziwei & Jiao, Dandan & Wu, Dongxing, 2022. "Improving predictions of evapotranspiration by integrating multi-source observations and land surface model," Agricultural Water Management, Elsevier, vol. 272(C).
    12. Wang, Yangjun & Liu, Kefeng & Zhang, Ren & Qian, Longxia & Shan, Yulong, 2021. "Feasibility of the Northeast Passage: The role of vessel speed, route planning, and icebreaking assistance determined by sea-ice conditions for the container shipping market during 2020–2030," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 149(C).
    13. Richards, Daniel Rex & Lavorel, Sandra, 2022. "Integrating social media data and machine learning to analyse scenarios of landscape appreciation," Ecosystem Services, Elsevier, vol. 55(C).
    14. Galaz, Victor & Centeno, Miguel A. & Callahan, Peter W. & Causevic, Amar & Patterson, Thayer & Brass, Irina & Baum, Seth & Farber, Darryl & Fischer, Joern & Garcia, David & McPhearson, Timon & Jimenez, 2021. "Artificial intelligence, systemic risks, and sustainability," Technology in Society, Elsevier, vol. 67(C).
    15. Wan, Zijing & Wei, Fulong & Peng, Jiale & Deng, Chao & Ding, Siqi & Xu, Dongwei & Luo, Xiaobing, 2023. "Application of physical model-based machine learning to the temperature prediction of electronic device in oil-gas exploration logging," Energy, Elsevier, vol. 282(C).
    16. Hood, Raleigh R. & Shenk, Gary W. & Dixon, Rachel L. & Smith, Sean M.C. & Ball, William P. & Bash, Jesse O. & Batiuk, Rich & Boomer, Kathy & Brady, Damian C. & Cerco, Carl & Claggett, Peter & de Mutse, 2021. "The Chesapeake Bay program modeling system: Overview and recommendations for future development," Ecological Modelling, Elsevier, vol. 456(C).
    17. Jennie Molinder & Sebastian Scher & Erik Nilsson & Heiner Körnich & Hans Bergström & Anna Sjöblom, 2020. "Probabilistic Forecasting of Wind Turbine Icing Related Production Losses Using Quantile Regression Forests," Energies, MDPI, vol. 14(1), pages 1-19, December.
    18. Chen, Zhe & Yang, Bisheng & Zhu, Rui & Dong, Zhen, 2024. "City-scale solar PV potential estimation on 3D buildings using multi-source RS data: A case study in Wuhan, China," Applied Energy, Elsevier, vol. 359(C).
    19. Quansheng Ge & Mengmeng Hao & Fangyu Ding & Dong Jiang & Jürgen Scheffran & David Helman & Tobias Ide, 2022. "Modelling armed conflict risk under climate change with machine learning and time-series data," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    20. Guoxiong Chen & Qiuming Cheng & Timothy W. Lyons & Jun Shen & Frits Agterberg & Ning Huang & Molei Zhao, 2022. "Reconstructing Earth’s atmospheric oxygenation history using machine learning," Nature Communications, Nature, vol. 13(1), pages 1-13, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:12:y:2021:i:1:d:10.1038_s41467-021-26107-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.