IDEAS home Printed from https://ideas.repec.org/a/plo/pcbi00/1007575.html
   My bibliography  Save this article

Systems biology informed deep learning for inferring parameters and hidden dynamics

Author

Listed:
  • Alireza Yazdani
  • Lu Lu
  • Maziar Raissi
  • George Em Karniadakis

Abstract

Mathematical models of biological reactions at the system-level lead to a set of ordinary differential equations with many unknown parameters that need to be inferred using relatively few experimental measurements. Having a reliable and robust algorithm for parameter inference and prediction of the hidden dynamics has been one of the core subjects in systems biology, and is the focus of this study. We have developed a new systems-biology-informed deep learning algorithm that incorporates the system of ordinary differential equations into the neural networks. Enforcing these equations effectively adds constraints to the optimization procedure that manifests itself as an imposed structure on the observational data. Using few scattered and noisy measurements, we are able to infer the dynamics of unobserved species, external forcing, and the unknown model parameters. We have successfully tested the algorithm for three different benchmark problems.Author summary: The dynamics of systems biological processes are usually modeled using ordinary differential equations (ODEs), which introduce various unknown parameters that need to be estimated efficiently from noisy measurements of concentration for a few species only. In this work, we present a new “systems-informed neural network” to infer the dynamics of experimentally unobserved species as well as the unknown parameters in the system of equations. By incorporating the system of ODEs into the neural networks, we effectively add constraints to the optimization algorithm, which makes the method robust to noisy and sparse measurements.

Suggested Citation

  • Alireza Yazdani & Lu Lu & Maziar Raissi & George Em Karniadakis, 2020. "Systems biology informed deep learning for inferring parameters and hidden dynamics," PLOS Computational Biology, Public Library of Science, vol. 16(11), pages 1-19, November.
  • Handle: RePEc:plo:pcbi00:1007575
    DOI: 10.1371/journal.pcbi.1007575
    as

    Download full text from publisher

    File URL: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1007575
    Download Restriction: no

    File URL: https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1007575&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pcbi.1007575?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Bryan C Daniels & Ilya Nemenman, 2015. "Efficient Inference of Parsimonious Phenomenological Models of Cellular Dynamics Using S-Systems and Alternating Regression," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-14, March.
    2. Ryan N Gutenkunst & Joshua J Waterfall & Fergal P Casey & Kevin S Brown & Christopher R Myers & James P Sethna, 2007. "Universally Sloppy Parameter Sensitivities in Systems Biology Models," PLOS Computational Biology, Public Library of Science, vol. 3(10), pages 1-8, October.
    3. Gabriele Lillacci & Mustafa Khammash, 2010. "Parameter Estimation and Model Selection in Computational Biology," PLOS Computational Biology, Public Library of Science, vol. 6(3), pages 1-17, March.
    4. David J Albers & Matthew Levine & Bruce Gluckman & Henry Ginsberg & George Hripcsak & Lena Mamykina, 2017. "Personalized glucose forecasting for type 2 diabetes using data assimilation," PLOS Computational Biology, Public Library of Science, vol. 13(4), pages 1-38, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fujun Cao & Xiaobin Guo & Fei Gao & Dongfang Yuan, 2023. "Deep Learning Nonhomogeneous Elliptic Interface Problems by Soft Constraint Physics-Informed Neural Networks," Mathematics, MDPI, vol. 11(8), pages 1-23, April.
    2. Katharina Paulick & Simon Seidel & Christoph Lange & Annina Kemmer & Mariano Nicolas Cruz-Bournazou & André Baier & Daniel Haehn, 2022. "Promoting Sustainability through Next-Generation Biologics Drug Development," Sustainability, MDPI, vol. 14(8), pages 1-31, April.
    3. Wenlong He & Peng Xia & Xinan Zhang & Tianhai Tian, 2022. "Bayesian Inference Algorithm for Estimating Heterogeneity of Regulatory Mechanisms Based on Single-Cell Data," Mathematics, MDPI, vol. 10(24), pages 1-15, December.
    4. Chen, Mo & Wang, Ankai & Wang, Chao & Wu, Huagan & Bao, Bocheng, 2022. "DC-offset-induced hidden and asymmetric dynamics in Memristive Chua's circuit," Chaos, Solitons & Fractals, Elsevier, vol. 160(C).
    5. Benjamin Fan & Edward Qiao & Anran Jiao & Zhouzhou Gu & Wenhao Li & Lu Lu, 2023. "Deep Learning for Solving and Estimating Dynamic Macro-Finance Models," Papers 2305.09783, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Joseph D Taylor & Samuel Winnall & Alain Nogaret, 2020. "Estimation of neuron parameters from imperfect observations," PLOS Computational Biology, Public Library of Science, vol. 16(7), pages 1-22, July.
    2. Agus Hartoyo & Peter J Cadusch & David T J Liley & Damien G Hicks, 2019. "Parameter estimation and identifiability in a neural population model for electro-cortical activity," PLOS Computational Biology, Public Library of Science, vol. 15(5), pages 1-27, May.
    3. Mark K Transtrum & Peng Qiu, 2016. "Bridging Mechanistic and Phenomenological Models of Complex Biological Systems," PLOS Computational Biology, Public Library of Science, vol. 12(5), pages 1-34, May.
    4. Samuel Bandara & Johannes P Schlöder & Roland Eils & Hans Georg Bock & Tobias Meyer, 2009. "Optimal Experimental Design for Parameter Estimation of a Cell Signaling Model," PLOS Computational Biology, Public Library of Science, vol. 5(11), pages 1-12, November.
    5. Adel Dayarian & Madalena Chaves & Eduardo D Sontag & Anirvan M Sengupta, 2009. "Shape, Size, and Robustness: Feasible Regions in the Parameter Space of Biochemical Networks," PLOS Computational Biology, Public Library of Science, vol. 5(1), pages 1-12, January.
    6. Amrita X Sarkar & Eric A Sobie, 2010. "Regression Analysis for Constraining Free Parameters in Electrophysiological Models of Cardiac Cells," PLOS Computational Biology, Public Library of Science, vol. 6(9), pages 1-11, September.
    7. Hongwei Shao & Tao Peng & Zhiwei Ji & Jing Su & Xiaobo Zhou, 2013. "Systematically Studying Kinase Inhibitor Induced Signaling Network Signatures by Integrating Both Therapeutic and Side Effects," PLOS ONE, Public Library of Science, vol. 8(12), pages 1-16, December.
    8. Fridtjof Brauns & Leila Iñigo de la Cruz & Werner K.-G. Daalman & Ilse Bruin & Jacob Halatek & Liedewij Laan & Erwin Frey, 2023. "Redundancy and the role of protein copy numbers in the cell polarization machinery of budding yeast," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    9. Eberhard O Voit & Harald A Martens & Stig W Omholt, 2015. "150 Years of the Mass Action Law," PLOS Computational Biology, Public Library of Science, vol. 11(1), pages 1-7, January.
    10. Céline Christiansen-Jucht & Kamil Erguler & Chee Yan Shek & María-Gloria Basáñez & Paul E. Parham, 2015. "Modelling Anopheles gambiae s.s. Population Dynamics with Temperature- and Age-Dependent Survival," IJERPH, MDPI, vol. 12(6), pages 1-31, May.
    11. William P T M van Doorn & Yuri D Foreman & Nicolaas C Schaper & Hans H C M Savelberg & Annemarie Koster & Carla J H van der Kallen & Anke Wesselius & Miranda T Schram & Ronald M A Henry & Pieter C Dag, 2021. "Machine learning-based glucose prediction with use of continuous glucose and physical activity monitoring data: The Maastricht Study," PLOS ONE, Public Library of Science, vol. 16(6), pages 1-17, June.
    12. Gabriele Lillacci & Mustafa Khammash, 2010. "Parameter Estimation and Model Selection in Computational Biology," PLOS Computational Biology, Public Library of Science, vol. 6(3), pages 1-17, March.
    13. Andrew White & Malachi Tolman & Howard D Thames & Hubert Rodney Withers & Kathy A Mason & Mark K Transtrum, 2016. "The Limitations of Model-Based Experimental Design and Parameter Estimation in Sloppy Systems," PLOS Computational Biology, Public Library of Science, vol. 12(12), pages 1-26, December.
    14. Diego Fernández Slezak & Cecilia Suárez & Guillermo A Cecchi & Guillermo Marshall & Gustavo Stolovitzky, 2010. "When the Optimal Is Not the Best: Parameter Estimation in Complex Biological Models," PLOS ONE, Public Library of Science, vol. 5(10), pages 1-10, October.
    15. Elba Raimúndez & Simone Keller & Gwen Zwingenberger & Karolin Ebert & Sabine Hug & Fabian J Theis & Dieter Maier & Birgit Luber & Jan Hasenauer, 2020. "Model-based analysis of response and resistance factors of cetuximab treatment in gastric cancer cell lines," PLOS Computational Biology, Public Library of Science, vol. 16(3), pages 1-21, March.
    16. Dimitrios V Vavoulis & Volko A Straub & John A D Aston & Jianfeng Feng, 2012. "A Self-Organizing State-Space-Model Approach for Parameter Estimation in Hodgkin-Huxley-Type Models of Single Neurons," PLOS Computational Biology, Public Library of Science, vol. 8(3), pages 1-1, March.
    17. Xinxian Shao & Andrew Mugler & Justin Kim & Ha Jun Jeong & Bruce R Levin & Ilya Nemenman, 2017. "Growth of bacteria in 3-d colonies," PLOS Computational Biology, Public Library of Science, vol. 13(7), pages 1-19, July.
    18. Maksat Ashyraliyev & Ken Siggens & Hilde Janssens & Joke Blom & Michael Akam & Johannes Jaeger, 2009. "Gene Circuit Analysis of the Terminal Gap Gene huckebein," PLOS Computational Biology, Public Library of Science, vol. 5(10), pages 1-16, October.
    19. Fuaada Mohd Siam & Muhamad Hanis Nasir, 2019. "Comparison of parameter fitting on the model of irradiation effects on bystander cells between Nelder-Mead simplex and particle swarm optimization," Journal of Advances in Technology and Engineering Research, A/Professor Akbar A. Khatibi, vol. 5(3), pages 142-150.
    20. Sungho Shin & Ophelia S Venturelli & Victor M Zavala, 2019. "Scalable nonlinear programming framework for parameter estimation in dynamic biological system models," PLOS Computational Biology, Public Library of Science, vol. 15(3), pages 1-29, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1007575. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.