IDEAS home Printed from https://ideas.repec.org/a/eee/chsofr/v188y2024ics0960077924010907.html
   My bibliography  Save this article

AI-Lorenz: A physics-data-driven framework for Black-Box and Gray-Box identification of chaotic systems with symbolic regression

Author

Listed:
  • De Florio, Mario
  • Kevrekidis, Ioannis G.
  • Karniadakis, George Em

Abstract

Discovering mathematical models that characterize the observed behavior of dynamical systems remains a major challenge, especially for systems in a chaotic regime, due to their sensitive dependence on initial conditions and the complex non-linear interactions within the system. The challenge is even greater when the physics underlying such systems is not yet understood, and scientific inquiry must solely rely on empirical data. Despite advancements such as the Sparse Identification of Nonlinear Dynamics (SINDy) algorithm, which has shown success in identifying chaotic systems with reasonable accuracy, challenges remain in dealing with noise, sparse data, and the need for models that generalize well across different chaotic systems. Driven by the need to fill this gap, we develop a framework named AI-Lorenz that learns mathematical expressions modeling complex dynamical behaviors by identifying differential equations from noisy and sparse observable data. We train a physics-informed neural network (PINN) with the eXtreme Theory of Functional Connections (X-TFC) algorithm by using data and known physics (when available) to learn the dynamics of a system, its rate of change in time, and missing model terms, which are used as input for a symbolic regression algorithm (PySR) to autonomously distill the explicit mathematical terms. This, in turn, enables us to predict the future evolution of the dynamical behavior. The performance of this framework is validated by recovering the right-hand sides and unknown terms of certain complex, chaotic systems, such as the well-known Lorenz system, a six-dimensional hyperchaotic system, the non-autonomous Sprott chaotic system, and the slow-fast Duffing system, and comparing them with their known analytical expressions and state-of-the-art regression and system identification methods.

Suggested Citation

  • De Florio, Mario & Kevrekidis, Ioannis G. & Karniadakis, George Em, 2024. "AI-Lorenz: A physics-data-driven framework for Black-Box and Gray-Box identification of chaotic systems with symbolic regression," Chaos, Solitons & Fractals, Elsevier, vol. 188(C).
  • Handle: RePEc:eee:chsofr:v:188:y:2024:i:c:s0960077924010907
    DOI: 10.1016/j.chaos.2024.115538
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960077924010907
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.chaos.2024.115538?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wei, Baolei, 2022. "Sparse dynamical system identification with simultaneous structural parameters and initial condition estimation," Chaos, Solitons & Fractals, Elsevier, vol. 165(P2).
    2. Cristina Cornelio & Sanjeeb Dash & Vernon Austel & Tyler R. Josephson & Joao Goncalves & Kenneth L. Clarkson & Nimrod Megiddo & Bachir El Khadir & Lior Horesh, 2023. "Combining data and theory for derivable scientific discovery with AI-Descartes," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    3. Yuan, Qianshun & Zhang, Jing & Wang, Haiying & Gu, Changgui & Yang, Huijie, 2023. "A multi-scale transition matrix approach to chaotic time series," Chaos, Solitons & Fractals, Elsevier, vol. 172(C).
    4. Daniele Mortari, 2017. "The Theory of Connections: Connecting Points," Mathematics, MDPI, vol. 5(4), pages 1-15, November.
    5. Sun, Ying & Zhang, Luying & Yao, Minghui, 2023. "Chaotic time series prediction of nonlinear systems based on various neural network models," Chaos, Solitons & Fractals, Elsevier, vol. 175(P1).
    6. Carl Leake & Hunter Johnston & Daniele Mortari, 2020. "The Multivariate Theory of Functional Connections: Theory, Proofs, and Application in Partial Differential Equations," Mathematics, MDPI, vol. 8(8), pages 1-30, August.
    7. Li, Yanfei & O'Neill, Zheng & Zhang, Liang & Chen, Jianli & Im, Piljae & DeGraw, Jason, 2021. "Grey-box modeling and application for building energy simulations - A critical review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 146(C).
    8. Daniele Mortari, 2017. "Least-Squares Solution of Linear Differential Equations," Mathematics, MDPI, vol. 5(4), pages 1-18, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yassopoulos, Christopher & Reddy, J.N. & Mortari, Daniele, 2023. "Analysis of nonlinear Timoshenko–Ehrenfest beam problems with von Kármán nonlinearity using the Theory of Functional Connections," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 205(C), pages 709-744.
    2. Damianakis, Nikolaos & Mouli, Gautham Ram Chandra & Bauer, Pavol & Yu, Yunhe, 2023. "Assessing the grid impact of Electric Vehicles, Heat Pumps & PV generation in Dutch LV distribution grids," Applied Energy, Elsevier, vol. 352(C).
    3. Zhang, Chengyu & Ma, Liangdong & Luo, Zhiwen & Han, Xing & Zhao, Tianyi, 2024. "Forecasting building plug load electricity consumption employing occupant-building interaction input features and bidirectional LSTM with improved swarm intelligent algorithms," Energy, Elsevier, vol. 288(C).
    4. Guo, Yurun & Wang, Shugang & Wang, Jihong & Zhang, Tengfei & Ma, Zhenjun & Jiang, Shuang, 2024. "Key district heating technologies for building energy flexibility: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PB).
    5. Vallianos, Charalampos & Candanedo, José & Athienitis, Andreas, 2023. "Application of a large smart thermostat dataset for model calibration and Model Predictive Control implementation in the residential sector," Energy, Elsevier, vol. 278(PA).
    6. Morovat, Navid & Athienitis, Andreas K. & Candanedo, José Agustín & Nouanegue, Hervé Frank, 2024. "Heuristic model predictive control implementation to activate energy flexibility in a fully electric school building," Energy, Elsevier, vol. 296(C).
    7. Khatibi, Mahmood & Rahnama, Samira & Vogler-Finck, Pierre & Dimon Bendtsen, Jan & Afshari, Alireza, 2023. "Towards designing an aggregator to activate the energy flexibility of multi-zone buildings using a hierarchical model-based scheme," Applied Energy, Elsevier, vol. 333(C).
    8. Daniele Mortari & Carl Leake, 2019. "The Multivariate Theory of Connections," Mathematics, MDPI, vol. 7(3), pages 1-22, March.
    9. Li, Yanxue & Wang, Zixuan & Xu, Wenya & Gao, Weijun & Xu, Yang & Xiao, Fu, 2023. "Modeling and energy dynamic control for a ZEH via hybrid model-based deep reinforcement learning," Energy, Elsevier, vol. 277(C).
    10. Kristofer Drozd & Roberto Furfaro & Enrico Schiassi & Andrea D’Ambrosio, 2023. "Physics-Informed Neural Networks and Functional Interpolation for Solving the Matrix Differential Riccati Equation," Mathematics, MDPI, vol. 11(17), pages 1-24, August.
    11. Daniele Mortari, 2022. "Theory of Functional Connections Subject to Shear-Type and Mixed Derivatives," Mathematics, MDPI, vol. 10(24), pages 1-16, December.
    12. Cui, Xueyuan & Liu, Shu & Ruan, Guangchun & Wang, Yi, 2024. "Data-driven aggregation of thermal dynamics within building virtual power plants," Applied Energy, Elsevier, vol. 353(PB).
    13. Di Natale, L. & Svetozarevic, B. & Heer, P. & Jones, C.N., 2023. "Towards scalable physically consistent neural networks: An application to data-driven multi-zone thermal building models," Applied Energy, Elsevier, vol. 340(C).
    14. Dongsu Kim & Jongman Lee & Sunglok Do & Pedro J. Mago & Kwang Ho Lee & Heejin Cho, 2022. "Energy Modeling and Model Predictive Control for HVAC in Buildings: A Review of Current Research Trends," Energies, MDPI, vol. 15(19), pages 1-30, October.
    15. Wang, Qiaochu & Ding, Yan & Kong, Xiangfei & Tian, Zhe & Xu, Linrui & He, Qing, 2022. "Load pattern recognition based optimization method for energy flexibility in office buildings," Energy, Elsevier, vol. 254(PC).
    16. Wei, Ziqing & Ren, Fukang & Zhu, Yikang & Yue, Bao & Ding, Yunxiao & Zheng, Chunyuan & Li, Bin & Zhai, Xiaoqiang, 2022. "Data-driven two-step identification of building thermal characteristics: A case study of office building," Applied Energy, Elsevier, vol. 326(C).
    17. Kristofer Drozd & Roberto Furfaro & Andrea D’Ambrosio, 2024. "A Theory of Functional Connections-Based hp -Adaptive Mesh Refinement Algorithm for Solving Hypersensitive Two-Point Boundary-Value Problems," Mathematics, MDPI, vol. 12(9), pages 1-35, April.
    18. Mengting Jiang & Camilo Rindt & David M. J. Smeulders, 2022. "Optimal Planning of Future District Heating Systems—A Review," Energies, MDPI, vol. 15(19), pages 1-38, September.
    19. Akhmet, Marat & Tleubergenova, Madina & Zhamanshin, Akylbek, 2024. "Cohen-Grossberg neural networks with unpredictable and Poisson stable dynamics," Chaos, Solitons & Fractals, Elsevier, vol. 178(C).
    20. Miao, Hua & Zhu, Wei & Dan, Yuanhong & Yu, Nanxiang, 2024. "Chaotic time series prediction based on multi-scale attention in a multi-agent environment," Chaos, Solitons & Fractals, Elsevier, vol. 183(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:chsofr:v:188:y:2024:i:c:s0960077924010907. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Thayer, Thomas R. (email available below). General contact details of provider: https://www.journals.elsevier.com/chaos-solitons-and-fractals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.