IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v296y2022i1p60-71.html
   My bibliography  Save this article

A massively parallel interior-point solver for LPs with generalized arrowhead structure, and applications to energy system models

Author

Listed:
  • Rehfeldt, Daniel
  • Hobbie, Hannes
  • Schönheit, David
  • Koch, Thorsten
  • Möst, Dominik
  • Gleixner, Ambros

Abstract

Linear energy system models are a crucial component of energy system design and operations, as well as energy policy consulting. If detailed enough, such models lead to large-scale linear programs, which can be intractable even for the best state-of-the-art solvers. This article introduces an interior-point solver that exploits common structures of energy system models to efficiently run in parallel on distributed-memory systems. The solver is designed for linear programs with doubly-bordered block-diagonal constraint matrix and makes use of a Schur complement based decomposition. In order to handle the large number of linking constraints and variables commonly observed in energy system models, a distributed Schur complement preconditioner is used. In addition, the solver features a number of more generic techniques such as parallel matrix scaling and structure-preserving presolving. The implementation is based on the solver PIPS-IPM. We evaluate the computational performance on energy system models with up to four billion nonzero entries in the constraint matrix—and up to one billion columns and one billion rows. This article mainly concentrates on the energy system model ELMOD, which is a linear optimization model representing the European electricity markets by the use of a nodal pricing market-clearing. It has been widely applied in the literature on energy system analyses in recent years. However, it will be demonstrated that the new solver is also applicable to other energy system models.

Suggested Citation

  • Rehfeldt, Daniel & Hobbie, Hannes & Schönheit, David & Koch, Thorsten & Möst, Dominik & Gleixner, Ambros, 2022. "A massively parallel interior-point solver for LPs with generalized arrowhead structure, and applications to energy system models," European Journal of Operational Research, Elsevier, vol. 296(1), pages 60-71.
  • Handle: RePEc:eee:ejores:v:296:y:2022:i:1:p:60-71
    DOI: 10.1016/j.ejor.2021.06.063
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221721005944
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2021.06.063?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jan Abrell & Friedrich Kunz, 2015. "Integrating Intermittent Renewable Wind Generation - A Stochastic Multi-Market Electricity Model for the European Electricity Market," Networks and Spatial Economics, Springer, vol. 15(1), pages 117-147, March.
    2. Gils, Hans Christian & Scholz, Yvonne & Pregger, Thomas & Luca de Tena, Diego & Heide, Dominik, 2017. "Integrated modelling of variable renewable energy-based power supply in Europe," Energy, Elsevier, vol. 123(C), pages 173-188.
    3. John R. Birge & Liqun Qi, 1988. "Computing Block-Angular Karmarkar Projections with Applications to Stochastic Programming," Management Science, INFORMS, vol. 34(12), pages 1472-1479, December.
    4. Robert J. Vanderbei, 2008. "The Homogeneous Self-Dual Method," International Series in Operations Research & Management Science, in: Linear Programming, edition 3, chapter 0, pages 361-381, Springer.
    5. Cosmin Petra & Mihai Anitescu, 2012. "A preconditioning technique for Schur complement systems arising in stochastic optimization," Computational Optimization and Applications, Springer, vol. 52(2), pages 315-344, June.
    6. Jacek Gondzio & Andreas Grothey, 2009. "Exploiting structure in parallel implementation of interior point methods for optimization," Computational Management Science, Springer, vol. 6(2), pages 135-160, May.
    7. Leuthold, Florian & Weigt, Hannes & von Hirschhausen, Christian, 2008. "ELMOD - A Model of the European Electricity Market," MPRA Paper 65660, University Library of Munich, Germany.
    8. Andersen, E.D. & Gondzio, J. & Meszaros, C. & Xu, X., 1996. "Implementation of Interior Point Methods for Large Scale Linear Programming," Papers 96.3, Ecole des Hautes Etudes Commerciales, Universite de Geneve-.
    9. Robert E. Bixby, 2002. "Solving Real-World Linear Programs: A Decade and More of Progress," Operations Research, INFORMS, vol. 50(1), pages 3-15, February.
    10. Gondzio, Jacek, 2012. "Interior point methods 25 years later," European Journal of Operational Research, Elsevier, vol. 218(3), pages 587-601.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Merrick, James H. & Bistline, John E.T. & Blanford, Geoffrey J., 2024. "On representation of energy storage in electricity planning models," Energy Economics, Elsevier, vol. 136(C).
    2. Grochowicz, Aleksander & van Greevenbroek, Koen & Benth, Fred Espen & Zeyringer, Marianne, 2023. "Intersecting near-optimal spaces: European power systems with more resilience to weather variability," Energy Economics, Elsevier, vol. 118(C).
    3. Shang, Jun & Ye, Haishan & Chang, Xiangyu, 2024. "Accelerated Double-Sketching Subspace Newton," European Journal of Operational Research, Elsevier, vol. 319(2), pages 484-493.
    4. Wolff, Michael & Becker, Tristan & Walther, Grit, 2023. "Long-term design and analysis of renewable fuel supply chains – An integrated approach considering seasonal resource availability," European Journal of Operational Research, Elsevier, vol. 304(2), pages 745-762.
    5. Reinert, Christiane & Nilges, Benedikt & Baumgärtner, Nils & Bardow, André, 2024. "This is SpArta: Rigorous Optimization of Regionally Resolved Energy Systems by Spatial Aggregation and Decomposition," Applied Energy, Elsevier, vol. 367(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Qu, Chunzi & Bang, Rasmus Noss, 2024. "European Grid Development Modeling and Analysis: Established Frameworks, Research Trends, and Future Opportunities," Discussion Papers 2024/11, Norwegian School of Economics, Department of Business and Management Science.
    2. Jacek Gondzio & Andreas Grothey, 2009. "Exploiting structure in parallel implementation of interior point methods for optimization," Computational Management Science, Springer, vol. 6(2), pages 135-160, May.
    3. Savvidis, Georgios & Siala, Kais & Weissbart, Christoph & Schmidt, Lukas & Borggrefe, Frieder & Kumar, Subhash & Pittel, Karen & Madlener, Reinhard & Hufendiek, Kai, 2019. "The gap between energy policy challenges and model capabilities," Energy Policy, Elsevier, vol. 125(C), pages 503-520.
    4. Cosmin Petra & Mihai Anitescu, 2012. "A preconditioning technique for Schur complement systems arising in stochastic optimization," Computational Optimization and Applications, Springer, vol. 52(2), pages 315-344, June.
    5. Gondzio, Jacek, 2012. "Interior point methods 25 years later," European Journal of Operational Research, Elsevier, vol. 218(3), pages 587-601.
    6. Cecilia Orellana Castro & Manolo Rodriguez Heredia & Aurelio R. L. Oliveira, 2023. "Recycling basic columns of the splitting preconditioner in interior point methods," Computational Optimization and Applications, Springer, vol. 86(1), pages 49-78, September.
    7. Prina, Matteo Giacomo & Nastasi, Benedetto & Groppi, Daniele & Misconel, Steffi & Garcia, Davide Astiaso & Sparber, Wolfram, 2022. "Comparison methods of energy system frameworks, models and scenario results," Renewable and Sustainable Energy Reviews, Elsevier, vol. 167(C).
    8. Liu, Yanwu & Tu, Yan & Zhang, Zhongzhen, 2021. "The row pivoting method for linear programming," Omega, Elsevier, vol. 100(C).
    9. Jakobsons Edgars, 2016. "Scenario aggregation method for portfolio expectile optimization," Statistics & Risk Modeling, De Gruyter, vol. 33(1-2), pages 51-65, September.
    10. Thiago Serra & Ryan J. O’Neil, 2020. "MIPLIBing: Seamless Benchmarking of Mathematical Optimization Problems and Metadata Extensions," SN Operations Research Forum, Springer, vol. 1(3), pages 1-6, September.
    11. Després, Jacques & Hadjsaid, Nouredine & Criqui, Patrick & Noirot, Isabelle, 2015. "Modelling the impacts of variable renewable sources on the power sector: Reconsidering the typology of energy modelling tools," Energy, Elsevier, vol. 80(C), pages 486-495.
    12. Bach, Lukas & Hasle, Geir & Schulz, Christian, 2019. "Adaptive Large Neighborhood Search on the Graphics Processing Unit," European Journal of Operational Research, Elsevier, vol. 275(1), pages 53-66.
    13. Gils, Hans Christian & Gardian, Hedda & Kittel, Martin & Schill, Wolf-Peter & Zerrahn, Alexander & Murmann, Alexander & Launer, Jann & Fehler, Alexander & Gaumnitz, Felix & van Ouwerkerk, Jonas & Bußa, 2022. "Modeling flexibility in energy systems — comparison of power sector models based on simplified test cases," Renewable and Sustainable Energy Reviews, Elsevier, vol. 158(C).
    14. Simshauser, Paul, 2024. "On static vs. dynamic line ratings in renewable energy zones," Energy Economics, Elsevier, vol. 129(C).
    15. Alexander Zerrahn, 2017. "Wind Power: Mitigated and Imposed External Costs and Other Indirect Economic Effects," DIW Roundup: Politik im Fokus 111, DIW Berlin, German Institute for Economic Research.
    16. Illes, Tibor & Terlaky, Tamas, 2002. "Pivot versus interior point methods: Pros and cons," European Journal of Operational Research, Elsevier, vol. 140(2), pages 170-190, July.
    17. Schönheit, David & Hladik, Dirk & Hobbie, Hannes & Möst, Dominik, 2020. "ELMOD documentation: Modeling of flow-based market coupling and congestion management," EconStor Preprints 217278, ZBW - Leibniz Information Centre for Economics.
    18. Maros, Istvan & Haroon Khaliq, Mohammad, 2002. "Advances in design and implementation of optimization software," European Journal of Operational Research, Elsevier, vol. 140(2), pages 322-337, July.
    19. Jens Hübner & Martin Schmidt & Marc C. Steinbach, 2017. "A Distributed Interior-Point KKT Solver for Multistage Stochastic Optimization," INFORMS Journal on Computing, INFORMS, vol. 29(4), pages 612-630, November.
    20. Schroeder, Andreas & Oei, Pao-Yu & Sander, Aram & Hankel, Lisa & Laurisch, Lilian Charlotte, 2013. "The integration of renewable energies into the German transmission grid—A scenario comparison," Energy Policy, Elsevier, vol. 61(C), pages 140-150.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:296:y:2022:i:1:p:60-71. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.