IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v301y2022i2p726-746.html
   My bibliography  Save this article

Integrated day-ahead and intraday self-schedule bidding for energy storage systems using approximate dynamic programming

Author

Listed:
  • Finnah, Benedikt
  • Gönsch, Jochen
  • Ziel, Florian

Abstract

Most modern energy markets trade electricity in advance for technical reasons. Thus, market participants must commit to delivering or consuming a certain amount of energy before the actual delivery. In Germany, two markets with daily auctions coexist. In the day-ahead auction market, the energy is traded in 60-minute time slots, which are further partitioned into 15-minute time slots for the intraday auction market. Because of the slow ramp-ups of nuclear and fossil power plants, these price-makers trade mostly in the day-ahead market. Only the residual energy is traded in the intraday market, where the market prices fluctuate substantially more. These fluctuations as well as the expected price difference between these markets can be exploited by fast ramping energy storage systems. We address the decision problem of an owner of an energy storage who trades on both markets, taking ramping times into account. Because the state variable of our dynamic programming formulation includes all features of our high-dimensional electricity price forecast, this problem cannot be solved to optimality. Instead, we use approximate dynamic programming. In a numerical study based on real-world data, we benchmark the algorithm against an adapted state-of-the-art approach from literature and an expectation model with a receding horizon. Furthermore, we investigate the influence of the price forecast on expected profit and demonstrate that it is essential for the dynamic program to capture the high dimensionality of the price forecast to compete with the expectation model, which does not suffer from the curses of dimensionality.

Suggested Citation

  • Finnah, Benedikt & Gönsch, Jochen & Ziel, Florian, 2022. "Integrated day-ahead and intraday self-schedule bidding for energy storage systems using approximate dynamic programming," European Journal of Operational Research, Elsevier, vol. 301(2), pages 726-746.
  • Handle: RePEc:eee:ejores:v:301:y:2022:i:2:p:726-746
    DOI: 10.1016/j.ejor.2021.11.010
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221721009565
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2021.11.010?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Xu, Xiao & Hu, Weihao & Cao, Di & Huang, Qi & Liu, Zhou & Liu, Wen & Chen, Zhe & Blaabjerg, Frede, 2020. "Scheduling of wind-battery hybrid system in the electricity market using distributionally robust optimization," Renewable Energy, Elsevier, vol. 156(C), pages 47-56.
    2. Fathima, A. Hina & Palanisamy, K., 2015. "Optimization in microgrids with hybrid energy systems – A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 45(C), pages 431-446.
    3. Nils Löhndorf & David Wozabal & Stefan Minner, 2013. "Optimizing Trading Decisions for Hydro Storage Systems Using Approximate Dual Dynamic Programming," Operations Research, INFORMS, vol. 61(4), pages 810-823, August.
    4. Daniel F. Salas & Warren B. Powell, 2018. "Benchmarking a Scalable Approximate Dynamic Programming Algorithm for Stochastic Control of Grid-Level Energy Storage," INFORMS Journal on Computing, INFORMS, vol. 30(1), pages 106-123, February.
    5. Hain, Martin & Schermeyer, Hans & Uhrig-Homburg, Marliese & Fichtner, Wolf, 2018. "Managing renewable energy production risk," Journal of Banking & Finance, Elsevier, vol. 97(C), pages 1-19.
    6. Grzegorz Marcjasz, 2020. "Forecasting Electricity Prices Using Deep Neural Networks: A Robust Hyper-Parameter Selection Scheme," Energies, MDPI, vol. 13(18), pages 1-18, September.
    7. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting: Part II — Probabilistic forecasting," Energy Economics, Elsevier, vol. 79(C), pages 171-182.
    8. Narajewski, Michał & Ziel, Florian, 2020. "Econometric modelling and forecasting of intraday electricity prices," Journal of Commodity Markets, Elsevier, vol. 19(C).
    9. Steffen, Bjarne, 2012. "Prospects for pumped-hydro storage in Germany," Energy Policy, Elsevier, vol. 45(C), pages 420-429.
    10. Finnah, Benedikt & Gönsch, Jochen, 2021. "Optimizing trading decisions of wind power plants with hybrid energy storage systems using backwards approximate dynamic programming," International Journal of Production Economics, Elsevier, vol. 238(C).
    11. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting with NARX neural networks," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1520-1532.
    12. Boomsma, Trine Krogh & Juul, Nina & Fleten, Stein-Erik, 2014. "Bidding in sequential electricity markets: The Nordic case," European Journal of Operational Research, Elsevier, vol. 238(3), pages 797-809.
    13. Florian Ziel, 2015. "Forecasting Electricity Spot Prices using Lasso: On Capturing the Autoregressive Intraday Structure," Papers 1509.01966, arXiv.org, revised Jan 2016.
    14. A. Rahman, Hasimah & Majid, Md. Shah & Rezaee Jordehi, A. & Chin Kim, Gan & Hassan, Mohammad Yusri & O. Fadhl, Saeed, 2015. "Operation and control strategies of integrated distributed energy resources: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 51(C), pages 1412-1420.
    15. Weitzel, Timm & Glock, C. H., 2018. "Energy Management for Stationary Electric Energy Storage Systems: A Systematic Literature Review," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 88880, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    16. Jochen Gönsch & Michael Hassler, 2016. "Sell or store? An ADP approach to marketing renewable energy," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 38(3), pages 633-660, July.
    17. Wozabal, David & Rameseder, Gunther, 2020. "Optimal bidding of a virtual power plant on the Spanish day-ahead and intraday market for electricity," European Journal of Operational Research, Elsevier, vol. 280(2), pages 639-655.
    18. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    19. Micha{l} Narajewski & Florian Ziel, 2020. "Ensemble Forecasting for Intraday Electricity Prices: Simulating Trajectories," Papers 2005.01365, arXiv.org, revised Aug 2020.
    20. Crespo-Vazquez, Jose L. & Carrillo, C. & Diaz-Dorado, E. & Martinez-Lorenzo, Jose A. & Noor-E-Alam, Md., 2018. "A machine learning based stochastic optimization framework for a wind and storage power plant participating in energy pool market," Applied Energy, Elsevier, vol. 232(C), pages 341-357.
    21. Olaszi, Balint D. & Ladanyi, Jozsef, 2017. "Comparison of different discharge strategies of grid-connected residential PV systems with energy storage in perspective of optimal battery energy storage system sizing," Renewable and Sustainable Energy Reviews, Elsevier, vol. 75(C), pages 710-718.
    22. Bartosz Uniejewski & Rafał Weron, 2018. "Efficient Forecasting of Electricity Spot Prices with Expert and LASSO Models," Energies, MDPI, vol. 11(8), pages 1-26, August.
    23. Weitzel, Timm & Glock, Christoph H., 2018. "Energy management for stationary electric energy storage systems: A systematic literature review," European Journal of Operational Research, Elsevier, vol. 264(2), pages 582-606.
    24. Jae Ho Kim & Warren B. Powell, 2011. "Optimal Energy Commitments with Storage and Intermittent Supply," Operations Research, INFORMS, vol. 59(6), pages 1347-1360, December.
    25. Narajewski, Michał & Ziel, Florian, 2020. "Ensemble forecasting for intraday electricity prices: Simulating trajectories," Applied Energy, Elsevier, vol. 279(C).
    26. Arkadiusz Jędrzejewski & Grzegorz Marcjasz & Rafał Weron, 2021. "Importance of the Long-Term Seasonal Component in Day-Ahead Electricity Price Forecasting Revisited: Parameter-Rich Models Estimated via the LASSO," Energies, MDPI, vol. 14(11), pages 1-17, June.
    27. Powell, Warren B., 2019. "A unified framework for stochastic optimization," European Journal of Operational Research, Elsevier, vol. 275(3), pages 795-821.
    28. Löhndorf, Nils & Shapiro, Alexander, 2019. "Modeling time-dependent randomness in stochastic dual dynamic programming," European Journal of Operational Research, Elsevier, vol. 273(2), pages 650-661.
    29. Yangfang (Helen) Zhou & Alan Scheller-Wolf & Nicola Secomandi & Stephen Smith, 2016. "Electricity Trading and Negative Prices: Storage vs. Disposal," Management Science, INFORMS, vol. 62(3), pages 880-898, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kim, Seokwoo & Choi, Dong Gu, 2024. "A sample robust optimal bidding model for a virtual power plant," European Journal of Operational Research, Elsevier, vol. 316(3), pages 1101-1113.
    2. Thomas Deschatre & Xavier Warin, 2023. "A Common Shock Model for multidimensional electricity intraday price modelling with application to battery valuation," Papers 2307.16619, arXiv.org.
    3. Karakoyun, Ece Cigdem & Avci, Harun & Kocaman, Ayse Selin & Nadar, Emre, 2023. "Deviations from commitments: Markov decision process formulations for the role of energy storage," International Journal of Production Economics, Elsevier, vol. 255(C).
    4. Yilmaz, Dogacan & Büyüktahtakın, İ. Esra, 2024. "An expandable machine learning-optimization framework to sequential decision-making," European Journal of Operational Research, Elsevier, vol. 314(1), pages 280-296.
    5. Cervellera, Cristiano, 2023. "Optimized ensemble value function approximation for dynamic programming," European Journal of Operational Research, Elsevier, vol. 309(2), pages 719-730.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Benedikt Finnah, 2022. "Optimal bidding functions for renewable energies in sequential electricity markets," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 44(1), pages 1-27, March.
    2. Katarzyna Maciejowska & Bartosz Uniejewski & Rafa{l} Weron, 2022. "Forecasting Electricity Prices," Papers 2204.11735, arXiv.org.
    3. Narajewski, Michał & Ziel, Florian, 2022. "Optimal bidding in hourly and quarter-hourly electricity price auctions: Trading large volumes of power with market impact and transaction costs," Energy Economics, Elsevier, vol. 110(C).
    4. Marcjasz, Grzegorz & Narajewski, Michał & Weron, Rafał & Ziel, Florian, 2023. "Distributional neural networks for electricity price forecasting," Energy Economics, Elsevier, vol. 125(C).
    5. Finnah, Benedikt & Gönsch, Jochen, 2021. "Optimizing trading decisions of wind power plants with hybrid energy storage systems using backwards approximate dynamic programming," International Journal of Production Economics, Elsevier, vol. 238(C).
    6. Arkadiusz Jędrzejewski & Grzegorz Marcjasz & Rafał Weron, 2021. "Importance of the Long-Term Seasonal Component in Day-Ahead Electricity Price Forecasting Revisited: Parameter-Rich Models Estimated via the LASSO," Energies, MDPI, vol. 14(11), pages 1-17, June.
    7. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    8. Schrotenboer, Albert H. & Veenstra, Arjen A.T. & uit het Broek, Michiel A.J. & Ursavas, Evrim, 2022. "A Green Hydrogen Energy System: Optimal control strategies for integrated hydrogen storage and power generation with wind energy," Renewable and Sustainable Energy Reviews, Elsevier, vol. 168(C).
    9. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    10. Uniejewski, Bartosz & Weron, Rafał, 2021. "Regularized quantile regression averaging for probabilistic electricity price forecasting," Energy Economics, Elsevier, vol. 95(C).
    11. Micha{l} Narajewski & Florian Ziel, 2021. "Optimal bidding in hourly and quarter-hourly electricity price auctions: trading large volumes of power with market impact and transaction costs," Papers 2104.14204, arXiv.org, revised Feb 2022.
    12. Serafin, Tomasz & Marcjasz, Grzegorz & Weron, Rafał, 2022. "Trading on short-term path forecasts of intraday electricity prices," Energy Economics, Elsevier, vol. 112(C).
    13. Karakoyun, Ece Cigdem & Avci, Harun & Kocaman, Ayse Selin & Nadar, Emre, 2023. "Deviations from commitments: Markov decision process formulations for the role of energy storage," International Journal of Production Economics, Elsevier, vol. 255(C).
    14. Grzegorz Marcjasz & Tomasz Serafin & Rafał Weron, 2018. "Selection of Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 11(9), pages 1-20, September.
    15. Weitzel, Timm & Glock, Christoph H., 2018. "Energy management for stationary electric energy storage systems: A systematic literature review," European Journal of Operational Research, Elsevier, vol. 264(2), pages 582-606.
    16. Russo, Marianna & Kraft, Emil & Bertsch, Valentin & Keles, Dogan, 2022. "Short-term risk management of electricity retailers under rising shares of decentralized solar generation," Energy Economics, Elsevier, vol. 109(C).
    17. Micha{l} Narajewski, 2022. "Probabilistic forecasting of German electricity imbalance prices," Papers 2205.11439, arXiv.org.
    18. Grzegorz Marcjasz & Bartosz Uniejewski & Rafał Weron, 2020. "Beating the Naïve—Combining LASSO with Naïve Intraday Electricity Price Forecasts," Energies, MDPI, vol. 13(7), pages 1-16, April.
    19. Bartosz Uniejewski & Rafał Weron, 2018. "Efficient Forecasting of Electricity Spot Prices with Expert and LASSO Models," Energies, MDPI, vol. 11(8), pages 1-26, August.
    20. Michał Narajewski, 2022. "Probabilistic Forecasting of German Electricity Imbalance Prices," Energies, MDPI, vol. 15(14), pages 1-17, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:301:y:2022:i:2:p:726-746. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.