IDEAS home Printed from https://ideas.repec.org/a/eee/eneeco/v32y2010i5p1009-1024.html
   My bibliography  Save this article

An agent-based approach equipped with game theory: Strategic collaboration among learning agents during a dynamic market change in the California electricity crisis

Author

Listed:
  • Sueyoshi, Toshiyuki

Abstract

An agent-based approach is a numerical (computer-intensive) method to explore the complex characteristics and dynamics of microeconomics. Using the agent-based approach, this study investigates the learning speed of traders and their strategic collaboration in a dynamic market change of electricity. An example of such a market change can be found in the California electricity crisis (2000-2001). This study incorporates the concept of partial reinforcement learning into trading agents and finds that they have two learning components: learning from a dynamic market change and learning from collaboration with other traders. The learning speed of traders becomes slow when a large fluctuation occurs in the power exchange market. The learning speed depends upon the type of traders, their learning capabilities and the fluctuation of market fundamentals. The degree of collaboration among traders gradually reduces during the electricity crisis. The strategic collaboration among traders is examined by a large simulator equipped with multiple learning capabilities.

Suggested Citation

  • Sueyoshi, Toshiyuki, 2010. "An agent-based approach equipped with game theory: Strategic collaboration among learning agents during a dynamic market change in the California electricity crisis," Energy Economics, Elsevier, vol. 32(5), pages 1009-1024, September.
    • Handle: RePEc:eee:eneeco:v:32:y:2010:i:5:p:1009-1024
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0140-9883(09)00244-8
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Chevillon, Guillaume & Rifflart, Christine, 2009. "Physical market determinants of the price of crude oil and the market premium," Energy Economics, Elsevier, vol. 31(4), pages 537-549, July.
    2. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-881, September.
    3. Knittel, Christopher R. & Roberts, Michael R., 2005. "An empirical examination of restructured electricity prices," Energy Economics, Elsevier, vol. 27(5), pages 791-817, September.
    4. Mohammadi, Hassan, 2009. "Electricity prices and fuel costs: Long-run relations and short-run dynamics," Energy Economics, Elsevier, vol. 31(3), pages 503-509, May.
    5. Roth, Alvin E. & Erev, Ido, 1995. "Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term," Games and Economic Behavior, Elsevier, vol. 8(1), pages 164-212.
    6. Paul L. Joskow & Edward Kohn, 2002. "A Quantitative Analysis of Pricing Behavior in California's Wholesale Electricity Market During Summer 2000," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4), pages 1-35.
    7. Colin F. Camerer, 1997. "Progress in Behavioral Game Theory," Journal of Economic Perspectives, American Economic Association, vol. 11(4), pages 167-188, Fall.
    8. Derek W. Bunn and Fernando Oliveira, 2001. "An Application of Agent-based Simulation to the New Electricity Trading Arrangements of England and Wales," Computing in Economics and Finance 2001 93, Society for Computational Economics.
    9. Robert Wilson, 2002. "Architecture of Power Markets," Econometrica, Econometric Society, vol. 70(4), pages 1299-1340, July.
    10. Yoella Bereby-Meyer & Alvin E. Roth, 2006. "The Speed of Learning in Noisy Games: Partial Reinforcement and the Sustainability of Cooperation," American Economic Review, American Economic Association, vol. 96(4), pages 1029-1042, September.
    11. Redl, Christian & Haas, Reinhard & Huber, Claus & Böhm, Bernhard, 2009. "Price formation in electricity forward markets and the relevance of systematic forecast errors," Energy Economics, Elsevier, vol. 31(3), pages 356-364, May.
    12. Severin Borenstein & James B. Bushnell & Frank A. Wolak, 2002. "Measuring Market Inefficiencies in California's Restructured Wholesale Electricity Market," American Economic Review, American Economic Association, vol. 92(5), pages 1376-1405, December.
    13. Makowski, Marek & Nakamori, Yoshiteru & Sebastian, Hans-Jurgen, 2005. "Advances in complex systems modeling," European Journal of Operational Research, Elsevier, vol. 166(3), pages 593-596, November.
    14. Ghaffari, Ali & Zare, Samaneh, 2009. "A novel algorithm for prediction of crude oil price variation based on soft computing," Energy Economics, Elsevier, vol. 31(4), pages 531-536, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhang, Di & Samsatli, Nouri J. & Hawkes, Adam D. & Brett, Dan J.L. & Shah, Nilay & Papageorgiou, Lazaros G., 2013. "Fair electricity transfer price and unit capacity selection for microgrids," Energy Economics, Elsevier, vol. 36(C), pages 581-593.
    2. Sueyoshi, Toshiyuki & Goto, Mika, 2012. "Returns to scale and damages to scale on U.S. fossil fuel power plants: Radial and non-radial approaches for DEA environmental assessment," Energy Economics, Elsevier, vol. 34(6), pages 2240-2259.
    3. Md. Sayed Iftekhar & John G. Tisdell, 2016. "An Agent Based Analysis of Combinatorial Bidding for Spatially Targeted Multi-Objective Environmental Programs," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 64(4), pages 537-558, August.
    4. Sueyoshi, Toshiyuki & Goto, Mika, 2015. "Environmental assessment on coal-fired power plants in U.S. north-east region by DEA non-radial measurement," Energy Economics, Elsevier, vol. 50(C), pages 125-139.
    5. Young, David & Poletti, Stephen & Browne, Oliver, 2014. "Can agent-based models forecast spot prices in electricity markets? Evidence from the New Zealand electricity market," Energy Economics, Elsevier, vol. 45(C), pages 419-434.
    6. Goto, Hisanori & Goto, Mika & Sueyoshi, Toshiyuki, 2011. "Consumer choice on ecologically efficient water heaters: Marketing strategy and policy implications in Japan," Energy Economics, Elsevier, vol. 33(2), pages 195-208, March.
    7. Mier, Mathias & Siala, Kais & Govorukha, Kristina & Mayer, Philip, 2023. "Collaboration, decarbonization, and distributional effects," Applied Energy, Elsevier, vol. 341(C).
    8. Sueyoshi, Toshiyuki & Goto, Mika & Sugiyama, Manabu, 2013. "DEA window analysis for environmental assessment in a dynamic time shift: Performance assessment of U.S. coal-fired power plants," Energy Economics, Elsevier, vol. 40(C), pages 845-857.
    9. Sueyoshi, Toshiyuki & Wang, Derek, 2017. "Measuring scale efficiency and returns to scale on large commercial rooftop photovoltaic systems in California," Energy Economics, Elsevier, vol. 65(C), pages 389-398.
    10. Sueyoshi, Toshiyuki & Goto, Mika, 2014. "Photovoltaic power stations in Germany and the United States: A comparative study by data envelopment analysis," Energy Economics, Elsevier, vol. 42(C), pages 271-288.
    11. Shafie-khah, Miadreza & Parsa Moghaddam, Mohsen & Sheikh-El-Eslami, Mohamad Kazem & Rahmani-Andebili, Mehdi, 2012. "Modeling of interactions between market regulations and behavior of plug-in electric vehicle aggregators in a virtual power market environment," Energy, Elsevier, vol. 40(1), pages 139-150.
    12. Sueyoshi, Toshiyuki & Goto, Mika, 2012. "Environmental assessment by DEA radial measurement: U.S. coal-fired power plants in ISO (Independent System Operator) and RTO (Regional Transmission Organization)," Energy Economics, Elsevier, vol. 34(3), pages 663-676.
    13. Sueyoshi, Toshiyuki, 2010. "An agent-based approach with collaboration among agents: Estimation of wholesale electricity price on PJM and artificial data generated by a mean reverting model," Energy Economics, Elsevier, vol. 32(5), pages 1025-1033, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Woo, C.K. & Zarnikau, J. & Moore, J. & Horowitz, I., 2011. "Wind generation and zonal-market price divergence: Evidence from Texas," Energy Policy, Elsevier, vol. 39(7), pages 3928-3938, July.
    2. Chi-Keung Woo, Ira Horowitz, Brian Horii, Ren Orans, and Jay Zarnikau, 2012. "Blowing in the Wind: Vanishing Payoffs of a Tolling Agreement for Natural-gas-fired Generation of Electricity in Texas," The Energy Journal, International Association for Energy Economics, vol. 0(Number 1).
    3. Sensfuß, Frank & Ragwitz, Mario & Genoese, Massimo & Möst, Dominik, 2007. "Agent-based simulation of electricity markets: a literature review," Working Papers "Sustainability and Innovation" S5/2007, Fraunhofer Institute for Systems and Innovation Research (ISI).
    4. Gaivoronskaia, E. & Tsyplakov, A., 2018. "Using a Modified Erev-Roth Algorithm in an Agent-Based Electricity Market Model," Journal of the New Economic Association, New Economic Association, vol. 39(3), pages 55-83.
    5. Cao, K.H. & Qi, H.S. & Tsai, C.H. & Woo, C.K. & Zarnikau, J., 2021. "Energy trading efficiency in the US Midcontinent electricity markets," Applied Energy, Elsevier, vol. 302(C).
    6. Lewis Evans & Graeme Guthrie, 2009. "How Options Provided by Storage Affect Electricity Prices," Southern Economic Journal, John Wiley & Sons, vol. 75(3), pages 681-702, January.
    7. Horowitz, I. & Woo, C.K., 2006. "Designing Pareto-superior demand-response rate options," Energy, Elsevier, vol. 31(6), pages 1040-1051.
    8. Grosskopf, Brit & Roth, Alvin E., 2009. "If you are offered the Right of First Refusal, should you accept? An investigation of contract design," Games and Economic Behavior, Elsevier, vol. 65(1), pages 176-204, January.
    9. Brehm, Paul A. & Zhang, Yiyuan, 2021. "The efficiency and environmental impacts of market organization: Evidence from the Texas electricity market," Energy Economics, Elsevier, vol. 101(C).
    10. Theodorou, Petros & Karyampas, Dimitrios, 2008. "Modeling the return and volatility of the Greek electricity marginal system price," Energy Policy, Elsevier, vol. 36(7), pages 2601-2609, July.
    11. Amundsen, Eirik S. & Bergman, Lars, 2006. "Why has the Nordic electricity market worked so well?," Utilities Policy, Elsevier, vol. 14(3), pages 148-157, September.
    12. Yoella Bereby-Meyer & Alvin E. Roth, 2006. "The Speed of Learning in Noisy Games: Partial Reinforcement and the Sustainability of Cooperation," American Economic Review, American Economic Association, vol. 96(4), pages 1029-1042, September.
    13. Woo, C.K. & Chen, Y. & Olson, A. & Moore, J. & Schlag, N. & Ong, A. & Ho, T., 2017. "Electricity price behavior and carbon trading: New evidence from California," Applied Energy, Elsevier, vol. 204(C), pages 531-543.
    14. Masiliūnas, Aidas, 2023. "Learning in rent-seeking contests with payoff risk and foregone payoff information," Games and Economic Behavior, Elsevier, vol. 140(C), pages 50-72.
    15. Spodniak, Petr & Bertsch, Valentin, 2017. "Determinants of power spreads in electricity futures markets: A multinational analysis," Papers WP580, Economic and Social Research Institute (ESRI).
    16. Albert Banal-Estañol & Augusto Rupérez-Micola, 2010. "Are agent-based simulations robust? The wholesale electricity trading case," Economics Working Papers 1214, Department of Economics and Business, Universitat Pompeu Fabra.
    17. Du, Limin & Mao, Jie & Shi, Jinchuan, 2009. "Assessing the impact of regulatory reforms on China's electricity generation industry," Energy Policy, Elsevier, vol. 37(2), pages 712-720, February.
    18. Abbink, Klaus & Bolton, Gary E. & Sadrieh, Abdolkarim & Tang, Fang-Fang, 2001. "Adaptive Learning versus Punishment in Ultimatum Bargaining," Games and Economic Behavior, Elsevier, vol. 37(1), pages 1-25, October.
    19. Köke, Sonja & Lange, Andreas & Nicklisch, Andreas, 2015. "Adversity is a school of wisdomː Experimental evidence on cooperative protection against stochastic losses," WiSo-HH Working Paper Series 22, University of Hamburg, Faculty of Business, Economics and Social Sciences, WISO Research Laboratory.
    20. Nicklisch, Andreas & Köke, Sonja & Lange, Andreas, 2016. "Is Adversity a School of Wisdom? Experimental Evidence on Cooperative Protection Against Stochastic Losses," VfS Annual Conference 2016 (Augsburg): Demographic Change 145716, Verein für Socialpolitik / German Economic Association.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:eneeco:v:32:y:2010:i:5:p:1009-1024. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eneco .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.