IDEAS home Printed from https://ideas.repec.org/p/osf/osfxxx/jrc58.html
   My bibliography  Save this paper

Comprehensive Review of Deep Reinforcement Learning Methods and Applications in Economics

Author

Listed:
  • Mosavi, Amir
  • Faghan, Yaser
  • Ghamisi, Pedram
  • Duan, Puhong
  • Ardabili, Sina Faizollahzadeh
  • Hassan, Salwana
  • Band, Shahab S.

Abstract

The popularity of deep reinforcement learning (DRL) applications in economics has increased exponentially. DRL, through a wide range of capabilities from reinforcement learning (RL) to deep learning (DL), offers vast opportunities for handling sophisticated dynamic economics systems. DRL is characterized by scalability with the potential to be applied to high-dimensional problems in conjunction with noisy and nonlinear patterns of economic data. In this paper, we initially consider a brief review of DL, RL, and deep RL methods in diverse applications in economics, providing an in-depth insight into the state-of-the-art. Furthermore, the architecture of DRL applied to economic applications is investigated in order to highlight the complexity, robustness, accuracy, performance, computational tasks, risk constraints, and profitability. The survey results indicate that DRL can provide better performance and higher efficiency as compared to the traditional algorithms while facing real economic problems in the presence of risk parameters and the ever-increasing uncertainties.

Suggested Citation

  • Mosavi, Amir & Faghan, Yaser & Ghamisi, Pedram & Duan, Puhong & Ardabili, Sina Faizollahzadeh & Hassan, Salwana & Band, Shahab S., 2020. "Comprehensive Review of Deep Reinforcement Learning Methods and Applications in Economics," OSF Preprints jrc58, Center for Open Science.
    • Handle: RePEc:osf:osfxxx:jrc58
    DOI: 10.31219/osf.io/jrc58
    as

    Download full text from publisher

    File URL: https://osf.io/download/5f6684f39e9a3d004f6e35aa/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/jrc58?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Majid Dehghani & Hossein Riahi-Madvar & Farhad Hooshyaripor & Amir Mosavi & Shahaboddin Shamshirband & Edmundas Kazimieras Zavadskas & Kwok-wing Chau, 2019. "Prediction of Hydropower Generation Using Grey Wolf Optimization Adaptive Neuro-Fuzzy Inference System," Energies, MDPI, vol. 12(2), pages 1-20, January.
    2. Li, Danny H.W. & Lou, Siwei & Lam, Joseph C. & Wu, Ronald H.T., 2016. "Determining solar irradiance on inclined planes from classified CIE (International Commission on Illumination) standard skies," Energy, Elsevier, vol. 101(C), pages 462-470.
    3. Rojas, Redlich García & Alvarado, Natalia & Boland, John & Escobar, Rodrigo & Castillejo-Cuberos, Armando, 2019. "Diffuse fraction estimation using the BRL model and relationship of predictors under Chilean, Costa Rican and Australian climatic conditions," Renewable Energy, Elsevier, vol. 136(C), pages 1091-1106.
    4. Jamil, Basharat & Akhtar, Naiem, 2017. "Estimation of diffuse solar radiation in humid-subtropical climatic region of India: Comparison of diffuse fraction and diffusion coefficient models," Energy, Elsevier, vol. 131(C), pages 149-164.
    5. Qing, Xiangyun & Niu, Yugang, 2018. "Hourly day-ahead solar irradiance prediction using weather forecasts by LSTM," Energy, Elsevier, vol. 148(C), pages 461-468.
    6. Kong, Chengdong & Xu, Zilin & Yao, Qiang, 2013. "Outdoor performance of a low-concentrated photovoltaic–thermal hybrid system with crystalline silicon solar cells," Applied Energy, Elsevier, vol. 112(C), pages 618-625.
    7. Martin Hofmann & Gunther Seckmeyer, 2017. "A New Model for Estimating the Diffuse Fraction of Solar Irradiance for Photovoltaic System Simulations," Energies, MDPI, vol. 10(2), pages 1-21, February.
    8. Kontoleon, K.J., 2015. "Glazing solar heat gain analysis and optimization at varying orientations and placements in aspect of distributed radiation at the interior surfaces," Applied Energy, Elsevier, vol. 144(C), pages 152-164.
    9. Li, Danny H.W. & Yang, Liu & Lam, Joseph C., 2013. "Zero energy buildings and sustainable development implications – A review," Energy, Elsevier, vol. 54(C), pages 1-10.
    10. Li, Danny H.W. & Cheung, K.L. & Lam, Tony N.T. & Chan, Wilco W.H., 2012. "A study of grid-connected photovoltaic (PV) system in Hong Kong," Applied Energy, Elsevier, vol. 90(1), pages 122-127.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Muhammad Umar Khan & Somia Mehak & Dr. Wajiha Yasir & Shagufta Anwar & Muhammad Usman Majeed & Hafiz Arslan Ramzan, 2023. "Quantitative Studies Of Deep Reinforcement Learning In Gaming, Robotics And Real-World Control Systems," Bulletin of Business and Economics (BBE), Research Foundation for Humanity (RFH), vol. 12(2), pages 389-395.
    2. Ben Hambly & Renyuan Xu & Huining Yang, 2021. "Recent Advances in Reinforcement Learning in Finance," Papers 2112.04553, arXiv.org, revised Feb 2023.
    3. Valentin Kuleto & Milena Ilić & Mihail Dumangiu & Marko Ranković & Oliva M. D. Martins & Dan Păun & Larisa Mihoreanu, 2021. "Exploring Opportunities and Challenges of Artificial Intelligence and Machine Learning in Higher Education Institutions," Sustainability, MDPI, vol. 13(18), pages 1-16, September.
    4. Petr Suler & Zuzana Rowland & Tomas Krulicky, 2021. "Evaluation of the Accuracy of Machine Learning Predictions of the Czech Republic’s Exports to the China," JRFM, MDPI, vol. 14(2), pages 1-30, February.
    5. Berigel, Muhammet & Boztaş, Gizem Dilan & Rocca, Antonella & Neagu, Gabriela, 2024. "Using machine learning for NEETs and sustainability studies: Determining best machine learning algorithms," Socio-Economic Planning Sciences, Elsevier, vol. 94(C).
    6. Fatemehsadat Mirshafiee & Emad Shahbazi & Mohadeseh Safi & Rituraj Rituraj, 2023. "Predicting Power and Hydrogen Generation of a Renewable Energy Converter Utilizing Data-Driven Methods: A Sustainable Smart Grid Case Study," Energies, MDPI, vol. 16(1), pages 1-20, January.
    7. Fernando Loor & Veronica Gil-Costa & Mauricio Marin, 2024. "Metric Space Indices for Dynamic Optimization in a Peer to Peer-Based Image Classification Crowdsourcing Platform," Future Internet, MDPI, vol. 16(6), pages 1-29, June.
    8. Chien-Liang Chiu & Paoyu Huang & Min-Yuh Day & Yensen Ni & Yuhsin Chen, 2024. "Mastery of “Monthly Effects”: Big Data Insights into Contrarian Strategies for DJI 30 and NDX 100 Stocks over a Two-Decade Period," Mathematics, MDPI, vol. 12(2), pages 1-21, January.
    9. Jifan Zhang & Salih Tutun & Samira Fazel Anvaryazdi & Mohammadhossein Amini & Durai Sundaramoorthi & Hema Sundaramoorthi, 2024. "Management of resource sharing in emergency response using data-driven analytics," Annals of Operations Research, Springer, vol. 339(1), pages 663-692, August.
    10. Rui (Aruhan) Shi, 2021. "Learning from Zero: How to Make Consumption-Saving Decisions in a Stochastic Environment with an AI Algorithm," CESifo Working Paper Series 9255, CESifo.
    11. Reilly Pickard & Yuri Lawryshyn, 2023. "Deep Reinforcement Learning for Dynamic Stock Option Hedging: A Review," Mathematics, MDPI, vol. 11(24), pages 1-19, December.
    12. Rui & Shi, 2021. "Learning from zero: how to make consumption-saving decisions in a stochastic environment with an AI algorithm," Papers 2105.10099, arXiv.org, revised Feb 2022.
    13. Brini, Alessio & Tedeschi, Gabriele & Tantari, Daniele, 2023. "Reinforcement learning policy recommendation for interbank network stability," Journal of Financial Stability, Elsevier, vol. 67(C).
    14. Charl Maree & Christian W. Omlin, 2022. "Balancing Profit, Risk, and Sustainability for Portfolio Management," Papers 2207.02134, arXiv.org.
    15. Bruno Gašperov & Stjepan Begušić & Petra Posedel Šimović & Zvonko Kostanjčar, 2021. "Reinforcement Learning Approaches to Optimal Market Making," Mathematics, MDPI, vol. 9(21), pages 1-22, October.
    16. Mei-Li Shen & Cheng-Feng Lee & Hsiou-Hsiang Liu & Po-Yin Chang & Cheng-Hong Yang, 2021. "An Effective Hybrid Approach for Forecasting Currency Exchange Rates," Sustainability, MDPI, vol. 13(5), pages 1-29, March.
    17. Jan Niederreiter, 2023. "Broadening Economics in the Era of Artificial Intelligence and Experimental Evidence," Italian Economic Journal: A Continuation of Rivista Italiana degli Economisti and Giornale degli Economisti, Springer;Società Italiana degli Economisti (Italian Economic Association), vol. 9(1), pages 265-294, March.
    18. Amir Masoud Rahmani & Efat Yousefpoor & Mohammad Sadegh Yousefpoor & Zahid Mehmood & Amir Haider & Mehdi Hosseinzadeh & Rizwan Ali Naqvi, 2021. "Machine Learning (ML) in Medicine: Review, Applications, and Challenges," Mathematics, MDPI, vol. 9(22), pages 1-52, November.
    19. Shidi Deng & Maximilian Schiffer & Martin Bichler, 2024. "Algorithmic Collusion in Dynamic Pricing with Deep Reinforcement Learning," Papers 2406.02437, arXiv.org.
    20. Ben Hambly & Renyuan Xu & Huining Yang, 2023. "Recent advances in reinforcement learning in finance," Mathematical Finance, Wiley Blackwell, vol. 33(3), pages 437-503, July.
    21. Adrian Millea, 2021. "Deep Reinforcement Learning for Trading—A Critical Survey," Data, MDPI, vol. 6(11), pages 1-25, November.
    22. Tian Zhu & Wei Zhu, 2022. "Quantitative Trading through Random Perturbation Q-Network with Nonlinear Transaction Costs," Stats, MDPI, vol. 5(2), pages 1-15, June.
    23. Dimitrios Vamvakas & Panagiotis Michailidis & Christos Korkas & Elias Kosmatopoulos, 2023. "Review and Evaluation of Reinforcement Learning Frameworks on Smart Grid Applications," Energies, MDPI, vol. 16(14), pages 1-38, July.
    24. Callum Rhys Tilbury, 2022. "Reinforcement Learning for Economic Policy: A New Frontier?," Papers 2206.08781, arXiv.org, revised Feb 2023.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lou, Siwei & Li, Danny H.W. & Lam, Joseph C. & Chan, Wilco W.H., 2016. "Prediction of diffuse solar irradiance using machine learning and multivariable regression," Applied Energy, Elsevier, vol. 181(C), pages 367-374.
    2. Li, Danny H.W. & Lou, Siwei, 2018. "Review of solar irradiance and daylight illuminance modeling and sky classification," Renewable Energy, Elsevier, vol. 126(C), pages 445-453.
    3. Yang, Liu & Cao, Qimeng & Yu, Ying & Liu, Yan, 2020. "Comparison of daily diffuse radiation models in regions of China without solar radiation measurement," Energy, Elsevier, vol. 191(C).
    4. Makade, Rahul G. & Chakrabarti, Siddharth & Jamil, Basharat & Sakhale, C.N., 2020. "Estimation of global solar radiation for the tropical wet climatic region of India: A theory of experimentation approach," Renewable Energy, Elsevier, vol. 146(C), pages 2044-2059.
    5. Jiaxin Yu & Jun Wang, 2020. "Optimization Design of a Rain-Power Utilization System Based on a Siphon and Its Application in a High-Rise Building," Energies, MDPI, vol. 13(18), pages 1-18, September.
    6. Wang, Zhenyu & Zhang, Yunpeng & Li, Guorong & Zhang, Jinlong & Zhou, Hai & Wu, Ji, 2024. "A novel solar irradiance forecasting method based on multi-physical process of atmosphere optics and LSTM-BP model," Renewable Energy, Elsevier, vol. 226(C).
    7. Ahmed, R. & Sreeram, V. & Mishra, Y. & Arif, M.D., 2020. "A review and evaluation of the state-of-the-art in PV solar power forecasting: Techniques and optimization," Renewable and Sustainable Energy Reviews, Elsevier, vol. 124(C).
    8. Stephan Schlüter & Fabian Menz & Milena Kojić & Petar Mitić & Aida Hanić, 2022. "A Novel Approach to Generate Hourly Photovoltaic Power Scenarios," Sustainability, MDPI, vol. 14(8), pages 1-16, April.
    9. Karathanassis, I.K. & Papanicolaou, E. & Belessiotis, V. & Bergeles, G.C., 2017. "Design and experimental evaluation of a parabolic-trough concentrating photovoltaic/thermal (CPVT) system with high-efficiency cooling," Renewable Energy, Elsevier, vol. 101(C), pages 467-483.
    10. Gao, Yuan & Miyata, Shohei & Akashi, Yasunori, 2022. "Interpretable deep learning models for hourly solar radiation prediction based on graph neural network and attention," Applied Energy, Elsevier, vol. 321(C).
    11. Deng, S. & Wang, R.Z. & Dai, Y.J., 2014. "How to evaluate performance of net zero energy building – A literature research," Energy, Elsevier, vol. 71(C), pages 1-16.
    12. Michael-Allan Millar & Bruce Elrick & Greg Jones & Zhibin Yu & Neil M. Burnside, 2020. "Roadblocks to Low Temperature District Heating," Energies, MDPI, vol. 13(22), pages 1-21, November.
    13. Khan, Waqas & Walker, Shalika & Zeiler, Wim, 2022. "Improved solar photovoltaic energy generation forecast using deep learning-based ensemble stacking approach," Energy, Elsevier, vol. 240(C).
    14. Lu, Yakai & Tian, Zhe & Zhou, Ruoyu & Liu, Wenjing, 2021. "A general transfer learning-based framework for thermal load prediction in regional energy system," Energy, Elsevier, vol. 217(C).
    15. Pikas, Ergo & Thalfeldt, Martin & Kurnitski, Jarek & Liias, Roode, 2015. "Extra cost analyses of two apartment buildings for achieving nearly zero and low energy buildings," Energy, Elsevier, vol. 84(C), pages 623-633.
    16. Zheng, Lingwei & Su, Ran & Sun, Xinyu & Guo, Siqi, 2023. "Historical PV-output characteristic extraction based weather-type classification strategy and its forecasting method for the day-ahead prediction of PV output," Energy, Elsevier, vol. 271(C).
    17. Castillejo-Cuberos, A. & Cardemil, J.M. & Escobar, R., 2024. "Temporal upscaling of solar radiation components using an analytical model for variability modeling," Renewable Energy, Elsevier, vol. 229(C).
    18. Wei, Nan & Li, Changjun & Peng, Xiaolong & Li, Yang & Zeng, Fanhua, 2019. "Daily natural gas consumption forecasting via the application of a novel hybrid model," Applied Energy, Elsevier, vol. 250(C), pages 358-368.
    19. Wang, Kejun & Qi, Xiaoxia & Liu, Hongda, 2019. "A comparison of day-ahead photovoltaic power forecasting models based on deep learning neural network," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
    20. Lou, Siwei & Li, Danny H.W. & Lam, Joseph C., 2017. "CIE Standard Sky classification by accessible climatic indices," Renewable Energy, Elsevier, vol. 113(C), pages 347-356.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:osfxxx:jrc58. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.