IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2407.01953.html
   My bibliography  Save this paper

CatMemo at the FinLLM Challenge Task: Fine-Tuning Large Language Models using Data Fusion in Financial Applications

Author

Listed:
  • Yupeng Cao
  • Zhiyuan Yao
  • Zhi Chen
  • Zhiyang Deng

Abstract

The integration of Large Language Models (LLMs) into financial analysis has garnered significant attention in the NLP community. This paper presents our solution to IJCAI-2024 FinLLM challenge, investigating the capabilities of LLMs within three critical areas of financial tasks: financial classification, financial text summarization, and single stock trading. We adopted Llama3-8B and Mistral-7B as base models, fine-tuning them through Parameter Efficient Fine-Tuning (PEFT) and Low-Rank Adaptation (LoRA) approaches. To enhance model performance, we combine datasets from task 1 and task 2 for data fusion. Our approach aims to tackle these diverse tasks in a comprehensive and integrated manner, showcasing LLMs' capacity to address diverse and complex financial tasks with improved accuracy and decision-making capabilities.

Suggested Citation

  • Yupeng Cao & Zhiyuan Yao & Zhi Chen & Zhiyang Deng, 2024. "CatMemo at the FinLLM Challenge Task: Fine-Tuning Large Language Models using Data Fusion in Financial Applications," Papers 2407.01953, arXiv.org.
    • Handle: RePEc:arx:papers:2407.01953
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2407.01953
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Franklin Allen & Xian Gu & Julapa Jagtiani, 2021. "A Survey of Fintech Research and Policy Discussion," Review of Corporate Finance, now publishers, vol. 1(3-4), pages 259-339, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Douglas Cumming & Lars Hornuf & Moein Karami & Denis Schweizer, 2023. "Disentangling Crowdfunding from Fraudfunding," Journal of Business Ethics, Springer, vol. 182(4), pages 1103-1128, February.
    2. Shashi Kant Srivastava & Verma Deepika Chandra & Srinivas Jangirala & Janardan Krishna Yadav, 2024. "The Genesis of the Crypto-economy: Application of the Institutional Theory," Vikalpa: The Journal for Decision Makers, , vol. 49(3), pages 244-256, September.
    3. Silvio Vismara, 2022. "Expanding corporate finance perspectives to equity crowdfunding," The Journal of Technology Transfer, Springer, vol. 47(6), pages 1629-1639, December.
    4. Štefan Lyócsa & Petra Vašaničová & Branka Hadji Misheva & Marko Dávid Vateha, 2022. "Default or profit scoring credit systems? Evidence from European and US peer-to-peer lending markets," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-21, December.
    5. Kowalewski, Oskar & Pisany, Paweł, 2022. "Banks' consumer lending reaction to fintech and bigtech credit emergence in the context of soft versus hard credit information processing," International Review of Financial Analysis, Elsevier, vol. 81(C).
    6. Douglas Cumming & Robert S. Reardon, 2023. "COVID-19 and entrepreneurial processes in US equity crowdfunding," Journal of Small Business Management, Taylor & Francis Journals, vol. 61(5), pages 2326-2349, September.
    7. Joseph P. Hughes & Julapa Jagtiani & Choon-Geol Moon, 2022. "Consumer lending efficiency: commercial banks versus a fintech lender," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-39, December.
    8. Junjuan Du, 2023. "Rational or Impulsive? Early Backers’ Investment Behavior in Agri-Food Crowdfunding from 4P–4C Perspectives," SAGE Open, , vol. 13(3), pages 21582440231, August.
    9. Luisa Faust & Maura Kolbe & Sasan Mansouri & Paul P. Momtaz, 2022. "The Crowdfunding of Altruism," JRFM, MDPI, vol. 15(3), pages 1-29, March.
    10. Li, Linwen & Gao, Wei & Gu, Wanhong, 2023. "Fintech, bank concentration and commercial bank profitability: Evidence from Chinese urban commercial banks," Finance Research Letters, Elsevier, vol. 57(C).
    11. Shijun Chai & Li Zhou & Yang Chen, 2023. "Digital Finance and Entrepreneurial Return Rate: Effects, Mechanisms and Inequality," SAGE Open, , vol. 13(4), pages 21582440231, October.
    12. Zhiyu Cao & Zihan Chen & Prerna Mishra & Hamed Amini & Zachary Feinstein, 2023. "Modeling Inverse Demand Function with Explainable Dual Neural Networks," Papers 2307.14322, arXiv.org, revised Oct 2023.
    13. Meoli, Michele & Vismara, Silvio, 2022. "Machine-learning forecasting of successful ICOs," Journal of Economics and Business, Elsevier, vol. 121(C).
    14. Fuzhong Chen & Xin Du & Wenting Wang, 2023. "Can FinTech Applied to Payments Improve Consumer Financial Satisfaction? Evidence from the USA," Mathematics, MDPI, vol. 11(2), pages 1-17, January.
    15. Cornelli, Giulio & Frost, Jon & Gambacorta, Leonardo & Jagtiani, Julapa, 2024. "The impact of fintech lending on credit access for U.S. small businesses," Journal of Financial Stability, Elsevier, vol. 73(C).
    16. Peng‐Fei Dai & John W. Goodell & Luu Duc Toan Huynh & Zhifeng Liu & Shaen Corbet, 2023. "Understanding the transmission of crash risk between cryptocurrency and equity markets," The Financial Review, Eastern Finance Association, vol. 58(3), pages 539-573, August.
    17. Tobias Berg & Andreas Fuster & Manju Puri, 2022. "FinTech Lending," Annual Review of Financial Economics, Annual Reviews, vol. 14(1), pages 187-207, November.
    18. Hasan, Iftekhar & Kwak, Boreum & Li, Xiang, 2024. "Financial technologies and the effectiveness of monetary policy transmission," European Economic Review, Elsevier, vol. 161(C).
    19. Zhang, Xiaoyan & Li, Jinbao & Xiang, Dong & Worthington, Andrew C., 2023. "Digitalization, financial inclusion, and small and medium-sized enterprise financing: Evidence from China," Economic Modelling, Elsevier, vol. 126(C).
    20. Michael Sockin & Wei Xiong, 2023. "Decentralization through Tokenization," Journal of Finance, American Finance Association, vol. 78(1), pages 247-299, February.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2407.01953. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.