IDEAS home Printed from https://ideas.repec.org/a/bla/agecon/v55y2024i3p479-497.html
   My bibliography  Save this article

Machine learning to predict grains futures prices

Author

Listed:
  • Paolo Libenzio Brignoli
  • Alessandro Varacca
  • Cornelis Gardebroek
  • Paolo Sckokai

Abstract

Accurate commodity price forecasts are crucial for stakeholders in agricultural supply chains. They support informed marketing decisions, risk management, and investment strategies. Machine learning methods have significant potential to provide accurate forecasts by maximizing out‐of‐sample accuracy. However, their inherent complexity makes it challenging to understand the appropriate data pre‐processing steps to ensure proper functionality. This study compares the forecasting performance of Long Short‐Term Memory Recurrent Neural Networks (LSTM‐RNNs) with classical econometric time series models for corn futures prices. The study considers various combinations of data pre‐processing techniques, variable clusters, and forecast horizons. Our results indicate that LSTM‐RNNs consistently outperform classical methods, particularly for longer forecast horizons. In particular, our findings demonstrate that LSTM‐RNNs are capable of automatically handling structural breaks, resulting in more accurate forecasts when trained on datasets that include such shocks. However, in our setting, LSTM‐RNNs struggle to deal with seasonality and trend components, necessitating specific data pre‐processing procedures for their removal.

Suggested Citation

  • Paolo Libenzio Brignoli & Alessandro Varacca & Cornelis Gardebroek & Paolo Sckokai, 2024. "Machine learning to predict grains futures prices," Agricultural Economics, International Association of Agricultural Economists, vol. 55(3), pages 479-497, May.
  • Handle: RePEc:bla:agecon:v:55:y:2024:i:3:p:479-497
    DOI: 10.1111/agec.12828
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/agec.12828
    Download Restriction: no

    File URL: https://libkey.io/10.1111/agec.12828?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Sheng-Hung Chen & Song-Zan Chiou-Wei & Zhen Zhu, 2022. "Stochastic seasonality in commodity prices: the case of US natural gas," Empirical Economics, Springer, vol. 62(5), pages 2263-2284, May.
    2. Thomas A. P. de Boer & Cornelis Gardebroek & Joost M. E. Pennings & Andres Trujillo‐Barrera, 2022. "Intraday liquidity in soybean complex futures markets," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 42(7), pages 1189-1211, July.
    3. Thorsten M. Egelkraut & Philip Garcia & Bruce J. Sherrick, 2007. "The Term Structure of Implied Forward Volatility: Recovery and Informational Content in the Corn Options Market," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 89(1), pages 1-11.
    4. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey & James Robins, 2018. "Double/debiased machine learning for treatment and structural parameters," Econometrics Journal, Royal Economic Society, vol. 21(1), pages 1-68, February.
    5. Zeileis, Achim & Leisch, Friedrich & Hornik, Kurt & Kleiber, Christian, 2002. "strucchange: An R Package for Testing for Structural Change in Linear Regression Models," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 7(i02).
    6. Smyl, Slawek, 2020. "A hybrid method of exponential smoothing and recurrent neural networks for time series forecasting," International Journal of Forecasting, Elsevier, vol. 36(1), pages 75-85.
    7. Bojer, Casper Solheim & Meldgaard, Jens Peder, 2021. "Kaggle forecasting competitions: An overlooked learning opportunity," International Journal of Forecasting, Elsevier, vol. 37(2), pages 587-603.
    8. Sendhil Mullainathan & Jann Spiess, 2017. "Machine Learning: An Applied Econometric Approach," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 87-106, Spring.
    9. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2022. "M5 accuracy competition: Results, findings, and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1346-1364.
    10. Zeileis, Achim & Kleiber, Christian & Kramer, Walter & Hornik, Kurt, 2003. "Testing and dating of structural changes in practice," Computational Statistics & Data Analysis, Elsevier, vol. 44(1-2), pages 109-123, October.
    11. Bradley Efron, 2020. "Prediction, Estimation, and Attribution," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(530), pages 636-655, April.
    12. Kwiatkowski, Denis & Phillips, Peter C. B. & Schmidt, Peter & Shin, Yongcheol, 1992. "Testing the null hypothesis of stationarity against the alternative of a unit root : How sure are we that economic time series have a unit root?," Journal of Econometrics, Elsevier, vol. 54(1-3), pages 159-178.
    13. Dong Hee Suh & Charles B. Moss, 2017. "Decompositions of corn price effects: implications for feed grain demand and livestock supply," Agricultural Economics, International Association of Agricultural Economists, vol. 48(4), pages 491-500, July.
    14. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey, 2017. "Double/Debiased/Neyman Machine Learning of Treatment Effects," American Economic Review, American Economic Association, vol. 107(5), pages 261-265, May.
    15. Capistrán, Carlos & Timmermann, Allan, 2009. "Forecast Combination With Entry and Exit of Experts," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
    16. Hyndman, Rob J., 2020. "A brief history of forecasting competitions," International Journal of Forecasting, Elsevier, vol. 36(1), pages 7-14.
    17. Andres Trujillo-Barrera & Philip Garcia & Mindy L. Mallory, 2016. "Price Density Forecasts in the U.S. Hog Markets: Composite Procedures," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 98(5), pages 1529-1544.
    18. Wallace E. Tyner, 2010. "The integration of energy and agricultural markets," Agricultural Economics, International Association of Agricultural Economists, vol. 41(s1), pages 193-201, November.
    19. Linwood A. Hoffman & Xiaoli L. Etienne & Scott H. Irwin & Evelyn V. Colino & Jose I. Toasa, 2015. "Forecast performance of WASDE price projections for U.S. corn," Agricultural Economics, International Association of Agricultural Economists, vol. 46(S1), pages 157-171, November.
    20. Bradley Efron, 2020. "Prediction, Estimation, and Attribution," International Statistical Review, International Statistical Institute, vol. 88(S1), pages 28-59, December.
    21. Jon A. Brandt & David A. Bessler, 1981. "Composite Forecasting: An Application with U.S. Hog Prices," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 63(1), pages 135-140.
    22. Evelyn V. Colino & Scott H. Irwin & Philip Garcia, 2011. "Improving the accuracy of outlook price forecasts," Agricultural Economics, International Association of Agricultural Economists, vol. 42(3), pages 357-371, May.
    23. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey & James Robins, 2016. "Double/Debiased Machine Learning for Treatment and Causal Parameters," Papers 1608.00060, arXiv.org, revised Dec 2017.
    24. Evelyn V. Colino & Scott H. Irwin, 2010. "Outlook vs. Futures: Three Decades of Evidence in Hog and Cattle Markets," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 92(1), pages 1-15.
    25. Andreasson, Pierre & Bekiros, Stelios & Nguyen, Duc Khuong & Uddin, Gazi Salah, 2016. "Impact of speculation and economic uncertainty on commodity markets," International Review of Financial Analysis, Elsevier, vol. 43(C), pages 115-127.
    26. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    27. Xiaojie Xu, 2020. "Corn Cash Price Forecasting," American Journal of Agricultural Economics, John Wiley & Sons, vol. 102(4), pages 1297-1320, August.
    28. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    29. Colin A. Carter & Sandeep Mohapatra, 2008. "How Reliable Are Hog Futures as Forecasts?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 90(2), pages 367-378.
    30. Brooks, Chris & Prokopczuk, Marcel & Wu, Yingying, 2013. "Commodity futures prices: More evidence on forecast power, risk premia and the theory of storage," The Quarterly Review of Economics and Finance, Elsevier, vol. 53(1), pages 73-85.
    31. Hugo Storm & Kathy Baylis & Thomas Heckelei, 2020. "Machine learning in agricultural and applied economics," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 47(3), pages 849-892.
    32. Hewamalage, Hansika & Bergmeir, Christoph & Bandara, Kasun, 2021. "Recurrent Neural Networks for Time Series Forecasting: Current status and future directions," International Journal of Forecasting, Elsevier, vol. 37(1), pages 388-427.
    33. Johansen, Soren, 1995. "Likelihood-Based Inference in Cointegrated Vector Autoregressive Models," OUP Catalogue, Oxford University Press, number 9780198774501, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xiaojie Xu, 2020. "Corn Cash Price Forecasting," American Journal of Agricultural Economics, John Wiley & Sons, vol. 102(4), pages 1297-1320, August.
    2. Wellens, Arnoud P. & Boute, Robert N. & Udenio, Maximiliano, 2024. "Simplifying tree-based methods for retail sales forecasting with explanatory variables," European Journal of Operational Research, Elsevier, vol. 314(2), pages 523-539.
    3. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    4. Delprato, Marcos & Frola, Alessia & Antequera, Germán, 2022. "Indigenous and non-Indigenous proficiency gaps for out-of-school and in-school populations: A machine learning approach," International Journal of Educational Development, Elsevier, vol. 93(C).
    5. Madadkhani, Shiva & Ikonnikova, Svetlana, 2024. "Toward high-resolution projection of electricity prices: A machine learning approach to quantifying the effects of high fuel and CO2 prices," Energy Economics, Elsevier, vol. 129(C).
    6. Godahewa, Rakshitha & Bergmeir, Christoph & Webb, Geoffrey I. & Montero-Manso, Pablo, 2023. "An accurate and fully-automated ensemble model for weekly time series forecasting," International Journal of Forecasting, Elsevier, vol. 39(2), pages 641-658.
    7. Li, Li & Kang, Yanfei & Li, Feng, 2023. "Bayesian forecast combination using time-varying features," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1287-1302.
    8. Songul Cinaroglu, 2020. "Modelling unbalanced catastrophic health expenditure data by using machine‐learning methods," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 27(4), pages 168-181, October.
    9. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios & Chen, Zhi & Gaba, Anil & Tsetlin, Ilia & Winkler, Robert L., 2022. "The M5 uncertainty competition: Results, findings and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1365-1385.
    10. Falco J. Bargagli Stoffi & Kenneth De Beckker & Joana E. Maldonado & Kristof De Witte, 2021. "Assessing Sensitivity of Machine Learning Predictions.A Novel Toolbox with an Application to Financial Literacy," Papers 2102.04382, arXiv.org.
    11. Athey, Susan & Imbens, Guido W. & Metzger, Jonas & Munro, Evan, 2024. "Using Wasserstein Generative Adversarial Networks for the design of Monte Carlo simulations," Journal of Econometrics, Elsevier, vol. 240(2).
    12. Rajapaksha, Dilini & Bergmeir, Christoph & Hyndman, Rob J., 2023. "LoMEF: A framework to produce local explanations for global model time series forecasts," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1424-1447.
    13. Monica Andini & Emanuele Ciani & Guido de Blasio & Alessio D'Ignazio & Viola Salvestrini, 2017. "Targeting policy-compliers with machine learning: an application to a tax rebate programme in Italy," Temi di discussione (Economic working papers) 1158, Bank of Italy, Economic Research and International Relations Area.
    14. Francesco Decarolis & Cristina Giorgiantonio, 2020. "Corruption red flags in public procurement: new evidence from Italian calls for tenders," Questioni di Economia e Finanza (Occasional Papers) 544, Bank of Italy, Economic Research and International Relations Area.
    15. Hoang, Daniel & Wiegratz, Kevin, 2022. "Machine learning methods in finance: Recent applications and prospects," Working Paper Series in Economics 158, Karlsruhe Institute of Technology (KIT), Department of Economics and Management.
    16. Xiaojie Xu, 2017. "Short-run price forecast performance of individual and composite models for 496 corn cash markets," Journal of Applied Statistics, Taylor & Francis Journals, vol. 44(14), pages 2593-2620, October.
    17. Kang, Yanfei & Spiliotis, Evangelos & Petropoulos, Fotios & Athiniotis, Nikolaos & Li, Feng & Assimakopoulos, Vassilios, 2021. "Déjà vu: A data-centric forecasting approach through time series cross-similarity," Journal of Business Research, Elsevier, vol. 132(C), pages 719-731.
    18. Helmut Wasserbacher & Martin Spindler, 2022. "Machine learning for financial forecasting, planning and analysis: recent developments and pitfalls," Digital Finance, Springer, vol. 4(1), pages 63-88, March.
    19. Lars Lien Ankile & Kjartan Krange, 2022. "Deep Learning and Linear Programming for Automated Ensemble Forecasting and Interpretation," Papers 2201.00426, arXiv.org, revised Nov 2022.
    20. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2022. "M5 accuracy competition: Results, findings, and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1346-1364.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:agecon:v:55:y:2024:i:3:p:479-497. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/iaaeeea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.