IDEAS home Printed from https://ideas.repec.org/a/eee/agisys/v168y2019icp203-212.html
   My bibliography  Save this article

Performance of the MARS-crop yield forecasting system for the European Union: Assessing accuracy, in-season, and year-to-year improvements from 1993 to 2015

Author

Listed:
  • van der Velde, M.
  • Nisini, L.

Abstract

19,980 crop yield forecasts have been published for the European Union (EU) Member States (MS) during 1993–2015 using the MARS-Crop Yield Forecasting System (MCYFS). We assess the performance of these forecasts for soft wheat, durum wheat, grain maize, rapeseed, sunflower, potato and sugar beet, and sought to answer three questions. First, how good has the system performed? This was investigated by calculating several accuracy indicators (e.g. the mean absolute percentage error, MAPE) for the first forecasts during a season, forecasts one month pre-harvest, and the end-of-campaign (EOC) forecasts during 2006–2015 using reported yields. Second, do forecasts improve during the season? This was evaluated by comparing the accuracy of the first, the pre-harvest, and the EOC forecasts. Third, have forecasts systematically improved year-to-year? This was quantified by testing whether linear models fitted to the median of the national level absolute relative forecast errors for each crop at EU-12 (EU-27) level from 1993 to 2015 (2006–2015) were characterized by significant negative slopes. Encouragingly, the lowest median MAPE across all crops is obtained for Europe's largest producer, France, equalling 3.73%. Similarly, the highest median MAPE is obtained for Portugal, at 14.37%. Forecasts generally underestimated reported yields, with a systematic underestimation across all MS for soft wheat, rapeseed and sugar beet forecasts. Forecasts generally improve during the growing season; both the forecast error and its variability tend to progressively decrease. This is the case for the cereals, and to a lesser extent for the tuber crops, while seasonal forecast improvements are lower for the oilseed crops. The median EU-12 yield forecasts for rapeseed, potato and sugar beet have significantly (p-value < 0.05) improved from 1993 to 2015. No evidence was found for improvements for the other crops, neither was there any significant improvement in any of the crop forecasts from 2006 to 2015, evaluated at EU-27 level. In the early years of the MCYFS, most of the yield time series were characterized by strong trends; nowadays yield growth has slowed or even plateaued in several MS. In addition, an increased volatility in yield statistics is observed, and while crop yield forecasts tend to improve in a given year, in recent years, there is no evidence of structural improvements that carry-over from year-to-year. This underlines that renewed efforts to improve operational crop yield forecasting are needed, especially in the light of the increasingly variable and occasionally unprecedented climatic conditions impacting the EU's crop production systems.

Suggested Citation

  • van der Velde, M. & Nisini, L., 2019. "Performance of the MARS-crop yield forecasting system for the European Union: Assessing accuracy, in-season, and year-to-year improvements from 1993 to 2015," Agricultural Systems, Elsevier, vol. 168(C), pages 203-212.
    • Handle: RePEc:eee:agisys:v:168:y:2019:i:c:p:203-212
    DOI: 10.1016/j.agsy.2018.06.009
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0308521X18300179
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.agsy.2018.06.009?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Balkovič, Juraj & van der Velde, Marijn & Schmid, Erwin & Skalský, Rastislav & Khabarov, Nikolay & Obersteiner, Michael & Stürmer, Bernhard & Xiong, Wei, 2013. "Pan-European crop modelling with EPIC: Implementation, up-scaling and regional crop yield validation," Agricultural Systems, Elsevier, vol. 120(C), pages 61-75.
    2. Patricio Grassini & Kent M. Eskridge & Kenneth G. Cassman, 2013. "Distinguishing between yield advances and yield plateaus in historical crop production trends," Nature Communications, Nature, vol. 4(1), pages 1-11, December.
    3. van der Velde, Marijn & Biavetti, Irene & El-Aydam, Mohamed & Niemeyer, Stefan & Santini, Fabien & van den Berg, Maurits, 2019. "Use and relevance of European Union crop monitoring and yield forecasts," Agricultural Systems, Elsevier, vol. 168(C), pages 224-230.
    4. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    5. Jig Han Jeong & Jonathan P Resop & Nathaniel D Mueller & David H Fleisher & Kyungdahm Yun & Ethan E Butler & Dennis J Timlin & Kyo-Moon Shim & James S Gerber & Vangimalla R Reddy & Soo-Hyung Kim, 2016. "Random Forests for Global and Regional Crop Yield Predictions," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-15, June.
    6. Christian Folberth & Rastislav Skalský & Elena Moltchanova & Juraj Balkovič & Ligia B. Azevedo & Michael Obersteiner & Marijn van der Velde, 2016. "Uncertainty in soil data can outweigh climate impact signals in global crop yield simulations," Nature Communications, Nature, vol. 7(1), pages 1-13, September.
    7. Bussay, Attila & van der Velde, Marijn & Fumagalli, Davide & Seguini, Lorenzo, 2015. "Improving operational maize yield forecasting in Hungary," Agricultural Systems, Elsevier, vol. 141(C), pages 94-106.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Paudel, Dilli & Boogaard, Hendrik & de Wit, Allard & Janssen, Sander & Osinga, Sjoukje & Pylianidis, Christos & Athanasiadis, Ioannis N., 2021. "Machine learning for large-scale crop yield forecasting," Agricultural Systems, Elsevier, vol. 187(C).
    2. Kaur, Harsimran & Huggins, David R. & Carlson, Bryan & Stockle, Claudio & Nelson, Roger, 2022. "Dryland fallow vs flex-cropping decisions in inland Pacific Northwest of USA," Agricultural Systems, Elsevier, vol. 201(C).
    3. Lin Liu & Bruno Basso, 2020. "Linking field survey with crop modeling to forecast maize yield in smallholder farmers’ fields in Tanzania," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 12(3), pages 537-548, June.
    4. Bregaglio, Simone & Ginaldi, Fabrizio & Raparelli, Elisabetta & Fila, Gianni & Bajocco, Sofia, 2023. "Improving crop yield prediction accuracy by embedding phenological heterogeneity into model parameter sets," Agricultural Systems, Elsevier, vol. 209(C).
    5. Igor Atamanyuk & Valerii Havrysh & Vitalii Nitsenko & Oleksii Diachenko & Mariia Tepliuk & Tetiana Chebakova & Hanna Trofimova, 2022. "Forecasting of Winter Wheat Yield: A Mathematical Model and Field Experiments," Agriculture, MDPI, vol. 13(1), pages 1-22, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Amirhossein Hassani & Adisa Azapagic & Nima Shokri, 2021. "Global predictions of primary soil salinization under changing climate in the 21st century," Nature Communications, Nature, vol. 12(1), pages 1-17, December.
    2. van Zelm, Rosalie & van der Velde, Marijn & Balkovic, Juraj & Čengić, Mirza & Elshout, Pieter M.F. & Koellner, Thomas & Núñez, Montserrat & Obersteiner, Michael & Schmid, Erwin & Huijbregts, Mark A.J., 2018. "Spatially explicit life cycle impact assessment for soil erosion from global crop production," Ecosystem Services, Elsevier, vol. 30(PB), pages 220-227.
    3. Paudel, Dilli & Boogaard, Hendrik & de Wit, Allard & Janssen, Sander & Osinga, Sjoukje & Pylianidis, Christos & Athanasiadis, Ioannis N., 2021. "Machine learning for large-scale crop yield forecasting," Agricultural Systems, Elsevier, vol. 187(C).
    4. Stefan Hochrainer-Stigler & Juraj Balkovič & Kadri Silm & Anna Timonina-Farkas, 2019. "Large scale extreme risk assessment using copulas: an application to drought events under climate change for Austria," Computational Management Science, Springer, vol. 16(4), pages 651-669, October.
    5. repec:prg:jnlcfu:v:2022:y:2022:i:1:id:572 is not listed on IDEAS
    6. Chang, Andrew C. & Hanson, Tyler J., 2016. "The accuracy of forecasts prepared for the Federal Open Market Committee," Journal of Economics and Business, Elsevier, vol. 83(C), pages 23-43.
    7. Frank, Johannes, 2023. "Forecasting realized volatility in turbulent times using temporal fusion transformers," FAU Discussion Papers in Economics 03/2023, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
    8. Kourentzes, Nikolaos & Petropoulos, Fotios & Trapero, Juan R., 2014. "Improving forecasting by estimating time series structural components across multiple frequencies," International Journal of Forecasting, Elsevier, vol. 30(2), pages 291-302.
    9. Paulo Júlio & Pedro M. Esperança, 2012. "Evaluating the forecast quality of GDP components: An application to G7," GEE Papers 0047, Gabinete de Estratégia e Estudos, Ministério da Economia, revised Apr 2012.
    10. Cameron Roach & Rob Hyndman & Souhaib Ben Taieb, 2021. "Non‐linear mixed‐effects models for time series forecasting of smart meter demand," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(6), pages 1118-1130, September.
    11. Alysha M De Livera, 2010. "Automatic forecasting with a modified exponential smoothing state space framework," Monash Econometrics and Business Statistics Working Papers 10/10, Monash University, Department of Econometrics and Business Statistics.
    12. Zhongen Niu & Huimin Yan & Fang Liu, 2020. "Decreasing Cropping Intensity Dominated the Negative Trend of Cropland Productivity in Southern China in 2000–2015," Sustainability, MDPI, vol. 12(23), pages 1-14, December.
    13. Nikitopoulos, Christina Sklibosios & Thomas, Alice Carole & Wang, Jianxin, 2023. "The economic impact of daily volatility persistence on energy markets," Journal of Commodity Markets, Elsevier, vol. 30(C).
    14. I. Yu. Zolotova & V. V. Dvorkin, 2017. "Short-term forecasting of prices for the Russian wholesale electricity market based on neural networks," Studies on Russian Economic Development, Springer, vol. 28(6), pages 608-615, November.
    15. Döpke, Jörg & Fritsche, Ulrich & Müller, Karsten, 2019. "Has macroeconomic forecasting changed after the Great Recession? Panel-based evidence on forecast accuracy and forecaster behavior from Germany," Journal of Macroeconomics, Elsevier, vol. 62(C).
    16. Thiyanga S. Talagala & Feng Li & Yanfei Kang, 2019. "Feature-based Forecast-Model Performance Prediction," Monash Econometrics and Business Statistics Working Papers 21/19, Monash University, Department of Econometrics and Business Statistics.
    17. Martin Guth, 2022. "Predicting Default Probabilities for Stress Tests: A Comparison of Models," Papers 2202.03110, arXiv.org.
    18. Santamaría-Bonfil, G. & Reyes-Ballesteros, A. & Gershenson, C., 2016. "Wind speed forecasting for wind farms: A method based on support vector regression," Renewable Energy, Elsevier, vol. 85(C), pages 790-809.
    19. Meira, Erick & Cyrino Oliveira, Fernando Luiz & de Menezes, Lilian M., 2022. "Forecasting natural gas consumption using Bagging and modified regularization techniques," Energy Economics, Elsevier, vol. 106(C).
    20. Wasilewski, J. & Baczynski, D., 2017. "Short-term electric energy production forecasting at wind power plants in pareto-optimality context," Renewable and Sustainable Energy Reviews, Elsevier, vol. 69(C), pages 177-187.
    21. Huber, Jakob & Stuckenschmidt, Heiner, 2020. "Daily retail demand forecasting using machine learning with emphasis on calendric special days," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1420-1438.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:agisys:v:168:y:2019:i:c:p:203-212. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/agsy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.