IDEAS home Printed from https://ideas.repec.org/a/eee/agisys/v168y2019icp203-212.html
   My bibliography  Save this article

Performance of the MARS-crop yield forecasting system for the European Union: Assessing accuracy, in-season, and year-to-year improvements from 1993 to 2015

Author

Listed:
  • van der Velde, M.
  • Nisini, L.

Abstract

19,980 crop yield forecasts have been published for the European Union (EU) Member States (MS) during 1993–2015 using the MARS-Crop Yield Forecasting System (MCYFS). We assess the performance of these forecasts for soft wheat, durum wheat, grain maize, rapeseed, sunflower, potato and sugar beet, and sought to answer three questions. First, how good has the system performed? This was investigated by calculating several accuracy indicators (e.g. the mean absolute percentage error, MAPE) for the first forecasts during a season, forecasts one month pre-harvest, and the end-of-campaign (EOC) forecasts during 2006–2015 using reported yields. Second, do forecasts improve during the season? This was evaluated by comparing the accuracy of the first, the pre-harvest, and the EOC forecasts. Third, have forecasts systematically improved year-to-year? This was quantified by testing whether linear models fitted to the median of the national level absolute relative forecast errors for each crop at EU-12 (EU-27) level from 1993 to 2015 (2006–2015) were characterized by significant negative slopes. Encouragingly, the lowest median MAPE across all crops is obtained for Europe's largest producer, France, equalling 3.73%. Similarly, the highest median MAPE is obtained for Portugal, at 14.37%. Forecasts generally underestimated reported yields, with a systematic underestimation across all MS for soft wheat, rapeseed and sugar beet forecasts. Forecasts generally improve during the growing season; both the forecast error and its variability tend to progressively decrease. This is the case for the cereals, and to a lesser extent for the tuber crops, while seasonal forecast improvements are lower for the oilseed crops. The median EU-12 yield forecasts for rapeseed, potato and sugar beet have significantly (p-value < 0.05) improved from 1993 to 2015. No evidence was found for improvements for the other crops, neither was there any significant improvement in any of the crop forecasts from 2006 to 2015, evaluated at EU-27 level. In the early years of the MCYFS, most of the yield time series were characterized by strong trends; nowadays yield growth has slowed or even plateaued in several MS. In addition, an increased volatility in yield statistics is observed, and while crop yield forecasts tend to improve in a given year, in recent years, there is no evidence of structural improvements that carry-over from year-to-year. This underlines that renewed efforts to improve operational crop yield forecasting are needed, especially in the light of the increasingly variable and occasionally unprecedented climatic conditions impacting the EU's crop production systems.

Suggested Citation

  • van der Velde, M. & Nisini, L., 2019. "Performance of the MARS-crop yield forecasting system for the European Union: Assessing accuracy, in-season, and year-to-year improvements from 1993 to 2015," Agricultural Systems, Elsevier, vol. 168(C), pages 203-212.
    • Handle: RePEc:eee:agisys:v:168:y:2019:i:c:p:203-212
    DOI: 10.1016/j.agsy.2018.06.009
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0308521X18300179
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.agsy.2018.06.009?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Balkovič, Juraj & van der Velde, Marijn & Schmid, Erwin & Skalský, Rastislav & Khabarov, Nikolay & Obersteiner, Michael & Stürmer, Bernhard & Xiong, Wei, 2013. "Pan-European crop modelling with EPIC: Implementation, up-scaling and regional crop yield validation," Agricultural Systems, Elsevier, vol. 120(C), pages 61-75.
    2. Patricio Grassini & Kent M. Eskridge & Kenneth G. Cassman, 2013. "Distinguishing between yield advances and yield plateaus in historical crop production trends," Nature Communications, Nature, vol. 4(1), pages 1-11, December.
    3. van der Velde, Marijn & Biavetti, Irene & El-Aydam, Mohamed & Niemeyer, Stefan & Santini, Fabien & van den Berg, Maurits, 2019. "Use and relevance of European Union crop monitoring and yield forecasts," Agricultural Systems, Elsevier, vol. 168(C), pages 224-230.
    4. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    5. Jig Han Jeong & Jonathan P Resop & Nathaniel D Mueller & David H Fleisher & Kyungdahm Yun & Ethan E Butler & Dennis J Timlin & Kyo-Moon Shim & James S Gerber & Vangimalla R Reddy & Soo-Hyung Kim, 2016. "Random Forests for Global and Regional Crop Yield Predictions," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-15, June.
    6. Christian Folberth & Rastislav Skalský & Elena Moltchanova & Juraj Balkovič & Ligia B. Azevedo & Michael Obersteiner & Marijn van der Velde, 2016. "Uncertainty in soil data can outweigh climate impact signals in global crop yield simulations," Nature Communications, Nature, vol. 7(1), pages 1-13, September.
    7. Bussay, Attila & van der Velde, Marijn & Fumagalli, Davide & Seguini, Lorenzo, 2015. "Improving operational maize yield forecasting in Hungary," Agricultural Systems, Elsevier, vol. 141(C), pages 94-106.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Paudel, Dilli & Boogaard, Hendrik & de Wit, Allard & Janssen, Sander & Osinga, Sjoukje & Pylianidis, Christos & Athanasiadis, Ioannis N., 2021. "Machine learning for large-scale crop yield forecasting," Agricultural Systems, Elsevier, vol. 187(C).
    2. Kaur, Harsimran & Huggins, David R. & Carlson, Bryan & Stockle, Claudio & Nelson, Roger, 2022. "Dryland fallow vs flex-cropping decisions in inland Pacific Northwest of USA," Agricultural Systems, Elsevier, vol. 201(C).
    3. Lin Liu & Bruno Basso, 2020. "Linking field survey with crop modeling to forecast maize yield in smallholder farmers’ fields in Tanzania," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 12(3), pages 537-548, June.
    4. Bregaglio, Simone & Ginaldi, Fabrizio & Raparelli, Elisabetta & Fila, Gianni & Bajocco, Sofia, 2023. "Improving crop yield prediction accuracy by embedding phenological heterogeneity into model parameter sets," Agricultural Systems, Elsevier, vol. 209(C).
    5. Igor Atamanyuk & Valerii Havrysh & Vitalii Nitsenko & Oleksii Diachenko & Mariia Tepliuk & Tetiana Chebakova & Hanna Trofimova, 2022. "Forecasting of Winter Wheat Yield: A Mathematical Model and Field Experiments," Agriculture, MDPI, vol. 13(1), pages 1-22, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Amirhossein Hassani & Adisa Azapagic & Nima Shokri, 2021. "Global predictions of primary soil salinization under changing climate in the 21st century," Nature Communications, Nature, vol. 12(1), pages 1-17, December.
    2. van Zelm, Rosalie & van der Velde, Marijn & Balkovic, Juraj & Čengić, Mirza & Elshout, Pieter M.F. & Koellner, Thomas & Núñez, Montserrat & Obersteiner, Michael & Schmid, Erwin & Huijbregts, Mark A.J., 2018. "Spatially explicit life cycle impact assessment for soil erosion from global crop production," Ecosystem Services, Elsevier, vol. 30(PB), pages 220-227.
    3. Paudel, Dilli & Boogaard, Hendrik & de Wit, Allard & Janssen, Sander & Osinga, Sjoukje & Pylianidis, Christos & Athanasiadis, Ioannis N., 2021. "Machine learning for large-scale crop yield forecasting," Agricultural Systems, Elsevier, vol. 187(C).
    4. Stefan Hochrainer-Stigler & Juraj Balkovič & Kadri Silm & Anna Timonina-Farkas, 2019. "Large scale extreme risk assessment using copulas: an application to drought events under climate change for Austria," Computational Management Science, Springer, vol. 16(4), pages 651-669, October.
    5. repec:prg:jnlcfu:v:2022:y:2022:i:1:id:572 is not listed on IDEAS
    6. Chang, Andrew C. & Hanson, Tyler J., 2016. "The accuracy of forecasts prepared for the Federal Open Market Committee," Journal of Economics and Business, Elsevier, vol. 83(C), pages 23-43.
    7. Ling Tang & Chengyuan Zhang & Tingfei Li & Ling Li, 2021. "A novel BEMD-based method for forecasting tourist volume with search engine data," Tourism Economics, , vol. 27(5), pages 1015-1038, August.
    8. Hewamalage, Hansika & Bergmeir, Christoph & Bandara, Kasun, 2021. "Recurrent Neural Networks for Time Series Forecasting: Current status and future directions," International Journal of Forecasting, Elsevier, vol. 37(1), pages 388-427.
    9. Michael Vössing & Niklas Kühl & Matteo Lind & Gerhard Satzger, 2022. "Designing Transparency for Effective Human-AI Collaboration," Information Systems Frontiers, Springer, vol. 24(3), pages 877-895, June.
    10. Frank, Johannes, 2023. "Forecasting realized volatility in turbulent times using temporal fusion transformers," FAU Discussion Papers in Economics 03/2023, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
    11. Kourentzes, Nikolaos & Petropoulos, Fotios & Trapero, Juan R., 2014. "Improving forecasting by estimating time series structural components across multiple frequencies," International Journal of Forecasting, Elsevier, vol. 30(2), pages 291-302.
    12. Jeon, Yunho & Seong, Sihyeon, 2022. "Robust recurrent network model for intermittent time-series forecasting," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1415-1425.
    13. Snyder, Ralph D. & Ord, J. Keith & Koehler, Anne B. & McLaren, Keith R. & Beaumont, Adrian N., 2017. "Forecasting compositional time series: A state space approach," International Journal of Forecasting, Elsevier, vol. 33(2), pages 502-512.
    14. Paulo Júlio & Pedro M. Esperança, 2012. "Evaluating the forecast quality of GDP components: An application to G7," GEE Papers 0047, Gabinete de Estratégia e Estudos, Ministério da Economia, revised Apr 2012.
    15. Rivera, Nilza & Guzmán, Juan Ignacio & Jara, José Joaquín & Lagos, Gustavo, 2021. "Evaluation of econometric models of secondary refined copper supply," Resources Policy, Elsevier, vol. 73(C).
    16. Cameron Roach & Rob Hyndman & Souhaib Ben Taieb, 2021. "Non‐linear mixed‐effects models for time series forecasting of smart meter demand," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(6), pages 1118-1130, September.
    17. Massimo Guidolin & Manuela Pedio, 2019. "Forecasting and Trading Monetary Policy Effects on the Riskless Yield Curve with Regime Switching Nelson†Siegel Models," Working Papers 639, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    18. Alysha M De Livera, 2010. "Automatic forecasting with a modified exponential smoothing state space framework," Monash Econometrics and Business Statistics Working Papers 10/10, Monash University, Department of Econometrics and Business Statistics.
    19. Philippe St-Aubin & Bruno Agard, 2022. "Precision and Reliability of Forecasts Performance Metrics," Forecasting, MDPI, vol. 4(4), pages 1-22, October.
    20. Zhongen Niu & Huimin Yan & Fang Liu, 2020. "Decreasing Cropping Intensity Dominated the Negative Trend of Cropland Productivity in Southern China in 2000–2015," Sustainability, MDPI, vol. 12(23), pages 1-14, December.
    21. Nikitopoulos, Christina Sklibosios & Thomas, Alice Carole & Wang, Jianxin, 2023. "The economic impact of daily volatility persistence on energy markets," Journal of Commodity Markets, Elsevier, vol. 30(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:agisys:v:168:y:2019:i:c:p:203-212. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/agsy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.