IDEAS home Printed from https://ideas.repec.org/a/wly/ajagec/v105y2023i4p1116-1148.html
   My bibliography  Save this article

The accuracy and informativeness of agricultural baselines

Author

Listed:
  • Siddhartha S. Bora
  • Ani L. Katchova
  • Todd H. Kuethe

Abstract

Agricultural baselines facilitate policy and investment decisions by governments and market participants by providing long‐term projections about the farm sector. Despite their importance in shaping agricultural policy, the agricultural baselines have not been rigorously evaluated. This study evaluates the accuracy and informativeness of two widely used baselines for the US farm sector published by the United States Department of Agriculture (USDA) and the Food and Agricultural Policy Research Institute (FAPRI) in three steps. First, we examine the average percent errors of the projections and perform tests of bias. Second, we use a testing framework based on the encompassing principle to test the predictive content of the projections for each horizon, determining the longest informative projection horizon. Third, we compare the USDA and FAPRI baseline projections using a multi‐horizon framework that considers all projection horizons jointly. We find that prediction error and bias increase with the horizon's length. The predictive content of the baselines projections for most variables diminishes after 4–5 years. The multi‐horizon comparison suggests that neither USDA nor FAPRI projections have uniform or average superior predictive ability over the other for most variables. Our findings are useful for the agencies producing these baselines and for the policymakers, agricultural businesses, and other stakeholders who use them. The study contributes to the recent literature on long‐term agricultural projections and establishes the groundwork for future research inquiries.

Suggested Citation

  • Siddhartha S. Bora & Ani L. Katchova & Todd H. Kuethe, 2023. "The accuracy and informativeness of agricultural baselines," American Journal of Agricultural Economics, John Wiley & Sons, vol. 105(4), pages 1116-1148, August.
  • Handle: RePEc:wly:ajagec:v:105:y:2023:i:4:p:1116-1148
    DOI: 10.1111/ajae.12350
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/ajae.12350
    Download Restriction: no

    File URL: https://libkey.io/10.1111/ajae.12350?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Andrew Patton & Allan Timmermann, 2012. "Forecast Rationality Tests Based on Multi-Horizon Bounds," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 1-17.
    2. John W. Galbraith & Greg Tkacz, 2007. "Forecast content and content horizons for some important macroeconomic time series," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 40(3), pages 935-953, August.
    3. Isiklar, Gultekin & Lahiri, Kajal, 2007. "How far ahead can we forecast? Evidence from cross-country surveys," International Journal of Forecasting, Elsevier, vol. 23(2), pages 167-187.
    4. Holden, K & Peel, D A, 1990. "On Testing for Unbiasedness and Efficiency of Forecasts," The Manchester School of Economic & Social Studies, University of Manchester, vol. 58(2), pages 120-127, June.
    5. Harvey, David I & Leybourne, Stephen J & Newbold, Paul, 1998. "Tests for Forecast Encompassing," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(2), pages 254-259, April.
    6. Westhoff, Pat, 2015. "Price Projections and Farm Bill Program Choices: Adding FAPRI-MU Projections to the Mix," farmdoc daily, University of Illinois at Urbana-Champaign, Department of Agricultural and Consumer Economics, vol. 5, February.
    7. Kuethe, Todd H. & Bora, Siddhartha & Katchova, Ani, 2022. "Improving ERS's Net Cash Income Forecasts using USDA Baseline Projections," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 47(2), May.
    8. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    9. Jacob A. Mincer, 1969. "Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance," NBER Books, National Bureau of Economic Research, Inc, number minc69-1.
    10. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sharma, Vishavdeep & Katchova, Ani, 2024. "Evaluating the Effectiveness and Efficiency of the USDA Farm Income Forecast Revisions," 2024 Annual Meeting, July 28-30, New Orleans, LA 344000, Agricultural and Applied Economics Association.
    2. Fang, Xiaoyi & Katchova, Ani, 2024. "An Evaluation of the Revisions in the OECD-FAO Baseline Projections in the European Union," 2024 Annual Meeting, July 28-30, New Orleans, LA 344007, Agricultural and Applied Economics Association.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jörg Breitung & Malte Knüppel, 2021. "How far can we forecast? Statistical tests of the predictive content," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(4), pages 369-392, June.
    2. Constantin Burgi, 2016. "What Do We Lose When We Average Expectations?," Working Papers 2016-013, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    3. G. Kontogeorgos & K. Lambrias, 2022. "Evaluating the Eurosystem/ECB staff macroeconomic projections: The first 20 years," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(2), pages 213-229, March.
    4. Clark, Todd & McCracken, Michael, 2013. "Advances in Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1107-1201, Elsevier.
    5. Mills, Terence C. & Pepper, Gordon T., 1999. "Assessing the forecasters: an analysis of the forecasting records of the Treasury, the London Business School and the National Institute," International Journal of Forecasting, Elsevier, vol. 15(3), pages 247-257, July.
    6. Kontogeorgos, Georgios & Lambrias, Kyriacos, 2019. "An analysis of the Eurosystem/ECB projections," Working Paper Series 2291, European Central Bank.
    7. Cepni, Oguzhan & Clements, Michael P., 2024. "How local is the local inflation factor? Evidence from emerging European countries," International Journal of Forecasting, Elsevier, vol. 40(1), pages 160-183.
    8. Marc-Oliver Pohle, 2020. "The Murphy Decomposition and the Calibration-Resolution Principle: A New Perspective on Forecast Evaluation," Papers 2005.01835, arXiv.org.
    9. repec:lan:wpaper:413 is not listed on IDEAS
    10. Fildes, Robert & Stekler, Herman, 2002. "The state of macroeconomic forecasting," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 435-468, December.
    11. repec:lan:wpaper:470 is not listed on IDEAS
    12. Clements, Michael P. & Reade, J. James, 2020. "Forecasting and forecast narratives: The Bank of England Inflation Reports," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1488-1500.
    13. Kappler, Marcus, 2007. "Projecting the Medium-Term: Outcomes and Errors for GDP Growth," ZEW Discussion Papers 07-068, ZEW - Leibniz Centre for European Economic Research.
    14. Ullrich Heilemann & Herman Stekler, 2010. "Perspectives on Evaluating Macroeconomic Forecasts," Working Papers 2010-002, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    15. repec:lan:wpaper:425 is not listed on IDEAS
    16. repec:lan:wpaper:539557 is not listed on IDEAS
    17. Goodness C. Aye & Stephen M. Miller & Rangan Gupta & Mehmet Balcilar, 2016. "Forecasting US real private residential fixed investment using a large number of predictors," Empirical Economics, Springer, vol. 51(4), pages 1557-1580, December.
    18. Harvey, David I. & Leybourne, Stephen J. & Whitehouse, Emily J., 2017. "Forecast evaluation tests and negative long-run variance estimates in small samples," International Journal of Forecasting, Elsevier, vol. 33(4), pages 833-847.
    19. Heather L. R. Tierney, 2019. "Forecasting with the Nonparametric Exclusion-from-Core Inflation Persistence Model Using Real-Time Data," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 25(1), pages 39-63, February.
    20. Atsushi Inoue & Lutz Kilian, 2005. "In-Sample or Out-of-Sample Tests of Predictability: Which One Should We Use?," Econometric Reviews, Taylor & Francis Journals, vol. 23(4), pages 371-402.
    21. Philip Rothman & Dick van Dijk & Philip Hans Franses, 1999. "A Multivariate STAR Analysis of the Relationship Between Money and Output," Working Papers 9913, East Carolina University, Department of Economics.
    22. Ali Dib & Mohamed Gammoudi & Kevin Moran, 2008. "Forecasting Canadian time series with the New Keynesian model," Canadian Journal of Economics, Canadian Economics Association, vol. 41(1), pages 138-165, February.
    23. Dovern, Jonas & Jannsen, Nils, 2017. "Systematic errors in growth expectations over the business cycle," International Journal of Forecasting, Elsevier, vol. 33(4), pages 760-769.
    24. Clements, Michael P. & Harvey, David I., 2011. "Combining probability forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 208-223.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:ajagec:v:105:y:2023:i:4:p:1116-1148. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1467-8276 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.