IDEAS home Printed from https://ideas.repec.org/p/fip/fedpwp/02-3.html
   My bibliography  Save this paper

Is macroeconomic research robust to alternative data sets?

Author

Listed:
  • Dean Croushore
  • Tom Stark

Abstract

This paper uses a real-time data set to analyze data revisions and to test the robustness of published econometric results. The data set consists of vintages, or snapshots, of the major macroeconomic data available at quarterly intervals in real time. The paper illustrates why such data may matter, examines the properties of several of the variables in the data set across vintages, and examines key empirical papers in macroeconomics, investigating their robustness to different vintages.

Suggested Citation

  • Dean Croushore & Tom Stark, 2002. "Is macroeconomic research robust to alternative data sets?," Working Papers 02-3, Federal Reserve Bank of Philadelphia.
    • Handle: RePEc:fip:fedpwp:02-3
    as

    Download full text from publisher

    File URL: https://www.philadelphiafed.org/-/media/frbp/assets/working-papers/2002/wp02-3.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Blanchard, Olivier Jean & Quah, Danny, 1989. "The Dynamic Effects of Aggregate Demand and Supply Disturbances," American Economic Review, American Economic Association, vol. 79(4), pages 655-673, September.
    2. Hall, Robert E, 1978. "Stochastic Implications of the Life Cycle-Permanent Income Hypothesis: Theory and Evidence," Journal of Political Economy, University of Chicago Press, vol. 86(6), pages 971-987, December.
    3. Evan F. Koenig & Sheila Dolmas & Jeremy Piger, 2003. "The Use and Abuse of Real-Time Data in Economic Forecasting," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 618-628, August.
    4. Glenn D. Rudebusch, 2001. "Is The Fed Too Timid? Monetary Policy In An Uncertain World," The Review of Economics and Statistics, MIT Press, vol. 83(2), pages 203-217, May.
    5. Maravall, Agustin & Pierce, David A, 1986. "The Transmission of Data Noise into Policy Noise in U.S. Monetary Control," Econometrica, Econometric Society, vol. 54(4), pages 961-979, July.
    6. Athanasios Orphanides, 2001. "Monetary Policy Rules Based on Real-Time Data," American Economic Review, American Economic Association, vol. 91(4), pages 964-985, September.
    7. Swanson Norman, 1996. "Forecasting Using First-Available Versus Fully Revised Economic Time-Series Data," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 1(1), pages 1-20, April.
    8. Dewald, William G & Thursby, Jerry G & Anderson, Richard G, 1986. "Replication in Empirical Economics: The Journal of Money, Credit and Banking Project," American Economic Review, American Economic Association, vol. 76(4), pages 587-603, September.
    9. Bernanke, Ben S. & Boivin, Jean, 2003. "Monetary policy in a data-rich environment," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 525-546, April.
    10. Rosanne Cole, 1969. "Data Errors and Forecasting Accuracy," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 47-82, National Bureau of Economic Research, Inc.
    11. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    12. Finn E. Kydland & Edward C. Prescott, 1990. "Business cycles: real facts and a monetary myth," Quarterly Review, Federal Reserve Bank of Minneapolis, vol. 14(Spr), pages 3-18.
    13. Flavin, Marjorie A, 1981. "The Adjustment of Consumption to Changing Expectations about Future Income," Journal of Political Economy, University of Chicago Press, vol. 89(5), pages 974-1009, October.
    14. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
    15. David E. Runkle, 1998. "Revisionist history: how data revisions distort economic policy research," Quarterly Review, Federal Reserve Bank of Minneapolis, vol. 22(Fall), pages 3-12.
    16. Mork, Knut Anton, 1987. "Ain't Behavin': Forecast Errors and Measurement Errors in Early GNP Estimates," Journal of Business & Economic Statistics, American Statistical Association, vol. 5(2), pages 165-175, April.
    17. Stark, Tom & Croushore, Dean, 2002. "Forecasting with a real-time data set for macroeconomists," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 507-531, December.
    18. Eric Ghysels & Norman R. Swanson & Myles Callan, 2002. "Monetary Policy Rules with Model and Data Uncertainty," Southern Economic Journal, John Wiley & Sons, vol. 69(2), pages 239-265, October.
    19. N. Gregory Mankiw & Matthew D. Shapiro, 1986. "News or Noise? An Analysis of GNP Revisions," NBER Working Papers 1939, National Bureau of Economic Research, Inc.
    20. Howrey, E Philip, 1978. "The Use of Preliminary Data in Econometric Forecasting," The Review of Economics and Statistics, MIT Press, vol. 60(2), pages 193-200, May.
    21. Norman R. Swanson & Jeffery D. Amato, 2000. "The real-time predictive content of money for output," BIS Working Papers 96, Bank for International Settlements.
    22. Francis X. Diebold & Glenn D. Rudebusch, 1989. "Forecasting output with the composite leading index: an ex ante analysis," Finance and Economics Discussion Series 90, Board of Governors of the Federal Reserve System (U.S.).
    23. Pierre-Daniel G. Sarte, 1997. "On the identification of structural vector autoregressions," Economic Quarterly, Federal Reserve Bank of Richmond, issue Sum, pages 45-68.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hillinger Claude, 2003. "The Money Metric, Price and Quantity Aggregation and Welfare Measurement," The B.E. Journal of Macroeconomics, De Gruyter, vol. 3(1), pages 1-36, July.
    2. Fuhrer, Jeff & Tootell, Geoff, 2008. "Eyes on the prize: How did the fed respond to the stock market?," Journal of Monetary Economics, Elsevier, vol. 55(4), pages 796-805, May.
    3. Andrew C. Chang & Phillip Li, 2018. "Measurement Error In Macroeconomic Data And Economics Research: Data Revisions, Gross Domestic Product, And Gross Domestic Income," Economic Inquiry, Western Economic Association International, vol. 56(3), pages 1846-1869, July.
    4. Döhrn, Roland, 2018. "Revisionen der Volkswirtschaftlichen Gesamtrechnungen: Revisionspraxis des Statistischen Bundesamtes und ihre Auswirkungen auf Prognosen," RWI Materialien 127, RWI - Leibniz-Institut für Wirtschaftsforschung.
    5. Liebermann, Joelle, 2012. "Real-time forecasting in a data-rich environment," MPRA Paper 39452, University Library of Munich, Germany.
    6. Anthony M. Santomero, 2005. "Making monetary policy: what do we know and when do we know it?," Business Review, Federal Reserve Bank of Philadelphia, issue Q4, pages 1-8.
    7. Roland Döhrn, 2019. "Revisionen der Volkswirtschaftlichen Gesamtrechnungen und ihre Auswirkungen auf Prognosen [Revisions of national accounts data and their impact on forecasts]," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 13(2), pages 99-123, September.
    8. Gloria Lucía Bernal Nisperuza & Johanna Táutiva Pradere, 2011. "Datos en tiempo real:una aplicación a la regla de taylor en Colombia," Revista de Economía Institucional, Universidad Externado de Colombia - Facultad de Economía, vol. 13(24), pages 373-394, January-J.
    9. Gerberding, Christina & Worms, Andreas & Seitz, Franz, 2004. "How the Bundesbank really conducted monetary policy: An analysis based on real-time data," Discussion Paper Series 1: Economic Studies 2004,25, Deutsche Bundesbank.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
    2. Dean Croushore, 2011. "Frontiers of Real-Time Data Analysis," Journal of Economic Literature, American Economic Association, vol. 49(1), pages 72-100, March.
    3. Dean Croushore & Tom Stark, 2000. "A real-time data set for macroeconomists: does data vintage matter for forecasting?," Working Papers 00-6, Federal Reserve Bank of Philadelphia.
    4. Dean Croushore & Tom Stark, 2003. "A Real-Time Data Set for Macroeconomists: Does the Data Vintage Matter?," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 605-617, August.
    5. Croushore, Dean & Evans, Charles L., 2006. "Data revisions and the identification of monetary policy shocks," Journal of Monetary Economics, Elsevier, vol. 53(6), pages 1135-1160, September.
    6. Clements, Michael P. & Beatriz Galvão, Ana, 2010. "First announcements and real economic activity," European Economic Review, Elsevier, vol. 54(6), pages 803-817, August.
    7. Denis Shibitov & Mariam Mamedli, 2021. "Forecasting Russian Cpi With Data Vintages And Machine Learning Techniques," Bank of Russia Working Paper Series wps70, Bank of Russia.
    8. Garratt, Anthony & Koop, Gary & Mise, Emi & Vahey, Shaun P., 2009. "Real-Time Prediction With U.K. Monetary Aggregates in the Presence of Model Uncertainty," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 480-491.
    9. Clements Michael P., 2012. "Forecasting U.S. Output Growth with Non-Linear Models in the Presence of Data Uncertainty," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 16(1), pages 1-27, January.
    10. Stark, Tom & Croushore, Dean, 2002. "Forecasting with a real-time data set for macroeconomists," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 507-531, December.
    11. Gregory E. Givens, 2017. "Do Data Revisions Matter for DSGE Estimation?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 49(6), pages 1385-1407, September.
    12. Christoffersen, Peter & Ghysels, Eric & Swanson, Norman R., 2002. "Let's get "real" about using economic data," Journal of Empirical Finance, Elsevier, vol. 9(3), pages 343-360, August.
    13. Clements, Michael P. & Beatriz Galvao, Ana, 2010. "Real-time Forecasting of Inflation and Output Growth in the Presence of Data Revisions," Economic Research Papers 270771, University of Warwick - Department of Economics.
    14. Faust, Jon & Rogers, John H & Wright, Jonathan H, 2005. "News and Noise in G-7 GDP Announcements," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 403-419, June.
    15. Emilia Tomczyk, 2013. "End of sample vs. real time data: perspectives for analysis of expectations," Working Papers 68, Department of Applied Econometrics, Warsaw School of Economics.
    16. Andrew C. Chang & Phillip Li, 2018. "Measurement Error In Macroeconomic Data And Economics Research: Data Revisions, Gross Domestic Product, And Gross Domestic Income," Economic Inquiry, Western Economic Association International, vol. 56(3), pages 1846-1869, July.
    17. Nikolsko-Rzhevskyy, Alex, 2008. "Monetary Policy Evaluation in Real Time: Forward-Looking Taylor Rules Without Forward-Looking Data," MPRA Paper 11352, University Library of Munich, Germany.
    18. Thomas A. Knetsch & Hans‐Eggert Reimers, 2009. "Dealing with Benchmark Revisions in Real‐Time Data: The Case of German Production and Orders Statistics," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(2), pages 209-235, April.
    19. Richard G. Anderson, 2006. "Replicability, real-time data, and the science of economic research: FRED, ALFRED, and VDC," Review, Federal Reserve Bank of St. Louis, vol. 88(Jan), pages 81-93.
    20. Jacobs, Jan P.A.M. & van Norden, Simon, 2011. "Modeling data revisions: Measurement error and dynamics of "true" values," Journal of Econometrics, Elsevier, vol. 161(2), pages 101-109, April.

    More about this item

    Keywords

    Macroeconomics;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedpwp:02-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Beth Paul (email available below). General contact details of provider: https://edirc.repec.org/data/frbphus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.