IDEAS home Printed from https://ideas.repec.org/a/cup/etheor/v21y2005i01p3-20_05.html
   My bibliography  Save this article

Automated Discovery In Econometrics

Author

Listed:
  • Phillips, Peter C.B.

Abstract

Our subject is the notion of automated discovery in econometrics. Advances in computer power, electronic communication, and data collection processes have all changed the way econometrics is conducted. These advances have helped to elevate the status of empirical research within the economics profession in recent years, and they now open up new possibilities for empirical econometric practice. Of particular significance is the ability to build econometric models in an automated way according to an algorithm of decision rules that allow for (what we call here) heteroskedastic and autocorrelation robust (HAR) inference. Computerized search algorithms may be implemented to seek out suitable models, thousands of regressions and model evaluations may be performed in seconds, statistical inference may be automated according to the properties of the data, and policy decisions can be made and adjusted in real time with the arrival of new data. We discuss some aspects and implications of these exciting, emergent trends in econometrics.The first version of this paper was written in April 2004 for the 20th Anniversary Issue of Econometric Theory. Helpful comments by the co-editor, Oliver Linton, Benno Pötscher, Brendan Beare, and two referees on the first draft are gratefully acknowledged.

Suggested Citation

  • Phillips, Peter C.B., 2005. "Automated Discovery In Econometrics," Econometric Theory, Cambridge University Press, vol. 21(1), pages 3-20, February.
    • Handle: RePEc:cup:etheor:v:21:y:2005:i:01:p:3-20_05
    as

    Download full text from publisher

    File URL: https://www.cambridge.org/core/product/identifier/S0266466605050024/type/journal_article
    File Function: link to article abstract page
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Phillips, Peter C.B., 2005. "Hac Estimation By Automated Regression," Econometric Theory, Cambridge University Press, vol. 21(1), pages 116-142, February.
    2. Linton, Oliver, 2005. "Nonparametric Inference For Unbalanced Time Series Data," Econometric Theory, Cambridge University Press, vol. 21(1), pages 143-157, February.
    3. Kevin D. Hoover & Stephen J. Perez, 1999. "Data mining reconsidered: encompassing and the general-to-specific approach to specification search," Econometrics Journal, Royal Economic Society, vol. 2(2), pages 167-191.
    4. Bauer, Dietmar & Wagner, Martin, 2002. "Estimating cointegrated systems using subspace algorithms," Journal of Econometrics, Elsevier, vol. 111(1), pages 47-84, November.
    5. Donggyu Sul & Peter C. B. Phillips & Chi‐Young Choi, 2005. "Prewhitening Bias in HAC Estimation," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(4), pages 517-546, August.
    6. Lee, Junsoo, 1996. "On the power of stationarity tests using optimal bandwidth estimates," Economics Letters, Elsevier, vol. 51(2), pages 131-137, May.
    7. Kuersteiner, Guido M., 2005. "Automatic Inference For Infinite Order Vector Autoregressions," Econometric Theory, Cambridge University Press, vol. 21(1), pages 85-115, February.
    8. Phillips, Peter C B, 1996. "Econometric Model Determination," Econometrica, Econometric Society, vol. 64(4), pages 763-812, July.
    9. Phillips, P C B, 1991. "Optimal Inference in Cointegrated Systems," Econometrica, Econometric Society, vol. 59(2), pages 283-306, March.
    10. Keuzenkamp,Hugo A., 2000. "Probability, Econometrics and Truth," Cambridge Books, Cambridge University Press, number 9780521553599.
    11. Yongmiao Hong & Jin Lee, 2000. "Wavelet-based Estimation for Heteroskedasticity and Autocorrelation Consistent Variance-Covariance Matrices," Econometric Society World Congress 2000 Contributed Papers 1211, Econometric Society.
    12. Peter C.B. Phillips, 1992. "Bayes Methods for Trending Multiple Time Series with an Empirical Application to the US Economy," Cowles Foundation Discussion Papers 1025, Cowles Foundation for Research in Economics, Yale University.
    13. Leeb, Hannes & Pötscher, Benedikt M., 2008. "Can One Estimate The Unconditional Distribution Of Post-Model-Selection Estimators?," Econometric Theory, Cambridge University Press, vol. 24(2), pages 338-376, April.
    14. Zellner,Arnold, 2004. "Statistics, Econometrics and Forecasting," Cambridge Books, Cambridge University Press, number 9780521832878.
    15. Peter C.B. Phillips, 1995. "Automated Forecasts of Asia-Pacific Economic Activity," Cowles Foundation Discussion Papers 1103, Cowles Foundation for Research in Economics, Yale University.
    16. Phillips, Peter C.B. & Ploberger, Werner, 1994. "Posterior Odds Testing for a Unit Root with Data-Based Model Selection," Econometric Theory, Cambridge University Press, vol. 10(3-4), pages 774-808, August.
    17. David F. Hendry & Hans-Martin Krolzig, 1999. "Improving on 'Data mining reconsidered' by K.D. Hoover and S.J. Perez," Econometrics Journal, Royal Economic Society, vol. 2(2), pages 202-219.
    18. Pesaran, M Hashem & Timmermann, Allan, 2000. "A Recursive Modelling Approach to Predicting UK Stock Returns," Economic Journal, Royal Economic Society, vol. 110(460), pages 159-191, January.
    19. Cartwright,Nancy, 1999. "The Dappled World," Cambridge Books, Cambridge University Press, number 9780521643368.
    20. Pesaran, Hashem & Timmermann, Allan, 2005. "Real-Time Econometrics," Econometric Theory, Cambridge University Press, vol. 21(1), pages 212-231, February.
    21. Pesaran, M Hashem & Timmermann, Allan, 1995. "Predictability of Stock Returns: Robustness and Economic Significance," Journal of Finance, American Finance Association, vol. 50(4), pages 1201-1228, September.
    22. Nicholas M. Kiefer & Timothy J. Vogelsang & Helle Bunzel, 2000. "Simple Robust Testing of Regression Hypotheses," Econometrica, Econometric Society, vol. 68(3), pages 695-714, May.
    23. Zellner,Arnold, 2004. "Statistics, Econometrics and Forecasting," Cambridge Books, Cambridge University Press, number 9780521540445.
    24. Cartwright,Nancy, 1999. "The Dappled World," Cambridge Books, Cambridge University Press, number 9780521644112.
    25. Kiefer, Nicholas M. & Vogelsang, Timothy J., 2002. "Heteroskedasticity-Autocorrelation Robust Testing Using Bandwidth Equal To Sample Size," Econometric Theory, Cambridge University Press, vol. 18(6), pages 1350-1366, December.
    26. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October.
    27. Peter C. B. Phillips, 2003. "Laws and Limits of Econometrics," Economic Journal, Royal Economic Society, vol. 113(486), pages 26-52, March.
    28. Dietmar Bauer & Martin Wagner, 2002. "A Canonical Form for Unit Root Processes in the State Space Framework," Diskussionsschriften dp0204, Universitaet Bern, Departement Volkswirtschaft.
    29. Hendry,David F. & Morgan,Mary S., 1995. "The Foundations of Econometric Analysis," Cambridge Books, Cambridge University Press, number 9780521380430.
    30. Leeb, Hannes & Pötscher, Benedikt M., 2005. "Model Selection And Inference: Facts And Fiction," Econometric Theory, Cambridge University Press, vol. 21(1), pages 21-59, February.
    31. Tony Lancaster, 2006. "A note on bootstraps and robustness," CeMMAP working papers CWP04/06, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    32. M. A. Kaboudan, 2000. "Genetic Programming Prediction of Stock Prices," Computational Economics, Springer;Society for Computational Economics, vol. 16(3), pages 207-236, December.
    33. John C. Driscoll & Aart C. Kraay, 1998. "Consistent Covariance Matrix Estimation With Spatially Dependent Panel Data," The Review of Economics and Statistics, MIT Press, vol. 80(4), pages 549-560, November.
    34. Hendry,David F. & Morgan,Mary S., 1997. "The Foundations of Econometric Analysis," Cambridge Books, Cambridge University Press, number 9780521588706.
    35. repec:cup:etheor:v:10:y:1994:i:3-4:p:774-808 is not listed on IDEAS
    36. Phillips, Peter C. B., 1995. "Bayesian model selection and prediction with empirical applications," Journal of Econometrics, Elsevier, vol. 69(1), pages 289-331, September.
    37. repec:cup:etheor:v:11:y:1995:i:3:p:537-49 is not listed on IDEAS
    38. Lucas, Robert Jr, 1976. "Econometric policy evaluation: A critique," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 1(1), pages 19-46, January.
    39. Phillips, Peter C. B., 1998. "Impulse response and forecast error variance asymptotics in nonstationary VARs," Journal of Econometrics, Elsevier, vol. 83(1-2), pages 21-56.
    40. Brunner, Karl & Meltzer, Allan H., 1976. "The Phillips curve," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 1(1), pages 1-18, January.
    41. Perez-Amaral, Teodosio & Gallo, Giampiero M. & White, Halbert, 2005. "A COMPARISON OF COMPLEMENTARY AUTOMATIC MODELING METHODS: RETINA AND PcGets," Econometric Theory, Cambridge University Press, vol. 21(1), pages 262-277, February.
    42. Kabaila, Paul, 1995. "The Effect of Model Selection on Confidence Regions and Prediction Regions," Econometric Theory, Cambridge University Press, vol. 11(3), pages 537-549, June.
    43. Lee, Jin & Hong, Yongmiao, 2001. "Testing For Serial Correlation Of Unknown Form Using Wavelet Methods," Econometric Theory, Cambridge University Press, vol. 17(2), pages 386-423, April.
    44. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    45. Pötscher, B.M., 1991. "Effects of Model Selection on Inference," Econometric Theory, Cambridge University Press, vol. 7(2), pages 163-185, June.
    46. Duchesne, Pierre, 2006. "On Testing For Serial Correlation With A Wavelet-Based Spectral Density Estimator In Multivariate Time Series," Econometric Theory, Cambridge University Press, vol. 22(4), pages 633-676, August.
    47. Swanson, N.R. & Granger, C.W.J., 1994. "Impulse Response Functions Based on Causal Approach to Residual Orthogonalization in Vector Autoregressions," Papers 9-94-1, Pennsylvania State - Department of Economics.
    48. Sala-i-Martin, Xavier, 1997. "I Just Ran Two Million Regressions," American Economic Review, American Economic Association, vol. 87(2), pages 178-183, May.
    49. Phillips, Peter C B & Ploberger, Werner, 1996. "An Asymptotic Theory of Bayesian Inference for Time Series," Econometrica, Econometric Society, vol. 64(2), pages 381-412, March.
    50. Danilov, Dmitry & Magnus, J.R.Jan R., 2004. "On the harm that ignoring pretesting can cause," Journal of Econometrics, Elsevier, vol. 122(1), pages 27-46, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hwang, Jungbin & Sun, Yixiao, 2018. "SIMPLE, ROBUST, AND ACCURATE F AND t TESTS IN COINTEGRATED SYSTEMS," Econometric Theory, Cambridge University Press, vol. 34(5), pages 949-984, October.
    2. Bernd Brandl & Christian Keber & Matthias Schuster, 2006. "An automated econometric decision support system: forecasts for foreign exchange trades," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 14(4), pages 401-415, December.
    3. Peter C. B. Phillips & Zhentao Shi, 2021. "Boosting: Why You Can Use The Hp Filter," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 62(2), pages 521-570, May.
    4. Jane E. Ihrig & Mario Marazzi & Alexander D. Rothenberg, 2006. "Exchange-rate pass-through in the G-7 countries," International Finance Discussion Papers 851, Board of Governors of the Federal Reserve System (U.S.).
    5. Ziwei Mei & Peter C. B. Phillips & Zhentao Shi, 2022. "The boosted HP filter is more general than you might think," Papers 2209.09810, arXiv.org, revised Apr 2024.
    6. Marquez, Jaime, 2006. "Estimating elasticities for U.S. trade in services," Economic Modelling, Elsevier, vol. 23(2), pages 276-307, March.
    7. Qin, Duo, 2008. "Uncover Latent PPP by Dynamic Factor Error Correction Model (DF-ECM) Approach: Evidence from Five OECD Countries," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 2, pages 1-26.
    8. Jaime R. Marquez, 2005. "Estimating elasticities for U.S. trade in services," International Finance Discussion Papers 836, Board of Governors of the Federal Reserve System (U.S.).
    9. Jennifer L. Castle & Xiaochuan Qin & W. Robert Reed, 2013. "Using Model Selection Algorithms To Obtain Reliable Coefficient Estimates," Journal of Economic Surveys, Wiley Blackwell, vol. 27(2), pages 269-296, April.
    10. Dahl, Christian M. & Hansen, Henrik & Smidt, John, 2009. "The cyclical component factor model," International Journal of Forecasting, Elsevier, vol. 25(1), pages 119-127.
    11. Jungbin Hwang & Gonzalo Valdés, 2020. "Finite-sample Corrected Inference for Two-step GMM in Time Series," Working papers 2020-02, University of Connecticut, Department of Economics.
    12. Heij, C. & Groenen, P.J.F. & van Dijk, D.J.C., 2006. "Time series forecasting by principal covariate regression," Econometric Institute Research Papers EI 2006-37, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    13. S. Yanki Kalfa & Jaime Marquez, 2021. "Forecasting FOMC Forecasts," Econometrics, MDPI, vol. 9(3), pages 1-21, September.
      • S. Yanki Kalfa & Jaime Marquez, 2018. "Forecasting FOMC Forecasts," Working Papers 2018-007, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    14. Sean Fahle & Jaime R. Marquez & Charles P. Thomas, 2008. "Measuring U.S. international relative prices: a WARP view of the world," International Finance Discussion Papers 917, Board of Governors of the Federal Reserve System (U.S.).
    15. Rustam Ibragimov & Paul Kattuman & Anton Skrobotov, 2021. "Robust Inference on Income Inequality: $t$-Statistic Based Approaches," Papers 2105.05335, arXiv.org, revised Nov 2021.
    16. Sun, Yixiao & Yang, Jingjing, 2020. "Testing-optimal kernel choice in HAR inference," Journal of Econometrics, Elsevier, vol. 219(1), pages 123-136.
    17. S. Yanki Kalfa & Jaime Marquez, 2019. "FOMC Forecasts: Are They Useful for Understanding Monetary Policy?," JRFM, MDPI, vol. 12(3), pages 1-17, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Peter C. B. Phillips, 2003. "Laws and Limits of Econometrics," Economic Journal, Royal Economic Society, vol. 113(486), pages 26-52, March.
    2. Julia Campos & Neil R. Ericsson & David F. Hendry, 2005. "General-to-specific modeling: an overview and selected bibliography," International Finance Discussion Papers 838, Board of Governors of the Federal Reserve System (U.S.).
    3. Chao, John C. & Phillips, Peter C. B., 1999. "Model selection in partially nonstationary vector autoregressive processes with reduced rank structure," Journal of Econometrics, Elsevier, vol. 91(2), pages 227-271, August.
    4. Castle Jennifer L. & Doornik Jurgen A & Hendry David F., 2011. "Evaluating Automatic Model Selection," Journal of Time Series Econometrics, De Gruyter, vol. 3(1), pages 1-33, February.
    5. Pesaran, Hashem & Timmermann, Allan, 2005. "Real-Time Econometrics," Econometric Theory, Cambridge University Press, vol. 21(1), pages 212-231, February.
    6. Phillips, Peter C.B., 2003. "Vision And Influence In Econometrics: John Denis Sargan," Econometric Theory, Cambridge University Press, vol. 19(3), pages 495-511, June.
    7. Hendry, David F. & Johansen, Søren, 2015. "Model Discovery And Trygve Haavelmo’S Legacy," Econometric Theory, Cambridge University Press, vol. 31(1), pages 93-114, February.
    8. Allen, P. Geoffrey & Morzuch, Bernard J., 2006. "Twenty-five years of progress, problems, and conflicting evidence in econometric forecasting. What about the next 25 years?," International Journal of Forecasting, Elsevier, vol. 22(3), pages 475-492.
    9. John Geweke & Joel Horowitz & M. Hashem Pesaran, 2006. "Econometrics: A Bird’s Eye View," CESifo Working Paper Series 1870, CESifo.
    10. Bardsen, Gunnar & Eitrheim, Oyvind & Jansen, Eilev S. & Nymoen, Ragnar, 2005. "The Econometrics of Macroeconomic Modelling," OUP Catalogue, Oxford University Press, number 9780199246502.
    11. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    12. Leeb, Hannes & Pötscher, Benedikt M., 2008. "Can One Estimate The Unconditional Distribution Of Post-Model-Selection Estimators?," Econometric Theory, Cambridge University Press, vol. 24(2), pages 338-376, April.
    13. Neil R. Ericsson, 2008. "The Fragility of Sensitivity Analysis: An Encompassing Perspective," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 70(s1), pages 895-914, December.
    14. Peter C.B. Phillips & Yixiao Sun & Sainan Jin, 2005. "Improved HAR Inference," Cowles Foundation Discussion Papers 1513, Cowles Foundation for Research in Economics, Yale University.
    15. Jan R. Magnus & Dmitry Danilov, 2004. "Forecast accuracy after pretesting with an application to the stock market," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(4), pages 251-274.
    16. Castle, Jennifer L. & Doornik, Jurgen A. & Hendry, David F., 2012. "Model selection when there are multiple breaks," Journal of Econometrics, Elsevier, vol. 169(2), pages 239-246.
    17. Sun, Yixiao & Phillips, Peter C.B. & Jin, Sainan, 2011. "Power Maximization And Size Control In Heteroskedasticity And Autocorrelation Robust Tests With Exponentiated Kernels," Econometric Theory, Cambridge University Press, vol. 27(6), pages 1320-1368, December.
    18. Todd E. Clark, 2004. "Can out-of-sample forecast comparisons help prevent overfitting?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(2), pages 115-139.
    19. Aaron Schiff & Peter Phillips, 2000. "Forecasting New Zealand's real GDP," New Zealand Economic Papers, Taylor & Francis Journals, vol. 34(2), pages 159-181.
    20. David F. Hendry & Hans‐Martin Krolzig, 2004. "We Ran One Regression," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 66(5), pages 799-810, December.

    More about this item

    JEL classification:

    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C50 - Mathematical and Quantitative Methods - - Econometric Modeling - - - General
    • C87 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Econometric Software

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cup:etheor:v:21:y:2005:i:01:p:3-20_05. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kirk Stebbing (email available below). General contact details of provider: https://www.cambridge.org/ect .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.