IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v76y2014icp424-448.html
   My bibliography  Save this article

Improved variance estimation of maximum likelihood estimators in stable first-order dynamic regression models

Author

Listed:
  • Kiviet, Jan F.
  • Phillips, Garry D.A.

Abstract

In dynamic regression models conditional maximum likelihood (least-squares) coefficient and variance estimators are biased. Using expansion techniques an approximation is obtained to the bias in variance estimation yielding a bias corrected variance estimator. This is achieved for both the standard and a bias corrected coefficient estimator enabling a comparison of their mean squared errors to second order. Sufficient conditions for admissibility of these approximations are formally derived. Illustrative numerical and simulation results are presented on bias reduction of coefficient and variance estimation for three relevant classes of first-order autoregressive models, supplemented by effects on mean squared errors, test size and size corrected power. These indicate that substantial biases do occur in moderately large samples, but these can be mitigated considerably and may also yield mean squared error reduction. Crude asymptotic tests are cursed by huge size distortions. However, operational bias corrections of both the estimates of coefficients and their estimated variance (for which software is provided) are shown to curb type I errors reasonably well.

Suggested Citation

  • Kiviet, Jan F. & Phillips, Garry D.A., 2014. "Improved variance estimation of maximum likelihood estimators in stable first-order dynamic regression models," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 424-448.
  • Handle: RePEc:eee:csdana:v:76:y:2014:i:c:p:424-448
    DOI: 10.1016/j.csda.2013.09.021
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947313003459
    Download Restriction: Full text for ScienceDirect subscribers only.

    File URL: https://libkey.io/10.1016/j.csda.2013.09.021?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kiviet, J.F. & Phillips, G.D.A., 1999. "The Bias of the 2SLS Variance Estimator," Discussion Papers 9904, University of Exeter, Department of Economics.
    2. Rudebusch, Glenn D, 1993. "The Uncertain Unit Root in Real GNP," American Economic Review, American Economic Association, vol. 83(1), pages 264-272, March.
    3. Ullah, Aman, 2004. "Finite Sample Econometrics," OUP Catalogue, Oxford University Press, number 9780198774488.
    4. Rudebusch, Glenn D, 1992. "Trends and Random Walks in Macroeconomic Time Series: A Re-examination," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 33(3), pages 661-680, August.
    5. Kiviet, Jan F., 2012. "Monte Carlo Simulation for Econometricians," Foundations and Trends(R) in Econometrics, now publishers, vol. 5(1–2), pages 1-181, March.
    6. Bao, Yong & Ullah, Aman, 2007. "The second-order bias and mean squared error of estimators in time-series models," Journal of Econometrics, Elsevier, vol. 140(2), pages 650-669, October.
    7. Jan F. Kiviet & Garry D.A. Phillips, 1998. "Degrees of freedom adjustment for disturbance variance estimators in dynamic regression models," Econometrics Journal, Royal Economic Society, vol. 1(RegularPa), pages 44-70.
    8. Kiviet, Jan F. & Phillips, Garry D. A., 1994. "Bias assessment and reduction in linear error-correction models," Journal of Econometrics, Elsevier, vol. 63(1), pages 215-243, July.
    9. Kiviet, Jan F. & Phillips, Garry D.A., 2012. "Higher-order asymptotic expansions of the least-squares estimation bias in first-order dynamic regression models," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3705-3729.
    10. Grubb, David & Symons, James, 1987. "Bias in Regressions With a Lagged Dependent Variable," Econometric Theory, Cambridge University Press, vol. 3(3), pages 371-386, June.
    11. Sargan, J D, 1976. "Econometric Estimators and the Edgeworth Approximation," Econometrica, Econometric Society, vol. 44(3), pages 421-448, May.
    12. Jan F. Kiviet & Garry D. A. Phillips, 2000. "Improved Coefficient and Variance Estimation in Stable First-Order Dynamic Regression Models," Econometric Society World Congress 2000 Contributed Papers 0631, Econometric Society.
    13. Kiviet, Jan F. & Phillips, Garry D. A. & Schipp, Bernhard, 1995. "The bias of OLS, GLS, and ZEF estimators in dynamic seemingly unrelated regression models," Journal of Econometrics, Elsevier, vol. 69(1), pages 241-266, September.
    14. Kiviet, Jan F. & Phillips, Garry D.A., 1993. "Alternative Bias Approximations in Regressions with a Lagged-Dependent Variable," Econometric Theory, Cambridge University Press, vol. 9(1), pages 62-80, January.
    15. Bao, Yong, 2007. "The Approximate Moments Of The Least Squares Estimator For The Stationary Autoregressive Model Under A General Error Distribution," Econometric Theory, Cambridge University Press, vol. 23(5), pages 1013-1021, October.
    16. MacKinnon, James G. & Smith Jr., Anthony A., 1998. "Approximate bias correction in econometrics," Journal of Econometrics, Elsevier, vol. 85(2), pages 205-230, August.
    17. Sawa, Takamitsu, 1978. "The exact moments of the least squares estimator for the autoregressive model," Journal of Econometrics, Elsevier, vol. 8(2), pages 159-172, October.
    18. Phillips, Garry D. A., 2000. "An alternative approach to obtaining Nagar-type moment approximations in simultaneous equation models," Journal of Econometrics, Elsevier, vol. 97(2), pages 345-364, August.
    19. Orcutt, Guy H & Winokur, Herbert S, Jr, 1969. "First Order Autoregression: Inference, Estimation, and Prediction," Econometrica, Econometric Society, vol. 37(1), pages 1-14, January.
    20. Yang, Zhenlin, 2015. "A general method for third-order bias and variance corrections on a nonlinear estimator," Journal of Econometrics, Elsevier, vol. 186(1), pages 178-200.
    21. Karim M. Abadir & Kaddour Hadri & Elias Tzavalis, 1999. "The Influence of VAR Dimensions on Estimator Biases," Econometrica, Econometric Society, vol. 67(1), pages 163-182, January.
    22. Jan F. Kiviet & Garry D. A. Phillips, 2005. "Moment approximation for least-squares estimators in dynamic regression models with a unit root *," Econometrics Journal, Royal Economic Society, vol. 8(2), pages 115-142, July.
    23. Anindya Roy & Barry Falk & Wayne A. Fuller, 2004. "Testing for Trend in the Presence of Autoregressive Error," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 1082-1091, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gareth Liu-Evans, 2021. "Improving the Estimation and Predictions of Small Time Series Models," Working Papers 202106, University of Liverpool, Department of Economics.
    2. Valerie Good & Douglas E. Hughes & Hao Wang, 2022. "More than money: establishing the importance of a sense of purpose for salespeople," Journal of the Academy of Marketing Science, Springer, vol. 50(2), pages 272-295, March.
    3. Phillip, Garry & Xu, Yongdeng, 2016. "Almost Unbiased Variance Estimation in Simultaneous Equation Models," Cardiff Economics Working Papers E2016/10, Cardiff University, Cardiff Business School, Economics Section.
    4. Maoshan Tian & Huw Dixon, 2022. "The variances of non-parametric estimates of the cross-sectional distribution of durations," Econometric Reviews, Taylor & Francis Journals, vol. 41(10), pages 1243-1264, November.
    5. Liu-Evans, Gareth, 2014. "A note on approximating moments of least squares estimators," MPRA Paper 57543, University Library of Munich, Germany.
    6. Quintana Carapia, Gustavo & Markovsky, Ivan & Pintelon, Rik & Csurcsia, Péter Zoltán & Verbeke, Dieter, 2020. "Bias and covariance of the least squares estimate in a structured errors-in-variables problem," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kiviet, Jan F. & Phillips, Garry D.A., 2012. "Higher-order asymptotic expansions of the least-squares estimation bias in first-order dynamic regression models," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3705-3729.
    2. Jan F. Kiviet & Garry D. A. Phillips, 2000. "Improved Coefficient and Variance Estimation in Stable First-Order Dynamic Regression Models," Econometric Society World Congress 2000 Contributed Papers 0631, Econometric Society.
    3. Aman Ullah & Yong Bao & Ru Zhang, 2014. "Moment Approximation for Unit Root Models with Nonnormal Errors," Working Papers 201401, University of California at Riverside, Department of Economics.
    4. Liu-Evans, Gareth, 2014. "A note on approximating moments of least squares estimators," MPRA Paper 57543, University Library of Munich, Germany.
    5. Liu-Evans Gareth D. & Phillips Garry D. A., 2012. "Bootstrap, Jackknife and COLS: Bias and Mean Squared Error in Estimation of Autoregressive Models," Journal of Time Series Econometrics, De Gruyter, vol. 4(2), pages 1-35, November.
    6. Liu-Evans, Gareth, 2010. "An alternative approach to approximating the moments of least squares estimators," MPRA Paper 26550, University Library of Munich, Germany.
    7. Bao, Yong & Ullah, Aman, 2007. "The second-order bias and mean squared error of estimators in time-series models," Journal of Econometrics, Elsevier, vol. 140(2), pages 650-669, October.
    8. MacKinnon, James G. & Smith Jr., Anthony A., 1998. "Approximate bias correction in econometrics," Journal of Econometrics, Elsevier, vol. 85(2), pages 205-230, August.
    9. Pesaran, M. Hashem & Timmermann, Allan, 2005. "Small sample properties of forecasts from autoregressive models under structural breaks," Journal of Econometrics, Elsevier, vol. 129(1-2), pages 183-217.
    10. Yong Bao & Aman Ullah, 2021. "Analytical Finite Sample Econometrics: From A. L. Nagar to Now," Journal of Quantitative Economics, Springer;The Indian Econometric Society (TIES), vol. 19(1), pages 17-37, December.
    11. Phillips, Garry David Alan & Wang, Dandan, 2019. "Bias assessment and reduction for the 2SLS estimator in general dynamic simultaneous equations models," DES - Working Papers. Statistics and Econometrics. WS 28322, Universidad Carlos III de Madrid. Departamento de Estadística.
    12. Phillips, Garry D.A. & Liu-Evans, Gareth, 2016. "Approximating and reducing bias in 2SLS estimation of dynamic simultaneous equation models," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 734-762.
    13. Yu, Jun, 2012. "Bias in the estimation of the mean reversion parameter in continuous time models," Journal of Econometrics, Elsevier, vol. 169(1), pages 114-122.
    14. Hisashi Tanizaki & Shigeyuki Hamori & Yoichi Matsubayashi, 2006. "On least-squares bias in the AR(p) models: Bias correction using the bootstrap methods," Statistical Papers, Springer, vol. 47(1), pages 109-124, January.
    15. Kiviet, Jan F. & Phillips, Garry D. A. & Schipp, Bernhard, 1999. "Alternative bias approximations in first-order dynamic reduced form models," Journal of Economic Dynamics and Control, Elsevier, vol. 23(7), pages 909-928, June.
    16. Tom Engsted & Thomas Q. Pedersen, 2014. "Bias-Correction in Vector Autoregressive Models: A Simulation Study," Econometrics, MDPI, vol. 2(1), pages 1-27, March.
    17. Kruse, Robinson & Kaufmann, Hendrik & Wegener, Christoph, 2018. "Bias-corrected estimation for speculative bubbles in stock prices," Economic Modelling, Elsevier, vol. 73(C), pages 354-364.
    18. Chambers, Marcus J., 2013. "Jackknife estimation of stationary autoregressive models," Journal of Econometrics, Elsevier, vol. 172(1), pages 142-157.
    19. Müller, Ulrich K. & Wang, Yulong, 2019. "Nearly weighted risk minimal unbiased estimation," Journal of Econometrics, Elsevier, vol. 209(1), pages 18-34.
    20. Marcet, Albert & Jarociński, Marek, 2010. "Autoregressions in small samples, priors about observables and initial conditions," Working Paper Series 1263, European Central Bank.

    More about this item

    Keywords

    Bias correction; Efficiency gains; Finite sample moments; Higher-order asymptotic expansions; Lagged dependent variables; Size improvements;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:76:y:2014:i:c:p:424-448. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.