IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2502.00751.html
   My bibliography  Save this paper

Online Generalized Method of Moments for Time Series

Author

Listed:
  • Man Fung Leung
  • Kin Wai Chan
  • Xiaofeng Shao

Abstract

Online learning has gained popularity in recent years due to the urgent need to analyse large-scale streaming data, which can be collected in perpetuity and serially dependent. This motivates us to develop the online generalized method of moments (OGMM), an explicitly updated estimation and inference framework in the time series setting. The OGMM inherits many properties of offline GMM, such as its broad applicability to many problems in econometrics and statistics, natural accommodation for over-identification, and achievement of semiparametric efficiency under temporal dependence. As an online method, the key gain relative to offline GMM is the vast improvement in time complexity and memory requirement. Building on the OGMM framework, we propose improved versions of online Sargan--Hansen and structural stability tests following recent work in econometrics and statistics. Through Monte Carlo simulations, we observe encouraging finite-sample performance in online instrumental variables regression, online over-identifying restrictions test, online quantile regression, and online anomaly detection. Interesting applications of OGMM to stochastic volatility modelling and inertial sensor calibration are presented to demonstrate the effectiveness of OGMM.

Suggested Citation

  • Man Fung Leung & Kin Wai Chan & Xiaofeng Shao, 2025. "Online Generalized Method of Moments for Time Series," Papers 2502.00751, arXiv.org.
    • Handle: RePEc:arx:papers:2502.00751
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2502.00751
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    2. Alexandre Belloni & Victor Chernozhukov & Denis Chetverikov & Christian Hansen & Kengo Kato, 2018. "High-dimensional econometrics and regularized GMM," CeMMAP working papers CWP35/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    3. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    4. de Castro, Luciano & Galvao, Antonio F. & Kaplan, David M. & Liu, Xin, 2019. "Smoothed GMM for quantile models," Journal of Econometrics, Elsevier, vol. 213(1), pages 121-144.
    5. Hall, Alastair R & Sen, Amit, 1999. "Structural Stability Testing in Models Estimated by Generalized Method of Moments," Journal of Business & Economic Statistics, American Statistical Association, vol. 17(3), pages 335-348, July.
    6. Chen, Xiaohong & Liao, Zhipeng, 2015. "Sieve semiparametric two-step GMM under weak dependence," Journal of Econometrics, Elsevier, vol. 189(1), pages 163-186.
    7. Lan Luo & Peter X.‐K. Song, 2020. "Renewable estimation and incremental inference in generalized linear models with streaming data sets," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(1), pages 69-97, February.
    8. Daniel Ackerberg & Xiaohong Chen & Jinyong Hahn & Zhipeng Liao, 2014. "Asymptotic Efficiency of Semiparametric Two-step GMM," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(3), pages 919-943.
    9. Lan Luo & Jingshen Wang & Emily C Hector, 2023. "Statistical inference for streamed longitudinal data," Biometrika, Biometrika Trust, vol. 110(4), pages 841-858.
    10. de Castro, Luciano & Galvao, Antonio F. & Kaplan, David M. & Liu, Xin, 2019. "Smoothed GMM for quantile models," Journal of Econometrics, Elsevier, vol. 213(1), pages 121-144.
    11. Bollerslev, Tim & Patton, Andrew J. & Quaedvlieg, Rogier, 2016. "Exploiting the errors: A simple approach for improved volatility forecasting," Journal of Econometrics, Elsevier, vol. 192(1), pages 1-18.
    12. Razvan Pascalau & Ryan Poirier, 2023. "Increasing the information content of realized volatility forecasts," Journal of Financial Econometrics, Oxford University Press, vol. 21(4), pages 1064-1098.
    13. Stéphane Guerrier & Jan Skaloud & Yannick Stebler & Maria-Pia Victoria-Feser, 2013. "Wavelet-Variance-Based Estimation for Composite Stochastic Processes," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(503), pages 1021-1030, September.
    14. Alastair R. Hall, 2000. "Covariance Matrix Estimation and the Power of the Overidentifying Restrictions Test," Econometrica, Econometric Society, vol. 68(6), pages 1517-1528, November.
    15. J Wang & H Wang & K Chen, 2023. "Discussion of ‘Statistical inference for streamed longitudinal data’," Biometrika, Biometrika Trust, vol. 110(4), pages 863-866.
    16. Xiaohong Chen & Sokbae Lee & Yuan Liao & Myung Hwan Seo & Youngki Shin & Myunghyun Song, 2023. "SGMM: Stochastic Approximation to Generalized Method of Moments," Papers 2308.13564, arXiv.org, revised Oct 2023.
    17. Lan Luo & Jingshen Wang & Emily C Hector, 2023. "Rejoinder: ‘Statistical inference for streamed longitudinal data’," Biometrika, Biometrika Trust, vol. 110(4), pages 871-874.
    18. Wanrong Zhu & Xi Chen & Wei Biao Wu, 2023. "Online Covariance Matrix Estimation in Stochastic Gradient Descent," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 118(541), pages 393-404, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Samuel Muller & Suojin Wang & A. H. Welsh, 2024. "The effect of the working correlation on fitting models to longitudinal data," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 51(2), pages 891-912, June.
    2. repec:bla:ecorec:v:91:y:2015:i::p:1-24 is not listed on IDEAS
    3. Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91(S1), pages 1-24, June.
    4. Firpo, Sergio & Galvao, Antonio F. & Pinto, Cristine & Poirier, Alexandre & Sanroman, Graciela, 2022. "GMM quantile regression," Journal of Econometrics, Elsevier, vol. 230(2), pages 432-452.
    5. Hidehiko Ichimura & Whitney K. Newey, 2022. "The influence function of semiparametric estimators," Quantitative Economics, Econometric Society, vol. 13(1), pages 29-61, January.
    6. de Castro, Luciano & Galvao, Antonio F. & Kaplan, David M. & Liu, Xin, 2019. "Smoothed GMM for quantile models," Journal of Econometrics, Elsevier, vol. 213(1), pages 121-144.
    7. Shin‐Kun Peng & Takatoshi Tabuchi, 2007. "Spatial Competition in Variety and Number of Stores," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 16(1), pages 227-250, March.
    8. Alain Guay & Florian Pelgrin, 2007. "Using Implied Probabilities to Improve Estimation with Unconditional Moment Restrictions," Cahiers de recherche 0747, CIRPEE.
    9. Chen, Xiaohong & Liao, Zhipeng, 2015. "Sieve semiparametric two-step GMM under weak dependence," Journal of Econometrics, Elsevier, vol. 189(1), pages 163-186.
    10. Hall, Alastair R. & Inoue, Atsushi, 2003. "The large sample behaviour of the generalized method of moments estimator in misspecified models," Journal of Econometrics, Elsevier, vol. 114(2), pages 361-394, June.
    11. Lee, Wei-Ming & Kuan, Chung-Ming & Hsu, Yu-Chin, 2014. "Testing over-identifying restrictions without consistent estimation of the asymptotic covariance matrix," Journal of Econometrics, Elsevier, vol. 181(2), pages 181-193.
    12. Alastair R. Hall & Yuyi Li & Chris D. Orme & Arthur Sinko, 2015. "Testing for Structural Instability in Moment Restriction Models: An Info-Metric Approach," Econometric Reviews, Taylor & Francis Journals, vol. 34(3), pages 286-327, March.
    13. Sun, Yixiao & Kim, Min Seong, 2012. "Simple and powerful GMM over-identification tests with accurate size," Journal of Econometrics, Elsevier, vol. 166(2), pages 267-281.
    14. Xiaohong Chen & Yin Jia Jeff Qiu, 2016. "Methods for Nonparametric and Semiparametric Regressions with Endogeneity: A Gentle Guide," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 259-290, October.
    15. Alain Guay & Jean-Francois Lamarche, 2005. "The Information Content of Implied Probabilities to Detect Structural Change," Working Papers 0804, Brock University, Department of Economics, revised Oct 2008.
    16. de Castro, Luciano & Galvao, Antonio F. & Kaplan, David M. & Liu, Xin, 2019. "Smoothed GMM for quantile models," Journal of Econometrics, Elsevier, vol. 213(1), pages 121-144.
    17. Daniel Borup & Martin Thyrsgaard, 2017. "Statistical tests for equal predictive ability across multiple forecasting methods," CREATES Research Papers 2017-19, Department of Economics and Business Economics, Aarhus University.
    18. repec:ebl:ecbull:v:3:y:2007:i:44:p:1-6 is not listed on IDEAS
    19. Paulo M. D. C. Parente & Richard J. Smith, 2021. "Quasi‐maximum likelihood and the kernel block bootstrap for nonlinear dynamic models," Journal of Time Series Analysis, Wiley Blackwell, vol. 42(4), pages 377-405, July.
    20. Arturo Estrella & Anthony P. Rodrigues, 1998. "Consistent covariance matrix estimation in probit models with autocorrelated errors," Staff Reports 39, Federal Reserve Bank of New York.
    21. Hansen, Lars Peter & Heaton, John & Luttmer, Erzo G J, 1995. "Econometric Evaluation of Asset Pricing Models," The Review of Financial Studies, Society for Financial Studies, vol. 8(2), pages 237-274.
    22. Xiaohong Chen & Andres Santos, 2018. "Overidentification in Regular Models," Econometrica, Econometric Society, vol. 86(5), pages 1771-1817, September.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2502.00751. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.