IDEAS home Printed from https://ideas.repec.org/a/spr/aistmt/v63y2011i4p851-871.html
   My bibliography  Save this article

On the equivalence of the weighted least squares and the generalised least squares estimators, with applications to kernel smoothing

Author

Listed:
  • Alessandra Luati
  • Tommaso Proietti

Abstract

The paper establishes the conditions under which the generalised least squares estimator of the regression parameters is equivalent to the weighted least squares estimator. The equivalence conditions have interesting applications in local polynomial regression and kernel smoothing. Specifically, they enable to derive the optimal kernel associated with a particular covariance structure of the measurement error, where optimality has to be intended in the Gauss-Markov sense. For local polynomial regression it is shown that there is a class of covariance structures, associated with non-invertible moving average processes of given orders which yield the the Epanechnikov and the Henderson kernels as the optimal kernels.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Alessandra Luati & Tommaso Proietti, 2011. "On the equivalence of the weighted least squares and the generalised least squares estimators, with applications to kernel smoothing," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 63(4), pages 851-871, August.
    • Handle: RePEc:spr:aistmt:v:63:y:2011:i:4:p:851-871
    DOI: 10.1007/s10463-009-0267-8
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s10463-009-0267-8
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s10463-009-0267-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Frederick R. Macaulay, 1931. "The Smoothing of Time Series," NBER Books, National Bureau of Economic Research, Inc, number maca31-1.
    2. Kramer, Walter & Hassler, Uwe, 1998. "Limiting efficiency of OLS vs. GLS when regressors are fractionally integrated," Economics Letters, Elsevier, vol. 60(3), pages 285-290, September.
    3. Wallis, Kenneth F, 1981. "Models for X-11 and 'X-11-Forecast' Procedures for Preliminary and Revised Seasonal Adjustments," The Warwick Economics Research Paper Series (TWERPS) 198, University of Warwick, Department of Economics.
    4. repec:bla:ecorec:v:68:y:1992:i:200:p:65-72 is not listed on IDEAS
    5. Frederick R. Macaulay, 1931. "Introduction to "The Smoothing of Time Series"," NBER Chapters, in: The Smoothing of Time Series, pages 17-30, National Bureau of Economic Research, Inc.
    6. Frederick R. Macaulay, 1931. "Appendices to "The Smoothing of Time Series"," NBER Chapters, in: The Smoothing of Time Series, pages 118-169, National Bureau of Economic Research, Inc.
    7. Peter C.B. Phillips & Joon Y. Park, 1986. "Asymptotic Equivalence of OLS and GLS in Regressions with Integrated Regressors," Cowles Foundation Discussion Papers 802, Cowles Foundation for Research in Economics, Yale University.
    8. Frederick R. Macaulay, 1931. "The Smoothing of Economic Time Series, Curve Fitting and Graduation," NBER Chapters, in: The Smoothing of Time Series, pages 31-42, National Bureau of Economic Research, Inc.
    9. Tian, Yongge & Wiens, Douglas P., 2006. "On equality and proportionality of ordinary least squares, weighted least squares and best linear unbiased estimators in the general linear model," Statistics & Probability Letters, Elsevier, vol. 76(12), pages 1265-1272, July.
    10. Phillips, Peter C.B., 1992. "Geometry of the Equivalence of OLS and GLS in the Linear Model," Econometric Theory, Cambridge University Press, vol. 8(01), pages 158-159, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alexander Dokumentov & Rob J. Hyndman, 2022. "STR: Seasonal-Trend Decomposition Using Regression," INFORMS Joural on Data Science, INFORMS, vol. 1(1), pages 50-62, April.
    2. Viv B. Hall & Peter Thomson, 2021. "Does Hamilton’s OLS Regression Provide a “better alternative” to the Hodrick-Prescott Filter? A New Zealand Business Cycle Perspective," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 17(2), pages 151-183, November.
    3. Hall, Viv & Thomson, Peter & McKelvie, Stuart, 2015. "On trend robustness and end-point issues for New Zealand’s stylised business cycle facts," Working Paper Series 18867, Victoria University of Wellington, School of Economics and Finance.
    4. Dagum Estela Bee & Luati Alessandra, 2004. "Relationship between Local and Global Nonparametric Estimators Measures of Fitting and Smoothing," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 8(2), pages 1-18, May.
    5. Wang, Shuai & Yu, Lean & Tang, Ling & Wang, Shouyang, 2011. "A novel seasonal decomposition based least squares support vector regression ensemble learning approach for hydropower consumption forecasting in China," Energy, Elsevier, vol. 36(11), pages 6542-6554.
    6. Shouvik Chakraborty, 2012. "Is Export Expansion of Manufactured Goods an Escape Route from Terms of Trade Deterioration of Developing Countries?," Journal of South Asian Development, , vol. 7(2), pages 81-108, October.
    7. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    8. Olivares, Kin G. & Challu, Cristian & Marcjasz, Grzegorz & Weron, Rafał & Dubrawski, Artur, 2023. "Neural basis expansion analysis with exogenous variables: Forecasting electricity prices with NBEATSx," International Journal of Forecasting, Elsevier, vol. 39(2), pages 884-900.
    9. Hall, Viv & Thomson, Peter & McKelvie, Stuart, 2015. "On trend robustness and end-point issues for New Zealand’s stylised business cycle facts," Working Paper Series 3761, Victoria University of Wellington, School of Economics and Finance.
    10. Viv B. Hall & Peter Thomson & Stuart McKelvie, 2017. "On the robustness of stylised business cycle facts for contemporary New Zealand," New Zealand Economic Papers, Taylor & Francis Journals, vol. 51(3), pages 193-216, September.
    11. Terence Mills, 2007. "A Note on Trend Decomposition: The 'Classical' Approach Revisited with an Application to Surface Temperature Trends," Journal of Applied Statistics, Taylor & Francis Journals, vol. 34(8), pages 963-972.
    12. Viv B Hall & Peter Thomson, 2020. "Does Hamilton’s OLS regression provide a “better alternative†to the Hodrick-Prescott filter? A New Zealand business cycle perspective," CAMA Working Papers 2020-71, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    13. Ingel, Anti & Shahroudi, Novin & Kängsepp, Markus & Tättar, Andre & Komisarenko, Viacheslav & Kull, Meelis, 2020. "Correlated daily time series and forecasting in the M4 competition," International Journal of Forecasting, Elsevier, vol. 36(1), pages 121-128.
    14. Zarnowitz, Victor & Ozyildirim, Ataman, 2006. "Time series decomposition and measurement of business cycles, trends and growth cycles," Journal of Monetary Economics, Elsevier, vol. 53(7), pages 1717-1739, October.
    15. Hackl, Peter & Westlund, Anders H., 1996. "Demand for international telecommunication time-varying price elasticity," Journal of Econometrics, Elsevier, vol. 70(1), pages 243-260, January.
    16. Hackl, Peter & Westlund, Anders H., 1995. "On price elasticities of international telecommunication demand," Information Economics and Policy, Elsevier, vol. 7(1), pages 27-36, April.
    17. Ryan Greenaway-McGrevy, 2013. "A Multivariate Approach to Seasonal Adjustment," BEA Working Papers 0100, Bureau of Economic Analysis.
    18. Hyndman, Rob J. & Ahmed, Roman A. & Athanasopoulos, George & Shang, Han Lin, 2011. "Optimal combination forecasts for hierarchical time series," Computational Statistics & Data Analysis, Elsevier, vol. 55(9), pages 2579-2589, September.
    19. Yuqin Sun & Rong Ke & Yongge Tian, 2014. "Some overall properties of seemingly unrelated regression models," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 98(2), pages 103-120, April.
    20. Proietti, Tommaso & Luati, Alessandra, 2009. "Low-Pass Filter Design using Locally Weighted Polynomial Regression and Discrete Prolate Spheroidal Sequences," MPRA Paper 15510, University Library of Munich, Germany.

    More about this item

    Keywords

    Epanechnikov kernel; Local polynomial regression; Non-invertible moving average processes;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:aistmt:v:63:y:2011:i:4:p:851-871. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.