IDEAS home Printed from https://ideas.repec.org/a/eee/stapro/v42y1999i2p167-174.html
   My bibliography  Save this article

A paradox in least-squares estimation of linear regression models

Author

Listed:
  • Bai, Z. D.
  • Guo, Meihui

Abstract

This note considers a paradox arising in the least-squares estimation of linear regression models in which the error terms are assumed to be i.i.d. and possess finite rth moment, for r[set membership, variant][1,2). We give a concrete example to show that the least-squares estimator of the slope parameter is inconsistent when the intercept parameter of the model is given. However, surprisingly this estimator is consistent when the intercept parameter is intendedly assumed to be unknown and re-estimated simultaneously with the slope parameter.

Suggested Citation

  • Bai, Z. D. & Guo, Meihui, 1999. "A paradox in least-squares estimation of linear regression models," Statistics & Probability Letters, Elsevier, vol. 42(2), pages 167-174, April.
    • Handle: RePEc:eee:stapro:v:42:y:1999:i:2:p:167-174
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167-7152(98)00205-3
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lai, T. L. & Robbins, Herbert & Wei, C. Z., 1979. "Strong consistency of least squares estimates in multiple regression II," Journal of Multivariate Analysis, Elsevier, vol. 9(3), pages 343-361, September.
    2. Gui-Jing, Chen & Lai, T. L. & Wei, C. Z., 1981. "Convergence systems and strong consistency of least squares estimates in regression models," Journal of Multivariate Analysis, Elsevier, vol. 11(3), pages 319-333, September.
    3. DRYGAS, Hilmar, 1976. "Weak and strong consistency of the least squares estimators in regression models," LIDAM Reprints CORE 236, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bai, Zhidong & Wang, Keyan & Wong, Wing-Keung, 2011. "The mean-variance ratio test--A complement to the coefficient of variation test and the Sharpe ratio test," Statistics & Probability Letters, Elsevier, vol. 81(8), pages 1078-1085, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lita da Silva, João, 2014. "Some strong consistency results in stochastic regression," Journal of Multivariate Analysis, Elsevier, vol. 129(C), pages 220-226.
    2. Wu, Tiee-Jian & Wasan, M. T., 1996. "Weighted least squares estimates in linear regression models for processes with uncorrelated increments," Stochastic Processes and their Applications, Elsevier, vol. 64(2), pages 273-286, November.
    3. Norbert Christopeit & Michael Massmann, 2013. "A Note on an Estimation Problem in Models with Adaptive Learning," Tinbergen Institute Discussion Papers 13-151/III, Tinbergen Institute.
    4. Ching-Kang Ing & Ching-Zong Wei, 2005. "A maximal moment inequality for long range dependent time series with applications to estimation and model selection," Econometrics 0508009, University Library of Munich, Germany.
    5. Dzhaparidze, K. & Spreij, P., 1989. "On SLLN for martingales with deterministic variation," Serie Research Memoranda 0079, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
    6. Cohen, Guy & Francos, Joseph M., 2002. "Linear Least Squares Estimation of Regression Models for Two-Dimensional Random Fields," Journal of Multivariate Analysis, Elsevier, vol. 82(2), pages 431-444, August.
    7. R. M. Balan & Ioana Schiopu-Kratina, 2004. "Asymptotic Results with Generalized Estimating Equations for Longitudinal data II," RePAd Working Paper Series lrsp-TRS398, Département des sciences administratives, UQO.
    8. Yuan-chin Chang, 2011. "Sequential estimation in generalized linear models when covariates are subject to errors," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 73(1), pages 93-120, January.
    9. Zhou, Xian & You, Jinhong, 2004. "Wavelet estimation in varying-coefficient partially linear regression models," Statistics & Probability Letters, Elsevier, vol. 68(1), pages 91-104, June.
    10. Yong Tao & Xiangjun Wu & Tao Zhou & Weibo Yan & Yanyuxiang Huang & Han Yu & Benedict Mondal & Victor M. Yakovenko, 2019. "Exponential structure of income inequality: evidence from 67 countries," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 14(2), pages 345-376, June.
    11. Jin Zhang, 2020. "Consistency of MLE, LSE and M-estimation under mild conditions," Statistical Papers, Springer, vol. 61(1), pages 189-199, February.
    12. Norbert Christopeit & Michael Massmann, 2010. "Consistent Estimation of Structural Parameters in Regression Models with Adaptive Learning," Tinbergen Institute Discussion Papers 10-077/4, Tinbergen Institute.
    13. Arnoud V. den Boer & Bert Zwart, 2014. "Simultaneously Learning and Optimizing Using Controlled Variance Pricing," Management Science, INFORMS, vol. 60(3), pages 770-783, March.
    14. repec:cte:wsrepe:6351 is not listed on IDEAS
    15. Aiting Shen & Yu Zhang & Benqiong Xiao & Andrei Volodin, 2017. "Moment inequalities for m-negatively associated random variables and their applications," Statistical Papers, Springer, vol. 58(3), pages 911-928, September.
    16. Zimu Chen & Zhanfeng Wang & Yuan‐chin Ivan Chang, 2020. "Sequential adaptive variables and subject selection for GEE methods," Biometrics, The International Biometric Society, vol. 76(2), pages 496-507, June.
    17. Eck, Daniel J., 2018. "Bootstrapping for multivariate linear regression models," Statistics & Probability Letters, Elsevier, vol. 134(C), pages 141-149.
    18. Spodarev, Evgeny & Straka, Peter & Winter, Steffen, 2015. "Estimation of fractal dimension and fractal curvatures from digital images," Chaos, Solitons & Fractals, Elsevier, vol. 75(C), pages 134-152.
    19. Robin C. O. Palmberg & Yusak O. Susilo & Győző Gidófalvi & Fatemeh Naqavi, 2021. "Built Environment Characteristics, Daily Travel, and Biometric Readings: Creation of an Experimental Tool Based on a Smartwatch Platform," Sustainability, MDPI, vol. 13(17), pages 1-21, September.
    20. Krätschmer, Volker, 2006. "Strong consistency of least-squares estimation in linear regression models with vague concepts," Journal of Multivariate Analysis, Elsevier, vol. 97(3), pages 633-654, March.
    21. Guo-Liang Fan & Han-Ying Liang & Jiang-Feng Wang & Hong-Xia Xu, 2010. "Asymptotic properties for LS estimators in EV regression model with dependent errors," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 94(1), pages 89-103, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:stapro:v:42:y:1999:i:2:p:167-174. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.