IDEAS home Printed from https://ideas.repec.org/a/eee/stapro/v82y2012i1p58-62.html
   My bibliography  Save this article

Asymptotic efficiency of ridge estimator in linear and semiparametric linear models

Author

Listed:
  • Luo, June

Abstract

The linear model with a growing number of predictors arises in many contemporary scientific endeavor. In this article, we consider the commonly used ridge estimator in linear models. We propose analyzing the ridge estimator for a finite sample size n and a growing dimension p. The existence and asymptotic normality of the ridge estimator are established under some regularity conditions when p→∞. It also occurs that a strictly linear model is inadequate when some of the relations are believed to be of certain linear form while others are not easily parameterized, and thus a semiparametric partial linear model is considered. For these semiparametric partial linear models with p>n, we develop a procedure to estimate the linear coefficients as if the nonparametric part is not present. The asymptotic efficiency of the proposed estimator for the linear component is studied for p→∞. It is shown that the proposed estimator of the linear component asymptotically performs very well.

Suggested Citation

  • Luo, June, 2012. "Asymptotic efficiency of ridge estimator in linear and semiparametric linear models," Statistics & Probability Letters, Elsevier, vol. 82(1), pages 58-62.
    • Handle: RePEc:eee:stapro:v:82:y:2012:i:1:p:58-62
    DOI: 10.1016/j.spl.2011.08.019
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167715211002835
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.spl.2011.08.019?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Luo, June, 2010. "The discovery of mean square error consistency of a ridge estimator," Statistics & Probability Letters, Elsevier, vol. 80(5-6), pages 343-347, March.
    2. Shao, Jun & Chow, Shein-Chung, 2007. "Variable screening in predicting clinical outcome with high-dimensional microarrays," Journal of Multivariate Analysis, Elsevier, vol. 98(8), pages 1529-1538, September.
    3. Ahn, Hyungtaik & Powell, James L., 1993. "Semiparametric estimation of censored selection models with a nonparametric selection mechanism," Journal of Econometrics, Elsevier, vol. 58(1-2), pages 3-29, July.
    4. Lam, Clifford & Fan, Jianqing, 2008. "Profile-kernel likelihood inference with diverging number of parameters," LSE Research Online Documents on Economics 31548, London School of Economics and Political Science, LSE Library.
    5. A. Yatchew, 2000. "Scale economies in electricity distribution: a semiparametric analysis," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(2), pages 187-210.
    6. Yatchew, A., 1997. "An elementary estimator of the partial linear model," Economics Letters, Elsevier, vol. 57(2), pages 135-143, December.
    7. Fan J. & Huang L-S., 2001. "Goodness-of-Fit Tests for Parametric Regression Models," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 640-652, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Luo, June & Kulasekera, K.B., 2013. "Error covariance matrix estimation using ridge estimator," Statistics & Probability Letters, Elsevier, vol. 83(1), pages 257-264.
    2. Luo, June & Gerard, Patrick, 2013. "Using thresholding difference-based estimators for variable selection in partial linear models," Statistics & Probability Letters, Elsevier, vol. 83(12), pages 2601-2606.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Luo, June & Gerard, Patrick, 2013. "Using thresholding difference-based estimators for variable selection in partial linear models," Statistics & Probability Letters, Elsevier, vol. 83(12), pages 2601-2606.
    2. Fikri Akdeniz & Mahdi Roozbeh, 2019. "Generalized difference-based weighted mixed almost unbiased ridge estimator in partially linear models," Statistical Papers, Springer, vol. 60(5), pages 1717-1739, October.
    3. Dette, Holger & Marchlewski, Mareen, 2007. "A test for the parametric form of the variance function in apartial linear regression model," Technical Reports 2007,26, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    4. Shen, Leilei, 2013. "Financial dependence and growth: Diminishing returns to improvement in financial development," Economics Letters, Elsevier, vol. 120(2), pages 215-219.
    5. Akdeniz Duran, Esra & Härdle, Wolfgang Karl & Osipenko, Maria, 2012. "Difference based ridge and Liu type estimators in semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 105(1), pages 164-175.
    6. Justin McCrary & Heather Royer, 2011. "The Effect of Female Education on Fertility and Infant Health: Evidence from School Entry Policies Using Exact Date of Birth," American Economic Review, American Economic Association, vol. 101(1), pages 158-195, February.
    7. Justin L. Tobias, 2003. "Are Returns to Schooling Concentrated Among the Most Able? A Semiparametric Analysis of the Ability–earnings Relationships," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 65(1), pages 1-29, February.
    8. Shen, Chung-Wei & Tsou, Tsung-Shan & Balakrishnan, N., 2011. "Robust likelihood inference for regression parameters in partially linear models," Computational Statistics & Data Analysis, Elsevier, vol. 55(4), pages 1696-1714, April.
    9. Yatchew, A., 1999. "An elementary nonparametric differencing test of equality of regression functions," Economics Letters, Elsevier, vol. 62(3), pages 271-278, March.
    10. Takahiro ITO, 2024. "Binary and Ordered Response Models in Randomized Experiments: Applications of the Resampling-Based Maximum Likelihood Method," GSICS Working Paper Series 42, Graduate School of International Cooperation Studies, Kobe University.
    11. Chien-Chia L. Huang & Yow-Jen Jou & Hsun-Jung Cho, 2017. "Difference-based matrix perturbation method for semi-parametric regression with multicollinearity," Journal of Applied Statistics, Taylor & Francis Journals, vol. 44(12), pages 2161-2171, September.
    12. Luo, June & Kulasekera, K.B., 2013. "Error covariance matrix estimation using ridge estimator," Statistics & Probability Letters, Elsevier, vol. 83(1), pages 257-264.
    13. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, volume 1, number 8355.
    14. John DiNardo & Justin L. Tobias, 2001. "Nonparametric Density and Regression Estimation," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 11-28, Fall.
    15. Gao, Jiti & Tong, Howell & Wolff, Rodney, 2002. "Model Specification Tests in Nonparametric Stochastic Regression Models," Journal of Multivariate Analysis, Elsevier, vol. 83(2), pages 324-359, November.
    16. James J. Heckman & Petra E. Todd, 2009. "A note on adapting propensity score matching and selection models to choice based samples," Econometrics Journal, Royal Economic Society, vol. 12(s1), pages 230-234, January.
    17. Agrell, Per J. & Teusch, Jonas, 2020. "Predictability and strategic behavior under frontier regulation," Energy Policy, Elsevier, vol. 137(C).
    18. Rahman, Aminur & Sawada, Yasuyuki, 2012. "Can donor coordination solve the aid proliferation problem?," Economics Letters, Elsevier, vol. 116(3), pages 609-612.
    19. Ichimura, Hidehiko & Todd, Petra E., 2007. "Implementing Nonparametric and Semiparametric Estimators," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 74, Elsevier.
    20. Bryan S. Graham & Fengshi Niu & James L. Powell, 2019. "Kernel density estimation for undirected dyadic data," CeMMAP working papers CWP39/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:stapro:v:82:y:2012:i:1:p:58-62. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.