IDEAS home Printed from https://ideas.repec.org/p/cdl/agrebk/qt8z25j0w3.html
   My bibliography  Save this paper

A Semi-Parametric Basis for Combining Estimation Problems Under Quadratic Loss

Author

Listed:
  • Judge, George G.
  • Mittelhammer, Ron C

Abstract

When there is uncertainty concerning the appropriate statistical model to use in representing the data sampling process and corresponding estimators, we consider a basis for optimally combining estimation problems. In the context of the multivariate linear statistical model, we consider a semi-parametric Stein-like (SPSL) estimator, B( ), that shrinks to a random data-dependent vector and, under quadratic loss, has superior performance relative to the conventional least squares estimator. The relationship of the SPSL estimator to the family of Stein estimators is noted and risk dominance extensions between correlated estimators are demonstrated. As an application we consider the problem of a possibly ill-conditioned design matrix and devise a corresponding SPSL estimator. Asymptotic and analytic finite sample risk properties of the estimator are demonstrated. An extensive sampling experiment is used to investigate finite sample performance over a wide range of data sampling processes to illustrate the robustness of the estimator for an array of symmetric and skewed distributions. Bootstrapping procedures are used to develop confidence sets and a basis for inference.

Suggested Citation

  • Judge, George G. & Mittelhammer, Ron C, 2003. "A Semi-Parametric Basis for Combining Estimation Problems Under Quadratic Loss," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt8z25j0w3, Department of Agricultural & Resource Economics, UC Berkeley.
    • Handle: RePEc:cdl:agrebk:qt8z25j0w3
    as

    Download full text from publisher

    File URL: https://www.escholarship.org/uc/item/8z25j0w3.pdf;origin=repeccitec
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Kim T-H. & White H., 2001. "James-Stein-Type Estimators in Large Samples With Application to the Least Absolute Deviations Estimator," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 697-705, June.
    2. Ullah, Aman & Ullah, Shobha, 1978. "Double k-Class Estimators of Coefficients in Linear Regression," Econometrica, Econometric Society, vol. 46(3), pages 705-722, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marian Grendar & George Judge, 2008. "Large-Deviations Theory and Empirical Estimator Choice," Econometric Reviews, Taylor & Francis Journals, vol. 27(4-6), pages 513-525.
    2. Miller, Douglas J. & Mittelhammer, Ronald C. & Judge, George G., 2004. "Entropy-Based Estimation And Inference In Binary Response Models Under Endogeneity," 2004 Annual meeting, August 1-4, Denver, CO 20319, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    3. Tae-Hwan Kim & Christophe Muller, 2020. "Inconsistency transmission and variance reduction in two-stage quantile regression," Post-Print hal-02084505, HAL.
    4. Raheem, S.M. Enayetur & Ahmed, S. Ejaz & Doksum, Kjell A., 2012. "Absolute penalty and shrinkage estimation in partially linear models," Computational Statistics & Data Analysis, Elsevier, vol. 56(4), pages 874-891.
    5. Mittelhammer, Ron C. & Judge, George G., 2005. "Combining estimators to improve structural model estimation and inference under quadratic loss," Journal of Econometrics, Elsevier, vol. 128(1), pages 1-29, September.
    6. Mittelhammer, Ron C & Judge, George G. & Miller, Douglas J & Cardell, N. Scott, 2005. "Minimum Divergence Moment Based Binary Response Models: Estimation and Inference," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt1546s6rn, Department of Agricultural & Resource Economics, UC Berkeley.
    7. Ruoyao Shi, 2021. "An Averaging Estimator for Two Step M Estimation in Semiparametric Models," Working Papers 202105, University of California at Riverside, Department of Economics.
    8. Shakhawat Hossain & Trevor Thomson & Ejaz Ahmed, 2018. "Shrinkage estimation in linear mixed models for longitudinal data," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 81(5), pages 569-586, July.
    9. Judge, George G. & Mittelhammer, Ron C, 2004. "Estimating the Link Function in Multinomial Response Models under Endogeneity and Quadratic Loss," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt4422n50w, Department of Agricultural & Resource Economics, UC Berkeley.
    10. Marchand, Éric & Strawderman, William E., 2020. "On shrinkage estimation for balanced loss functions," Journal of Multivariate Analysis, Elsevier, vol. 175(C).
    11. Shakhawat Hossain & Shahedul A. Khan, 2020. "Shrinkage estimation of the exponentiated Weibull regression model for time‐to‐event data," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 74(4), pages 592-610, November.
    12. Cl'ement de Chaisemartin & Xavier D'Haultf{oe}uille, 2020. "Empirical MSE Minimization to Estimate a Scalar Parameter," Papers 2006.14667, arXiv.org.
    13. Joshua D. Angrist & Peter D. Hull & Parag A. Pathak & Christopher R. Walters, 2017. "Leveraging Lotteries for School Value-Added: Testing and Estimation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(2), pages 871-919.
    14. Judge, George G. & Mittelhammer, Ron C., 2007. "Estimation and inference in the case of competing sets of estimating equations," Journal of Econometrics, Elsevier, vol. 138(2), pages 513-531, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zou, Guohua & Wan, Alan T.K. & Wu, Xiaoyong & Chen, Ti, 2007. "Estimation of regression coefficients of interest when other regression coefficients are of no interest: The case of non-normal errors," Statistics & Probability Letters, Elsevier, vol. 77(8), pages 803-810, April.
    2. Judge G.G. & Mittelhammer R.C., 2004. "A Semiparametric Basis for Combining Estimation Problems Under Quadratic Loss," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 479-487, January.
    3. Clarke, Judith A., 2008. "On weighted estimation in linear regression in the presence of parameter uncertainty," Economics Letters, Elsevier, vol. 100(1), pages 1-3, July.
    4. Akio Namba, 2003. "On the use of the Stein variance estimator in the double k-class estimator when each individual regression coefficient is estimated," Statistical Papers, Springer, vol. 44(1), pages 117-124, January.
    5. Wan, Alan T. K. & Chaturvedi, Anoop, 2001. "Double k-Class Estimators in Regression Models with Non-spherical Disturbances," Journal of Multivariate Analysis, Elsevier, vol. 79(2), pages 226-250, November.
    6. Kazuhiro Ohtani & Alan Wan, 2002. "ON THE USE OF THE STEIN VARIANCE ESTIMATOR IN THE DOUBLE k-CLASS ESTIMATOR IN REGRESSION," Econometric Reviews, Taylor & Francis Journals, vol. 21(1), pages 121-134.
    7. Tae-Hwan Kim & Christophe Muller, 2012. "Bias Transmission and Variance Reduction in Two-Stage Quantile Regression," Working Papers halshs-00793372, HAL.
    8. Tran Van Hoa, 2002. "WTO Membership for China and Its Impact on Growth, Investment and Consumption: A New Flexible Keynesian Approach," Economics Working Papers wp02-04, School of Economics, University of Wollongong, NSW, Australia.
    9. Namba, Akio, 2003. "PMSE dominance of the positive-part shrinkage estimator in a regression model when relevant regressors are omitted," Statistics & Probability Letters, Elsevier, vol. 63(4), pages 375-385, July.
    10. Pal, Amresh Bahadur & Dubey, Ashutosh Kumar & Chaturvedi, Anoop, 2016. "Shrinkage estimation in spatial autoregressive model," Journal of Multivariate Analysis, Elsevier, vol. 143(C), pages 362-373.
    11. An, Lihua & Nkurunziza, Sévérien & Fung, Karen Y. & Krewski, Daniel & Luginaah, Isaac, 2009. "Shrinkage estimation in general linear models," Computational Statistics & Data Analysis, Elsevier, vol. 53(7), pages 2537-2549, May.
    12. Chaturvedi, Anoop & Shalabh, 2004. "Risk and Pitman closeness properties of feasible generalized double k-class estimators in linear regression models with non-spherical disturbances under balanced loss function," Journal of Multivariate Analysis, Elsevier, vol. 90(2), pages 229-256, August.
    13. Ohtani, Kazuhiro, 2001. "MSE dominance of the pre-test iterative variance estimator over the iterative variance estimator in regression," Statistics & Probability Letters, Elsevier, vol. 54(3), pages 331-340, October.
    14. Tran Van Hoa, 2003. "Growth of Asian Regional Trade and Income Convergence: Evidence from ASEAN+3 Based on Extended Helpman-Krugman Hypothesis and Flexible Modelling Approach," Economics Working Papers wp03-02, School of Economics, University of Wollongong, NSW, Australia.
    15. Judith Anne Clarke, 2017. "Model Averaging OLS and 2SLS: An Application of the WALS Procedure," Econometrics Working Papers 1701, Department of Economics, University of Victoria.
    16. Ullah, A. & Vinod, H. D. & Kadiyala, R. K., 1978. "A Family Of Improved Ordinary Ridge Estimators," Econometric Institute Archives 272169, Erasmus University Rotterdam.
    17. Tran Van Hoa, 2000. "Recent Significant Advances in Estimating and Forecasting Theories and Economic Modelling: With Applications to Asian Investment Studies," Economics Working Papers wp00-01, School of Economics, University of Wollongong, NSW, Australia.
    18. Shalabh, & Garg, G. & Heumann, C., 2012. "Performance of double k-class estimators for coefficients in linear regression models with non-spherical disturbances under asymmetric losses," Journal of Multivariate Analysis, Elsevier, vol. 112(C), pages 35-47.
    19. Muhammad Qasim, 2024. "A weighted average limited information maximum likelihood estimator," Statistical Papers, Springer, vol. 65(5), pages 2641-2666, July.
    20. Chaturvedi, Anoop & Gupta, Suchita & Bhatti, M. Ishaq, 2012. "Confidence ellipsoids based on a general family of shrinkage estimators for a linear model with non-spherical disturbances," Journal of Multivariate Analysis, Elsevier, vol. 104(1), pages 140-158, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cdl:agrebk:qt8z25j0w3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Lisa Schiff (email available below). General contact details of provider: https://edirc.repec.org/data/dabrkus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.