IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v126y2014icp137-152.html
   My bibliography  Save this article

Coefficient of determination for multiple measurement error models

Author

Listed:
  • Cheng, C.-L.
  • Shalabh,
  • Garg, G.

Abstract

The coefficient of determination (R2) is used for judging the goodness of fit in a linear regression model. It is the square of the multiple correlation coefficient between the study and explanatory variables based on the sample values. It gives valid results only when the observations are correctly observed without any measurement error. The conventional R2 provides invalid results in the presence of measurement errors in the data because the sample R2 becomes an inconsistent estimator of its population counterpart which is the square of the population multiple correlation coefficient between the study and explanatory variables. The goodness of fit statistics based on the variants of R2 for multiple measurement error models have been proposed in this paper. These variants are based on the utilization of the two forms of additional information from outside the sample. The two forms are the known covariance matrix of measurement errors associated with the explanatory variables and the known reliability matrix associated with the explanatory variables. The asymptotic properties of the conventional R2 and the proposed variants of R2 like goodness of fit statistics have been studied analytically and numerically.

Suggested Citation

  • Cheng, C.-L. & Shalabh, & Garg, G., 2014. "Coefficient of determination for multiple measurement error models," Journal of Multivariate Analysis, Elsevier, vol. 126(C), pages 137-152.
    • Handle: RePEc:eee:jmvana:v:126:y:2014:i:c:p:137-152
    DOI: 10.1016/j.jmva.2014.01.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X14000141
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2014.01.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Chi-Lun Cheng & Alexander Kukush, 2006. "Non-Existence of the First Moment of the Adjusted Least Squares Estimator in Multivariate Errors-in-Variables Model," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 64(1), pages 41-46, August.
    2. Eshima, Nobuoki & Tabata, Minoru, 2011. "Three predictive power measures for generalized linear models: The entropy coefficient of determination, the entropy correlation coefficient and the regression correlation coefficient," Computational Statistics & Data Analysis, Elsevier, vol. 55(11), pages 3049-3058, November.
    3. Knight, John L., 1980. "The coefficient of determination and simultaneous equation systems," Journal of Econometrics, Elsevier, vol. 14(2), pages 265-270, October.
    4. Shalabh & Garg, Gaurav & Misra, Neeraj, 2009. "Use of prior information in the consistent estimation of regression coefficients in measurement error models," Journal of Multivariate Analysis, Elsevier, vol. 100(7), pages 1498-1520, August.
    5. H. Schneeweiß, 1976. "Consistent estimation of a regression with errors in the variables," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 23(1), pages 101-115, December.
    6. Shalabh, 1998. "Improved Estimation in Measurement Error Models Through Stein Rule Procedure," Journal of Multivariate Analysis, Elsevier, vol. 67(1), pages 35-48, October.
    7. Marchand Éric, 2001. "Point Estimation Of The Coefficient Of Determination," Statistics & Risk Modeling, De Gruyter, vol. 19(2), pages 137-154, February.
    8. Gleser, Leon Jay, 1993. "Estimators of slopes in linear errors-invariables regression models when the predictors have known reliability matrix," Statistics & Probability Letters, Elsevier, vol. 17(2), pages 113-121, May.
    9. Ohtani, Kazuhiro & Hasegawa, Hikaru, 1993. "On Small Sample Properties of R2 in a Linear Regression Model with Multivariate t Errors and Proxy Variables," Econometric Theory, Cambridge University Press, vol. 9(3), pages 504-515, June.
    10. Cramer, J. S., 1987. "Mean and variance of R2 in small and moderate samples," Journal of Econometrics, Elsevier, vol. 35(2-3), pages 253-266, July.
    11. Hilliard, Jimmy E. & Lloyd, William P., 1980. "Coefficient of determination in a simultaneous equation model: A pedagogic note," Journal of Business Research, Elsevier, vol. 8(1), pages 1-6, March.
    12. Liao J.G. & McGee D., 2003. "Adjusted Coefficients of Determination for Logistic Regression," The American Statistician, American Statistical Association, vol. 57, pages 161-165, August.
    13. McKean, Joseph W. & Sievers, Gerald L., 1987. "Coefficients of determination for least absolute deviation analysis," Statistics & Probability Letters, Elsevier, vol. 5(1), pages 49-54, January.
    14. Shalabh & Gaurav Garg & Neeraj Misra, 2010. "Consistent estimation of regression coefficients in ultrastructural measurement error model using stochastic prior information," Statistical Papers, Springer, vol. 51(3), pages 717-748, September.
    15. Tjur, Tue, 2009. "Coefficients of Determination in Logistic Regression Models—A New Proposal: The Coefficient of Discrimination," The American Statistician, American Statistical Association, vol. 63(4), pages 366-372.
    16. Ullah, Aman & Srivastava, Virendra K., 1994. "Moments of the ratio of quadratic forms in non-normal variables with econometric examples," Journal of Econometrics, Elsevier, vol. 62(2), pages 129-141, June.
    17. Shalabh & Garg, Gaurav & Misra, Neeraj, 2007. "Restricted regression estimation in measurement error models," Computational Statistics & Data Analysis, Elsevier, vol. 52(2), pages 1149-1166, October.
    18. Ohtani, Kazuhiro, 1994. "The density functions of R2 and , and their risk performance under asymmetric loss in misspecified linear regression models," Economic Modelling, Elsevier, vol. 11(4), pages 463-471, October.
    19. Eshima, Nobuoki & Tabata, Minoru, 2010. "Entropy coefficient of determination for generalized linear models," Computational Statistics & Data Analysis, Elsevier, vol. 54(5), pages 1381-1389, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fausto André Valenzuela-Domínguez & Luis Alfonso Santa Cruz & Enrique A. Enríquez-Velásquez & Luis C. Félix-Herrán & Victor H. Benitez & Jorge de-J. Lozoya-Santos & Ricardo A. Ramírez-Mendoza, 2021. "Solar Irradiation Evaluation through GIS Analysis Based on Grid Resolution and a Mathematical Model: A Case Study in Northeast Mexico," Energies, MDPI, vol. 14(19), pages 1-37, October.
    2. Bresson Georges & Chaturvedi Anoop & Rahman Mohammad Arshad & Shalabh, 2021. "Seemingly unrelated regression with measurement error: estimation via Markov Chain Monte Carlo and mean field variational Bayes approximation," The International Journal of Biostatistics, De Gruyter, vol. 17(1), pages 75-97, May.
    3. Farzin Golzar & David Nilsson & Viktoria Martin, 2020. "Forecasting Wastewater Temperature Based on Artificial Neural Network (ANN) Technique and Monte Carlo Sensitivity Analysis," Sustainability, MDPI, vol. 12(16), pages 1-17, August.
    4. Oana Vlăduţ & George Eduard Grigore & Dumitru Alexandru Bodislav & Gabriel Ilie Staicu & Raluca Iuliana Georgescu, 2024. "Analysing the Connection between Economic Growth, Conventional Energy, and Renewable Energy: A Comparative Analysis of the Caspian Countries," Energies, MDPI, vol. 17(1), pages 1-30, January.
    5. Cheng, C.-L. & Shalabh, & Garg, G., 2016. "Goodness of fit in restricted measurement error models," Journal of Multivariate Analysis, Elsevier, vol. 145(C), pages 101-116.
    6. Hammad Tahir & Muhammad Basit Khan & Nasir Shafiq & Dorin Radu & Marijana Hadzima Nyarko & Ahsan Waqar & Hamad R. Almujibah & Omrane Benjeddou, 2023. "Optimisation of Mechanical Characteristics of Alkali-Resistant Glass Fibre Concrete towards Sustainable Construction," Sustainability, MDPI, vol. 15(14), pages 1-25, July.
    7. Tomasz Chrulski & Mariusz Łaciak, 2021. "Analysis of Natural Gas Consumption Interdependence for Polish Industrial Consumers on the Basis of an Econometric Model," Energies, MDPI, vol. 14(22), pages 1-26, November.
    8. Muhammad Riaz Hasib Hossain & Muhammad Ashad Kabir, 2023. "Machine Learning Techniques for Estimating Soil Moisture from Smartphone Captured Images," Agriculture, MDPI, vol. 13(3), pages 1-25, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cheng, C.-L. & Shalabh, & Garg, G., 2016. "Goodness of fit in restricted measurement error models," Journal of Multivariate Analysis, Elsevier, vol. 145(C), pages 101-116.
    2. Sukhbir Singh & Kanchan Jain & Suresh Sharma, 2014. "Replicated measurement error model under exact linear restrictions," Statistical Papers, Springer, vol. 55(2), pages 253-274, May.
    3. Shalabh & Garg, Gaurav & Misra, Neeraj, 2009. "Use of prior information in the consistent estimation of regression coefficients in measurement error models," Journal of Multivariate Analysis, Elsevier, vol. 100(7), pages 1498-1520, August.
    4. Jain, Kanchan & Singh, Sukhbir & Sharma, Suresh, 2011. "Restricted estimation in multivariate measurement error regression model," Journal of Multivariate Analysis, Elsevier, vol. 102(2), pages 264-280, February.
    5. Ohtani, Kazuhiro, 2000. "Bootstrapping R2 and adjusted R2 in regression analysis," Economic Modelling, Elsevier, vol. 17(4), pages 473-483, December.
    6. Kim, H.M. & Saleh, A.K.Md.Ehsanes, 2005. "Improved estimation of regression parameters in measurement error models," Journal of Multivariate Analysis, Elsevier, vol. 95(2), pages 273-300, August.
    7. Liang, Hua & Song, Weixing, 2009. "Improved estimation in multiple linear regression models with measurement error and general constraint," Journal of Multivariate Analysis, Elsevier, vol. 100(4), pages 726-741, April.
    8. Saleh, A.K.Md. Ehsanes & Shalabh,, 2014. "A ridge regression estimation approach to the measurement error model," Journal of Multivariate Analysis, Elsevier, vol. 123(C), pages 68-84.
    9. Takeshi Kurosawa & Francis K.C. Hui & A.H. Welsh & Kousuke Shinmura & Nobuoki Eshima, 2020. "On goodness‐of‐fit measures for Poisson regression models," Australian & New Zealand Journal of Statistics, Australian Statistical Publishing Association Inc., vol. 62(3), pages 340-366, September.
    10. Singh, Sukhbir & Jain, Kanchan & Sharma, Suresh, 2012. "Using stochastic prior information in consistent estimation of regression coefficients in replicated measurement error model," Journal of Multivariate Analysis, Elsevier, vol. 111(C), pages 198-212.
    11. Schneeweiss, H. & Shalabh, H., 2007. "On the estimation of the linear relation when the error variances are known," Computational Statistics & Data Analysis, Elsevier, vol. 52(2), pages 1143-1148, October.
    12. Shalabh, 1998. "Improved Estimation in Measurement Error Models Through Stein Rule Procedure," Journal of Multivariate Analysis, Elsevier, vol. 67(1), pages 35-48, October.
    13. Michael Hagerty & V. Srinivasan, 1991. "Comparing the predictive powers of alternative multiple regression models," Psychometrika, Springer;The Psychometric Society, vol. 56(1), pages 77-85, March.
    14. Daifeng Xiang & Gangsheng Wang & Jing Tian & Wanyu Li, 2023. "Global patterns and edaphic-climatic controls of soil carbon decomposition kinetics predicted from incubation experiments," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    15. Zichen Zhang & Ye Eun Bae & Jonathan R. Bradley & Lang Wu & Chong Wu, 2022. "SUMMIT: An integrative approach for better transcriptomic data imputation improves causal gene identification," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    16. Laura H. Antão & Benjamin Weigel & Giovanni Strona & Maria Hällfors & Elina Kaarlejärvi & Tad Dallas & Øystein H. Opedal & Janne Heliölä & Heikki Henttonen & Otso Huitu & Erkki Korpimäki & Mikko Kuuss, 2022. "Climate change reshuffles northern species within their niches," Nature Climate Change, Nature, vol. 12(6), pages 587-592, June.
    17. Giulio Bottazzi & Marco Grazzi, 2014. "Dynamics Of Productivity And Cost Of Labour In Italian Manufacturing Firms," Bulletin of Economic Research, Wiley Blackwell, vol. 66(S1), pages 55-73, December.
    18. Shalabh & Gaurav Garg & Neeraj Misra, 2010. "Consistent estimation of regression coefficients in ultrastructural measurement error model using stochastic prior information," Statistical Papers, Springer, vol. 51(3), pages 717-748, September.
    19. Noh, Hohsuk & El Ghouch, Anouar & Van Keilegom, Ingrid, 2013. "Assessing model adequacy in possibly misspecified quantile regression," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 558-569.
    20. Mikkel Kruuse & Kasper Reming Tangbæk & Kristjan Jespersen & Caleb Gallemore, 2019. "Navigating Input and Output Legitimacy in Multi-Stakeholder Initiatives: Institutional Stewards at Work," Sustainability, MDPI, vol. 11(23), pages 1-27, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:126:y:2014:i:c:p:137-152. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.