IDEAS home Printed from https://ideas.repec.org/a/taf/amstat/v70y2016i4p325-334.html
   My bibliography  Save this article

Assessing Equality of Means Using the Overlap of Range-Preserving Confidence Intervals

Author

Listed:
  • Kimihiro Noguchi
  • Fernando Marmolejo-Ramos

Abstract

Hypothesis testing procedures where equality of means is assessed at a prespecified level based on the (non-)overlap of confidence intervals are discussed. Assessing statistical significance via the (non-)overlap of two confidence intervals with an appropriate confidence level provides a simple and effective way of visually understanding statistical results. This article extends previous approaches by considering range-preserving confidence intervals where the values in such intervals are in the allowable range of the parameter of interest. To obtain reliable procedures, appropriate effective degrees of freedom are suggested by considering the Welch-Satterthwaite equation for both independent two-sample and paired-sample cases. The proposed procedures also allow users to express results in terms of commonly used scale-free effect sizes, which are highly useful for interpreting parameters of interest. Simulation results suggest that the proposed procedures may be robust to unequal or small sample sizes, nonnormal distributions, heterogeneous variances, and various degrees of correlation. A real-life application from a study in cognitive psychology illustrates the effectiveness of the proposed procedures.

Suggested Citation

  • Kimihiro Noguchi & Fernando Marmolejo-Ramos, 2016. "Assessing Equality of Means Using the Overlap of Range-Preserving Confidence Intervals," The American Statistician, Taylor & Francis Journals, vol. 70(4), pages 325-334, October.
    • Handle: RePEc:taf:amstat:v:70:y:2016:i:4:p:325-334
    DOI: 10.1080/00031305.2016.1200487
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/00031305.2016.1200487
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/00031305.2016.1200487?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Harvey Goldstein & Michael J. R. Healy, 1995. "The Graphical Presentation of a Collection of Means," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 158(1), pages 175-177, January.
    2. Afshartous, David & Preston, Richard A., 2010. "Confidence intervals for dependent data: Equating non-overlap with statistical significance," Computational Statistics & Data Analysis, Elsevier, vol. 54(10), pages 2296-2305, October.
    3. Aurore Delaigle & Peter Hall & Jiashun Jin, 2011. "Robustness and accuracy of methods for high dimensional data analysis based on Student's t‐statistic," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 73(3), pages 283-301, June.
    4. U. Munzel, 1999. "Nonparametric methods for paired samples," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 53(3), pages 277-286, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ryan C. Erps & Kimihiro Noguchi, 2020. "A Robust Test for Checking the Homogeneity of Variability Measures and Its Application to the Analysis of Implicit Attitudes," Journal of Educational and Behavioral Statistics, , vol. 45(4), pages 403-425, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Columbu, Silvia & Porcu, Mariano & Sulis, Isabella, 2021. "University choice and the attractiveness of the study area: Insights on the differences amongst degree programmes in Italy based on generalised mixed-effect models," Socio-Economic Planning Sciences, Elsevier, vol. 74(C).
    2. Giorgio E. Montanari & Marco Doretti, 2019. "Ranking Nursing Homes’ Performances Through a Latent Markov Model with Fixed and Random Effects," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 146(1), pages 307-326, November.
    3. Brini, Elisa & Borgen, Solveig Topstad & Borgen, Nicolai T., 2023. "Avoiding the eyeballing fallacy: Visualizing statistical differences between estimates using the pheatplot command," SocArXiv fghcd, Center for Open Science.
    4. Pickery, Jan, 2002. "Contextual effects on the vote in Germany: A multilevel analysis," Discussion Papers, Research Unit: Institutions and Social Change FS III 02-202, WZB Berlin Social Science Center.
    5. Chang, Meng-Shiuh & Wu, Ximing, 2015. "Transformation-based nonparametric estimation of multivariate densities," Journal of Multivariate Analysis, Elsevier, vol. 135(C), pages 71-88.
    6. Omar Paccagnella, 2006. "Centering or Not Centering in Multilevel Models? The Role of the Group Mean and the Assessment of Group Effects," Evaluation Review, , vol. 30(1), pages 66-85, February.
    7. Tim Goedemé & Karel Van den Bosch & Lina Salanauskaite & Gerlinde Verbist, 2013. "Testing the Statistical Significance of Microsimulation Results: Often Easier than You Think. A Technical Note," ImPRovE Working Papers 13/10, Herman Deleeck Centre for Social Policy, University of Antwerp.
    8. Chen, Song Xi & Guo, Bin & Qiu, Yumou, 2023. "Testing and signal identification for two-sample high-dimensional covariances via multi-level thresholding," Journal of Econometrics, Elsevier, vol. 235(2), pages 1337-1354.
    9. Mikula, Stepan & Montag, Josef, 2023. "Roma and Bureaucrats: A Field Experiment on Ethnic and Socioeconomic Discrimination," IZA Discussion Papers 16218, Institute of Labor Economics (IZA).
    10. Yu-Cheng Ku & Tsun-Feng Chiang & Sheng-Mao Chang, 2017. "Is what you choose what you want?—outlier detection in choice-based conjoint analysis," Marketing Letters, Springer, vol. 28(1), pages 29-42, March.
    11. Eleonora Trappolini & Giammarco Alderotti, 2023. "Migrants’ health in Italy: do the union status and the partner’s nationality matter? (Best Young Researcher Paper 2023)," RIEDS - Rivista Italiana di Economia, Demografia e Statistica - The Italian Journal of Economic, Demographic and Statistical Studies, SIEDS Societa' Italiana di Economia Demografia e Statistica, vol. 77(2), pages 179-189, April-Jun.
    12. S. Bacci & B. Bertaccini, 2021. "Assessment of the University Reputation Through the Analysis of the Student Mobility," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 156(2), pages 363-388, August.
    13. De Novellis, G. & Musile Tanzi, P. & Ranalli, M.G. & Stanghellini, E., 2024. "Leveraged finance exposure in the banking system: Systemic risk and interconnectedness," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 90(C).
    14. Eleonora Trappolini & Cristina Giudici, 2021. "Gendering health differences between nonmigrants and migrants by duration of stay in Italy," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 45(7), pages 221-258.
    15. Giammarco Alderotti & Cecilia Tomassini & Daniele Vignoli, 2022. "‘Silver splits’ in Europe: The role of grandchildren and other correlates," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 46(21), pages 619-652.
    16. Dennis Dobler & Markus Pauly, 2018. "Bootstrap- and permutation-based inference for the Mann–Whitney effect for right-censored and tied data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 27(3), pages 639-658, September.
    17. Nianbo Dong & Mark W. Lipsey, 2018. "Can Propensity Score Analysis Approximate Randomized Experiments Using Pretest and Demographic Information in Pre-K Intervention Research?," Evaluation Review, , vol. 42(1), pages 34-70, February.
    18. Feng Xu & Xiaogang He & Xueru Yang, 2021. "A Multilevel Approach Linking Entrepreneurial Contexts to Subjective Well-Being: Evidence from Rural Chinese Entrepreneurs," Journal of Happiness Studies, Springer, vol. 22(4), pages 1537-1561, April.
    19. Victoor, Aafke & Hansen, Johan & van den Akker-van Marle, M. Elske & van den Berg, Bernard & van den Hout, Wilbert B. & de Jong, Judith D., 2014. "Choosing your health insurance package: A method for measuring the public's preferences for changes in the national health insurance plan," Health Policy, Elsevier, vol. 117(2), pages 257-265.
    20. Andrew James Williams & Katrina M Wyatt & Craig A Williams & Stuart Logan & William E Henley, 2015. "Exploring the Potential of a School Impact on Pupil Weight Status: Exploratory Factor Analysis and Repeat Cross-Sectional Study of the National Child Measurement Programme," PLOS ONE, Public Library of Science, vol. 10(12), pages 1-23, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:amstat:v:70:y:2016:i:4:p:325-334. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/UTAS20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.