IDEAS home Printed from https://ideas.repec.org/a/gam/jijerp/v19y2022i17p10595-d897214.html
   My bibliography  Save this article

Reliability Analysis of Observation-Based Exposure Assessment Tools for the Upper Extremities: A Systematic Review

Author

Listed:
  • Preston Riley Graben

    (3323 Shelby Center for Engineering Technology, Department of Industrial and Systems Engineering, Auburn University, Auburn, AL 36849-5346, USA)

  • Mark C. Schall

    (3323 Shelby Center for Engineering Technology, Department of Industrial and Systems Engineering, Auburn University, Auburn, AL 36849-5346, USA)

  • Sean Gallagher

    (3323 Shelby Center for Engineering Technology, Department of Industrial and Systems Engineering, Auburn University, Auburn, AL 36849-5346, USA)

  • Richard Sesek

    (3323 Shelby Center for Engineering Technology, Department of Industrial and Systems Engineering, Auburn University, Auburn, AL 36849-5346, USA)

  • Yadrianna Acosta-Sojo

    (3323 Shelby Center for Engineering Technology, Department of Industrial and Systems Engineering, Auburn University, Auburn, AL 36849-5346, USA)

Abstract

(1) Background: The objectives of this systematic review were to (i) summarize the results of studies evaluating the reliability of observational ergonomics exposure assessment tools addressing exposure to physical risk factors associated with upper extremity musculoskeletal disorders (MSDs), and (ii) identify best practices for assessing the reliability of new observational exposure assessment tools. (2) Methods: A broad search was conducted in March 2020 of four academic databases: PubMed, Science Direct, Ergonomic Abstracts, and Web of Science. Articles were systematically excluded by removing redundant articles, examining titles and abstracts, assessing relevance to physical ergonomics and the upper extremities, and article type. (3) Results: Eleven articles were included in the review. The results indicated no singular best practice; instead, there were multiple methodological approaches researchers chose to use. Some of the significant variations in methodologies include the selection of reliability coefficients, rater and participant selection, and direct vs. digital observation. (4) Conclusion: The findings serve as a resource summarizing the reliability of existing observational risk assessment tools and identify common methods for assessing the reliability of new observational risk assessment tools. Limitations of this review include the number of databases searched, the removal of truncation symbols, and the selection of keywords used for the initial search.

Suggested Citation

  • Preston Riley Graben & Mark C. Schall & Sean Gallagher & Richard Sesek & Yadrianna Acosta-Sojo, 2022. "Reliability Analysis of Observation-Based Exposure Assessment Tools for the Upper Extremities: A Systematic Review," IJERPH, MDPI, vol. 19(17), pages 1-17, August.
    • Handle: RePEc:gam:jijerp:v:19:y:2022:i:17:p:10595-:d:897214
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1660-4601/19/17/10595/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1660-4601/19/17/10595/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Robert Ebel, 1951. "Estimation of the reliability of ratings," Psychometrika, Springer;The Psychometric Society, vol. 16(4), pages 407-424, December.
    2. Morton B. Brown, 1977. "The Tetrachoric Correlation and its Asymptotic Standard Error," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 26(3), pages 343-351, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Teresia Nyman & Ida-Märta Rhén & Peter J. Johansson & Kristina Eliasson & Katarina Kjellberg & Per Lindberg & Xuelong Fan & Mikael Forsman, 2023. "Reliability and Validity of Six Selected Observational Methods for Risk Assessment of Hand Intensive and Repetitive Work," IJERPH, MDPI, vol. 20(8), pages 1-26, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ben-David, Vered, 2016. "Substance-abusing parents and their children in termination of parental rights cases in Israel," Children and Youth Services Review, Elsevier, vol. 66(C), pages 94-100.
    2. Paul Hoffman, 1963. "Test reliability and practice effects," Psychometrika, Springer;The Psychometric Society, vol. 28(3), pages 273-288, September.
    3. Kim, Yusoon & Choi, Thomas Y., 2021. "Supplier relationship strategies and outcome dualities: An empirical study of embeddedness perspective," International Journal of Production Economics, Elsevier, vol. 232(C).
    4. Mark P. Becker & Clifford C. Clogg, 1988. "A Note on Approximating Correlations from Odds Ratios," Sociological Methods & Research, , vol. 16(3), pages 407-424, February.
    5. Chung-Chou Chu & Annisse' Abi-Dargham & Bette Ackerman & Maummer Cetingok & Helen E. Klein, 1989. "Sex Differences in Schizophrenia," International Journal of Social Psychiatry, , vol. 35(3), pages 237-244, September.
    6. Reuer, Jeffrey J. & Ariño, Africa, 2002. "Contractual heterogeneity in strategic alliances," IESE Research Papers D/482, IESE Business School.
    7. Paul F. Zelhart JR & Milton S. Davis, 1973. "Therapeutic Conditions and Physician—Patient Interactions: With Comment On Criticisms of Truax's Scales," International Journal of Social Psychiatry, , vol. 19(1-2), pages 70-76, April.
    8. Walter Kristof, 1963. "Statistical inferences about the error variance," Psychometrika, Springer;The Psychometric Society, vol. 28(2), pages 129-143, June.
    9. Chung-Chou Chu & Helen E. Klein & Marcia H. Lange, 1982. "Symptomatology Differentials Between Urban and Rural Schizophrenics," International Journal of Social Psychiatry, , vol. 28(4), pages 251-255, December.
    10. Grimm, Curtis M. & Smith, Ken G., 1985. "Impact of Deregulation on Railroad on railroad strategies and performance," Transportation Research Forum Proceedings 1980s 311794, Transportation Research Forum.
    11. Baruah, Joydeep, 2012. "On Identification of Backward Blocks," MPRA Paper 47258, University Library of Munich, Germany.
    12. Nouman, Hani & Enosh, Guy & Niselbaum-Atzur, Pnina, 2016. "The role of parental communication, child's wishes and child's gender in social workers' custody recommendations," Children and Youth Services Review, Elsevier, vol. 70(C), pages 302-308.
    13. Tej Pandey & Lawrence Hubert, 1975. "An empirical comparison of several interval estimation procedures for coefficient alpha," Psychometrika, Springer;The Psychometric Society, vol. 40(2), pages 169-181, June.
    14. Azzurra Ragone & Katsiaryna Mirylenka & Fabio Casati & Maurizio Marchese, 2013. "On peer review in computer science: analysis of its effectiveness and suggestions for improvement," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(2), pages 317-356, November.
    15. Peters, C. P. & Friedman, N. & Jacobs, S. S. & Jones, B. J. & Kelley, J. M. & Nazar, K. L., 1999. "The use of client surrogates in determining the reliability of a standardized assessment instrument in multiple, diverse settings," Evaluation and Program Planning, Elsevier, vol. 22(4), pages 429-437, November.
    16. Alvaro, Cuervo-Cazurra, 2011. "Selecting the country in which to start internationalization: The non-sequential internationalization model," Journal of World Business, Elsevier, vol. 46(4), pages 426-437, October.
    17. Chung-Chou Chu & Harriet S. Sallach & Saleha A. Zakeria & Helen E. Klein, 1985. "Differences in Psychopathology between Black and White Schizophrenics," International Journal of Social Psychiatry, , vol. 31(4), pages 252-256, December.
    18. Gaylen N. Chandler & Douglas W. Lyon, 2009. "Involvement in Knowledge–Acquisition Activities by Venture Team Members and Venture Performance," Entrepreneurship Theory and Practice, , vol. 33(3), pages 571-592, May.
    19. Chung-Chou Chu & Soa Yuc Lee & Harriet S. Sallach & Muammer Cçetingök & Helen E. Klein, 1986. "Symptom Differences Between Urban and Rural Schizophrenics in Turkey," International Journal of Social Psychiatry, , vol. 32(3), pages 65-71, September.
    20. Joseph Fleiss, 1965. "Estimating the accuracy of dichotomous judgments," Psychometrika, Springer;The Psychometric Society, vol. 30(4), pages 469-479, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jijerp:v:19:y:2022:i:17:p:10595-:d:897214. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.