IDEAS home Printed from https://ideas.repec.org/a/sae/somere/v31y2002i1p87-105.html
   My bibliography  Save this article

A Note on the Reliability of Ranked Items

Author

Listed:
  • DAWN M. VANLEEUWEN

    (New Mexico State University)

  • KEITH H. MANDABACH

    (New Mexico State University)

Abstract

Instruments may be designed to use either Likert-type items (ratings) or ranks to obtain priority rankings of items. Models commonly used in generalizability theory (GT) provide a basis for assessing the reliability of item measurements based on ratings. However, these commonly used models do not apply when respondents are required to rank a set of items. Unlike ratings, ranks force subject effects to zero. Furthermore, ranks violate independence assumptions, and the dependence between ranks assigned to different items affects the standard error of item mean differences and, consequently, the reliability of the item comparisons. A GT analysis for ranked items is presented and used to derive standard errors for differences between item means as well as an item measurement reliability coefficient. This analysis uses a linear model that is not typically used in GT analyses but that models those features unique to ranks.

Suggested Citation

  • Dawn M. Vanleeuwen & Keith H. Mandabach, 2002. "A Note on the Reliability of Ranked Items," Sociological Methods & Research, , vol. 31(1), pages 87-105, August.
    • Handle: RePEc:sae:somere:v:31:y:2002:i:1:p:87-105
    DOI: 10.1177/0049124102031001004
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0049124102031001004
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0049124102031001004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Kovach, Kenneth A., 1987. "What motivates employees? Workers and supervisors give different answers," Business Horizons, Elsevier, vol. 30(5), pages 58-65.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Grobelna Aleksandra, 2017. "The Perception of Job-related Motivators When Choosing a Career in the Tourism and Hospitality Industry – A Comparative Study Between Polish and Spanish Students," International Journal of Management and Economics, Warsaw School of Economics, Collegium of World Economy, vol. 53(2), pages 84-106, June.
    2. Ioan Moise Achim & Larisa Dragolea & George Bălan, 2013. "The Importance Of Employee Motivation To Increase Organizational Performance," Annales Universitatis Apulensis Series Oeconomica, Faculty of Sciences, "1 Decembrie 1918" University, Alba Iulia, vol. 2(15), pages 1-32.
    3. Nuria Calvo & Flora Calvo, 2018. "Corporate social responsibility and multiple agency theory: A case study of internal stakeholder engagement," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 25(6), pages 1223-1230, November.
    4. Silvia Lorincová & Peter Štarchoň & Dagmar Weberová & Miloš Hitka & Martina Lipoldová, 2019. "Employee Motivation as a Tool to Achieve Sustainability of Business Processes," Sustainability, MDPI, vol. 11(13), pages 1-15, June.
    5. Ljiljana Kontić & Slađana Čabrilo, 2009. "A Strategic Model For Measuring Intellectual Capital In Serbian Industrial Enterprises," Economic Annals, Faculty of Economics and Business, University of Belgrade, vol. 54(183), pages 89-118, October -.
    6. Grobelna Aleksandra & Wyszkowska-Wróbel Ewa, 2023. "Promoting hotel employees’ work engagement and its service outcomes: The critical role of intrinsic motivation," International Journal of Management and Economics, Warsaw School of Economics, Collegium of World Economy, vol. 59(3), pages 264-274, September.
    7. Tan, Teck Hong & Waheed, Amna, 2011. "Herzberg's motivation-hygiene theory and job satisfaction in the malaysian retail sector: the mediating effect of love of money," MPRA Paper 30419, University Library of Munich, Germany.
    8. Sheikh Raheel Manzoor & Ahmer Naveed & Syed Habib Shah, 2012. "Arising Sales force Motivation Due to Organizational Justice," International Journal of Learning and Development, Macrothink Institute, vol. 2(3), pages 270-282, June.
    9. Dávid Szabó & Peter Karácsony, 2021. "Analysis of employee motivation in small and medium-sized companies in western Slovakia region," Entrepreneurship and Sustainability Issues, VsI Entrepreneurship and Sustainability Center, vol. 9(2), pages 508-520, December.
    10. Dede Fahri & Kuşakcı Sümeyye, 2022. "An Up-to-Date Overview of The Motivation-Performance Relationship: A Study on the Bosnian Banking Sector," South East European Journal of Economics and Business, Sciendo, vol. 17(2), pages 96-112, December.
    11. Popescu Jenica, 2007. "WHAT MOTIVATES EMPLOYEES OF BANKING SYSTEM Abstract The relationship between people and their work has long attracted psychologists, behavioral scientists and, also, economic scientists.Early manageme," Revista Tinerilor Economisti (The Young Economists Journal), University of Craiova, Faculty of Economics and Business Administration, vol. 1(8), pages 29-39, April.
    12. Wendenburg, Oriana, 2020. "The Effect of Gratitude on Individuals' Effort – A Field Experiment," Junior Management Science (JUMS), Junior Management Science e. V., vol. 5(4), pages 429-451.
    13. Sachin Kumar Srivastava & Dhruve Narain Kakkar, 2007. "Estimation of motivation using entropy," Journal of Business Economics and Management, Taylor & Francis Journals, vol. 9(1), pages 53-56, December.
    14. Sabina IRIMIE & Bianca ARMEAN, 2012. "Employee of the Month in Romania: a Study on Perceptions," REVISTA DE MANAGEMENT COMPARAT INTERNATIONAL/REVIEW OF INTERNATIONAL COMPARATIVE MANAGEMENT, Faculty of Management, Academy of Economic Studies, Bucharest, Romania, vol. 13(5), pages 861-870, December.
    15. Deborah A. Waldron, 1999. "Status in organizations: where evolutionary theory ranks," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 19(7-8), pages 505-520.
    16. Zopiatis, Anastasios & Constanti, Panikkos, 2006. "Mission Impossible? Motivating Hospitality Managers in Cyprus," MPRA Paper 25386, University Library of Munich, Germany, revised 28 Dec 2006.
    17. Iqbal Muhammad Babar & Li Jianxun & Nie Yu & Raza Ali & Jan Shahina Qurban, 2023. "Assessing the Influential Act of Compensation and Leadership on Stressful Jobs: also Devising Leadership and Compensation as Mediators," Zagreb International Review of Economics and Business, Sciendo, vol. 26(2), pages 137-162.
    18. Linz, Susan J., 2004. "Motivating Russian workers: analysis of age and gender differences," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 33(3), pages 261-289, July.
    19. Uka Ana & Prendi Ardita, 2021. "Motivation as an indicator of performance and productivity from the perspective of employees," Management & Marketing, Sciendo, vol. 16(3), pages 268-285, September.
    20. Akshay Vij & Lynette Washington & Sally Weller & Jacob Irving & Ilke Onur, 2024. "Labour Market Preferences of Retrenched Australian Auto Industry Workers for Job Quality and Meaningful Work," The Economic Record, The Economic Society of Australia, vol. 100(329), pages 209-233, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:somere:v:31:y:2002:i:1:p:87-105. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.