IDEAS home Printed from https://ideas.repec.org/a/bla/bstrat/v33y2024i4p3607-3634.html
   My bibliography  Save this article

How can organizations measure the integration of environmental, social, and governance (ESG) criteria? Validation of an instrument using item response theory to capture workers' perception

Author

Listed:
  • Anrafel de Souza Barbosa
  • Maria Cristina Crispim
  • Luiz Bueno da Silva
  • Jonhatan Magno Norte da Silva
  • Aglaucibelly Maciel Barbosa
  • Sandra Naomi Morioka

Abstract

Evaluation of corporate sustainability parameters has become part of organizational management. Item Response Theory (IRT) serves as a valuable approach for quantifying and exploring observable variables associated with these parameters. Therefore, this article aims to propose, apply, and validate an instrument utilizing IRT to measure environmental, social, and governance (ESG) impacts on corporate sustainability performance, using the perspective of workers. Workers were chosen as key stakeholders for the present study, as they were pointed by previous research as central to corporate sustainability decisions. The present paper addresses a literature gap by introducing, implementing, and validating a research instrument, along with a comparative scale, to assess the effects of integrating ESG criteria on corporate sustainability performance. Workers of two major Brazilian electricity sector companies were respondents for this instrument. Multigroup IRT method was used to assess item discrimination and difficulty levels, and to construct a scale reflecting workers' perceptions of integrating ESG criteria. The questionnaire consisted of 15 items, demonstrating Content Validity Coefficients (CVC) above .97, confirming the instrument's content effectiveness. Cronbach's Alpha and McDonald's Omega were greater than .94 for both companies. Questionnaire items demonstrated satisfactory discrimination ability and varying difficulty levels, resulting in a five‐level scale to gauge the impacts of ESG criteria. This research contributes through the introduction and validation of the research instrument, the latent trait assessment scale, and the evaluation of workers' perceptions regarding ESG criteria impacts on corporate sustainability performance. In conclusion, the proposed instrument showed robust psychometric properties, displaying favorable reliability and validity parameters. It effectively measures the impacts of ESG criteria, providing interpretable levels aligned with the unique characteristics of its constituent items

Suggested Citation

  • Anrafel de Souza Barbosa & Maria Cristina Crispim & Luiz Bueno da Silva & Jonhatan Magno Norte da Silva & Aglaucibelly Maciel Barbosa & Sandra Naomi Morioka, 2024. "How can organizations measure the integration of environmental, social, and governance (ESG) criteria? Validation of an instrument using item response theory to capture workers' perception," Business Strategy and the Environment, Wiley Blackwell, vol. 33(4), pages 3607-3634, May.
    • Handle: RePEc:bla:bstrat:v:33:y:2024:i:4:p:3607-3634
    DOI: 10.1002/bse.3675
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/bse.3675
    Download Restriction: no
    File URL: https://libkey.io/10.1002/bse.3675?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ester Clementino & Richard Perkins, 2021. "How Do Companies Respond to Environmental, Social and Governance (ESG) ratings? Evidence from Italy," Journal of Business Ethics, Springer, vol. 171(2), pages 379-397, June.
    2. Maia, Rodrigo Gomes Távora & Garcia, Katia Cristina, 2023. "What they say, what they do and how they do it: An evaluation of the energy transition and GHG emissions of electricity companies," Energy Policy, Elsevier, vol. 174(C).
    3. Tamas Barko & Martijn Cremers & Luc Renneboog, 2022. "Shareholder Engagement on Environmental, Social, and Governance Performance," Journal of Business Ethics, Springer, vol. 180(2), pages 777-812, October.
    4. Salvatore Esposito De Falco & Giuseppe Scandurra & Antonio Thomas, 2021. "How stakeholders affect the pursuit of the Environmental, Social, and Governance. Evidence from innovative small and medium enterprises," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 28(5), pages 1528-1539, September.
    5. Marilen Gabriel Pirtea & Graţiela Georgiana Noja & Mirela Cristea & Mirela Panait, 2021. "Interplay between environmental, social and governance coordinates and the financial performance of agricultural companies," Agricultural Economics, Czech Academy of Agricultural Sciences, vol. 67(12), pages 479-490.
    6. Jin Zhu & Fei Huang, 2023. "Transformational Leadership, Organizational Innovation, and ESG Performance: Evidence from SMEs in China," Sustainability, MDPI, vol. 15(7), pages 1-23, March.
    7. Artie W. Ng & Tiffany Cheng Han Leung & Tao-Wang Yu & Charles H. Cho & Tai Ming Wut, 2023. "Disparities in ESG reporting by emerging Chinese enterprises: evidence from a global financial center," Sustainability Accounting, Management and Policy Journal, Emerald Group Publishing Limited, vol. 14(2), pages 343-368, February.
    8. Minsuck Jin & Boyoung Kim, 2022. "Effects of ESG Activity Recognition Factors on Innovative Organization Culture, Job Crafting, and Job Performance," Administrative Sciences, MDPI, vol. 12(4), pages 1-16, September.
    9. Bice Cavallo, 2020. "Functional relations and Spearman correlation between consistency indices," Journal of the Operational Research Society, Taylor & Francis Journals, vol. 71(2), pages 301-311, February.
    10. Rajesh Kumar Bhaskaran & Irene Wei Kiong Ting & Sujit K. Sukumaran & Saraswathy Divakaran Sumod, 2020. "Environmental, social and governance initiatives and wealth creation for firms: An empirical examination," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 41(5), pages 710-729, July.
    11. Simone Terzani & Teresa Turzo, 2021. "Religious social norms and corporate sustainability: The effect of religiosity on environmental, social, and governance disclosure," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 28(1), pages 485-496, January.
    12. Bouslah, Kais & Kryzanowski, Lawrence & M’Zali, Bouchra, 2013. "The impact of the dimensions of social performance on firm risk," Journal of Banking & Finance, Elsevier, vol. 37(4), pages 1258-1273.
    13. Lee Siew Peng & Mansor Isa, 2020. "Environmental, Social and Governance (ESG) Practices And Performance In Shariah Firms: Agency or Stakeholder Theory?," Asian Academy of Management Journal of Accounting and Finance (AAMJAF), Penerbit Universiti Sains Malaysia, vol. 16(1), pages 1-34.
    14. Grant J. Cameron & Hai‐Anh H. Dang & Mustafa Dinc & James Foster & Michael M. Lokshin, 2021. "Measuring the Statistical Capacity of Nations," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 83(4), pages 870-896, August.
    15. Rezaee, Zabihollah & Homayoun, Saeid & Poursoleyman, Ehsan & Rezaee, Nick J., 2023. "Comparative analysis of environmental, social, and governance disclosures," Global Finance Journal, Elsevier, vol. 55(C).
    16. Fiaschi, Davide & Giuliani, Elisa & Nieri, Federica & Salvati, Nicola, 2020. "How bad is your company? Measuring corporate wrongdoing beyond the magic of ESG metrics," Business Horizons, Elsevier, vol. 63(3), pages 287-299.
    17. Zeineb Ouni & Jamal Ben Mansour & Sana Arfaoui, 2020. "Board/Executive Gender Diversity and Firm Financial Performance in Canada: The Mediating Role of Environmental, Social, and Governance (ESG) Orientation," Sustainability, MDPI, vol. 12(20), pages 1-17, October.
    18. Francisco Bravo & Nuria Reguera‐Alvarado, 2019. "Sustainable development disclosure: Environmental, social, and governance reporting and gender diversity in the audit committee," Business Strategy and the Environment, Wiley Blackwell, vol. 28(2), pages 418-429, February.
    19. Chalmers, R. Philip, 2012. "mirt: A Multidimensional Item Response Theory Package for the R Environment," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i06).
    20. Muhammad Azeem Qureshi & Minhas Akbar & Ahsan Akbar & Petra Poulova, 2021. "Do ESG Endeavors Assist Firms in Achieving Superior Financial Performance? A Case of 100 Best Corporate Citizens," SAGE Open, , vol. 11(2), pages 21582440211, June.
    21. Marco Taliento & Christian Favino & Antonio Netti, 2019. "Impact of Environmental, Social, and Governance Information on Economic Performance: Evidence of a Corporate ‘Sustainability Advantage’ from Europe," Sustainability, MDPI, vol. 11(6), pages 1-26, March.
    22. Saverio Petruzzelli & Francesco Badia, 2023. "The quality assessment of stakeholder engagement disclosure in the EU mandatory non-financial reporting framework," Journal of Applied Accounting Research, Emerald Group Publishing Limited, vol. 25(1), pages 126-148, May.
    23. Sheila Mendes Fernandes & Antonio Cezar Bornia, 2019. "Reporting on supply chain sustainability: Measurement using item response theory," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 26(1), pages 106-116, January.
    24. Amir Gholami & John Sands & Habib Ur Rahman, 2022. "Environmental, Social and Governance Disclosure and Value Generation: Is the Financial Industry Different?," Sustainability, MDPI, vol. 14(5), pages 1-17, February.
    25. Jose R.S. Santos & Caio L.N. Azevedo & Heleno Bolfarine, 2013. "A multiple group item response theory model with centered skew-normal latent trait distributions under a Bayesian framework," Journal of Applied Statistics, Taylor & Francis Journals, vol. 40(10), pages 2129-2149, October.
    26. Lee Cronbach, 1951. "Coefficient alpha and the internal structure of tests," Psychometrika, Springer;The Psychometric Society, vol. 16(3), pages 297-334, September.
    27. Anrafel Souza Barbosa & Maria Cristina Basilio Crispim Silva & Luiz Bueno Silva & Sandra Naomi Morioka & Vinícius Fernandes Souza, 2023. "Integration of Environmental, Social, and Governance (ESG) criteria: their impacts on corporate sustainability performance," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-18, December.
    28. Huang, Jun & Han, Feifei & Li, Yun, 2023. "Government as major customer: The effects of government procurement on corporate environmental, social, and governance performance," Finance Research Letters, Elsevier, vol. 54(C).
    29. Xiaokai Meng & Ghulam Muhammad Shaikh, 2023. "Evaluating Environmental, Social, and Governance Criteria and Green Finance Investment Strategies Using Fuzzy AHP and Fuzzy WASPAS," Sustainability, MDPI, vol. 15(8), pages 1-19, April.
    30. Sara De Masi & Agnieszka Słomka‐Gołębiowska & Claudio Becagli & Andrea Paci, 2021. "Toward sustainable corporate behavior: The effect of the critical mass of female directors on environmental, social, and governance disclosure," Business Strategy and the Environment, Wiley Blackwell, vol. 30(4), pages 1865-1878, May.
    31. Elisa Baraibar‐Diez & María D. Odriozola & José Luis Fernández Sánchez, 2019. "Sustainable compensation policies and its effect on environmental, social, and governance scores," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 26(6), pages 1457-1472, November.
    32. Murad Harasheh & Roberta Provasi, 2023. "A need for assurance: Do internal control systems integrate environmental, social, and governance factors?," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 30(1), pages 384-401, January.
    33. Gow, Ian D. & Larcker, David F. & Watts, Edward M., 2023. "Board diversity and shareholder voting," Journal of Corporate Finance, Elsevier, vol. 83(C).
    34. Kun Luo & Sirui Wu, 2022. "Corporate sustainability and analysts' earnings forecast accuracy: Evidence from environmental, social and governance ratings," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 29(5), pages 1465-1481, September.
    35. Elahi, Ehsan & Khalid, Zainab & Zhang, Zhixin, 2022. "Understanding farmers’ intention and willingness to install renewable energy technology: A solution to reduce the environmental emissions of agriculture," Applied Energy, Elsevier, vol. 309(C).
    36. Muhammad Azeem Qureshi & Sina Kirkerud & Kim Theresa & Tanveer Ahsan, 2020. "The impact of sustainability (environmental, social, and governance) disclosure and board diversity on firm value: The moderating role of industry sensitivity," Business Strategy and the Environment, Wiley Blackwell, vol. 29(3), pages 1199-1214, March.
    37. Ruoyu He & Xueli Chen & Cheng Chen & Jianqiao Zhai & Lixin Cui, 2021. "Environmental, Social, and Governance Incidents and Bank Loan Contracts," Sustainability, MDPI, vol. 13(4), pages 1-19, February.
    38. Iman Harymawan & Mohammad Nasih & Dian Agustia & Fajar Kristanto Gautama Putra & Hadrian Geri Djajadikerta, 2022. "Investment efficiency and environmental, social, and governance reporting: Perspective from corporate integration management," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 29(5), pages 1186-1202, September.
    39. Liu, Hongxun & Zhang, Zihan, 2023. "The impact of managerial myopia on environmental, social and governance (ESG) engagement: Evidence from Chinese firms," Energy Economics, Elsevier, vol. 122(C).
    40. Hakan Gökhan Gündoğdu & Ahmet Aytekin & Şura Toptancı & Selçuk Korucuk & Çağlar Karamaşa, 2023. "Environmental, social, and governance risks and environmentally sensitive competitive strategies: A case study of a multinational logistics company," Business Strategy and the Environment, Wiley Blackwell, vol. 32(7), pages 4874-4906, November.
    41. Giovanni Catello Landi & Francesca Iandolo & Antonio Renzi & Andrea Rey, 2022. "Embedding sustainability in risk management: The impact of environmental, social, and governance ratings on corporate financial risk," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 29(4), pages 1096-1107, July.
    42. Muhammad Zahid & Syeda Um-Ul-Baneen Naqvi & Amin Jan & Haseeb Ur Rahman & Said Wali, 2023. "The nexus of environmental, social, and governance practices with the financial performance of banks: A comparative analysis for the pre and COVID-19 periods," Cogent Economics & Finance, Taylor & Francis Journals, vol. 11(1), pages 2183654-218, December.
    43. Giuliana Birindelli & Stefano Dell’Atti & Antonia Patrizia Iannuzzi & Marco Savioli, 2018. "Composition and Activity of the Board of Directors: Impact on ESG Performance in the Banking System," Sustainability, MDPI, vol. 10(12), pages 1-20, December.
    44. Tuan-Hock Ng & Chun-Teck Lye & Kar-Hoong Chan & Ying-Zhee Lim & Ying-San Lim, 2020. "Sustainability in Asia: The Roles of Financial Development in Environmental, Social and Governance (ESG) Performance," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 150(1), pages 17-44, July.
    45. Brian O’Connor & Maxine Crawford & Mark Holder, 2015. "An Item Response Theory Analysis of the Subjective Happiness Scale," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 124(1), pages 249-258, October.
    46. Silvana Bortolotti & Rafael Tezza & Dalton Andrade & Antonio Bornia & Afonso Sousa Júnior, 2013. "Relevance and advantages of using the item response theory," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(4), pages 2341-2360, June.
    47. Dawood Ashraf & Muhammad Suhail Rizwan & Barbara L’Huillier, 2022. "Environmental, social, and governance integration: the case of microfinance institutions," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 62(1), pages 837-891, March.
    48. Jiang, Yihuo & Ni, Hongliang & Ni, Yihan & Guo, Xiaomei, 2023. "Assessing environmental, social, and governance performance and natural resource management policies in China's dual carbon era for a green economy," Resources Policy, Elsevier, vol. 85(PB).
    49. Li‐Yu Chen & Teng‐Shih Wang, 2023. "Effect of supplier cost stickiness on environmental, social, and governance: Moderating role of customer bargaining power," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 30(5), pages 2304-2314, September.
    50. Magdalena Ziolo & Beata Zofia Filipiak & Iwona Bąk & Katarzyna Cheba, 2019. "How to Design More Sustainable Financial Systems: The Roles of Environmental, Social, and Governance Factors in the Decision-Making Process," Sustainability, MDPI, vol. 11(20), pages 1-34, October.
    51. Minsuck Jin & Boyoung Kim, 2022. "The Effects of ESG Activity Recognition of Corporate Employees on Job Performance: The Case of South Korea," JRFM, MDPI, vol. 15(7), pages 1-18, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Anrafel Souza Barbosa & Maria Cristina Basilio Crispim Silva & Luiz Bueno Silva & Sandra Naomi Morioka & Vinícius Fernandes Souza, 2023. "Integration of Environmental, Social, and Governance (ESG) criteria: their impacts on corporate sustainability performance," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-18, December.
    2. Juan Dempere & Shahira Abdalla, 2023. "The Impact of Women’s Empowerment on the Corporate Environmental, Social, and Governance (ESG) Disclosure," Sustainability, MDPI, vol. 15(10), pages 1-18, May.
    3. Khine Kyaw & Julio Pindado & Chabela de-la-Torre, 2022. "Disentangling the Bidirectional Relationships Across the Corporate Sustainable Development Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 163(1), pages 297-320, August.
    4. Arduino, Francesca Romana & Buchetti, Bruno & Harasheh, Murad, 2024. "The veil of secrecy: Family firms’ approach to ESG transparency and the role of institutional investors," Finance Research Letters, Elsevier, vol. 62(PB).
    5. Ann Susan Thomas & Ambili Jayachandran & Ajithakumari Vijayappan Nair Biju, 2024. "Strategic mapping of the environmental social governance landscape in finance – A bibliometric exploration through concepts and themes," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 31(5), pages 4428-4453, September.
    6. Silvia Carnini Pulino & Mirella Ciaburri & Barbara Sveva Magnanelli & Luigi Nasta, 2022. "Does ESG Disclosure Influence Firm Performance?," Sustainability, MDPI, vol. 14(13), pages 1-18, June.
    7. Shaista Wasiuzzaman & Vasanthan Subramaniam, 2023. "Board gender diversity and environmental, social and governance (ESG) disclosure: Is it different for developed and developing nations?," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 30(5), pages 2145-2165, September.
    8. Adam Arian & John Sands & Stuart Tooley, 2023. "Industry and Stakeholder Impacts on Corporate Social Responsibility (CSR) and Financial Performance: Consumer vs. Industrial Sectors," Sustainability, MDPI, vol. 15(16), pages 1-21, August.
    9. Saba Iqbal & Safia Nosheen, 2023. "Moderating impact of non-performing loans on the relationship between sustainable development goals and the financial performance of banks," Future Business Journal, Springer, vol. 9(1), pages 1-12, December.
    10. Louis Maximilian Ronalter & Merce Bernardo & Javier Manuel Romaní, 2023. "Quality and environmental management systems as business tools to enhance ESG performance: a cross-regional empirical study," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 25(9), pages 9067-9109, September.
    11. Caterina Lucarelli & Sabrina Severini, 2024. "Anatomy of the chimera: Environmental, Social, and Governance ratings beyond the myth," Business Strategy and the Environment, Wiley Blackwell, vol. 33(5), pages 4198-4217, July.
    12. Chang Liu & Zihao Xin, 2024. "Does environmental, social, and governance practice boost corporate human capital inflow in China? From the perspective of stakeholder response," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 31(4), pages 3251-3273, July.
    13. Alan Kai Ming Au & Yi-Fan Yang & Huan Wang & Rui-Hong Chen & Leven J. Zheng, 2023. "Mapping the Landscape of ESG Strategies: A Bibliometric Review and Recommendations for Future Research," Sustainability, MDPI, vol. 15(24), pages 1-26, December.
    14. Mariasole Bannò & Emilia Filippi & Sandro Trento, 2023. "Women in top echelon positions and their effects on sustainability: a review, synthesis and future research agenda," Journal of Management & Governance, Springer;Accademia Italiana di Economia Aziendale (AIDEA), vol. 27(1), pages 181-251, March.
    15. Cunyi Yang & Conghao Zhu & Khaldoon Albitar, 2024. "ESG ratings and green innovation: A U‐shaped journey towards sustainable development," Business Strategy and the Environment, Wiley Blackwell, vol. 33(5), pages 4108-4129, July.
    16. Jianzhuang Zheng & Muhammad Usman Khurram & Lifeng Chen, 2022. "Can Green Innovation Affect ESG Ratings and Financial Performance? Evidence from Chinese GEM Listed Companies," Sustainability, MDPI, vol. 14(14), pages 1-32, July.
    17. Scholz, Robert, 2023. "Unternehmensmitbestimmung und die sozialökologische Transformation: Zusammenhang zwischen Mitbestimmungsindex und ESG-Kriterien in börsennotierten Unternehmen," Mitbestimmungsreport 79, Hans-Böckler-Stiftung, Düsseldorf.
    18. Yan Zhao & Ehsan Elahi & Zainab Khalid & Xuegang Sun & Fang Sun, 2023. "Environmental, Social and Governance Performance: Analysis of CEO Power and Corporate Risk," Sustainability, MDPI, vol. 15(2), pages 1-18, January.
    19. Simona Galletta & Sebastiano Mazzù & Valeria Naciti, 2021. "Banks' business strategy and environmental effectiveness: The monitoring role of the board of directors and the managerial incentives," Business Strategy and the Environment, Wiley Blackwell, vol. 30(5), pages 2656-2670, July.
    20. Costantiello, Alberto & Leogrande, Angelo, 2023. "The Role Of Gdp Growth In The Esg Approach At World Level," SocArXiv r56hu, Center for Open Science.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:bstrat:v:33:y:2024:i:4:p:3607-3634. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://onlinelibrary.wiley.com/journal/10.1002/(ISSN)1099-0836 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.