IDEAS home Printed from https://ideas.repec.org/a/eee/ijoais/v14y2013i3p193-208.html
   My bibliography  Save this article

Exploring the use of the Delphi method in accounting information systems research

Author

Listed:
  • Worrell, James L.
  • Di Gangi, Paul M.
  • Bush, Ashley A.

Abstract

Recent focus on the diversity of research methodologies available to accounting information systems (AIS) scholars has led researchers to suggest the Delphi method has reached the limits of its usefulness. Using a review of the accounting and information systems literature, we suggest such a finding is premature for the AIS discipline. The Delphi method is especially useful in reducing ambiguity through the use of expert panels of both practitioners and experts and informing relevant and timely issues facing organizations. In essence, the Delphi method has potential to provide both rigor and relevance to AIS researchers. Our purpose is to review the prior literature on the use of the Delphi method and discuss potential areas of research within the AIS discipline where the method might add value. Based on this review, we develop a series of guidelines on how to properly develop, administer, and assess panel responses and then use an illustrative study example that explores IT risks in operations. We conclude with a discussion of the value of the Delphi method and provide insight into its limitations.

Suggested Citation

  • Worrell, James L. & Di Gangi, Paul M. & Bush, Ashley A., 2013. "Exploring the use of the Delphi method in accounting information systems research," International Journal of Accounting Information Systems, Elsevier, vol. 14(3), pages 193-208.
  • Handle: RePEc:eee:ijoais:v:14:y:2013:i:3:p:193-208
    DOI: 10.1016/j.accinf.2012.03.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1467089512000188
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.accinf.2012.03.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Akkermans, Henk A. & Bogerd, Paul & Yucesan, Enver & van Wassenhove, Luk N., 2003. "The impact of ERP on supply chain management: Exploratory findings from a European Delphi study," European Journal of Operational Research, Elsevier, vol. 146(2), pages 284-301, April.
    2. David M. Boje & J. Keith Murnighan, 1982. "Group Confidence Pressures in Iterative Decisions," Management Science, INFORMS, vol. 28(10), pages 1187-1196, October.
    3. Rowe, Gene & Wright, George, 1999. "The Delphi technique as a forecasting tool: issues and analysis," International Journal of Forecasting, Elsevier, vol. 15(4), pages 353-375, October.
    4. Norman Dalkey & Olaf Helmer, 1963. "An Experimental Application of the DELPHI Method to the Use of Experts," Management Science, INFORMS, vol. 9(3), pages 458-467, April.
    5. Dubois, Anna & Gadde, Lars-Erik, 2002. "Systematic combining: an abductive approach to case research," Journal of Business Research, Elsevier, vol. 55(7), pages 553-560, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Saskia Crucke & Adelien Decramer, 2016. "The Development of a Measurement Instrument for the Organizational Performance of Social Enterprises," Sustainability, MDPI, vol. 8(2), pages 1-30, February.
    2. Saeed Nosratabadi & Gergo Pinter & Amir Mosavi & Sandor Semperger, 2020. "Sustainable Banking; Evaluation of the European Business Models," Sustainability, MDPI, vol. 12(6), pages 1-19, March.
    3. Paul M. Gangi & Allen C. Johnston & James L. Worrell & Samuel C. Thompson, 2018. "What could possibly go wrong? A multi-panel Delphi study of organizational social media risk," Information Systems Frontiers, Springer, vol. 20(5), pages 1097-1116, October.
    4. Albanese, Massimo, 2023. "Reviewing literature through multidimensional representations," International Journal of Accounting Information Systems, Elsevier, vol. 49(C).
    5. Khaled Alzeaideen, 2020. "Construction of Competitive Advantage Instrument in Jordanian SME Context Using Structural Equation Modelling," International Journal of Financial Research, International Journal of Financial Research, Sciedu Press, vol. 11(1), pages 236-251, January.
    6. Jaime de Pablo Valenciano & Juan Uribe-Toril & Juan Milán-García & José Luis Ruiz-Real & José Antonio Torres Arriaza, 2019. "Auxiliary Companies of the Horticultural Sector as a Competitiveness Element: The Case of Almeria (Spain)," IJERPH, MDPI, vol. 16(14), pages 1-19, July.
    7. Saeed Nosratabadi & Gergo Pinter & Amir Mosavi & Sandor Semperger, 2020. "Sustainable Banking; Evaluation of the European Business Models," Papers 2003.13423, arXiv.org.
    8. Huiru Zhao & Nana Li, 2015. "Risk Evaluation of a UHV Power Transmission Construction Project Based on a Cloud Model and FCE Method for Sustainability," Sustainability, MDPI, vol. 7(3), pages 1-30, March.
    9. Ekström, Thomas & Hilletofth, Per & Skoglund, Per, 2021. "Towards a purchasing portfolio model for defence procurement – A Delphi study of Swedish defence authorities," International Journal of Production Economics, Elsevier, vol. 233(C).
    10. Tiberius, Victor & Hirth, Stefanie, 2019. "Impacts of digitization on auditing: A Delphi study for Germany," Journal of International Accounting, Auditing and Taxation, Elsevier, vol. 37(C).
    11. Huang, Shaio-Yan & Wang, Tawei & Huang, Yu-Ting & Yeh, Tzu-Ning, 2024. "Information security risk items and management practices for mobile payment using non-financial-institution service providers: An exploratory study," International Journal of Accounting Information Systems, Elsevier, vol. 53(C).
    12. Menéndez-Caravaca, Eloísa & Bueno, Salvador & Gallego, M. Dolores, 2021. "Exploring the link between free and open source software and the collaborative economy: A Delphi-based scenario for the year 2025," Technological Forecasting and Social Change, Elsevier, vol. 173(C).
    13. Paul M. Gangi & Allen C. Johnston & James L. Worrell & Samuel C. Thompson, 0. "What could possibly go wrong? A multi-panel Delphi study of organizational social media risk," Information Systems Frontiers, Springer, vol. 0, pages 1-20.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Meijering, Jurian V. & Tobi, Hilde, 2016. "The effect of controlled opinion feedback on Delphi features: Mixed messages from a real-world Delphi experiment," Technological Forecasting and Social Change, Elsevier, vol. 103(C), pages 166-173.
    2. Bolger, Fergus & Rowe, Gene & Belton, Ian & Crawford, Megan M & Hamlin, Iain & Sissons, Aileen & Taylor Browne Lūka, Courtney & Vasilichi, Alexandrina & Wright, George, 2020. "The Simulated Group Response Paradigm: A new approach to the study of opinion change in Delphi and other structured-group techniques," OSF Preprints 4ufzg, Center for Open Science.
    3. Peppel, Marcel & Ringbeck, Jürgen & Spinler, Stefan, 2022. "How will last-mile delivery be shaped in 2040? A Delphi-based scenario study," Technological Forecasting and Social Change, Elsevier, vol. 177(C).
    4. Chang, Victor & Liu, Ben S.C. & Sudharshan, D. & Xu, Qianwen Ariel, 2021. "Towards an effective negotiation modeling: Investigating transboundary disputes with cases of lower possibilities," Technological Forecasting and Social Change, Elsevier, vol. 165(C).
    5. Prianto Budi Saptono & Gustofan Mahmud & Intan Pratiwi & Dwi Purwanto & Ismail Khozen & Muhamad Akbar Aditama & Siti Khodijah & Maria Eurelia Wayan & Rina Yuliastuty Asmara & Ferry Jie, 2023. "Development of Climate-Related Disclosure Indicators for Application in Indonesia: A Delphi Method Study," Sustainability, MDPI, vol. 15(14), pages 1-25, July.
    6. Di Zio, Simone & Bolzan, Mario & Marozzi, Marco, 2021. "Classification of Delphi outputs through robust ranking and fuzzy clustering for Delphi-based scenarios," Technological Forecasting and Social Change, Elsevier, vol. 173(C).
    7. Litsiou, Konstantia & Polychronakis, Yiannis & Karami, Azhdar & Nikolopoulos, Konstantinos, 2022. "Relative performance of judgmental methods for forecasting the success of megaprojects," International Journal of Forecasting, Elsevier, vol. 38(3), pages 1185-1196.
    8. Alyami, Saleh. H. & Rezgui, Yacine & Kwan, Alan, 2013. "Developing sustainable building assessment scheme for Saudi Arabia: Delphi consultation approach," Renewable and Sustainable Energy Reviews, Elsevier, vol. 27(C), pages 43-54.
    9. Christoph Markmann & Alexander Spickermann & Heiko A. von der Gracht & Alexander Brem, 2021. "Improving the question formulation in Delphi‐like surveys: Analysis of the effects of abstract language and amount of information on response behavior," Futures & Foresight Science, John Wiley & Sons, vol. 3(1), March.
    10. Haarhaus, Tim & Liening, Andreas, 2020. "Building dynamic capabilities to cope with environmental uncertainty: The role of strategic foresight," Technological Forecasting and Social Change, Elsevier, vol. 155(C).
    11. Ribeiro, Barbara E. & Quintanilla, Miguel A., 2015. "Transitions in biofuel technologies: An appraisal of the social impacts of cellulosic ethanol using the Delphi method," Technological Forecasting and Social Change, Elsevier, vol. 92(C), pages 53-68.
    12. Belton, Ian & Wright, George & Sissons, Aileen & Bolger, Fergus & Crawford, Megan M. & Hamlin, Iain & Taylor Browne Lūka, Courtney & Vasilichi, Alexandrina, 2021. "Delphi with feedback of rationales: How large can a Delphi group be such that participants are not overloaded, de-motivated, or disengaged?," Technological Forecasting and Social Change, Elsevier, vol. 170(C).
    13. Yeh, Duen-Yian & Cheng, Ching-Hsue, 2015. "Recommendation system for popular tourist attractions in Taiwan using Delphi panel and repertory grid techniques," Tourism Management, Elsevier, vol. 46(C), pages 164-176.
    14. Hsin-Ke Lu & Sung-Chun Tsai & Peng-Chun Lin & Kuo-Chung Chu & Alexander N. Chen, 2020. "Toward a New Real-Time Approach for Group Consensus: A Usability Analysis of Synchronous Delphi System," Group Decision and Negotiation, Springer, vol. 29(2), pages 345-370, April.
    15. Kawamoto, Carlos Tadao & Wright, James Terence Coulter & Spers, Renata Giovinazzo & de Carvalho, Daniel Estima, 2019. "Can we make use of perception of questions' easiness in Delphi-like studies? Some results from an experiment with an alternative feedback," Technological Forecasting and Social Change, Elsevier, vol. 140(C), pages 296-305.
    16. Paméla Baillette & Bernard Fallery, 2016. "La méthode du Delphi argumentaire, une innovation managériale dans le cadre d'un projet complexe," Post-Print hal-02160359, HAL.
    17. Torres Sibille, Ana del Carmen & Cloquell-Ballester, Víctor-Andrés & Cloquell-Ballester, Vicente-Agustín & Darton, Richard, 2009. "Development and validation of a multicriteria indicator for the assessment of objective aesthetic impact of wind farms," Renewable and Sustainable Energy Reviews, Elsevier, vol. 13(1), pages 40-66, January.
    18. Fritschy, Carolin & Spinler, Stefan, 2019. "The impact of autonomous trucks on business models in the automotive and logistics industry–a Delphi-based scenario study," Technological Forecasting and Social Change, Elsevier, vol. 148(C).
    19. Contadini, Jose F., 2002. "Life Cycle Assessment of Fuel Cell Vehicles - Dealing with Uncertainties," Institute of Transportation Studies, Working Paper Series qt9gz1s67d, Institute of Transportation Studies, UC Davis.
    20. Förster, Bernadette, 2015. "Technology foresight for sustainable production in the German automotive supplier industry," Technological Forecasting and Social Change, Elsevier, vol. 92(C), pages 237-248.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ijoais:v:14:y:2013:i:3:p:193-208. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/international-journal-of-accounting-information-systems/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.