IDEAS home Printed from https://ideas.repec.org/a/spr/binfse/v58y2016i6d10.1007_s12599-016-0427-3.html
   My bibliography  Save this article

Evaluation Methods in Process-Aware Information Systems Research with a Perspective on Human Orientation

Author

Listed:
  • Simone Kriglstein

    (Vienna University of Technology)

  • Maria Leitner

    (AIT Austrian Institute of Technology GmbH)

  • Sonja Kabicher-Fuchs

    (University of Vienna)

  • Stefanie Rinderle-Ma

    (University of Vienna)

Abstract

Research on process-aware information systems (PAIS) has experienced a dramatic growth in recent years. Lately, a particular increase of empirical studies and focus on human oriented research questions could be observed, leading to an expansion of applied evaluation methods in PAIS research. At the same time, it can be observed that evaluation methods are not always applied in a systematic manner and related terminology is at times used in an ambiguous way. Hence, the paper aims at investigating evaluation methods that are typically employed in PAIS research with a special focus on human orientation. The applied methodology includes a literature review, an expert survey, and a focus group. The authors present their findings as a collection of typical evaluation methods and the related PAIS artifacts. They highlight which evaluation methods are currently used and which evaluation methods could be of interest for future PAIS research efforts.

Suggested Citation

  • Simone Kriglstein & Maria Leitner & Sonja Kabicher-Fuchs & Stefanie Rinderle-Ma, 2016. "Evaluation Methods in Process-Aware Information Systems Research with a Perspective on Human Orientation," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 58(6), pages 397-414, December.
    • Handle: RePEc:spr:binfse:v:58:y:2016:i:6:d:10.1007_s12599-016-0427-3
    DOI: 10.1007/s12599-016-0427-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s12599-016-0427-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s12599-016-0427-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jan Recker, 2012. "The Research Process," Progress in IS, in: Scientific Research in Information Systems, edition 127, chapter 0, pages 25-43, Springer.
    2. Katharina J. Srnka & Sabine t. Koeszegi, 2007. "From Words to Numbers: How to Transform Qualitative Data into Meaningful Quantitative Results," Schmalenbach Business Review (sbr), LMU Munich School of Management, vol. 59(1), pages 29-57, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhengcai Cao & Lijie Zhou & Biao Hu & Chengran Lin, 2019. "An Adaptive Scheduling Algorithm for Dynamic Jobs for Dealing with the Flexible Job Shop Scheduling Problem," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 61(3), pages 299-309, June.
    2. Martin (Dae Youp) Kang & Anat Hovav, 2020. "Benchmarking Methodology for Information Security Policy (BMISP): Artifact Development and Evaluation," Information Systems Frontiers, Springer, vol. 22(1), pages 221-242, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:kap:iaecre:v:15:y:2009:i:2:p:178-185 is not listed on IDEAS
    2. Krishnadas Nanath & R Radhakrishna Pillai, 2021. "Towards a framework for sustaining Green IT initiatives: an empirical investigation," Information Technology and Management, Springer, vol. 22(3), pages 193-206, September.
    3. Lang, Le Dang & Tiwari, Aviral Kumar & Hieu, Hoang Ngoc & Ha, Nguyen Minh & Gaur, Jighyasu, 2023. "The role of structural social capital in driving social-oriented sustainable agricultural entrepreneurship," Energy Economics, Elsevier, vol. 124(C).
    4. Ana F. Ferreira & Heike Zimmermann & Rui Santos & Henrik Von Wehrden, 2018. "A Social–Ecological Systems Framework as a Tool for Understanding the Effectiveness of Biosphere Reserve Management," Sustainability, MDPI, vol. 10(10), pages 1-26, October.
    5. Truyens, Jasper & De Bosscher, Veerle & Sotiriadou, Popi & Heyndels, Bruno & Westerbeek, Hans, 2016. "A method to evaluate countries’ organisational capacity: A four country comparison in athletics," Sport Management Review, Elsevier, vol. 19(3), pages 279-292.
    6. Yunjeong Kim & Kyung Wha Oh, 2020. "Which Consumer Associations Can Build a Sustainable Fashion Brand Image? Evidence from Fast Fashion Brands," Sustainability, MDPI, vol. 12(5), pages 1-16, February.
    7. Oliver Laasch & Dirk C. Moosmayer & Frithjof Arp, 2020. "Responsible Practices in the Wild: An Actor-Network Perspective on Mobile Apps in Learning as Translation(s)," Journal of Business Ethics, Springer, vol. 161(2), pages 253-277, January.
    8. Soviana, Soviana, 2013. "Case Survey for Assessing Community-Based Enterprise: A Research Design," EconStor Preprints 84707, ZBW - Leibniz Information Centre for Economics.
    9. Luederitz, Christopher & Brink, Ebba & Gralla, Fabienne & Hermelingmeier, Verena & Meyer, Moritz & Niven, Lisa & Panzer, Lars & Partelow, Stefan & Rau, Anna-Lena & Sasaki, Ryuei & Abson, David J. & La, 2015. "A review of urban ecosystem services: six key challenges for future research," Ecosystem Services, Elsevier, vol. 14(C), pages 98-112.
    10. Andreas Hoffjan & Rouven Trapp & Christoph Endenich & Thomas Boucoiran, 2012. "International budgeting—challenges for German-French companies," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 23(1), pages 5-25, September.
    11. Purohit, Sonal & Radia, Karan Nilesh, 2022. "Conceptualizing masstige buying behavior: A mixed-method approach," Journal of Business Research, Elsevier, vol. 142(C), pages 886-898.
    12. Luiza Ossowska & Dorota Janiszewska & Grzegorz Kwiatkowski, 2023. "The Entrepreneurship Ecosystem of Food Festivals—A Vendors’ Approach," Sustainability, MDPI, vol. 15(2), pages 1-19, January.
    13. María Elena Orduña Alegría & Niels Schütze & Samuel C. Zipper, 2020. "A Serious Board Game to Analyze Socio-Ecological Dynamics towards Collaboration in Agriculture," Sustainability, MDPI, vol. 12(13), pages 1-19, June.
    14. George Assaf, A. & Josiassen, Alexander & Woo, Linda & Agbola, Frank W. & Tsionas, Mike, 2017. "Destination characteristics that drive hotel performance: A state-of-the-art global analysis," Tourism Management, Elsevier, vol. 60(C), pages 270-279.
    15. Katharina Srnka & A. Gegez & S. Arzova, 2007. "Why Is It (Un-)ethical? Comparing Potential European Partners: A Western Christian and An Eastern Islamic Country – On Arguments Used in Explaining Ethical Judgments," Journal of Business Ethics, Springer, vol. 74(2), pages 101-118, August.
    16. Hana Tomaskova & Martin Kopecky, 2020. "Specialization of Business Process Model and Notation Applications in Medicine—A Review," Data, MDPI, vol. 5(4), pages 1-42, October.
    17. Muhammed-Fatih Kaya, 2022. "Pattern Labelling of Business Communication Data," Group Decision and Negotiation, Springer, vol. 31(6), pages 1203-1234, December.
    18. Christoph Laubert & Jennifer Parlamis, 2019. "Are You Angry (Happy, Sad) or Aren’t You? Emotion Detection Difficulty in Email Negotiation," Group Decision and Negotiation, Springer, vol. 28(2), pages 377-413, April.
    19. Julie Vardhan, 2015. "Internationalization and the Changing Paradigm of Higher Education in the GCC Countries," SAGE Open, , vol. 5(2), pages 21582440155, April.
    20. Wang, Miaomiao & Mühlbacher, Hans & Wittmann, Xinhua & Perrett, Pieter, 2021. "Dynamic collaboration between small- and medium-sized enterprises from highly dissimilar markets," European Management Journal, Elsevier, vol. 39(2), pages 185-200.
    21. Eva-Maria Pesendorfer & Sabine T. Koeszegi, 2007. "Social Embeddedness in Electronic Negotiations," Group Decision and Negotiation, Springer, vol. 16(4), pages 399-415, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:binfse:v:58:y:2016:i:6:d:10.1007_s12599-016-0427-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.