IDEAS home Printed from https://ideas.repec.org/a/spr/binfse/v58y2016i6d10.1007_s12599-016-0427-3.html
   My bibliography  Save this article

Evaluation Methods in Process-Aware Information Systems Research with a Perspective on Human Orientation

Author

Listed:
  • Simone Kriglstein

    (Vienna University of Technology)

  • Maria Leitner

    (AIT Austrian Institute of Technology GmbH)

  • Sonja Kabicher-Fuchs

    (University of Vienna)

  • Stefanie Rinderle-Ma

    (University of Vienna)

Abstract

Research on process-aware information systems (PAIS) has experienced a dramatic growth in recent years. Lately, a particular increase of empirical studies and focus on human oriented research questions could be observed, leading to an expansion of applied evaluation methods in PAIS research. At the same time, it can be observed that evaluation methods are not always applied in a systematic manner and related terminology is at times used in an ambiguous way. Hence, the paper aims at investigating evaluation methods that are typically employed in PAIS research with a special focus on human orientation. The applied methodology includes a literature review, an expert survey, and a focus group. The authors present their findings as a collection of typical evaluation methods and the related PAIS artifacts. They highlight which evaluation methods are currently used and which evaluation methods could be of interest for future PAIS research efforts.

Suggested Citation

  • Simone Kriglstein & Maria Leitner & Sonja Kabicher-Fuchs & Stefanie Rinderle-Ma, 2016. "Evaluation Methods in Process-Aware Information Systems Research with a Perspective on Human Orientation," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 58(6), pages 397-414, December.
    • Handle: RePEc:spr:binfse:v:58:y:2016:i:6:d:10.1007_s12599-016-0427-3
    DOI: 10.1007/s12599-016-0427-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s12599-016-0427-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s12599-016-0427-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jan Recker, 2012. "The Research Process," Progress in IS, in: Scientific Research in Information Systems, edition 127, chapter 0, pages 25-43, Springer.
    2. Katharina J. Srnka & Sabine t. Koeszegi, 2007. "From Words to Numbers: How to Transform Qualitative Data into Meaningful Quantitative Results," Schmalenbach Business Review (sbr), LMU Munich School of Management, vol. 59(1), pages 29-57, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhengcai Cao & Lijie Zhou & Biao Hu & Chengran Lin, 2019. "An Adaptive Scheduling Algorithm for Dynamic Jobs for Dealing with the Flexible Job Shop Scheduling Problem," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 61(3), pages 299-309, June.
    2. Martin (Dae Youp) Kang & Anat Hovav, 2020. "Benchmarking Methodology for Information Security Policy (BMISP): Artifact Development and Evaluation," Information Systems Frontiers, Springer, vol. 22(1), pages 221-242, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Truyens, Jasper & De Bosscher, Veerle & Sotiriadou, Popi & Heyndels, Bruno & Westerbeek, Hans, 2016. "A method to evaluate countries’ organisational capacity: A four country comparison in athletics," Sport Management Review, Elsevier, vol. 19(3), pages 279-292.
    2. Oliver Laasch & Dirk C. Moosmayer & Frithjof Arp, 2020. "Responsible Practices in the Wild: An Actor-Network Perspective on Mobile Apps in Learning as Translation(s)," Journal of Business Ethics, Springer, vol. 161(2), pages 253-277, January.
    3. Luiza Ossowska & Dorota Janiszewska & Grzegorz Kwiatkowski, 2023. "The Entrepreneurship Ecosystem of Food Festivals—A Vendors’ Approach," Sustainability, MDPI, vol. 15(2), pages 1-19, January.
    4. George Assaf, A. & Josiassen, Alexander & Woo, Linda & Agbola, Frank W. & Tsionas, Mike, 2017. "Destination characteristics that drive hotel performance: A state-of-the-art global analysis," Tourism Management, Elsevier, vol. 60(C), pages 270-279.
    5. Katharina Srnka & A. Gegez & S. Arzova, 2007. "Why Is It (Un-)ethical? Comparing Potential European Partners: A Western Christian and An Eastern Islamic Country – On Arguments Used in Explaining Ethical Judgments," Journal of Business Ethics, Springer, vol. 74(2), pages 101-118, August.
    6. Hana Tomaskova & Martin Kopecky, 2020. "Specialization of Business Process Model and Notation Applications in Medicine—A Review," Data, MDPI, vol. 5(4), pages 1-42, October.
    7. Christoph Laubert & Jennifer Parlamis, 2019. "Are You Angry (Happy, Sad) or Aren’t You? Emotion Detection Difficulty in Email Negotiation," Group Decision and Negotiation, Springer, vol. 28(2), pages 377-413, April.
    8. Wang, Miaomiao & Mühlbacher, Hans & Wittmann, Xinhua & Perrett, Pieter, 2021. "Dynamic collaboration between small- and medium-sized enterprises from highly dissimilar markets," European Management Journal, Elsevier, vol. 39(2), pages 185-200.
    9. Eva-Maria Pesendorfer & Sabine T. Koeszegi, 2007. "Social Embeddedness in Electronic Negotiations," Group Decision and Negotiation, Springer, vol. 16(4), pages 399-415, July.
    10. Christoph Graf & Rudolf Vetschera & Yingchao Zhang, 2013. "Parameters of social preference functions: measurement and external validity," Theory and Decision, Springer, vol. 74(3), pages 357-382, March.
    11. Benoit (née Moeller), Sabine & Schaefers, Tobias & Heider, Raphael, 2016. "Understanding on-the-go consumption: Identifying and quantifying its determinants," Journal of Retailing and Consumer Services, Elsevier, vol. 31(C), pages 32-42.
    12. Düsterhöft, Maximilian & Schiemann, Frank & Walther, Thomas, 2023. "Let’s talk about risk! Stock market effects of risk disclosure for European energy utilities," Energy Economics, Elsevier, vol. 125(C).
    13. Rufaidah AlMaian & Amani Bu Qammaz, 2023. "The Organizational Learning Role in Construction Organizations Resilience during the COVID-19 Pandemic," Sustainability, MDPI, vol. 15(2), pages 1-19, January.
    14. Daniel Druckman & Ronald Mitterhofer & Michael Filzmoser & Sabine T. Koeszegi, 2014. "Resolving Impasses in e-Negotiation: Does e-Mediation Work?," Group Decision and Negotiation, Springer, vol. 23(2), pages 193-210, March.
    15. Yongmei Liu & Sixuan Chen & Chris Bell & Justin Tan, 2020. "How Do Power and Status Differ in Predicting Unethical Decisions? A Cross-National Comparison of China and Canada," Journal of Business Ethics, Springer, vol. 167(4), pages 745-760, December.
    16. Sabine T. Koeszegi & Eva-Maria Pesendorfer & Rudolf Vetschera, 2011. "Data-Driven Phase Analysis of E-negotiations: An Exemplary Study of Synchronous and Asynchronous Negotiations," Group Decision and Negotiation, Springer, vol. 20(4), pages 385-410, July.
    17. Mareike Schoop & Marije Amelsvoort & Johannes Gettinger & Michael Koerner & Sabine T. Koeszegi & Per Wijst, 2014. "The Interplay of Communication and Decisions in Electronic Negotiations: Communicative Decisions or Decisive Communication?," Group Decision and Negotiation, Springer, vol. 23(2), pages 167-192, March.
    18. Prashant Barsing & Yash Daultani & Omkarprasad S. Vaidya & Sushil Kumar, 2018. "Cross-docking Centre Location in a Supply Chain Network: A Social Network Analysis Approach," Global Business Review, International Management Institute, vol. 19(3_suppl), pages 218-234, June.
    19. Jochen Wulf & Rüdiger Zarnekow, 2011. "Cross-Sector Competition in Telecommunications," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 3(5), pages 289-298, October.
    20. Benoit, Sabine & Baker, Thomas L. & Bolton, Ruth N. & Gruber, Thorsten & Kandampully, Jay, 2017. "A triadic framework for collaborative consumption (CC): Motives, activities and resources & capabilities of actors," Journal of Business Research, Elsevier, vol. 79(C), pages 219-227.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:binfse:v:58:y:2016:i:6:d:10.1007_s12599-016-0427-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.