Evaluating methodologies-in-action: a cognitive approach

Organisations' information systems development methodologies (ISDM) vary in how they implement best practices, often creating their own methodology-in-action. These variations in ISDM practices sometimes improve the decision making throughout the process and sometimes hinder the decision making. However, we lack clarity on how to evaluate methodologies-in-action based on the cognitive bias or lack thereof, in the embedded practices. Building off of theory in ISDM debiasing and pedagogical debiasing, we propose an evaluative technique that analyses the practices of a methodologies-in-action at the project level. Proof of concept that the technique works is provided in a case study within a methodology-in-action at a Fortune 500 firm.