IDEAS home Printed from https://ideas.repec.org/a/bla/srbeha/v39y2022i4p840-866.html
   My bibliography  Save this article

Systems thinking assessments in engineering: A systematic literature review

Author

Listed:
  • Kelley E. Dugan
  • Erika A. Mosyjowski
  • Shanna R. Daly
  • Lisa R. Lattuca

Abstract

Engineers, facing increasingly complex problems, need to understand the technical and contextual aspects of their work to develop effective solutions. Assessments of comprehensive systems thinking skills are needed to support the development of these skills and to inform professional placement. Thus, our study investigated current systems thinking assessments in engineering by systematically reviewing existing assessments. We analyzed which systems thinking skills were emphasized, how they were evaluated, how data were collected and in what content areas assessments were based. The results revealed a range of assessments, in terms of type, format, and content area, but a lack of assessments that equally prioritized accounting for technical and contextual considerations. This overview of assessments can be used by employers and educators to select assessments appropriate for their contexts and goals. Overall, this study demonstrates a need for comprehensive systems thinking assessments that evaluate performance.

Suggested Citation

  • Kelley E. Dugan & Erika A. Mosyjowski & Shanna R. Daly & Lisa R. Lattuca, 2022. "Systems thinking assessments in engineering: A systematic literature review," Systems Research and Behavioral Science, Wiley Blackwell, vol. 39(4), pages 840-866, July.
    • Handle: RePEc:bla:srbeha:v:39:y:2022:i:4:p:840-866
    DOI: 10.1002/sres.2808
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/sres.2808
    Download Restriction: no
    File URL: https://libkey.io/10.1002/sres.2808?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Moti Frank, 2006. "Knowledge, abilities, cognitive characteristics and behavioral competences of engineers with high capacity for engineering systems thinking (CEST)," Systems Engineering, John Wiley & Sons, vol. 9(2), pages 91-103, June.
    2. David Rousseau, 2019. "A vision for advancing systems science as a foundation for the systems engineering and systems practice of the future," Systems Research and Behavioral Science, Wiley Blackwell, vol. 36(5), pages 621-634, September.
    3. Moti Frank & David Elata, 2005. "Developing the capacity for engineering systems thinking (CEST) of freshman engineering students," Systems Engineering, John Wiley & Sons, vol. 8(2), pages 187-195.
    4. Mike Yearworth, 2020. "The theoretical foundation(s) for Systems Engineering?," Systems Research and Behavioral Science, Wiley Blackwell, vol. 37(1), pages 184-187, January.
    5. Trochim, W.M. & Cabrera, D.A. & Milstein, B. & Gallagher, R.S. & Leischow, S.J., 2006. "Practical challenges of systems thinking and modeling in public health," American Journal of Public Health, American Public Health Association, vol. 96(3), pages 538-546.
    6. Moti Frank, 2000. "Engineering systems thinking and systems thinking," Systems Engineering, John Wiley & Sons, vol. 3(3), pages 163-168.
    7. Jens Christian Benninghaus & Andreas Mühling & Kerstin Kremer & Sandra Sprenger, 2019. "Complexity in Education for Sustainable Consumption—An Educational Data Mining Approach using Mysteries," Sustainability, MDPI, vol. 11(3), pages 1-16, January.
    8. Steven Gray & Eleanor J. Sterling & Payam Aminpour & Lissy Goralnik & Alison Singer & Cynthia Wei & Sharon Akabas & Rebecca C. Jordan & Philippe J. Giabbanelli & Jennifer Hodbod & Erin Betley & Patric, 2019. "Assessing (Social-Ecological) Systems Thinking by Evaluating Cognitive Maps," Sustainability, MDPI, vol. 11(20), pages 1-11, October.
    9. David Rousseau, 2020. "The Theoretical Foundation(s) for Systems Engineering? Response to Yearworth," Systems Research and Behavioral Science, Wiley Blackwell, vol. 37(1), pages 188-191, January.
    10. Moti Frank, 2010. "Assessing the interest for systems engineering positions and other engineering positions' required capacity for engineering systems thinking (CEST)," Systems Engineering, John Wiley & Sons, vol. 13(2), pages 161-174, June.
    11. Gail F. Latta & Keith Swigger, 1992. "Validation of the repertory grid for use in modeling knowledge," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 43(2), pages 115-129, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Emily A. Royse & Amanda D. Manzanares & Heqiao Wang & Kevin C. Haudek & Caterina Belle Azzarello & Lydia R. Horne & Daniel L. Druckenbrod & Megan Shiroda & Sol R. Adams & Ennea Fairchild & Shirley Vin, 2024. "FEW questions, many answers: using machine learning to assess how students connect food–energy–water (FEW) concepts," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-18, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Miguel A. Rodenas & Michael C. Jackson, 2021. "Lessons for systems engineering from the Segura River reclamation project: A critical systems thinking analysis," Systems Research and Behavioral Science, Wiley Blackwell, vol. 38(3), pages 368-376, May.
    2. Christian Hoyer & Indra Gunawan & Carmen Haule Reaiche, 2020. "The Implementation of Industry 4.0 – A Systematic Literature Review of the Key Factors," Systems Research and Behavioral Science, Wiley Blackwell, vol. 37(4), pages 557-578, July.
    3. Bucaro, Anthony C., 2019. "Enhancing auditors' critical thinking in audits of complex estimates," Accounting, Organizations and Society, Elsevier, vol. 73(C), pages 35-49.
    4. David Rousseau, 2020. "The Theoretical Foundation(s) for Systems Engineering? Response to Yearworth," Systems Research and Behavioral Science, Wiley Blackwell, vol. 37(1), pages 188-191, January.
    5. Moti Frank, 2010. "Assessing the interest for systems engineering positions and other engineering positions' required capacity for engineering systems thinking (CEST)," Systems Engineering, John Wiley & Sons, vol. 13(2), pages 161-174, June.
    6. Alejandro Salado, 2021. "A systems‐theoretic articulation of stakeholder needs and system requirements," Systems Engineering, John Wiley & Sons, vol. 24(2), pages 83-99, March.
    7. Rahi Jain & Prashant Narnaware, 2020. "Application of Systems Thinking to Dent Child Malnutrition: A Palghar District, India Case Study," Millennial Asia, , vol. 11(1), pages 79-98, April.
    8. Goldman, Alyssa W. & Kane, Mary, 2014. "Concept mapping and network analysis: An analytic approach to measure ties among constructs," Evaluation and Program Planning, Elsevier, vol. 47(C), pages 9-17.
    9. Jason M. Orr & Jonathon P. Leider & Margaret J. Gutilla, 2023. "System approaches in governmental public health: Findings from an analysis of the literature," Systems Research and Behavioral Science, Wiley Blackwell, vol. 40(1), pages 159-169, January.
    10. Nina Roczen & Frank Fischer & Janis Fögele & Johannes Hartig & Rainer Mehren, 2021. "Measuring System Competence in Education for Sustainable Development," Sustainability, MDPI, vol. 13(9), pages 1-15, April.
    11. Céline Bérard & L.M., Cloutier & Luc Cassivi, 2017. "The effects of using system dynamics-based decision support models: testing policy-makers’ boundaries in a complex situation," Post-Print hal-02128255, HAL.
    12. Liesel Carlsson & Edith Callaghan & Göran Broman, 2021. "Assessing Community Contributions to Sustainable Food Systems: Dietitians Leverage Practice, Process and Paradigms," Systemic Practice and Action Research, Springer, vol. 34(5), pages 575-601, October.
    13. Hyunju Rachel Kim, 2014. "Formulation of a Success Model in Pharmaceutical R&D," SAGE Open, , vol. 4(1), pages 21582440145, March.
    14. Lalani, Baqir & Aminpour, Payam & Gray, Steven & Williams, Meredith & Büchi, Lucie & Haggar, Jeremy & Grabowski, Philip & Dambiro, José, 2021. "Mapping farmer perceptions, Conservation Agriculture practices and on-farm measurements: The role of systems thinking in the process of adoption," Agricultural Systems, Elsevier, vol. 191(C).
    15. Therese Riley & Liza Hopkins & Maria Gomez & Seanna Davidson & Daniel Chamberlain & Jessica Jacob & Sonia Wutzke, 2021. "A Systems Thinking Methodology for Studying Prevention Efforts in Communities," Systemic Practice and Action Research, Springer, vol. 34(5), pages 555-573, October.
    16. Ar. R. T. Hidayat & Corinthias P. M. Sianipar & Shizuka Hashimoto & Satoshi Hoshino & Muhammad Dimyati & Ahmad E. Yustika, 2023. "Personal Cognition and Implicit Constructs Affecting Preferential Decisions on Farmland Ownership: Multiple Case Studies in Kediri, East Java, Indonesia," Land, MDPI, vol. 12(10), pages 1-23, September.
    17. Heidi L. Davidz & Deborah J. Nightingale, 2008. "Enabling systems thinking to accelerate the development of senior systems engineers," Systems Engineering, John Wiley & Sons, vol. 11(1), pages 1-14, March.
    18. Nisbett, Nicholas, 2019. "Understanding the nourishment of bodies at the centre of food and health systems – systemic, bodily and new materialist perspectives on nutritional inequity," Social Science & Medicine, Elsevier, vol. 228(C), pages 9-16.
    19. Roderick J. Lawrence, 2023. "Promoting and Sustaining Urban Health: Challenges and Responses," Sustainability, MDPI, vol. 15(17), pages 1-13, August.
    20. Omid Ali Kharazmi & Amirali Kharazmi, 2022. "A pathological analysis of challenges related to systems thinking studies in Iran," Systems Research and Behavioral Science, Wiley Blackwell, vol. 39(2), pages 241-257, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:srbeha:v:39:y:2022:i:4:p:840-866. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://onlinelibrary.wiley.com/journal/10.1111/1092-7026 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.