IDEAS home Printed from https://ideas.repec.org/a/eee/teinso/v78y2024ics0160791x24001994.html
   My bibliography  Save this article

Cognitive-affective maps (CAMs) as measurement tool – Elaboration of quantitative and qualitative test-retest reliability

Author

Listed:
  • Gros, Wilhelm
  • Reuter, Lisa
  • Sprich, Julia
  • Schuldzinski, Dennis
  • Fenn, Julius
  • Kiesel, Andrea

Abstract

Cognitive-Affective Mapping is a novel mind-map like technique enabling to visually represent existing belief systems or any declarative knowledge and can therefore be used in empirical social research. It can be applied broadly, for example to assess technology acceptance, and the obtained data can be analyzed with quantitative and/or qualitative approaches. Here, we aimed for the first time to assess the data quality of Cognitive-Affective Maps (CAMs). To assess whether the findings of CAM studies are due to measurement errors or due to a real effect, we aimed for a quantitative as well as qualitative test-retest reliability approach. Participants (62 in total) drew a CAM online on their cognitions, emotions and experiences regarding the topic "Universal Basic Income" twice with delays of the two measurement time points ranging from 7 to 24 days. Assuming that the evaluation of this topic is driven by values, a stable psychological measurement construct, we presume a high test-retest reliability. Pearson's Product-Moment-Correlations and Spearman's Rank Correlations of CAM parameters show quantitative test-retest reliabilities up to 0.78. Furthermore, two raters identified on average 52 % of repeated or at least semantically similar concepts drawn by the participants between the two measurement time points. Taken together, these findings are promising for a method with this amount of degrees of freedom.

Suggested Citation

  • Gros, Wilhelm & Reuter, Lisa & Sprich, Julia & Schuldzinski, Dennis & Fenn, Julius & Kiesel, Andrea, 2024. "Cognitive-affective maps (CAMs) as measurement tool – Elaboration of quantitative and qualitative test-retest reliability," Technology in Society, Elsevier, vol. 78(C).
    • Handle: RePEc:eee:teinso:v:78:y:2024:i:c:s0160791x24001994
    DOI: 10.1016/j.techsoc.2024.102651
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0160791X24001994
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.techsoc.2024.102651?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cousse, Julia & Trutnevyte, Evelina & Hahnel, Ulf J.J., 2021. "Tell me how you feel about geothermal energy: Affect as a revealing factor of the role of seismic risk on public acceptance," Energy Policy, Elsevier, vol. 158(C).
    2. Lee Soomi, 2018. "Attitudes Toward Universal Basic Income and Welfare State in Europe: A Research Note," Basic Income Studies, De Gruyter, vol. 13(1), pages 1-9, June.
    3. Lilach Sagiv & Sonia Roccas & Jan Cieciuch & Shalom H. Schwartz, 2017. "Personal values in human life," Nature Human Behaviour, Nature, vol. 1(9), pages 630-639, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Claudia Salceanu, 2019. "The Evolution of Human Values – A Comparative Study of Values in Adolescents and Emerging Adults," Postmodern Openings, Editura Lumen, Department of Economics, vol. 10(2), pages 74-83, June.
    2. Sasse, Jan-Philipp & Trutnevyte, Evelina, 2023. "Cost-effective options and regional interdependencies of reaching a low-carbon European electricity system in 2035," Energy, Elsevier, vol. 282(C).
    3. Ana Carneiro & Hélder Fernando Pedrosa e Sousa & Maria Alzira Pimenta Dinis & Ângela Leite, 2021. "Human Values and Religion: Evidence from the European Social Survey," Social Sciences, MDPI, vol. 10(2), pages 1-18, February.
    4. Valentina Socci & Dalila Talevi & Paolo Stratta & Alessandro Rossi & Francesca Pacitti & Alessia Lucaselli & Eleonora Gregori & Eleonora Quarta & Rodolfo Rossi, 2021. "Personal values in mental disorders: an exploratory analysis," Palgrave Communications, Palgrave Macmillan, vol. 8(1), pages 1-7, December.
    5. Dabić, Marina & Maley, Jane F. & Črešnar, Rok & Nedelko, Zlatko, 2023. "Unappreciated channel of manufacturing productivity under industry 4.0: Leadership values and capabilities," Journal of Business Research, Elsevier, vol. 162(C).
    6. Julia Jastrzębska & Magdalena Błażek, 2022. "Questioning Gender and Sexual Identity in the Context of Self-Concept Clarity, Sense of Coherence and Value System," IJERPH, MDPI, vol. 19(17), pages 1-10, August.
    7. Spampatti, Tobia & Hahnel, Ulf J.J. & Trutnevyte, Evelina & Brosch, Tobias, 2022. "Short and long-term dominance of negative information in shaping public energy perceptions: The case of shallow geothermal systems," Energy Policy, Elsevier, vol. 167(C).
    8. Rok Črešnar & Zlatko Nedelko, 2020. "Understanding Future Leaders: How Are Personal Values of Generations Y and Z Tailored to Leadership in Industry 4.0?," Sustainability, MDPI, vol. 12(11), pages 1-19, May.
    9. Ângela Leite & Ana Ramires & Diogo Guedes Vidal & Hélder Fernando Pedrosa e Sousa & Maria Alzira Pimenta Dinis & Alexandra Fidalgo, 2021. "Hierarchical Cluster Analysis of Human Value Priorities and Associations with Subjective Well-Being, Subjective General Health, Social Life, and Depression across Europe," Social Sciences, MDPI, vol. 10(2), pages 1-25, February.
    10. Cinzia Daraio & Alessio Vaccari, 2020. "Using normative ethics for building a good evaluation of research practices: towards the assessment of researcher’s virtues," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1053-1075, November.
    11. R.V., Rohit & R., Vipin Raj & Kiplangat, Dennis C. & R., Veena & Jose, Rajan & Pradeepkumar, A.P. & Kumar, K. Satheesh, 2023. "Tracing the evolution and charting the future of geothermal energy research and development," Renewable and Sustainable Energy Reviews, Elsevier, vol. 184(C).
    12. Cinzia Daraio & Alessio Vaccari, 2019. "Sorting out Guidelines for the Good Evaluation of Research Practices," DIAG Technical Reports 2019-02, Department of Computer, Control and Management Engineering, Universita' degli Studi di Roma "La Sapienza".
    13. Li, Tingting Elle & Chan, Eric Tak Hin, 2020. "Diaspora tourism and well-being over life-courses," Annals of Tourism Research, Elsevier, vol. 82(C).
    14. Anastasia Ioannou & Gioia Falcone & Christina Baisch & Georgie Friederichs & Jan Hildebrand, 2023. "A Decision Support Tool for Social Engagement, Alternative Financing and Risk Mitigation of Geothermal Energy Projects," Energies, MDPI, vol. 16(3), pages 1-25, January.
    15. Phillips, L. Taylor & Kreps, Tamar A. & Chugh, Dolly, 2024. "Different ally motivations lead to different outcomes: How self-transcendence and self-enhancement values predict effectiveness of self-identified allies," Organizational Behavior and Human Decision Processes, Elsevier, vol. 182(C).
    16. Anna M. Zalewska & Marta Zwierzchowska, 2022. "Personality Traits, Personal Values, and Life Satisfaction among Polish Nurses," IJERPH, MDPI, vol. 19(20), pages 1-15, October.
    17. Cinzia Daraio & Alessio Vaccari, 2019. "Sorting out Guidelines for a Good Evaluation of Research Practices.Towards the Assessment of Researcher’s Virtues," DIAG Technical Reports 2019-10, Department of Computer, Control and Management Engineering, Universita' degli Studi di Roma "La Sapienza".
    18. Jaana Sorvali & Janne Kaseva & Pirjo Peltonen-Sainio, 2021. "Farmer views on climate change—a longitudinal study of threats, opportunities and action," Climatic Change, Springer, vol. 164(3), pages 1-19, February.
    19. Susan L. Prescott & Alan C. Logan, 2018. "From Authoritarianism to Advocacy: Lifestyle-Driven, Socially-Transmitted Conditions Require a Transformation in Medical Training and Practice," Challenges, MDPI, vol. 9(1), pages 1-29, March.
    20. Barbara Kump, 2021. "When do threats mobilize managers for organizational change toward sustainability? An environmental belief model," Business Strategy and the Environment, Wiley Blackwell, vol. 30(5), pages 2713-2726, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:teinso:v:78:y:2024:i:c:s0160791x24001994. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/technology-in-society .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.