IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v51y2017i6d10.1007_s11135-016-0399-x.html
   My bibliography  Save this article

Multi-map comparison for group concept mapping: an approach for examining conceptual congruence through spatial correspondence

Author

Listed:
  • Scott R. Rosas

    (Concept Systems, Inc.)

Abstract

Group concept mapping, a participatory mixed-methods approach used extensively in behavioral and social research, is used to specify and generate a two-dimensional conceptual model based on input solicited from an identified group. In situations where the systematic evaluation of the multidimensional conceptualized patterns generated by different subgroups is meaningful, little guidance exists. This paper contrasts two analytical approaches, configural similarity comparison and Procrustes comparison, emphasizing the latter as a more rigorous and appropriate technique for facilitating such comparisons. As demonstrated in this study, Procrustes analysis provides a solid statistical and interpretative foundation to measuring the similarity of MDS configurations found in concept mapping output. Paired with a permutation strategy for assessing significance and examination of residual values, Procrustes analysis offers an objective means to evaluate the general concordance of multivariate patterns generated through group concept mapping. Statistical and visual techniques are also used to further explore the specific patterns of residual values generated in the Procrustes comparison. From this demonstration, a procedure for testing the correspondence between multiple two-dimensional concept maps where the same content is considered by independent groups is suggested.

Suggested Citation

  • Scott R. Rosas, 2017. "Multi-map comparison for group concept mapping: an approach for examining conceptual congruence through spatial correspondence," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(6), pages 2421-2439, November.
    • Handle: RePEc:spr:qualqt:v:51:y:2017:i:6:d:10.1007_s11135-016-0399-x
    DOI: 10.1007/s11135-016-0399-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-016-0399-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11135-016-0399-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Rosas, Scott R. & Kane, Mary, 2012. "Quality and rigor of the concept mapping methodology: A pooled study analysis," Evaluation and Program Planning, Elsevier, vol. 35(2), pages 236-245.
    2. Per Ahlgren & Bo Jarneving & Ronald Rousseau, 2003. "Requirements for a cocitation similarity measure, with special reference to Pearson's correlation coefficient," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 54(6), pages 550-560, April.
    3. Marquart, Jules M., 1989. "A pattern matching approach to assess the construct validity of an evaluation instrument," Evaluation and Program Planning, Elsevier, vol. 12(1), pages 37-43, January.
    4. Dumont, Jeanne, 1989. "Validity of multidimensional scaling in the context of structured conceptualization," Evaluation and Program Planning, Elsevier, vol. 12(1), pages 81-86, January.
    5. J. Kruskal, 1964. "Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis," Psychometrika, Springer;The Psychometric Society, vol. 29(1), pages 1-27, March.
    6. Forrest Young, 1970. "Nonmetric multidimensional scaling: Recovery of metric information," Psychometrika, Springer;The Psychometric Society, vol. 35(4), pages 455-473, December.
    7. Davis, James E., 1989. "Construct validity in measurement : A pattern matching approach," Evaluation and Program Planning, Elsevier, vol. 12(1), pages 31-36, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roger Girard & Norman Cliff, 1976. "A monte carlo evaluation of interactive multidimensional scaling," Psychometrika, Springer;The Psychometric Society, vol. 41(1), pages 43-64, March.
    2. Rosas, Scott R. & Ridings, John W., 2017. "The use of concept mapping in measurement development and evaluation: Application and future directions," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 265-276.
    3. Michael C. Hout & Corbin A. Cunningham & Arryn Robbins & Justin MacDonald, 2018. "Simulating the Fidelity of Data for Large Stimulus Set Sizes and Variable Dimension Estimation in Multidimensional Scaling," SAGE Open, , vol. 8(2), pages 21582440187, April.
    4. Loet Leydesdorff & Daniele Rotolo & Ismael Rafols, 2012. "Bibliometric perspectives on medical innovation using the medical subject Headings of PubMed," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(11), pages 2239-2253, November.
    5. Orsi, Rebecca, 2017. "Use of multiple cluster analysis methods to explore the validity of a community outcomes concept map," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 277-283.
    6. George Rabinowitz, 1976. "A procedure for ordering object pairs consistent with the multidimensional unfolding model," Psychometrika, Springer;The Psychometric Society, vol. 41(3), pages 349-373, September.
    7. Miller, J. Jay & Grise-Owens, Erlene & Addison, Donia & Marshall, Midaya & Trabue, Donna & Escobar-Ratliff, Laura, 2016. "Planning an organizational wellness initiative at a multi-state social service agency," Evaluation and Program Planning, Elsevier, vol. 56(C), pages 1-10.
    8. Loet Leydesdorff & Duncan Kushnir & Ismael Rafols, 2014. "Interactive overlay maps for US patent (USPTO) data based on International Patent Classification (IPC)," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 1583-1599, March.
    9. Rosas, Scott R. & Kane, Mary, 2012. "Quality and rigor of the concept mapping methodology: A pooled study analysis," Evaluation and Program Planning, Elsevier, vol. 35(2), pages 236-245.
    10. Ian Spence, 1972. "A monte carlo evaluation of three nonmetric multidimensional scaling algorithms," Psychometrika, Springer;The Psychometric Society, vol. 37(4), pages 461-486, December.
    11. Forrest Young & Cynthia Null, 1978. "Multidimensional scaling of nominal data: The recovery of metric information with alscal," Psychometrika, Springer;The Psychometric Society, vol. 43(3), pages 367-379, September.
    12. Soellner, Renate & Lenartz, Norbert & Rudinger, Georg, 2017. "Concept mapping as an approach for expert-guided model building: The example of health literacy," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 245-253.
    13. Kinga Varga & Ciaran MacDonncha & Laurence Blondel & Enrico Bozzano & Fabrice Burlot & Rute Costa & Nadine Debois & Dominique Delon & Antonio Figueiredo & Joerg Foerster & Masar Gjaka & Carlos Gonçalv, 2021. "Collective conceptualization of parental support of dual career athletes: The EMPATIA framework," PLOS ONE, Public Library of Science, vol. 16(9), pages 1-23, September.
    14. Roger Shepard, 1974. "Representation of structure in similarity data: Problems and prospects," Psychometrika, Springer;The Psychometric Society, vol. 39(4), pages 373-421, December.
    15. Giovanna Boccuzzo & Licia Maron, 2017. "Proposal of a composite indicator of job quality based on a measure of weighted distances," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(5), pages 2357-2374, September.
    16. Laura Borge & Stefanie Bröring, 2020. "What affects technology transfer in emerging knowledge areas? A multi-stakeholder concept mapping study in the bioeconomy," The Journal of Technology Transfer, Springer, vol. 45(2), pages 430-460, April.
    17. Jong-Seok Lee & Dan Zhu, 2012. "Shilling Attack Detection---A New Approach for a Trustworthy Recommender System," INFORMS Journal on Computing, INFORMS, vol. 24(1), pages 117-131, February.
    18. Ján Kulfan & Lenka Sarvašová & Michal Parák & Marek Dzurenko & Peter Zach, 2018. "Can late flushing trees avoid attack by moth larvae in temperate forests?," Plant Protection Science, Czech Academy of Agricultural Sciences, vol. 54(4), pages 272-283.
    19. Ma, Jie & Tse, Ying Kei & Wang, Xiaojun & Zhang, Minhao, 2019. "Examining customer perception and behaviour through social media research – An empirical study of the United Airlines overbooking crisis," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 127(C), pages 192-205.
    20. Muñoz-Mas, Rafael & Vezza, Paolo & Alcaraz-Hernández, Juan Diego & Martínez-Capel, Francisco, 2016. "Risk of invasion predicted with support vector machines: A case study on northern pike (Esox Lucius, L.) and bleak (Alburnus alburnus, L.)," Ecological Modelling, Elsevier, vol. 342(C), pages 123-134.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:51:y:2017:i:6:d:10.1007_s11135-016-0399-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.