IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v60y2017icp265-276.html
   My bibliography  Save this article

The use of concept mapping in measurement development and evaluation: Application and future directions

Author

Listed:
  • Rosas, Scott R.
  • Ridings, John W.

Abstract

The past decade has seen an increase of measurement development research in social and health sciences that featured the use of concept mapping as a core technique. The purpose, application, and utility of concept mapping have varied across this emerging literature. Despite the variety of uses and range of outputs, little has been done to critically review how researchers have approached the application of concept mapping in the measurement development and evaluation process. This article focuses on a review of the current state of practice regarding the use of concept mapping as methodological tool in this process. We systematically reviewed 23 scale or measure development and evaluation studies, and detail the application of concept mapping in the context of traditional measurement development and psychometric testing processes. Although several limitations surfaced, we found several strengths in the contemporary application of the method. We determined concept mapping provides (a) a solid method for establishing content validity, (b) facilitates researcher decision-making, (c) insight into target population perspectives that are integrated a priori, and (d) a foundation for analytical and interpretative choices. Based on these results, we outline how concept mapping can be situated in the measurement development and evaluation processes for new instrumentation.

Suggested Citation

  • Rosas, Scott R. & Ridings, John W., 2017. "The use of concept mapping in measurement development and evaluation: Application and future directions," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 265-276.
    • Handle: RePEc:eee:epplan:v:60:y:2017:i:c:p:265-276
    DOI: 10.1016/j.evalprogplan.2016.08.016
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718916301604
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2016.08.016?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Brian Everitt, 1980. "Cluster analysis," Quality & Quantity: International Journal of Methodology, Springer, vol. 14(1), pages 75-100, January.
    2. J. Kruskal, 1964. "Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis," Psychometrika, Springer;The Psychometric Society, vol. 29(1), pages 1-27, March.
    3. Trochim, William M. K. & Linton, Rhoda, 1986. "Conceptualization for planning and evaluation," Evaluation and Program Planning, Elsevier, vol. 9(4), pages 289-308, January.
    4. Galvin, Patrick F., 1989. "Concept mapping for planning and evaluation of a big brother/big sister program," Evaluation and Program Planning, Elsevier, vol. 12(1), pages 53-57, January.
    5. Rosas, Scott R. & Camphausen, Lauren C., 2007. "The use of concept mapping for scale development and validation in evaluation," Evaluation and Program Planning, Elsevier, vol. 30(2), pages 125-135, May.
    6. Rosas, Scott R. & Kane, Mary, 2012. "Quality and rigor of the concept mapping methodology: A pooled study analysis," Evaluation and Program Planning, Elsevier, vol. 35(2), pages 236-245.
    7. Southern, Donna M. & Young, Doris & Dunt, David & Appleby, Natalie J. & Batterham, Roy W., 2002. "Integration of primary health care services: perceptions of Australian general practitioners, non-general practitioner health service providers and consumers at the general practice-primary care inter," Evaluation and Program Planning, Elsevier, vol. 25(1), pages 47-59, February.
    8. Trochim, William M. K., 1989. "An introduction to concept mapping for planning and evaluation," Evaluation and Program Planning, Elsevier, vol. 12(1), pages 1-16, January.
    9. Batterham, R. & Southern, D. & Appleby, N. & Elsworth, G. & Fabris, S. & Dunt, D. & Young, D., 2002. "Construction of a GP integration model," Social Science & Medicine, Elsevier, vol. 54(8), pages 1225-1241, April.
    10. van der Waal, Marieke A. E. & Casparie, Anton F. & Lako, Christiaan J., 1996. "Quality of care: A comparison of preferences between medical specialists and patients with chronic diseases," Social Science & Medicine, Elsevier, vol. 42(5), pages 643-649, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lleo, A. & Ruiz-Palomino, P. & Viles, E. & Muñoz-Villamizar, A.F., 2021. "A valid and reliable scale for measuring middle managers’ trustworthiness in continuous improvement," International Journal of Production Economics, Elsevier, vol. 242(C).
    2. Monteiro Moretti, Débora & Baum, Chad M. & Ehlers, Melf-Hinrich & Finger, Robert & Bröring, Stefanie, 2023. "Exploring actors' perceptions of the precision agriculture innovation system – A Group Concept Mapping approach in Germany and Switzerland," Technological Forecasting and Social Change, Elsevier, vol. 189(C).
    3. Kwai Wing Wong & Kuan Siew Khor & Stephen Thomas Homer, 2023. "Perception of smart sustainable cities: a conceptual framework development using group concept mapping method," Asia-Pacific Journal of Regional Science, Springer, vol. 7(3), pages 959-985, September.
    4. Marta Roczniewska & Emma Hedberg Rundgren & Henna Hasson & Arnold B. Bakker & Ulrica von Thiele Schwarz, 2022. "How Should Job Crafting Interventions Be Implemented to Make Their Effects Last? Protocol for a Group Concept Mapping Study," IJERPH, MDPI, vol. 19(21), pages 1-10, October.
    5. Sandesh Pantha & Martin Jones & Richard Gray, 2022. "Development of a Guideline to Enhance the Reporting of Concept Mapping Research: Study Protocol," IJERPH, MDPI, vol. 19(12), pages 1-9, June.
    6. Albert Weckenmann & Ştefan Bodi & Sorin Popescu & Mihai Dragomir & Dan Hurgoiu & Radu Comes, 2019. "Hit or Miss? Evaluating the Potential of a Research Niche: A Case Study in the Field of Virtual Quality Management," Sustainability, MDPI, vol. 11(5), pages 1-26, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Scott R. Rosas, 2017. "Group concept mapping methodology: toward an epistemology of group conceptualization, complexity, and emergence," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(3), pages 1403-1416, May.
    2. Trochim, William M. & McLinden, Daniel, 2017. "Introduction to a special issue on concept mapping," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 166-175.
    3. Jabbar, Amina M. & Abelson, Julia, 2011. "Development of a framework for effective community engagement in Ontario, Canada," Health Policy, Elsevier, vol. 101(1), pages 59-69, June.
    4. Miller, J. Jay & Grise-Owens, Erlene & Addison, Donia & Marshall, Midaya & Trabue, Donna & Escobar-Ratliff, Laura, 2016. "Planning an organizational wellness initiative at a multi-state social service agency," Evaluation and Program Planning, Elsevier, vol. 56(C), pages 1-10.
    5. C. Pons-Morera & L. Canós-Darós & I. Gil-Pechuan, 2018. "A model of collaborative innovation between local government and tourism operators," Service Business, Springer;Pan-Pacific Business Association, vol. 12(1), pages 143-168, March.
    6. Trochim, William M., 2017. "Hindsight is 20/20: Reflections on the evolution of concept mapping," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 176-185.
    7. McLinden, Daniel, 2017. "And then the internet happened: Thoughts on the future of concept mapping," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 293-300.
    8. Donnelly, James P., 2017. "A systematic review of concept mapping dissertations," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 186-193.
    9. Soellner, Renate & Lenartz, Norbert & Rudinger, Georg, 2017. "Concept mapping as an approach for expert-guided model building: The example of health literacy," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 245-253.
    10. Kinga Varga & Ciaran MacDonncha & Laurence Blondel & Enrico Bozzano & Fabrice Burlot & Rute Costa & Nadine Debois & Dominique Delon & Antonio Figueiredo & Joerg Foerster & Masar Gjaka & Carlos Gonçalv, 2021. "Collective conceptualization of parental support of dual career athletes: The EMPATIA framework," PLOS ONE, Public Library of Science, vol. 16(9), pages 1-23, September.
    11. Laura Borge & Stefanie Bröring, 2020. "What affects technology transfer in emerging knowledge areas? A multi-stakeholder concept mapping study in the bioeconomy," The Journal of Technology Transfer, Springer, vol. 45(2), pages 430-460, April.
    12. Urban, Jennifer Brown & Hargraves, Monica & Trochim, William M., 2014. "Evolutionary Evaluation: Implications for evaluators, researchers, practitioners, funders and the evidence-based program mandate," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 127-139.
    13. Luis Miranda-Gumucio & Ignacio Gil-Pechuán & Daniel Palacios-Marqués, 2013. "An exploratory study of the determinants of switching and loyalty in prepaid cell phone users. An application of concept mapping," Service Business, Springer;Pan-Pacific Business Association, vol. 7(4), pages 603-622, December.
    14. Shern, David L. & Trochim, William M. K. & LaComb, Christina A., 1995. "The use of concept mapping for assessing fidelity of model transfer: An example from psychiatric rehabilitation," Evaluation and Program Planning, Elsevier, vol. 18(2), pages 143-153.
    15. Sandesh Pantha & Martin Jones & Richard Gray, 2022. "Development of a Guideline to Enhance the Reporting of Concept Mapping Research: Study Protocol," IJERPH, MDPI, vol. 19(12), pages 1-9, June.
    16. Miller, J. Jay & Duron, Jacquelynn F. & Donohue-Dioh, Jessica & Geiger, Jennifer M., 2018. "Conceptualizing effective legal representation for Foster youth: A group concept mapping study," Children and Youth Services Review, Elsevier, vol. 91(C), pages 271-278.
    17. Péladeau, Normand & Dagenais, Christian & Ridde, Valéry, 2017. "Concept mapping internal validity: A case of misconceived mapping?," Evaluation and Program Planning, Elsevier, vol. 62(C), pages 56-63.
    18. Erin Lebow-Skelley & Sarah Yelton & Brandi Janssen & Esther Erdei & Melanie A. Pearson, 2020. "Identifying Issues and Priorities in Reporting Back Environmental Health Data," IJERPH, MDPI, vol. 17(18), pages 1-19, September.
    19. Brown, Jason D. & Ivanova, Viktoria & Mehta, Nisha & Skrodzki, Donna & Gerrits, Julie, 2013. "Social needs of aboriginal foster parents," Children and Youth Services Review, Elsevier, vol. 35(11), pages 1886-1893.
    20. Marta Roczniewska & Emma Hedberg Rundgren & Henna Hasson & Arnold B. Bakker & Ulrica von Thiele Schwarz, 2022. "How Should Job Crafting Interventions Be Implemented to Make Their Effects Last? Protocol for a Group Concept Mapping Study," IJERPH, MDPI, vol. 19(21), pages 1-10, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:60:y:2017:i:c:p:265-276. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.