IDEAS home Printed from https://ideas.repec.org/a/sae/sagope/v7y2017i2p2158244017710291.html
   My bibliography  Save this article

Developing and Applying a Framework for Assessing the Research Quality of Qualitative Project Methods in the EU Project SECUR-ED

Author

Listed:
  • Sindre A. Høyland
  • Janne M. Hagen
  • Wolf Engelbach

Abstract

Qualitative research plays a vital role in political development and in the design of statutes and directives. Consequently, ensuring the quality of this research is important. However, the current literature on evaluation of quantitative and qualitative research does not reflect this importance, and we have identified a need to establish guidelines for evaluating qualitative research projects for quality. Therefore, and based on existing research, we have developed a framework for assessing the research quality of large complex projects using qualitative methods. In our study, as presented in this article, we operationalize and apply the framework to evaluate six specific methods in the large European research project, Secured Urban Transportation—A European Demonstration (SECUR-ED); each method is assessed according to the quality criteria of “transferability,†“systematic design/reliability,†and “transactional validity.†Overall, we find that half of the SECUR-ED project methods demonstrate thorough documentation and transferability, and that half of the methods lack consistent usage and therefore score low on both reliability and validity. We also find that one method, the capacity mapping matrix, scores high on all quality parameters. Accordingly, we suggest that future European Union (EU) projects replicate the documentation efforts demonstrated in relation to several of the SECUR-ED methods, and consider the capacity mapping matrix as “best practice†standard. We conclude that the framework represents a novel approach to quality assessments of qualitative project methods across research topics and contexts.

Suggested Citation

  • Sindre A. Høyland & Janne M. Hagen & Wolf Engelbach, 2017. "Developing and Applying a Framework for Assessing the Research Quality of Qualitative Project Methods in the EU Project SECUR-ED," SAGE Open, , vol. 7(2), pages 21582440177, May.
  • Handle: RePEc:sae:sagope:v:7:y:2017:i:2:p:2158244017710291
    DOI: 10.1177/2158244017710291
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/2158244017710291
    Download Restriction: no

    File URL: https://libkey.io/10.1177/2158244017710291?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Anthony Onwuegbuzie & Nancy Leech, 2007. "Validity and Qualitative Research: An Oxymoron?," Quality & Quantity: International Journal of Methodology, Springer, vol. 41(2), pages 233-249, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arif Mostafa Khan & Meine Pieter van Dijk, 2024. "The role of multi‐stakeholder initiatives in advancing circularity and social sustainability in the textiles sector of Bangladesh," Journal of International Development, John Wiley & Sons, Ltd., vol. 36(3), pages 1765-1788, April.
    2. Dietlmeier, Simon Frederic & Floetgen, Rob Jago & Urmetzer, Florian, 2024. "Performance of B2B Platform Partnership Management," MPRA Paper 120610, University Library of Munich, Germany.
    3. Sven Ivens & Monika Oberle, 2020. "Does Scientific Evaluation Matter? Improving Digital Simulation Games by Design-Based Research," Social Sciences, MDPI, vol. 9(9), pages 1-14, September.
    4. Hassan Raza, 2018. "Participatory action research: working beyond disaster toward prevention," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 91(1), pages 117-131, March.
    5. Caspar, Sienna & Phinney, Alison & Spenceley, Shannon & Ratner, Pam, 2020. "Creating cultures of care: exploring the social organization of care delivery in long-term care homes," LSE Research Online Documents on Economics 106220, London School of Economics and Political Science, LSE Library.
    6. Rosario Vázquez-Carrasco & Ma. López-Pérez & Edgar Centeno, 2012. "A qualitative approach to the challenges for women in management: are they really starting in the 21st century?," Quality & Quantity: International Journal of Methodology, Springer, vol. 46(5), pages 1337-1357, August.
    7. Hamdan A. Alamri & Abdulaziz A. Alfayez, 2023. "Preservice teachers’ experiences of observing their teaching competencies via self-recorded videos in a personalized learning environment," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-12, December.
    8. Eeva‐Mari Ihantola & Lili‐Anne Kihn, 2011. "Threats to validity and reliability in mixed methods accounting research," Qualitative Research in Accounting & Management, Emerald Group Publishing Limited, vol. 8(1), pages 39-58, April.
    9. Matthew M. Mars, 2022. "Community and Cultural Entrepreneurship and Value Co-Creation in the Local Food Marketscape," Sustainability, MDPI, vol. 14(24), pages 1-20, December.
    10. Sam De Boise, 2014. "Learning to be Affected: Masculinities, Music and Social Embodiment," Sociological Research Online, , vol. 19(2), pages 1-15, May.
    11. Wiley Kimberly Kay, 2022. "Leveraging Political Resources: Applying the Advocacy Coalition Framework to the National Coalition Against Domestic Violence," Nonprofit Policy Forum, De Gruyter, vol. 13(1), pages 1-30, January.
    12. Sascha Fuerst & Odille Sanchez-Dominguez & Miguel Angel Rodriguez-Montes, 2023. "The Role of Digital Technology within the Business Model of Sustainable Entrepreneurship," Sustainability, MDPI, vol. 15(14), pages 1-17, July.
    13. Genevé Richard & Elza Odendaal, 2020. "Integrated reporting assurance practices—a study of South African firms," International Journal of Disclosure and Governance, Palgrave Macmillan, vol. 17(4), pages 245-266, December.
    14. Seyyed Ostovar-Namaghi & Maryam Gholami, 2018. "Exploring Language Teachers’ Perceptions of Cyclical Presentation of Materials in an EFL Context: A Grounded Theory," English Language Teaching, Canadian Center of Science and Education, vol. 11(3), pages 1-60, March.
    15. Lukka, Kari & Modell, Sven, 2010. "Validation in interpretive management accounting research," Accounting, Organizations and Society, Elsevier, vol. 35(4), pages 462-477, May.
    16. Karen Hidden & Jonathan Tresman Marks, 2020. "Misaligned Needs in the Pursuit of Shared Value: A Multi-Stakeholder Study of the Shift from Corporate Social Responsibility to Corporate Social Entrepreneurship in an Emerging Economy," Journal of Entrepreneurship and Innovation in Emerging Economies, Entrepreneurship Development Institute of India, vol. 6(2), pages 363-382, July.
    17. Joel Oommen George & Suzanne Elayan & Martin Sykora & Marin Solter & Rob Feick & Christopher Hewitt & Yiqiao Liu & Ketan Shankardass, 2023. "The Role of Social Media in Building Pandemic Resilience in an Urban Community: A Qualitative Case Study," IJERPH, MDPI, vol. 20(17), pages 1-18, September.
    18. John Robert Warren & Andrew Halpern-Manners, 2012. "Panel Conditioning in Longitudinal Social Science Surveys," Sociological Methods & Research, , vol. 41(4), pages 491-534, November.
    19. Milanova, Veselina & Maas, Peter, 2017. "Sharing intangibles: Uncovering individual motives for engagement in a sharing service setting," Journal of Business Research, Elsevier, vol. 75(C), pages 159-171.
    20. C. Poortman & K. Schildkamp, 2012. "Alternative quality standards in qualitative research?," Quality & Quantity: International Journal of Methodology, Springer, vol. 46(6), pages 1727-1751, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:sagope:v:7:y:2017:i:2:p:2158244017710291. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.