IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v91y2022ics0149718922000027.html
   My bibliography  Save this article

Integrating user experience evaluation in the development of a web-based Community Engagement Toolkit

Author

Listed:
  • Asikin-Garmager, Asih
  • Dowd, Patrick
  • George, Salim
  • Afifi, Rima A.

Abstract

Current advances in technology have allowed programs to become more innovative and provide web-based services and products for their participants. This requires evaluators to expand their evaluation repertoire to continue to provide useful and actionable information. Our study illustrates the application of user experience evaluation as part of the formative evaluation of the Community Engagement Toolkit (CETK), developed by the Network of the National Library of Medicine. The CETK is a website containing resources that help library staff deliver health-literacy programming more effectively. The overarching objective of the evaluation was to obtain in-depth feedback from potential users about the website design and content in order to make the toolkit user friendly and useful. We used an online video conferencing software to conduct contextual observations and interviews with geographically dispersed participants. Findings from the evaluation study indicated an overall favorable review of the toolkit’s interface and navigation, but relatively less favorable review of content relevance and broad appeal for the participants. Feedback from the participants was used to inform the development of the toolkit to increase the likelihood of its use and value for intended users.

Suggested Citation

  • Asikin-Garmager, Asih & Dowd, Patrick & George, Salim & Afifi, Rima A., 2022. "Integrating user experience evaluation in the development of a web-based Community Engagement Toolkit," Evaluation and Program Planning, Elsevier, vol. 91(C).
  • Handle: RePEc:eee:epplan:v:91:y:2022:i:c:s0149718922000027
    DOI: 10.1016/j.evalprogplan.2022.102048
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718922000027
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.evalprogplan.2022.102048?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Marya Wani & Vishnupriya Raghavan & Dolphy Abraham & Virginia Kleist, 2017. "Beyond utilitarian factors: User experience and travel company website successes," Information Systems Frontiers, Springer, vol. 19(4), pages 769-785, August.
    2. Ping Zhang & Gisela M. von Dran, 2000. "Satisfiers and dissatisfiers: A two‐factor model for website design and evaluation," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 51(14), pages 1253-1268.
    3. Brennan Ramirez, Laura K. & Bender, Julie M. & Barnidge, Ellen K. & Baker, Elizabeth A. & Land, Garland, 2006. "Evaluating an evidence-based physical activity intervention website," Evaluation and Program Planning, Elsevier, vol. 29(3), pages 269-279, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Uglješa Stankov & Ulrike Gretzel, 2020. "Tourism 4.0 technologies and tourist experiences: a human-centered design perspective," Information Technology & Tourism, Springer, vol. 22(3), pages 477-488, September.
    2. Geetu Tuteja & Shashank Gupta & Vaishali Garg, 2016. "Consumer Trust in Internet Shopping," Paradigm, , vol. 20(2), pages 191-215, December.
    3. Chia-Ying Li & Yu-Hui Fang & Badri Munir Sukoco, 2021. "Value proposition as a catalyst for innovative service experience: the case of smart-tourism destinations," Service Business, Springer;Pan-Pacific Business Association, vol. 15(2), pages 281-308, June.
    4. Bilegjargal Ganbold & Kyungbo Park & Jongyi Hong, 2022. "Study of Educational Service Quality in Mongolian Universities," Sustainability, MDPI, vol. 15(1), pages 1-27, December.
    5. Waleed A. Hammood & Ruzaini Abdullah Arshah & Salwana Mohamad Asmara & Hussam Al Halbusi & Omar A. Hammood & Salem Al Abri, 2021. "A Systematic Review on Flood Early Warning and Response System (FEWRS): A Deep Review and Analysis," Sustainability, MDPI, vol. 13(1), pages 1-24, January.
    6. Chulmo Koo & Francesco Ricci & Cihan Cobanoglu & Fevzi Okumus, 2017. "Special issue on smart, connected hospitality and tourism," Information Systems Frontiers, Springer, vol. 19(4), pages 699-703, August.
    7. Carlos Tam & Diogo Santos & Tiago Oliveira, 2020. "Exploring the influential factors of continuance intention to use mobile Apps: Extending the expectation confirmation model," Information Systems Frontiers, Springer, vol. 22(1), pages 243-257, February.
    8. Teresa Borges-Tiago & Sandra Silva & Sónia Avelar & João Pedro Couto & Luíz Mendes-Filho & Flávio Tiago, 2021. "Tourism and COVID-19: The Show Must Go On," Sustainability, MDPI, vol. 13(22), pages 1-19, November.
    9. Gabor Aranyi & Paul Schaik, 2015. "Modeling user experience with news websites," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(12), pages 2471-2493, December.
    10. Ioannis Krasonikolakis & Adam Vrechopoulos & Sergios Dimitriadis & Nancy Pouloudi, 2021. "User perceptions of 3D online store designs: an experimental investigation," Information Systems and e-Business Management, Springer, vol. 19(4), pages 1321-1354, December.
    11. Arnold Ojugo & D. O. Otakore, 2017. "Redesigning Academic Website for Better Visibility and Footprint: A Case of the Federal University of Petroleum Resources Effurun Website," Network and Communication Technologies, Canadian Center of Science and Education, vol. 3(1), pages 1-33, December.
    12. Heinze, Nathan & Hu, Qing, 2006. "The evolution of corporate web presence: A longitudinal study of large American companies," International Journal of Information Management, Elsevier, vol. 26(4), pages 313-325.
    13. Olayinka David-West & Oluwasola Oni & Folajimi Ashiru, 2022. "Diffusion of Innovations: Mobile Money Utility and Financial Inclusion in Nigeria. Insights from Agents and Unbanked Poor End Users," Information Systems Frontiers, Springer, vol. 24(6), pages 1753-1773, December.
    14. Harman Preet Singh & Ibrahim Abdullah Alhamad, 2022. "A Novel Categorization of Key Predictive Factors Impacting Hotels’ Online Ratings: A Case of Makkah," Sustainability, MDPI, vol. 14(24), pages 1-25, December.
    15. Maksym Koghut & Omar AI-Tabbaa, 2021. "Exploring Consumers’ Discontinuance Intention of Remote Mobile Payments during Post-Adoption Usage: An Empirical Study," Administrative Sciences, MDPI, vol. 11(1), pages 1-33, February.
    16. Lo, Louis Yi-Shih & Lin, Sheng-Wei & Hsu, Li-Yi, 2016. "Motivation for online impulse buying: A two-factor theory perspective," International Journal of Information Management, Elsevier, vol. 36(5), pages 759-772.
    17. Anne-Madeleine Kranzbühler & Mirella H. P. Kleijnen & Peeter W. J. Verlegh, 2019. "Outsourcing the pain, keeping the pleasure: effects of outsourced touchpoints in the customer journey," Journal of the Academy of Marketing Science, Springer, vol. 47(2), pages 308-327, March.
    18. Swati Singh & Sapna Rakesh, 2012. "Consumer Perception towards Loyalty Card Programs - A Study of Indian Consumers," Indian Journal of Commerce and Management Studies, Educational Research Multimedia & Publications,India, vol. 3(2), pages 58-62, May.
    19. Mahfouz, Ahmed Y. & Joonas, Kishwar & Opara, Emmanuel U., 2020. "An overview of and factor analytic approach to flow theory in online contexts," Technology in Society, Elsevier, vol. 61(C).
    20. Anil Kumar Thekkat & S. Victor Anandkumar, 2021. "Luxury Shopping Websites: The Impact of ‘Hygiene’ Design Factors on Trust and Distrust," FIIB Business Review, , vol. 10(3), pages 290-299, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:91:y:2022:i:c:s0149718922000027. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.