IDEAS home Printed from https://ideas.repec.org/a/gam/jijerp/v18y2021i21p11507-d670159.html
   My bibliography  Save this article

Methodological Quality of User-Centered Usability Evaluation of Ambient Assisted Living Solutions: A Systematic Literature Review

Author

Listed:
  • Rute Bastardo

    (UNIDCOM, Science and Technology School, University of Trás-os-Montes and Alto Douro, Quinta de Prado, 5001-801 Vila Real, Portugal)

  • Ana Isabel Martins

    (Center for Health Technology and Services Research, Health Sciences School, University of Aveiro, 3810-193 Aveiro, Portugal)

  • João Pavão

    (INESC-TEC, Science and Technology School, University of Trás-os-Montes and Alto Douro, Quinta de Prado, 5001-801 Vila Real, Portugal)

  • Anabela Gonçalves Silva

    (Center for Health Technology and Services Research, Health Sciences School, University of Aveiro, 3810-193 Aveiro, Portugal)

  • Nelson Pacheco Rocha

    (Department of Medical Sciences, IEETA-Institute of Electronics and Informatics Engineering of Aveiro, University of Aveiro, 3810-193 Aveiro, Portugal)

Abstract

This study aimed to determine the methodological quality of user-centered usability evaluation of Ambient Assisted Living (AAL) solutions by (i) identifying the characteristics of the AAL studies reporting on user-centered usability evaluation, (ii) systematizing the methods, procedures and instruments being used, and (iii) verifying if there is evidence of a common understanding on methods, procedures, and instruments for user-centered usability evaluation. An electronic search was conducted on Web of Science, Scopus, and IEEE Xplore databases, combining relevant keywords. Then, titles and abstracts were screened against inclusion and exclusion criteria, and the full texts of the eligible studies were retrieved and screened for inclusion. A total of 44 studies were included. The results show a great heterogeneity of methods, procedures, and instruments to evaluate the usability of AAL solutions and, in general, the researchers fail to consider and report relevant methodological aspects. Guidelines and instruments to assess the quality of the studies might help improving the experimental design and reporting of studies on user-centered usability evaluation of AAL solutions.

Suggested Citation

  • Rute Bastardo & Ana Isabel Martins & João Pavão & Anabela Gonçalves Silva & Nelson Pacheco Rocha, 2021. "Methodological Quality of User-Centered Usability Evaluation of Ambient Assisted Living Solutions: A Systematic Literature Review," IJERPH, MDPI, vol. 18(21), pages 1-18, November.
    • Handle: RePEc:gam:jijerp:v:18:y:2021:i:21:p:11507-:d:670159
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1660-4601/18/21/11507/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1660-4601/18/21/11507/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Lina Garcés & Flavio Oquendo & Elisa Yumi Nakagawa, 2020. "Assessment of Reference Architectures and Reference Models for Ambient Assisted Living Systems: Results of a Systematic Literature Review," International Journal of E-Health and Medical Communications (IJEHMC), IGI Global, vol. 11(1), pages 17-36, January.
    2. Glass, Thomas A. & McAtee, Matthew J., 2006. "Behavioral science at the crossroads in public health: Extending horizons, envisioning the future," Social Science & Medicine, Elsevier, vol. 62(7), pages 1650-1671, April.
    3. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    4. Ana F. Almeida & Nelson P. Rocha & Anabela G. Silva, 2020. "Methodological Quality of Manuscripts Reporting on the Usability of Mobile Applications for Pain Assessment and Management: A Systematic Review," IJERPH, MDPI, vol. 17(3), pages 1-12, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. İlkay Unay-Gailhard & Mark A. Brennen, 2022. "How digital communications contribute to shaping the career paths of youth: a review study focused on farming as a career option," Agriculture and Human Values, Springer;The Agriculture, Food, & Human Values Society (AFHVS), vol. 39(4), pages 1491-1508, December.
    2. Mahin Ghafari & Vali Baigi & Zahra Cheraghi & Amin Doosti-Irani, 2016. "The Prevalence of Asymptomatic Bacteriuria in Iranian Pregnant Women: A Systematic Review and Meta-Analysis," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-10, June.
    3. Elizabeth T Cafiero-Fonseca & Andrew Stawasz & Sydney T Johnson & Reiko Sato & David E Bloom, 2017. "The full benefits of adult pneumococcal vaccination: A systematic review," PLOS ONE, Public Library of Science, vol. 12(10), pages 1-23, October.
    4. Santos Urbina & Sofía Villatoro & Jesús Salinas, 2021. "Self-Regulated Learning and Technology-Enhanced Learning Environments in Higher Education: A Scoping Review," Sustainability, MDPI, vol. 13(13), pages 1-12, June.
    5. Oded Berger-Tal & Alison L Greggor & Biljana Macura & Carrie Ann Adams & Arden Blumenthal & Amos Bouskila & Ulrika Candolin & Carolina Doran & Esteban Fernández-Juricic & Kiyoko M Gotanda & Catherine , 2019. "Systematic reviews and maps as tools for applying behavioral ecology to management and policy," Behavioral Ecology, International Society for Behavioral Ecology, vol. 30(1), pages 1-8.
    6. Nadine Desrochers & Adèle Paul‐Hus & Jen Pecoskie, 2017. "Five decades of gratitude: A meta‐synthesis of acknowledgments research," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(12), pages 2821-2833, December.
    7. Maryono, Maryono & Killoes, Aditya Marendra & Adhikari, Rajendra & Abdul Aziz, Ammar, 2024. "Agriculture development through multi-stakeholder partnerships in developing countries: A systematic literature review," Agricultural Systems, Elsevier, vol. 213(C).
    8. Alene Sze Jing Yong & Yi Heng Lim & Mark Wing Loong Cheong & Ednin Hamzah & Siew Li Teoh, 2022. "Willingness-to-pay for cancer treatment and outcome: a systematic review," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 23(6), pages 1037-1057, August.
    9. Xue-Ying Xu & Hong Kong & Rui-Xiang Song & Yu-Han Zhai & Xiao-Fei Wu & Wen-Si Ai & Hong-Bo Liu, 2014. "The Effectiveness of Noninvasive Biomarkers to Predict Hepatitis B-Related Significant Fibrosis and Cirrhosis: A Systematic Review and Meta-Analysis of Diagnostic Test Accuracy," PLOS ONE, Public Library of Science, vol. 9(6), pages 1-16, June.
    10. Vicente Miñana-Signes & Manuel Monfort-Pañego & Javier Valiente, 2021. "Teaching Back Health in the School Setting: A Systematic Review of Randomized Controlled Trials," IJERPH, MDPI, vol. 18(3), pages 1-18, January.
    11. Agnieszka A. Tubis & Katarzyna Grzybowska, 2022. "In Search of Industry 4.0 and Logistics 4.0 in Small-Medium Enterprises—A State of the Art Review," Energies, MDPI, vol. 15(22), pages 1-26, November.
    12. Obsa Urgessa Ayana & Jima Degaga, 2022. "Effects of rural electrification on household welfare: a meta-regression analysis," International Review of Economics, Springer;Happiness Economics and Interpersonal Relations (HEIRS), vol. 69(2), pages 209-261, June.
    13. Caloffi, Annalisa & Colovic, Ana & Rizzoli, Valentina & Rossi, Federica, 2023. "Innovation intermediaries' types and functions: A computational analysis of the literature," Technological Forecasting and Social Change, Elsevier, vol. 189(C).
    14. García-Poole, Chloe & Byrne, Sonia & Rodrigo, María José, 2019. "How do communities intervene with adolescents at psychosocial risk? A systematic review of positive development programs," Children and Youth Services Review, Elsevier, vol. 99(C), pages 194-209.
    15. Jie Zhao & Ji Chen & Damien Beillouin & Hans Lambers & Yadong Yang & Pete Smith & Zhaohai Zeng & Jørgen E. Olesen & Huadong Zang, 2022. "Global systematic review with meta-analysis reveals yield advantage of legume-based rotations and its drivers," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    16. Qing Ye & Bao-Xin Qian & Wei-Li Yin & Feng-Mei Wang & Tao Han, 2016. "Association between the HFE C282Y, H63D Polymorphisms and the Risks of Non-Alcoholic Fatty Liver Disease, Liver Cirrhosis and Hepatocellular Carcinoma: An Updated Systematic Review and Meta-Analysis o," PLOS ONE, Public Library of Science, vol. 11(9), pages 1-17, September.
    17. Bishal Mohindru & David Turner & Tracey Sach & Diana Bilton & Siobhan Carr & Olga Archangelidi & Arjun Bhadhuri & Jennifer A. Whitty, 2020. "Health State Utility Data in Cystic Fibrosis: A Systematic Review," PharmacoEconomics - Open, Springer, vol. 4(1), pages 13-25, March.
    18. Subramaniam, Mega & Pang, Natalie & Morehouse, Shandra & Asgarali-Hoffman, S. Nisa, 2020. "Examining vulnerability in youth digital information practices scholarship: What are we missing or exhausting?," Children and Youth Services Review, Elsevier, vol. 116(C).
    19. Neal R. Haddaway & Matthew J. Page & Chris C. Pritchard & Luke A. McGuinness, 2022. "PRISMA2020: An R package and Shiny app for producing PRISMA 2020‐compliant flow diagrams, with interactivity for optimised digital transparency and Open Synthesis," Campbell Systematic Reviews, John Wiley & Sons, vol. 18(2), June.
    20. Ding Zhu & Mindan Wu & Yuan Cao & Shihua Lin & Nanxia Xuan & Chen Zhu & Wen Li & Huahao Shen, 2018. "Heated humidification did not improve compliance of positive airway pressure and subjective daytime sleepiness in obstructive sleep apnea syndrome: A meta-analysis," PLOS ONE, Public Library of Science, vol. 13(12), pages 1-16, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jijerp:v:18:y:2021:i:21:p:11507-:d:670159. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.