IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v12y2020i18p7451-d411629.html
   My bibliography  Save this article

Automated Assessment in Programming Courses: A Case Study during the COVID-19 Era

Author

Listed:
  • Enrique Barra

    (Departamento de Ingeniería de Sistemas Telemáticos, Escuela Técnica Superior de Ingenieros de Telecomunicación, Universidad Politécnica de Madrid, 28040 Madrid, Spain)

  • Sonsoles López-Pernas

    (Departamento de Ingeniería de Sistemas Telemáticos, Escuela Técnica Superior de Ingenieros de Telecomunicación, Universidad Politécnica de Madrid, 28040 Madrid, Spain)

  • Álvaro Alonso

    (Departamento de Ingeniería de Sistemas Telemáticos, Escuela Técnica Superior de Ingenieros de Telecomunicación, Universidad Politécnica de Madrid, 28040 Madrid, Spain)

  • Juan Fernando Sánchez-Rada

    (Departamento de Ingeniería de Sistemas Telemáticos, Escuela Técnica Superior de Ingenieros de Telecomunicación, Universidad Politécnica de Madrid, 28040 Madrid, Spain)

  • Aldo Gordillo

    (Departamento de Sistemas Informáticos, Escuela Técnica Superior de Ingenieros de Sistemas Informáticos, Universidad Politécnica de Madrid, 28031 Madrid, Spain)

  • Juan Quemada

    (Departamento de Ingeniería de Sistemas Telemáticos, Escuela Técnica Superior de Ingenieros de Telecomunicación, Universidad Politécnica de Madrid, 28040 Madrid, Spain)

Abstract

The COVID-19 pandemic imposed in many countries, in the short term, the interruption of face-to-face teaching activities and, in the medium term, the existence of a ‘new normal’, in which teaching methods should be able to switch from face-to-face to remote overnight. However, this flexibility can pose a great difficulty, especially in the assessment of practical courses with a high student–teacher ratio, in which the assessment tools or methods used in face-to-face learning are not ready to be adopted within a fully online environment. This article presents a case study describing the transformation of the assessment method of a programming course in higher education to a fully online format during the COVID-19 pandemic, by means of an automated student-centered assessment tool. To evaluate the new assessment method, we studied students’ interactions with the tool, as well as students’ perceptions, which were measured with two different surveys: one for the programming assignments and one for the final exam. The results show that the students’ perceptions of the assessment tool were highly positive: if using the tool had been optional, the majority of them would have chosen to use it without a doubt, and they would like other courses to involve a tool like the one presented in this article. A discussion about the use of this tool in subsequent years in the same and related courses is also presented, analyzing the sustainability of this new assessment method.

Suggested Citation

  • Enrique Barra & Sonsoles López-Pernas & Álvaro Alonso & Juan Fernando Sánchez-Rada & Aldo Gordillo & Juan Quemada, 2020. "Automated Assessment in Programming Courses: A Case Study during the COVID-19 Era," Sustainability, MDPI, vol. 12(18), pages 1-24, September.
    • Handle: RePEc:gam:jsusta:v:12:y:2020:i:18:p:7451-:d:411629
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/12/18/7451/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/12/18/7451/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. -, 2020. "Education in the time of COVID-19," Coediciones, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL), number 45905 edited by Eclac.
    2. -, 2020. "Education in the time of COVID-19," Libros y Documentos Institucionales, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL), number 45905 edited by Eclac.
    3. Aldo Gordillo, 2019. "Effect of an Instructor-Centered Tool for Automatic Assessment of Programming Assignments on Students’ Perceptions and Performance," Sustainability, MDPI, vol. 11(20), pages 1-24, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jan Skalka & Martin Drlik & Lubomir Benko & Jozef Kapusta & Juan Carlos Rodríguez del Pino & Eugenia Smyrnova-Trybulska & Anna Stolinska & Peter Svec & Pavel Turcinek, 2021. "Conceptual Framework for Programming Skills Development Based on Microlearning and Automated Source Code Evaluation in Virtual Learning Environment," Sustainability, MDPI, vol. 13(6), pages 1-30, March.
    2. Sonsoles López-Pernas & Mohammed Saqr & Olga Viberg, 2021. "Putting It All Together: Combining Learning Analytics Methods and Data Sources to Understand Students’ Approaches to Learning Programming," Sustainability, MDPI, vol. 13(9), pages 1-18, April.
    3. Esperanza Milena Torres-Madroñero & Maria C. Torres-Madroñero & Luz Dary Ruiz Botero, 2020. "Challenges and Possibilities of ICT-Mediated Assessment in Virtual Teaching and Learning Processes," Future Internet, MDPI, vol. 12(12), pages 1-20, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Elvie Barzo Gonzaga & Don Anton Robles Balida & Angelo Evangelio Gonzaga, 2023. "COVID-19 Precautionary Measures and Practices for Delivering Modular Distance Learning," World Journal of English Language, Sciedu Press, vol. 13(2), pages 1-98, March.
    2. Rima Wajih Hamed Daraghmeh, 2021. "Palestinian University Students' Perceptions of Distance Education in Light of the Coronavirus Crisis," Modern Applied Science, Canadian Center of Science and Education, vol. 15(5), pages 1-1, October.
    3. Gene Klein, 2021. "Viewing Gamification Design Limitations and Weaknesses through a Pandemic Lens," Societies, MDPI, vol. 11(4), pages 1-8, November.
    4. Ilona & Urbanyi-Popiolek, 2022. "New Insights into the Ferry Business in the Turbulent Environment," European Research Studies Journal, European Research Studies Journal, vol. 0(4), pages 63-73.
    5. Amith Khandakar & Muhammad E. H. Chowdhury & Md. Saifuddin Khalid & Nizar Zorba, 2022. "Case Study of Multi-Course Project-Based Learning and Online Assessment in Electrical Engineering Courses during COVID-19 Pandemic," Sustainability, MDPI, vol. 14(9), pages 1-18, April.
    6. U. Y. Abdur Rahman, 2020. "Utilization of Indonesia’s Digital Economy to Invest in Human Capital and Provide Socio-Economic Support to Stimulate Economic Growth," International Journal of Business and Administrative Studies, Professor Dr. Bahaudin G. Mujtaba, vol. 6(6), pages 312-322.
    7. Rozina Afroz & Nurul Islam & Sajedur Rahman & Nusrat Zerin Anny, 2021. "Students’ and teachers’ attitude towards online classes during Covid-19 pandemic: A study on three Bangladeshi government colleges," International Journal of Research in Business and Social Science (2147-4478), Center for the Strategic Studies in Business and Finance, vol. 10(3), pages 462-476, April.
    8. Alfonso Infante-Moro & Juan C. Infante-Moro & Julia Gallardo-Pérez & Francisco J. Martínez-López, 2022. "Key Factors in the Implementation of E-Proctoring in the Spanish University System," Sustainability, MDPI, vol. 14(13), pages 1-16, July.
    9. Ana Iolanda Vodă & Cristina Cautisanu & Camelia Grădinaru & Chris Tănăsescu & Gustavo Herminio Salati Marcondes de Moraes, 2022. "Exploring Digital Literacy Skills in Social Sciences and Humanities Students," Sustainability, MDPI, vol. 14(5), pages 1-31, February.
    10. Mališ Sanja Sever & Sačer Ivana Mamić & Žager Katarina, 2022. "Landscape of e-Learning during Covid-19: Case Study of Economic Disciplines in Croatia," Business Systems Research, Sciendo, vol. 13(2), pages 8-27, December.
    11. Sorina Ioana MIȘU & Monica TRICULESCU, 2021. "Living And Teaching During Covid-19: The Damages And Benefits Of Telework," Business Excellence and Management, Faculty of Management, Academy of Economic Studies, Bucharest, Romania, vol. 11(5), pages 129-137, October.
    12. Antonietta Cosentino & Paola Paoloni, 2021. "Women’s Skills and Aptitudes as Drivers of Organizational Resilience: An Italian Case Study," Administrative Sciences, MDPI, vol. 11(4), pages 1-18, November.
    13. Kareema Ali & Daniel Burgos & Saida Affouneh, 2023. "Educational Loss at Times of Crisis: The Role of Games in Students’ Learning in Palestine and Iraq," Sustainability, MDPI, vol. 15(6), pages 1-15, March.
    14. José M. Ramírez-Hurtado & Alfredo G. Hernández-Díaz & Ana D. López-Sánchez & Víctor E. Pérez-León, 2021. "Measuring Online Teaching Service Quality in Higher Education in the COVID-19 Environment," IJERPH, MDPI, vol. 18(5), pages 1-14, March.
    15. Maricar M. Navarro & Yogi Tri Prasetyo & Michael Nayat Young & Reny Nadlifatin & Anak Agung Ngurah Perwira Redi, 2021. "The Perceived Satisfaction in Utilizing Learning Management System among Engineering Students during the COVID-19 Pandemic: Integrating Task Technology Fit and Extended Technology Acceptance Model," Sustainability, MDPI, vol. 13(19), pages 1-18, September.
    16. Hülya Tuncer & Tuçe Öztürk Karataş, 2022. "Recommendations of ELT Students for Four Language Skills Development: A Study on Emergency Distance Education During the COVID-19 Pandemic," SAGE Open, , vol. 12(1), pages 21582440221, March.
    17. Monica Ioana Burcă-Voicu & Romana Emilia Cramarenco & Dan-Cristian Dabija, 2022. "Investigating Learners’ Teaching Format Preferences during the COVID-19 Pandemic: An Empirical Investigation on an Emerging Market," IJERPH, MDPI, vol. 19(18), pages 1-21, September.
    18. Seung-hye Jung & Joon-ho Kim & Ha-na Cho & Hae-won Lee & Hyun-ju Choi, 2021. "Brand Personality of Korean Dance and Sustainable Behavioral Intention of Global Consumers in Four Countries: Focusing on the Technological Acceptance Model," Sustainability, MDPI, vol. 13(20), pages 1-19, October.
    19. Victor Manuel Peinado-Guevara & Aldo Alan Cuadras Berrelleza & Jaime Herrera-Barrientos & Peinado-Guevara Hector Jose & Samuel Doeg Izaguirre-Gamez & Alejandro Urias-Camacho, 2021. "Knowledge and behavioral attitudes of the academic community of the high school and university levels towards the prevention of covid-19: a cross-sectional study in Guasave, Sinaloa," Technium Social Sciences Journal, Technium Science, vol. 17(1), pages 1-19, March.
    20. -, 2021. "The economic autonomy of women in a sustainable recovery with equality," Libros y Documentos Institucionales, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL), number 46634 edited by Eclac.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:12:y:2020:i:18:p:7451-:d:411629. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.