Using chatbot for course evaluation in higher education

The growing potential of chatbots is getting more attention in education, both in application and in the research area. Using chatbot technology as a new channel of collecting feedback from students is an innovative approach that is less time and resource-demanding for both sides included in evaluation: teachers and students.

The main purpose of this study is to present a result summary of the students’ reflection upon courses collected in an innovative way – using the educational chatbot Hubert. Hubert’s features include dynamic conversation, personal experience and better interpretation of student feedback. Built on the basis of user feedback, new features include a more dynamic chat conversation that allows for a more personalized experience and better comprehension of students’ input. Hubert's main advantage is engaging students and customizing flow of conversation about course perception and asking follow-up questions for additional explanation. The study was conducted at three courses at the University of Zagreb, Faculty of Organization and Informatics in 2020. Number of students involved in study was n=69. Thematic analysis was conducted to reveal patterns and themes within a data set of student-chatbot conversations. Following Braun and Clark's six-step recursive framework, main themes and categories were found upon positive and negative aspects of the course, suggestions for improvements and students' personal opinion. Since course evaluation was conducted in full swing of COVID-19 pandemic, some of the themes are related to this topic. In conclusion, guidelines and recommendations for implementing chatbots as a form of course evaluation in higher education are highlighted.

About Edubots
Edubots is an ongoing Erasmus+ Knowledge Alliance, funded by the European Commission for 2020-2021. The aim is to document and develop best practice use of chatbots in Higher Education, and to create a learning community of Educators in Europe.

Consortium partners

The project was initiated by 6 partners from Norway, Sweden, UK, Croatia, Cyprus and Spain.

EDUBOTS - Best Practices of Pedagogical Chatbots in Higher Education
Reference Number: 612466-EPP-1-2019-1-NO-EPPKA2-KA

Consortium leader
EdTech Foundry AS
Hoffsveien 6a
0275 Oslo
Organizational number: 998 716 454
Project Manager: Gregor Jarisch  ( send email )