Interactions with generative AI chatbots: unveiling dialogic dynamics, students’ perceptions, and practical competencies in creative problem-solving

Abstract This study explores the effectiveness of chatbots empowered by generative artificial intelligence (GAI) in assisting university students’ creative problem-solving (CPS). We used quasi-experiments to compare the performance of dialogue dynamics, learner perceptions, and practical competencies in CPS during students’ interactions with: (1) a GAI chatbot, and (2) their peers. In total, 80 postgraduate students participated. The assigned CPS task was the creation of an innovative research proposal. We found that there were significant differences in the dialogic exchanges observed between the two types of interaction. Student-GAI chatbot interactions featured more knowledge-based dialogue and elaborate discussions, with less subjective expression compared to student-peer interactions. Notably, students contributed significantly less dialogue when interacting with a GAI chatbot than they did during peer interactions. The dialogic exchanges arising from student-GAI chatbot interactions tended to follow distinct patterns, while those from student-peer interactions were less predictable. The students perceived interacting with a GAI chatbot as more useful and easier than interacting with peers. Furthermore, they exhibited higher intention levels when utilising a GAI chatbot to tackle the CPS task compared to engaging in discussions with their peers. Ultimately, practical performance was significantly enhanced through interactions with a GAI chatbot. This study implies that the prudent use of GAI-based techniques can facilitate university students’ learning achievement.