Exploring the application of LLM-based AI in UX design: an empirical case study of ChatGPT

Large language model (LLM) based AI applications are being rapidly adopted by various creativity-related sectors, including UX design. However, as newly emerged applications, how UX designers work with LLMs and how to optimize the benefits of LLMs in UX design remain unclear. Leveraging the widely adopted LLM application ChatGPT as a case study, we recruited 12 experienced frontline UX practitioners from IT companies to use ChatGPT in their everyday design activities for 4 to 6 weeks. Through use logs, questionnaires, and interviews, we collected participants' usage and reflection data. Our analysis reveals the different functions of ChatGPT in facilitating UX design, such as offering design guidelines, constructing user profiles, and simulating stakeholders. Challenges also emerged, such as limitations in understanding complex design problems and prototyping design ideas. Based on the findings, we reflect on the working dynamics between human workers and AI tools and suggest implications for designing more usable LLM-based AI applications.