“Journey of Finding the Best Query”: Understanding the User Experience of AI Image Generation System
Soomin Kim, Jinsu Eun, Changhoon Oh, Joonhwan Lee
Abstract
With the advancement of AI, even people without professional experience can create artworks using AI-based image generation systems like DALL-E 2. However, little is known about how users interact with these new AI algorithms, much less how AI-infused systems can be designed. We explore the user experience of these new technologies and their potential to foster creativity. A user study was carried out where 13 participants executed tasks of creating artworks using DALL-E 2 alongside in-depth interviews related to their experience. The results showed that users had ambivalent opinions regarding the algorithm’s performance. When users were informed of the system’s capabilities, they subsequently utilized more specific prompts to generate the intended output. Users also optimized their prompts (the queries they entered to create artworks) based on how algorithms worked to achieve their desired outcome. The users wanted a two-way interaction where AI explained the outcome and accepted feedback rather than simply accepting unilateral instructions. We discuss the implications for designing interfaces that maximize creativity while providing comfort for the users.