Communication Dans Un Congrès Année : 2025

FusAIn: Composing Generative AI Visual Prompts Using Pen-based Interaction

Résumé

Although current generative AI (GenAI) enables designers to create novel images, its focus on text-based and whole-image interaction limits expressive engagement with visual materials. Based on the design concept of deconstruction and reconstruction of digital visual attributes for visual prompts, we present FusAIn, a GenAI prompt composition tool that lets designers create personalized pens by loading them with objects or attributes such as color or texture. GenAI then fuses the pen’s contents to create new images. Extracting and reusing inspirational material matches designers’ existing work practices, making GenAI more contextualized for professional design. A study with 12 designers shows how FusAIn improves their ability to define visual details at different levels that are difficult to express with current GenAI prompts. Pen-based interaction lets them maintain fine-grained control over generated results, increasing GenAI image’s editability and reusability. We discuss the benefits of “composition as prompts” and directions for future research.

Fichier principal
Vignette du fichier
CHI25_FusAIn.pdf (30 Mo) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte
Licence

Dates et versions

hal-05065936 , version 1 (13-05-2025)

Licence

Identifiants

Citer

Xiaohan Peng, Janin Koch, Wendy E. Mackay. FusAIn: Composing Generative AI Visual Prompts Using Pen-based Interaction. CHI 2025 - CHI Conference on Human Factors in Computing Systems, Apr 2025, Yokohama, Japan. pp.1 - 20, ⟨10.1145/3706598.3714027⟩. ⟨hal-05065936⟩
725 Consultations
73 Téléchargements

Altmetric

Partager

  • More