DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation

🤖 Plain-English Summary

Large text-to-image models achieved a remarkable leap in the evolution of AI, enabling high-quality and diverse synthesis of images from a given text prompt. We also provide a new dataset and evaluation protocol for this new task of subject-driven generation.

🔑 Key Findings

• However, these models lack the ability to mimic the appearance of subjects in a given reference set and synthesize novel renditions of them in different contexts.
• In this work, we present a new approach for “personalization” of text-to-image diffusion models.
• Given as input just a few images of a subject, we fine-tune a pretrained text-to-image model such that it learns to bind a unique identifier with that specific subject.

🔗 Related Resources