Image Generation with Diffusion Models

How computers imagine our world

13:2010/11/2023

Recent machine learning developments saw a breakthrough in generating images. So-called Diffusion Models can create photo-realistic images from noise. With the help of an input text (prompt) we can guide the generation and produce matching images.

This technology opened new doors for creating digital art, modifying existing images, and creating stunning visual experiences. In the talk, we will find out how these algorithms work, introduce Stable Diffusion (a concrete implementation), and find out what its use cases are. We will see how text can be used to generate matching outputs but also take a look at more experimental features such as creating images from edges, outlines, or depth maps.

We will mainly focus on the open source text-to-image model Stable Diffusion, which has set new standards in image generation. With it also comes an active community that keeps it open source and accessible for everyone.

Video

Presentations