GitHub – utkuozbulak/pytorch-simple-diffusion

This repository contains a bare-bone implementation of denoising diffusion [1,2] in PyTorch, with majority of its code taken from The Annotated Diffusion and Phil Wang’s diffusion repository. Both resources are great to get started with diffusion models but they were still a bit convoluted for me when I first started learning about diffusion models so I refactored majority of The Annotated Diffusion‘s implementation and made a bare-bone implementation with functions and classes logically separated into different files as a learning exercise. My goal was to understand the building blocks of diffusion models in order to use them in some upcoming projects. I’m sharing this repo in hopes that my exercise will be useful for you in understanding more complex implementations.

Code is organized under src folder as follows:

• funct_diffusion.py – Contains all necessary functions for forward and backward diffusion process, including the scheduler.

• cls_dataset.py – Contains data-related functions and classes. I used a single class (n01443537 – Carassius auratus – Goldfish) with some augmentations (e.g., rotations and flips), that’s why generated images have several upside down fishes.

• cls_model.py – Contains the model. The model in this repo is basically a copy paste of The Annotated Diffusion‘s implementation, except for dim_mults=(1, 2, 4, 8) and channe=3 (RGB).

• main_train_diffusion.py – I wanted to separate training and generation into two different files to digest what parameter is needed for what. This file is used to train the diffusion model.

• main_generate_images.py – Generates images using the trained model.

Examples from the dataset:

Examples generated by the diffusion model (rotations are because of the data augmentation, it’s hilarious though):

Example diffusion process:

As you can see, generated images are not as crisp as those from the dataset. There are many improvements that can be incorporated to improve the image quality, with each of those adding more to the complexity. Phil Wang’s diffusion repository is a great place to discover some of those methods.

torch
torchvision
datasets
PIL
numpy

[1] Song and Ermon, Generative Modeling by Estimating Gradients of the Data Distribution

[2] Ho et al., Denoising Diffusion Probabilistic Models

Keep your files stored safely and securely with the SanDisk 2TB Extreme Portable SSD. With over 69,505 ratings and an impressive 4.6 out of 5 stars, this product has been purchased over 8K+ times in the past month. At only $129.99, this Amazon’s Choice product is a must-have for secure file storage.

Help keep private content private with the included password protection featuring 256-bit AES hardware encryption. Order now for just $129.99 on Amazon!

Help Power Techcratic’s Future – Scan To Support

If Techcratic’s content and insights have helped you, consider giving back by supporting the platform with crypto. Every contribution makes a difference, whether it’s for high-quality content, server maintenance, or future updates. Techcratic is constantly evolving, and your support helps drive that progress.

As a solo operator who wears all the hats, creating content, managing the tech, and running the site, your support allows me to stay focused on delivering valuable resources. Your support keeps everything running smoothly and enables me to continue creating the content you love. I’m deeply grateful for your support, it truly means the world to me! Thank you!