When you enroll in this course, you'll also be enrolled in this Professional Certificate.
Learn new concepts from industry experts
Gain a foundational understanding of a subject or tool
Develop job-relevant skills with hands-on projects
Earn a shareable career certificate from Coursera
There are 4 modules in this course
The Fine-Tuning Image Models with Diffusion course is designed for developers, engineers, and technical product builders who are new to Generative AI but already have intermediate machine learning knowledge, basic Python proficiency, and familiarity with development environments such as VS Code, and who want to engineer, customize, and deploy open generative AI solutions while avoiding vendor lock-in.
The course gives learners hands-on experience adapting generative image models for custom styles and applications. The course begins with the foundations of diffusion models, explaining forward and reverse diffusion processes and exploring the key components of Stable Diffusion architectures, including U-Net, VAE, and text encoders. Learners then apply Low-Rank Adaptation (LoRA) techniques to train efficiently on consumer hardware, comparing performance and trade-offs with full fine-tuning. In the second module, learners implement DreamBooth, a methodology for training on limited datasets to personalize models with custom concepts and artistic styles. Learners practice dataset preparation, hyperparameter tuning, and checkpoint management while preserving model generalization.
The third module introduces ComfyUI, where learners design and execute node-based workflows that integrate fine-tuned models with advanced extensions like ControlNet. And, in the final module, learners will optimize fine-tuned diffusion models for production by systematically adjusting inference parameters to achieve optimal trade-offs between image quality, generation speed, and resource efficiency. By the end of the course, learners will have produced a custom fine-tuned diffusion model, integrated it into ComfyUI pipelines, and optimized it for production-quality image generation.
Learn the fundamentals of diffusion models and why they play such a critical role in modern image generation. You’ll explore the key architectural components of Stable Diffusion, U-Net, VAE, and text encoders, and see how LoRA adapts these models efficiently for fine-tuning. You’ll also analyze memory optimization techniques and compare LoRA with full fine-tuning approaches, giving you practical principles for deciding which method to use depending on your goals and constraints.
What's included
3 videos2 readings1 assignment1 ungraded lab
Show info about module content
3 videos•Total 22 minutes
Podcast: What Really Happens When You Fine-Tune a Diffusion Model •4 minutes
How LoRA Connects to Stable Diffusion•7 minutes
Training and Applying LoRA: Dataset Prep, Training Loop, and Inference•10 minutes
2 readings•Total 34 minutes
Code Demonstration Transcripts•4 minutes
How Stable Diffusion Works•30 minutes
1 assignment•Total 30 minutes
Diffusion & LoRA Basics•30 minutes
1 ungraded lab•Total 60 minutes
Run Your First LoRA Adapter•60 minutes
Fine-Tuning Custom Styles with DreamBooth
Module 2•2 hours to complete
Module details
Learn how to personalize diffusion models using the DreamBooth methodology. You’ll prepare small, targeted datasets for training custom concepts and styles, and understand how prior-preservation loss helps maintain model generalization. You’ll also apply hyperparameter strategies to balance creativity with stability and practice managing checkpoints and merging techniques. These skills give you the ability to adapt diffusion models to unique styles and use cases, making fine-tuning directly relevant to real-world creative and professional projects.
What's included
3 videos1 reading1 assignment1 ungraded lab
Show info about module content
3 videos•Total 23 minutes
Podcast - Personalizing Diffusion: DreamBooth in Action•3 minutes
Prepping Your Dataset (and Avoiding Overfitting) in DreamBooth•9 minutes
Merging & Managing Checkpoints •11 minutes
1 reading•Total 12 minutes
How DreamBooth Works•12 minutes
1 assignment•Total 30 minutes
DreamBooth Troubleshooting•30 minutes
1 ungraded lab•Total 60 minutes
Train a Style Concept with DreamBooth•60 minutes
Workflow Design with ComfyUI
Module 3•1 hour to complete
Module details
Learn how to use ComfyUI to design and manage advanced workflows for diffusion models. You’ll set up the environment, navigate the node-based interface, and load custom fine-tuned models into your pipelines. You’ll also practice building complex generation workflows with extensions like ControlNet, giving you a flexible, visual way to experiment and produce consistent, high-quality results. These skills make workflow design more efficient and directly applicable to real-world creative and production settings.
What's included
3 videos2 readings1 assignment
Show info about module content
3 videos•Total 26 minutes
How ComfyUI Simplifies Diffusion Fine-Tuning•9 minutes
Setting Up ComfyUI and Building Your First Workflow•6 minutes
Adding ControlNet to Your ComfyUI Workflow•10 minutes
2 readings•Total 20 minutes
The Must-Know Basics of ComfyUI•10 minutes
Create a Workflow in ComfyUI•10 minutes
1 assignment•Total 30 minutes
ComfyUI Workflow Design•30 minutes
Optimizing Diffusion Models for Production
Module 4•2 hours to complete
Module details
Learn how to optimize fine-tuned diffusion models so they’re reliable in real production environments. You’ll adjust inference settings like steps, CFG scale, and batch size to balance speed, quality, and resource use, and practice testing how small tweaks can dramatically improve results. You’ll also adapt workflows for deployment, gaining practical skills to deliver outputs that are both efficient and production-ready. These techniques give you the ability to make informed trade-offs that directly impact performance in real-world projects.
What's included
2 videos1 reading1 assignment1 ungraded lab
Show info about module content
2 videos•Total 10 minutes
Testing & Optimizing Outputs •8 minutes
Podcast: Bringing It All Together: Fine-Tuning Diffusion Models That Work •3 minutes
1 reading•Total 9 minutes
Practical Optimization for Diffusion Models•9 minutes
1 assignment•Total 60 minutes
End-to-End Diffusion Fine-Tuning Check•60 minutes
1 ungraded lab•Total 60 minutes
Optimize Your Fine-Tuned Model•60 minutes
Earn a career certificate
Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.
Coursera brings together a diverse network of subject matter experts who have demonstrated their expertise through professional industry experience or strong academic backgrounds. These instructors design and teach courses that make practical, career-relevant skills accessible to learners worldwide.
When will I have access to the lectures and assignments?
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I subscribe to this Certificate?
When you enroll in the course, you get access to all of the courses in the Certificate, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.