Back to Custom and Distributed Training with TensorFlow
DeepLearning.AI

Custom and Distributed Training with TensorFlow

In this course, you will: • Learn about Tensor objects, the fundamental building blocks of TensorFlow, understand the difference between the eager and graph modes in TensorFlow, and learn how to use a TensorFlow tool to calculate gradients. • Build your own custom training loops using GradientTape and TensorFlow Datasets to gain more flexibility and visibility with your model training. • Learn about the benefits of generating code that runs in graph mode, take a peek at what graph code looks like, and practice generating this more efficient code automatically with TensorFlow’s tools. • Harness the power of distributed training to process more data and train larger models, faster, get an overview of various distributed training strategies, and practice working with a strategy that trains on multiple GPU cores, and another that trains on multiple TPU cores. The DeepLearning.AI TensorFlow: Advanced Techniques Specialization introduces the features of TensorFlow that provide learners with more control over their model architecture and tools that help them create and train advanced ML models. This Specialization is for early and mid-career software and machine learning engineers with a foundational understanding of TensorFlow who are looking to expand their knowledge and skill set by learning advanced TensorFlow features to build powerful models.

Status: Tensorflow
Status: Deep Learning
IntermediateCourse24 hours

Featured reviews

VV

5.0Reviewed Jan 8, 2022

A​nother great course by Moroney sir. Loved how TF can be used to train models using different strategies. A great intro to the deep applications of TensorFlow

AZ

5.0Reviewed Jan 7, 2021

Difficult concepts are explained with simple words and simple examples. Great course

AA

5.0Reviewed Jan 20, 2021

He is a very good instructor and the content is well prepared, also the course covers rare topics.

JN

5.0Reviewed Jun 22, 2022

Detail and easy to understand. I really recommend this specialization to improve training process using distributed training and strategy

RA

5.0Reviewed Jul 15, 2021

5 stars for excellent videos, contents and code walkthrough. Insipired me to learn more and experiment on distributed training and custom training loop.

GJ

5.0Reviewed Dec 11, 2021

It was helpful to learn the details of the optimization by using GradientTape and manually updating the parameters for every iteration.

NS

5.0Reviewed Feb 27, 2021

This course was fantastic! Laurence and DeepLearning.ai team did great job. Definitely recommended.

SM

5.0Reviewed Aug 5, 2022

A​mazing Course With Simple Words And High-Level Understanding.

PJ

4.0Reviewed Dec 31, 2021

The course provides under-the-hood insights of Keras APIs and gives in-depth review of native TF APIs

DG

5.0Reviewed Nov 26, 2020

A very detailed course with lots of nitty gritty. Learned a lot and of course enjoyed it thoroughly.

VY

5.0Reviewed Oct 30, 2023

Awesome course for everyone in this field who want tp excel in model training efficiently.

AA

5.0Reviewed Feb 1, 2021

great to learn things about writing custom training loops, and distributed training of deep learning models.

All reviews

Showing: 20 of 65

DEBASHIS GHOSH
5.0
Reviewed Nov 27, 2020
Shaik Sameer
5.0
Reviewed Nov 23, 2020
Hüseyin Kalçık
5.0
Reviewed Feb 16, 2021
Homayoun
5.0
Reviewed Apr 23, 2021
Pramit Dutta
4.0
Reviewed Feb 10, 2021
Ruchen Zhen
4.0
Reviewed Jan 24, 2022
Aleksander Ogonowski
3.0
Reviewed Jan 15, 2024
Charles Tang
3.0
Reviewed Jan 17, 2023
Goran Isic
2.0
Reviewed Jan 27, 2025
Mina Essam Saber
2.0
Reviewed Aug 5, 2023
H.S
2.0
Reviewed Feb 18, 2022
Francois Robert
5.0
Reviewed Mar 6, 2021
Muhammad Danish
5.0
Reviewed Jun 12, 2022
Hagar Bendary
5.0
Reviewed May 9, 2023
PAIDIMARRI NITHISH
5.0
Reviewed May 17, 2024
Vaseekaran Varatharajah
5.0
Reviewed Jan 9, 2022
Rajendra Aparajit
5.0
Reviewed Jul 16, 2021
josua naiborhu
5.0
Reviewed Jun 23, 2022
Gang-Won Jang
5.0
Reviewed Dec 12, 2021
Animesh
5.0
Reviewed Feb 2, 2021