This course is part of the Deep Learning Specialization

Andrew Ng +2 more instructors
Top Instructors

Offered By

Deep Learning SpecializationDeepLearning.AI

About this Course

737,189 recent views

This course will teach you the "magic" of getting deep learning to work well. Rather than the deep learning process being a black box, you will understand what drives performance, and be able to more systematically get good results. You will also learn TensorFlow. 
After 3 weeks, you will: 
- Understand industry best-practices for building deep learning applications. 
- Be able to effectively use the common neural network "tricks", including initialization, L2 and dropout regularization, Batch normalization, gradient checking, 
- Be able to implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence. 
- Understand new best-practices for the deep learning era of how to set up train/dev/test sets and analyze bias/variance
- Be able to implement a neural network in TensorFlow. 

This is the second course of the Deep Learning Specialization.

Learner Career Outcomes

32%

started a new career after completing these courses

30%

got a tangible career benefit from this course

11%

got a pay increase or promotion

Shareable Certificate

Earn a Certificate upon completion

100% online

Start instantly and learn at your own schedule.

Course 2 of 5 in the

Deep Learning Specialization

Flexible deadlines

Reset deadlines in accordance to your schedule.

Beginner Level

Approx. 18 hours to complete

English

Subtitles: Chinese (Traditional), Arabic, French, Portuguese (European), Chinese (Simplified), Italian, Portuguese (Brazilian), Vietnamese, Korean, German, Russian, Turkish, English, Spanish

Skills you will gain

HyperparameterTensorflowHyperparameter OptimizationDeep Learning

Learner Career Outcomes

32%

started a new career after completing these courses

30%

got a tangible career benefit from this course

11%

got a pay increase or promotion

Shareable Certificate

Earn a Certificate upon completion

100% online

Start instantly and learn at your own schedule.

Course 2 of 5 in the

Deep Learning Specialization

Flexible deadlines

Reset deadlines in accordance to your schedule.

Beginner Level

Approx. 18 hours to complete

English

Subtitles: Chinese (Traditional), Arabic, French, Portuguese (European), Chinese (Simplified), Italian, Portuguese (Brazilian), Vietnamese, Korean, German, Russian, Turkish, English, Spanish

Instructors

Instructor rating

4.92/5 (3,064 Ratings)

Offered by

DeepLearning.AI

Founded by Andrew Ng, DeepLearning.AI is an education technology company that develops a global community of AI talent.

Syllabus - What you will learn from this course

Content Rating96%(57,243 ratings)

Week

Week 1

8 hours to complete

Practical aspects of Deep Learning

8 hours to complete

15 videos (Total 131 min), 3 readings, 4 quizzes

15 videos

Train / Dev / Test sets12m

Bias / Variance8m

Basic Recipe for Machine Learning6m

Regularization9m

Why regularization reduces overfitting?7m

Dropout Regularization9m

Understanding Dropout7m

Other regularization methods8m

Normalizing inputs5m

Vanishing / Exploding gradients6m

Weight Initialization for Deep Networks6m

Numerical approximation of gradients6m

Gradient checking6m

Gradient Checking Implementation Notes5m

Yoshua Bengio interview25m

3 readings

Clarification about Upcoming Regularization Video1m

Clarification about Upcoming Understanding dropout Video1m

Clarification about Upcoming Normalizing Inputs Video1m

1 practice exercise

Practical aspects of deep learning30m

Week

Week 2

5 hours to complete

Optimization algorithms

5 hours to complete

11 videos (Total 92 min), 2 readings, 2 quizzes

11 videos

Mini-batch gradient descent11m

Understanding mini-batch gradient descent11m

Exponentially weighted averages5m

Understanding exponentially weighted averages9m

Bias correction in exponentially weighted averages4m

Gradient descent with momentum9m

RMSprop7m

Adam optimization algorithm7m

Learning rate decay6m

The problem of local optima5m

Yuanqing Lin interview13m

2 readings

Clarification about Upcoming Adam Optimization Video1m

Clarification about Learning Rate Decay Video1m

1 practice exercise

Optimization algorithms30m

Week

Week 3

5 hours to complete

Hyperparameter tuning, Batch Normalization and Programming Frameworks

5 hours to complete

11 videos (Total 104 min), 2 readings, 2 quizzes

11 videos

Tuning process7m

Using an appropriate scale to pick hyperparameters8m

Hyperparameters tuning in practice: Pandas vs. Caviar6m

Normalizing activations in a network8m

Fitting Batch Norm into a neural network12m

Why does Batch Norm work?11m

Batch Norm at test time5m

Softmax Regression11m

Training a softmax classifier10m

Deep learning frameworks4m

TensorFlow16m

2 readings

Clarifications about Upcoming Softmax Video1m

Note about TensorFlow 1 and TensorFlow 210m

1 practice exercise

Hyperparameter tuning, Batch Normalization, Programming Frameworks30m

About the Deep Learning Specialization

If you want to break into AI, this Specialization will help you do so. Deep Learning is one of the most highly sought after skills in tech. We will help you become good at Deep Learning.

In five courses, you will learn the foundations of Deep Learning, understand how to build neural networks, and learn how to lead successful machine learning projects. You will learn about Convolutional networks, RNNs, LSTM, Adam, Dropout, BatchNorm, Xavier/He initialization, and more. You will work on case studies from healthcare, autonomous driving, sign language reading, music generation, and natural language processing. You will master not only the theory, but also see how it is applied in industry. You will practice all these ideas in Python and in TensorFlow, which we will teach. You will also hear from many top leaders in Deep Learning, who will share with you their personal stories and give you career advice. AI is transforming multiple industries. After finishing this specialization, you will likely find creative ways to apply it to your work. We will help you master Deep Learning, understand how to apply it, and build a career in AI.

Frequently Asked Questions

When will I have access to the lectures and assignments?
Access to lectures and assignments depends on your type of enrollment. If you take a course in audit mode, you will be able to see most course materials for free. To access graded assignments and to earn a Certificate, you will need to purchase the Certificate experience, during or after your audit. If you don't see the audit option:
The course may not offer an audit option. You can try a Free Trial instead, or apply for Financial Aid.
The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I subscribe to this Specialization?
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile. If you only want to read and view the course content, you can audit the course for free.
Is financial aid available?
Yes, Coursera provides financial aid to learners who cannot afford the fee. Apply for it by clicking on the Financial Aid link beneath the "Enroll" button on the left. You'll be prompted to complete an application and will be notified if you are approved. You'll need to complete this step for each course in the Specialization, including the Capstone Project. Learn more.

More questions? Visit the Learner Help Center.

Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

About this Course

Learner Career Outcomes

32%

30%

11%

Skills you will gain

Learner Career Outcomes

32%

30%

11%

Instructors

Andrew Ng
Top Instructor

Kian Katanforoosh
Top Instructor

Teaching Assistant - Younes Bensouda Mourri
Top Instructor

Offered by

DeepLearning.AI

Syllabus - What you will learn from this course

Week 1

Practical aspects of Deep Learning

Week 2

Optimization algorithms

Week 3

Hyperparameter tuning, Batch Normalization and Programming Frameworks

Reviews

TOP REVIEWS FROM IMPROVING DEEP NEURAL NETWORKS: HYPERPARAMETER TUNING, REGULARIZATION AND OPTIMIZATION

About the Deep Learning Specialization

Frequently Asked Questions

Top Online Courses

Top Online Specializations

Online Certificates

Online Degree Programs

Coursera

Community

More

Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

About this Course

Learner Career Outcomes

32%

30%

11%

Skills you will gain

Learner Career Outcomes

32%

30%

11%

Instructors

Andrew NgTop Instructor

Kian KatanforooshTop Instructor

Teaching Assistant - Younes Bensouda MourriTop Instructor

Offered by

DeepLearning.AI

Syllabus - What you will learn from this course

Week 1

Practical aspects of Deep Learning

Week 2

Optimization algorithms

Week 3

Hyperparameter tuning, Batch Normalization and Programming Frameworks

Reviews

TOP REVIEWS FROM IMPROVING DEEP NEURAL NETWORKS: HYPERPARAMETER TUNING, REGULARIZATION AND OPTIMIZATION

About the Deep Learning Specialization

Frequently Asked Questions

Coursera Footer

Top Online Courses

Top Online Specializations

Online Certificates

Online Degree Programs

Coursera

Community

More

Andrew Ng
Top Instructor

Kian Katanforoosh
Top Instructor

Teaching Assistant - Younes Bensouda Mourri
Top Instructor