Chevron Left
Back to Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

Learner Reviews & Feedback for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization by DeepLearning.AI

57,960 ratings
6,669 reviews

About the Course

In the second course of the Deep Learning Specialization, you will open the deep learning black box to understand the processes that drive performance and generate good results systematically. By the end, you will learn the best practices to train and develop test sets and analyze bias/variance for building deep learning applications; be able to use standard neural network techniques such as initialization, L2 and dropout regularization, hyperparameter tuning, batch normalization, and gradient checking; implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence; and implement a neural network in TensorFlow. The Deep Learning Specialization is our foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. It provides a pathway for you to gain the knowledge and skills to apply machine learning to your work, level up your technical career, and take the definitive step in the world of AI....

Top reviews

Apr 18, 2020

Very good course to give you deep insight about how to enhance your algorithm and neural network and improve its accuracy. Also teaches you Tensorflow. Highly recommend especially after the 1st course

Jan 13, 2020

After completion of this course I know which values to look at if my ML model is not performing up to the task. It is a detailed but not too complicated course to understand the parameters used by ML.

Filter by:

126 - 150 of 6,593 Reviews for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

By Yonas T

Oct 28, 2017

An excellent class and loved the tensor flow tutorial. One thing I would also like to mention is the fact that Andrew made us do the algorithm coding in the first class from scratch helps a lot to really understand the basics of the neural networks. When you then move to using tensor flow it gets even better. Thanks for whole team, Andrew and all the students around the world who makes the environment/forum so vibrant and helpful.

By Jean T

Feb 7, 2018

Extremely clear and informative about deep learning algorithms per se. The only issue I had is the Tensorflow exercises: since I had never seen TensorFlow before, I lost time guessing the syntax. A more progressive exercise sheet would help get familiar. The point is that, by having to focus so much on the syntax, one focuses less on the structure of the language, so one learns less well the ideas behind the TensorFlow design.

By David R R

Nov 15, 2017

This course gives you a better understanding of how to increase the performance of your neural network.

There are some video-lectures that are a little harder to understand and maybe boring but, in general, I recomend this course.

Este curso te da un mejor entendimiento de como aumentar el rendimiento de tu red neuronal.

Hay algunos videos que son dificiles de seguir y quizas aburridos pero en general recomiendo hacer este curso.

By K W

Sep 5, 2020

Andrew Ng's Deep Learning course is phenomenal. He patiently and cleverly focuses on explaining the intuition behind concepts like regularization, normalization and optimizers in bite sized chunks, rather than drowning students in linear algebra. The guest speakers are giants in Deep Learning, literally the guys who wrote the textbooks. It's like a religious summit where the guest speakers invited are Jesus, Allah and Budda.

By Sikang B

Apr 1, 2018

Clear and practical, this course sets a good bridge from the old NP based programming model to the modern programming models of using Tensorflow and Keras. The optimization methodologies lead to the very useful aspect of ML: hyper-parameters tuning. Though a lot of these hyper-parameters still feel magical, it is super helpful to know more about them.

Suggest to clearly mark this course as a requirement for course 4 and 5.

By Chinmay K K C

May 10, 2020

I finally got to delve deeper into the intuitions behind the choice of hyperparameters and optimisation algorithms. It is incredible to see how even the smallest of choices can affect our model's performance and understanding the effects of certain choices of hyperparameters on the overall performance of our model will help us make better decisions in regard to how we set up our models. This course was totally worth it!

By Durgaprasad N

Jan 19, 2020

This course builds upon the fundamentals learnt in the first course. By doing this course I have learnt the importance of regularization, and initialization of weights while training a neural network. The course also gives information on implementing neural networks on large datasets and how to methodically choose the hyperparameters. The course exercises are informative and helped me in solidifying the theory learnt.

By Itay M

Mar 8, 2021

Great course and great Professor to teach from - very well explained all the materiel. The quiz are very good and really test understanding. There is a place to try to make the programming exercise less guided to the last detail and a little more to let people think about how certain things need to be done and send them to look at documentation (a good balance of right guidance and hard work seems like great recipe).

By David B

Jul 24, 2019

Excellent course - my only complaint is that the grader is really finicky about completing the notebooks in a very specific way. Your submissions get rejected in a very cryptic way if you use certain valid TensorFlow constructions, namely you cannot use "Z = W @ X + b", instead you must type "Z = tf.add(tf.matmul(W, X), b)", which I find much more difficult to read. Nonetheless, I think this was an excellent course.

By Heinz D

Nov 6, 2019

Great course, great instructor and staff. Good speed and good hands-on exercises. Some flaws in the downloadable material and a couple of everlasting corrigenda, but nothing too serious. Integrity control could be enhanced in the TensowFlow assignment. I wish there were not only quizzes at the ends of the weeks but also inbetween or even within the lectures. Looking forward to the next course in this specialization.

By Jaime M

May 29, 2019

Very good course as well, although the exercises need some "debugging" there are some typos and errors. I found that the previous courses exercises where too guided, too easy in some points. In this case are more tricky, but not in the correct sense. I would orient a bit more the way of thinking or refer to external sources to get a bit more on track with TF before coding. Nonetheless, all in all, is a great course.

By Renzo B

Aug 27, 2019

It was a very insightful course. I learned the basic intuition behind the concepts that Andrew Ng explained. For my suggestions, maybe the deeper derivations and meanings behind the concepts could be discussed in video or just a reading material. For example with the maths behind regularization, batch normalization and etc. could be discussed more in depth in a reading material. All in all the course was excellent.

By Mehedi H

Sep 23, 2017

Very good one. It was great pleasure to learn momentum , RMSProp and then coming to know how to combine them in Adam. Tensorflow example was great. In tensorflow exercise, using regularization can give a boost in the generalization of data which has been mentioned (and I tested it )-but this could have been a part of the exercise.

However, starting to audit the next course of this series. Best of Luck for me !! :D

By Mikhail G

Mar 7, 2020

Very nice course, worth taking for everyone who is interested in ML/Deep learning, including the very beginners and professionals. I work at the edge of Neuroscience/ML/AI, I have a strong theoretical ML background, but little practice. Even though I was familiar with many of the concepts before taking the course, it was still extremely useful to hear about it again and have way better understanding of the topic

By Chong O K

Oct 31, 2020

The course covers many regularization and optimization techniques of deep neural network. The instructor can explain the concept and theory of those techniques using easy-to-understand analogies and example. He also used visualisations like diagrams and charts to make the explanations intuitive. The assignments are very comprehensive and mimic real-world examples that let students build a very solid foundation.

By Ganesh S V M K

Aug 2, 2020

First of all, I would like to thank Coursera for providing the course. I would always be in debt to Coursera for providing me with financial aid. This website is one of the best online learning platforms. Love the way the assignments are provided. Even I have a bit of understanding and experience in deep learning, this course clears all the blue skies in between and makes deep learning looks simple to learn :)

By Lyle T

Sep 14, 2017

Very good in-depth coverage of mini-batch, ReLU, Adam, L2 and dropout regularization. Good overview of batch normalization. Brief but useful intro to Tensor Flow (including programming assignment). In general, the programming assignments are pretty easy, but a bit hard to debug in the Jupiter notebooks, though I was able to get things working by inspecting the code to locate typos.

Summary: Highly recommended

By Jonathan M

May 1, 2020

Builds upon the concepts that were explained in the first course in specialization and Andrew Ng's Machine Learning MOOC and really goes more into depth about regularization and optimization techniques. The introduction to frameworks at the end of the course does a great job of showing how this can apply to other concepts. The programming exercises and course material are great overall and very informative.

By Jingyu Z

Jul 15, 2019

This Course is really good for the beginner of NN and deep learning. It tells me what to consider and how to consider for model build-up. I also like the quiz which helps me to check my concepts understanding, the coding practice is easy to understand and I can logically learn how to practice my understanding of this session. I also love the interview session with DL Heroes. This course is really inspiring.

By Sakshar C

May 17, 2020

This course really helped me to get a proper hold on how to work with hyperparameter tuning in an organized and efficient way. I used to think of it as a "voodoo" magic, the way one can fall upon the exact set of values for hyperparameters. Now, I think that I have a better concrete idea of how to approach tuning for improving a neural network according to the available resources and also the applications.

By Marlon A C V

Sep 28, 2017

This course is AWESOME, a lot of new things related to Deep neural networks regularization techniques, initialization techniques and Tensorflow Neural Networks modeling. A step forward into mastering applied Artificial Neural Networks!! Course really recommended for ML/AI enthusiasts and begginer or promising researchers in the field. I recommend to take all the courses provided in this DL Specialization!!

By Kyle W

Aug 15, 2017

Great course. I'm particularly happy that they chose to teach TensorFlow. There were a number of typos/errata, which is to be expected with such a new course, but it looks like they are working quickly to address them. Overall, I feel more confident implementing neural nets than I did after the original ML course taught by Andrew Ng.

Watching Andrew try to draw a horse in one a the lectures is a huge bonus.

By Rohit K

Jul 6, 2019

Hello Andrew, I am a big fan of you. Learning from your every course. Very unfortunate that I can do that remotely only.

One thing that I want to mention - Can we have lecture notes on coursera, just like the way used to in CS229 that we can read before coming to next lecture. I found that that was very useful in understanding when things get harder.

Thanks hope we can improve coursera in that matter.

By Itsido C A

Dec 16, 2019

This is a must to really understand and master the art of machine learning. With this course I understood that building a model and training it is not even half of the story of being a machine learning engineer, without knowledge of how to tune the models parameters you might not be able to deliver product on schedule. Thanks for Dr Andrew and the team for an awesome content and learning experience.

By sunshineren

Aug 31, 2019

It is really a EXTREMELY GOOD course for a bad-basic student, according this course, not only I have know the theories, but also the pratical project.I do think now I know the BN, the Hyperparameter, and the Regularization and so on in Deep Learning field! It would be very helpful for me to step into the AI!

and both videos and lectures are very important for new comers in deep learning ! THANKS ALOT!