Chevron Left
Back to Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization

Learner Reviews & Feedback for Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization by

42,913 ratings
4,599 reviews

About the Course

This course will teach you the "magic" of getting deep learning to work well. Rather than the deep learning process being a black box, you will understand what drives performance, and be able to more systematically get good results. You will also learn TensorFlow. After 3 weeks, you will: - Understand industry best-practices for building deep learning applications. - Be able to effectively use the common neural network "tricks", including initialization, L2 and dropout regularization, Batch normalization, gradient checking, - Be able to implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence. - Understand new best-practices for the deep learning era of how to set up train/dev/test sets and analyze bias/variance - Be able to implement a neural network in TensorFlow. This is the second course of the Deep Learning Specialization....

Top reviews


Dec 06, 2019

I enjoyed it, it is really helpful, id like to have the oportunity to implement all these deeply in a real example.\n\nthe only thing i didn't have completely clear is the barch norm, it is so confuse


Dec 24, 2017

Exceptional Course, the Hyper parameters explanations are excellent every tip and advice provided help me so much to build better models, I also really liked the introduction of Tensor Flow\n\nThanks.

Filter by:

326 - 350 of 4,545 Reviews for Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization

By Neeraj

Feb 28, 2018

A bit hard to follow but worth the time spent as this course helps to build the intuitions behind some of the most famous optimization algorithms and tuning methods by making the students work through them using only basic python and numpy.

By Kunjin C

Sep 04, 2017

Very practical course for implementing deep neural networks from scratch. The ideas of hyper-parameter tuning, regularization and optimization are very refreshing even for experienced deep learning engineers. Learned a lot from this course.

By Pratyush S

Aug 28, 2017

Continuing the trend of magnificent course content, Dr. Andrew Ng walks us through some exceptional practical advice in implementing DL algorithms, detailing the concepts and the best-practices, and mentioning the pitfalls. Simple awesome!

By Dragos R

Jul 17, 2019

It's a very good course for those willing to dig into the nitpicking of it. If you're really serious about this field, or if you're going to use neural networks often in your job, these lectures (and notebooks) can save you a lot of time.

By Neil O

Jan 12, 2018

This is an excellent class for understanding how to tune neural networks. I guess this will continue to be a valuable skill set until we have neural networks that can figure out optimal parameters to design and tune other neural networks.

By Serhii K

Sep 10, 2017

I've worked with deep neural networks before for a while, but this course gave me a lot of new ideas, especially different tips and tricks on fine-tuning hyperparameters and speeding up the training of a deep neural net. Highly recommend!

By Michail T

Aug 28, 2018

This part is one of the most important to working with NN or DL nets. The instructor has achieved to teach a not so easy topic in an awesome manner so everyone is able to tune his networks as a professional. Can't wait for the next part.

By Adrian L

Nov 25, 2017

I this course I learned how to improve Deep Neural Networks by applying different methods that help to speed up the convergence and to reduce overfitting. Also, now I have some basic knowledge about using TensorFlow. Thank you very much!


Jul 25, 2019

pretty good course all in all !, I would say considering the difficulty of this topics, the instructor has done a great job in transmitting the relevant parts that one needs to remember and also in justifying why things are as they are.

By Alexandre R

Dec 29, 2018

Very well structured class as a follow-up to the first one. Heavy on information but this is a good thing. As someone who isn't pro at Python, the development part was much smoother since programming wise it is similar to the first one.

By Santiago I C

Dec 05, 2018

En línea con los anteriores. Muy teórico pero perfecto para entender los entresijos del funcionamiento de los algoritmos. Si acaso echo en falta algo más de tensorflow pero supongo que se verá en el resto de cursos de la especializacion

By Rahul Y

Nov 18, 2018

I really like the practical aspects of the course where although there is a focus on teaching the fundamentals, there is also a good focus on teaching the latest frameworks to apply the knowledge of the learnt concepts more efficiently.

By stewart n

Feb 24, 2018

Excellent practical advice on running NNs. The lectures teach the subject matter in a lucid and intuitive way. The course ends with a TemperFlow exercise that shows how to implement NNs at a higher level than peviously shown with numpy.

By Alejandro M

Nov 12, 2017

Great material. Short, precise videos.

It would be great if you propose projects to work on outside the course, in order to learn more about the topics. Just like ideas where we could apply what we have learned and a seed to build upon.

By Jagdeep

Oct 29, 2017

Loved the programming assignments. After learning Tensor flow in this course, I learnt about Keras on my own. It made model building very easy, but without understanding the basics, going straight to Keras would make a person dangerous.

By Carlson O

Oct 01, 2017

Again, the course was great. Covering a large spectrum of deep neural net adaptations and configurations of its hyperparameters give me a better understanding and tips with how to best use this deep learning technology. Congratulations!

By Thomas L

Oct 09, 2019

I can't emphasize how much I enjoyed this course. The course material is clear, structured and well laid out and each concept builds on the previous with repeated emphasis on key walk away points. Can't wait to start the next course :)

By Ali S

Mar 19, 2019

This is a great course like other ones in this specialization. I learned from this course why we need regularization, how to do them exactly, what are the rules-of-thumb for setting hyperparameters, and how to find them systematically.


Jan 21, 2020

After learning neural network and deep learning it is important to learn improving networks.This course gives idea to improve your network.Only knowing how to build a neural net is not okay you should also know to improve the network.

By Sriram G

Jun 24, 2018

Had a lot of confusions on why and how to tune hyper parameters. Got a good amount of knowledge in Mini batch, batch normalization, momentum, Adam and RMS prop. Will surely be useful when I tune hyper parameters in my future projects.

By Scott G

Feb 17, 2018

Great course. It was a little short, but covered the necessary parts of hyperparameter tuning. I also liked how the last homework was done using TensorFlow and how the courses in the specialization build upon the preceding lectures.

By Zhan S

Oct 26, 2017

Teaches "what it is" and "how to do it". Clear steps, easy to follow. It would be great if you can also teach "why it is like this", or say, why is regularization valid, what is the theoretical justification behind regularization etc.

By Tarry S

Oct 06, 2017

Excellently taught by Andrew Ng. While the field of Deep Learning and AI continues to evolve rapidly, Andrew maintains calm and explains the core and relevant aspects needed to succeed in this course and hopefully also in your career.

By Sowmya A

Sep 19, 2019

As with the first course of this specialization, Professor takes one step at a time building/ explaining things. He explains even minor details, so it very easy to understand. Also the assignments are very useful to learn the topics.

By Shrikant A

Jan 05, 2020

It has been a very helpful course for me. I got a proper intuition behind the hyperparameter tuning because of this course. Professor Andrew Ng's pedagogy and coursework design is just perfect and i really enjoyed learning from him.