The course is very good and has taught me the all the important concepts required to build a sequence model. The assignments are also very neatly and precisely designed for the real world application.
Hope can elaborate the backpropagation of RNN much more. BP through time is a bit tricky though we do not need to think about it during implementation using most of existing deep learning frameworks.
By Sayon S•
A bit cryptic
By Phoenix A•
By Paul A•
a bit hard!
By Sonia D•
By BILLA N R•
By Roberto J•
By Ariel H•
By 36 - O S•
By teaching m•
By VIGNESHKUMAR R•
By Shashank V M•
By Yashwanth M•
By Rahila T•
By savinay s•
By krishna m s g•
By Aaradhya S•
By Natalia O•
in comparison to the previous courses from this sequence, this one is even less structured - ptobably this is because even broader knowledge is tried to be shown in only 3 weeks, but i feel like a lot is skipped between videos (which are ok) and the tasks - in many assignment tasks in this course it is not very well explained what is meant to be done - i mean this especially in case of Keras objects. In many cases it is quite unclear how those classes are supposed to be handled in the context of our task. There are some hints but those are mostly links to documentation (btw, some of the links are no longer up to date), but it is often not too well explained which properties those objects have, what one can do etc. so one ends up with trying using those objects in different configuarations, then googling around, looking on the course forum for the right answer but it is very difficult to derive it. There should be more precise instructions regarding handling Keras objects - the examples in the documentation and in blogs are often much simpler than those from assignments so one ends up not knowing what is going on. In summary - there is a big jump and a big gap between the intuitions in videos (which btw are much more fuzzy than those in first cources in the specialization, the intuitions get more and more superfluous as one doesnt go into detail) and what is being done in the assignments. One thing i really liked about hte previous assignments was that when writing the code one could really know very well what is going on. And this is no longer the case in this course...
By Mark S•
As we head to the last course in the specialization (and the last two courses are the ones that interested me), we have error after error in the assignments, including problems with the kernel that are not obvious until you've struggled with incoherent stack trace output for a while.
Searching the disorganised discussion centre for the course/week in question you can find that these errors affect everyone and go back for a couple of years, never having been fixed. The mentors there help explain, but mentors cannot edit to fix the code as they do not have permission, and the course supervisors have long since disappeared. So you have to submit incorrect code to pass, then fix the code for your personal private code store - as the fixed code generates the correct numerical answers that unfortunately do not match the numerical answers that the grader requires to pass you!
It feels like, in the hurry to get the full specialization out, the final courses go downhill in terms of care & attention in the rush. Then afterwards, all of the errors and badly designed code in the assignments cause many unexpected headaches, nothing to do with DL, and were never fixed or maintained afterwards by the course supervisors.
In the end, the delays caused to me in the final (two) course(s) added at least one extra monthly payment on to my subscription. Overall I can't complain, the specialization is good. But feels abandoned by the lecturer & assistant lecturers since early 2018
By Stephen D•
It's helpful to have this course since there aren't enough beginner-oriented courses on these topics, especially ones that also get into actual equations like he does. However I think he doesn't provide enough explanations of complicated topics like GRU's and LSTM's. There are lots of confusing aspects of both such technologies, and he could afford to spend even more time in explanation than he does.
EDIT: I am now on week 2. This course feels rushed and he doesn't take the time to clarify confusing issues - for example, when he first introduces how to learn word embeddings he calls the neural network you use a "language model" even though the network bears no resemblance to the language model we learned in week 1. This really confused me and he doesn't address this point. Also, he variously describes the embeddings as the "input" and the "parameters" of this neural network, even though those are clearly two different things. There are more issues where that came from.
Unlike all of his previous courses, I've found myself needing to go to Wikipedia and Google to try to fill in various holes in the presentations here.
Also, there is essentially no help on the forums. That isn't the reason for my low rating, since for a cheap course I didn't expect much. Still, it would have been nice if they had tried to do a little bit more there.
By Ramon R•
Unlike the other courses which Andrew Ng provides, this one contains many spelling mistakes in the programming assignment, the programming assignments are less structured and understandable (missing or wrong information in nearly every assignment) and an introduction to keras is missing. I found it great that the keras framework is an important component of this course, but unlike the tensorflow introduction it is missing here. It is frustrating, when you might have the right functions but no information how to input and determine the correct variables for the functions. Anyway I found the outline of the course very good as it gives a good overview of many methods and how they work. To my mind the consistency of the assignments and also the story telling needs to be improved to reach the level of other courses where Andrew is involved. It appeared more chaotic and the complexity of the algorithms is overwhelming, so a better introduction to how they work, might be appealing. In the end, I worked through it and I gained a basic understanding of keras and RNN algorithms. So it was definitely worth it.
By Luca M B•
A nice course after all, but I expected something more. It is valuable if you know nothing about RNN and NLP, or if you know something and want to go a little deeper and work on some guided keras examples.
What it is not, is an in depth RNN course. It's very short: in my case the 3 weeks boiled down to 2.5 fulltime days. Not enough for a full review of the topic.
Homeworks are interesting but:
-very simple, no large scale application
-short rounds of CPU training: no GPU, no access to server clusters
-keras layers are used without much explanation about it, this is sad since keras docs is really incomplete about usage examples. I'm referring to calling an LSTM layer inside a loop to manually create all the timestep stucture!
-keras layers are used that have never been introduced in the course (such as BatchNormalization)
-often heuristics for network topology and hyperparameter values are not clearly explained, leaving the student with no insights on how to approach different tasks
By Travis J•
The subject matter was a good introduction to various RNN model types and concepts. I have to dock a couple stars, however, as the course leans so heavily on Keras implementations during the assignments that it really should be listed as a firm requirement. While I feel that I'm more experienced with both RNN models and the use of Keras now, it was a struggle with what felt like a lot of cargo culting for me to get through most of the assignments. I don't consider the brief lesson on Keras at the end of the second course to be sufficient training, particularly if much time has passed between taking that course and this one. A brief "Lesson 0" on Keras is sorely needed at the beginning of this course. Otherwise, it should be explicitly and firmly communicated at the start that the programming assignments require a certain familiarity with the Keras framework. Overall, I do highly recommend this course, but be forewarned about the need to be familiar with Keras before starting.
By Joshua P J•
The material provides a strong overview of sample problems for which sequence models work well. However, the class doesn't give users the conceptual mastery needed to apply sequence models to new or related problems. The issue is that the motivation and concepts underlying new architectures aren't well-explained (they're often an afterthought at the end of a lecture). This approach to teaching feels backwards.
Specific issues: Week 2 & 3 homework treats lecture material as mostly black boxes so they aren't particularly illustrative. The week 3 Attention Model lectures make no sense, are taught in reverse order, and feel unfocused (with apologies, I know there's a bad pun there; it's not intentional). In Week 3, I ended up skipping to the homework because I found lecture exasperating; to my surprise, the Markdown comment boxes in the Python notebooks explained the material better than lecture did.