This course will teach you how to build models for natural language, audio, and other sequence data. Thanks to deep learning, sequence algorithms are working far better than just two years ago, and this is enabling numerous exciting applications in speech recognition, music synthesis, chatbots, machine translation, natural language understanding, and many others.
This course is part of the Deep Learning Specialization
Offered By
Deep Learning SpecializationDeepLearning.AIAbout this Course
749,130 recent views
Learner Career Outcomes
38%
started a new career after completing these courses
39%
got a tangible career benefit from this course
13%
got a pay increase or promotion
Shareable Certificate
Earn a Certificate upon completion
100% online
Start instantly and learn at your own schedule.
Course 5 of 5 in the
Flexible deadlines
Reset deadlines in accordance to your schedule.
Intermediate Level
Approx. 16 hours to complete
English
Subtitles: Chinese (Traditional), French, Portuguese (Brazilian), Chinese (Simplified), Korean, Russian, English, Spanish
Skills you will gain
Recurrent Neural NetworkArtificial Neural NetworkDeep LearningLong Short-Term Memory (ISTM)
Learner Career Outcomes
38%
started a new career after completing these courses
39%
got a tangible career benefit from this course
13%
got a pay increase or promotion
Shareable Certificate
Earn a Certificate upon completion
100% online
Start instantly and learn at your own schedule.
Course 5 of 5 in the
Flexible deadlines
Reset deadlines in accordance to your schedule.
Intermediate Level
Approx. 16 hours to complete
English
Subtitles: Chinese (Traditional), French, Portuguese (Brazilian), Chinese (Simplified), Korean, Russian, English, Spanish
Offered by
DeepLearning.AI
Founded by Andrew Ng, DeepLearning.AI is an education technology company that develops a global community of AI talent.
Syllabus - What you will learn from this course
6 hours to complete
Recurrent Neural Networks
Learn about recurrent neural networks. This type of model has been proven to perform extremely well on temporal data. It has several variants including LSTMs, GRUs and Bidirectional RNNs, which you are going to learn about in this section.
6 hours to complete
12 videos (Total 112 min), 2 readings, 4 quizzes
12 videos
Notation9m
Recurrent Neural Network Model16m
Backpropagation through time6m
Different types of RNNs9m
Language model and sequence generation12m
Sampling novel sequences8m
Vanishing gradients with RNNs6m
Gated Recurrent Unit (GRU)17m
Long Short Term Memory (LSTM)9m
Bidirectional RNN8m
Deep RNNs5m
2 readings
Gated Recurrent Unit (GRU) *CORRECTION*1m
Long Short Term Memory (LSTM) *CORRECTION*1m
1 practice exercise
Recurrent Neural Networks30m
4 hours to complete
Natural Language Processing & Word Embeddings
Natural language processing with deep learning is an important combination. Using word vector representations and embedding layers you can train recurrent neural networks with outstanding performances in a wide variety of industries. Examples of applications are sentiment analysis, named entity recognition and machine translation.
4 hours to complete
10 videos (Total 102 min), 1 reading, 3 quizzes
10 videos
Using word embeddings9m
Properties of word embeddings11m
Embedding matrix5m
Learning word embeddings10m
Word2Vec12m
Negative Sampling11m
GloVe word vectors11m
Sentiment Classification7m
Debiasing word embeddings11m
1 reading
GloVe word vectors *CORRECTION*1m
1 practice exercise
Natural Language Processing & Word Embeddings30m
5 hours to complete
Sequence models & Attention mechanism
Sequence models can be augmented using an attention mechanism. This algorithm will help your model understand where it should focus its attention given a sequence of inputs. This week, you will also learn about speech recognition and how to deal with audio data.
5 hours to complete
11 videos (Total 103 min), 4 readings, 3 quizzes
11 videos
Picking the most likely sentence8m
Beam Search11m
Refinements to Beam Search11m
Error analysis in beam search9m
Bleu Score (optional)16m
Attention Model Intuition9m
Attention Model12m
Speech recognition8m
Trigger Word Detection5m
Conclusion and thank you2m
4 readings
Bleu Score *CORRECTION*1m
Corrections10m
Workera's Standardized Tests for AI Skills1m
Instructions if you are unable to open your notebook10m
1 practice exercise
Sequence models & Attention mechanism30m
Reviews
TOP REVIEWS FROM SEQUENCE MODELS
by ACJun 23, 2019
Very well produced and explained. In my case, the nature of the Sequence Model makes understanding the concepts and finishing the assignment more challenging than other segments of the specialization.
by JYOct 29, 2018
The lectures covers lots of SOTA deep learning algorithms and the lectures are well-designed and easy to understand. The programming assignment is really good to enhance the understanding of lectures.
by PJApr 3, 2019
The previous courses raised the bar and expectations. The assignments for Week 1 and Week 2 were a bit unclear. Lectures for Week 1 and Week 2 can be improved as well. Besides, this is a great course!
by AMJun 30, 2019
The course is very good and has taught me the all the important concepts required to build a sequence model. The assignments are also very neatly and precisely designed for the real world application.
About the Deep Learning Specialization
If you want to break into AI, this Specialization will help you do so. Deep Learning is one of the most highly sought after skills in tech. We will help you become good at Deep Learning.
Frequently Asked Questions
When will I have access to the lectures and assignments?
What will I get if I subscribe to this Specialization?
Is financial aid available?
More questions? Visit the Learner Help Center.
