This course will teach you how to build models for natural language, audio, and other sequence data. Thanks to deep learning, sequence algorithms are working far better than just two years ago, and this is enabling numerous exciting applications in speech recognition, music synthesis, chatbots, machine translation, natural language understanding, and many others.
This course is part of the Deep Learning Specialization
Offered By
Deep Learning Specializationdeeplearning.aiAbout this Course
1,201,383 recent views
Learner Career Outcomes
39%
started a new career after completing these courses
40%
got a tangible career benefit from this course
13%
got a pay increase or promotion
Shareable Certificate
Earn a Certificate upon completion
100% online
Start instantly and learn at your own schedule.
Course 5 of 5 in the
Flexible deadlines
Reset deadlines in accordance to your schedule.
Intermediate Level
Approx. 16 hours to complete
English
Subtitles: Chinese (Traditional), French, Chinese (Simplified), Korean, English, Spanish
Skills you will gain
Recurrent Neural NetworkArtificial Neural NetworkDeep LearningLong Short-Term Memory (ISTM)
Learner Career Outcomes
39%
started a new career after completing these courses
40%
got a tangible career benefit from this course
13%
got a pay increase or promotion
Shareable Certificate
Earn a Certificate upon completion
100% online
Start instantly and learn at your own schedule.
Course 5 of 5 in the
Flexible deadlines
Reset deadlines in accordance to your schedule.
Intermediate Level
Approx. 16 hours to complete
English
Subtitles: Chinese (Traditional), French, Chinese (Simplified), Korean, English, Spanish
Offered by
deeplearning.ai
Founded by Andrew Ng, deeplearning.ai is on a mission to make world-class AI education accessible to people around the globe so that we can all benefit from an AI-powered future.
Syllabus - What you will learn from this course
6 hours to complete
Recurrent Neural Networks
Learn about recurrent neural networks. This type of model has been proven to perform extremely well on temporal data. It has several variants including LSTMs, GRUs and Bidirectional RNNs, which you are going to learn about in this section.
6 hours to complete
12 videos (Total 112 min), 2 readings, 4 quizzes
12 videos
Notation9m
Recurrent Neural Network Model16m
Backpropagation through time6m
Different types of RNNs9m
Language model and sequence generation12m
Sampling novel sequences8m
Vanishing gradients with RNNs6m
Gated Recurrent Unit (GRU)17m
Long Short Term Memory (LSTM)9m
Bidirectional RNN8m
Deep RNNs5m
2 readings
Gated Recurrent Unit (GRU) *CORRECTION*1m
Long Short Term Memory (LSTM) *CORRECTION*1m
1 practice exercise
Recurrent Neural Networks30m
4 hours to complete
Natural Language Processing & Word Embeddings
Natural language processing with deep learning is an important combination. Using word vector representations and embedding layers you can train recurrent neural networks with outstanding performances in a wide variety of industries. Examples of applications are sentiment analysis, named entity recognition and machine translation.
4 hours to complete
10 videos (Total 102 min), 1 reading, 3 quizzes
10 videos
Using word embeddings9m
Properties of word embeddings11m
Embedding matrix5m
Learning word embeddings10m
Word2Vec12m
Negative Sampling11m
GloVe word vectors11m
Sentiment Classification7m
Debiasing word embeddings11m
1 reading
GloVe word vectors *CORRECTION*1m
1 practice exercise
Natural Language Processing & Word Embeddings30m
5 hours to complete
Sequence models & Attention mechanism
Sequence models can be augmented using an attention mechanism. This algorithm will help your model understand where it should focus its attention given a sequence of inputs. This week, you will also learn about speech recognition and how to deal with audio data.
5 hours to complete
11 videos (Total 103 min), 4 readings, 3 quizzes
11 videos
Picking the most likely sentence8m
Beam Search11m
Refinements to Beam Search11m
Error analysis in beam search9m
Bleu Score (optional)16m
Attention Model Intuition9m
Attention Model12m
Speech recognition8m
Trigger Word Detection5m
Conclusion and thank you2m
4 readings
Bleu Score *CORRECTION*1m
Corrections10m
Workera's Standardized Tests for AI Skills1m
Instructions if you are unable to open your notebook10m
1 practice exercise
Sequence models & Attention mechanism30m
Reviews
TOP REVIEWS FROM SEQUENCE MODELS
by AMJun 30, 2019
The course is very good and has taught me the all the important concepts required to build a sequence model. The assignments are also very neatly and precisely designed for the real world application.
by JYOct 29, 2018
The lectures covers lots of SOTA deep learning algorithms and the lectures are well-designed and easy to understand. The programming assignment is really good to enhance the understanding of lectures.
by ACJun 23, 2019
Very well produced and explained. In my case, the nature of the Sequence Model makes understanding the concepts and finishing the assignment more challenging than other segments of the specialization.
by PJApr 3, 2019
The previous courses raised the bar and expectations. The assignments for Week 1 and Week 2 were a bit unclear. Lectures for Week 1 and Week 2 can be improved as well. Besides, this is a great course!
About the Deep Learning Specialization
If you want to break into AI, this Specialization will help you do so. Deep Learning is one of the most highly sought after skills in tech. We will help you become good at Deep Learning.
In five courses, you will learn the foundations of Deep Learning, understand how to build neural networks, and learn how to lead successful machine learning projects. You will learn about Convolutional networks, RNNs, LSTM, Adam, Dropout, BatchNorm, Xavier/He initialization, and more. You will work on case studies from healthcare, autonomous driving, sign language reading, music generation, and natural language processing. You will master not only the theory, but also see how it is applied in industry. You will practice all these ideas in Python and in TensorFlow, which we will teach.
You will also hear from many top leaders in Deep Learning, who will share with you their personal stories and give you career advice.
AI is transforming multiple industries. After finishing this specialization, you will likely find creative ways to apply it to your work.
We will help you master Deep Learning, understand how to apply it, and build a career in AI.
Frequently Asked Questions
When will I have access to the lectures and assignments?
Access to lectures and assignments depends on your type of enrollment. If you take a course in audit mode, you will be able to see most course materials for free. To access graded assignments and to earn a Certificate, you will need to purchase the Certificate experience, during or after your audit. If you don't see the audit option:
- The course may not offer an audit option. You can try a Free Trial instead, or apply for Financial Aid.
- The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I subscribe to this Specialization?
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile. If you only want to read and view the course content, you can audit the course for free.
What is the refund policy?
If you subscribed, you get a 7-day free trial during which you can cancel at no penalty. After that, we don’t give refunds, but you can cancel your subscription at any time. See our full refund policy.
Is financial aid available?
Yes, Coursera provides financial aid to learners who cannot afford the fee. Apply for it by clicking on the Financial Aid link beneath the "Enroll" button on the left. You'll be prompted to complete an application and will be notified if you are approved. You'll need to complete this step for each course in the Specialization, including the Capstone Project. Learn more.
More questions? Visit the Learner Help Center.
