Explore
For Enterprise
Join for Free
Log In

Arts and Humanities
Business
Computer Science
Data Science
Information Technology
Health
Math and Logic
Personal Development
Physical Science and Engineering
Social Sciences
Language Learning
Degrees
Certificates

Explore all of Coursera

Browse
Search
For Enterprise
Log In
Join for Free

Trigger Word Detection

Loading...

Sequence Models

deeplearning.ai

4.8 (15,251 ratings) | 130K Students Enrolled

Course 5 of 5 in the Deep Learning Specialization

This course will teach you how to build models for natural language, audio, and other sequence data. Thanks to deep learning, sequence algorithms are working far better than just two years ago, and this is enabling numerous exciting applications in speech recognition, music synthesis, chatbots, machine translation, natural language understanding, and many others. You will: - Understand how to build and train Recurrent Neural Networks (RNNs), and commonly-used variants such as GRUs and LSTMs. - Be able to apply sequence models to natural language problems, including text synthesis. - Be able to apply sequence models to audio applications, including speech recognition and music synthesis. This is the fifth and final course of the Deep Learning Specialization. deeplearning.ai is also partnering with the NVIDIA Deep Learning Institute (DLI) in Course 5, Sequence Models, to provide a programming assignment on Machine Translation with deep learning. You will have the opportunity to build a deep learning project with cutting-edge, industry-relevant content.

Skills You'll Learn

Recurrent Neural Network, Artificial Neural Network, Deep Learning, Long Short-Term Memory (ISTM)

Reviews

4.8 (15,251 ratings)

5 stars
12,815 ratings
4 stars
1,955 ratings
3 stars
372 ratings
2 stars
73 ratings
1 star
36 ratings

WK

Mar 14, 2018

I was really happy because I could learn deep learning from Andrew Ng.\n\nThe lectures were fantastic and amazing.\n\nI was able to catch really important concepts of sequence models.\n\nThanks a lot!

NM

Feb 21, 2018

Hope can elaborate the backpropagation of RNN much more. BP through time is a bit tricky though we do not need to think about it during implementation using most of existing deep learning frameworks.

From the lesson

Sequence models & Attention mechanism

Sequence models can be augmented using an attention mechanism. This algorithm will help your model understand where it should focus its attention given a sequence of inputs. This week, you will also learn about speech recognition and how to deal with audio data.

Speech recognition8:53

Trigger Word Detection5:02

Taught By

Andrew Ng
CEO/Founder Landing AI; Co-founder, Coursera; Adjunct Professor, Stanford University; formerly Chief Scientist,Baidu and founding lead of Google Brain
Head Teaching Assistant - Kian Katanforoosh
Lecturer of Computer Science at Stanford University, deeplearning.ai, Ecole CentraleSupelec
Teaching Assistant - Younes Bensouda Mourri
Mathematical & Computational Sciences, Stanford University, deeplearning.ai

Transcript

You've now learned so much about deep learning, and sequence models,

that we can actually describe a trigger word system quite simply,

just on one slide as you see in this video.

But, with the rise of speech recognition,

there have been more and more devices.

You can wake up with your voice,

and those are sometimes called trigger word detection systems.

So, let's see how you can build a trigger word system.

Examples of trigger word systems include;

Amazon Echo, which is broken out with the word Alexa,

the Baidu DuerOS power devices,

broken out with the phrase Xiadunihao,

Apple Siri broken up with Hey Siri,

and Google Home broken up with Okay Google.

So, [inaudible] trigger word detection,

that if you have say an Amazon echo in your living room,

you can walk through the living room and just say,

"Alexa, what time is it",

and have it wake up,

or be triggered by the voice Alexa,

and answer your voice query.

So, if you can build a trigger word detection system;

maybe you can make your computer do something by telling your computer, "activate."

One of my friends also works on turning on and off a particular lamp,

using a trigger word,

as a fun project.

But, what I want to show you is how you can build a trigger word detection system.

The literature on triggered detection algorithm is still evolving,

so there isn't wide consensus yet,

on what's the best algorithm for trigger word detection.

So, I'm just going to show you one example of an algorithm you can use.

Now, you've seen RNNs like this,

and what we really do,

is to take an audio clip,

maybe compute spectrogram features,

and that generates audio features X-1 X-2 X-3,

that you pass through an RNN.

So, all that remains to be done,

is to define the target labels y.

So, this point in the audio clip,

is when someone just finished saying the trigger word,

such as Alexa or Xiadunihao,

or Hey Siri, or okay Google.

Then, in the training set,

you can set the target labels to be zero for everything before that point,

and right after that,

to set the target label of one.

Then, if a little bit later on,

the trigger word was said again at this point,

then you can again set the target label to be one, right after that.

Now, this type of labeling scheme for an RNN could work.

Actually it just won't actually work reasonably well.

One slight disadvantage of this is,

it creates a very imbalanced training set,

so we have a lot more zeros than we want.

So, one other thing you could do,

that it's little bit of a hack,

but could make the model a little bit easier to train,

is instead of setting only a single time step to operate one,

you could actually make it to operate a few ones for several times.

So, for a fixed period of time,

before reverting back to zero.

So that slightly evens out the ratio of one's to zero's,

but there's this little bit of a hack.

But, if this is when in the audio clip,

the trigger word was said, then right after that,

you can set the target label to one,

and if this is the trigger word said again,

then right after that,

is when you want the RNN to output one.

So, you get to play more off this as well,

in the programming exercise,

but I think you should feel quite proud of yourself.

We've learned enough about deep learning,

that it just takes one picture;

one slide, to describe something as complicated as trigger word detection.

Based on this, I hope you'll implement something that works,

and allows you to detect trigger words.

Well, you see more of this in the programming exercise.

So, that's it for trigger words.

I hope you feel quite proud of yourself,

for how much you've learned about deep learning,

that you can now describe trigger words in just one slide in a few minutes,

and that you prepare hopefully to implemented it, and get it to work.

Maybe even make it do something fun in your house even,

like turn on or turn off,

or you could do something on your computer,

when you or when someone else says the trigger words.

This is the last technical video of this course,

and to wrap up in discourse on sequence models,

you learned about RNNs,

including both GR use and LSTMs.

Then in the second week,

you've learned a lot about word embeddings,

and also learned representations of words.

Then in this week,

you learned about the attention model,

as well as how to use it to process audio theater.

I hope you have fun implementing all of these ideas in this peace-pro exercise.

Let's go on to the last video.

Explore our Catalog

Join for free and get personalized recommendations, updates and offers.

Coursera provides universal access to the world’s best education, partnering with top universities and organizations to offer courses online.

© 2019 Coursera Inc. All rights reserved.

Download on the App Store

Get it on Google Play

Coursera
About
Leadership
Careers
Catalog
Certificates
MasterTrack™ Certificates
Degrees
For Enterprise
For Government

Community
Learners
Partners
Developers
Beta Testers
Translators

Connect
Blog
Facebook
LinkedIn
Twitter
Instagram
YouTube
Tech Blog

More
Terms
Privacy
Help
Accessibility
Press
Contact
Directory
Affiliates