Queries, Keys, Values, and Attention

video-placeholder
Loading...
View Syllabus

Skills You'll Learn

Reformer Models, Neural Machine Translation, Chatterbot, T5+BERT Models, Attention Models

Reviews

4.3 (845 ratings)

  • 5 stars
    66.15%
  • 4 stars
    15.26%
  • 3 stars
    8.99%
  • 2 stars
    5.32%
  • 1 star
    4.26%

SB

Nov 20, 2020

The course is a very comprehensive one and covers all state-of-the-art techniques used in NLP. It's quite an advanced level course and a good python coding skill is a must.

DB

Jan 24, 2023

I learned a lot from this course, and the ungraded and graded problems are relevant to understanding and knowing how to build a transformer or a reformer from scratch

From the lesson

Neural Machine Translation

Discover some of the shortcomings of a traditional seq2seq model and how to solve for them by adding an attention mechanism, then build a Neural Machine Translation model with Attention that translates English sentences into German.

Taught By

  • Placeholder

    Younes Bensouda Mourri

    Instructor

  • Placeholder

    Łukasz Kaiser

    Instructor

  • Placeholder

    Eddy Shyu

    Curriculum Architect

Explore our Catalog

Join for free and get personalized recommendations, updates and offers.