Concise, challenging, thought-provoking. This course is an immersive look into the inner workings of Transformer models, and the BERT model
This course should never have been published to coursera with such a state, it should have been a free YouTube video at best. What can be done better: - Make it a full course, i.e., start by introducing sequence modelling, why use attention mechanism over something like LSTM etc. - Start introducing concepts such as tokenization, vectorization, etc. - Describe transformer model in detail, take a simple 1 encoder / 1 decoder block and explain how it works with a toy example dataset. - Teach implementation of the toy example in code. - Introduce BERT with clear goal on what it aims to solve - Then comes the part that was discussed in the current course.
