Back to Transformer Models and BERT Model
Google Cloud

Transformer Models and BERT Model

This course introduces you to the Transformer architecture and the Bidirectional Encoder Representations from Transformers (BERT) model. You learn about the main components of the Transformer architecture, such as the self-attention mechanism, and how it is used to build the BERT model. You also learn about the different tasks that BERT can be used for, such as text classification, question answering, and natural language inference. This course is estimated to take approximately 45 minutes to complete.

Status: Generative Model Architectures
Status: Large Language Modeling
AdvancedCourse1 hour

Featured reviews

JS

Reviewed Jan 30, 2025

Concise, challenging, thought-provoking. This course is an immersive look into the inner workings of Transformer models, and the BERT model

NS

Reviewed Jun 24, 2023

very clear and detailed explanation of the transformers with practical example of training BERT model

WC

Reviewed Mar 12, 2024

Excellent and concise presentation of Transformer and BERT models. The course designer may consider adding programming assignments to illustrate the concepts and to reinforce student learning.

KB

Reviewed Mar 21, 2025

Lab no longer works end to end. I was able to run until we started building classification model. TesnsorFlow code is no longer compiling.

RR

Reviewed Jul 21, 2025

it is a short but very effective video. the content is crisp and easy to understand if you have decent understanding of NN.

All reviews

Showing: 20 of 28

Swastik
1.0
Reviewed Jun 29, 2023
Ankit
3.0
Reviewed Sep 13, 2023
A
2.0
Reviewed Dec 21, 2023
SRIKARA
1.0
Reviewed Jan 5, 2025
Minseok
1.0
Reviewed Feb 19, 2025
Naman
4.0
Reviewed Jul 17, 2023
Peter
1.0
Reviewed Aug 25, 2024
Waheed
5.0
Reviewed Jun 26, 2024
Karen
5.0
Reviewed Oct 24, 2025
Joaquin
5.0
Reviewed Jan 31, 2025
Riddhimaan
5.0
Reviewed Jul 22, 2025
Nabih
5.0
Reviewed Jun 25, 2023
Javi22
5.0
Reviewed Jul 18, 2025
Mr.
5.0
Reviewed Nov 7, 2023
Wingyan
4.0
Reviewed Mar 13, 2024
Kashish
4.0
Reviewed Mar 22, 2025
Kian
4.0
Reviewed Oct 29, 2023
Naveen
4.0
Reviewed May 14, 2025
이성재
4.0
Reviewed Jul 21, 2025
Andreas
3.0
Reviewed Apr 17, 2025