Back to Generative AI Language Modeling with Transformers
IBM

Generative AI Language Modeling with Transformers

This course provides a practical introduction to using transformer-based models for natural language processing (NLP) applications. You will learn to build and train models for text classification using encoder-based architectures like Bidirectional Encoder Representations from Transformers (BERT), and explore core concepts such as positional encoding, word embeddings, and attention mechanisms. The course covers multi-head attention, self-attention, and causal language modeling with GPT for tasks like text generation and translation. You will gain hands-on experience implementing transformer models in PyTorch, including pretraining strategies such as masked language modeling (MLM) and next sentence prediction (NSP). Through guided labs, you’ll apply encoder and decoder models to real-world scenarios. This course is designed for learners interested in generative AI engineering and requires prior knowledge of Python, PyTorch, and machine learning. Enroll now to build your skills in NLP with transformers!

Status: Large Language Modeling
Status: Transfer Learning
IntermediateCourse9 hours

Featured reviews

RR

4.0Reviewed Oct 10, 2024

Once again, great content and not that great documentation (printable cheatsheets, no slides, etc). Documentation is essential to review a course content in the future. Alas!

AB

5.0Reviewed Dec 29, 2024

This course gives me a wide picture of what transformers can be.

RR

5.0Reviewed Sep 1, 2025

I loved this course. It is very informative and has a lot of examples. It will take some time to master all this information.

PA

4.0Reviewed Nov 4, 2025

Excellent course to understand about AI/ML/GenAI. The videos are not very detailed and just the right amount to skim through the details.

MA

5.0Reviewed Jan 17, 2025

Exceptional course and all the labs are industry related

VB

4.0Reviewed Nov 16, 2024

need assistance from humans, which seems lacking though a coach can give guidance but not to the extent of human touch.

All reviews

Showing: 20 of 31

Ohad Horowitz
1.0
Reviewed Feb 2, 2025
Deleted Account
4.0
Reviewed Oct 22, 2024
Alexandre Tutelaire
5.0
Reviewed Feb 22, 2025
raul vigo rivas
4.0
Reviewed Oct 11, 2024
XUETING WANG
4.0
Reviewed Dec 2, 2024
vikky bhai
4.0
Reviewed Nov 17, 2024
Makhlouf Mahmoud
5.0
Reviewed Apr 6, 2025
GILBERTO PEÑA NUR
5.0
Reviewed Oct 30, 2025
Robert Rosu
5.0
Reviewed Sep 2, 2025
José Luis Cucardo Camayo
5.0
Reviewed Sep 5, 2025
LO WingChong
5.0
Reviewed Nov 10, 2024
Ana Aguilar Beltrán
5.0
Reviewed Dec 30, 2024
Muhammad Azeem
5.0
Reviewed Jan 18, 2025
Harshit Rq
5.0
Reviewed Jul 25, 2025
janice Pinnock
5.0
Reviewed Nov 18, 2025
Oscar Leon
5.0
Reviewed Nov 19, 2025
Santanu Ghosh
5.0
Reviewed Jan 14, 2026
ROSHNI CHATTERJEE
5.0
Reviewed Dec 30, 2025
329_SUDIP CHAKRABARTY
5.0
Reviewed Dec 2, 2024
Purva Tijare
5.0
Reviewed Jul 26, 2024