When you enroll in this course, you'll also be enrolled in this Specialization.
Learn new concepts from industry experts
Gain a foundational understanding of a subject or tool
Develop job-relevant skills with hands-on projects
Earn a shareable career certificate
There are 3 modules in this course
NVIDIA: Large Language Models and Generative AI Deployment is the fourth course of the Exam Prep (NCA-GENL): NVIDIA-Certified Generative AI LLMs - Associate Specialization. This course offers a comprehensive understanding of Large Language Models (LLMs) and Generative AI deployment, combining theoretical insights with practical skills.
Learners will explore key components of Generative AI, data requirements, and cleaning techniques for LLMs. The course covers model training, optimization, and evaluation methods, including Few-shot, Zero-shot, and Instruction Tuning. Additionally, the course dives into loss functions, alignment techniques, and evaluation metrics such as Perplexity. It also emphasizes the use of GPUs for training, fine-tuning methods like prompt tuning, and Parameter Efficient Fine Tuning (PEFT). Learners will gain expertise in LLM deployment strategies and monitoring with ONNX.
This course is divided into three modules, each containing lessons and video lectures. Learners will engage with 4:30-5:00 hours of video content, covering both theoretical concepts and hands-on practices. Each module is equipped with quizzes to reinforce learning and assess understanding.
Module 1: Fundamentals of Large Language Models
Module 2: Training, Optimization, and Evaluation of LLMs
Module 3: LLM Deployment Strategies and Monitoring
By the end of this course, a learner will be able to:
- Understand the foundational concepts of LLMs, including NLP and training data.
- Explore model optimization techniques like loss functions, alignment, and PEFT.
- Implement deployment strategies for LLMs and monitor performance using ONNX.
This course is intended for professionals looking to deepen their expertise in deploying and optimizing LLMs for Generative AI applications.
Welcome to Week 1 of the NVIDIA: Large Language Models and Generative AI Deployment course. This week, we will begin by introducing you to Large Language Models (LLMs) and explore their significance in Natural Language Processing (NLP). We will also demonstrate how LLMs are applied to various NLP tasks using HuggingFace.
Next, we will dive into the concept of Generative AI models and their components. We’ll cover the importance of training data for LLMs and best practices for data cleaning.
By the end of this week, you will have a solid understanding of LLMs, their applications, and the essential processes involved in training them.
Usage of LLM on NLP Tasks - HuggingFace - Demo•8 minutes
What is Generative AI Model ?•4 minutes
Components of Generative AI•4 minutes
Training data for LLMs•4 minutes
Data Cleaning for LLMs•4 minutes
2 readings•Total 20 minutes
Welcome to the Course•10 minutes
Overview of Fundamentals of Large Language Models•10 minutes
2 assignments•Total 30 minutes
LLM Foundations & Generative AI - Knowledge check•15 minutes
Fundamentals of Large Language Models - Assessment•15 minutes
1 discussion prompt•Total 10 minutes
Meet and Greet•10 minutes
Training, Optimization, and Evaluation of LLMs
Module 2•2 hours to complete
Module details
Welcome to Week 2 of the NVIDIA: Large Language Models and Generative AI Deployment course. This week, we will cover the essentials of training and optimizing Large Language Models (LLMs). We will begin by exploring the various learning methods, including Few-shot, Zero-shot, Instruction Tuning, and Reinforcement Learning with Human Feedback (RLHF).
Next, we will delve into loss functions used in LLMs and techniques for aligning models effectively. We will also cover evaluation metrics such as Perplexity and discuss the critical role of humans in evaluating LLMs.
Additionally, we will examine the role of GPUs in training models and explore LLM fine-tuning techniques like Prompt Tuning and Parameter Efficient Fine-Tuning (PEFT).
By the end of the week, you will have a solid understanding of how to train, optimize, and evaluate LLMs for real-world applications.
What's included
9 videos1 reading2 assignments
Show info about module content
9 videos•Total 52 minutes
LLM Training and Optimization•9 minutes
Techniques of Learning methods (Few-shot, Zero-shot, Instruction tuning, RLHF)•7 minutes
Loss Functions of LLMs•6 minutes
LLM Alignment Techniques•5 minutes
Evaluation Metrics of LLM•4 minutes
Perplexity•4 minutes
Role of Humans in Evaluation of LLMs•5 minutes
Role of GPUs in Model Training•5 minutes
LLM Finetuning - Prompt Tuning & PEFT•6 minutes
1 reading•Total 10 minutes
Overview of Training, Optimization, and Evaluation of LLMs•10 minutes
2 assignments•Total 30 minutes
LLM Training & Optimization - Knowledge check•15 minutes
Training, Optimization, and Evaluation of LLMs - Assessment•15 minutes
LLM Deployment Strategies and Monitoring
Module 3•1 hour to complete
Module details
Welcome to Week 3 of the NVIDIA: Large Language Models and Generative AI Deployment course. This week, we will cover essential strategies for deploying Large Language Models (LLMs) in real-world applications. We will start by exploring various deployment strategies and how to choose the right one for different scenarios.
Next, we will introduce ONNX as a tool for unifying the deep learning landscape, and demonstrate how to convert deep learning models using ONNX. We will also focus on monitoring LLMs in production, covering best practices for ensuring their performance and reliability.
Finally, we will dive into the NVIDIA ecosystem and how it supports LLM deployment, enhancing model efficiency and scalability. By the end of the week, you will have a clear understanding of LLM deployment and monitoring techniques.
What's included
5 videos3 readings2 assignments
Show info about module content
5 videos•Total 23 minutes
LLM Deployment Strategies•5 minutes
ONNX: Unifying the Deep Learning Landscape•4 minutes
Convert the Deep Learning Model with ONNX - Demo•4 minutes
Monitoring the LLM Models in Production•6 minutes
NVIDIA Eco System in LLM Deployment•4 minutes
3 readings•Total 30 minutes
Overview of LLM Deployment Strategies and Monitoring•10 minutes
Key Takeaways of the course•10 minutes
Course Conclusion•10 minutes
2 assignments•Total 30 minutes
LLM Deployment and Optimization Strategies - Knowledge check•15 minutes
LLM Deployment Strategies and Monitoring - Assessment•15 minutes
Earn a career certificate
Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.
Providing certification training since the year 2000, Whizlabs is the pioneer among online training providers across the globe. We are dedicated to helping you learn the skills you need to transform your career in the IT industry.
We provide certification training in the form of Video Courses, Practice Tests, Hands-on Labs and Sandbox in various disciplines such as Cloud Computing, DevOps, Cyber Security, Java, Big Data, Snowflake, CompTIA, Agile, Linux, CCNA, Blockchain, and much more.
When will I have access to the lectures and assignments?
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I subscribe to this Specialization?
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Is financial aid available?
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.