Machine Learning Operations with Vertex AI: Model Evaluation

Machine Learning Operations with Vertex AI: Model Evaluation

Instructor: Google Cloud Training

Access provided by Xavier School of Management, XLRI

4 modules

Gain insight into a topic and learn the fundamentals.

Intermediate level

Some related experience required

2 hours to complete

Flexible schedule

Learn at your own pace

4 modules

Gain insight into a topic and learn the fundamentals.

Intermediate level

Some related experience required

2 hours to complete

Flexible schedule

Learn at your own pace

What you'll learn

Understand the nuances of model evaluation in both predictive and generative AI, recognizing its crucial role within the MLOps lifecycle.
Identify and apply appropriate evaluation metrics for different generative AI tasks.
Efficiently evaluate generative AI with Vertex AI's diverse evaluation services, including both computation-based and model-based methods.
Implement best practices for LLM evaluation, to ensure robust and reliable model deployment in production environments.

Skills you'll gain

Tools you'll learn

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

2 assignments

Taught in English

See how employees at top companies are mastering in-demand skills

Learn more about Coursera for Business

logos of Petrobras, TATA, Danone, Capgemini, P&G and L'Oreal

There are 4 modules in this course

This course equips machine learning practitioners with the essential tools, techniques, and best practices for evaluating both generative and predictive AI models. Model evaluation is a critical discipline for ensuring that ML systems deliver reliable, accurate, and high-performing results in production.

Participants will gain a deep understanding of various evaluation metrics, methodologies, and their appropriate application across different model types and tasks. The course will emphasize the unique challenges posed by generative AI models and provide strategies for tackling them effectively. By leveraging Google Cloud's Vertex AI platform, participants will learn how to implement robust evaluation processes for model selection, optimization, and continuous monitoring.

This module covers the course objectives and provides an overview of the course structure.

What's included

1 video

This module introduces model evaluation challenges and solution offerings by Vertex AI.

What's included

3 videos1 reading1 assignment

This module describes challenges of evaluating the Generative AI tasks and best practices to overcome these challenges. The module also covers the different types of model evaluation services available in Vertex AI and then introduces Vertex AI Automatic Metrics, Automatic Side by Side and Safety Bias evaluation services.