Edureka

Evaluating and Scaling LLMs

Edureka

Evaluating and Scaling LLMs

Edureka

Instructor: Edureka

Included with Coursera PlusLearn more

Gain insight into a topic and learn the fundamentals.
Intermediate level

Recommended experience

1 week to complete
at 10 hours a week
Flexible schedule
Learn at your own pace
Gain insight into a topic and learn the fundamentals.
Intermediate level

Recommended experience

1 week to complete
at 10 hours a week
Flexible schedule
Learn at your own pace

What you'll learn

  • Evaluate and improve RAG pipelines using ranking metrics, RAGAS, and hybrid search.

  • Fine-tune open-source LLMs with LoRA, QLoRA, and adapters on Hugging Face.

  • Deploy GenAI APIs with FastAPI and Docker using caching, retries, and fallbacks.

  • Monitor LLM systems with guardrails, red-teaming, tracing, and drift detection.

Details to know

Shareable certificate

Add to your LinkedIn profile

Recently updated!

September 2026

Assessments

10 assignments

Taught in English

See how employees at top companies are mastering in-demand skills

 logos of Petrobras, TATA, Danone, Capgemini, P&G and L'Oreal

Build your subject-matter expertise

This course is part of the Large Language Models for Developers Specialization
When you enroll in this course, you'll also be enrolled in this Specialization.
  • Learn new concepts from industry experts
  • Gain a foundational understanding of a subject or tool
  • Develop job-relevant skills with hands-on projects
  • Earn a shareable career certificate

There are 6 modules in this course

Analyze the limitations of basic RAG by examining re-ranking, query transformations, hybrid search, and advanced retrievers. Develop foundational skills by implementing cross-encoder re-ranking, query rewriting, HyDE, hybrid search, and parent-document and self-querying retrievers. Build practical capabilities by measuring retrieval quality and generation faithfulness with ranking metrics and RAGAS, and by improving weak RAG pipelines.

What's included

17 videos5 readings2 assignments

Evaluate when to use prompting, RAG, or fine-tuning by examining model selection trade-offs in cost, latency, and quality. Develop foundational skills by benchmarking candidate models and preparing instruction-tuning datasets. Build practical capabilities by fine-tuning models with LoRA, QLoRA, and adapters on Hugging Face and comparing quality before and after fine-tuning.

What's included

11 videos7 readings2 assignments

Analyze how multimodal LLMs process and combine text, image, and audio inputs. Develop foundational skills by generating image captions and answering questions over images with vision-language models. Build practical capabilities by integrating speech-to-text and text-to-speech into generative AI applications.

What's included

5 videos4 readings1 assignment

Analyze reliability patterns for GenAI services by examining caching, retries, provider fallbacks, and observability. Develop foundational skills by building a GenAI API with FastAPI and containerizing it with Docker. Build practical capabilities by deploying containerized GenAI applications to the cloud.

What's included

4 videos3 readings2 assignments

Evaluate LLMOps practices by examining how versioning, experiment tracking, guardrails, and red-teaming keep GenAI systems safe in production. Develop foundational skills by versioning prompts and outputs and tracking experiments. Build practical capabilities by implementing guardrails and red-teaming applications for toxicity and hallucination.

What's included

4 videos1 reading1 assignment

Evaluate the production readiness of GenAI systems by examining tracing, monitoring, and drift detection. Develop foundational skills by tracing and monitoring deployed applications and detecting model and data drift. Build practical capabilities by designing a deployed, guarded, and monitored end-to-end GenAI application that integrates retrieval, fine-tuning, and LLMOps practices.

What's included

5 videos2 assignments

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.

Instructor

Edureka
Edureka
262 Courses230,753 learners

Offered by

Edureka

Explore more from Machine Learning

Why people choose Coursera for their career

Felipe M.

Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."

Jennifer J.

Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."

Larry W.

Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Frequently asked questions