DeepLearning.AI

Efficiently Serving LLMs

Travis Addair

Instructor: Travis Addair

Project

Build in-demand job skills with step-by-step instructions

Intermediate level

Recommended experience

1 hour
Learn at your own pace
No downloads or installation required
Only available on desktop
Hands-on learning

What you'll learn

  • Learn how Large Language Models (LLMs) repeatedly predict the next token, and how techniques like KV caching can greatly speed up text generation.

  • Code for efficient LLM app serving, balancing model output speed and serving many users at once.

  • Explore the fundamentals of Low Rank Adapters and see how Predibase builds their framework inference server to serve fine-tuned models at once.

Skills you'll practice

Details to know

Taught in English
Recently updated!

June 2024

Project

Build in-demand job skills with step-by-step instructions

Intermediate level

Recommended experience

1 hour
Learn at your own pace
No downloads or installation required
Only available on desktop
Hands-on learning

See how employees at top companies are mastering in-demand skills

Placeholder

Learn, practice, and apply job-ready skills in less than 2 hours

  • Receive training from industry experts
  • Gain hands-on experience solving real-world job tasks
Placeholder

About this project

Instructor

Travis Addair
DeepLearning.AI
1 Course63 learners

Offered by

DeepLearning.AI

How you'll learn

  • Hands-on, project-based learning

    Practice new skills by completing job-related tasks with step-by-step instructions.

  • No downloads or installation required

    Access the tools and resources you need in a cloud environment.

  • Available only on desktop

    This project is designed for laptops or desktop computers with a reliable Internet connection, not mobile devices.

Why people choose Coursera for their career

Felipe M.
Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
Jennifer J.
Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
Larry W.
Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
Chaitanya A.
"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

New to Algorithms? Start here.

Placeholder

Open new doors with Coursera Plus

Unlimited access to 7,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription

Advance your career with an online degree

Earn a degree from world-class universities - 100% online

Join over 3,400 global companies that choose Coursera for Business

Upskill your employees to excel in the digital economy

Frequently asked questions