Duke University
Beginning Llamafile for Local Large Language Models (LLMs)
Duke University

Beginning Llamafile for Local Large Language Models (LLMs)

Taught in English

Course

Gain insight into a topic and learn the fundamentals

Noah Gift
Alfredo Deza

Instructors: Noah Gift

Beginner level

Recommended experience

3 hours to complete
3 weeks at 1 hour a week
Flexible schedule
Learn at your own pace

What you'll learn

  • Learn how to serve large language models as production-ready web APIs using the llama.cpp framework

  • Understand the architecture and capabilities of the llama.cpp example server for text generation, tokenization, and embedding extraction

  • Gain hands-on experience in configuring and customizing the server using command line options and API parameters

Details to know

Shareable certificate

Add to your LinkedIn profile

Recently updated!

April 2024

Assessments

4 assignments

See how employees at top companies are mastering in-demand skills

Placeholder
Placeholder

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV

Share it on social media and in your performance review

Placeholder

There is 1 module in this course

This week, you run language models locally. Keep data private. Avoid latency and fees. Use Mixtral model and llamafile.

What's included

8 videos17 readings4 assignments1 discussion prompt4 ungraded labs

Instructors

Noah Gift
Duke University
40 Courses118,757 learners

Offered by

Duke University

Recommended if you're interested in Software Development

Why people choose Coursera for their career

Felipe M.
Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
Jennifer J.
Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
Larry W.
Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
Chaitanya A.
"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

New to Software Development? Start here.

Placeholder

Open new doors with Coursera Plus

Unlimited access to 7,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription

Advance your career with an online degree

Earn a degree from world-class universities - 100% online

Join over 3,400 global companies that choose Coursera for Business

Upskill your employees to excel in the digital economy

Frequently asked questions