By 2025, 80% of enterprises will integrate GenAI into production workflows, yet only 15% feel confident deploying reliable RAG systems. This Short Course was created to help Machine Learning and Artificial Intelligence professionals build, optimize, and evaluate production-grade GenAI applications on the Databricks platform. By completing this course, you'll be able to construct vector search pipelines from raw data, fine-tune models with MLflow tracking, and implement rigorous evaluation frameworks that ensure your GenAI systems meet real-world SLA requirements—skills you can apply immediately to customer-facing AI deployments.
By the end of this course, you will be able to:
• Apply Databricks Lakehouse and vector search features to build a retrieval-augmented generation pipeline from raw data to queryable embeddings
• Analyze fine-tuning experiment results in MLflow to select adapter parameters that balance output quality and latency constraints
• Evaluate GenAI model responses for relevance, hallucination rate, cost, and latency, iterating prompt and context configurations to meet acceptance criteria
This course is unique because it combines hands-on Databricks Lakehouse workflows with MLflow experiment tracking and production-grade evaluation metrics, bridging the gap between GenAI prototypes and enterprise deployments. To be successful in this course, you should have working knowledge of Python programming, basic machine learning concepts, and familiarity with cloud data platforms at the CB2 intermediate level.
Learners apply Databricks Lakehouse and vector search features to construct a retrieval-augmented generation pipeline from raw customer support documents to queryable embeddings.
What's included
3 videos1 reading2 assignments
Show info about module content
3 videos•Total 15 minutes
When RAG Goes Wrong: The Cost of Static LLMs•3 minutes
Lakehouse Architecture and Vector Search Fundamentals•5 minutes
Building a Vector Search Index in Databricks•7 minutes
1 reading•Total 10 minutes
RAG Pipeline Components: From Documents to Queryable Embeddings•10 minutes
2 assignments•Total 21 minutes
Design a RAG Pipeline Architecture for a Customer Support Use Case•15 minutes
Knowledge Check: Building a RAG Pipeline on Databricks•6 minutes
Module 2: Optimizing Fine-Tuning Experiments with MLflow
Module 2•1 hour to complete
Module details
Learners analyze fine-tuning experiment results in MLflow to select adapter parameters that balance output quality and latency constraints for production GenAI deployments.
What's included
2 videos2 readings1 assignment
Show info about module content
2 videos•Total 11 minutes
Interpreting Experiment Results: Selecting the Right Adapter Parameters•6 minutes
Comparing MLflow Experiment Runs for Fine-Tuning Decisions•5 minutes
2 readings•Total 20 minutes
MLflow Experiment Tracking for Fine-Tuning: Concepts and Metrics•10 minutes
Evaluating Fine-Tuning Configurations: A Guided Analysis Framework•10 minutes
1 assignment•Total 6 minutes
Knowledge Check: Optimizing Fine-Tuning Experiments with MLflow•6 minutes
Module 3: Evaluating GenAI Responses for Production Readiness
Module 3•1 hour to complete
Module details
Learners evaluate GenAI model responses across relevance, hallucination rate, cost, and latency metrics, iterating prompt and context configurations to meet enterprise acceptance criteria for production deployment.
What's included
3 videos1 reading3 assignments
Show info about module content
3 videos•Total 14 minutes
The Evaluation Gap: Why GenAI Systems Fail in Production•3 minutes
Iterating Prompt and Context Configurations for SLA Compliance•6 minutes
Running GenAI Evaluations in Databricks with MLflow•5 minutes
1 reading•Total 10 minutes
GenAI Evaluation Metrics: Relevance, Hallucination, Cost, and Latency•10 minutes
3 assignments•Total 51 minutes
Build an Evaluation Report for a GenAI Deployment Scenario•15 minutes
Knowledge Check: Evaluating GenAI Responses for Production Readiness•6 minutes
Course Assessment: Build GenAI Apps on Databricks•30 minutes
Coursera brings together a diverse network of subject matter experts who have demonstrated their expertise through professional industry experience or strong academic backgrounds. These instructors design and teach courses that make practical, career-relevant skills accessible to learners worldwide.
When will I have access to the lectures and assignments?
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I purchase the Certificate?
When you purchase a Certificate you get access to all course materials, including graded assignments. Upon completing the course, your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Is financial aid available?
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.