In this Machine Learning in Production course, you will build intuition about designing a production ML system end-to-end: project scoping, data needs, modeling strategies, and deployment patterns and technologies. You will learn strategies for addressing common challenges in production like establishing a model baseline, addressing concept drift, and performing error analysis. You’ll follow a framework for developing, deploying, and continuously improving a productionized ML application.
Understanding machine learning and deep learning concepts is essential, but if you’re looking to build an effective AI career, you need experience preparing your projects for deployment as well. Machine learning engineering for production combines the foundational concepts of machine learning with the skills and best practices of modern software development necessary to successfully deploy and maintain ML systems in real-world environments.
Week 1: Overview of the ML Lifecycle and Deployment
Week 2: Modeling Challenges and Strategies
Week 3: Data Definition and Baseline
This week covers a quick introduction to machine learning production systems focusing on their requirements and challenges. Next, the week focuses on deploying production systems and what is needed to do so robustly while facing constantly changing data.
Join the DeepLearning.AI Forum to ask questions, get support, or share amazing ideas!•10 minutes
Week 1 Optional References•3 minutes
Lecture Notes Week 1•1 minute
2 assignments•Total 20 minutes
The Machine Learning Project Lifecycle•10 minutes
Deployment•10 minutes
1 app item•Total 1 minute
Intake Survey•1 minute
2 ungraded labs•Total 90 minutes
Deploying a Deep Learning model•30 minutes
Deploying a deep learning model with Docker and a cloud service (optional)•60 minutes
Week 2: Modeling Challenges and Strategies
Week 2•3 hours to complete
Module details
This week is about model strategies and key challenges in model development. It covers error analysis and strategies to work with different data types. It also addresses how to cope with class imbalance and highly skewed data sets.
What's included
16 videos2 readings2 assignments1 ungraded lab
Show info about module content
16 videos•Total 107 minutes
Modeling overview•3 minutes
Key challenges•5 minutes
Why low average error isn't good enough•11 minutes
Establish a baseline•8 minutes
Tips for getting started•6 minutes
Error analysis example•8 minutes
Prioritizing what to work on•6 minutes
Skewed datasets•12 minutes
Performance auditing•8 minutes
Data-centric AI development•3 minutes
A useful picture of data augmentation•6 minutes
Data augmentation•9 minutes
Can adding data hurt?•6 minutes
Adding features•9 minutes
Experiment tracking•5 minutes
From big data to good data•4 minutes
2 readings•Total 4 minutes
Week 2 Optional References•3 minutes
Lecture Notes Week 2•1 minute
2 assignments•Total 20 minutes
Selecting and Training a Model•10 minutes
Modeling challenges•10 minutes
1 ungraded lab•Total 60 minutes
A journey through Data•60 minutes
Week 3: Data Definition and Baseline
Week 3•5 hours to complete
Module details
This week is all about working with different data types and ensuring label consistency for classification problems. This leads to establishing a performance baseline for your model and discussing strategies to improve it given your time and resources constraints. This week also includes the final end-to-end project.
What's included
17 videos5 readings2 assignments2 ungraded labs
Show info about module content
17 videos•Total 128 minutes
Why is data definition hard?•4 minutes
More label ambiguity examples•9 minutes
Major types of data problems•11 minutes
Small data and label consistency•8 minutes
Improving label consistency•9 minutes
Human level performance (HLP)•10 minutes
Raising HLP•8 minutes
Obtaining data•12 minutes
Data pipelines•6 minutes
Meta-data, data provenance and lineage•10 minutes
Balanced train/dev/test splits•5 minutes
What is scoping?•3 minutes
Scoping process•7 minutes
Diligence on feasibility and value•14 minutes
Diligence on value•7 minutes
Milestones and resourcing•3 minutes
Final project overview•2 minutes
5 readings•Total 14 minutes
[IMPORTANT] Reminder about end of access to Lab Notebooks•2 minutes
Week 3 Optional References•3 minutes
Lecture Notes Week 3•1 minute
References•5 minutes
Acknowledgments•3 minutes
2 assignments•Total 30 minutes
Scoping (optional)•10 minutes
Data Stage of the ML Production Lifecycle•20 minutes
2 ungraded labs•Total 105 minutes
Data Labeling•45 minutes
The Machine Learning Project Lifecycle•60 minutes
Instructor
Instructor ratings
Instructor ratings
We asked all learners to give feedback on our instructors based on the quality of their teaching style.
DeepLearning.AI is an education technology company that develops a global community of AI talent.
DeepLearning.AI's expert-led educational experiences provide AI practitioners and non-technical professionals with the necessary tools to go all the way from foundational basics to advanced application, empowering them to build an AI-powered future.
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
Jennifer J.
Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
Larry W.
Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
Chaitanya A.
"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."
Learner reviews
4.8
3,358 reviews
5 stars
84.08%
4 stars
12.97%
3 stars
1.90%
2 stars
0.74%
1 star
0.29%
Showing 3 of 3358
E
EW
5·
Reviewed on Nov 15, 2024
I learned many new perspective on how I can build my machine learning product and some pitfalls that could happen. It gives me fundamental on how do I design my product better.
G
GD
4·
Reviewed on Mar 4, 2023
Good refresher if you already work in ML. A bit longish and could have been shortened.I found the code provided useful to remind the use of KerasIn short, solid but not super mandatory
R
RG
5·
Reviewed on Jun 4, 2021
really a great course. It'll really change your way of thinking ML in production use and will help you better understand how can you leverage the power of ML in a way that I'll really create a value
What is machine learning engineering for production? Why is it relevant?
Machine learning engineering for production refers to the tools, techniques, and practical experiences that transform theoretical ML knowledge into a production-ready skillset.
Effectively deploying machine learning models requires competencies more commonly found in technical fields such as software engineering and DevOps. Machine learning engineering for production combines the foundational concepts of machine learning with the functional expertise of modern software development and engineering roles.
Understanding machine learning and deep learning concepts is essential, but if you’re looking to build an effective AI career, you need production engineering capabilities as well. With machine learning engineering for production, you can turn your knowledge of machine learning into production-ready skills.
What is the Machine Learning in Production Course about?
The Machine Learning in Production course covers how to conceptualize integrated systems that continuously operate in production as well as solve common challenges unique to the production environment. In striking contrast with standard machine learning modeling, production systems need to handle evolving data. Moreover, the production system must run non-stop at the minimum cost while producing the maximum performance.
In this Machine Learning in Production course, you will build intuition about designing a production ML system end-to-end: project scoping, data needs, modeling strategies, and deployment patterns and technologies. You will learn strategies for addressing common challenges in production like establishing a model baseline, addressing concept drift, and performing error analysis. You’ll follow a framework for developing, deploying, and continuously improving a productionized ML application.
What will I be able to do after completing the Machine Learning in Production course?
By the end, you will be ready to:
Design an ML production system end-to-end: project scoping, data needs, modeling strategies, and deployment requirements.
Establish a model baseline, address concept drift, and prototype how to develop, deploy, and continuously improve a productionized ML application.
Build data pipelines by gathering, cleaning, and validating datasets.
Implement feature engineering, transformation, and selection with TensorFlow Extended.
Establish data lifecycle by leveraging data lineage and provenance metadata tools and follow data evolution with enterprise data schemas.
Apply techniques to manage modeling resources and best serve offline/online inference requests.
Use analytics to address model fairness, explainability issues, and mitigate bottlenecks.
Deliver deployment pipelines for model serving that require different infrastructures.
Apply best practices and progressive delivery techniques to maintain a continuously operating production system.
What background knowledge is necessary for the Machine Learning in Production course?
Learners should have a working knowledge of AI and deep learning.
Learners should have intermediate Python skills and experience with any deep learning framework (TensorFlow, Keras, or PyTorch).
We highly recommend that you complete the updated Deep Learning Specialization before starting this course.
What will I learn in the Machine Learning in Production course?
Design an ML production system end-to-end: project scoping, data needs, modeling strategies, and deployment requirements.
Establish a model baseline, address concept drift, and prototype how to develop, deploy, and continuously improve a productionized ML application.
Build data pipelines by gathering, cleaning, and validating datasets. Establish data lifecycle by using data lineage and provenance metadata tools.
Apply best practices and progressive delivery techniques to maintain and monitor a continuously operating production system.
Who is the Machine Learning in Production course for?
The Machine Learning in Production course is for early-career machine learning practitioners or software engineers looking to gain practical knowledge of how to formulate a reproducible, traceable, and verifiable machine learning project for production.
How long does it take to complete the Machine Learning in Production course?
At the rate of 5 hours a week, it typically takes 3 weeks to complete this course.
Who is the Machine Learning in Production course by?
The Machine Learning in Production course has been created by Andrew Ng. Andrew Ng is Founder of DeepLearning.AI, General Partner at AI Fund, Chairman and Co-Founder of Coursera, and an Adjunct Professor at Stanford University. As a pioneer in machine learning and online education, Dr. Ng has changed countless lives through his work in AI, authoring or co-authoring over 100 research papers in machine learning, robotics, and related fields. Previously, he was chief scientist at Baidu, the founding lead of the Google Brain team, and the co-founder of Coursera – the world’s largest MOOC platform.
Is this a standalone course or a Specialization?
The course is a standalone course.
How do I get a receipt to get this reimbursed by my employer?
Go to your Coursera account.
Click on My Purchases and find the relevant course or Specialization.
Click Email Receipt and wait up to 24 hours to receive the receipt.
I want to purchase this course for my employees. How can I do that?
Visit coursera.org/business for more information, to pick up a plan, and to contact Coursera. For each plan, you decide the number of courses every member can enroll in and the collection of courses they can choose from.
Will I earn university credit for completing the Specialization?
No.
Will I receive a certificate at the end of the Specialization?
You will receive a certificate at the end of the each course if you pay for the course and complete the assignments. There is a limit of 180 days of certificate eligibility, after which you must re-purchase the course to obtain a certificate. If you audit the course for free, you will not receive a certificate.
When will I have access to the lectures and assignments?
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I subscribe to this Specialization?
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Is financial aid available?
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.