About this Course
109,665 recent views

Learner Career Outcomes

45%

started a new career after completing these courses

42%

got a tangible career benefit from this course

18%

got a pay increase or promotion

100% online

Start instantly and learn at your own schedule.

Flexible deadlines

Reset deadlines in accordance to your schedule.

Approx. 35 hours to complete

Suggested: 6 weeks of study, 5-8 hours/week...

English

Subtitles: English, Korean, Arabic

Skills you will gain

Linear RegressionRidge RegressionLasso (Statistics)Regression Analysis

Learner Career Outcomes

45%

started a new career after completing these courses

42%

got a tangible career benefit from this course

18%

got a pay increase or promotion

100% online

Start instantly and learn at your own schedule.

Flexible deadlines

Reset deadlines in accordance to your schedule.

Approx. 35 hours to complete

Suggested: 6 weeks of study, 5-8 hours/week...

English

Subtitles: English, Korean, Arabic

Syllabus - What you will learn from this course

Week
1
1 hour to complete

Welcome

5 videos (Total 20 min), 3 readings
5 videos
What is the course about?3m
Outlining the first half of the course5m
Outlining the second half of the course5m
Assumed background4m
3 readings
Important Update regarding the Machine Learning Specialization10m
Slides presented in this module10m
Reading: Software tools you'll need10m
3 hours to complete

Simple Linear Regression

25 videos (Total 122 min), 5 readings, 2 quizzes
25 videos
Regression fundamentals: data & model8m
Regression fundamentals: the task2m
Regression ML block diagram4m
The simple linear regression model2m
The cost of using a given line6m
Using the fitted line6m
Interpreting the fitted line6m
Defining our least squares optimization objective3m
Finding maxima or minima analytically7m
Maximizing a 1d function: a worked example2m
Finding the max via hill climbing6m
Finding the min via hill descent3m
Choosing stepsize and convergence criteria6m
Gradients: derivatives in multiple dimensions5m
Gradient descent: multidimensional hill descent6m
Computing the gradient of RSS7m
Approach 1: closed-form solution5m
Approach 2: gradient descent7m
Comparing the approaches1m
Influence of high leverage points: exploring the data4m
Influence of high leverage points: removing Center City7m
Influence of high leverage points: removing high-end towns3m
Asymmetric cost functions3m
A brief recap1m
5 readings
Slides presented in this module10m
Optional reading: worked-out example for closed-form solution10m
Optional reading: worked-out example for gradient descent10m
Download notebooks to follow along10m
Fitting a simple linear regression model on housing data10m
2 practice exercises
Simple Linear Regression14m
Fitting a simple linear regression model on housing data8m
Week
2
3 hours to complete

Multiple Regression

19 videos (Total 87 min), 5 readings, 3 quizzes
19 videos
Polynomial regression3m
Modeling seasonality8m
Where we see seasonality3m
Regression with general features of 1 input2m
Motivating the use of multiple inputs4m
Defining notation3m
Regression with features of multiple inputs3m
Interpreting the multiple regression fit7m
Rewriting the single observation model in vector notation6m
Rewriting the model for all observations in matrix notation4m
Computing the cost of a D-dimensional curve9m
Computing the gradient of RSS3m
Approach 1: closed-form solution3m
Discussing the closed-form solution4m
Approach 2: gradient descent2m
Feature-by-feature update9m
Algorithmic summary of gradient descent approach4m
A brief recap1m
5 readings
Slides presented in this module10m
Optional reading: review of matrix algebra10m
Exploring different multiple regression models for house price prediction10m
Numpy tutorial10m
Implementing gradient descent for multiple regression10m
3 practice exercises
Multiple Regression18m
Exploring different multiple regression models for house price prediction16m
Implementing gradient descent for multiple regression10m
Week
3
2 hours to complete

Assessing Performance

14 videos (Total 93 min), 2 readings, 2 quizzes
14 videos
What do we mean by "loss"?4m
Training error: assessing loss on the training set7m
Generalization error: what we really want8m
Test error: what we can actually compute4m
Defining overfitting2m
Training/test split1m
Irreducible error and bias6m
Variance and the bias-variance tradeoff6m
Error vs. amount of data6m
Formally defining the 3 sources of error14m
Formally deriving why 3 sources of error20m
Training/validation/test split for model selection, fitting, and assessment7m
A brief recap1m
2 readings
Slides presented in this module10m
Polynomial Regression10m
2 practice exercises
Assessing Performance26m
Exploring the bias-variance tradeoff8m
Week
4
3 hours to complete

Ridge Regression

16 videos (Total 85 min), 5 readings, 3 quizzes
16 videos
Overfitting demo7m
Overfitting for more general multiple regression models3m
Balancing fit and magnitude of coefficients7m
The resulting ridge objective and its extreme solutions5m
How ridge regression balances bias and variance1m
Ridge regression demo9m
The ridge coefficient path4m
Computing the gradient of the ridge objective5m
Approach 1: closed-form solution6m
Discussing the closed-form solution5m
Approach 2: gradient descent9m
Selecting tuning parameters via cross validation3m
K-fold cross validation5m
How to handle the intercept6m
A brief recap1m
5 readings
Slides presented in this module10m
Download the notebook and follow along10m
Download the notebook and follow along10m
Observing effects of L2 penalty in polynomial regression10m
Implementing ridge regression via gradient descent10m
3 practice exercises
Ridge Regression18m
Observing effects of L2 penalty in polynomial regression14m
Implementing ridge regression via gradient descent16m
4.8
838 ReviewsChevron Right

Top reviews from Machine Learning: Regression

By PDMar 17th 2016

I really enjoyed all the concepts and implementations I did along this course....except during the Lasso module. I found this module harder than the others but very interesting as well. Great course!

By CMJan 27th 2016

I really like the top-down approach of this specialization. The iPython code assignments are very well structured. They are presented in a step-by-step manner while still being challenging and fun!

Instructors

Avatar

Emily Fox

Amazon Professor of Machine Learning
Statistics
Avatar

Carlos Guestrin

Amazon Professor of Machine Learning
Computer Science and Engineering

About University of Washington

Founded in 1861, the University of Washington is one of the oldest state-supported institutions of higher education on the West Coast and is one of the preeminent research universities in the world....

About the Machine Learning Specialization

This Specialization from leading researchers at the University of Washington introduces you to the exciting, high-demand field of Machine Learning. Through a series of practical case studies, you will gain applied experience in major areas of Machine Learning including Prediction, Classification, Clustering, and Information Retrieval. You will learn to analyze large and complex datasets, create systems that adapt and improve over time, and build intelligent applications that can make predictions from data....
Machine Learning

Frequently Asked Questions

  • Once you enroll for a Certificate, you’ll have access to all videos, quizzes, and programming assignments (if applicable). Peer review assignments can only be submitted and reviewed once your session has begun. If you choose to explore the course without purchasing, you may not be able to access certain assignments.

  • When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile. If you only want to read and view the course content, you can audit the course for free.

More questions? Visit the Learner Help Center.