When you enroll in this course, you'll also be enrolled in this Specialization.
Learn new concepts from industry experts
Gain a foundational understanding of a subject or tool
Develop job-relevant skills with hands-on projects
Earn a shareable career certificate
There are 6 modules in this course
Welcome to the Advanced Linear Models for Data Science Class 1: Least Squares. This class is an introduction to least squares from a linear algebraic and mathematical perspective. Before beginning the class make sure that you have the following:
- A basic understanding of linear algebra and multivariate calculus.
- A basic understanding of statistics and regression models.
- At least a little familiarity with proof based mathematics.
- Basic knowledge of the R programming language.
After taking this course, students will have a firm foundation in a linear algebraic treatment of regression modeling. This will greatly augment applied data scientists' general understanding of regression models.
We cover some basic matrix algebra results that we will need throughout the class. This includes some basic vector derivatives. In addition, we cover some some basic uses of matrices to create summary statistics from data. This includes calculating and subtracting means from observations (centering) as well as calculating the variance.
What's included
7 videos4 readings1 assignment
Show info about module content
7 videos•Total 28 minutes
Introduction•3 minutes
Matrix derivatives•5 minutes
Coding example•2 minutes
Centering by matrix multiplication•7 minutes
Coding example•2 minutes
Variance via matrix multiplication•7 minutes
Coding example•2 minutes
4 readings•Total 40 minutes
Welcome to the class•10 minutes
Course textbook•10 minutes
Grading•10 minutes
In this module•10 minutes
1 assignment•Total 30 minutes
Background Quiz•30 minutes
One and two parameter regression
Module 2•1 hour to complete
Module details
In this module, we cover the basics of regression through the origin and linear regression. Regression through the origin is an interesting case, as one can build up all of multivariate regression with it.
What's included
6 videos2 readings1 assignment
Show info about module content
6 videos•Total 29 minutes
Regression through the origin•5 minutes
Centering first•8 minutes
Coding example•2 minutes
Connection with linear regression•8 minutes
Coding example•2 minutes
Fitted values and residuals•5 minutes
2 readings•Total 20 minutes
Before you begin•10 minutes
Before you begin•10 minutes
1 assignment•Total 30 minutes
One Parameter Regression Quiz•30 minutes
Linear regression
Module 3•1 hour to complete
Module details
In this lecture, we focus on linear regression, the most standard technique for investigating unconfounded linear relationships.
What's included
8 videos2 readings1 assignment
Show info about module content
8 videos•Total 23 minutes
Least squares•5 minutes
Coding example•1 minute
Prediction•2 minutes
Coding example•2 minutes
Residuals•2 minutes
Coding example•2 minutes
Generalizations•6 minutes
Generalizations example•2 minutes
2 readings•Total 20 minutes
Before you begin•10 minutes
Generalizations•10 minutes
1 assignment•Total 30 minutes
Linear Regression Quiz•30 minutes
General least squares
Module 4•1 hour to complete
Module details
We now move on to general least squares where an arbitrary full rank design matrix is fit to a vector outcome.
What's included
6 videos1 reading1 assignment
Show info about module content
6 videos•Total 39 minutes
Least squares•4 minutes
Coding example•3 minutes
Second derivation of least squares•5 minutes
Projections•10 minutes
Third derivation of least squares•12 minutes
Coding example•5 minutes
1 reading•Total 10 minutes
Before you begin•10 minutes
1 assignment•Total 30 minutes
General Least Squares Quiz•30 minutes
Least squares examples
Module 5•1 hour to complete
Module details
Here we give some canonical examples of linear models to relate them to techniques that you may already be using.
What's included
4 videos1 assignment
Show info about module content
4 videos•Total 44 minutes
Basic examples of design matrices and fits•25 minutes
Group effects•4 minutes
Change of parameterization•5 minutes
ANCOVA•11 minutes
1 assignment•Total 30 minutes
Least Squares Examples Quiz•30 minutes
Bases and residuals
Module 6•2 hours to complete
Module details
Here we give a very useful kind of linear model, that is decomposing a signal into a basis expansion.
What's included
6 videos2 assignments
Show info about module content
6 videos•Total 44 minutes
Bases, introduction•4 minutes
Bases 2, Fourier•5 minutes
Bases 3, SVDs•9 minutes
Bases, coding example•10 minutes
Introduction to residuals•6 minutes
Partitioning variability•10 minutes
2 assignments•Total 60 minutes
Bases Quiz•30 minutes
Residuals Quiz•30 minutes
Earn a career certificate
Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.
Instructor
Instructor ratings
Instructor ratings
We asked all learners to give feedback on our instructors based on the quality of their teaching style.
The mission of The Johns Hopkins University is to educate its students and cultivate their capacity for life-long learning, to foster independent and original research, and to bring the benefits of discovery to the world.
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
Jennifer J.
Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
Larry W.
Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
Chaitanya A.
"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."
Learner reviews
4.5
191 reviews
5 stars
64.06%
4 stars
24.47%
3 stars
7.29%
2 stars
3.12%
1 star
1.04%
Showing 3 of 191
J
JR
4·
Reviewed on Nov 6, 2017
Great, detailed walk-through of least squares. Linear Algebra is a must for this course. To follow the last part requires knowledge of matrix (eigen?)decomposition, which derailed me somewhat.
J
JC
5·
Reviewed on Mar 4, 2018
Very thorough and rigorous. A great review for me.
S
SH
5·
Reviewed on Sep 12, 2020
Excellent experience. I have learnt a lot in different aspect of linear models as well as the coding skills from this course. Thank you.
When will I have access to the lectures and assignments?
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I subscribe to this Specialization?
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Is financial aid available?
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.